Quick search Find article
Quick search
Find article

Phase transitions in least-effort communications

Mikhail Prokopenko1,2, Nihat Ay1,3, Oliver Obst2 and Daniel Polani4

Show affiliations


We critically examine a model that attempts to explain the emergence of power laws (e.g., Zipf's law) in human language. The model is based on the principle of least effort in communications—specifically, the overall effort is balanced between the speaker effort and listener effort, with some trade-off. It has been shown that an information-theoretic interpretation of this principle is sufficiently rich to explain the emergence of Zipf's law in the vicinity of the transition between referentially useless systems (one signal for all referable objects) and indexical reference systems (one signal per object). The phase transition is defined in the space of communication accuracy (information content) expressed in terms of the trade-off parameter. Our study explicitly solves the continuous optimization problem, subsuming a recent, more specific result obtained within a discrete space. The obtained results contrast Zipf's law found by heuristic search (that attained only local minima) in the vicinity of the transition between referentially useless systems and indexical reference systems, with an inverse-factorial (sub-logarithmic) law found at the transition that corresponds to global minima. The inverse-factorial law is observed to be the most representative frequency distribution among optimal solutions.


Keywords

stochastic search

exact results

communication, supply and information networks

PACS

84.40.Ua Telecommunications: signal transmission and processing; communication satellites

89.70.-a Information and communication theory

MSC

94A12 Signal theory (characterization, reconstruction, etc.)

94A17 Measures of information, entropy

94A05 Communication theory (See also 60G35, 90B18)

Subjects

Electronics and devices

Statistical physics and nonlinear systems

Dates

Issue 11 (November 2010)

Received 14 July 2010, accepted for publication 21 October 2010

Published 15 November 2010



View by subject




Export








Please login to access our web services, or create an account if you don't yet have one.

You must have cookies enabled in your web browser to be able to login.

Username
Password

Forgotten your password? Get a new one here.