Mikhail Prokopenko et al J. Stat. Mech. (2010) P11025 doi:10.1088/1742-5468/2010/11/P11025
Mikhail Prokopenko1,2, Nihat Ay1,3, Oliver Obst2 and Daniel Polani4
Show affiliationsWe critically examine a model that attempts to explain the emergence of power laws (e.g., Zipf's law) in human language. The model is based on the principle of least effort in communications—specifically, the overall effort is balanced between the speaker effort and listener effort, with some trade-off. It has been shown that an information-theoretic interpretation of this principle is sufficiently rich to explain the emergence of Zipf's law in the vicinity of the transition between referentially useless systems (one signal for all referable objects) and indexical reference systems (one signal per object). The phase transition is defined in the space of communication accuracy (information content) expressed in terms of the trade-off parameter. Our study explicitly solves the continuous optimization problem, subsuming a recent, more specific result obtained within a discrete space. The obtained results contrast Zipf's law found by heuristic search (that attained only local minima) in the vicinity of the transition between referentially useless systems and indexical reference systems, with an inverse-factorial (sub-logarithmic) law found at the transition that corresponds to global minima. The inverse-factorial law is observed to be the most representative frequency distribution among optimal solutions.
84.40.Ua Telecommunications: signal transmission and processing; communication satellites
94A12 Signal theory (characterization, reconstruction, etc.)
Issue 11 (November 2010)
Received 14 July 2010, accepted for publication 21 October 2010
Published 15 November 2010
Mikhail Prokopenko et al J. Stat. Mech. (2010) P11025
D Villamaina et al J. Stat. Mech. (2009) P07024
Dylan Walker et al J. Stat. Mech. (2007) P06010
Federico Corberi et al J. Stat. Mech. (2007) P07002
A P Georgopoulos et al 2010 J. Neural Eng. 7 016011
Sridhar Sunderam et al 2009 J. Neural Eng. 6 046009
Jennie B Leach et al 2007 J. Neural Eng. 4 26
Aaron Gilletti and Jit Muthuswamy 2006 J. Neural Eng. 3 189
Dan Zhang et al 2010 J. Neural Eng. 7 016010
Stepan Y Kruglikov et al 2008 J. Neural Eng. 5 133