- Access by Xinjiang University
Emergence of Zipf’s law in the evolution of communication
Phys. Rev. E 83, 036115 – Published 28 March, 2011
DOI: https://doi.org/10.1103/PhysRevE.83.036115
Abstract
Zipf’s law seems to be ubiquitous in human languages and appears to be a universal property of complex communicating systems. Following the early proposal made by Zipf concerning the presence of a tension between the efforts of speaker and hearer in a communication system, we introduce evolution by means of a variational approach to the problem based on Kullback’s Minimum Discrimination of Information Principle. Therefore, using a formalism fully embedded in the framework of information theory, we demonstrate that Zipf’s law is the only expected outcome of an evolving communicative system under a rigorous definition of the communicative tension described by Zipf.
Article Text
References (25)
- F. Auerbach, Patermanns Geographische Mitteilungen 59, 74 (1913).
- G. K. Zipf, The Psycho-Biology of Language (Routledge, London, 1936).
- G. K. Zipf, Human Behavior and the Principle of Least Effort (Addison-Wesley, Reading, 1949).
- P. Bak, C. Tang, and K. Wiesenfeld, Phys. Rev. Lett. 59, 381 (1987).
- X. Gabaix, The Quarterly Journal of Economics 114, 739 (1999).
- M. E. J. Newman, Contemp. Phys. 46, (2005).
- V. Pareto, Cours d’Economie Politique (Droz, Geneva, 1896).
- H. A. Simon, Biometrika 42, 425 (1955).
- W. Li, IEEE Trans. Inf. Theory 38, 1842 (1992).
- P. Harremoës and F. Topsœ, Entropy 3, 191 (2001).
- R. Ferrer-i-Cancho and R. V. Solé, Proc. Natl. Acad. Sci. USA 100, 788 (2003).
- B. Corominas-Murtra and R. V. Solé, Phys. Rev. E 82, 011102 (2010).
- P. Vogt, in I. J. Pollack, M. Bedau, P. Husbands, T. Ikegami, and R. A. WatsonArtificial Life IX Proceedings of the Ninth International Conference on the Simulation and Synthesis of Living Systems, edited by (MIT Press, Cambridge, 2004).
- T. Maillart, D. Sornette, S. Spaeth, and G. von Krogh, Phys. Rev. Lett. 101, 218701 (2008).
- S. N. Dorogovtsev and J. F. F. Mendes, Evolution of Networks (Oxford University Press, New York, 2003).
- E. T. Jaynes, Phys. Rev. 106, 620 (1957).
- S. Kullback, Information Theory and Statistics (John Wiley and Sons, New York, 1959).
- A. R. Plastino, H. G. Miller, and A. Plastino, Phys. Rev. E 56, 3927 (1997).
- J. Hurford, Lingua 77, 187 (1989).
- M. A. Nowak and D. Krakauer, Proc. Nat. Acad. Sci. USA 96, 8028 (1999).
- N. L. Komarova and P. Niyogi, Art. Int. 154, 1 (2004).
- T. M. Cover and J. A. Thomas, Elements of Information Theory (John Wiley and Sons, New York, 1991).
- M. Abramowitz and S. I. (editors), Handbook of Mathematical Functions, Vol. 55 of NBS, Appl. Math. Ser. (US Government Printing office, Washington, D. C., 1965).
- I. Kanter and D. A. Kessler, Phys. Rev. Lett. 74, 4559 (1995).
- D. Avnir, O. Biham, D. Lidar, and O. Malcai, Science 279, 39 (1998).