- Physical Review Journals
All JournalsPhysics Magazine
Access Provided by Xinjiang University

Reviews of Modern Physics

Export citation

Export citation

Choose format for download:

Download Citation
  • Access by Xinjiang University

General properties of entropy

Alfred Wehrl*

Alfred Wehrl*

  • Institute for Theoretical Physics, University of Vienna, Vienna, Austria

  • *Work supported in part by "Fonds zur Förderung der wissenschaftlichen Forschung in Österreich," Projekt Nr. 3016.
PDF

Rev. Mod. Phys. 50, 221 – Published 1 April, 1978

DOI: https://doi.org/10.1103/RevModPhys.50.221

Abstract

It is rather paradoxical that, although entropy is one of the most important quantities in physics, its main properties are rarely listed in the usual textbooks on statistical mechanics. In this paper we try to fill this gap by discussing these properties, as, for instance, invariance, additivity, concavity, subadditivity, strong subadditivity, continuity, etc., in detail, with reference to their implications in statistical mechanics. In addition, we consider related concepts such as relative entropy, skew entropy, dynamical entropy, etc. Taking into account that statistical mechanics deals with large, essentially infinite systems, we finally will get a glimpse of systems with infinitely many degrees of freedom.

View figure in article

References (193)

  1. Aczel, J., and Z. Daroczy, 1963, C. R. Acad. Sci. Paris 257, 1581
  2. Aczel, J., 1974, On Measures of Information and Their Characterizations (Academic, New York)
  3. Aczel, J., B. Forte, and C. T. Ng, 1974, Adv. Appl. Prob. 6, 131
  4. Alberti, P., 1973, thesis, Leipzig
  5. Alberti, P., 1977, to be published in Wiss. Z. Karl-Marx-Univ., Leipzig
  6. dell'Antonio, G. F., 1967, Commun. Pure Appl. Math. 20, 413
  7. Araki, H., 1975, preprint RIMS 190, Kyoto
  8. Araki, H., and E. Lieb, 1970, Commun. Math. Phys 18, 160
  9. Araki, H., and G. L. Sewell, 1977, Commun. Math. Phys. 52, 103
  10. Arnold, V., and A. Avez, 1969, Ergodic Problems of Classical Mechanics (Benjamin, New York)
  11. Baumann, F., and R. Jost, 1969, in The Problems of Theoretical Physics: Essays Devoted to N. N. Bogoliubov (Nauka, Moscow)
  12. Baumann, F., 1971, Helv. Phys. Acta 44, 95
  13. Bayer, W., and W. Ochs, 1973, Z. Naturforsch. A 28a, 693
  14. Berezin, F., 1972a, Izv. Akad. Nauk SSSR Ser. Mat. 36, 5
  15. Berezin, F., 1972b, Mat. Sb. Nov. Ser. 86 (128), 4 (12) ibid.88, (130) ibid.882 (6)
  16. Billingsley, P., 1965, Ergodic Theory and Information (Wiley, New York)
  17. Birkhoff, G. D., Proc. Natl. Acad. Sci. USA 17, 656
  18. Blau, J. M., 1959, Prog. Theor. Phys. 22, 745
  19. Boltzmann, L., 1872, Wiener Ber. 66, 275
  20. Boltzmann, L., 1877a, Wiener Ber. 75, 67
  21. Boltzmann, L., 1877b, Wiener Ber. 76, 373
  22. Boltzmann, L., 1896, Vorlesungen über Gastheorie (Barth, Leipzig)
  23. Brillouin, L., 1962, Science and Information Theory (Academic, New York)
  24. Brush, S., 1965, 1966, Kinetic Theory I, II (Pergamon, Oxford)
  25. Burbury, S., 1890, Philos. Mag. 30, 301
  26. Carnot, S., 1824, Reflexions sur la puissance matrice du feu (Bachelier, Paris)
  27. Clausius, R., 1850, Über die bewegende Kraft der Wärme (Ostwalds Klassiker, Leipzig, 1898)
  28. Clausius, R., 1865, Ann. Phys. 125, 353
  29. Clausius, R.Cohen, E. G. D., and W. Thirring, eds., 1972, The Boltzmann Equation (Springer, Vienna)
  30. Connes, A., and E. Størmer, 1975, Acta Math. 134, 289
  31. Daroczy, Z., 1970, Inf. Control 16, 36
  32. Davies, E., 1972, Commun. Math. Phys. 27, 309
  33. Davies, E., 1976, Quantum Theory of Open Systems (Academic, London)
  34. Dixmier, J., 1957 (1969), Les algèbres d' opérateurs dans l'espace Hilbertien (Gauthier-Villars, Paris)
  35. Dixmier, J., 1964, Les C*algèbres et leurs représentations (Gauthiers-Villars, Paris)
  36. Doplicher, S., D. Kastler, R. Kadison, and D. Robinson, 1967, Commun. Math. Phys. 6, 101
  37. Doplicher, S., D. Kastler, and D. Robinson, 1966, Commun. Math. Phys. 3, 1
  38. Dyson, F. J., 1967, J. Math. Phys. 8, 1538
  39. Dyson, F. J., and A. Lenard, 1967, J. Math. Phys. 8, 423
  40. Eckmann, J. P., and M. Guenin, 1969, Méthodes algebriques dans la mécanique statistique (Springer, Berlin)
  41. Ehrenfest, P. and T., 1911, Encyclopädie der math. Wiss. 4, Article 32
  42. Einstein, A., 1914, Verh. Dtsch. Phys. Ges. 12, 820
  43. Emch, G., 1972, Algebraic Methods in Statistical Mechanics and Quantum Field Theory (Wiley, New York)
  44. Emch, G., 1976a, Acta Phys. Austriaca, Suppl. XV, 79
  45. Emch, G., 1976b, Commun. Math. Phys. 49, 191
  46. Epstein, H., 1973, Commun. Math. Phys. 31, 317
  47. Erdös, P., 1946, Ann. Math. 47, 1
  48. Fano, U., 1957, Rev. Mod. Phys. 29, 74
  49. Feller, W., 1950, An Introduction to Probability Theory and Its Applications (Wiley-Chapman, New York)
  50. Fierz, M., 1966, Helv. Phys. Acta 28, 705
  51. Fisher, M. E., 1964, Arch. Ration. Mech. Anal. 17, 377
  52. Fréchet, M., 1938, Méthode des fonctions arbitraires, théorie des évenements en chaîne dans le cas d'un nombre fini d'états possibles (Dunod, Paris)
  53. Gibbs, J. W., 1902, Elementary Principles in Statistical Mechanics (Yale University, New Haven, Conn.)
  54. Glasman, I. M., and Y. I. Gubich, 1969, Finite-dimensional Linear Analysis, in Russian (Gostekhisdat, Moscow)
  55. Golden, S., 1965, Phys. Rev. B 137, 1127
  56. Gorini, V., A. Kossakowski, and E. C. G. Sudarshan, 1976, J. Math. Phys. 17, 821
  57. Gorini, V., A. Frigerio, A. Kossakowski, E. C. G. Sudarshan, and M. Verri, 1976, to be published in Rep. Math. Phys
  58. Grabowski, M., 1977, to be published in Rep. Math. Phys
  59. Grad, H., 1958, in Handbook der Physik, Vol. XII: Thermodynamik der Gase, edited by S. Flügge (Springer, Berlin)
  60. Griffiths, R. B., 1965, J. Math. Phys. 6, 1447
  61. Guichardet, A., 1974, Systèmes dynamiques non-commutatifs (Gauthier-Villars, Paris)
  62. Haag, R., N. M. Hugenholtz, and M. Winnink, 1967, Commun. Math. Phys. 5, 215
  63. Haag, R., D. Kastler, and E. Trych-Pohlmeyer, 1974, Commun. Math. Phys. 38, 143
  64. Haag, R., and E. Trych-Pohlmeyer, 1977, to be published in Commun. Math. Phys
  65. Halmos, P. R., 1956, Lectures in Ergodic Theory (Chelsea, New York)
  66. Hardy, G. H., J. E. Littlewood, and G. Polya, 1934 (1967), Inequalities (Cambridge University, Cambridge, England)
  67. von Helmholtz, H., 1854, reprinted in Popular Scientific Lectures, 1962 (Dover, New York)
  68. Hertel, P., H. Narnhofer, and W. Thirring, 1972, Commun. Math. Phys. 28, 159
  69. Hertel, P., and W. Thirring, 1971, Commun. Math. Phys. 24, 22
  70. Hopf, E., 1932, Proc. Natl. Acad. Sci. USA 18, 204
  71. van Hove, L., 1949, Physica 15, 951
  72. van Hove, L., 1950, Physica 16, 137
  73. van Hove, L., 1962, in Fundamental Problems in Statistical Mechanics, edited by E. G. D. Cohen (North-Holland, Amsterdam)
  74. Huang, K., 1963, Statistical Mechanics (Wiley, New York)
  75. Ingarden, R. S., 1965, Fortschr. Phys. 13, 755
  76. Ingarden, R. S., 1973, Acta Phys. Pol. 43, 3
  77. Ingarden, R. S., and K. Urbanik, 1962, Acta Phys. Pol. 21, 281
  78. Jacobs, K., 1960, Neuere Methoden und Ergebnisse der Ergodentheorie (Springer, Berlin)
  79. Jacobs, K., 1963, Lectures on Ergodic Theory (Aarhus University, Aarhus)
  80. Jaynes, E. T., 1957, Phys. Rev. 106, 620
  81. Joule, J. P., 1845, Phil. Mag. 27, 205
  82. van Kampen, N. G., 1962, in Fundamental Problems in Statistical Mechanics, edited by E. G. D. Cohen (North-Holland, Amsterdam)
  83. Katai, S., 1967, Ann. Univ. Sci. Budapest, Eötvös Sect. Math. 12, 81
  84. Klauder, J. R., and E. C. G. Sudarshan, 1968, Fundamentals of Quantum Optics (Benjamin, New York)
  85. Klein, M., 1972, in The Boltzmann Equation, edited by E. G. D. Cohen and W. Thirring (Springer, Vienna)
  86. Koenig, F. O., 1959, in Men and Moments in the History of Science, edited by H. M. Evans (University of Washington, Seattle)
  87. Kolmogorov, A. N., 1953, Dokl. Akad. Nauk SSSR 119, 861
  88. Kolmogorov, A. N., 1959, Dokl. Akad. Nauk SSSR 124, 754
  89. Koopman, B. O., 1931, Proc. Natl. Acad. Sci. USA 17, 315
  90. Kossakowski, A., 1972, Rep. Math. Phys. 3, 247
  91. Köthe, G., 1960, Topologische lineare Räume I (Springer, Berlin)
  92. Kouchnirenko, A. G., 1965, Dokl. Akad. Nauk SSSR 161, 37
  93. Kouchnirenko, A. G., 1967, Funkz. Analys i ego Prilojenija, Moscow, 1, 103
  94. Kraus, K., 1970, Ann. Phys. 64, 311
  95. Kubo, R., 1957, J. Phys. Soc. Japan 12, 570
  96. Ky Fan, 1959, Proc. Natl. Acad. Sci. USA 35, 652
  97. Landau, L. D., and E. M. Lifschitz, 1966, Statistische Physik (Akademie, Berlin)
  98. Lanford, O. E., 1975, in Dynamical Systems, Theory and Applications, edited by J. Moser (Springer, Berlin)
  99. Lanford, O. E., and D. Robinson, 1968, J. Math. Phys. 9, 1120
  100. Lassner, G. and G., 1978, to be published in Rep. Math. Phys
  101. Lebowitz, J., and E. Lieb, 1969, Phys. Rev. Lett. 22, 631
  102. Lebowitz, J., and H. Spohn, 1977, preprint, Yeshiva University
  103. Lenard, A., and F. J. Dyson, 1968, J. Math. Phys. 9, 698
  104. Lewis, M. B., and A. Siegert, 1956, Phys. Rev. 101, 1227
  105. Lieb, E., 1973a, Commun. Math. Phys. 31, 327
  106. Lieb, E., 1973b, Adv. Math. 11, 267
  107. Lieb, E., 1975, Bull. Am. Math. Soc. 81, 1
  108. Lieb, E., 1976, Rev. Mod. Phys. 48, 553
  109. Lieb, E., and J. Lebowitz, 1972, Adv. Math. 9, 316
  110. Lieb, E., and M. B. Ruskai, 1973a, Phys. Rev. Lett. 30, 434
  111. Lieb, E., and M. B. Ruskai, 1973b, J. Math. Phys. 14, 1938
  112. Lieb, E., and W. Thirring, 1975, Phys. Rev. Lett. 35, 687
  113. Lindblad, G., 1973, Commun. Math. Phys. 33, 305
  114. Lindblad, G., 1974, Commun. Math. Phys. 39, 111
  115. Lindblad, G., 1975, Commun. Math. Phys. 40, 147
  116. Lindblad, G., 1976a, Commun. Math. Phys. 48, 119
  117. Lindblad, G., 1976b, Lett. Math. Phys. 1, 219
  118. Lindblad, G., 1977, Preprint, Stockholm
  119. Loschmidt, J., 1876, Wiener Ber. 73, 128
  120. Maison, D., 1971, Commun. Math. Phys. 22, 166
  121. Martin, P. C., and J. Schwinger, 1959, Phys. Rev. 115, 1342
  122. Maxwell, J. C., 1860, Philos. Mag. 19, 19 ibid.20, 21
  123. Maxwell, J. C., 1871, Theory of Heat (Longmans, London)
  124. Mayer, J. E., 1961, J. Chem. Phys. 34, 1207
  125. Mayer, R., 1842, Die Mechanik der Wärme (Ostwalds Klassiker, Leipzig, 1911)
  126. Mead, A., 1977, J. Chem. Phys. 66, 459
  127. von Mises, R., 1931, Wahrscheinlichkeitsrechnung und ihre Anwendung in der Statistik und theoretischen Physik (Deuticke, Leipzig)
  128. Naudts, J., 1969, thesis, Brussels, unpublished
  129. von Neumann, J., 1927, Gött, Nachr. 273
  130. von Neumann, J., 1929, Z. Phys. 57, 30
  131. von Neumann, J., 1932, Proc. Natl. Acad. Sci. USA 18, 710
  132. Ochs, W., 1975, Rep. Math. Phys. 8, 109
  133. Ochs, W., 1976, Rep. Math. Phys. 9, 135
  134. Ochs, W., and W. Bayer, 1973, Z. Naturforsch. A 28a, 1571
  135. Ochs, W., and H. Spohn, 1976, preprint, München
  136. Pauli, W., 1928, in Festschrift zum 60. Geburtstage A. Sommerfelds, edited by P. Debye (Hirzel, Leipzig)
  137. Pauli, W., and M. Fierz, 1937, Z. Phys. 106, 572
  138. Peierls, R., 1936, Proc. Camb. Philos. Soc. 32, 477
  139. Planck, M., 1906, Vorlesungen uber die Theorie der Wärmestrahlung (Barth, Leipzig)
  140. Poincaré, H., 1890, Acta Math. 13, 1
  141. Polya, G., and G. Szegö, 1970, Aufgaben und Lehrsätze der Analysis (Springer, Heidelberg)
  142. Prigogine, I., 1972, in The Boltzmann Equation, edited by E. G. D. Cohen and W. Thirring (Springer, Vienna)
  143. Reed, M., and B. Simon, 1972, Methods of Modern Mathematical Physics (Academic, New York)
  144. Reif, F., 1965, Fundamentals of Statistical and Thermal Physics (McGraw-Hill, New York)
  145. Renyi, A., 1965, Rev. Int. Statist. Inst. 33, 1
  146. Renyi, A., 1966, Wahrscheinlichkeitsrechnung (Deutscher Verlag der Wissenschaften, Berlin)
  147. Robertson, A. and W., 1964, Topological Vector Spaces (Cambridge University, Cambridge, England)
  148. Robinson, D. W., 1971, The Thermodynamical Pressure in Quantum Statistical Mechanics (Springer, Berlin)
  149. Robinson, D. W., and D. Ruelle, 1967, Commun. Math. Phys. 5, 288
  150. Roller, D., 1950, The Early Development of the Concepts of Temperature and Heat (Harvard University, Cambridge, Mass.)
  151. Ruch, E., 1975, Theor. Chim. Acta 38, 167
  152. Ruch, E., and A. Mead, 1976, Theor. Chim. Acta 41, 95
  153. Ruelle, D., 1966, Commun. Math. Phys. 3, 133
  154. Ruelle, D., 1969, Statistical Mechanics (Benjamin, New York)
  155. Schlögl, F., 1976, Z. Phys. B 25, 411
  156. Schrödinger, E., 1927, Naturwissenschaften 14, 644
  157. Segal, I. E., 1951, Duke Math. J. 18, 221
  158. Segal, I. E., 1960, J. Math. Mech. 9, 623
  159. Shannon, C., and W. Weaver, 1949, The Mathematical Theory of Communication (University of Illinois, Urbana)
  160. Simon, B., 1973, appendix to Lieb and Ruskai, J. Math. Phys. 1973
  161. Simon, B., private communication
  162. Sinai, Ya. G., 1961, Dokl. Akad. Nauk SSSR 25, 899
  163. Sinai, Ya. G., 1965, Usp. Math. Nauk 20, 232
  164. von Smoluchowski, M., 1914, Vorträge über die kinetische Theorie der Materie und Elektrizität (Teubner, Leipzig)
  165. Spohn, H., private communication
  166. Spohn, H., 1977, preprint
  167. Staszewski, P., 1977, to be published in Rep. Math. Phys
  168. Stinespring, W. F., 1955, Proc. Am. Math. Soc. 6, 211
  169. Szilard, L., 1925, Z. Phys. 32, 777
  170. Takesaki, M., 1970, Tomita's Theory of Modular Hilbert Algebras and Its Applications (Springer, Berlin)
  171. Takesaki, M., 1972, J. Funct. Anal. 9, 306
  172. Thirring, W., 1975, Vorlesungen über mathematische Physik (University of Vienna)
  173. Thompson, C., 1965, J. Math. Phys. 6, 1812
  174. Thomson, W. (Lord Kelvin), 1852, Philos. Mag. 4, 304
  175. Thomson, W. (Lord Kelvin), 1857, Proc. R. Soc. Edinb. 3, 139
  176. Uhlmann, A., 1971, Wiss. Z. Karl-Marx-Univ. Leipzig 20, 633
  177. Uhlmann, A., 1972, Wiss. Z. Karl-Marx-Univ. Leipzig 21, 427
  178. Uhlmann, A., 1973, Wiss. Z. Karl-Marx-Univ. Leipzig 22, 139
  179. Uhlmann, A., 1975, Rep. Math. Phys. 7, 449
  180. Uhlmann, A., 1976, Commun. Math. Phys. 54, 21
  181. Uhlmann, A., 1977, preprint, Leipzig
  182. Umegaki, H., 1954, Tôhoku Math. J. 6, 177
  183. Umegaki, H., 1962, Kodai Math. Sem. Rep. 14, 59
  184. Wehrl, A., 1973, Acta Phys. Austriaca 37, 361
  185. Wehrl, A., 1974, Rep. Math. Phys. 6, 15
  186. Wehrl, A., 1975, Acta Phys. Austriaca 41, 197
  187. Wehrl, A., 1976a, to be published in Rep. Math. Phys
  188. Wehrl, A., 1976b, Lectures at the CIME Summer School in Bressanone
  189. Wehrl, A., 1976c, Rep. Math. Phys. 10, 159
  190. Wehrl, A., 1977, to be published in Rep. Math. Phys
  191. Wigner, E. P., and M. M. Yanase, 1963, Proc. Natl. Acad. Sci. USA 49, 910
  192. Yang, C. N., and T. D. Lee, 1952, Phys. Rev. 87, 404
  193. Zermelo, E., 1896, Ann. Phys. 57, 485 ibid.59, 793

Outline

Information

Rev. Mod. Phys. 50, 221– Published 1 April, 1978

    © 1978 American Physical Society

    Sign In to Your Journals Account

    Filter

    Filter

    Article Lookup

    Enter a citation