- Physical Review Journals
All JournalsPhysics Magazine
Access Provided by Xinjiang University

Physical Review E

Export citation

Export citation

Choose format for download:

Download Citation
  • Access by Xinjiang University

Shannon-entropy-based nonequilibrium “entropic” temperature of a general distribution

K. R. Narayanan1 and A. R. Srinivasa2,*

  • 1Department of Electrical Engineering, Texas A&M University, College Station, Texas 77843, USA
  • 2Department of Mechanical Engineering, Texas A&M University, College Station, Texas 77843, USA

  • *asrinivasa@tamu.edu
PDF

Phys. Rev. E 85, 031151 – Published 30 March, 2012

DOI: https://doi.org/10.1103/PhysRevE.85.031151

Abstract

The concept of temperature is one of the key ideas in describing the thermodynamical properties of systems. In classical statistical mechanics of ideal gases, the notion of temperature can be described in at least two different ways: the kinetic temperature (related to the average kinetic energy of the particles) and the thermodynamic temperature (related to the ratio between infinitesimal changes in entropy and energy). For the Boltzmann distribution, the two notions lead to the same result. However, for nonequilibrium phenomena, while the kinetic temperature has been commonly used both for theoretical and simulation purposes, there appears to be no corresponding general definition of thermodynamic or entropic temperature. In this paper, we consider the statistical or Shannon entropy of a system and use the “de Bruijn identity” from information theory (see Appendix A 2 for a derivation of this identity) to show that it is possible to define a “Shannon temperature” or “entropic temperature” T for a nonequilibrium system as the ratio between the average curvature of the Hamiltonian function associated with the system and the trace of the Fisher information matrix of the nonequilibrium probability distribution (see Appendix A 1 for a definition of the Fisher information). We show that this definition subsumes many other attempts at defining entropic temperatures for nonequilibrium systems and is not restricted to equilibrium or near equilibrium systems. Intuitively, the gist of our approach is to use the Shannon or Gibbs entropy of a system and make use of the relation dS=dQrev/T as a definition of temperature. We achieve this by positing a statistical notion of infinitesimal heating as the addition of uncorrelated random variables (in a special way). As an example of the utility of such a definition, we obtain the nonequilibrium entropic temperature for a system satisfying the Langevin equations. For such a system, we show that while the kinetic temperature is related to the changes in the energy of the system, the entropic or Shannon temperature is related to the changes in the entropy of the system. We show that this notion, together with the well known Cramer-Rao inequality in statistics demonstrates the validity of the second law of thermodynamics for such a nonequilibrium system.

View figure in article

Article Text

References (24)

  1. J. Casas-Vazquez and D. Jou, Rep. Prog. Phys. 66, 1937 (2003).
  2. D. Jou, M. Criado-Sancho, and J. Casas-Vazquez, Physica A 358, 49 (2005).
  3. D. Jou and M. S. Mongiovi, Phys. Lett. A 359, 183 (2006).
  4. M. Criado-Sancho, D. Jou, and J. Casas-Vazquez, Phys. Lett. A 350, 339 (2006).
  5. E. Bertin, K. Martens, O. Dauchot, and M. Droz, Phys. Rev. E 75, 031120 (2007).
  6. J. L. Garden, J. Richard, and H. Guillou, J. Chem. Phys. 129, 044508 (2008).
  7. W. G. Hoover and C. G. Hoover, Phys. Rev. E 77, 041104 (2008).
  8. A. Criado-Sancho, D. Jou, and J. Casas-Vazquez, Phys. Lett. A 372, 2172 (2008).
  9. T. Hatano and D. Jou, Phys. Rev. E 67, 026121 (2003).
  10. V. Balakrishnan, Elements of Nonequilibrium Statistical Mechanics (Ane Books, New Delhi, 2008).
  11. A. J. Stam, Inf. Control 2, 101 (1959).
  12. O. Johnson, Information Theory and the Central Limit Theorem (Imperial College Press, London, 2004).
  13. T. Cover and J. Thomas, Elements of Information Theory, 2nd ed. (Wiley, New York, 2006).
  14. L. D. Landau and E. M. Lifshitz, Statistical Physics, 3rd ed. (Butterworth-Heinemann, 1980).
  15. H. Cramer, Mathematical Methods of Statistics (Princeton University Press, Princeton, NJ, 1999).
  16. C. R. Rao, Bull. Calcutta Math. Soc. 77, 81 (1945).
  17. T. Callen, Thermodynamics, 2nd ed. (Wiley, New York, 1985).
  18. H. H. Rugh, Phys. Rev. Lett. 78, 772 (1997).
  19. A. Baranyai, J. Chem. Phys. 112, 3964 (2000).
  20. D. Reguera, J. M. Rubi, and J. M. G. Vilar, J. Phys. Chem. B 109, 21502 (2005).
  21. K. R. Narayanan and A. R. Srinivasa, e-print arXiv:0711.1460.
  22. S. Kullback, Information Theory and Statistics (Dover, New York, 1959).
  23. M. Evans and T. Swartz, Stat. Sci. 10, 254 (1995).
  24. C. F. Chen, J. R. Stat. Soc. Ser. B (Stat. Methodol.) 47, 540 (1985).

Outline

Information

Phys. Rev. E 85, 031151– Published 30 March, 2012
  • Received 25 October 2010

©2012 American Physical Society

Sign In to Your Journals Account

Filter

Filter

Article Lookup

Enter a citation