Export citation

Export citation

Choose format for download:

Download Citation
  • Access by Xinjiang University

Comment on “Inference with minimal Gibbs free energy in information field theory”

D. Iatsenko, A. Stefanovska, and P. V. E. McClintock

  • Department of Physics, Lancaster University, Lancaster LA1 4YB, United Kingdom

Phys. Rev. E 85, 033101 – Published 20 March, 2012

DOI: https://doi.org/10.1103/PhysRevE.85.033101

Abstract

Enßlin and Weig [Phys. Rev. E 82, 051112 (2010)] have introduced a “minimum Gibbs free energy” (MGFE) approach for estimation of the mean signal and signal uncertainty in Bayesian inference problems: it aims to combine the maximum a posteriori (MAP) and maximum entropy (ME) principles. We point out, however, that there are some important questions to be clarified before the new approach can be considered fully justified, and therefore able to be used with confidence. In particular, after obtaining a Gaussian approximation to the posterior in terms of the MGFE at some temperature T, this approximation should always be raised to the power of T to yield a reliable estimate. In addition, we show explicitly that MGFE indeed incorporates the MAP principle, as well as the MDI (minimum discrimination information) approach, but not the well-known ME principle of Jaynes [E.T. Jaynes, Phys. Rev. 106, 620 (1957)]. We also illuminate some related issues and resolve apparent discrepancies. Finally, we investigate the performance of MGFE estimation for different values of T, and we discuss the advantages and shortcomings of the approach.

Comments & Replies

Article Text

Original Article

Inference with minimal Gibbs free energy in information field theory

Torsten A. Enßlin and Cornelius Weig
Phys. Rev. E 82, 051112 (2010)

References (12)

  1. T. A. Enßlin and C. Weig, Phys. Rev. E 82, 051112 (2010).
  2. N. Oppermann, G. Robbers, and T. A. Ensslin, Phys. Rev. E 84, 041118 (2011).
  3. E. T. Jaynes, Phys. Rev. 106, 620 (1957).
  4. E. T. Jaynes, Proc. IEEE 70, 939 (1982).
  5. E. T. Jaynes, in Statistical Physics, Vol. 3, edited by K. Ford (Benjamin, New York, 1963), pp. 181–218.
  6. E. T. Jaynes, IEEE Trans. Syst. Sci. Cybernet. SSC4, 227 (1968).
  7. E. T. Jaynes, Probability Theory: The Logic of Science (Cambridge University Press, Cambridge, 2003).
  8. S. F. Gull, in Maximum Entropy and Bayesian Methods in Science and Engineering, edited by G. J. Erickson and C. R. Smith (Kluwer, Dordrecht, 1988), pp. 53–74.
  9. S. Kullback, Information Theory and Statistics (Wiley, New York, 1959).
  10. S. Kullback and M. A. Khairat, Ann. Math. Statist. 37, 279 (1966).
  11. I. J. Good, Ann. Math. Statist. 34, 911 (1963).
  12. E. S. Soofi and D. V. Gokhale, Comput. Stat. Data Anal. 11, 165 (1991).

Outline

Information

Sign In to Your Journals Account

Filter

Filter

Article Lookup

Enter a citation