- Featured in Physics
- Open Access
Neural Density Functional Theory of Liquid-Gas Phase Coexistence
Phys. Rev. X 15, 011013 – Published 24 January, 2025
DOI: https://doi.org/10.1103/PhysRevX.15.011013
Abstract
We use supervised machine learning together with the concepts of classical density functional theory to investigate the effects of interparticle attraction on the pair structure, thermodynamics, bulk liquid-gas coexistence, and associated interfacial phenomena in many-body systems. Local learning of the one-body direct correlation functional is based on Monte Carlo simulations of inhomogeneous systems with randomized thermodynamic conditions, randomized planar shapes of the external potential, and randomized box sizes. Focusing on the prototypical Lennard-Jones system, we test predictions of the resulting neural attractive density functional across a broad spectrum of physical behavior associated with liquid-gas phase coexistence in bulk and at interfaces. We analyze the bulk radial distribution function obtained from automatic differentiation and the Ornstein-Zernike route and determine (i) the Fisher-Widom line, i.e., the crossover of the asymptotic (large distance) decay of from monotonic to oscillatory, (ii) the (Widom) line of maximal correlation length, (iii) the line of maximal isothermal compressibility, and (iv) the spinodal by calculating the poles of the structure factor in the complex plane. The bulk binodal and the density profile of the free liquid-gas interface are obtained from density functional minimization and the corresponding surface tension from functional line integration. We also show that the neural functional describes accurately the phenomena of drying at a hard wall and of capillary evaporation for a liquid confined in a slit pore. Our neural framework yields results that improve significantly upon standard mean-field treatments of interparticle attraction. Comparison with independent simulation results demonstrates a consistent picture of phase separation even when restricting the training to supercritical states only. We argue that phase coexistence and its associated signatures can be discovered as emerging phenomena via functional mappings and educated extrapolation.
Physics Subject Headings (PhySH)
Focus
Machine Learning Predicts Liquid–Gas Transition
Conventional theory has trouble predicting the conditions that will cause a liquid to boil, but a neural-network-based approach performs better.
See more in Physics
Popular Summary
Investigating the basic physics of complex many-body systems requires one to make approximations. Analytical approaches, which input information about underlying physical mechanisms, usually stand in contrast to brute-force numerical simulation methods, which enable quantitative predictions at the expense of increased computational demands and often physical insight. Focusing on the challenging case of liquids, we combine the virtues of simulations with the rigorous framework of classical density functional theory. Our approach yields an accurate and workable implementation of the statistical mechanics based on functional mappings represented by neural networks.
Using thermally trained neural density functionals, we investigate and connect an extensive spectrum of physical behavior arising from interparticle attraction in a many-body system. We cast new light on the entropy-versus-energy mechanism that drives bulk liquid-gas phase coexistence, the nature of pair correlation functions both away from and close to the critical point, and the subtle interfacial phenomena that occur for liquids at substrates and in capillaries. A key example is the drying transition, whereby a stable gas film intrudes between the bulk liquid and a repulsive wall. The framework that we develop provides access to a broad array of physical properties while remaining computationally efficient.
The numerical accuracy of the neural functional predictions that we have gleaned for a simple model liquid, and the ease with which these are obtained, promise exciting new perspectives for the discovery of emerging collective phenomena in soft matter.
Article Text
References (99)
- J. Carrasquilla and R. G. Melko, Machine learning phases of matter, Nat. Phys. 13, 431 (2017).
- E. Bedolla, L. C. Padierna, and R. Castañeda-Priego, Machine learning for condensed matter physics, J. Phys. Condens. Matter 33, 053001 (2020).
- V. Chertenkov, E. Burovski, and L. Shchur, Finite-size analysis in neural network classification of critical phenomena, Phys. Rev. E 108, L032102 (2023).
- J. Arnold, F. Schäfer, A. Edelman, and C. Bruder, Mapping out phase diagrams with generative classifiers, Phys. Rev. Lett. 132, 207301 (2024).
- Z. Liu, X. Zhang, X. Ru, T.-T. Gao, J. M. Moore, and G. Yan, Early predictor for the onset of critical transitions in networked dynamical systems, Phys. Rev. X 14, 031009 (2024).
- B. Harris, L. L. Gollo, and B. D. Fulcher, Tracking the distance to criticality in systems with unknown noise, Phys. Rev. X 14, 031021 (2024).
- A. Morr and N. Boers, Detection of approaching critical transitions in natural systems driven by red noise, Phys. Rev. X 14, 021037 (2024).
- J.-P. Hansen and I. R. McDonald, Theory of Simple Liquids with Applications to Soft Matter, 4th ed. (Elsevier Science & Technology Books, London, 2013).
- D. Frenkel and B. Smit, Understanding Molecular Simulation: From Algorithms to Applications, 3rd ed. (Academic Press, London, 2023).
- R. Evans, The nature of the liquid-vapour interface and other topics in the statistical mechanics of non-uniform, classical fluids, Adv. Phys. 28, 143 (1979).
- R. Evans, Density functionals in the theory of nonuniform fluids, in Fundamentals of Inhomogeneous Fluids, edited by D. Henderson (Marcel Dekker, New York, 1992), Chap. 3, pp. 85–176.
- R. Evans, M. Oettel, R. Roth, and G. Kahl, New developments in classical density functional theory, J. Phys. Condens. Matter 28, 240401 (2016).
- Y. Rosenfeld, Free-energy model for the inhomogeneous hard-sphere fluid mixture and density-functional theory of freezing, Phys. Rev. Lett. 63, 980 (1989).
- R. Roth, Fundamental measure theory for hard-sphere mixtures: A review, J. Phys. Condens. Matter 22, 063102 (2010).
- R. Evans, M. C. Stewart, and N. B. Wilding, A unified description of hydrophilic and superhydrophobic surfaces in terms of the wetting and drying transitions of liquids, Proc. Natl. Acad. Sci. U.S.A. 116, 23901 (2019).
- M. K. Coe, R. Evans, and N. B. Wilding, Density depletion and enhanced fluctuations in water near hydrophobic solutes: Identifying the underlying physics, Phys. Rev. Lett. 128, 045501 (2022).
- M. K. Coe, R. Evans, and N. B. Wilding, Understanding the physics of hydrophobic solvation, J. Chem. Phys. 158, 034508 (2023).
- S.-C. Lin and M. Oettel, A classical density functional from machine learning and a convolutional neural network, SciPost Phys. 6, 025 (2019).
- S.-C. Lin, G. Martius, and M. Oettel, Analytical classical density functionals from an equation learning network, J. Chem. Phys. 152, 021102 (2020).
- P. Cats, S. Kuipers, S. de Wind, R. van Damme, G. M. Coli, M. Dijkstra, and R. van Roij, Machine-learning free-energy functionals using density profiles from simulations, APL Mater. 9, 031109 (2021).
- P. Yatsyshin, S. Kalliadasis, and A. B. Duncan, Physics-constrained Bayesian inference of state functions in classical density-functional theory, J. Chem. Phys. 156, 074105 (2022).
- A. Malpica-Morales, P. Yatsyshin, M. A. Durán-Olivencia, and S. Kalliadasis, Physics-informed Bayesian inference of external potentials in classical density-functional theory, J. Chem. Phys. 159, 104109 (2023).
- J. Dijkman, M. Dijkstra, R. van Roij, M. Welling, J.-W. van de Meent, and B. Ensing, Learning neural free-energy functionals with pair-correlation matching, arXiv:2403.15007.
- D. de las Heras, T. Zimmermann, F. Sammüller, S. Hermann, and M. Schmidt, Perspective: How to overcome dynamical density functional theory, J. Phys. Condens. Matter 35, 271501 (2023).
- F. Sammüller, S. Hermann, D. de las Heras, and M. Schmidt, Neural functional theory for inhomogeneous fluids: Fundamentals and applications, Proc. Natl. Acad. Sci. U.S.A. 120, e2312484120 (2023).
- F. Sammüller, S. Hermann, and M. Schmidt, Why neural functionals suit statistical mechanics, J. Phys. Condens. Matter 36, 243002 (2024).
- F. Sammüller, S. Robitschko, S. Hermann, and M. Schmidt, Hyperdensity functional theory of soft matter, Phys. Rev. Lett. 133, 098201 (2024).
- F. Sammüller and M. Schmidt, Neural density functionals: Local learning and pair-correlation matching, Phys. Rev. E 110, L032601 (2024).
- T. Zimmermann, F. Sammüller, S. Hermann, M. Schmidt, and D. de las Heras, Neural force functional for non-equilibrium many-body colloidal systems, Mach. Learn. Sci. Technol. 5, 035062 (2024).
- A. Simon, J. Weimar, G. Martius, and M. Oettel, Machine learning of a density functional for anisotropic patchy particles, J. Chem. Theory Comput. 20, 1062 (2024).
- A. Simon and M. Oettel, Machine learning approaches to classical density functional theory, arXiv:2406.07345.
- R. Stierle, G. Bauer, N. Thiele, B. Bursik, P. Rehner, and J. Gross, Classical density functional theory in three dimensions with GPU-accelerated automatic differentiation: Computational performance analysis using the example of adsorption in covalent-organic frameworks, Chem. Eng. Sci. 298, 120380 (2024).
- S. M. Kampa, F. Sammüller, M. Schmidt, and R. Evans, Metadensity functional theory for classical fluids: Extracting the pair potential, arXiv:2411.06972.
- J. Yang, R. Pan, J. Sun, and J. Wu, High-dimensional operator learning for molecular density functional theory, arXiv:2411.03698.
- R. Nagai, R. Akashi, S. Sasaki, and S. Tsuneyuki, Neural-network Kohn-Sham exchange-correlation potential and its out-of-training transferability, J. Chem. Phys. 148, 241737 (2018).
- J. Schmidt, C. L. Benavides-Riveros, and M. A. L. Marques, Machine learning the physical nonlocal exchange-correlation functional of density-functional theory, J. Phys. Chem. Lett. 10, 6425 (2019).
- Y. Zhou, J. Wu, S. Chen, and G. Chen, Toward the exact exchange-correlation potential: A three-dimensional convolutional neural network construct, J. Phys. Chem. Lett. 10, 7264 (2019).
- R. Nagai, R. Akashi, and O. Sugino, Completing density functional theory by machine learning hidden messages from molecules, npj Comput. Mater. 6, 43 (2020).
- L. Li, S. Hoyer, R. Pederson, R. Sun, E. D. Cubuk, P. Riley, and K. Burke, Kohn-Sham equations as regularizer: Building prior knowledge into machine-learned physics, Phys. Rev. Lett. 126, 036401 (2021).
- H. Li, Z. Wang, N. Zou, M. Ye, R. Xu, X. Gong, W. Duan, and Y. Xu, Deep-learning density functional theory Hamiltonian for efficient ab initio electronic-structure calculation, Nat. Comput. Sci. 2, 367 (2022).
- R. Pederson, B. Kalita, and K. Burke, Machine learning and density functional theory, Nat. Rev. Phys. 4, 357 (2022).
- J. Gedeon, J. Schmidt, M. J. P. Hodgson, J. Wetherell, C. L. Benavides-Riveros, and M. A. L. Marques, Machine learning the derivative discontinuity of density-functional theory, Mach. Learn. Sci. Technol. 3, 015011 (2021).
- M. M. Kelley, J. Quinton, K. Fazel, N. Karimitari, C. Sutton, and R. Sundararaman, Bridging electronic and classical density-functional theory using universal machine-learned functional approximations, J. Chem. Phys. 161, 144101 (2024).
- M. Schmidt and J. M. Brader, Power functional theory for Brownian dynamics, J. Chem. Phys. 138, 214101 (2013).
- M. Schmidt, Power functional theory for many-body dynamics, Rev. Mod. Phys. 94, 015007 (2022).
- A. G. Baydin, B. A. Pearlmutter, A. A. Radul, and J. M. Siskind, Automatic differentiation in machine learning: A survey, J. Mach. Learn. Res. 18, 1 (2018), https://jmlr.org/papers/v18/17-468.html.
- M. Baus, Broken symmetry and invariance properties of classical fluids, Mol. Phys. 51, 211 (1984).
- R. Evans and A. O. Parry, Liquids at interfaces: What can a theorist contribute?, J. Phys. Condens. Matter 2, SA15 (1990).
- J. R. Henderson, Statistical mechanical sum rules, in Fundamentals of Inhomogeneous Fluids (Ref. [11]), Chap. 2, pp. 23–84.
- S. Hermann and M. Schmidt, Noether’s theorem in statistical mechanics, Commun. Phys. 4, 176 (2021).
- S. Hermann and M. Schmidt, Why Noether’s theorem applies to statistical mechanics, J. Phys. Condens. Matter 34, 213001 (2022).
- F. Sammüller, S. Hermann, D. de las Heras, and M. Schmidt, Noether-constrained correlations in equilibrium liquids, Phys. Rev. Lett. 130, 268203 (2023).
- S. Hermann, F. Sammüller, and M. Schmidt, Noether invariance theory for the equilibrium force structure of soft matter, J. Phys. A 57, 175001 (2024).
- S. Robitschko, F. Sammüller, M. Schmidt, and S. Hermann, Hyperforce balance via thermal Noether invariance of any observable, Commun. Phys. 7, 103 (2024).
- J. Müller, S. Hermann, F. Sammüller, and M. Schmidt, Gauge invariance of equilibrium statistical mechanics, Phys. Rev. Lett. 133, 217101 (2024).
- H. Hansen-Goos and R. Roth, Density functional theory for hard-sphere mixtures: The White Bear version mark II, J. Phys. Condens. Matter 18, 8413 (2006).
- J. K. Percus, Approximation methods in classical statistical mechanics, Phys. Rev. Lett. 8, 462 (1962).
- J. K. Percus, Equilibrium state of a classical fluid of hard rods in an external field, J. Stat. Phys. 15, 505 (1976).
- N. B. Wilding, Critical-point and coexistence-curve properties of the Lennard-Jones fluid: A finite-size scaling study, Phys. Rev. E 52, 602 (1995).
- A. Z. Panagiotopoulos, Molecular simulation of phase coexistence: Finite-size effects and determination of critical parameters for two- and three-dimensional Lennard-Jones fluids, Int. J. Thermophys. 15, 1057 (1994).
- A. Trokhymchuk and J. Alejandre, Computer simulations of liquid/vapor interface in Lennard-Jones fluids: Some questions and answers, J. Chem. Phys. 111, 8510 (1999).
- J. R. Errington and D. A. Kofke, Calculation of surface tension via area sampling, J. Chem. Phys. 127, 174709 (2007).
- K. S. Rane, V. Kumar, and J. R. Errington, Monte Carlo simulation methods for computing the wetting and drying properties of model systems, J. Chem. Phys. 135, 234102 (2011).
- R. Evans, M. C. Stewart, and N. B. Wilding, Drying and wetting transitions of a Lennard-Jones fluid: Simulations and density functional theory, J. Chem. Phys. 147, 044701 (2017).
- F. Chollet, Deep Learning with Python, 2nd ed. (Manning, Shelter Island, New York, 2021).
- F. Sammüller, Neural density functional theory of liquid-gas phase coexistence, Zenodo, 10.5281/zenodo.13384421 (2024).
- M. Dijkstra and R. Evans, A simulation study of the decay of the pair correlation function in simple fluids, J. Chem. Phys. 112, 1449 (2000).
- M. E. Fisher and B. Widom, Decay of correlations in linear systems, J. Chem. Phys. 50, 3756 (1969).
- R. Evans, J. R. Henderson, D. C. Hoyle, A. O. Parry, and Z. A. Sabeur, Asymptotic decay of liquid structure: Oscillatory liquid-vapour density profiles and the Fisher-Widom line, Mol. Phys. 80, 755 (1993).
- A. M. Ferrenberg, J. Xu, and D. P. Landau, Pushing the limits of Monte Carlo simulations for the three-dimensional Ising model, Phys. Rev. E 97, 043301 (2018).
- D. E. Sullivan, Surface tension and contact angle of a liquid–solid interface, J. Chem. Phys. 74, 2604 (1981).
- P. Tarazona and R. Evans, A simple density functional theory for inhomogeneous liquids: Wetting by gas at a solid-liquid interface, Mol. Phys. 52, 847 (1984).
- J. R. Henderson and F. van Swol, On the approach to complete wetting by gas at a liquid-wall interface: Exact sum rules, fluctuation theory and the verification by computer simulation of the presence of long-range pair correlations at the wall, Mol. Phys. 56, 1313 (1985).
- N. B. Wilding, R. Evans, and F. Turci, What is the best simulation approach for measuring local density fluctuations near solvo-/hydrophobes?, J. Chem. Phys. 160, 164103 (2024).
- P. Tarazona, U. M. B. Marconi, and R. Evans, Phase equilibria of fluid interfaces and confined fluids: Non-local versus local density functionals, Mol. Phys. 60, 573 (1987).
- R. Roth and A. O. Parry, Drying in a capped capillary, Mol. Phys. 109, 1159 (2011).
- R. Evans and M. C. Stewart, The local compressibility of liquids near non-adsorbing substrates: A useful measure of solvophobicity and hydrophobicity?, J. Phys. Condens. Matter 27, 194111 (2015).
- R. Evans and N. B. Wilding, Quantifying density fluctuations in water at a hydrophobic surface: Evidence for critical drying, Phys. Rev. Lett. 115, 016103 (2015).
- T. Eckert, N. C. X. Stuhlmüller, F. Sammüller, and M. Schmidt, Fluctuation profiles in inhomogeneous fluids, Phys. Rev. Lett. 125, 268004 (2020).
- T. Eckert, N. C. X. Stuhlmüller, F. Sammüller, and M. Schmidt, Local measures of fluctuations in inhomogeneous liquids: Statistical mechanics and illustrative applications, J. Phys. Condens. Matter 35, 425102 (2023).
- P. Tarazona and R. Evans, Long ranged correlations at a solid-fluid interface a signature of the approach to complete wetting, Mol. Phys. 47, 1033 (1982).
- F. S. Carvalho and J. P. Braga, Physics informed neural networks applied to liquid state theory, J. Mol. Liq. 367, 120504 (2022).
- J. Wu and M. Gu, Perfecting liquid-state theories with machine intelligence, J. Phys. Chem. Lett. 14, 10545 (2023).
- W. Chen, P. Gao, and P. Stinis, Physics-informed machine learning of the correlation functions in bulk fluids, Phys. Fluids 36, 017133 (2024).
- S. M. Tschopp, H. D. Vuijk, A. Sharma, and J. M. Brader, Mean-field theory of inhomogeneous fluids, Phys. Rev. E 102, 042140 (2020).
- J. M. Brader, R. Evans, M. Schmidt, and H. Löwen, Entropic wetting and the fluid-fluid interface of a model colloid-polymer mixture, J. Phys. Condens. Matter 14, L1 (2001).
- J. M. Brader, R. Evans, and M. Schmidt, Statistical mechanics of inhomogeneous model colloid-polymer mixtures, Mol. Phys. 101, 3349 (2003).
- V. Molinero and E. B. Moore, Water modeled as an intermediate element between carbon and silicon, J. Phys. Chem. B 113, 4008 (2008).
- G. A. Cisneros, K. T. Wikfeldt, L. Ojamäe, J. Lu, Y. Xu, H. Torabifard, A. P. Bartók, G. Csányi, V. Molinero, and F. Paesani, Modeling molecular interactions in water: From pairwise to many-body potential energy functions, Chem. Rev. 116, 7501 (2016).
- S. Saw, N. L. Ellegaard, W. Kob, and S. Sastry, Structural relaxation of a gel modeled by three body interactions, Phys. Rev. Lett. 103, 248305 (2009).
- R. L. Henderson, A uniqueness theorem for fluid pair correlation functions, Phys. Lett. A 49, 197 (1974).
- G. Jeanmairet, M. Levesque, R. Vuilleumier, and D. Borgis, Molecular density functional theory of water, J. Phys. Chem. Lett. 4, 619 (2013).
- L. Ding, M. Levesque, D. Borgis, and L. Belloni, Efficient molecular density functional theory using generalized spherical harmonics expansions, J. Chem. Phys. 147, 094107 (2017).
- A. Simon, L. Belloni, D. Borgis, and M. Oettel, The orientational structure of a model patchy particle fluid: Simulations, integral equations, density functional theory and machine learning, arXiv:2411.06973.
- N. B. Wilding, F. Schmid, and P. Nielaba, Liquid-vapor phase behavior of a symmetrical binary fluid mixture, Phys. Rev. E 58, 2201 (1998).
- A. T. Bui and S. J. Cox, Learning classical density functionals for ionic fluids, arXiv:2410.02556.
- T. Cohen and M. Welling, Group equivariant convolutional networks, in Proceedings of the 33rd International Conference on Machine Learning, edited by M. F. Balcan and K. Q. Weinberger (PMLR, New York, 2016), Vol. 48, pp. 2990–2999.
- V. G. Satorras, E. Hoogeboom, and M. Welling, equivariant graph neural networks, in Proceedings of the 38th International Conference on Machine Learning, edited by M. Meila and T. Zhang (PMLR, New York, 2021), Vol. 139, pp. 9323–9332.
- K. Burke, Perspective on density functional theory, J. Chem. Phys. 136, 150901 (2012).
