- Access by Xinjiang University
Accelerating black hole image generation via latent space diffusion models
Phys. Rev. D 114, 083049 – Published 27 October, 2026
DOI: https://doi.org/10.1103/78xb-q47l
Abstract
Interpreting horizon-scale black hole images currently relies on computationally intensive general relativistic ray-tracing simulations, which pose a significant bottleneck for rapid parameter exploration and high-precision tests of strong-field gravity. We demonstrate that physically accurate black hole images, synthesized from magnetized accretion flows, inherently reside on a low-dimensional manifold encoding the essential features of spacetime geometry, plasma distribution, and relativistic emission. Leveraging this structure, we introduce a physics-conditioned diffusion model that operates in a compact latent space to generate high-fidelity black hole imagery directly from physical parameters. The model reproduces key general relativistic ray-tracing signatures, including shadow diameter, photon-ring structure, and relativistic brightness asymmetry, while reducing the average inference time from 5.25 to 1.15 s per image relative to the baseline model. Ablation studies show that self-attention drives the improvements in reconstruction and parameter estimation, whereas principal component analysis provides computational efficiency through latent compression.
Physics Subject Headings (PhySH)
Article Text
References (79)
- K. Akiyama, A. Alberdi, W. Alef et al. (Event Horizon Telescope Collaboration), First M87 event horizon telescope results. I. The shadow of the supermassive black hole, Astrophys. J. Lett. 875, L1 (2019).
- K. Akiyama, A. Alberdi, W. Alef et al. (Event Horizon Telescope Collaboration), First Sagittarius A* event horizon telescope results. I. The shadow of the supermassive black hole in the center of the Milky Way, Astrophys. J. Lett. 930, L12 (2022).
- K. Akiyama, A. Alberdi, W. Alef et al. (Event Horizon Telescope Collaboration), The persistent shadow of the supermassive black hole of M 87. I. Observations, calibration, imaging, and analysis, Astron. Astrophys. 681, A79 (2024).
- Y. Mizuno, Z. Younsi, C. M. Fromm, O. Porth, M. De Laurentis, H. Olivares, H. Falcke, M. Kramer, and L. Rezzolla, The current ability to test theories of gravity with black hole shadows, Nat. Astron. 2, 585 (2018).
- A. Uniyal, I. K. Dihingia, Y. Mizuno, and L. Rezzolla, The future ability to test theories of gravity with black-hole shadows, Nat. Astron. 1, 8 (2025).
- B. Crinquand, B. Cerutti, G. Dubus, K. Parfrey, and A. A. Philippov, Synthetic images of magnetospheric reconnection-powered radiation around supermassive black holes, Phys. Rev. Lett. 129, 205101 (2022).
- X.-J. Gao, T.-T. Sui, X.-X. Zeng, Y.-S. An, and Y.-P. Hu, Investigating shadow images and rings of the charged Horndeski black hole illuminated by various thin accretions, Eur. Phys. J. C 83, 1052 (2023).
- T.-T. Sui, Z.-L. Wang, and W.-D. Guo, The effect of scalar hair on the charged black hole with the images from accretions disk, Eur. Phys. J. C 84, 441 (2024).
- W. Liu, D. Wu, and J. Wang, Light rings and shadows of static black holes in effective quantum gravity, Phys. Lett. B 858, 139052 (2024).
- W. Liu, D. Wu, and J. Wang, Light rings and shadows of static black holes in effective quantum gravity II: A new solution without Cauchy horizons, Phys. Lett. B 868, 139742 (2025).
- W. Liu, D. Wu, X. Fang, J. Jing, and J. Wang, Kerr-MOG-(A)dS black hole and its shadow in scalar-tensor-vector gravity theory, J. Cosmol. Astropart. Phys. 08 (2024) 035.
- W. Liu, D. Wu, and J. Wang, Shadow of slowly rotating Kalb-Ramond black holes, J. Cosmol. Astropart. Phys. 05 (2025) 017.
- M. Israr Aslam, R. Saleem, C.-Y. Yang, and X.-X. Zeng, Imprints of dark matter on the shadow and polarization images of a black hole illuminated by various thick disks, J. High Energy Astrophys. 51, 100551 (2026).
- X. Wang, H. Ye, and X.-X. Zeng, Imaging and polarization patterns of various thick disks around Kerr-MOG black holes, J. Cosmol. Astropart. Phys. 05 (2026) 057.
- X.-X. Zeng, C.-Y. Yang, M. Israr Aslam, and R. Saleem, Probing Horndeski gravity via Kerr black hole: Insights from thin accretion disks and shadows with EHT observations, J. High Energy Astrophys. 51, 100540 (2026).
- Y. Huang, D.-J. Liu, and H. Zhang, Dynamics of photons and shadows for black holes haired with parity-odd fields, J. High Energy Phys. 11 (2025) 027.
- M. Wang, C.-Y. Zhang, S. Chen, and J. Jing, Dynamic shadow of a black hole with a self-interacting massive complex scalar hair, Chin. Phys. C 50, 025102 (2025).
- W. Liu, H. Huang, D. Wu, and J. Wang, Lorentz violation signatures in the low-energy sector of Hořava gravity from black hole shadow observations, Phys. Lett. B 868, 139812 (2025).
- R. Narayan, D. C. M. Palumbo, M. D. Johnson, Z. Gelles et al., The polarized image of a synchrotron-emitting ring of gas orbiting a black hole, Astrophys. J. 912, 35 (2021).
- P. V. P. Cunha and C. A. R. Herdeiro, Shadows and strong gravitational lensing: A brief review, Gen. Relativ. Gravit. 50, 42 (2018).
- V. Perlick and O. Y. Tsupko, Calculating black hole shadows: Review of analytical studies, Phys. Rep. 947, 1 (2022).
- T. Bronzwaer and H. Falcke, The nature of black hole shadows, Astrophys. J. 920, 155 (2021).
- R. A. Konoplya and A. Zhidenko, Shadows of parametrized axially symmetric black holes allowing for separation of variables, Phys. Rev. D 103, 104033 (2021).
- S. Vagnozzi et al., Horizon-scale tests of gravity theories and fundamental physics from the event horizon telescope image of Sagittarius A, Classical Quantum Gravity 40, 165007 (2023).
- C. Bambi, K. Freese, S. Vagnozzi, and L. Visinelli, Testing the rotational nature of the supermassive object M87* from the circularity and size of its first image, Phys. Rev. D 100, 044057 (2019).
- S. Chen, J. Jing, W.-L. Qian, and B. Wang, Black hole images: A review, Sci. China Phys. Mech. Astron. 66, 260401 (2023).
- D. Ayzenberg et al., Fundamental physics opportunities with future ground-based mm/sub-mm VLBI arrays, Living Rev. Relativity 28, 4 (2025); 28, 7(E) (2025).
- Y. Hou, J. Huang, M. Guo, Y. Mizuno, and B. Chen, Near-horizon polarization as a diagnostic of black hole spacetime, Astrophys. J. Lett. 988, L51 (2025).
- C. Qiao, M. Li, D. Xie, and M. Guo, Geometric approach to light rings in axially symmetric spacetimes, arXiv:2512.20802.
- W. Liu, D. Wu, X. Fang, Y.-X. Liu, and J. Wang, Macroscopic optical nonreciprocity: A black hole as an optical diode, arXiv:2604.18101.
- P. V. P. Cunha, C. A. R. Herdeiro, E. Radu, and H. F. Runarsson, Shadows of Kerr black holes with scalar hair, Phys. Rev. Lett. 115, 211102 (2015).
- P. V. P. Cunha, C. A. R. Herdeiro, and E. Radu, Spontaneously scalarized Kerr black holes in extended scalar-tensor–Gauss-Bonnet gravity, Phys. Rev. Lett. 123, 011101 (2019).
- Z. Hu, Z. Zhong, P.-C. Li, M. Guo, and B. Chen, QED effect on a black hole shadow, Phys. Rev. D 103, 044057 (2021).
- F. Bacchini, D. R. Mayerson, B. Ripperda, J. Davelaar, H. Olivares, T. Hertog, and B. Vercnocke, Fuzzball shadows: Emergent horizons from microstructure, Phys. Rev. Lett. 127, 171601 (2021).
- W. Liu, Y. Liu, D. Wu, and Y.-X. Liu, A universal framework for horizon-scale tests of gravity with black hole shadows, Phys. Rev. D 114, L021503 (2026).
- Y.-P. Zhang, S.-W. Wei, and Y.-X. Liu, Emerging black hole shadow from collapsing boson star, arXiv:2503.14159.
- Y. Huang, D.-J. Liu, and H. Zhang, Lensing and light rings of parity-odd rotating boson stars, Sci. China Phys. Mech. Astron. 68, 280411 (2025).
- Q.-H. Zhu, Ray tracing for the Terrell-Penrose effect in black hole spacetime, arXiv:2511.09355.
- F. Yuan and R. Narayan, Hot accretion flows around black holes, Annu. Rev. Astron. Astrophys. 52, 529 (2014).
- R. Narayan, A. Chael, K. Chatterjee, A. Ricarte, and B. Curd, Jets in magnetically arrested hot accretion flows: Geometry, power, and black hole spin-down, Mon. Not. R. Astron. Soc. 511, 3795 (2022).
- Q.-H. Zhu, Auto- and cross-correlations for multiple images of corotating hotspots in accretion disks, Phys. Rev. D 112, 064021 (2025).
- Q.-H. Zhu, Observational signatures from higher-order images of moving hotspots in accretion disks, Phys. Rev. D 111, 044010 (2025).
- Q.-H. Zhu, Aberration effect on lower-order images of a thin accretion disk in the astrometric approach, Phys. Rev. D 109, 044057 (2024).
- X.-X. Zeng, G.-P. Li, and K.-J. He, The shadows and observational appearance of a noncommutative black hole surrounded by various profiles of accretions, Nucl. Phys. B974, 115639 (2022).
- M. A. Abramowicz and P. C. Fragile, Foundations of black hole accretion disk theory, Living Rev. Relativity 16, 1 (2013).
- O. Porth et al. (Event Horizon Telescope Collaboration), The event horizon general relativistic magnetohydrodynamic code comparison project, Astrophys. J. Suppl. Ser. 243, 26 (2019).
- S. Cupp, L. R. Werneck, T. P. Jacques, S. Tootle, and Z. B. Etienne, GRHayL: A modern, infrastructure-agnostic, extensible library for GRMHD simulations, Phys. Rev. D 113, 043045 (2026).
- Y. Chen, R. Ding, Y. Liu, Y. Mizuno, J. Shu, H. Yu, and Y. Zeng, Illuminating black hole shadows with dark matter annihilation, Phys. Rev. Lett. 135, 121001 (2025).
- J. M. Bardeen, Timelike and null geodesics in the Kerr metric, in Black Holes (Les Astres Occlus), edited by C. Dewitt and B. S. Dewitt (Gordon and Breach, New York, 1973), pp. 215–239.
- H. Falcke, F. Melia, and E. Agol, Viewing the shadow of the black hole at the Galactic Center, Astrophys. J. Lett. 528, L13 (2000).
- S. E. Gralla, D. E. Holz, and R. M. Wald, Black hole shadows, photon rings, and lensing rings, Phys. Rev. D 100, 024018 (2019).
- A. E. Broderick, R. Gold, M. Karami, J. A. Preciado-López et al., THEMIS: A parameter estimation framework for the event horizon telescope, Astrophys. J. 897, 139 (2020).
- A. I. Yfantis, S. Zhao, R. Gold, M. Mościbrodzka, and A. E. Broderick, Testing Bayesian inference of GRMHD model parameters from VLBI data, Mon. Not. R. Astron. Soc. 535, 3181 (2024).
- D. Chang, P. Tiede, M. Johnson, and D. Palumbo, Bayesian black hole photogrammetry, Astrophys. J. 974, 143 (2024).
- Z. Zhang, Z. Shao, J. Ma, J. Zhang, Y. Wang, Z. Liao, G. Cheng, J. Liu, M. Guo, and L. Wu, Land-cover prior diffusion probabilistic model for remote sensing image super resolution, Pattern Recognit. 172, 112577 (2026).
- S. Liu, K. Li, Y. Ding, and Q. Qi, Underwater image enhancement by diffusion model with customized CLIP-classifier, Pattern Recognit. 171, 112232 (2026).
- D. Xie, X. Hu, Y. Zhou, and S. Duan, All-in-one adverse weather removal via dual state space-based diffusion model with degradation-aware guidance, Pattern Recognit. 171, 112081 (2026).
- J. Oh and J. Lee, Mitigating ANC pressure effect in active noise cancellation using diffusion-based generative models, Measurement 259, 119599 (2026).
- Z. Chang, G. A. Koulieris, H. J. Chang, and H. P. H. Shum, On the design fundamentals of diffusion models: A survey, Pattern Recognit. 169, 111934 (2026).
- A. Liu, Z. Zhang, S. Chen, C. Wen, and J. Wang, BCDDM: Branch correction denoising diffusion model for black hole image generation, Astrophys. J. Suppl. Ser. 279, 10 (2025).
- M. Mathieu, C. Couprie, and Y. LeCun, Deep multi-scale video prediction beyond mean square error, arXiv:1511.05440.
- C. Fefferman, S. Mitter, and H. Narayanan, Testing the manifold hypothesis, arXiv:1310.0425.
- M. Belkin and P. Niyogi, Laplacian eigenmaps for dimensionality reduction and data representation, Neural Comput. 15, 1373 (2003).
- Y. Bengio, A. Courville, and P. Vincent, Representation learning: A review and new perspectives, arXiv:1206.5538.
- P. Pope, C. Zhu, A. Abdelkader, M. Goldblum, and T. Goldstein, The intrinsic dimension of images and its impact on learning, arXiv:2104.08894.
- L. Medeiros, T. R. Lauer, D. Psaltis, and F. Özel, Principal component analysis as a tool for characterizing black hole images and variability, Astrophys. J. 864, 7 (2018).
- P. Hallur, L. Medeiros, and T. R. Lauer, A red-noise eigenbasis for the reconstruction of blobby images, Astrophys. J. 927, 111 (2022).
- D. Psaltis, F. Özel, L. Medeiros, and T. R. Lauer, Theoretical foundation of black hole image reconstruction using PRIMO, Astrophys. J. 984, 86 (2025).
- M. Park, M. Gatti, and B. Jain, Dimensionality reduction techniques for statistical inference in cosmology, Phys. Rev. D 111, 063523 (2025).
- C. M. Bishop, Pattern Recognition and Machine Learning (Springer, New York, 2006).
- I. Goodfellow, Y. Bengio, and A. Courville, Deep Learning (MIT Press, Cambridge, MA, 2016).
- A. Vaswani, N. Shazeer, N. Parmar, J. Uszkoreit, L. Jones, A. N. Gomez, Ł. Kaiser, and I. Polosukhin, Attention is all you need, in Advances in Neural Information Processing Systems Vol. 30 (2017), arXiv:1706.03762.
- Z. Zhang and S. Chen, Supplementary data for “bcddm: Branch-corrected denoising diffusion model for black hole image generation”, 10.5281/zenodo.15354648 (2025).
- S. S. Komissarov, Magnetized Tori around Kerr black holes: Analytic solutions with a toroidal magnetic field, Mon. Not. R. Astron. Soc. 368, 993 (2006).
- F. Yuan and R. Narayan, Hot accretion flows around black holes, Annu. Rev. Astron. Astrophys. 52, 529 (2014).
- Y. Hou, Z. Zhang, M. Guo, and B. Chen, A new analytical model of magnetofluids surrounding rotating black holes, J. Cosmol. Astropart. Phys. 02 (2024) 030.
- Z. Zhang, Y. Hou, M. Guo, and B. Chen, Imaging thick accretion disks and jets surrounding black holes, J. Cosmol. Astropart. Phys. 05 (2024) 032.
- Q. Wan, Y. Hou, and M. Guo, Probing the scalar hair of rotating Horndeski black holes through thick disk images, Phys. Rev. D 113, 083023 (2026).
- Z. Zhang, S. Chen, and J. Jing, Images of Kerr-MOG black holes surrounded by geometrically thick magnetized equilibrium tori, J. Cosmol. Astropart. Phys. 09 (2024) 027.