- Access by Xinjiang University
Full nonlinear velocity reconstruction with transformer and ensemble tree machine learning
Phys. Rev. D 114, 103517 – Published 9 November, 2026
DOI: https://doi.org/10.1103/5yrw-sl7s
Abstract
Accurate reconstruction of peculiar velocities from galaxy positions is important for probing the motion and evolution of large-scale structure. They are sensitive to the cosmological effects of gravity and dark sector matter, and they complement other velocity inference methods such as the kinematic Sunyaev-Zel’dovich (kSZ) imprinted in the cosmic microwave background. We show that machine learning methods improve velocity reconstruction by capturing nonlinear contributions. Specifically, we train both a gradient boosting decision tree (GBDT) and a transformer using multiscale features to predict the residual between the actual velocity and the estimate from linear theory for both the line-of-sight and transverse components. We evaluate our approach in both periodic box and, more realistically, light cone settings using mock galaxy catalogs from the abacussummit simulations tailored to DESI spectroscopic surveys of luminous red galaxies and emission line galaxies. We also assess the impact of redshift uncertainties such as those in Rubin LSST photometry. Both models significantly outperform the linear theory, with the transformer achieving the best performance for the simulation considered here. They more accurately recover the density-weighted momentum power spectrum and maintain a higher cross-correlation with the true velocities across a wider range of spatial scales. Finally, we demonstrate two applications relevant to kSZ analyses: estimating cluster pairwise velocity correlations and stacked cluster density profiles. This machine learning framework for nonlinear velocity reconstruction opens up powerful new applications of survey data from DESI, Rubin LSST, Euclid and the Roman Space Telescope.
Physics Subject Headings (PhySH)
Article Text
References (88)
- N. Kaiser, Mon. Not. R. Astron. Soc. 227, 1 (1987).
- M. A. Strauss and J. A. Willick, Phys. Rep. 261, 271 (1995).
- C. Howlett, K. Said, J. R. Lucey, M. Colless, F. Qin, Y. Lai, R. B. Tully, and T. M. Davis, Mon. Not. R. Astron. Soc. 515, 953 (2022).
- W. J. Percival and M. White, Mon. Not. R. Astron. Soc. 393, 297 (2009).
- M. J. Hudson and S. J. Turnbull, Astrophys. J. Lett. 751, L30 (2013).
- K. Said, M. Colless, C. Magoulas, J. R. Lucey, and M. J. Hudson, Mon. Not. R. Astron. Soc. 497, 1275 (2020).
- R. J. Turner, arXiv:2411.19484.
- R. A. Sunyaev and Y. B. Zeldovich, Mon. Not. R. Astron. Soc. 190, 413 (1980).
- N. Hand et al., Phys. Rev. Lett. 109, 041101 (2012).
- E. Schaan et al. (Atacama Cosmology Telescope Collaboration), Phys. Rev. D 103, 063513 (2021).
- A. Laguë, M. S. Madhavacheril, K. M. Smith, S. Ferraro, and E. Schaan, Phys. Rev. Lett. 134, 151003 (2025).
- Y. Gong et al., Phys. Rev. D 113, 063538 (2026).
- C. M. Springob, C. Magoulas, M. Colless, J. Mould, P. Erdogdu, D. H. Jones, J. R. Lucey, L. Campbell, and C. J. Fluke, Mon. Not. R. Astron. Soc. 445, 2677 (2014).
- J. S. Bullock and M. Boylan-Kolchin, Annu. Rev. Astron. Astrophys. 55, 343 (2017).
- N. Battaglia, S. Ferraro, E. Schaan, and D. Spergel, J. Cosmol. Astropart. Phys. 11 (2017) 040.
- D. J. Eisenstein, H.-j. Seo, and M. J. White, Astrophys. J. 664, 660 (2007).
- D. J. Eisenstein, H.-j. Seo, E. Sirko, and D. Spergel, Astrophys. J. 664, 675 (2007).
- N. Padmanabhan, X. Xu, D. J. Eisenstein, R. Scalzo, A. J. Cuesta, K. T. Mehta, and E. Kazin, Mon. Not. R. Astron. Soc. 427, 2132 (2012).
- X. Xu, A. J. Cuesta, N. Padmanabhan, D. J. Eisenstein, and C. K. McBride, Mon. Not. R. Astron. Soc. 431, 2834 (2013).
- L. Anderson et al. (BOSS Collaboration), Mon. Not. R. Astron. Soc. 439, 83 (2014).
- H. Gil-Marin et al. (eBOSS Collaboration), Mon. Not. R. Astron. Soc. 498, 2492 (2020).
- K. C. Chan, G. Lu, and X. Wang, Mon. Not. R. Astron. Soc. 529, 1667 (2024).
- M. White, Mon. Not. R. Astron. Soc. 450, 3822 (2015).
- S.-F. Chen, Z. Vlah, and M. White, J. Cosmol. Astropart. Phys. 09 (2019) 017.
- E. Schaan et al. (ACTPol Collaboration), Phys. Rev. D 93, 082002 (2016).
- P. Zhang, J. Pan, and Y. Zheng, Phys. Rev. D 87, 063526 (2013).
- C. Blake and R. J. Turner 10.33232/001c.124509 (2024).
- Y. Lai et al., J. Cosmol. Astropart. Phys. 04 (2026) 026.
- A. Aghamousa et al. (DESI Collaboration), arXiv:1611.00036.
- LSST Science Collaboration, LSST Science Book, version 2.0 (2009).
- Y. Mellier et al. (Euclid Collaboration), Astron. Astrophys. 697, A1 (2025).
- D. Spergel et al., arXiv:1503.03757.
- B. R. Guachalla, E. Schaan, B. Hadzhiyska, and S. Ferraro, Phys. Rev. D 109, 103533 (2024).
- B. Hadzhiyska, S. Ferraro, B. R. Guachalla, and E. Schaan, Phys. Rev. D 109, 103534 (2024).
- Y. B. Zel’dovich, Astron. Astrophys. 5, 84 (1970).
- X. Xu, N. Padmanabhan, D. J. Eisenstein, K. T. Mehta, and A. J. Cuesta, Mon. Not. R. Astron. Soc. 427, 2146 (2012).
- A.-S. Deutsch, E. Dimastrogiovanni, M. C. Johnson, M. Münchmeyer, and A. Terrana, Phys. Rev. D 98, 123501 (2018).
- J. I. Cayuso, M. C. Johnson, and J. B. Mertens, Phys. Rev. D 98, 063502 (2018).
- R. Bloch and M. C. Johnson, arXiv:2405.00809.
- M. Schmittfull, T. Baldauf, and M. Zaldarriaga, Phys. Rev. D 96, 023505 (2017).
- R. Hada and D. J. Eisenstein, Mon. Not. R. Astron. Soc. 478, 1866 (2018).
- Y.-Z. Ma, G.-D. Gong, N. Sui, and P. He, Mon. Not. R. Astron. Soc. 475, 379 (2018).
- R. J. Turner and C. Blake, Mon. Not. R. Astron. Soc. 526, 337 (2023).
- A. J. Tishue, C. Shiveshwarkar, and G. Holder, arXiv:2510.25821.
- R. Suresh, H. Bishnoi, A. V. Kuklin, A. Parikh, M. Molokeev, R. Harinarayanan, S. Gharat, and P. Hiba, Front. Phys. 12, 1322162 (2024).
- Y. Gong and R. Bean, Phys. Rev. D 112, 023527 (2025).
- O. Ronneberger, P. Fischer, and T. Brox, arXiv:1505.04597.
- Y. Wang and X. Yang, Astrophys. J. 969, 76 (2024).
- X. Xiao, J. Ding, X. Luo, S. K. Lan, L. Xiao, S. Liu, X. Wang, L. Zhang, and X.-D. Li, Astrophys. J. 994, 204 (2025).
- A. Dosovitskiy, L. Beyer, A. Kolesnikov, D. Weissenborn, X. Zhai, T. Unterthiner, M. Dehghani, M. Minderer, G. Heigold, S. Gelly, J. Uszkoreit, and N. Houlsby, arXiv:2010.11929.
- Z. Liu, Y. Lin, Y. Cao, H. Hu, Y. Wei, Z. Zhang, S. Lin, and B. Guo, arXiv:2103.14030.
- C. Li, Y. Zhang, C. Cui, D. Fan, Y. Zhao, X.-B. Wu, B. He, Y. Xu, S. Li, J. Han, Y. Tao, L. Mi, H. Yang, and S. Yang, Mon. Noti. R. Astron. Soc. 506, 1651 (2021).
- N. Sahakyan, V. Vardanyan, and M. Khachatryan, Mon. Not. R. Astron. Soc. 519, 3000 (2022).
- A. Tolamatti, K. K. Singh, and K. K. Yadav, Mon. Not. R. Astron. Soc. 523, 5341 (2023).
- J. Coronado-Blázquez, Mon. Not. R. Astron. Soc. 521, 4156 (2023).
- C. Donoso-Oliva, I. Becker, P. Protopapas, G. Cabrera-Vives, M. Vishnu, and H. Vardhan, Astron. Astrophys. 670, A54 (2023).
- H. W. Leung and J. Bovy, Mon. Not. R. Astron. Soc. 527, 1494 (2023).
- Y. Gong and R. Bean, Phys. Rev. D 109, 123525 (2024).
- T. Signor et al. (Euclid Collaboration), Astron. Astrophys. 685, A127 (2024).
- J. H. Friedman, Ann. Stat. 29, 1189 (2001).
- G. Ke, Q. Meng, T. Finley, T. Wang, W. Chen, W. Ma, Q. Ye, and T.-Y. Liu, in Advances in Neural Information Processing Systems, Vol. 30 (Curran Associates, Inc, Red Hook, New York, 2017).
- A. Vaswani, N. Shazeer, N. Parmar, J. Uszkoreit, L. Jones, A. N. Gomez, Ł. Kaiser, and I. Polosukhin, in Advances in Neural Information Processing Systems, Vol. 30 (Curran Associates, Inc, Red Hook, New York, 2017).
- N. A. Maksimova, L. H. Garrison, D. J. Eisenstein, B. Hadzhiyska, S. Bose, and T. P. Satterthwaite, Mon. Not. R. Astron. Soc. 508, 4017 (2021).
- L. H. Garrison, D. J. Eisenstein, and P. A. Pinto, Mon. Not. R. Astron. Soc. 485, 3370 (2019).
- L. H. Garrison, D. J. Eisenstein, D. Ferrer, N. A. Maksimova, and P. A. Pinto, Mon. Not. R. Astron. Soc. 508, 575 (2021).
- N. Aghanim et al. (Planck Collaboration), Astron. Astrophys. 641, A6 (2020); 652, C4(E) (2021).
- S. Yuan, L. H. Garrison, B. Hadzhiyska, S. Bose, and D. J. Eisenstein, Mon. Not. R. Astron. Soc. 510, 3301 (2022).
- S. Yuan et al., Mon. Not. R. Astron. Soc. 530, 947 (2024).
- Z. Zheng, A. L. Coil, and I. Zehavi, Astrophys. J. 667, 760 (2007).
- B. Hadzhiyska et al., arXiv:2305.11935.
- J. L. Tinker, B. E. Robertson, A. V. Kravtsov, A. Klypin, M. S. Warren, G. Yepes, and S. Gottlöber, Astrophys. J. 724, 878 (2010).
- B. Hadzhiyska, L. H. Garrison, D. Eisenstein, and S. Bose, Mon. Not. R. Astron. Soc. 509, 2194 (2021).
- V. Desjacques, D. Jeong, and F. Schmidt, Phys. Rep. 733, 1 (2018).
- S. C. Hotinli, K. M. Smith, M. S. Madhavacheril, and M. Kamionkowski, Phys. Rev. D 104, 083529 (2021).
- S. C. Hotinli, E. Pierpaoli, S. Ferraro, and K. Smith, Phys. Rev. D 108, 083508 (2023).
- B. Soergel, A. Saro, T. Giannantonio, G. Efstathiou, and K. Dolag, Mon. Not. R. Astron. Soc. 478, 5320 (2018).
- B. Hadzhiyska, S. Ferraro, R. Pakmor, S. Bose, A. M. Delgado, C. Hernández-Aguayo, R. Kannan, V. Springel, S. D. M. White, and L. Hernquist, Mon. Not. R. Astron. Soc. 526, 369 (2023).
- P. G. Ferreira, R. Juszkiewicz, H. A. Feldman, M. Davis, and A. H. Jaffe, Astrophys. J. Lett. 515, L1 (1999).
- J. E. Forero-Romero, Y. Hoffman, S. Gottloeber, A. Klypin, and G. Yepes, Mon. Not. R. Astron. Soc. 396, 1815 (2009).
- L. Lucie-Smith, H. V. Peiris, and A. Pontzen, Mon. Not. R. Astron. Soc. 490, 331 (2019).
- Y. Wang et al., Mon. Not. R. Astron. Soc. 409, 737 (2010).
- B. Hadzhiyska et al. 10.5281/zenodo.19160138 (2026).
- P. Ade et al. (Simons Observatory Collaboration), J. Cosmol. Astropart. Phys. 02 (2019) 056.
- Y. Gong, R. Bean, P. A. Gallardo, E. M. Vavagiakis, N. Battaglia, and M. Niemack, Phys. Rev. D 109, 023513 (2024).
- F. A. Roper, Y.-C. Cai, and J. A. Peacock, Mon. Not. Roy. Astron. Soc. 551, stag1619 (2026).
- K. M. Górski, E. Hivon, A. J. Banday, B. D. Wandelt, F. K. Hansen, M. Reinecke, and M. Bartelman, Astrophys. J. 622, 759 (2005).
- A. Lewis and A. Challinor, CAMB: Code for Anisotropies in the Microwave Background, Astrophysics Source Code Library, record ascl:1102.026 (2011), ascl:1102.026.
- V. Calafut et al., Phys. Rev. D 104, 043502 (2021).