- Access by Xinjiang University
Denoising diffusion models with geometry adaptation for high fidelity calorimeter simulation
Phys. Rev. D 108, 072014 – Published 27 October, 2023
DOI: https://doi.org/10.1103/PhysRevD.108.072014
Abstract
Simulation is crucial for all aspects of collider data analysis, but the available computing budget in the High Luminosity LHC era will be severely constrained. Generative machine learning models may act as surrogates to replace physics-based full simulation of particle detectors, and diffusion models have recently emerged as the state of the art for other generative tasks. We introduce CaloDiffusion, a denoising diffusion model trained on the public CaloChallenge datasets to generate calorimeter showers. Our algorithm employs 3D cylindrical convolutions, which take advantage of symmetries of the underlying data representation. To handle irregular detector geometries, we augment the diffusion model with a new geometry latent mapping (GLaM) layer to learn forward and reverse transformations to a regular geometry that is suitable for cylindrical convolutions. The showers generated by our approach are nearly indistinguishable from the full simulation, as measured by several different metrics.
Physics Subject Headings (PhySH)
Article Text
References (63)
- S. Agostinelli et al. (geant4 Collaboration), geant4–a simulation toolkit, Nucl. Instrum. Methods Phys. Res., Sect. A 506, 250 (2003).
- J. Allison et al., geant4 developments and applications, IEEE Trans. Nucl. Sci. 53, 270 (2006).
- J. Allison et al., Recent developments in geant4, Nucl. Instrum. Methods Phys. Res., Sect. A 835, 186 (2016).
- J. Apostolakis et al. (HEP Software Foundation Collaboration), HEP software foundation community white paper working group—detector simulation, arXiv:1803.04165.
- CMS Collaboration, The phase-2 upgrade of the CMS endcap calorimeter, CMS Technical Design Report, Reports No. CERN-LHCC-2017-023, No. CMS-TDR-019, 2017, https://cds.cern.ch/record/2293646.
- K. Pedro (CMS Collaboration), Integration and performance of new technologies in the CMS simulation, EPJ Web Conf. 245, 02020 (2020).
- X. Ju et al., Performance of a geometric deep learning pipeline for HL-LHC particle tracking, Eur. Phys. J. C 81, 876 (2021).
- S. Abdullin, P. Azzi, F. Beaudette, P. Janot, and A. Perrotta, The fast simulation of the CMS detector at LHC, J. Phys. Conf. Ser. 331, 032049 (2011).
- A. Giammanco, The fast simulation of the CMS experiment, J. Phys. Conf. Ser. 513, 022012 (2014).
- S. Sekmen (CMS Collaboration), Recent developments in CMS fast simulation, Proc. Sci., ICHEP20162016 (2016) 181 [arXiv:1701.03850].
- M. Beckingham, M. Duehrssen, E. Schmidt, M. Shapiro, M. Venturi, J. Virzi, I. Vivarelli, M. Werner, S. Yamamoto, and T. Yamanaka (ATLAS Collaboration), The simulation principle and performance of the ATLAS fast calorimeter simulation FastCaloSim, Report No. ATL-PHYS-PUB-2010-013, CERN, Geneva, 2010, http://cds.cern.ch/record/1300517.
- W. Lukas, Fast simulation for ATLAS: Atlfast-II and ISF, J. Phys. Conf. Ser. 396, 022031 (2012).
- ATLAS Collaboration, AtlFast3: The next generation of fast simulation in ATLAS, Comput. Software Big Sci. 6, 7 (2022).
- M. Paganini, L. de Oliveira, and B. Nachman, CaloGAN: Simulating 3D high energy particle showers in multilayer electromagnetic calorimeters with generative adversarial networks, Phys. Rev. D 97, 014021 (2018).
- V. Chekalina, E. Orlova, F. Ratnikov, D. Ulyanov, A. Ustyuzhanin, and E. Zakharov, Generative models for fast calorimeter simulation: The LHCb case, EPJ Web Conf. 214, 02034 (2019).
- ATLAS Collaboration, Fast simulation of the ATLAS calorimeter system with generative adversarial networks, Report No. ATL-SOFT-PUB-2020-006, CERN, Geneva, 2020, https://cds.cern.ch/record/2746032.
- E. Buhmann, S. Diefenbacher, E. Eren, F. Gaede, G. Kasieczka, A. Korol, and K. Krüger, Getting high: High fidelity simulation of high granularity calorimeters with high speed, Comput. Software Big Sci. 5, 13 (2021).
- S. Diefenbacher, E. Eren, G. Kasieczka, A. Korol, B. Nachman, and D. Shih, DCTRGAN: Improving the precision of generative models with reweighting, J. Instrum. 15, P11004 (2020).
- C. Krause and D. Shih, Fast and accurate simulations of calorimeter showers with normalizing flows, Phys. Rev. D 107, 113003 (2023).
- C. Krause and D. Shih, Accelerating accurate simulations of calorimeter showers with normalizing flows and probability density distillation, Phys. Rev. D 107, 113004 (2023).
- E. Buhmann, S. Diefenbacher, E. Eren, F. Gaede, G. Kasieczka, A. Korol, and K. Krüger, Decoding photons: Physics in the latent space of a BIB-AE generative network, EPJ Web Conf. 251, 03003 (2021).
- ATLAS Collaboration, Deep generative models for fast photon shower simulation in ATLAS, arXiv:2210.06204.
- E. Buhmann, S. Diefenbacher, D. Hundhausen, G. Kasieczka, W. Korcari, E. Eren, F. Gaede, K. Krüger, P. McKeown, and L. Rustige, Hadrons, better, faster, stronger, Mach. Learn. Sci. Tech. 3, 025014 (2022).
- V. Mikuni and B. Nachman, Score-based generative models for calorimeter shower simulation, Phys. Rev. D 106, 092009 (2022).
- E. Buhmann, G. Kasieczka, and J. Thaler, EPiC-GAN: Equivariant point cloud generation for particle jets, arXiv:2301.08128.
- S. Diefenbacher, E. Eren, F. Gaede, G. Kasieczka, C. Krause, I. Shekhzadeh, and D. Shih, L2LFlows: Generating high-fidelity 3D calorimeter images, arXiv:2302.11594.
- H. Hashemi, N. Hartmann, S. Sharifzadeh, J. Kahn, and T. Kuhr, Ultra-high-resolution detector simulation with intra-event aware GAN and self-supervised relational reasoning, arXiv:2303.08046.
- S. Diefenbacher, E. Eren, F. Gaede, G. Kasieczka, A. Korol, K. Krüger, P. McKeown, and L. Rustige, New angles on fast calorimeter shower simulation, Mach. Learn. Sci. Tech. 4, 035044 (2023).
- V. Mikuni, B. Nachman, and M. Pettee, Fast point cloud generation with diffusion models in high energy physics, Phys. Rev. D 108, 036025 (2023).
- E. Buhmann, S. Diefenbacher, E. Eren, F. Gaede, G. Kasieczka, A. Korol, W. Korcari, K. Krüger, and P. McKeown, CaloClouds: Fast geometry-independent highly-granular calorimeter simulation, arXiv:2305.04847.
- M. R. Buckley, C. Krause, I. Pang, and D. Shih, Inductive CaloFlow, arXiv:2305.11934.
- V. Mikuni and B. Nachman, CaloScore v2: Single-shot calorimeter shower simulation with diffusion models, arXiv:2308.03847.
- A. Adelmann et al., New directions for surrogate models and differentiable programming for High Energy Physics detector simulation, arXiv:2203.08806.
- S. Badger et al., Machine learning and LHC event generation, SciPost Phys. 14, 079 (2023).
- M. Barbetti, Lamarr: LHCb ultra-fast simulation based on machine learning models deployed within Gauss, in Proceedings of the 21th International Workshop on Advanced Computing and Analysis Techniques in Physics Research: AI meets Reality (2023), arXiv:2303.11428.
- J. Ho, A. Jain, and P. Abbeel, Denoising diffusion probabilistic models, in Advances in Neural Information Processing Systems, edited by H. Larochelle, M. Ranzato, R. Hadsell, M. Balcan, and H. Lin (Curran Associates, Inc., Red Hook, New York, 2020), vol. 33, p. 6840.
- R. Rombach, A. Blattmann, D. Lorenz, P. Esser, and B. Ommer, High-resolution image synthesis with latent diffusion models, in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) (2022), p. 10684, arXiv:2112.10752.
- T. Karras, M. Aittala, T. Aila, and S. Laine, Elucidating the design space of diffusion-based generative models, arXiv:2206.00364.
- F. T. Acosta, V. Mikuni, B. Nachman, M. Arratia, K. Barish, B. Karki, R. Milton, P. Karande, and A. Angerami, Comparison of point cloud and image-based models for calorimeter fast simulation, arXiv:2307.04780.
- M. Leigh, D. Sengupta, J. A. Raine, G. Quétant, and T. Golling, PC-Droid: Faster diffusion and improved quality for particle cloud generation, arXiv:2307.06836.
- A. Shmakov, K. Greif, M. Fenton, A. Ghosh, P. Baldi, and D. Whiteson, End-to-end latent variational diffusion models for inverse problems in high energy physics, arXiv:2305.10399.
- A. Butter, N. Huetsch, S. P. Schweitzer, T. Plehn, P. Sorrenson, and J. Spinner, Jet diffusion versus JetGPT—modern networks for the LHC, arXiv:2305.10475.
- V. Mikuni and B. Nachman, High-dimensional and permutation invariant anomaly detection, arXiv:2306.03933.
- M. F. Giannelli, G. Kasieczka, C. Krause, B. Nachman, D. Salamani, D. Shih, and A. Zaborowska, Fast calorimeter simulation challenge, 2022, https://calochallenge.github.io/homepage/.
- ATLAS Collaboration, Datasets used to train the generative adversarial networks used in ATLFast3, 10.7483/OPENDATA.ATLAS.UXKX.TXBN (2021).
- A. Q. Nichol and P. Dhariwal, Improved denoising diffusion probabilistic models, in Proceedings of the 38th International Conference on Machine Learning, edited by M. Meila and T. Zhang, Vol. 139 of Proceedings of Machine Learning Research (PMLR, 2021), p. 8162, arXiv:2102.09672.
- O. Ronneberger, P. Fischer, and T. Brox, U-net: Convolutional networks for biomedical image segmentation, in Proceedings of the Medical Image Computing and Computer-Assisted Intervention—MICCAI 2015, edited by N. Navab, J. Hornegger, W. M. Wells, and A. F. Frangi (Springer International Publishing, Cham, 2015), p. 234, arXiv:1505.04597.
- K. He, X. Zhang, S. Ren, and J. Sun, Deep residual learning for image recognition, in Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) (2016), p. 770, arXiv:1512.03385.
- A. Katharopoulos, A. Vyas, N. Pappas, and F. Fleuret, Transformers are RNNs: Fast autoregressive transformers with linear attention, arXiv:2006.16236.
- R. Zhang, P. Isola, A. A. Efros, E. Shechtman, and O. Wang, The unreasonable effectiveness of deep features as a perceptual metric, in Proceedings of the 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), (IEEE Computer Society, Los Alamitos, CA, USA, 2018), p. 586, arXiv:1801.03924.
- R. Das, L. Favaro, T. Heimel, C. Krause, T. Plehn, and D. Shih, How to understand limitations of generative networks, arXiv:2305.16774.
- R. Kansal, A. Li, J. Duarte, N. Chernyavskaya, M. Pierini, B. Orzari, and T. Tomei, Evaluating generative models in high energy physics, Phys. Rev. D 107, 076017 (2023).
- N. Srivastava, G. Hinton, A. Krizhevsky, I. Sutskever, and R. Salakhutdinov, Dropout: A simple way to prevent neural networks from overfitting, J. Mach. Learn. Res. 15, 1929 (2014).
- C. Krause, I. Pang, and D. Shih, CaloFlow for calochallenge dataset 1, arXiv:2210.14245.
- R. Kansal, J. Duarte, C. Pareja, L. Action, Z. Hao, and mova, jet-net/JetNet: v0.2.3.post3, 10.5281/zenodo.7778868 (2023).
- C. Krause, The Fast Calorimeter Challenge 2022: Results and The Road Ahead, CaloChallenge Workshop (2023), https://agenda.infn.it/event/34036/contributions/200888/attachments/106010/149192/CaloChallenge.Summary.C.Krause.pdf.
- T. Salimans and J. Ho, Progressive distillation for fast sampling of diffusion models, in Proceedings of the International Conference on Learning Representations (2022), arXiv:2202.00512.
- Y. Song, P. Dhariwal, M. Chen, and I. Sutskever, Consistency models, arXiv:2303.01469.
- A. Bansal, E. Borgnia, H.-M. Chu, J. S. Li, H. Kazemi, F. Huang, M. Goldblum, J. Geiping, and T. Goldstein, Cold diffusion: Inverting arbitrary image transforms without noise, arXiv:2208.09392.
- S. Banerjee, B. C. Rodriguez, L. Franklin, H. G. De La Cruz, T. Leininger, S. Norberg, K. Pedro, A. Rosado Trinidad, and Y. Ye, Denoising convolutional networks to accelerate detector simulation, J. Phys. Conf. Ser. 2438, 012079 (2023).
- S. Diefenbacher, V. Mikuni, and B. Nachman, Refining fast calorimeter simulations with a Schrödinger bridge, arXiv:2308.12339.
- S. Bein, P. Connor, K. Pedro, P. Schleper, and M. Wolf, Refining fast simulation using machine learning, in Proceedings of the 26th International Conference on Computing in High Energy & Nuclear Physics (2023), arXiv:2309.12919.
- O. Amram and K. Pedro, CaloDiffusion github repository, https://github.com/OzAmram/CaloDiffusionPaper/blob/main/README.md, (2023).