- Open Access
- Access by Xinjiang University
Nonholomorphic modular invariance for fermion masses and mixing in GUT
Phys. Rev. D 112, 015008 – Published 9 July, 2025
DOI: https://doi.org/10.1103/1py2-cmfx
Abstract
Addressing the fermion flavor structures using modular invariance is a challenging task in the framework of quark-lepton unification. Building on recent applications of modular symmetry in nonsupersymmetric models, we propose the first renormalizable grand unified theory incorporating level 3 nonholomorphic modular symmetry, . This framework constrains Yukawa couplings to polyharmonic Maaß forms, significantly reducing the number of free parameters while enhancing the predictive power of the models. We present a comprehensive analysis of fermion masses and mixing while tackling key grand unified theory (GUT) queries such as gauge coupling unification and proton decay. Beyond the minimal framework, the Higgs sector incorporates the dimensional Higgs field crucial in differentiating the masses of down quarks and charged leptons, and the fermion sector is extended with three right-handed neutrinos enabling neutrino masses via the type-I seesaw mechanism. We analyze two benchmark models with distinct modular weight and charge assignments. The predicted effective Majorana mass values align with current neutrinoless double-beta decay experiments, and the effective neutrino mass is within the reach of future beta decay searches. The predicted sum of neutrino masses, , satisfies the upper bound set by recent cosmological observations. The gauge coupling unification is achieved through a light scalar triplet and a scalar octet belonging to the Higgs, while proton decay constraints require that the contribution of the Higgs to the up-quark mass matrix remains highly suppressed.
Physics Subject Headings (PhySH)
Article Text
References (95)
- Y. Fukuda et al. (Super-Kamiokande Collaboration), Evidence for oscillation of atmospheric neutrinos, Phys. Rev. Lett. 81, 1562 (1998).
- Q. R. Ahmad et al. (SNO Collaboration), Direct evidence for neutrino flavor transformation from neutral current interactions in the Sudbury Neutrino Observatory, Phys. Rev. Lett. 89, 011301 (2002).
- S. Navas et al. (Particle Data Group), Review of particle physics, Phys. Rev. D 110, 030001 (2024).
- J. H. Christenson, J. W. Cronin, V. L. Fitch, and R. Turlay, Evidence for the decay of the meson, Phys. Rev. Lett. 13, 138 (1964).
- S. F. King, Unified models of neutrinos, flavour and violation, Prog. Part. Nucl. Phys. 94, 217 (2017).
- Z.-Z. Xing, Flavor structures of charged fermions and massive neutrinos, Phys. Rep. 854, 1 (2020).
- F. Feruglio and A. Romanino, Lepton flavor symmetries, Rev. Mod. Phys. 93, 015007 (2021).
- G.-J. Ding and J. W. F. Valle, The symmetry approach to quark and lepton masses and mixing, Phys. Rep. 1109, 1 (2025).
- J. C. Pati and A. Salam, Is baryon number conserved?, Phys. Rev. Lett. 31, 661 (1973).
- J. C. Pati and A. Salam, Lepton number as the fourth color, Phys. Rev. D 10, 275 (1974); 11, 703(E) (1975).
- H. Georgi and S. L. Glashow, Unity of all elementary particle forces, Phys. Rev. Lett. 32, 438 (1974).
- H. Georgi, H. R. Quinn, and S. Weinberg, Hierarchy of interactions in unified gauge theories, Phys. Rev. Lett. 33, 451 (1974).
- H. Georgi, The state of the art—gauge theories, AIP Conf. Proc. 23, 575 (1975).
- H. Fritzsch and P. Minkowski, Unified interactions of leptons and hadrons, Ann. Phys. (N.Y.) 93, 193 (1975).
- A. Takenaka et al. (Super-Kamiokande Collaboration), Search for proton decay via and with an enlarged fiducial volume in Super-Kamiokande I-IV, Phys. Rev. D 102, 112011 (2020).
- N. Sakai, Naturalness in supersymmetric GUTs, Z. Phys. C 11, 153 (1981).
- S. Dimopoulos and H. Georgi, Softly broken supersymmetry and SU(5), Nucl. Phys. B193, 150 (1981).
- J. R. Ellis, S. Kelley, and D. V. Nanopoulos, Probing the desert using gauge coupling unification, Phys. Lett. B 260, 131 (1991).
- U. Amaldi, W. de Boer, and H. Furstenau, Comparison of grand unified theories with electroweak and strong coupling constants measured at LEP, Phys. Lett. B 260, 447 (1991).
- P. Langacker and M.-x. Luo, Implications of precision electroweak experiments for , , and grand unification, Phys. Rev. D 44, 817 (1991).
- C. Giunti, C. W. Kim, and U. W. Lee, Running coupling constants and grand unification models, Mod. Phys. Lett. A 06, 1745 (1991).
- F. Feruglio, Are neutrino masses modular forms?, in From My Vast Repertoire ... (World Scientific, Singapore, 2019), pp. 227–266.
- S. Ferrara, D. Lust, A. D. Shapere, and S. Theisen, Modular invariance in supersymmetric field theories, Phys. Lett. B 225, 363 (1989).
- E. J. Chun, J. Mas, J. Lauer, and H. P. Nilles, Duality and Landau-Ginzburg models, Phys. Lett. B 233, 141 (1989).
- J. Lauer, J. Mas, and H. P. Nilles, Twisted sector representations of discrete background symmetries for two-dimensional orbifolds, Nucl. Phys. B351, 353 (1991).
- G. Altarelli and F. Feruglio, Tri-bimaximal neutrino mixing, A(4) and the modular symmetry, Nucl. Phys. B741, 215 (2006).
- C. Luhn, S. Nasri, and P. Ramond, Tri-bimaximal neutrino mixing and the family symmetry semidirect product of Z(7) and Z(3), Phys. Lett. B 652, 27 (2007).
- C. Luhn, S. Nasri, and P. Ramond, Simple finite non-Abelian flavor groups, J. Math. Phys. (N.Y.) 48, 123519 (2007).
- R. de Adelhart Toorop, F. Feruglio, and C. Hagedorn, Finite modular groups and lepton mixing, Nucl. Phys. B858, 437 (2012).
- T. Kobayashi and M. Tanimoto, Modular flavor symmetric models, Int. J. Mod. Phys. A 39, 2441012 (2024).
- G.-J. Ding and S. F. King, Neutrino mass and mixing with modular symmetry, Rep. Prog. Phys. 87, 084201 (2024).
- B.-Y. Qu and G.-J. Ding, Non-holomorphic modular flavor symmetry, J. High Energy Phys. 08 (2024) 136.
- G.-J. Ding, F. Feruglio, and X.-G. Liu, Automorphic forms and fermion masses, J. High Energy Phys. 01 (2021) 037.
- T. Nomura and H. Okada, Type-II seesaw of a non-holomorphic modular symmetry, arXiv:2408.01143.
- G.-J. Ding, J.-N. Lu, S. T. Petcov, and B.-Y. Qu, Non-holomorphic modular lepton flavour models, J. High Energy Phys. 01 (2025) 191.
- C.-C. Li, J.-N. Lu, and G.-J. Ding, Non-holomorphic modular symmetry for lepton masses and mixing, J. High Energy Phys. 12 (2024) 189.
- T. Nomura and H. Okada, Zee model in a non-holomorphic modular symmetry, arXiv:2412.18095.
- H. Okada and Y. Orikasa, A radiative seesaw in a non-holomorphic modular flavor symmetry, arXiv:2501.15748.
- T. Kobayashi, H. Okada, and Y. Orikasa, Zee-Babu model in a non-holomorphic modular symmetry and modular stabilization, arXiv:2502.12662.
- H. Ishimori, Y. Shimizu, and M. Tanimoto, S(4) flavor symmetry of quarks and leptons in SU(5) GUT, Prog. Theor. Phys. 121, 769 (2009).
- C. Hagedorn, S. F. King, and C. Luhn, A SUSY GUT of flavour with to NLO, J. High Energy Phys. 06 (2010) 048.
- C. Hagedorn, S. F. King, and C. Luhn, SUSY revisited, Phys. Lett. B 717, 207 (2012).
- M. Dimou, S. F. King, and C. Luhn, Approaching minimal flavour violation from an SUSY GUT, J. High Energy Phys. 02 (2016) 118.
- M. Dimou, S. F. King, and C. Luhn, Phenomenological implications of an SUSY GUT of flavor, Phys. Rev. D 93, 075026 (2016).
- G. Altarelli, F. Feruglio, and C. Hagedorn, A SUSY SU(5) grand unified model of tri-bimaximal mixing from , J. High Energy Phys. 03 (2008) 052.
- P. Ciafaloni, M. Picariello, E. Torrente-Lujan, and A. Urbano, Neutrino masses and tribimaximal mixing in minimal renormalizable SUSY SU(5) grand unified model with flavor symmetry, Phys. Rev. D 79, 116010 (2009).
- P. Ciafaloni, M. Picariello, A. Urbano, and E. Torrente-Lujan, Toward minimal renormalizable SUSY SU(5) grand unified model with tribimaximal mixing from flavor symmetry, Phys. Rev. D 81, 016004 (2010).
- I. K. Cooper, S. F. King, and C. Luhn, SUSY SU(5) with singlet plus adjoint matter and family symmetry, Phys. Lett. B 690, 396 (2010).
- I. K. Cooper, S. F. King, and C. Luhn, SUSY GUT of flavour with trimaximal neutrino mixing, J. High Energy Phys. 06 (2012) 130.
- F. Björkeroth, F. J. de Anda, I. de Medeiros Varzielas, and S. F. King, Towards a complete SUSY GUT, J. High Energy Phys. 06 (2015) 141.
- R. A. Laamara, M. A. Loualidi, M. Miskaoui, and E. H. Saidi, Hybrid seesaw neutrino model in SUSY , Phys. Rev. D 98, 015004 (2018).
- L. O. E. Ramos, M. Mondragón, G. Patellis, and G. Zoupanos, Flavor in SU(5) finite grand unified models, Fortschr. Phys. 72, 2400177 (2024).
- R. Ahl Laamara, M. A. Loualidi, M. Miskaoui, and E. H. Saidi, Fermion masses and mixing in model, Nucl. Phys. B916, 430 (2017).
- M. Miskaoui and M. A. Loualidi, Leptogenesis, fermion masses and mixings in a SUSY SU(5) GUT with flavor symmetry, J. High Energy Phys. 11 (2021) 147.
- M. A. Loualidi and M. Miskaoui, Unflavored leptogenesis and neutrino masses in flavored SUSY SU(5) model, in 1st Pan-African Astro-Particle and Collider Physics Workshop (2022), arXiv:2206.01052.
- G.-J. Ding, S. F. King, and C.-Y. Yao, Modular GUT, Phys. Rev. D 104, 055034 (2021).
- S. F. King and Y.-L. Zhou, Twin modular with SU(5) GUT, J. High Energy Phys. 04 (2021) 291.
- I. de Medeiros Varzielas, S. F. King, and M. Levy, A modular SU (5) littlest seesaw, J. High Energy Phys. 05 (2024) 203.
- F. J. de Anda, S. F. King, and E. Perdomo, grand unified theory with modular symmetry, Phys. Rev. D 101, 015028 (2020).
- P. Chen, G.-J. Ding, and S. F. King, SU(5) GUTs with modular symmetry, J. High Energy Phys. 04 (2021) 239.
- T. Kobayashi, Y. Shimizu, K. Takagi, M. Tanimoto, and T. H. Tatsuishi, Modular -invariant flavor model in SU(5) grand unified theory, Prog. Theor. Exp. Phys. 2020, 053B05 (2020).
- X. Du and F. Wang, SUSY breaking constraints on modular flavor invariant SU(5) GUT model, J. High Energy Phys. 02 (2021) 221.
- P. Minkowski, at a rate of one out of muon decays?, Phys. Lett. 67B, 421 (1977).
- T. Yanagida, Proceedings: Workshop on unified theory and the baryon number in the universe, KEK Report No. 79-18, 1979.
- M. Gell-Mann, P. Ramond, and R. Slansky, Complex spinors and unified theories, Conf. Proc. C 790927, 315 (1979).
- S. L. Glashow, The future of elementary particle physics, NATO Sci. Ser. B 61, 687 (1980).
- R. N. Mohapatra and G. Senjanovic, Neutrino mass and spontaneous parity nonconservation, Phys. Rev. Lett. 44, 912 (1980).
- X.-G. Liu and G.-J. Ding, Neutrino masses and mixing from double covering of finite modular groups, J. High Energy Phys. 08 (2019) 134.
- A. Borel, Automorphic Forms on Reductive Groups, Automorphic Forms and Applications, IAS/Park City Mathematics Series Vol. 12 (American Mathematical Society, Providence, Rhode Island, 2007), 5.
- A. Borel, Algebraic groups and discontinuous subgroups, in Proceedings of Symposia in Pure Mathematics (American Mathematical Society, Providence, 1966).
- J. C. Lagarias and R. C. Rhoades, Polyharmonic Maaß forms for , Ramanujan J. 41, 191 (2016).
- H. Georgi and C. Jarlskog, A new lepton—quark mass relation in a unified theory, Phys. Lett. B 86, 297 (1979).
- K. S. Babu, B. Bajc, and S. Saad, Yukawa sector of minimal SO(10) unification, J. High Energy Phys. 02 (2017) 136.
- I. Esteban, M. C. Gonzalez-Garcia, M. Maltoni, I. Martinez-Soler, J. a. P. Pinheiro, and T. Schwetz, nufit-6.0: Updated global analysis of three-flavor neutrino oscillations, J. High Energy Phys. 12 (2024) 216.
- N. Aghanim et al. (Planck Collaboration), Planck 2018 results. VI. Cosmological parameters, Astron. Astrophys. 641, A6 (2020); 652, C4(E) (2021).
- S. Abe et al. (KamLAND-Zen Collaboration), Search for Majorana neutrinos with the complete KamLAND-Zen dataset, arXiv:2406.11438.
- N. Abgrall et al. (LEGEND Collaboration), The large enriched germanium experiment for neutrinoless decay: LEGEND-1000 preconceptual design report, arXiv:2107.11462.
- G. Adhikari et al. (nEXO Collaboration), nEXO: Neutrinoless double beta decay search beyond half-life sensitivity, J. Phys. G 49, 015104 (2022).
- M. Aker et al. (Katrin Collaboration), Direct neutrino-mass measurement based on 259 days of KATRIN data, Science 388, 180 (2025).
- M. Aker et al. (KATRIN Collaboration), The design, construction, and commissioning of the KATRIN experiment, J. Instrum. 16, T08015 (2021).
- A. Baur, flavorpy, 10.5281/zenodo.11060597 (2024).
- M. Belfkir, M. A. Loualidi, and S. Nasri, Fermion masses and mixing in Pati-Salam unification with modular symmetry, Prog. Theor. Exp. Phys. 2025, 033B05 (2025).
- A. Ashtari Esfahani et al. (Project 8 Collaboration), Determining the neutrino mass with cyclotron radiation emission spectroscopy—Project 8, J. Phys. G 44, 054004 (2017).
- T. Goto, S. Mishima, and T. Shindou, Flavor physics in SU(5) GUT with scalar fields in the 45 representation, Phys. Rev. D 108, 095012 (2023).
- N. Haba, K. Nagano, Y. Shimizu, and T. Yamada, Gauge coupling unification and proton decay via 45 Higgs boson in SU(5) GUT, Prog. Theor. Exp. Phys. 2024, 053B05 (2024).
- N. Haba, K. Nagano, Y. Shimizu, and T. Yamada, Proton decay and gauge coupling unification in an extended SU(5) GUT with 45D Higgs, Prog. Theor. Exp. Phys. 2024, 103B04 (2024).
- P. Nath and P. Fileviez Perez, Proton stability in grand unified theories, in strings and in branes, Phys. Rep. 441, 191 (2007).
- I. Dorsner, S. Fajfer, and N. Kosnik, Heavy and light scalar leptoquarks in proton decay, Phys. Rev. D 86, 015013 (2012).
- I. Dorsner, A scalar leptoquark in SU(5), Phys. Rev. D 86, 055009 (2012).
- V. Khachatryan et al. (CMS Collaboration), Search for narrow resonances decaying to dijets in proton-proton collisions at , Phys. Rev. Lett. 116, 071801 (2016).
- K. Abe et al. (Hyper-Kamiokande Collaboration), Hyper-Kamiokande design report, arXiv:1805.04163.
- R. Ahl Laamara, M. A. Loualidi, and E. H. Saidi, Type II seesaw supersymmetric neutrino model for , Phys. Rev. D 93, 113005 (2016).
- M. A. Ouahid, M. A. Loualidi, R. A. Laamara, and E. H. Saidi, Neutrino phenomenology in the flavored NMSSM without domain wall problems, Phys. Rev. D 102, 115023 (2020).
- P. Kalyniak and J. N. Ng, Symmetry breaking patterns in SU(5) with nonminimal Higgs fields, Phys. Rev. D 26, 890 (1982).
- P. Eckert, J. M. Gerard, H. Ruegg, and T. Schucker, Minimization of the SU(5) invariant scalar potential for the fortyfive-dimensional representation, Phys. Lett. 125B, 385 (1983).