Reuse & Permissions

It is not necessary to obtain permission to reuse this article or its components as it is available under the terms of the Creative Commons Attribution 4.0 International license. This license permits unrestricted use, distribution, and reproduction in any medium, provided attribution to the author(s) and the published article's title, journal citation, and DOI are maintained. Please note that some figures may have been included with permission from other third parties. It is your responsibility to obtain the proper permission from the rights holder directly for these figures.

Export citation

Export citation

Choose format for download:

Download Citation
  • Open Access
  • Access by Xinjiang University

Nonholomorphic A4 modular invariance for fermion masses and mixing in SU(5) GUT

Mohamed Amin Loualidi1, Mohamed Miskaoui2, and Salah Nasri1,*

  • *Contact author: snasri@uaeu.ac.ae, salah.nasri@cern.ch

Phys. Rev. D 112, 015008 – Published 9 July, 2025

DOI: https://doi.org/10.1103/1py2-cmfx

Abstract

Addressing the fermion flavor structures using modular invariance is a challenging task in the framework of quark-lepton unification. Building on recent applications of modular symmetry in nonsupersymmetric models, we propose the first renormalizable SU(5) grand unified theory incorporating level 3 nonholomorphic modular symmetry, Γ3A4. This framework constrains Yukawa couplings to polyharmonic Maaß forms, significantly reducing the number of free parameters while enhancing the predictive power of the models. We present a comprehensive analysis of fermion masses and mixing while tackling key grand unified theory (GUT) queries such as gauge coupling unification and proton decay. Beyond the minimal SU(5) framework, the Higgs sector incorporates the 45H dimensional Higgs field crucial in differentiating the masses of down quarks and charged leptons, and the fermion sector is extended with three right-handed neutrinos enabling neutrino masses via the type-I seesaw mechanism. We analyze two benchmark models with distinct modular weight and A4 charge assignments. The predicted effective Majorana mass mββ values align with current neutrinoless double-beta decay experiments, and the effective neutrino mass mβ is within the reach of future beta decay searches. The predicted sum of neutrino masses, mi, satisfies the upper bound set by recent cosmological observations. The gauge coupling unification is achieved through a light scalar triplet ϕ3(3,3,1/3) and a scalar octet ϕ5(8,2,1/2) belonging to the 45H Higgs, while proton decay constraints require that the contribution of the 45H Higgs to the up-quark mass matrix remains highly suppressed.

View figure in article

Physics Subject Headings (PhySH)

Article Text

References (95)

  1. Y. Fukuda et al. (Super-Kamiokande Collaboration), Evidence for oscillation of atmospheric neutrinos, Phys. Rev. Lett. 81, 1562 (1998).
  2. Q. R. Ahmad et al. (SNO Collaboration), Direct evidence for neutrino flavor transformation from neutral current interactions in the Sudbury Neutrino Observatory, Phys. Rev. Lett. 89, 011301 (2002).
  3. S. Navas et al. (Particle Data Group), Review of particle physics, Phys. Rev. D 110, 030001 (2024).
  4. J. H. Christenson, J. W. Cronin, V. L. Fitch, and R. Turlay, Evidence for the 2π decay of the K20 meson, Phys. Rev. Lett. 13, 138 (1964).
  5. S. F. King, Unified models of neutrinos, flavour and CP violation, Prog. Part. Nucl. Phys. 94, 217 (2017).
  6. Z.-Z. Xing, Flavor structures of charged fermions and massive neutrinos, Phys. Rep. 854, 1 (2020).
  7. F. Feruglio and A. Romanino, Lepton flavor symmetries, Rev. Mod. Phys. 93, 015007 (2021).
  8. G.-J. Ding and J. W. F. Valle, The symmetry approach to quark and lepton masses and mixing, Phys. Rep. 1109, 1 (2025).
  9. J. C. Pati and A. Salam, Is baryon number conserved?, Phys. Rev. Lett. 31, 661 (1973).
  10. J. C. Pati and A. Salam, Lepton number as the fourth color, Phys. Rev. D 10, 275 (1974); 11, 703(E) (1975).
  11. H. Georgi and S. L. Glashow, Unity of all elementary particle forces, Phys. Rev. Lett. 32, 438 (1974).
  12. H. Georgi, H. R. Quinn, and S. Weinberg, Hierarchy of interactions in unified gauge theories, Phys. Rev. Lett. 33, 451 (1974).
  13. H. Georgi, The state of the art—gauge theories, AIP Conf. Proc. 23, 575 (1975).
  14. H. Fritzsch and P. Minkowski, Unified interactions of leptons and hadrons, Ann. Phys. (N.Y.) 93, 193 (1975).
  15. A. Takenaka et al. (Super-Kamiokande Collaboration), Search for proton decay via pe+π0 and pμ+π0 with an enlarged fiducial volume in Super-Kamiokande I-IV, Phys. Rev. D 102, 112011 (2020).
  16. N. Sakai, Naturalness in supersymmetric GUTs, Z. Phys. C 11, 153 (1981).
  17. S. Dimopoulos and H. Georgi, Softly broken supersymmetry and SU(5), Nucl. Phys. B193, 150 (1981).
  18. J. R. Ellis, S. Kelley, and D. V. Nanopoulos, Probing the desert using gauge coupling unification, Phys. Lett. B 260, 131 (1991).
  19. U. Amaldi, W. de Boer, and H. Furstenau, Comparison of grand unified theories with electroweak and strong coupling constants measured at LEP, Phys. Lett. B 260, 447 (1991).
  20. P. Langacker and M.-x. Luo, Implications of precision electroweak experiments for Mt, ρ0, sin2θW and grand unification, Phys. Rev. D 44, 817 (1991).
  21. C. Giunti, C. W. Kim, and U. W. Lee, Running coupling constants and grand unification models, Mod. Phys. Lett. A 06, 1745 (1991).
  22. F. Feruglio, Are neutrino masses modular forms?, in From My Vast Repertoire ... (World Scientific, Singapore, 2019), pp. 227–266.
  23. S. Ferrara, D. Lust, A. D. Shapere, and S. Theisen, Modular invariance in supersymmetric field theories, Phys. Lett. B 225, 363 (1989).
  24. E. J. Chun, J. Mas, J. Lauer, and H. P. Nilles, Duality and Landau-Ginzburg models, Phys. Lett. B 233, 141 (1989).
  25. J. Lauer, J. Mas, and H. P. Nilles, Twisted sector representations of discrete background symmetries for two-dimensional orbifolds, Nucl. Phys. B351, 353 (1991).
  26. G. Altarelli and F. Feruglio, Tri-bimaximal neutrino mixing, A(4) and the modular symmetry, Nucl. Phys. B741, 215 (2006).
  27. C. Luhn, S. Nasri, and P. Ramond, Tri-bimaximal neutrino mixing and the family symmetry semidirect product of Z(7) and Z(3), Phys. Lett. B 652, 27 (2007).
  28. C. Luhn, S. Nasri, and P. Ramond, Simple finite non-Abelian flavor groups, J. Math. Phys. (N.Y.) 48, 123519 (2007).
  29. R. de Adelhart Toorop, F. Feruglio, and C. Hagedorn, Finite modular groups and lepton mixing, Nucl. Phys. B858, 437 (2012).
  30. T. Kobayashi and M. Tanimoto, Modular flavor symmetric models, Int. J. Mod. Phys. A 39, 2441012 (2024).
  31. G.-J. Ding and S. F. King, Neutrino mass and mixing with modular symmetry, Rep. Prog. Phys. 87, 084201 (2024).
  32. B.-Y. Qu and G.-J. Ding, Non-holomorphic modular flavor symmetry, J. High Energy Phys. 08 (2024) 136.
  33. G.-J. Ding, F. Feruglio, and X.-G. Liu, Automorphic forms and fermion masses, J. High Energy Phys. 01 (2021) 037.
  34. T. Nomura and H. Okada, Type-II seesaw of a non-holomorphic modular A4 symmetry, arXiv:2408.01143.
  35. G.-J. Ding, J.-N. Lu, S. T. Petcov, and B.-Y. Qu, Non-holomorphic modular S4 lepton flavour models, J. High Energy Phys. 01 (2025) 191.
  36. C.-C. Li, J.-N. Lu, and G.-J. Ding, Non-holomorphic modular A5 symmetry for lepton masses and mixing, J. High Energy Phys. 12 (2024) 189.
  37. T. Nomura and H. Okada, Zee model in a non-holomorphic modular A4 symmetry, arXiv:2412.18095.
  38. H. Okada and Y. Orikasa, A radiative seesaw in a non-holomorphic modular S3 flavor symmetry, arXiv:2501.15748.
  39. T. Kobayashi, H. Okada, and Y. Orikasa, Zee-Babu model in a non-holomorphic modular A4 symmetry and modular stabilization, arXiv:2502.12662.
  40. H. Ishimori, Y. Shimizu, and M. Tanimoto, S(4) flavor symmetry of quarks and leptons in SU(5) GUT, Prog. Theor. Phys. 121, 769 (2009).
  41. C. Hagedorn, S. F. King, and C. Luhn, A SUSY GUT of flavour with S4×SU(5) to NLO, J. High Energy Phys. 06 (2010) 048.
  42. C. Hagedorn, S. F. King, and C. Luhn, SUSY S4×SU(5) revisited, Phys. Lett. B 717, 207 (2012).
  43. M. Dimou, S. F. King, and C. Luhn, Approaching minimal flavour violation from an SU(5)×S4×U(1) SUSY GUT, J. High Energy Phys. 02 (2016) 118.
  44. M. Dimou, S. F. King, and C. Luhn, Phenomenological implications of an SU(5)×S4×U(1) SUSY GUT of flavor, Phys. Rev. D 93, 075026 (2016).
  45. G. Altarelli, F. Feruglio, and C. Hagedorn, A SUSY SU(5) grand unified model of tri-bimaximal mixing from A4, J. High Energy Phys. 03 (2008) 052.
  46. P. Ciafaloni, M. Picariello, E. Torrente-Lujan, and A. Urbano, Neutrino masses and tribimaximal mixing in minimal renormalizable SUSY SU(5) grand unified model with A4 flavor symmetry, Phys. Rev. D 79, 116010 (2009).
  47. P. Ciafaloni, M. Picariello, A. Urbano, and E. Torrente-Lujan, Toward minimal renormalizable SUSY SU(5) grand unified model with tribimaximal mixing from A4 flavor symmetry, Phys. Rev. D 81, 016004 (2010).
  48. I. K. Cooper, S. F. King, and C. Luhn, SUSY SU(5) with singlet plus adjoint matter and A4 family symmetry, Phys. Lett. B 690, 396 (2010).
  49. I. K. Cooper, S. F. King, and C. Luhn, A4xSU(5) SUSY GUT of flavour with trimaximal neutrino mixing, J. High Energy Phys. 06 (2012) 130.
  50. F. Björkeroth, F. J. de Anda, I. de Medeiros Varzielas, and S. F. King, Towards a complete A4×SU(5) SUSY GUT, J. High Energy Phys. 06 (2015) 141.
  51. R. A. Laamara, M. A. Loualidi, M. Miskaoui, and E. H. Saidi, Hybrid seesaw neutrino model in SUSY SU(5)×A4, Phys. Rev. D 98, 015004 (2018).
  52. L. O. E. Ramos, M. Mondragón, G. Patellis, and G. Zoupanos, Flavor in SU(5) finite grand unified models, Fortschr. Phys. 72, 2400177 (2024).
  53. R. Ahl Laamara, M. A. Loualidi, M. Miskaoui, and E. H. Saidi, Fermion masses and mixing in SU(5)×D4×U(1) model, Nucl. Phys. B916, 430 (2017).
  54. M. Miskaoui and M. A. Loualidi, Leptogenesis, fermion masses and mixings in a SUSY SU(5) GUT with D4 flavor symmetry, J. High Energy Phys. 11 (2021) 147.
  55. M. A. Loualidi and M. Miskaoui, Unflavored leptogenesis and neutrino masses in flavored SUSY SU(5) model, in 1st Pan-African Astro-Particle and Collider Physics Workshop (2022), arXiv:2206.01052.
  56. G.-J. Ding, S. F. King, and C.-Y. Yao, Modular S4×SU(5) GUT, Phys. Rev. D 104, 055034 (2021).
  57. S. F. King and Y.-L. Zhou, Twin modular S4 with SU(5) GUT, J. High Energy Phys. 04 (2021) 291.
  58. I. de Medeiros Varzielas, S. F. King, and M. Levy, A modular SU (5) littlest seesaw, J. High Energy Phys. 05 (2024) 203.
  59. F. J. de Anda, S. F. King, and E. Perdomo, SU(5) grand unified theory with A4 modular symmetry, Phys. Rev. D 101, 015028 (2020).
  60. P. Chen, G.-J. Ding, and S. F. King, SU(5) GUTs with A4 modular symmetry, J. High Energy Phys. 04 (2021) 239.
  61. T. Kobayashi, Y. Shimizu, K. Takagi, M. Tanimoto, and T. H. Tatsuishi, Modular S3-invariant flavor model in SU(5) grand unified theory, Prog. Theor. Exp. Phys. 2020, 053B05 (2020).
  62. X. Du and F. Wang, SUSY breaking constraints on modular flavor S3 invariant SU(5) GUT model, J. High Energy Phys. 02 (2021) 221.
  63. P. Minkowski, μeγ at a rate of one out of 109 muon decays?, Phys. Lett. 67B, 421 (1977).
  64. T. Yanagida, Proceedings: Workshop on unified theory and the baryon number in the universe, KEK Report No. 79-18, 1979.
  65. M. Gell-Mann, P. Ramond, and R. Slansky, Complex spinors and unified theories, Conf. Proc. C 790927, 315 (1979).
  66. S. L. Glashow, The future of elementary particle physics, NATO Sci. Ser. B 61, 687 (1980).
  67. R. N. Mohapatra and G. Senjanovic, Neutrino mass and spontaneous parity nonconservation, Phys. Rev. Lett. 44, 912 (1980).
  68. X.-G. Liu and G.-J. Ding, Neutrino masses and mixing from double covering of finite modular groups, J. High Energy Phys. 08 (2019) 134.
  69. A. Borel, Automorphic Forms on Reductive Groups, Automorphic Forms and Applications, IAS/Park City Mathematics Series Vol. 12 (American Mathematical Society, Providence, Rhode Island, 2007), 5.
  70. A. Borel, Algebraic groups and discontinuous subgroups, in Proceedings of Symposia in Pure Mathematics (American Mathematical Society, Providence, 1966).
  71. J. C. Lagarias and R. C. Rhoades, Polyharmonic Maaß forms for psl(2,z), Ramanujan J. 41, 191 (2016).
  72. H. Georgi and C. Jarlskog, A new lepton—quark mass relation in a unified theory, Phys. Lett. B 86, 297 (1979).
  73. K. S. Babu, B. Bajc, and S. Saad, Yukawa sector of minimal SO(10) unification, J. High Energy Phys. 02 (2017) 136.
  74. I. Esteban, M. C. Gonzalez-Garcia, M. Maltoni, I. Martinez-Soler, J. a. P. Pinheiro, and T. Schwetz, nufit-6.0: Updated global analysis of three-flavor neutrino oscillations, J. High Energy Phys. 12 (2024) 216.
  75. N. Aghanim et al. (Planck Collaboration), Planck 2018 results. VI. Cosmological parameters, Astron. Astrophys. 641, A6 (2020); 652, C4(E) (2021).
  76. S. Abe et al. (KamLAND-Zen Collaboration), Search for Majorana neutrinos with the complete KamLAND-Zen dataset, arXiv:2406.11438.
  77. N. Abgrall et al. (LEGEND Collaboration), The large enriched germanium experiment for neutrinoless ββ decay: LEGEND-1000 preconceptual design report, arXiv:2107.11462.
  78. G. Adhikari et al. (nEXO Collaboration), nEXO: Neutrinoless double beta decay search beyond 1028year half-life sensitivity, J. Phys. G 49, 015104 (2022).
  79. M. Aker et al. (Katrin Collaboration), Direct neutrino-mass measurement based on 259 days of KATRIN data, Science 388, 180 (2025).
  80. M. Aker et al. (KATRIN Collaboration), The design, construction, and commissioning of the KATRIN experiment, J. Instrum. 16, T08015 (2021).
  81. A. Baur, flavorpy, 10.5281/zenodo.11060597 (2024).
  82. M. Belfkir, M. A. Loualidi, and S. Nasri, Fermion masses and mixing in Pati-Salam unification with S3 modular symmetry, Prog. Theor. Exp. Phys. 2025, 033B05 (2025).
  83. A. Ashtari Esfahani et al. (Project 8 Collaboration), Determining the neutrino mass with cyclotron radiation emission spectroscopy—Project 8, J. Phys. G 44, 054004 (2017).
  84. T. Goto, S. Mishima, and T. Shindou, Flavor physics in SU(5) GUT with scalar fields in the 45 representation, Phys. Rev. D 108, 095012 (2023).
  85. N. Haba, K. Nagano, Y. Shimizu, and T. Yamada, Gauge coupling unification and proton decay via 45 Higgs boson in SU(5) GUT, Prog. Theor. Exp. Phys. 2024, 053B05 (2024).
  86. N. Haba, K. Nagano, Y. Shimizu, and T. Yamada, Proton decay and gauge coupling unification in an extended SU(5) GUT with 45D Higgs, Prog. Theor. Exp. Phys. 2024, 103B04 (2024).
  87. P. Nath and P. Fileviez Perez, Proton stability in grand unified theories, in strings and in branes, Phys. Rep. 441, 191 (2007).
  88. I. Dorsner, S. Fajfer, and N. Kosnik, Heavy and light scalar leptoquarks in proton decay, Phys. Rev. D 86, 015013 (2012).
  89. I. Dorsner, A scalar leptoquark in SU(5), Phys. Rev. D 86, 055009 (2012).
  90. V. Khachatryan et al. (CMS Collaboration), Search for narrow resonances decaying to dijets in proton-proton collisions at s=13TeV, Phys. Rev. Lett. 116, 071801 (2016).
  91. K. Abe et al. (Hyper-Kamiokande Collaboration), Hyper-Kamiokande design report, arXiv:1805.04163.
  92. R. Ahl Laamara, M. A. Loualidi, and E. H. Saidi, Type II seesaw supersymmetric neutrino model for θ130, Phys. Rev. D 93, 113005 (2016).
  93. M. A. Ouahid, M. A. Loualidi, R. A. Laamara, and E. H. Saidi, Neutrino phenomenology in the flavored NMSSM without domain wall problems, Phys. Rev. D 102, 115023 (2020).
  94. P. Kalyniak and J. N. Ng, Symmetry breaking patterns in SU(5) with nonminimal Higgs fields, Phys. Rev. D 26, 890 (1982).
  95. P. Eckert, J. M. Gerard, H. Ruegg, and T. Schucker, Minimization of the SU(5) invariant scalar potential for the fortyfive-dimensional representation, Phys. Lett. 125B, 385 (1983).

Outline

Information

Sign In to Your Journals Account

Filter

Filter

Article Lookup

Enter a citation