- Physical Review Journals
All JournalsPhysics Magazine
Access Provided by Xinjiang University

Physical Review D

Export citation

Export citation

Choose format for download:

Download Citation
  • Access by Xinjiang University

Deep neural networks to enable real-time multimessenger astrophysics

Daniel George1,2,* and E. A. Huerta1,2

  • 1Department of Astronomy, University of Illinois at Urbana-Champaign, Urbana, Illinois 61801, USA
  • 2NCSA, University of Illinois at Urbana-Champaign, Urbana, Illinois 61801, USA

  • *Corresponding author. dgeorge5@illinois.edu
PDF

Phys. Rev. D 97, 044039 – Published 26 February, 2018

DOI: https://doi.org/10.1103/PhysRevD.97.044039

Abstract

Gravitational wave astronomy has set in motion a scientific revolution. To further enhance the science reach of this emergent field of research, there is a pressing need to increase the depth and speed of the algorithms used to enable these ground-breaking discoveries. We introduce Deep Filtering—a new scalable machine learning method for end-to-end time-series signal processing. Deep Filtering is based on deep learning with two deep convolutional neural networks, which are designed for classification and regression, to detect gravitational wave signals in highly noisy time-series data streams and also estimate the parameters of their sources in real time. Acknowledging that some of the most sensitive algorithms for the detection of gravitational waves are based on implementations of matched filtering, and that a matched filter is the optimal linear filter in Gaussian noise, the application of Deep Filtering using whitened signals in Gaussian noise is investigated in this foundational article. The results indicate that Deep Filtering outperforms conventional machine learning techniques, achieves similar performance compared to matched filtering, while being several orders of magnitude faster, allowing real-time signal processing with minimal resources. Furthermore, we demonstrate that Deep Filtering can detect and characterize waveform signals emitted from new classes of eccentric or spin-precessing binary black holes, even when trained with data sets of only quasicircular binary black hole waveforms. The results presented in this article, and the recent use of deep neural networks for the identification of optical transients in telescope data, suggests that deep learning can facilitate real-time searches of gravitational wave sources and their electromagnetic and astroparticle counterparts. In the subsequent article, the framework introduced herein is directly applied to identify and characterize gravitational wave events in real LIGO data.

View figure in article

Physics Subject Headings (PhySH)

Article Text

References (130)

  1. LIGO Scientific and Virgo Collaborations, Phys. Rev. Lett. 116, 131103 (2016).
  2. J. Aasi et al. (LIGO Scientific Collaboration), Classical Quantum Gravity 32, 7 (2015).
  3. B. P. Abbott et al., Phys. Rev. Lett. 116, 061102 (2016).
  4. B. P. Abbott et al., Phys. Rev. Lett. 116, 241103 (2016).
  5. B. P. Abbott et al., Phys. Rev. Lett. 118, 221101 (2017).
  6. B. P. Abbott et al. (LIGO Scientific and Virgo Collaborations), Astrophys. J. 851, L35 (2017).
  7. B. P. Abbott et al., Phys. Rev. Lett. 119, 141101 (2017).
  8. F. Acernese et al., Classical Quantum Gravity 32, 024001 (2015).
  9. B. P. Abbott et al., Phys. Rev. Lett. 119, 161101 (2017).
  10. B. P. Abbott et al., Living Rev. Relativity 19, 1 (2016).
  11. L. P. Singer, L. R. Price, B. Farr, A. L. Urban, C. Pankow, S. Vitale, J. Veitch, W. M. Farr, C. Hanna, K. Cannon, T. Downes, P. Graff, C.-J. Haster, I. Mandel, T. Sidery, and A. Vecchio, Astrophys. J. 795, 105 (2014).
  12. B. P. Abbott et al., Astrophys. J. 848, L12 (2017).
  13. B. P. Abbott et al., Astrophys. J. Lett. 848, L13 (2017).
  14. D. Eichler, M. Livio, T. Piran, and D. N. Schramm, Nature (London) 340, 126 (1989).
  15. B. Paczynski, Astrophys. J. Lett. 308, L43 (1986).
  16. R. Narayan, B. Paczynski, and T. Piran, Astrophys. J. Lett. 395, L83 (1992).
  17. C. S. Kochanek and T. Piran, Astrophys. J. 417, L17 (1993).
  18. C. D. Ott, Classical Quantum Gravity 26, 063001 (2009).
  19. E. S. Phinney, arXiv:0903.0098.
  20. T. Abbott et al. (Dark Energy Survey Collaboration), Mon. Not. R. Astron. Soc. 460, 1270 (2016).
  21. A. A. Abdo et al., Astrophys. J. Suppl. Ser. 208, 17 (2013).
  22. J. A. Tyson, Proc. SPIE Int. Soc. Opt. Eng. 4836, 10 (2002).
  23. L. Amendola et al., Living Rev. Relativity 16, 6 (2013).
  24. N. Gehrels and D. Spergel (on behalf of the WFIRST SDT and Project), J. Phys. Conf. Ser. 610, 012007 (2015).
  25. S. Adrián-Martínez et al. (Antares Collaboration, IceCube Collaboration, LIGO Scientific Collaboration, and Virgo Collaboration), Phys. Rev. D 93, 122010 (2016).
  26. B. P. Abbott et al., Phys. Rev. D 94, 064035 (2016).
  27. J. Healy et al., arXiv:1712.05836.
  28. P. Mösta, B. C. Mundim, J. A. Faber, R. Haas, S. C. Noble, T. Bode, F. Löffler, C. D. Ott, C. Reisswig, and E. Schnetter, Classical Quantum Gravity 31, 015005 (2014).
  29. R. Haas, C. D. Ott, B. Szilagyi, J. D. Kaplan, J. Lippuner, M. A. Scheel, K. Barkett, C. D. Muhlberger, T. Dietrich, M. D. Duez, F. Foucart, H. P. Pfeiffer, L. E. Kidder, and S. A. Teukolsky, Phys. Rev. D 93, 124062 (2016).
  30. E. Abdikamalov, S. Gossan, A. M. DeMaio, and C. D. Ott, Phys. Rev. D 90, 044001 (2014).
  31. L. E. Kidder, S. E. Field, F. Foucart, E. Schnetter, S. A. Teukolsky, A. Bohn, N. Deppe, P. Diener, F. Hébert, J. Lippuner, J. Miller, C. D. Ott, M. A. Scheel, and T. Vincent, J. Comput. Phys. 335, 84 (2017).
  32. S. Nissanke, M. Kasliwal, and A. Georgieva, Astrophys. J. 767, 124 (2013).
  33. S. A. Usman et al., Classical Quantum Gravity 33, 215004 (2016).
  34. K. Cannon, R. Cariou, A. Chapman, M. Crispin-Ortuzar, N. Fotopoulos, M. Frei, C. Hanna, E. Kara, D. Keppel, L. Liao, S. Privitera, A. Searle, L. Singer, and A. Weinstein, Astrophys. J. 748, 136 (2012).
  35. B. P. Abbott et al., Phys. Rev. D 93, 122004 (2016).
  36. N. J. Cornish and T. B. Littenberg, Classical Quantum Gravity 32, 135012 (2015).
  37. R. Smith, S. E. Field, K. Blackburn, C.-J. Haster, M. Pürrer, V. Raymond, and P. Schmidt, Phys. Rev. D 94, 044031 (2016).
  38. J. Veitch et al., Phys. Rev. D 91, 042003 (2015).
  39. I. Harry, S. Privitera, A. Bohé, and A. Buonanno, Phys. Rev. D 94, 024012 (2016).
  40. T. B. Littenberg, B. Farr, S. Coughlin, and V. Kalogera, Astrophys. J. 820, 7 (2016).
  41. N. Indik, H. Fehrmann, F. Harke, B. Krishnan, and A. B. Nielsen, arXiv:1712.07869.
  42. E. A. Huerta, R. Haas, E. Fajardo, D. S. Katz, S. Anderson, P. Couvares, J. Willis, T. Bouvet, J. Enos, W. T. C. Kramer, H. W. Leong, and D. Wheeler, arXiv:1709.08767.
  43. D. Weitzel, B. Bockelman, D. A. Brown, P. Couvares, F. Würthwein, and E. Fajardo Hernandez, arXiv:1705.06202.
  44. Y. Lecun, Y. Bengio, and G. Hinton, Nature (London) 521, 436 (2015).
  45. Y. LeCun and Y. Bengio, in The Handbook of Brain Theory and Neural Networks, edited by M. A. Arbib (MIT, Cambridge, MA, 1998), p. 255.
  46. C. Messick et al., Phys. Rev. D 95, 042001 (2017).
  47. A. Taracchini, A. Buonanno, Y. Pan, T. Hinderer, M. Boyle, D. A. Hemberger, L. E. Kidder, G. Lovelace, A. H. Mroué, H. P. Pfeiffer, M. A. Scheel, B. Szilágyi, N. W. Taylor, and A. Zenginoglu, Phys. Rev. D 89, 061502 (2014).
  48. A. Bohé et al., Phys. Rev. D 95, 044028 (2017).
  49. K. Belczynski, D. E. Holz, T. Bulik, and R. O’Shaughnessy, Nature (London) 534, 512 (2016).
  50. D. Shoemaker, Advanced LIGO anticipated sensitivity curves, LIGO Document T0900288-v3, https://dcc.ligo.org/LIGO-T0900288/public.
  51. D. George and E. A. Huerta, Phys. Lett. B 778, 64 (2018).
  52. D. J. C. Mackay, Information Theory, Inference and Learning Algorithms (Cambridge University Press, Cambridge, England, 2003).
  53. C. J. Moore, C. P. L. Berry, A. J. K. Chua, and J. R. Gair, Phys. Rev. D 93, 064001 (2016).
  54. C. J. Moore and J. R. Gair, Phys. Rev. Lett. 113, 251101 (2014).
  55. M. Zevin, S. Coughlin, S. Bahaadini, E. Besler, N. Rohani, S. Allen, M. Cabero, K. Crowston, A. Katsaggelos, S. Larson, T. K. Lee, C. Lintott, T. Littenberg, A. Lundgren, C. Oesterlund, J. Smith, L. Trouille, and V. Kalogera, arXiv:1611.04596.
  56. D. George, H. Shen, and E. A. Huerta, arXiv:1706.07446.
  57. N. Sedaghat and A. Mahabal, arXiv:1710.01422.
  58. I. Goodfellow, Y. Bengio, and A. Courville, Deep Learning (MIT, Cambridge, MA, 2016).
  59. J. Schmidhuber, Neural Netw. 61, 85 (2015).
  60. Y. Bengio, A. Courville, and P. Vincent, IEEE Trans. Pattern Anal. Mach. Intell. 35, 1798 (2013).
  61. M. Nielsen, Neural Networks and Deep Learning (2016), http://neuralnetworksanddeeplearning.com/.
  62. D. Graupe, Principles of Artificial Neural Networks, 3rd ed. (World Scientific, Singapore, 2013).
  63. F. Rosenblatt, Psychol. Rev. 65, 386 (1958).
  64. M. Minsky and S. Papert, Perceptrons: An Introduction to Computational Geometry (MIT, Cambridge, MA, 1969).
  65. K. Hornik, M. Stinchcombe, and H. White, Neural Netw. 2, 359 (1989).
  66. K. Jarrett, K. Kavukcuoglu, M. Ranzato, and Y. Lecun, What is the best multi-stage architecture for object recognition?, in 2009 IEEE 12th International Conference on Computer Vision, Kyoto, 2009 (IEEE, New York, 2009), p. 2146.
  67. Wikimedia Commons: Artifical Neural Network, https://upload.wikimedia.org/wikipedia/commons/thumb/e/e4/Artificial_neural_network.svg/2000px-Artificial_neural_network.svg.png.
  68. Y. LeCun, L. Bottou, G. B. Orr, and K.-R. Müller, in Neural Networks: Tricks of the Trade (Springer-Verlag, Berlin, 1998), p. 9.
  69. S. Ruder, arXiv:1609.04747.
  70. D. P. Kingma and J. Ba, arXiv:1412.6980.
  71. A. Krizhevsky, I. Sutskever, and G. E. Hinton, in Advances in Neural Information Processing Systems 25, edited by P. Bartlett (Curran Associates, Inc., Red Hook, NY, 2012), p. 1097.
  72. F. Yu and V. Koltun, in ICLR (2016).
  73. B. J. Owen and B. S. Sathyaprakash, Phys. Rev. D 60, 022002 (1999).
  74. P. Graff, F. Feroz, M. P. Hobson, and A. Lasenby, Mon. Not. R. Astron. Soc. 421, 169 (2012).
  75. N. Mukund, S. Abraham, S. Kandhasamy, S. Mitra, and N. S. Philip, Phys. Rev. D 95, 104059 (2017).
  76. J. Powell, A. Torres-Forné, R. Lynch, D. Trifirò, E. Cuoco, M. Cavaglià, I. S. Heng, and J. A. Font, Classical Quantum Gravity 34, 034002 (2017).
  77. J. Powell, D. Trifirò, E. Cuoco, I. S. Heng, and M. Cavaglià, Classical Quantum Gravity 32, 215012 (2015).
  78. S. Bahaadini, N. Rohani, S. Coughlin, M. Zevin, V. Kalogera, and A. K. Katsaggelos, arXiv:1705.00034.
  79. H. Shen, D. George, E. A. Huerta, and Z. Zhao, arXiv:1711.09919.
  80. M. Zevin, S. Coughlin, S. Bahaadini, E. Besler, N. Rohani, S. Allen, M. Cabero, K. Crowston, A. Katsaggelos, S. Larson, T. K. Lee, C. Lintott, T. Littenberg, A. Lundgren, C. Oesterlund, J. Smith, L. Trouille, and V. Kalogera, Classical Quantum Gravity 34, 064003 (2017).
  81. D. George, H. Shen, and E. A. Huerta, arXiv:1711.07468.
  82. C. Szegedy, W. Liu, Y. Jia, P. Sermanet, S. Reed, D. Anguelov, D. Erhan, V. Vanhoucke, and A. Rabinovich, in 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) (Curran Associates, Inc., Red Hook, NY, 2015).
  83. K. Simonyan and A. Zisserman, arXiv:1409.1556.
  84. K. He, X. Zhang, S. Ren, and J. Sun, arXiv:1512.03385.
  85. B. J. Owen and B. S. Sathyaprakash, Phys. Rev. D 60, 022002 (1999).
  86. T. J. O’Shea, J. Corgan, and T. C. Clancy, Convolutional radio modulation recognition networks, in Engineering Applications of Neural Networks: 17th International Conference, EANN 2016, Aberdeen, UK, September 2–5, 2016, Proceedings, edited by C. Jayne and L. Iliadis (Springer, New York, 2016), p. 213.
  87. Y. Zheng, Q. Liu, E. Chen, Y. Ge, and J. L. Zhao, Time series classification using multi-channels deep convolutional neural networks, in Web-Age Information Management: 15th International Conference, WAIM 2014, Macau, China, June 16–18, 2014. Proceedings, edited by F. Li, G. Li, S.-w. Hwang, B. Yao, and Z. Zhang (Springer, New York, 2014), p. 298.
  88. M. Pürrer, Phys. Rev. D 93, 064041 (2016).
  89. K. Belczynski, S. Repetto, D. Holz, R. O’Shaughnessy, T. Bulik, E. Berti, C. Fryer, and M. Dominik, Astrophys. J. 819, 108 (2016).
  90. B. P. Abbott et al., Phys. Rev. X 6, 041015 (2016).
  91. F. Löffler, J. Faber, E. Bentivegna, T. Bode, P. Diener, R. Haas, I. Hinder, B. C. Mundim, C. D. Ott, E. Schnetter, G. Allen, M. Campanelli, and P. Laguna, Classical Quantum Gravity 29, 115001 (2012).
  92. A. Torres-Forné, A. Marquina, J. A. Font, and J. M. Ibáñez, Phys. Rev. D 94, 124040 (2016).
  93. A. H. Mroué, M. A. Scheel, B. Szilágyi, H. P. Pfeiffer, M. Boyle, D. A. Hemberger, L. E. Kidder, G. Lovelace, S. Ossokine, N. W. Taylor, A. Zenginoğlu, L. T. Buchman, T. Chu, E. Foley, M. Giesler, R. Owen, and S. A. Teukolsky, Phys. Rev. Lett. 111, 241104 (2013).
  94. Y. LeCun, L. Bottou, G. B. Orr, and K. R. Müller, Efficient backprop, in Neural Networks: Tricks of the Trade, edited by G. B. Orr and K.-R. Müller (Springer-Verlag, Berlin, 1998), p. 9.
  95. Y. LeCun, L. Bottou, Y. Bengio, and P. Haffner, Proc. IEEE 86, 2278 (1998).
  96. S. Ioffe and C. Szegedy, arXiv:1502.03167.
  97. N. Srivastava, G. Hinton, A. Krizhevsky, I. Sutskever, and R. Salakhutdinov, J. Mach. Learn. Res. 15, 1929 (2014).
  98. T. Chen, M. Li, Y. Li, M. Lin, N. Wang, M. Wang, T. Xiao, B. Xu, C. Zhang, and Z. Zhang, arXiv:1512.01274.
  99. S. Chetlur, C. Woolley, P. Vandermersch, J. Cohen, J. Tran, B. Catanzaro, and E. Shelhamer, arXiv:1410.0759.
  100. A. H. Nitz, Classical Quantum Gravity 35, 035016 (2018).
  101. T. Chu, H. Fong, P. Kumar, H. P. Pfeiffer, M. Boyle, D. A. Hemberger, L. E. Kidder, M. A. Scheel, and B. Szilagyi, Classical Quantum Gravity 33, 165001 (2016).
  102. S. Privitera, S. R. P. Mohapatra, P. Ajith, K. Cannon, N. Fotopoulos, M. A. Frei, C. Hanna, A. J. Weinstein, and J. T. Whelan, Phys. Rev. D 89, 024003 (2014).
  103. V. Tiwari, S. Klimenko, N. Christensen, E. A. Huerta, S. R. P. Mohapatra, A. Gopakumar, M. Haney, P. Ajith, S. T. McWilliams, G. Vedovato, M. Drago, F. Salemi, G. A. Prodi, C. Lazzaro, S. Tiwari, G. Mitselmakher, and F. Da Silva, Phys. Rev. D 93, 043007 (2016).
  104. E. A. Huerta, C. J. Moore, P. Kumar, D. George, A. J. K. Chua, R. Haas, E. Wessel, D. Johnson, D. Glennon, A. Rebei, A. M. Holgado, J. R. Gair, and H. P. Pfeiffer, Phys. Rev. D 97, 024031 (2018).
  105. E. A. Huerta, P. Kumar, B. Agarwal, D. George, H.-Y. Schive, H. P. Pfeiffer, R. Haas, W. Ren, T. Chu, M. Boyle, D. A. Hemberger, L. E. Kidder, M. A. Scheel, and B. Szilagyi, Phys. Rev. D 95, 024038 (2017).
  106. E. A. Huerta, P. Kumar, S. T. McWilliams, R. O’Shaughnessy, and N. Yunes, Phys. Rev. D 90, 084016 (2014).
  107. E. A. Huerta and D. A. Brown, Phys. Rev. D 87, 127501 (2013).
  108. E. A. Huerta, S. T. McWilliams, J. R. Gair, and S. R. Taylor, Phys. Rev. D 92, 063010 (2015),
  109. The Wolfram Language Image Identification Project, https://www.imageidentify.com/.
  110. S. Ioffe and C. Szegedy, Proceedings of Machine Learning Research 37, 448 (2015).
  111. P. Goyal, P. Dollár, R. Girshick, P. Noordhuis, L. Wesolowski, A. Kyrola, A. Tulloch, Y. Jia, and K. He, arXiv:1706.02677.
  112. Y. Bengio and Y. LeCun, in Large Scale Kernel Machines, edited by L. Bottou, O. Chapelle, D. DeCoste, and J. Weston (MIT, Cambridge, MA 2007).
  113. L. Perreault Levasseur, Y. D. Hezaveh, and R. H. Wechsler, Astrophys. J. 850, L7 (2017).
  114. W. Dai, C. Dai, S. Qu, J. Li, and S. Das, arXiv:1610.00087.
  115. Y. Xu, J. Du, L. R. Dai, and C. H. Lee, IEEE/ACM Transactions on Audio, Speech, and Language Processing 23, 7 (2015).
  116. A. Kumar and D. Florêncio, arXiv:1605.02427.
  117. H. J. Pletsch and B. Allen, Phys. Rev. Lett. 103, 181102 (2009).
  118. C. Zhang, P. Li, G. Sun, Y. Guan, B. Xiao, and J. Cong, in Proceedings of the 2015 ACM/SIGDA International Symposium on Field-Programmable Gate Arrays (ACM, New York, 2015), p. 161.
  119. GPU-based deep learning inference: A performance and power analysis, https://www.nvidia.com/content/tegra/embedded-systems/pdf/jetson_tx1_whitepaper.pdf.
  120. S. Han, X. Liu, H. Mao, J. Pu, A. Pedram, M. A. Horowitz, and W. J. Dally, SIGARCH Comput. Archit. News 44, 243 (2016).
  121. G. E. Hinton and R. R. Salakhutdinov, Science 313, 504 (2006).
  122. G. Cabrera-Vives, I. Reyes, F. Förster, P. A. Estévez, and J.-C. Maureira, Astrophys. J. 836, 97 (2017).
  123. Wolfram Language System & Documentation Center, https://reference.wolfram.com/language/.
  124. LSC, LSC Algorithm Library software packages lal, lalwrapper, and lalapps, http://www.lsc-group.phys.uwm.edu/lal.
  125. B. S. Sathyaprakash and B. F. Schutz, Living Rev. Relativity 12, 2 (2009).
  126. D. Shoemaker, Advanced LIGO anticipated sensitivity curves (2010), https://dcc.ligo.org/cgi-bin/DocDB/ShowDocument?docid=2974.
  127. X. Glorot and Y. Bengio, Proceedings of Machine Learning Research 9, 249 (2010).
  128. NetModel, https://reference.wolfram.com/language/ref/NetModel.html.
  129. F. Löffler, J. Faber, E. Bentivegna, T. Bode, P. Diener, R. Haas, I. Hinder, B. C. Mundim, C. D. Ott, E. Schnetter, G. Allen, M. Campanelli, and P. Laguna, Classical Quantum Gravity 29, 115001 (2012), https://einsteintoolkit.org/.
  130. B. Wardell, I. Hinder, and E. Bentivegna, Simulation of GW150914 binary black hole merger using the Einstein Toolkit, https://doi.org/10.5281/zenodo.155394.

Outline

Information

Phys. Rev. D 97, 044039– Published 26 February, 2018
  • Received 18 October 2017
Article part of CHORUS
Crossmark - Check for updates button

© 2018 American Physical Society

Sign In to Your Journals Account

Filter

Filter

Article Lookup

Enter a citation