- Physical Review Journals
All JournalsPhysics Magazine
Access Provided by Xinjiang University

Physical Review Applied

Export citation

Export citation

Choose format for download:

Download Citation
  • Featured in Physics
  • Editors' Suggestion
  • Letter
  • Access by Xinjiang University

Non-Line-of-Sight Three-Dimensional Imaging with a Single-Pixel Camera

G. Musarra1,*, A. Lyons1, E. Conca2, Y. Altmann3, F. Villa2, F. Zappa2, M.J. Padgett1, and D. Faccio1,†

  • 1School of Physics & Astronomy, University of Glasgow, Glasgow G12 8QQ, United Kingdom
  • 2Dipartimento di Elettronica, Informazione e Bioingegneria, Politecnico di Milano, 20133 Milano, Italy
  • 3School of Engineering and Physical Sciences, Heriot-Watt University, Edinburgh EH144AS, United Kingdom

  • *2376730m@student.gla.ac.uk
  • †daniele.faccio@glasgow.ac.uk
PDF

Phys. Rev. Applied 12, 011002 – Published 18 July, 2019

DOI: https://doi.org/10.1103/PhysRevApplied.12.011002

Abstract

Real-time high-resolution three-dimensional (3D) reconstruction of scenes hidden from the direct field of view is a challenging field of research, with applications in real-life situations related, e.g., to surveillance, self-driving cars, and rescue missions. Most current techniques recover the 3D structure of a non-line-of-sight (NLOS) static scene by detecting the return signal from the hidden object on a scattering observation area. Here, we demonstrate the full color retrieval of the 3D shape of a hidden scene by coupling back-projection imaging algorithms with the high-resolution time-of-flight information provided by a single-pixel camera. By using a high-efficiency single-photon avalanche-diode (SPAD) detector, this technique provides the advantage of imaging with no mechanical scanning parts, with acquisition times down to the subsecond range.

View figure in article

Physics Subject Headings (PhySH)

Synopsis

Seeing Around Corners in Real Time

Published 18 July, 2019

Using a laser, a high-speed detector, and an array of tiny movable mirrors, researchers can reconstruct an image of a hidden object in under a second.

See more in Physics

Article Text

References (37)

  1. D. Faccio and A. Velten, A trillion frames per second: The techniques and applications of light-in-flight photography, Rep. Progr. Phys. 81, 105901 (2018).
  2. A. Sume, M. Gustafsson, A. Jänis, S. Nilsson, J. Rahm, and A. Örbom, in Radar Sensor Technology XIII (International Society for Optics and Photonics, Orlando, Florida, USA, 2009), vol. 7308, p. 73080V.
  3. O. Katz, E. Small, and Y. Silberberg, Looking around corners and through thin turbid layers in real time with scattered incoherent light, Nat. Photonics 6, 549 (2012).
  4. O. Katz, P. Heidmann, M. Fink, and S. Gigan, Non-invasive single-shot imaging through scattering layers and around corners via speckle correlations, Nat. Photonics 8, 784 (2014).
  5. Y. Altmann, S. McLaughlin, M. J. Padgett, V. K. Goyal, A. Hero, and D. Faccio, Quantum-inspired computational imaging, Science 361, eaat2298 (2018).
  6. C. Saunders, J. Murray-Bruce, and V. K. Goyal, Computational periscopy with an ordinary digital camera, Nature 565, 472 (2019).
  7. U. Wandinger, Lidar—Range-Resolved Optical Remote Sensing of the Atmosphere (Springer, New York, 2005).
  8. B. Schwarz, Lidar: Mapping the world in 3D, Nat. Photonics 4, 429 (2010).
  9. A. Kirmani, T. Hutchison, J. Davis, and R. Raskar, Looking around the corner using ultrafast transient imaging, Int. J. Comput. Vis. 95, 13 (2011).
  10. M. Buttafava, J. Zeman, A. Tosi, K. Eliceiri, and A. Velten, Non-line-of-sight imaging using a time-gated single photon avalanche diode, Opt. Express 23, 20997 (2015).
  11. A. K. Pediredla, M. Buttafava, A. Tosi, O Cossairt, and A. Veeraraghavan, in 2017 IEEE International Conference on Computational Photography (ICCP) (IEEE, Stanford, California, USA, 2017).
  12. A. Velten, T. Willwacher, O. Gupta, A. Veeraraghavan, M. G. Bawendi, and R. Raskar, Recovering three-dimensional shape around a corner using ultrafast time-of-flight imaging, Nat. Commun. 3, 745 (2012).
  13. G. Gariepy, F. Tonolini, R. Henderson, J. Leach, and D. Faccio, Detection and tracking of moving objects hidden from view, Nat. Photonics 10, 23 (2016).
  14. S. Chan, R. E. Warburton, G. Gariepy, J. Leach, and D. Faccio, Non-line-of-sight tracking of people at long range, Opt. Express 25, 10109 (2017).
  15. V. Arellano, D. Gutierrez, and A. Jarabo, Fast back-projection for non-line of sight reconstruction, Opt. Express 25, 11574 (2017).
  16. C. Jin, J. Xie, S. Zhang, Z. Zhang, and Y. Zhao, Reconstruction of multiple non-line-of-sight objects using back projection based on ellipsoid mode decomposition, Opt. Express 26, 20089 (2018).
  17. J. Klein, C. Peters, J. Martin, M. Laurenzis, and M. B. Hullin, Tracking objects outside the line of sight using 2D intensity images, Sci. Rep. 6, 32491 (2016).
  18. P. Caramazza, A. Boccolini, D. Buschek, M. Hullin, C. F. Higham, R. Henderson, R. Murray-Smith, and D. Faccio, Neural network identification of people hidden from view with a single-pixel, single-photon detector, Sci. Rep. 8, 11945 (2018).
  19. M. OToole, D. Lindell, and G. Wetzstein, Confocal non-line-of-sight imaging based on the light-cone transform, Nature 555, 338 (2018).
  20. M. La Manna, F. Kine, E. Breitbach, J. Jackson, T. Sultan, and A. Velten, Error backprojection algorithms for non-line-of-sight imaging, IEEE Trans. Pattern Anal. Mach. Intell. 41, 1615 (2018).
  21. A. C. Kak, Algorithms for reconstruction with nondiffracting sources, Principles Comput. Tomogr. Imaging, 49 (2001).
  22. M. P. Edgar, G. M. Gibson, and M. J. Padgett, Principles and prospects for single-pixel imaging, Nat. Photonics 13, 13 (2019).
  23. N. Radwell, K. J. Mitchell, G. M. Gibson, M. P. Edgar, R. Bowman, and M. J. Padgett, Single-pixel infrared and visible microscope, Optica 1, 285 (2014).
  24. E. Tajahuerce, V. Durán, P. Clemente, E. Irles, F. Soldevila, P. Andrés, and J. Lancis, Image transmission through dynamic scattering media by single-pixel photodetection, Opt. Express 22, 16945 (2014).
  25. W. L. Chan, K. Charan, D. Takhar, K. F. Kelly, R. G. Baraniuk, and D. M. Mittleman, A single-pixel terahertz imaging system based on compressed sensing, Appl. Phys. Lett. 93, 121105 (2008).
  26. G. M. Gibson, B. Sun, M. P. Edgar, D. B. Phillips, N. Hempler, G. T. Maker, G. P. Malcolm, and M. J. Padgett, Real-time imaging of methane gas leaks using a single-pixel camera, Opt. Express 25, 2998 (2017).
  27. M. J. Sun, M. P. Edgar, G. M. Gibson, B. Sun, N. Radwell, R. Lamb, and M. J. Padgett, Single-pixel three-dimensional imaging with time-based depth resolution, Nat. Commun. 7, 12010 (2016).
  28. M. P. Edgar, M. J. Sun, G. M. Gibson, G. C. Spalding, D. B. Phillips, and M. J. Padgett, in Optical Trapping and Optical Micromanipulation XIII (International Society for Optics and Photonics, San Diego, California, USA, 2016), vol. 9922, p. 99221B.
  29. M. F. Duarte, M. A. Davenport, D. Takhar, J. N. Laska, T. Sun, K. F. Kelly, and R. G. Baraniuk, Single-pixel imaging via compressive sampling, IEEE Signal Process. Mag. 25, 83 (2008).
  30. M. Satat, G. Tancik, and R. Raskar, Lensless imaging with compressive ultrafast sensing, IEEE Trans. Comput. Imaging 3, 398 (2017).
  31. R. A. Brooks, G. H. Weiss, and A. J. Talbert, A new approach to interpolation in computed tomography, J. Comput. Assist. Tomogr. 2, 577 (1978).
  32. M. Sanzaro, P. Gattari, F. Villa, A. Tosi, G. Croce, and F. Zappa, Single-photon avalanche diodes in a 0.16μm BCD technology with sharp timing response and red-enhanced sensitivity, IEEE J. Sel. Top. Quantum Electron. 24, 1 (2018).
  33. P. Caramazza, K. Wilson, G. Gariepy, J. Leach, S. McLaughlin, D. Faccio, and Y. Altmann, Enhancing the recovery of a temporal sequence of images using joint deconvolution, Sci. Rep. 8, 5257 (2018).
  34. M. A. T. Figueiredo and J. M. Bioucas-Dias, Restoration of Poissonian images using alternating direction optimization, IEEE Trans. Image Process. 19, 3133 (2010).
  35. Y. Altmann, A. Maccarone, A. Halimi, A. McCarthy, G. Buller, and S. McLaughlin, in 2016 Sensor Signal Processing for Defence (SSPD) (IEEE, Edinburgh, UK, 2016), p. 1.
  36. R. Tobin, Y. Altmann, X. Ren, A. McCarthy, R. Lamb, S. McLaughlin, and G. Buller, Comparative study of sampling strategies for sparse photon multispectral lidar imaging: Towards mosaic filter arrays, J. Opt. 19, 094006 (2017).
  37. Q. Chen, S. K. Chamoli, P. Yin, X. Wang, and X. Xu, Imaging of hidden object using passive mode single pixel imaging with compressive sensing, Laser Phys. Lett. 15, 126201 (2018).

Outline

Information

Phys. Rev. Applied 12, 011002– Published 18 July, 2019
  • Received 6 March 2019
Crossmark - Check for updates button

© 2019 American Physical Society

Sign In to Your Journals Account

Filter

Filter

Article Lookup

Enter a citation