- Access by Xinjiang University
Identification of plagioclase extinction-angle features from polarized images using deep neural network
Phys. Rev. E 110, 045303 – Published 8 October, 2024
DOI: https://doi.org/10.1103/PhysRevE.110.045303
Abstract
Plagioclase is a principal component of the Earth's crust, whose compositional and structural analysis is vital for understanding the crust's construction and evolution. Accurate identification of extinction angle features plays an important role in determining the sodium-calcium content in plagioclase. Manual evaluation of these extinction angle features is tedious and dependent on human expertise. Additionally, current image recognition methods for identifying plagioclase extinction angles face challenges such as information loss, weak stripe features, and difficulty in capturing long-range spatiotemporal features. To address these challenges, we propose an extinction angle identification neural network called AFI-Net, which utilizes polarized image sequences for the accurate detection of plagioclase's extinction angle features. AFI-Net combines a 2D convolutional neural network with a Transformer. Initially, a stripe attention module is developed to enhance the network's ability to detect stripe features. Building upon this module, a 2D backbone network is designed to efficiently extract spatial features from polarized images. The spatial features are then fed into a customized Transformer-based module to extract spatiotemporal features. Ultimately, these spatiotemporal features are used to accurately identify the extinction angle features of plagioclase. Extensive quantitative and qualitative experimental results demonstrate that AFI-Net achieves high accuracy and stability in recognizing the extinction angle features of plagioclase, showing significant superiority over current advanced recognition methods.
Physics Subject Headings (PhySH)
Article Text
References (57)
- O. Higgins and T. Sheldrake, Geochem. Geophys. Geosyst. 25, e2023GC011369 (2024).
- B. Ruan, B. Luo, H. Zhang, X. Zhao, C. Zhang, H. Yang, W. Xu, F. Pan, and L. Guo, Lithos 472–473, 107564 (2024).
- Transmitted Light Microscopy of Rock-Forming Minerals: An Introduction to Optical Mineralogy, edited by M. M. Raith, P. Raase, and J. Reinhardt (Springer, Berlin, 2021).
- C. R. Brugger and J. E. Hammer, Am. Mineral. 100, 385 (2015).
- C. Kumar, S. Chatterjee, T. Oommen, A. Guha, and A. Mukherjee, Geocarto Int. 37, 6004 (2022).
- R. Das, A. Mondal, T. Chakraborty, and K. Ghosh, Appl. Intell. 52, 2332 (2022).
- S. T. Schmidt, in Transmitted Light Microscopy of Rock-Forming Minerals: An Introduction to Optical Mineralogy, edited by M. M. Raith, P. Raase, and J. Reinhardt (Springer, Berlin, 2023), pp. 37–48.
- L. Wang, Y. Xiong, Z. Wang, Y. Qiao, D. Lin, X. Tang, and L. Van Gool, in Proceedings of the European Conference on Computer Vision (Springer, Amsterdam, Netherlands, 2016), pp. 20–36.
- Y. Chen, Y. Kalantidis, J. Li, S. Yan, and J. Feng, in Proceedings of the European Conference on Computer Vision (Springer, Munich, Germany, 2018), pp. 352–367.
- C. Feichtenhofer, H. Fan, J. Malik, and K. He, in Proceedings of the IEEE International Conference on Computer Vision (IEEE, Seoul, South Korea, 2019), pp. 6202–6211.
- C. Yang, Y. Xu, J. Shi, B. Dai, and B. Zhou, in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (IEEE, Seattle, WA, 2020), pp. 591–600.
- Z. Liu, L. Wang, W. Wu, C. Qian, and T. Lu, in Proceedings of the IEEE/CVF International Conference on Computer Vision (IEEE, Montreal, Canada, 2021), pp. 13708–13718.
- J. Carreira and A. Zisserman, in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (IEEE, Honolulu, HI, 2017), pp. 6299–6308.
- C. Feichtenhofer, in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (IEEE, Seattle, WA, 2020), pp. 203–213.
- Z. Qiu, T. Yao, and T. Mei, in Proceedings of the IEEE International Conference on Computer Vision (IEEE, Venice, Italy, 2017), pp. 5533–5541.
- D. Tran, H. Wang, L. Torresani, J. Ray, Y. LeCun, and M. Paluri, in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (IEEE, Salt Lake City, UT, 2018), pp. 6450–6459.
- O. Köpüklü, N. Kose, A. Gunduz, and G. Rigoll, in Proceedings of the IEEE/CVF International Conference on Computer Vision Workshop (IEEE, Seoul, South Korea, 2019), pp. 1910–1919.
- M. Sandler, A. Howard, M. Zhu, A. Zhmoginov, and L.-C. Chen, in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (IEEE, Salt Lake City, UT, 2018), pp. 4510–4520.
- X. Zhang, X. Zhou, M. Lin, and J. Sun, in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (IEEE, Salt Lake City, UT, 2018), pp. 6848–6856.
- N. Ma, X. Zhang, H.-T. Zheng, and J. Sun, in Proceedings of the European Conference on Computer Vision (Springer, Munich, Germany, 2018), pp. 116–131.
- J. Hu, L. Shen, and G. Sun, in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (IEEE, Salt Lake City, UT, 2018), pp. 7132–7141.
- A. Arnab, M. Dehghani, G. Heigold, C. Sun, M. Lučić, and C. Schmid, in Proceedings of the IEEE/CVF International Conference on Computer Vision (IEEE, Virtual, 2021), pp. 6836–6846.
- Y. Li, C.-Y. Wu, H. Fan, K. Mangalam, B. Xiong, J. Malik, and C. Feichtenhofer, in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (IEEE, New Orleans, LA, 2022), pp. 4804–4814.
- Z. Liu, J. Ning, Y. Cao, Y. Wei, Z. Zhang, S. Lin, and H. Hu, in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (IEEE, New Orleans, LA, 2022), pp. 3202–3211.
- L. Wang, B. Huang, Z. Zhao, Z. Tong, Y. He, Y. Wang, Y. Wang, and Y. Qiao, in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (IEEE, Vancouver, Canada, 2023), pp. 14549–14560.
- A. Vaswani, N. Shazeer, N. Parmar, J. Uszkoreit, L. Jones, A. N. Gomez, Ł. Kaiser, and I. Polosukhin, Adv. Neural Info. Proc. Syst. 30, 5998 (2017).
- K. He, X. Zhang, S. Ren, and J. Sun, in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (IEEE, Las Vegas, NV, 2016), pp. 770–778.
- I. Goodfellow, Y. Bengio, and A. Courville, Deep Learning (MIT Press, Cambridge, MA, 2016).
- I. Loshchilov and F. Hutter, arXiv:1711.05101.
- J. D. Rodriguez, A. Perez, and J. A. Lozano, IEEE Trans. Pattern Anal. Mach. Intell. 32, 569 (2009).
- N. Ballas, L. Yao, C. Pal, and A. Courville, arXiv:1511.06432.
- D. Tran, L. Bourdev, R. Fergus, L. Torresani, and M. Paluri, in Proceedings of the IEEE/CVF International Conference on Computer Vision (IEEE, Santiago, Chile, 2015), pp. 4489–4497.
- J. Lin, C. Gan, and S. Han, in Proceedings of the IEEE/CVF International Conference on Computer Vision (IEEE, Seoul, South Korea, 2019), pp. 7083–7093.
- K. Hara, H. Kataoka, and Y. Satoh, in Proceedings of the IEEE/CVF International Conference on Computer Vision Workshops (IEEE, Venice, Italy, 2017), pp. 3154–3160.
- A. Diba, M. Fayyaz, V. Sharma, M. M. Arzani, R. Yousefzadeh, J. Gall, and L. Van Gool, in Proceedings of the European Conference on Computer Vision (Springer, Munich, Germany, 2018), pp. 284–299.
- G. Bertasius, H. Wang, and L. Torresani, arXiv:2102.05095.
- K. Li, Y. Wang, G. Peng, G. Song, Y. Liu, H. Li, and Y. Qiao, arXiv:2201.04676.
- D. Zhang, X. Dai, X. Wang, and Y.-F. Wang, arXiv:1807.08069.
- K. Min and J. J. Corso, in Proceedings of the IEEE/CVF International Conference on Computer Vision (IEEE, Seoul, South Korea, 2019), pp. 2394–2403.
- D. Tran, H. Wang, L. Torresani, and M. Feiszli, in Proceedings of the IEEE/CVF International Conference on Computer Vision (IEEE, Seoul, South Korea, 2019), pp. 5552–5561.
- L. Wang, B. Huang, Z. Zhao, Z. Tong, Y. He, Y. Wang, Y. Wang, and Y. Qiao, in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (IEEE, Vancouver, Canada, 2023), pp. 14549–14560.
- C. Szegedy, V. Vanhoucke, S. Ioffe, J. Shlens, and Z. Wojna, in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (IEEE, Las Vegas, NV, 2016), pp. 2818–2826.
- C.-Y. Wang, H.-Y. M. Liao, Y.-H. Wu, P.-Y. Chen, J.-W. Hsieh, and I.-H. Yeh, in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (IEEE, Virtual, 2020), pp. 390–391.
- J. Wang, K. Sun, T. Cheng, B. Jiang, C. Deng, Y. Zhao, D. Liu, Y. Mu, M. Tan, X. Wang et al., IEEE Trans. Pattern Anal. Mach. Intell. 43, 3349 (2020).
- S. Xie, R. Girshick, P. Dollár, Z. Tu, and K. He, in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (IEEE, Honolulu, HI, 2017), pp. 1492–1500.
- I. Radosavovic, R. P. Kosaraju, R. Girshick, K. He, and P. Dollár, in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (IEEE, Virtual, 2020), pp. 10428–10436.
- F. Chollet, in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (IEEE, Honolulu, HI, 2017), pp. 1251–1258.
- X. Ding, X. Zhang, N. Ma, J. Han, G. Ding, and J. Sun, in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (IEEE, Virtual, 2021), pp. 13733–13742.
- G. Huang, Z. Liu, L. Van Der Maaten, and K. Q. Weinberger, in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (IEEE, Honolulu, HI, 2017), pp. 4700–4708.
- M. Maaz, A. Shaker, H. Cholakkal, S. Khan, S. W. Zamir, R. M. Anwer, and F. Shahbaz Khan, in European Conference on Computer Vision (Springer, Tel Aviv, Israel, 2022), pp. 3–20.
- M. Sandler, A. Howard, M. Zhu, A. Zhmoginov, and L.-C. Chen, in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (IEEE, Salt Lake City, UT, 2018), pp. 4510–4520.
- Z. Liu, H. Mao, C.-Y. Wu, C. Feichtenhofer, T. Darrell, and S. Xie, in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (IEEE, New Orleans, LA, 2022), pp. 11976–11986.
- X. Li, W. Wang, X. Hu, and J. Yang, in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (IEEE, Long Beach, CA, 2019), pp. 510–519.
- M.-H. Guo, C.-Z. Lu, Z.-N. Liu, M.-M. Cheng, and S.-M. Hu, Comput. Visual Media 9, 733 (2023).
- A. Howard, M. Sandler, G. Chu, L.-C. Chen, B. Chen, M. Tan, W. Wang, Y. Zhu, R. Pang, V. Vasudevan, et al., in Proceedings of the IEEE/CVF International Conference on Computer Vision (IEEE, Seoul, South Korea, 2019), pp. 1314–1324.
- S. Woo, S. Debnath, R. Hu, X. Chen, Z. Liu, I. S. Kweon, and S. Xie, in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (IEEE, Vancouver, Canada, 2023), pp. 16133–16142.
- S.-H. Gao, M.-M. Cheng, K. Zhao, X.-Y. Zhang, M.-H. Yang, and P. Torr, IEEE Trans. Pattern Anal. Mach. Intell. 43, 652 (2019).