- Open Access
Stochastic -Bits for Invertible Logic
Phys. Rev. X 7, 031014 – Published 20 July, 2017
DOI: https://doi.org/10.1103/PhysRevX.7.031014
Abstract
Conventional semiconductor-based logic and nanomagnet-based memory devices are built out of stable, deterministic units such as standard metal-oxide semiconductor transistors, or nanomagnets with energy barriers in excess of . In this paper, we show that unstable, stochastic units, which we call “-bits,” can be interconnected to create robust correlations that implement precise Boolean functions with impressive accuracy, comparable to standard digital circuits. At the same time, they are invertible, a unique property that is absent in standard digital circuits. When operated in the direct mode, the input is clamped, and the network provides the correct output. In the inverted mode, the output is clamped, and the network fluctuates among all possible inputs that are consistent with that output. First, we present a detailed implementation of an invertible gate to bring out the key role of a single three-terminal transistorlike building block to enable the construction of correlated -bit networks. The results for this specific, CMOS-assisted nanomagnet-based hardware implementation agree well with those from a universal model for -bits, showing that -bits need not be magnet based: any three-terminal tunable random bit generator should be suitable. We present a general algorithm for designing a Boltzmann machine (BM) with a symmetric connection matrix [] () that implements a given truth table with -bits. The [] matrices are relatively sparse with a few unique weights for convenient hardware implementation. We then show how BM full adders can be interconnected in a partially directed manner () to implement large logic operations such as 32-bit binary addition. Hundreds of stochastic -bits get precisely correlated such that the correct answer out of () possibilities can be extracted by looking at the statistical mode or majority vote of a number of time samples. With perfect directivity () a small number of samples is enough, while for less directed connections more samples are needed, but even in the former case logical invertibility is largely preserved. This combination of digital accuracy and logical invertibility is enabled by the hybrid design that uses bidirectional BM units to construct circuits with partially directed interunit connections. We establish this key result with extensive examples including a 4-bit multiplier which in inverted mode functions as a factorizer.
Physics Subject Headings (PhySH)
Popular Summary
There is increasing interest in probabilistic brainlike logic, which can be far more energy efficient than standard deterministic logic. However, probabilistic logic is generally considered suitable only for operations such as search and optimization rather than precise computation, which seems better suited for deterministic logic. Here, we show that unstable, stochastic units, which we call “-bits,” can be interconnected into “-circuits” to create robust correlations that implement precise Boolean functions with impressive accuracy, comparable to that of deterministic digital circuits.
We show that these -circuits are “invertible,” a unique property that is absent in standard digital circuits. When operated in the direct mode, the input is clamped, and the network provides the correct output. In the inverted mode, the output is clamped, and the network fluctuates among all possible inputs that are consistent with that output. Even large circuits composed of hundreds of -bits can be designed to exhibit this property of invertibility while preserving a striking degree of digital accuracy. A 32-bit adder, for example, rapidly converges to the single correct state out of (roughly ) possible states with an accuracy similar to digital circuits. However, unlike digital circuits, these circuits can also be operated in the inverse mode to perform subtraction. We also show that spin-current-driven nanomagnets can represent -bits, but the situation is by no means limited: Any three-terminal tunable random bit generator should be suitable.
We expect that our theoretical findings will inspire searches for physical realizations of -bits.
Article Text
References (63)
- L. Lopez-Diaz, L. Torres, and E. Moro, Transition from Ferromagnetism to Superparamagnetism on the Nanosecond Time Scale, Phys. Rev. B 65, 224406 (2002).
- K. Palem and A. Lingamneni, Ten Years of Building Broken Chips: The Physics and Engineering of Inexact Computing, ACM Trans. Embed. Comput. Syst. 12, 87 (2013).
- S. Cheemalavagu, P. Korkmaz, K. V. Palem, B. E. S. Akgul, and L. N. Chakrapani, in Proceedings of the International Federation for Information Processing International Conference on Very Large Scale Integration, Perth, Australia (2005), pp. 535–541.
- A. Fukushima, T. Seki, K. Yakushiji, H. Kubota, H. Imamura, S. Yuasa, and K. Ando, Spin Dice: A Scalable Truly Random Number Generator Based on Spintronics, Appl. Phys. Express 7, 083001 (2014).
- W. H. Choi, Y. Lv, J. Kim, A. Deshpande, G. Kang, J.-P. Wang, and C. H. Kim, A Magnetic Tunnel Junction based True Random Number Generator with Conditional Perturb and Real-Time Output Probability Tracking, in Proceedings of the 2014 IEEE International Electron Devices Meeting (IEDM), San Francisco (IEEE, New York, 2014), pp. 12.5.1–12.5.4.
- J. Grollier, D. Querlioz, and M. D. Stiles, Spintronic Nanodevices for Bioinspired Computing, Proc. IEEE 104, 2024 (2016).
- J. Roychowdhury (private communication).
- For an example of the use of, invertible relations, see , in Proceedings of the Conference on Theory of Cryptography (Springer, New York, 2009), pp. 73–90.
- B. Behin-Aein, V. Diep, and S. Datta, A Building Block for Hardware Belief Networks, Sci. Rep. 6, 29893 (2016).
- Y. Shim, A. Jaiswal, and K. Roy, Ising Computation based Combinatorial Optimization using Spin-Hall Effect (SHE) Induced Stochastic Magnetization Reversal, J. Appl. Phys. 121, 193902 (2017).
- B. Sutton, K. Y. Camsari, B. Behin-Aein, and S. Datta, Intrinsic Optimization using Stochastic Nanomagnets, Sci. Rep. 7, 44370 (2017).
- J. J. Yang, D. B. Strukov, and D. R. Stewart, Memristive Devices for Computing, Nat. Nanotechnol. 8, 13 (2013).
- V. Q. Diep, B. Sutton, B. Behin-Aein, and S. Datta, Spin Switches for Compact Implementation of Neuron and Synapse, Appl. Phys. Lett. 104, 222405 (2014).
- A. Sengupta, Y. Shim, and K. Roy, Proposal for an All-Spin Artificial Neural Network: Emulating Neural and Synaptic Functionalities through Domain Wall Motion in Ferromagnets, IEEE Trans. Biomed. Circuits Syst. 10, 1152 (2016).
- M. Yamaoka, C. Yoshimura, M. Hayashi, T. Okuyama, H. Aoki, and H. Mizuno, Ising Computer, Hitachi Review 65, 157 (2016).
- D. H. Ackley, G. E. Hinton, and T. J. Sejnowski, A Learning Algorithm for Boltzmann Machines, Cogn. Sci. 9, 147 (1985).
- M. Yamaoka, C. Yoshimura, M. Hayashi, T. Okuyama, H. Aoki, and H. Mizuno, in IEEE International Solid-State Circuits Conference (ISSCC), 2015 Technical Digest (IEEE, New York, 2015), pp. 1–3.
- T. Inagaki, K. Inaba, R. Hamerly, K. Inoue, Y. Yamamoto, and H. Takesue, Large-Scale Ising Spin Network Based on Degenerate Optical Parametric Iscillators, Nat. Photonics 10, 415 (2016).
- R. Salakhutdinov, A. Mnih, and G. Hinton, in Proceedings of the 24th International Conference on Machine Learning (ACM, Corvalis, 2007), pp. 791–798.
- D. J. Amit, Modeling Brain Function: The World of Attractor Neural Networks (Cambridge University Press, Cambridge, England, 1992).
- D. Du, J. Gu, P. M. Pardalos et al., Proceedings of the DIMACS Workshop on Satisfiability Problem: Theory and Applications1996, Vol. 35 (American Mathematical Society, Providence, 1997).
- L. Liu, C.-F. Pai, Y. Li, H. W. Tseng, D. C. Ralph, and R. A. Buhrman, Spin-Torque Switching with the Giant Spin Hall Effect of Tantalum, Science 336, 555 (2012).
- N. Locatelli, A. Mizrahi, A. Accioly, R. Matsumoto, A. Fukushima, H. Kubota, S. Yuasa, V. Cros, L. G. Pereira, D. Querlioz et al., Noise-Enhanced Synchronization of Stochastic Magnetic Oscillators, Phys. Rev. Applied 2, 034009 (2014).
- A. van den Brink, G. Vermijs, A. Solignac, J. Koo, J. T. Kohlhepp, H. J. M. Swagten, and B. Koopmans, Field-Free Magnetization Reversal by Spin-Hall Effect and Exchange Bias, Nat. Commun. 7, 10854 (2016).
- Y.-C. Lau, D. Betto, K. Rode, J. M. D. Coey, and P. Stamenov, Spin-Orbit Torque Switching without an External Field Using Interlayer Exchange Coupling, Nat. Nanotechnol. 11, 758 (2016).
- A. K. Smith, M. Jamali, Z. Zhao, and J.-P. Wang, External Field Free Spin Hall Effect Device for Perpendicular Magnetization Reversal Using a Composite Structure with Biasing Layer, arXiv:1603.09624.
- S. Fukami, C. Zhang, S. DuttaGupta, A. Kurenkov, and H. Ohno, Magnetization Switching by Spin-Orbit Torque in an Antiferromagnet-Ferromagnet Bilayer System, Nat. Mater. 15, 535 (2016).
- J. T. Heron, J. L. Bosse, Q. He, Y. Gao, M. Trassin, L. Ye, J. D. Clarkson, C. Wang, J. Liu, S. Salahuddin et al., Deterministic Switching of Ferromagnetism at Room Temperature Using an Electric Field, Nature (London) 516, 370 (2014).
- S. Manipatruni, D. E. Nikonov, and I. A. Young, Spin-Orbit Logic with Magnetoelectric Nodes: A Scalable Charge Mediated Nonvolatile Spintronic Logic, arXiv:1512.05428.
- Roger H. Koch, G. Grinstein, G. A. Keefe, Yu Lu, P. L. Trouilloud, W. J. Gallagher, and S. S. P. Parkin, Thermally Assisted Magnetization Reversal in Submicron-Sized Magnetic Thin Films, Phys. Rev. Lett. 84, 5419 (2000).
- S. Urazhdin, N. O. Birge, W. P. Pratt, Jr., and J. Bass, Current-Driven Magnetic Excitations in Permalloy-Based Multilayer Nanopillars, Phys. Rev. Lett. 91, 146803 (2003).
- I. N. Krivorotov, N. C. Emley, A. G. F. Garcia, J. C. Sankey, S. I. Kiselev, D. C. Ralph, and R. A. Buhrman, Temperature Dependence of Spin-Transfer-Induced Switching of Nanomagnets, Phys. Rev. Lett. 93, 166603 (2004).
- A. V. Khvalkovskiy, D. Apalkov, S. Watts, R. Chepulskii, R. S. Beach, A. Ong, X. Tang, A. Driskill-Smith, W. H. Butler, P. B. Visscher et al., Basic Principles of STT-MRAM Cell Operation in Memory Arrays, J. Phys. D 46, 074001 (2013).
- R. P. Cowburn, Property Variation with Shape in Magnetic Nanoelements, J. Phys. D 33, R1 (2000).
- P. Debashis, R. Faria, K. Y. Camsari, J. Appenzeller, S. Datta, and Z. Chen, Experimental demonstration of nanomagnet networks as hardware for ising computing, in Proceedings of the 2016 IEEE International Electron Devices Meeting (IEDM) (IEEE, New York, 2016), pp. 34.3.1–34.3.4.
- K. Y. Camsari, S. Ganguly, and S. Datta, Modular Approach to Spintronics, Sci. Rep. 5, 10571 (2015).
- L. Liu, T. Moriyama, D. C. Ralph, and R. A. Buhrman, Spin-Torque Ferromagnetic Resonance Induced by the Spin Hall Effect, Phys. Rev. Lett. 106, 036601 (2011).
- S. Hong, S. Sayed, and S. Datta, Spin Circuit Representation for the Spin Hall Effect, IEEE Trans. Nanotechnol. 15, 225 (2016).
- S. Datta, S. Salahuddin, and B. Behin-Aein, Non-Volatile Spin Switch for Boolean and Non-Boolean Logic, Appl. Phys. Lett. 101, 252411 (2012).
- W. H. Butler, T. Mewes, C. K. A. Mewes, P. B. Visscher, W. H. Rippard, S. E. Russek, and R. Heindl, Switching Distributions for Perpendicular Spin-Torque Devices within the Macrospin Approximation, IEEE Trans. Magn. 48, 4684 (2012).
- A. D. Kent and D. C. Worledge, A New Spin on Magnetic Memories, Nat. Nanotechnol. 10, 187 (2015).
- D. Morris, D. Bromberg, J.-G. J. Zhu, and L. Pileggi, in Proceedings of the 49th Annual Design Automation Conference (ACM, San Fransisco, 2012), pp. 486–491.
- D. Datta, B. Behin-Aein, S. Datta, and S. Salahuddin, Voltage Asymmetry of Spin-Transfer Torques, IEEE Trans. Nanotechnol. 11, 261 (2012).
- Predictive Technology Model (PTM), http://ptm.asu.edu/.
- J. D. Biamonte, Nonperturbative -Body to Two-Body Commuting Conversion Hamiltonians and Embedding Problem Instances into Ising Spins, Phys. Rev. A 77, 052331 (2008).
- K.-U. Demasius, T. Phung, W. Zhang, B. P. Hughes, S.-H. Yang, A. Kellock, W. Han, A. Pushp, and S. S. P. Parkin, Enhanced Spin-Orbit Torques by Oxygen Incorporation in Tungsten Films, Nat. Commun. 7, 10644 (2016).
- C.-F. Pai, L. Liu, Y. Li, H. W. Tseng, D. C. Ralph, and R. A. Buhrman, Spin Transfer Torque Devices Utilizing the Giant Spin Hall Effect of Tungsten, Appl. Phys. Lett. 101, 122404 (2012).
- Q. Hao and G. Xiao, Giant Spin Hall Effect and Switching Induced by Spin-Transfer Torque in a Structure with Perpendicular Magnetic Anisotropy, Phys. Rev. Applied 3, 034009 (2015).
- T. J. Sejnowski, P. K. Kienker, and G. E. Hinton, Learning Symmetry Groups with Hidden Units: Beyond the Perceptron, Physica (Amsterdam) 22D, 260 (1986).
- S. Patarnello and P. Carnevali, Learning Networks of Neurons with Boolean Logic, Europhys. Lett. 4, 503 (1987).
- L. Personnaz, I. Guyon, and G. Dreyfus, Collective Computational Properties of Neural Networks: New Learning Mechanisms, Phys. Rev. A 34, 4217 (1986).
- S. V. B. Aiyer, M. Niranjan, and F. Fallside, A Theoretical Investigation into the Performance of the Hopfield Model, IEEE Trans. Neural Networks 1, 204 (1990).
- H. Suzuki, J.-i. Imura, Y. Horio, and K. Aihara, Chaotic Boltzmann Machines, Sci. Rep. 3, 1610 (2013).
- G. E. Hinton, Boltzmann Machine, Scholarpedia 2, 1668 (2007), revision no. 91075.
- J. J. Hopfield, Neural Networks and Physical Systems with Emergent Collective Computational Abilities, Proc. Natl. Acad. Sci. U.S.A. 79, 2554 (1982).
- B. Sutton, K. Y. Camsari, R. Faria, and S. Datta, Probabilistic Spin Logic Simulator, 2017, https://nanohub.org/resources/26057
- J. Liu, S. Zhou, H. Zhu, and C.-K. Cheng, in Proceedings of the 2003 IEEE/ACM International Conference on Computer-Aided Design (IEEE Computer Society, San Jose, 2003), p. 734.
- R. Uma, V. Vijayan, M. Mohanapriya, and S. Paul, Area, Delay and Power Comparison of Adder Topologies, Int. J. VLSI Design Commun. Syst. 3, 153 (2012).
- D. E. Knuth and L. T. Pardo, Analysis of a Simple Factorization Algorithm, Theor. Comput. Sci. 3, 321 (1976).
- F. L. Traversa and M. Di Ventra, Polynomial-Time Solution of Prime Factorization and NP-Complete Problems with Digital Memcomputing Machines, Chaos 27, 023107 (2017).
- M. Di Ventra, F. L. Traversa, and I. V. Ovchinnikov, Topological Field Theory and Computing with Instantons, arXiv:1609.03230.
- A. Ekert and R. Jozsa, Quantum Computation and Shor’s Factoring Algorithm, Rev. Mod. Phys. 68, 733 (1996).
- R. P. Feynman, Simulating Physics with Computers, Int. J. Theor. Phys. 21, 467 (1982).
