- Access by Xinjiang University
Reservoir observer enhanced with residual calibration and attention mechanism
Phys. Rev. E 113, 034201 – Published 2 March, 2026
DOI: https://doi.org/10.1103/jjcf-w1st
Abstract
Reservoir observers provide a data-driven approach to the inference of unmeasured variables from observed ones for nonlinear dynamical systems. While previous studies have demonstrated wide applicability, their performance may vary considerably with different input variables, even compromising reliability in the worst cases. To enhance the performance of inference, we integrate residual calibration and attention mechanism into the reservoir observer design. The residual calibration module leverages information from the estimation residuals to refine the observer output, and the attention mechanism exploits the temporal dependencies of the data to enrich the representation of reservoir internal dynamics. Experiments on typical chaotic systems demonstrate that our method substantially improves inference accuracy, especially for the worst cases resulting from the traditional reservoir observers. We also invoke the notion of transfer entropy to explain the reason for the input-dependent observation discrepancy and the effectiveness of the proposed method.
Physics Subject Headings (PhySH)
Article Text
References (31)
- D. Luenberger, An introduction to observers, IEEE Trans. Aut. Contr. 16, 596 (1971).
- Z. Lu, J. Pathak, B. Hunt, M. Girvan, R. Brockett, and E. Ott, Reservoir observers: Model-free inference of unmeasured variables in chaotic systems, Chaos 27, 041102 (2017).
- H. Jaeger and H. Haas, Harnessing nonlinearity: Predicting chaotic systems and saving energy in wireless communication, Science 304, 78 (2004).
- M. Rafayelyan, J. Dong, Y. Tan, F. Krzakala, and S. Gigan, Large-scale optical reservoir computing for spatiotemporal chaotic systems prediction, Phys. Rev. X 10, 041037 (2020).
- H. Zhang, H. Fan, L. Wang, and X. Wang, Learning Hamiltonian dynamics with reservoir computing, Phys. Rev. E 104, 024205 (2021).
- P. R. Vlachas, J. Pathak, B. R. Hunt, T. P. Sapsis, M. Girvan, E. Ott, and P. Koumoutsakos, Backpropagation algorithms and reservoir computing in recurrent neural networks for the forecasting of complex spatiotemporal dynamics, Neural Netw. 126, 191 (2020).
- J. Pathak, B. Hunt, M. Girvan, Z. Lu, and E. Ott, Model-free prediction of large spatiotemporally chaotic systems from data: A reservoir computing approach, Phys. Rev. Lett. 120, 024102 (2018).
- J. Pathak, Z. Lu, B. R. Hunt, M. Girvan, and E. Ott, Using machine learning to replicate chaotic attractors and calculate Lyapunov exponents from data, Chaos 27, 121102 (2017).
- A. Haluszczynski and C. Räth, Good and bad predictions: Assessing and improving the replication of chaotic attractors by means of reservoir computing, Chaos 29, 103143 (2019).
- T. L. Carroll, Using reservoir computers to distinguish chaotic signals, Phys. Rev. E 98, 052209 (2018).
- H. Peng, X. Xiong, M. Wu, J. Wang, Q. Yang, D. Orellana-Martín, and M. J. Pérez-Jiménez, Reservoir computing models based on spiking neural P systems for time series classification, Neural Netw. 169, 274 (2024).
- F. M. Bianchi, S. Scardapane, S. Løkse, and R. Jenssen, Reservoir computing approaches for representation and classification of multivariate time series, IEEE Trans. Neural Netw. Learn. Syst. 32, 2169 (2020).
- P. Antonik, M. Gulina, J. Pauwels, and S. Massar, Using a reservoir computer to learn chaotic attractors, with applications to chaos synchronization and cryptography, Phys. Rev. E 98, 012215 (2018).
- A. Nazerian, C. Nathe, J. D. Hart, and F. Sorrentino, Synchronizing chaos using reservoir computing, Chaos 33, 103121 (2023).
- L.-W. Kong, H.-W. Fan, C. Grebogi, and Y.-C. Lai, Machine learning prediction of critical transition and system collapse, Phys. Rev. Res. 3, 013090 (2021).
- S. Panahi, L.-W. Kong, M. Moradi, Z.-M. Zhai, B. Glaz, M. Haile, and Y.-C. Lai, Machine learning prediction of tipping in complex dynamical systems, Phys. Rev. Res. 6, 043194 (2024).
- K. Nakai and Y. Saiki, Machine-learning inference of fluid variables from data using reservoir computing, Phys. Rev. E 98, 023111 (2018).
- R. S. Zimmermann and U. Parlitz, Observing spatio-temporal dynamics of excitable media using reservoir computing, Chaos 28, 043118 (2018).
- U. Parlitz, Learning from the past: Reservoir computing using delayed variables, Front. Appl. Math. Stat. 10, 1221051 (2024).
- I. Goodfellow, Y. Bengio, and A. Courville, Deep Learning (MIT Press, Cambridge, MA, 2016).
- A. Yuan, D. Wang, J. Bai, Z. Xiao, Z. Wang, J. Li, and L. Jiao, Lightweight and lifelong hyperspectral image classification via attention-based reservoir computing, IEEE Trans. Geosci. Remote Sens. 62, 5514517 (2024).
- F. Köster, K. Kanno, J. Ohkubo, and A. Uchida, Attention-enhanced reservoir computing, Phys. Rev. Appl. 22, 014039 (2024).
- T. Schreiber, Measuring information transfer, Phys. Rev. Lett. 85, 461 (2000).
- T. Bäck and H.-P. Schwefel, An overview of evolutionary algorithms for parameter optimization, Evol. Comput. 1, 1 (1993).
- K. Beyer, J. Goldstein, R. Ramakrishnan, and U. Shaft, When is “nearest neighbor” meaningful? in International Conference on Database Theory (Springer, Berlin, 1999), pp. 217–235.
- M. Gavish and D. L. Donoho, The optimal hard threshold for singular values is , IEEE Trans. Inf. Theory 60, 5040 (2014).
- E. Ott, Chaos in Dynamical Systems (Cambridge University Press, Cambridge, 2002).
- Chua's Circuit: A Paradigm for Chaos, edited by R. N. Madan (World Scientific, Singapore, 1993).
- J. M. Hyman and B. Nicolaenko, The Kuramoto-Sivashinsky equation: A bridge between PDE's and dynamical systems, Physica D 18, 113 (1986).
- O. Bousquet and A. Elisseeff, Stability and generalization, J. Mach. Learn. Res. 2, 499 (2002).
- H.-H. Ren, Y.-L. Bai, M.-H. Fan, L. Ding, X.-X. Yue, and Q.-H. Yu, Constructing polynomial libraries for reservoir computing in nonlinear dynamical system forecasting, Phys. Rev. E 109, 024227 (2024).
