- Letter
- Open Access
- Access by Xinjiang University
Higher order definition of causality by optimally conditioned transfer entropy
Phys. Rev. E 111, L042302 – Published 23 April, 2025
DOI: https://doi.org/10.1103/PhysRevE.111.L042302
Abstract
The description of the dynamics of complex systems, in particular the capture of the interaction structure and causal relationships between elements of the system, is one of the central questions of interdisciplinary research. While the characterization of pairwise causal interactions is a relatively ripe field with established theoretical concepts and the current focus is on technical issues of their efficient estimation, it turns out that the standard concepts such as Granger causality or transfer entropy may not faithfully reflect possible synergies or interactions of higher orders, phenomena highly relevant for many real-world complex systems. In this paper, we propose a generalization and refinement of the information-theoretic approach to causal inference, enabling the description of truly multivariate, rather than multiple pairwise, causal interactions, and moving thus from causal networks to causal hypernetworks. In particular, while keeping the ability to control for mediating variables or common causes, in case of purely synergistic interactions such as the exclusive disjunction, it ascribes the causal role to the multivariate causal set but not to individual inputs, distinguishing it thus from the case of, e.g., two additive univariate causes. We demonstrate this concept by application to illustrative theoretical examples as well as a biophysically realistic simulation of biological neuronal dynamics recently reported to employ synergistic computations.
Physics Subject Headings (PhySH)
Article Text
References (24)
- S. Boccaletti, V. Latora, Y. Moreno, M. Chavez, and D. U. Hwang, Phys. Rep. 424, 175 (2006).
- C. W. Granger, Econometrica 37, 424 (1969).
- T. Schreiber, Phys. Rev. Lett. 85, 461 (2000).
- K. Hlaváčková-Schindler, M. Paluš, M. Vejmelka, and J. Bhattacharya, Phys. Rep. 441, 1 (2007).
- L. Barnett, A. B. Barrett, and A. K. Seth, Phys. Rev. Lett. 103, 238701 (2009).
- J. Hlinka, D. Hartman, N. Jajcay, D. Tomeček, J. Tintěra, and M. Paluš, Chaos 27, 035812 (2017).
- F. Battiston, E. Amico, A. Barrat, G. Bianconi, G. Ferraz de Arruda, B. Franceschiello, I. Iacopini, S. Kéfi, V. Latora, Y. Moreno, M. M. Murray, T. P. Peixoto, F. Vaccarino, and G. Petri, Nat. Phys. 17, 1093 (2021).
- E. Schneidman, M. J. Berry, II, R. Segev, and W. Bialek, Nature (London) 440, 1007 (2006).
- S. Yu, H. Yang, H. Nakahara, G. S. Santos, D. Nikolić, and D. Plenz, J. Neurosci. 31, 17514 (2011).
- M. M. Mayfield and D. B. Stouffer, Nat. Ecol. Evol. 1, 0062 (2017).
- G. Cencetti, F. Battiston, B. Lepri, and M. Karsai, Sci. Rep. 11, 7028 (2021).
- M. A. Javidian, Z. Wang, L. Lu, and M. Valtorta, Ann. Math. Artif. Intell. 88, 1003 (2020).
- J. Kořenek and J. Hlinka, Chaos 30, 013117 (2020).
- A. Fotiadis, I. Vlachos, and D. Kugiumtzis, Chaos 34, 033113 (2024).
- E. Martin, J. Hlinka, and J. Davidsen, Phys. Rev. E 94, 040301(R) (2016).
- P. L. Williams and R. D. Beer, arXiv:1004.2515.
- S. Stramaglia, L. Faes, J. M. Cortes, and D. Marinazzo, Phys. Rev. Res. 6, L032007 (2024).
- J. Pearl, Causality, 2nd ed. (Cambridge University Press, Cambridge, UK, 2009).
- J. Pearl, Probabilistic and Causal Inference: The Works of Judea Pearl, 1st ed. (Association for Computing Machinery, New York, NY, USA, 2022), pp. 373–392.
- H. Al-Dmour and A. Al-Ani, Expert Syst. Appl. 46, 293 (2016).
- A.-V. Diaconu and I. Sima, in Proceedings of the International Conference on Electronics, Computers and Artificial Intelligence-ECAI-2013 (IEEE, Piscataway, New Jersey, USA, 2013), pp. 1–6.
- M. Meister and M. J. Berry, II, Neuron 22, 435 (1999).
- A. Gidon, T. A. Zolnik, P. Fidzinski, F. Bolduan, A. Papoutsi, P. Poirazi, M. Holtkamp, I. Vida, and M. E. Larkum, Science 367, 83 (2020).
- https://modeldb.science/2016664.