Reuse & Permissions

It is not necessary to obtain permission to reuse this article or its components as it is available under the terms of the Creative Commons Attribution 4.0 International license. This license permits unrestricted use, distribution, and reproduction in any medium, provided attribution to the author(s) and the published article's title, journal citation, and DOI are maintained. Please note that some figures may have been included with permission from other third parties. It is your responsibility to obtain the proper permission from the rights holder directly for these figures.

Export citation

Export citation

Choose format for download:

Download Citation
  • Letter
  • Open Access
  • Access by Xinjiang University

Higher order definition of causality by optimally conditioned transfer entropy

Jakub Kořenek1,2, Pavel Sanda1, and Jaroslav Hlinka1,3,*

  • *Contact author: hlinka@cs.cas.cz

Phys. Rev. E 111, L042302 – Published 23 April, 2025

DOI: https://doi.org/10.1103/PhysRevE.111.L042302

Abstract

The description of the dynamics of complex systems, in particular the capture of the interaction structure and causal relationships between elements of the system, is one of the central questions of interdisciplinary research. While the characterization of pairwise causal interactions is a relatively ripe field with established theoretical concepts and the current focus is on technical issues of their efficient estimation, it turns out that the standard concepts such as Granger causality or transfer entropy may not faithfully reflect possible synergies or interactions of higher orders, phenomena highly relevant for many real-world complex systems. In this paper, we propose a generalization and refinement of the information-theoretic approach to causal inference, enabling the description of truly multivariate, rather than multiple pairwise, causal interactions, and moving thus from causal networks to causal hypernetworks. In particular, while keeping the ability to control for mediating variables or common causes, in case of purely synergistic interactions such as the exclusive disjunction, it ascribes the causal role to the multivariate causal set but not to individual inputs, distinguishing it thus from the case of, e.g., two additive univariate causes. We demonstrate this concept by application to illustrative theoretical examples as well as a biophysically realistic simulation of biological neuronal dynamics recently reported to employ synergistic computations.

View figure in article

Physics Subject Headings (PhySH)

Article Text

References (24)

  1. S. Boccaletti, V. Latora, Y. Moreno, M. Chavez, and D. U. Hwang, Phys. Rep. 424, 175 (2006).
  2. C. W. Granger, Econometrica 37, 424 (1969).
  3. T. Schreiber, Phys. Rev. Lett. 85, 461 (2000).
  4. K. Hlaváčková-Schindler, M. Paluš, M. Vejmelka, and J. Bhattacharya, Phys. Rep. 441, 1 (2007).
  5. L. Barnett, A. B. Barrett, and A. K. Seth, Phys. Rev. Lett. 103, 238701 (2009).
  6. J. Hlinka, D. Hartman, N. Jajcay, D. Tomeček, J. Tintěra, and M. Paluš, Chaos 27, 035812 (2017).
  7. F. Battiston, E. Amico, A. Barrat, G. Bianconi, G. Ferraz de Arruda, B. Franceschiello, I. Iacopini, S. Kéfi, V. Latora, Y. Moreno, M. M. Murray, T. P. Peixoto, F. Vaccarino, and G. Petri, Nat. Phys. 17, 1093 (2021).
  8. E. Schneidman, M. J. Berry, II, R. Segev, and W. Bialek, Nature (London) 440, 1007 (2006).
  9. S. Yu, H. Yang, H. Nakahara, G. S. Santos, D. Nikolić, and D. Plenz, J. Neurosci. 31, 17514 (2011).
  10. M. M. Mayfield and D. B. Stouffer, Nat. Ecol. Evol. 1, 0062 (2017).
  11. G. Cencetti, F. Battiston, B. Lepri, and M. Karsai, Sci. Rep. 11, 7028 (2021).
  12. M. A. Javidian, Z. Wang, L. Lu, and M. Valtorta, Ann. Math. Artif. Intell. 88, 1003 (2020).
  13. J. Kořenek and J. Hlinka, Chaos 30, 013117 (2020).
  14. A. Fotiadis, I. Vlachos, and D. Kugiumtzis, Chaos 34, 033113 (2024).
  15. E. Martin, J. Hlinka, and J. Davidsen, Phys. Rev. E 94, 040301(R) (2016).
  16. P. L. Williams and R. D. Beer, arXiv:1004.2515.
  17. S. Stramaglia, L. Faes, J. M. Cortes, and D. Marinazzo, Phys. Rev. Res. 6, L032007 (2024).
  18. J. Pearl, Causality, 2nd ed. (Cambridge University Press, Cambridge, UK, 2009).
  19. J. Pearl, Probabilistic and Causal Inference: The Works of Judea Pearl, 1st ed. (Association for Computing Machinery, New York, NY, USA, 2022), pp. 373–392.
  20. H. Al-Dmour and A. Al-Ani, Expert Syst. Appl. 46, 293 (2016).
  21. A.-V. Diaconu and I. Sima, in Proceedings of the International Conference on Electronics, Computers and Artificial Intelligence-ECAI-2013 (IEEE, Piscataway, New Jersey, USA, 2013), pp. 1–6.
  22. M. Meister and M. J. Berry, II, Neuron 22, 435 (1999).
  23. A. Gidon, T. A. Zolnik, P. Fidzinski, F. Bolduan, A. Papoutsi, P. Poirazi, M. Holtkamp, I. Vida, and M. E. Larkum, Science 367, 83 (2020).
  24. https://modeldb.science/2016664.

Outline

Information

Sign In to Your Journals Account

Filter

Filter

Article Lookup

Enter a citation