Tangent Space Causal Inference: Leveraging Vector Fields for Causal Discovery in Dynamical Systems
Abstract: Causal discovery with time series data remains a challenging yet increasingly important task across many scientific domains. Convergent cross mapping (CCM) and related methods have been proposed to study time series that are generated by dynamical systems, where traditional approaches like Granger causality are unreliable. However, CCM often yields inaccurate results depending upon the quality of the data. We propose the Tangent Space Causal Inference (TSCI) method for detecting causalities in dynamical systems. TSCI works by considering vector fields as explicit representations of the systems' dynamics and checks for the degree of synchronization between the learned vector fields. The TSCI approach is model-agnostic and can be used as a drop-in replacement for CCM and its generalizations. We first present a basic version of the TSCI algorithm, which is shown to be more effective than the basic CCM algorithm with very little additional computation. We additionally present augmented versions of TSCI that leverage the expressive power of latent variable models and deep learning. We validate our theory on standard systems, and we demonstrate improved causal inference performance across a number of benchmark tasks.
- Interventional causal representation learning. In International Conference on Machine Learning, pages 372–407. PMLR, 2023.
- A robust method for detecting interdependences: application to intracranially recorded EEG. Physica D: Nonlinear Phenomena, 134(4):419–430, 1999.
- Bayesian inference of causal relations between dynamical systems. Chaos, Solitons & Fractals, 185:115142, 2024.
- Cause-effect inference by comparing regression errors. In International Conference on Artificial Intelligence and Statistics, pages 900–909. PMLR, 2018.
- Convergent cross sorting for estimating dynamic coupling. Scientific Reports, 11(1):20374, 2021.
- On causal discovery with convergent cross mapping. IEEE Transactions on Signal Processing, 2023.
- Spatial convergent cross mapping to detect causal relationships from short time series. Ecology, 96(5):1174–1181, 2015.
- Limits to causal inference with state-space reconstruction for infectious disease. PloS one, 11(12):e0169050, 2016.
- Elements of Information Theory. Wiley-Interscience, USA, 2006.
- Beyond normal: On the evaluation of mutual information estimators. In Thirty-seventh Conference on Neural Information Processing Systems, 2023.
- Inferring deterministic causal relations. In Proceedings of the Twenty-Sixth Conference on Uncertainty in Artificial Intelligence, pages 143–150, 2010.
- Latent convergent cross mapping. In International Conference on Learning Representations, 2020.
- Improving convergent cross mapping for causal discovery with Gaussian processes. In 2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pages 3692–3696. IEEE, 2020.
- Causal inference from cross-sectional earth system data with geographical convergent cross mapping. Nature Communications, 14(1):5875, 2023.
- Clive WJ Granger. Investigating causal relations by econometric models and cross-spectral methods. Econometrica: Journal of the Econometric Society, pages 424–438, 1969.
- Michael T Heath. Scientific Computing: An Introductory Survey. SIAM, 2018.
- Nonlinear causal discovery with additive noise models. Advances in Neural Information Processing Systems, 21, 2008.
- Causal discovery toolbox: Uncovering causal relationships in Python. Journal of Machine Learning Research, 21(37):1–5, 2020.
- Determining embedding dimension for phase-space reconstruction using a geometrical construction. Physical Review A, 45(6):3403, 1992.
- Estimating mutual information. Physical Review E, 69(6):066138, 2004.
- Dimitris Kugiumtzis. State space reconstruction parameters in the analysis of chaotic time series—the role of the time window length. Physica D: Nonlinear Phenomena, 95(1):13–28, 1996.
- John M Lee. Introduction to Smooth Manifolds, volume 218 of Graduate Texts in Mathematics. Springer, second edition, 2012.
- Detecting causality from nonlinear dynamics with short-term time series. Scientific Reports, 4(1):7464, 2014.
- A. McInerney. First Steps in Differential Geometry: Riemannian, Contact, Symplectic. Undergraduate Texts in Mathematics. Springer New York, 2013.
- Causal inference from noisy time-series data—testing the convergent cross-mapping algorithm in the presence of noise and external influence. Future Generation Computer Systems, 73:52–62, 2017.
- Training deep networks without learning rates through coin betting. Advances in Neural Information Processing Systems, 30, 2017.
- Judea Pearl. Causality. Cambridge University Press, 2009.
- Learning driver-response relationships from synchronization patterns. Physical Review E, 61(5):5142, 2000.
- Generalized synchronization of chaos in directionally coupled chaotic systems. Physical Review E, 51(2):980, 1995.
- Causal inference for time series. Nature Reviews Earth & Environment, 4(7):487–505, 2023.
- Identifying causal gateways and mediators in complex spatio-temporal systems. Nature Communications, 6(1):8502, 2015.
- Tim Sauer. Reconstruction of dynamical systems from interspike intervals. Physical Review Letters, 72(24):3811, 1994.
- Embedology. Journal of Statistical Physics, 65:579–616, 1991.
- Smoothing and differentiation of data by simplified least squares procedures. Analytical Chemistry, 36(8):1627–1639, 1964.
- Detecting dynamical interdependence and generalized synchrony through mutual prediction in a neural ensemble. Physical Review E, 54(6):6708, 1996.
- Toward causal representation learning. Proceedings of the IEEE, 109(5):612–634, 2021.
- statsmodels: Econometric and statistical modeling with Python. In 9th Python in Science Conference, 2010.
- Derivative observations in Gaussian process models of dynamic systems. Advances in Neural Information Processing Systems, 15, 2002.
- Jaroslav Stark. Delay embeddings for forced systems. I. Deterministic forcing. Journal of Nonlinear Science, 9:255–332, 1999.
- Delay embeddings for forced systems. II. Stochastic forcing. Journal of Nonlinear Science, 13:519–577, 2003.
- Detecting causality in complex ecosystems. Science, 338(6106):496–500, 2012.
- Floris Takens. Detecting strange attractors in turbulence. In David Rand and Lai-Sang Young, editors, Dynamical Systems and Turbulence, Warwick 1980, pages 366–381, Berlin, Heidelberg, 1981. Springer.
- Learning causal representations with Granger PCA. In UAI 2022 Workshop on Causal Representation Learning, 2022.
- Distinguishing time-delayed causal interactions using convergent cross mapping. Scientific Reports, 5(1):14750, 2015.
- Information leverage in interconnected ecosystems: Overcoming the curse of dimensionality. Science, 353(6302):922–925, 2016.
- Causal-learn: Causal discovery in Python. Journal of Machine Learning Research, 25(60):1–8, 2024.
Paper Prompts
Sign up for free to create and run prompts on this paper using GPT-5.
Top Community Prompts
Collections
Sign up for free to add this paper to one or more collections.