On Geometry of Information Flow for Causal Inference

  • 2020-02-06 02:46:48
  • Sudam Surasinghe, Erik M. Bollt
  • 18

Abstract

Causal inference is perhaps one of the most fundamental concepts in science,beginning originally from the works of some of the ancient philosophers,through today, but also weaved strongly in current work from statisticians,machine learning experts, and scientists from many other fields. This papertakes the perspective of information flow, which includes the Nobel prizewinning work on Granger-causality, and the recently highly popular transferentropy, these being probabilistic in nature. Our main contribution will be todevelop analysis tools that will allow a geometric interpretation ofinformation flow as a causal inference indicated by positive transfer entropy.We will describe the effective dimensionality of an underlying manifold asprojected into the outcome space that summarizes information flow. Thereforecontrasting the probabilistic and geometric perspectives, we will introduce anew measure of causal inference based on the fractal correlation dimensionconditionally applied to competing explanations of future forecasts, which wewill write $GeoC_{y\rightarrow x}$. This avoids some of the boundedness issuesthat we show exist for the transfer entropy, $T_{y\rightarrow x}$. We willhighlight our discussions with data developed from synthetic models ofsuccessively more complex nature: then include the H\'{e}non map example, andfinally a real physiological example relating breathing and heart ratefunction. Keywords: Causal Inference; Transfer Entropy; Differential Entropy;Correlation Dimension; Pinsker's Inequality; Frobenius-Perron operator.

 

Quick Read (beta)

loading the full paper ...