Novel approach constructs differential causal networks from EEG data.
problem Difficulty in modeling interactions of thousands of neurons in group comparisons.
method Hierarchical differential dynamic causal nets based on Chen-Fliess expansions.
result Evidence of network functional disruptions in epileptic brains.
This paper presents a new causal network learning algorithm (FSNN, Feedback System Neural Network) based on the construction and analysis of a non-linear system of Ordinary Differential Equations (ODEs). The constructed system provides insight into the mechanisms responsible for generating the past and potential future…
Partial differential equations (PDEs) are commonly derived based on empirical observations. However, recent advances of technology enable us to collect and store massive amount of data, which offers new opportunities for data-driven discovery of PDEs. In this paper, we propose a new deep neural network, called PDE-Net …
SDE-Net quantifies uncertainty in deep nets using stochastic dynamics.
problem Uncertainty quantification in deep neural networks.
method Viewing DNN transformations as state evolution of a stochastic dynamical system, introducing a Brownian motion term for epistemic uncertainty.
result SDE-Net outperforms existing methods in uncertainty estimation across various tasks.
Combines causal learning with dynamical systems for practical model identification.
problem Lack of practical, identifiable models for causal inference in dynamical systems.
method Draws connection between causal representation learning and dynamical systems, applying identifiable methods to scalable differentiable solvers.
result Learned explicitly controllable models for trajectory-specific parameters.
In this paper, we present an initial attempt to learn evolution PDEs from data. Inspired by the latest development of neural network designs in deep learning, we propose a new feed-forward deep network, called PDE-Net, to fulfill two objectives at the same time: to accurately predict dynamics of complex systems and to …
Dynamic Structural Causal Models handle time-dependent systems with cycles and latent confounding.
problem Representing and analyzing systems of Stochastic Differential Equations (SDEs) with DSCMs.
method Define time-splitting and subsampling operations to analyze DSCMs of SDEs, and apply existing causal discovery algorithms to time-series data.
result DSCMs provide a graphical Markov property for SDEs and enable identification of time-dependent causal effects.
Neural Ordinary Differential Equations (N-ODEs) are a powerful building block for learning systems, which extend residual networks to a continuous-time dynamical system. We propose a Bayesian version of N-ODEs that enables well-calibrated quantification of prediction uncertainty, while maintaining the expressive power …
Improves model accuracy for neural nets in stochastic dynamics with partial prior knowledge.
problem Stability and accuracy in neural nets modeling stochastic dynamics with many parameters.
method Three steps: probabilistic weights, partial knowledge incorporation, and PAC-Bayesian training.
result Improved model fit with partial and noisy prior knowledge.
BCD Nets use variational inference to estimate DAGs with uncertainty.
problem Uncertainty in inferring causal graphs from limited data.
method Variational inference framework for Bayesian DAG estimation.
result BCD Nets outperform maximum-likelihood methods in low data regimes.
CASPER improves DAG structure learning by integrating graph structure into score function.
problem Discovering suboptimal DAGs and model vulnerabilities in causal discovery.
method CASPER integrates graph structure into the score function as a new measure in the causal space, enhancing DAG structure learning via adaptive attention to DAG-ness.
result CASPER outperforms state-of-the-art methods in terms of accuracy and robustness.
Study improves paddy rice yield predictions in Peru using sparse regression and climatic variables.
problem Improving precision of paddy rice yield forecasts in Peru.
method Sparse regression, Elastic-Net regularization, climatic variables, dynamic transformations.
result Improved predictive performance of paddy rice yield forecasts.
Computational Fluid Dynamics (CFD) is a hugely important subject with applications in almost every engineering field, however, fluid simulations are extremely computationally and memory demanding. Towards this end, we present Lat-Net, a method for compressing both the computation time and memory usage of Lattice Boltzm…
In this paper, we propose a novel unsupervised learning method to learn the brain dynamics using a deep learning architecture named residual D-net. As it is often the case in medical research, in contrast to typical deep learning tasks, the size of the resting-state functional Magnetic Resonance Image (rs-fMRI) dataset…
A novel method for learning DAGs from positive-valued data.
problem Causal discovery from observational data of positive-valued variables.
method Hybrid Moment-Ratio Scoring (H-MRS) algorithm combining moment-based scoring and log-scale regression.
result H-MRS integrates log-scale Ridge regression for moment-ratio estimation with a greedy ordering procedure based on raw-scale moment ratios, followed by Elastic Net-based parent selection.
RODE-Net learns ODEs from data with random parameters using neural networks and GANs.
problem Learning ODEs from data with unknown and random parameters.
method RODE-Net combines symbolic networks and GANs to estimate both the ODE and its parameters.
result RODE-Net can accurately estimate the distribution of model parameters and make reliable predictions.
Temporal Causal Prior-Data Fitted Networks (TCPFN) for industrial time series causal discovery
problem Estimating causal effects in industrial time series
method Temporal Causal Prior-Data Fitted Networks
result Zero-shot causal discovery with explicit reliability signals
Paper tackles anomaly detection and RCA in dynamical systems using ICODE Networks.
problem Anomalies in dynamical systems impact performance and reliability.
method Proposes ICODE Networks for anomaly detection, RCA, and type classification.
result Demonstrates the ability to accurately detect anomalies, classify types, and pinpoint origins.
A new algorithm infers causal networks from data using topological thresholds.
problem Inferring causal networks from data.
method Two methods for determining topological thresholds: one to leave no disconnected nodes, the other to find a causal large connected component.
result The novel algorithm is faster and more accurate than the PC algorithm.
The paper develops CI tests for causal discovery in SDEs.
problem Inferring causal structure from stochastic dynamical systems.
method Developed CI constraints and a CI test for SDEs.
result Proposed CI test outperforms existing methods.
Structural Causal Models (SCMs) provide a popular causal modeling framework. In this work, we show that SCMs are not flexible enough to give a complete causal representation of dynamical systems at equilibrium. Instead, we propose a generalization of the notion of an SCM, that we call Causal Constraints Model (CCM), an…
Perfect adaptation in systems is identified and tested using graphical tools.
problem Identifying perfect adaptation in dynamical systems.
method Causal ordering algorithm and graphical representations of dynamical systems.
result Sufficient graphical and testing conditions for perfect adaptation.
Dynamical systems are widely used in science and engineering to model systems consisting of several interacting components. Often, they can be given a causal interpretation in the sense that they not only model the evolution of the states of the system's components over time, but also describe how their evolution is af…
We establish causal semantics for SDEs and develop methods to reason about them.
problem Understanding causal relationships in systems modeled by stochastic differential equations.
method We introduce a causal graph framework, Markov properties, and do-calculus for SDEs.
result We prove the σ-separation Markov property and do-calculus for causal SDEs. New algebraic-geometry method for Ribaucour transformations.
problem Classical differential geometry problems.
method Algebraic-geometry approach to constructing orthogonal nets.
result Obtains smooth orthogonal nets as Ribaucour transformations.
In this paper, we introduce Symplectic ODE-Net (SymODEN), a deep learning framework which can infer the dynamics of a physical system, given by an ordinary differential equation (ODE), from observed state trajectories. To achieve better generalization with fewer training samples, SymODEN incorporates appropriate induct…
Automatic debiasing for causal and policy effects using Neural Nets and Random Forests.
problem Estimating causal and policy effects from high-dimensional or non-parametric regression functions.
method Automatic learning of Riesz representation using Neural Nets and Random Forests.
result Automatic debiasing method performs well compared to state-of-the-art algorithms.
Proposes Causal Loss to improve machine learning models' causal inference.
problem Machine learning algorithms often fail to capture causal relationships when data is inconsistent.
method Introduces Causal Loss, a model-agnostic loss function that enhances interventional capabilities.
result Causal Loss improves non-causal associative models to have interventional capabilities.
Graph neural controlled differential equations learn graph dynamics from vertex observations.
problem Predicting future states of dynamical systems on graphs with limited vertex data.
method Incorporates graph topology information into NCDE to predict graph dynamics.
result Informed NCDE requires fewer parameters and lower MAE compared to previous methods.
DP-Net uses dynamic programming for efficient deep neural network compression.
problem Efficiently compressing deep neural networks while maintaining accuracy.
method Dynamic Programming for optimal weight quantization and clustering-friendly training.
result Achieves up to 77X compression ratio on Wide ResNet with minimal accuracy loss.
The Frame Problem (FP) is a puzzle in philosophy of mind and epistemology, articulated by the Stanford Encyclopedia of Philosophy as follows: "How do we account for our apparent ability to make decisions on the basis only of what is relevant to an ongoing situation without having explicitly to consider all that is not …
Despite the phenomenal success of deep learning in recent years, there remains a gap in understanding the fundamental mechanics of neural nets. More research is focussed on handcrafting complex and larger networks, and the design decisions are often ad-hoc and based on intuition. Some recent research has aimed to demys…
Study shows credit expansion in mortgage markets influenced U.S. business cycle.
problem Lack of causal evidence in cross-country business cycle studies.
method Unique research design combining cross-metropolitan U.S. data.
result Credit expansion caused stronger booms and busts in house-related industries.
SLAM-net learns to navigate visually in challenging indoor environments.
problem Challenges in SLAM for visual robot navigation, especially in noisy conditions.
method Differentiable SLAM Network (SLAM-net) that encodes a particle filter SLAM algorithm in a differentiable graph and learns components through backpropagation.
result Significantly outperforms ORB-SLAM in noisy conditions and improves the Habitat Challenge 2020 PointNav task.
This paper introduces Non-Autonomous Input-Output Stable Network(NAIS-Net), a very deep architecture where each stacked processing block is derived from a time-invariant non-autonomous dynamical system. Non-autonomy is implemented by skip connections from the block input to each of the unrolled processing stages and al…
Observed associations in a database may be due in whole or part to variations in unrecorded (latent) variables. Identifying such variables and their causal relationships with one another is a principal goal in many scientific and practical domains. Previous work shows that, given a partition of observed variables such …
GIT-Net uses neural networks to approximate PDE operators efficiently.
problem Approximating PDE operators for complex geometries.
method Parametrizes adaptive generalized integral transforms with deep neural networks.
result GIT-Net outperforms existing neural network operators in multiple areas.
We derive a consistent differential representation for the dynamics of a self-financing portfolio for different hedging strategies. In the basis of the derivation there is the so called "retarded action principle", which represents the causality in the evolution of dependent stochastic variables. We demonstrate this pr…
A fundamental goal in network neuroscience is to understand how activity in one region drives activity elsewhere, a process referred to as effective connectivity. Here we propose to model this causal interaction using integro-differential equations and causal kernels that allow for a rich analysis of effective connecti…
Delay-SDE-net models time series with memory and uncertainty, outperforming other models.
problem Accurately modeling time series with memory and uncertainty.
method Stochastic delay differential equations (SDDEs) neural network model with aleatoric and epistemic uncertainty.
result The Delay-SDE-net consistently outperforms other models in predicting time series values and uncertainties.
Aux-Net model handles dynamic systems with inconsistent inputs.
problem Inconsistent or unreliable input data in real-world scenarios.
method Aux-Net uses a weighted ensemble of classifiers and online gradient descent.
result Aux-Net provides scalable and agile online learning for dynamic systems.
Particle filtering is a powerful approach to sequential state estimation and finds application in many domains, including robot localization, object tracking, etc. To apply particle filtering in practice, a critical challenge is to construct probabilistic system models, especially for systems with complex dynamics or r…
Convolutional neural networks (CNNs) with dilated filters such as the Wavenet or the Temporal Convolutional Network (TCN) have shown good results in a variety of sequence modelling tasks. However, efficiently modelling long-term dependencies in these sequences is still challenging. Although the receptive field of these…
Boosts causal discovery by dynamically reweighting samples to learn better DAGs.
problem Overfitting to easier-to-fit samples and violating homogeneity assumptions in causal discovery.
method Adaptive sample reweighting via ReScore function to upweight and downweight samples based on fitting quality.
result Consistent and significant boosts in structure learning performance on synthetic and real-world datasets.
Method infers causal structure from system behaviors using RKHS and kernel ε-machines.
problem Discovering causal structure in systems with varying external and measurement noise.
method Combines causal states and RKHS for efficient representation and inference of causal structure.
result Robustly estimates causal structure in high-dimensional data with varying noise.
Differentiable causal discovery methods perform robustly under model violations.
problem Causal discovery algorithms struggle with real-world data due to unverifiable causal assumptions.
method Benchmarked differentiable causal discovery methods under eight model assumption violations.
result Differentiable causal discovery methods exhibit robust performance under Structural Hamming Distance and Structural Intervention Distance metrics.
Proposes DCNAR for dynamic causal inference from neural time series.
problem Uncertainty and evolution of causal structure in real-world domains.
method Two-stage neural causal modeling integrating discovery and inference.
result Dynamic causal inferences are more stable and meaningful than alternatives.
Study of discrete Koenigs nets and their properties.
problem Characterization and properties of discrete Koenigs nets.
method Generalization of inscribed conics to inscribed quadrics and study of Koenigs d-grids.
result Established a bijection between Koenigs d-grids and pairs of discrete autoconjugate curves.