This work tackles causal graph discovery with stochastic interventions to minimize the number of interventions.
problem Discovering the true causal graph from observational data with limited interventions.
method Proposes a stochastic intervention model and studies verification and search problems with approximation algorithms.
result Provides approximation algorithms with competitive ratios for verification and search problems.
The paper establishes bounds for score-matching in causal discovery and generative modeling.
problem Estimating causal relationships from data.
method Training a deep neural network to estimate the score function and applying it to causal discovery.
result Bounds on the error rate of causal discovery methods using score-matching.
We quantify content availability and user discovery opportunities in recommender systems.
problem Determining the maximum probability of recommending content to users.
method Stochastic reachability to compute upper bounds on recommendation likelihood.
result Reachability metrics can detect biases and diagnose user discovery limitations.
The paper develops CI tests for causal discovery in SDEs.
problem Inferring causal structure from stochastic dynamical systems.
method Developed CI constraints and a CI test for SDEs.
result Proposed CI test outperforms existing methods.
Researchers solved a model of an exhaustible resource with stochastic discoveries.
problem Optimal exploration of an exhaustible resource with uncertain discoveries.
method Impulse control and Poisson process of new discoveries.
result A frontier of critical levels of proven reserves exists, above which exploration is stopped.
This work bridges stochastic interpolants to infinite-dimensional Hilbert spaces.
problem Limited flexibility in generating arbitrary distributions for function-valued data.
method Establishes a rigorous framework for stochastic interpolants in infinite-dimensional Hilbert spaces.
result Achieves state-of-the-art results in conditional generation for complex PDE-based benchmarks.
Machine learning discovers equations from simulated data.
problem Discovering equations from computer-generated data.
method Sparse regression for equation learning.
result Machine learning can discover equations from complex data.
SPOT improves differentiable causal discovery by estimating skeleton posterior for latent confounders.
problem Scalable and accurate estimation of causal skeletons in the presence of latent confounders.
method SPOT (Skeleton Posterior-guided OpTimization) framework that estimates skeleton posterior and integrates it with differentiable causal discovery.
result SPOT enhances differentiable causal discovery by reducing the search space and improving accuracy.
New framework learns physics from output measurements only.
problem Learning governing physics from only output measurements.
method Stochastic calculus, sparse learning, Bayesian statistics, Euler Maruyama scheme.
result Potential to identify governing physics from sparse, noisy, incomplete data.
BLADE uses Bayesian methods to discover complex systems from scarce data.
problem Efficiently discovering governing equations of complex dynamical systems from limited data.
method Combines replica-exchange stochastic gradient Langevin Monte Carlo with active learning.
result Reduces measurement requirements by 60% for Lotka-Volterra and 40% for Burgers' equation.
Develops a model for causal discovery in path spaces.
problem Discover causal relationships in path spaces using asymmetric independence.
method Theory linking E-separation in DMGs to conditional independence in SDEs, proving global Markov property, characterizing equivalence classes of graphs.
result Each equivalence class of graphs has a greatest element as a parsimonious representation, which can be identified from data.
We investigate the problem of truth discovery based on opinions from multiple agents who may be unreliable or biased. We consider the case where agents' reliabilities or biases are correlated if they belong to the same community, which defines a group of agents with similar opinions regarding a particular event. An age…
A new framework predicts links in time-dependent networks using Bernoulli autoregression.
problem Predicting links in time-dependent networks with additional auxiliary information.
method A Bernoulli autoregressive model with regularization for link discovery.
result The model can discover new links not present in the data.
Algorithm learns stochastic system dynamics from data.
problem Recovering interpretable symbolic expressions for stochastic systems.
method Data-driven, trajectory averaging, drift-informed correction.
result Recover coefficients and densities to within 5% and 0.01 in total variation, respectively.
The gold standard for discovering causal relations is by means of experimentation. Over the last decades, alternative methods have been proposed that can infer causal relations between variables from certain statistical patterns in purely observational data. We introduce Joint Causal Inference (JCI), a novel approach t…
Testing for conditional independence is a core aspect of constraint-based causal discovery. Although commonly used tests are perfect in theory, they often fail to reject independence in practice, especially when conditioning on multiple variables. We focus on discrete data and propose a new test based on the notion of …
Derandomization reveals structure in neural networks, reducing sample complexity.
problem Understanding feature learning dynamics in neural networks.
method Derandomization lemma applied to arbitrary NNs with any smooth loss function.
result Optimizing function converges to zero weight matrix, revealing structure.
Calibration without labels in multiple testing
problem Interpretable error probabilities in large-scale hypothesis testing
method Constructing pseudo-labels from spacings of ordered p-values result Finding that q-value can be severely miscalibrated SIP framework discovers governing equations in uncertain systems.
problem Discovering governing equations in systems with input variability and noisy data.
method SIP framework treats unknown coefficients as random variables and infers their posterior distribution by minimizing Kullback-Leibler divergence.
result SIP consistently identifies correct equations and lowers coefficient error by 82% relative to SINDy.
Study compares causal discovery methods for cyclic models with hidden confounders.
problem Detect causal directions in cyclic systems with hidden confounders.
method Comprehensive comparison of four causal discovery techniques.
result Performance varies across different experimental setups and dataset sizes.
Neural node embeddings have recently emerged as a powerful representation for supervised learning tasks involving graph-structured data. We leverage this recent advance to develop a novel algorithm for unsupervised community discovery in graphs. Through extensive experimental studies on simulated and real-world data, w…
Accelerates optimization in asynchronous systems with sparse updates.
problem Optimizing finite-sum objectives in asynchronous lock-free environments.
method New accelerated SVRG variant with sparse updates.
result Achieves optimal incremental gradient complexity.
SBI uses neural networks to infer model parameters from simulators.
problem Computational infeasibility of Bayesian inference for complex models.
method Training neural networks on simulator-generated data.
result Efficient Bayesian inference without likelihood evaluations.
Study shows informed traders harm market makers but price discovery benefits outweigh costs.
problem Informed traders' impact on market makers' profitability.
method Agent-based model with heterogeneous learning agents, multi-agent reinforcement learning.
result Informed market order flow is harmful when aggregate informedness is low but beneficial as it increases.
Robust CD method for real-world time series with power-law distributions.
problem Challenges in causal discovery due to noise sensitivity.
method Power-law spectral feature extraction for robust CD.
result Consistently outperforms state-of-the-art alternatives on real-world datasets.
New method handles complex systems with discontinuous, heavy-tailed noise.
problem Handling discontinuous, heavy-tailed Lévy noise in stochastic systems.
method Developed nonlocal Kramers-Moyal formulas for SDEs with multiplicative Lévy noise.
result Validated framework for discovering interpretable SDE models from data.
Latent truth discovery, LTD for short, refers to the problem of aggregating ltiple claims from various sources in order to estimate the plausibility of atements about entities. In the absence of a ground truth, this problem is highly challenging, when some sources provide conflicting claims and others no claims at all.…
Dynamic Structural Causal Models handle time-dependent systems with cycles and latent confounding.
problem Representing and analyzing systems of Stochastic Differential Equations (SDEs) with DSCMs.
method Define time-splitting and subsampling operations to analyze DSCMs of SDEs, and apply existing causal discovery algorithms to time-series data.
result DSCMs provide a graphical Markov property for SDEs and enable identification of time-dependent causal effects.
BCD Nets use variational inference to estimate DAGs with uncertainty.
problem Uncertainty in inferring causal graphs from limited data.
method Variational inference framework for Bayesian DAG estimation.
result BCD Nets outperform maximum-likelihood methods in low data regimes.
We address the problem of causal discovery from data, making use of the recently proposed causal modeling framework of modular structural causal models (mSCM) to handle cycles, latent confounders and non-linearities. We introduce σ-connection graphs (σ-CG), a new class of mixed graphs (containing undirected, bidirected…
The study examines how many samples are needed to minimize a noisy convex function with inaccurate gradient estimates.
problem Determining the number of samples needed to minimize a noisy convex function with inaccurate gradient estimates.
method Using Stochastic Convex Optimization as a case study, the study analyzes the relationship between the number of samples and the accuracy of gradient estimates.
result The study provides partial answers to the question, showing that a general analyst requires Ω(1/ε3) samples and that under certain assumptions, ildeΩ(1/ε2.5) samples are necessary for gradient descent to interact with the oracle. New method recovers BSDE from financial data without ergodicity.
problem Discovering probabilistic laws from financial data.
method Stochastic SINDy method under risk-neutral measure.
result Recovery of BSDE from limited financial data.
Surprise predicts breakthroughs in science and technology.
problem Predicting breakthroughs in science and technology.
method Using embeddings from high-dimensional stochastic block models, predicting combinations with AUC of 95%.
result Breakthroughs often occur when problems from one field are solved by researchers from another field.
Proposes a method to estimate SDE noise from a single trajectory.
problem Estimating SDE noise from a single data trajectory without ergodicity or stationarity.
method Combining Taylor expansions, Girsanov transformations, and drift function's initial value for drift and noise estimation.
result First SSISDE algorithm capable of identifying SDE dynamics from a single trajectory.
We propose a network structure discovery model for continuous observations that generalizes linear causal models by incorporating a Gaussian process (GP) prior on a network-independent component, and random sparsity and weight matrices as the network-dependent parameters. This approach provides flexible modeling of net…
New estimator learns symmetric dynamics from few observations.
problem Learning parameters of stochastic linear dynamics from limited data.
method Method of moments estimator using T=O(logN) observations. result Achieves small maximum element-wise error on symmetric matrices.
Determining the 3D structures of biological molecules is a key problem for both biology and medicine. Electron Cryomicroscopy (Cryo-EM) is a promising technique for structure estimation which relies heavily on computational methods to reconstruct 3D structures from 2D images. This paper introduces the challenging Cryo-…
This work analyzes SGGMs, offering convergence insights and practical design tips.
problem Theoretical convergence analysis for SGGMs with a system of coupled SDEs.
method Non-asymptotic convergence analysis for three graph generation paradigms.
result Unique factors affecting convergence in SGGMs and practical hyperparameter selection.
Deep neural networks decompose SDF into linear and nonlinear components.
problem Constructing accurate stochastic discount factors (SDFs) for pricing.
method Additive decomposition of a deep neural network trained to construct SDFs.
result The PTK representation delivers significant performance gains in equity data.
Differentiable causal discovery methods perform robustly under model violations.
problem Causal discovery algorithms struggle with real-world data due to unverifiable causal assumptions.
method Benchmarked differentiable causal discovery methods under eight model assumption violations.
result Differentiable causal discovery methods exhibit robust performance under Structural Hamming Distance and Structural Intervention Distance metrics.
New framework uses background knowledge to speed up causal discovery.
problem Scalable causal discovery for large datasets.
method Utilizes background knowledge during causal discovery process.
result Background knowledge reduces computational requirements and improves structure quality.
New method prevents invalid inference after causal discovery.
problem Invalid inference after causal discovery.
method Developed tools for valid post-causal-discovery inference.
result Our method provides reliable coverage while achieving more accurate causal discovery.
Data that is gathered adaptively --- via bandit algorithms, for example --- exhibits bias. This is true both when gathering simple numeric valued data --- the empirical means kept track of by stochastic bandit algorithms are biased downwards --- and when gathering more complicated data --- running hypothesis tests on c…
LANCA uses ANM to learn latent causal factors without supervision.
problem Learning latent causal factors without supervision.
method LANCA employs a deterministic Wasserstein Auto-Encoder coupled with a differentiable ANM Layer.
result LANCA outperforms baselines on physics and photorealistic environments.
The paper introduces new KMEs to capture stochastic process filtrations.
problem Missing filtration information in stochastic processes.
method Higher order kernel mean embeddings (KMEs) conditioned on filtrations.
result Consistent estimators and tests for filtration-sensitive information.
New method learns temporal abstractions by defining interest functions.
problem Learning temporal abstractions with limited, variable durations.
method Introduced interest functions to define initiation sets, enabling gradient-based learning.
result Demonstrated effectiveness in discrete and continuous environments.
LDP speeds up causal discovery by partitioning, improving VAS recall and runtime.
problem Hard causal discovery in nonparametric settings with exponential complexity.
method Local Discovery by Partitioning (LDP) for causal inference around exposure-outcome pairs.
result LDP yields less biased and more precise estimates than baseline methods.
We show that dropout training is best understood as performing MAP estimation concurrently for a family of conditional models whose objectives are themselves lower bounded by the original dropout objective. This discovery allows us to pick any model from this family after training, which leads to a substantial improvem…