New method combines experimental and observational data for causal inference.
problem Combining internal validity of experiments and larger sample sizes of observations.
method Empirical risk minimization (ERM) framework with cross-validation.
result Efficacy and reliability demonstrated on real and synthetic data.
Theoretical limits show experimental data can falsify but not validate causal estimates from observational studies.
problem Fundamental limits on validating causal estimates using experimental data in observational studies.
method Impossible inference framework, Gaussian Process based approach.
result Experimental data can falsify but not validate causal estimates from observational studies.
Observational data is increasingly used as a means for making individual-level causal predictions and intervention recommendations. The foremost challenge of causal inference from observational data is hidden confounding, whose presence cannot be tested in data and can invalidate any causal conclusion. Experimental dat…
Combining experimental and observational data for long-term causal effects.
problem Estimating causal effects of treatment on long-term outcomes using mixed data types.
method Three approaches for fusing experimental and observational data: equal confounding, shared confounder, and proxy variables.
result Developed estimators for each approach and analyzed their robustness.
New BED method handles online inference for partially observed dynamical systems.
problem Optimizing data collection for partially observable, partially online dynamical systems.
method Derived estimators of expected information gain and its gradient for SSMs, using nested particle filters.
result Successfully handles both partial observability and online inference in realistic models.
Medical imaging systems are commonly assessed by use of objective image quality measures. Supervised deep learning methods have been investigated to implement numerical observers for task-based image quality assessment. However, labeling large amounts of experimental data to train deep neural networks is tedious, expen…
Experimental fractal landscape dynamics observed in emulsions.
problem Understanding anomalous motions in soft glassy materials.
method Quantitative analysis of oil droplet trajectories in dense emulsions.
result Experimental fractal geometry matches computational model of soft glassy dynamics.
New method infers human sensorimotor costs from behavior.
problem Inferring human sensorimotor costs from observed behavior.
method Inverse optimal control with signal-dependent noise.
result Recovering costs and benefits in sensorimotor behavior.
New framework models high-Hopf-index hopfions using generalized fold maps.
problem Modeling and understanding high-Hopf-index hopfions.
method Proposes a new mathematical framework based on generalized Hopf maps and fold maps.
result Establishes a robust bridge between singular maps and experimentally observed hopfion topologies.
Efficiently designs experiments without integrating posterior distributions.
problem Computational inefficiency in Bayesian experimental design for PDE-based models.
method Likelihood-free approach using ANN to approximate conditional expectation.
result Significant reduction in observation model evaluations.
Paper improves feature selection for predicting outcomes from observational data.
problem Feature selection for post-intervention outcome prediction from pre-intervention variables in healthcare settings.
method Extends Markov boundary concept to treatment-outcome pairs, uses observational and experimental data.
result Combining observational and experimental data improves feature selection and effect estimation.
Framework tests CATE homogeneity across trials and evaluates confounding.
problem Assessing treatment effect consistency across randomized and observational studies.
method Leverages multiple randomized trials to test CATE homogeneity and compares with observational data.
result Identifies potential confounding and effect heterogeneity in treatment effects.
Estimates long-term effects from short-term experiments and observational data with unobserved confounders.
problem Estimating long-term causal effects from short-term experiments and long-term observational data with unobserved confounding.
method Combining regression residuals with short-term experimental outcomes to create an instrumental variable for estimating long-term causal effects.
result The estimator is unbiased and its variance is analytically studied.
Optimal adaptive experiment for choosing best treatment with binary outcomes.
problem Choosing the best treatment from binary options in an adaptive experiment.
method Adaptive experiment with two phases: treatment allocation and choice. Neyman allocation method used.
result Neyman allocation is minimax and Bayes optimal, matching lower bounds for regret.
INNs improve acceptance rates in electron spectra analysis.
problem Analyzing electron spectra from near-critical laser-plasmas.
method Invertible Neural Networks (INNs) for forward and inverse modeling.
result INNs significantly increase acceptance rates up to a factor of 10.
Simplified identification methods for causal inference with arbitrary interventional distributions.
problem Estimating cause-effect relationships from data with experimental interventions.
method Using Single World Intervention Graphs and nested model factorization, we provide algorithms for identifying causal parameters from mixed observational and interventional distributions.
result Our algorithms are complete for certain types of interventional marginal distributions.
The paper benchmarks OS with RCTs, accounting for right-censoring.
problem Benchmarking observational studies with experimental data under censoring.
method Two cases: independent and dependent censoring. Censoring-doubly-robust signal for CATE.
result Effectiveness of censoring-aware tests verified via experiments and real data.
Bayesian method for inferring causal relations from mixed observational and interventional data.
problem Challenges in causal inference from heterogeneous study conditions with unknown soft interventions.
method Interventional Bayesian Gaussian equivalent score for a mixture of observational and interventional data.
result Effective characterisation of posterior distributions of causal structures and intervention effects.
The spectral energy distribution (SED) is a relatively easy way for astronomers to distinguish between different astronomical objects such as galaxies, black holes, and stellar objects. By comparing the observations from a source at different frequencies with template models, astronomers are able to infer the type of t…
Generalizing empirical findings to new environments, settings, or populations is essential in most scientific explorations. This article treats a particular problem of generalizability, called "transportability", defined as a license to transfer information learned in experimental studies to a different population, on …
Much of scientific data is collected as randomized experiments intervening on some and observing other variables of interest. Quite often, a given phenomenon is investigated in several studies, and different sets of variables are involved in each study. In this article we consider the problem of integrating such knowle…
This article provides a thorough meta-analysis of the anomaly detection problem. To accomplish this we first identify approaches to benchmarking anomaly detection algorithms across the literature and produce a large corpus of anomaly detection benchmarks that vary in their construction across several dimensions we deem…
Every design choice will have different effects on different units. However traditional A/B tests are often underpowered to identify these heterogeneous effects. This is especially true when the set of unit-level attributes is high-dimensional and our priors are weak about which particular covariates are important. How…
We consider a class of misspecified dynamical models where the governing term is only approximately known. Under the assumption that observations of the system's evolution are accessible for various initial conditions, our goal is to infer a non-parametric correction to the misspecified driving term such as to faithful…
Expands experimental design for causal discovery from limited data.
problem Challenges in causal discovery from observational and interventional data.
method Bayesian optimal experimental design incorporating recent advances in causal discovery.
result Active causal discovery of large, nonlinear SCMs with both intervention target and value selection.
This work formalizes and extends parameter sharing in multi-agent reinforcement learning.
problem Parameter sharing limits multi-agent learning to a single policy, preventing different tasks or action spaces.
method Introduces agent indication and extends parameter sharing to heterogeneous observation and action spaces.
result Proves convergence to optimal policies for parameter sharing in heterogeneous environments.
Synthesizes computational approaches to understand neural timescales.
problem Varying definitions and measurements of neural timescales across studies.
method Reviews data analysis methods, biophysical models, and machine learning models.
result Complements experimental studies with a holistic view of neural timescales.
PIED optimizes experimental design for inverse problems using physics-informed neural networks.
problem Optimizing experimental design for inverse problems with limited budget and constraints.
method PIED uses physics-informed neural networks (PINNs) for continuous optimization of design parameters in one-shot deployments.
result PIED significantly outperforms existing ED methods in solving inverse problems, including unknown functions.
Diffusion maps help learn complex quantum phase transitions from data.
problem Learning quantum phase transitions from experimental data is challenging.
method Diffusion maps for nonlinear dimensionality reduction and spectral clustering.
result Diffusion maps can learn complex phase transitions unsupervised.
A new method for experimental design focuses on predicting downstream quantities of interest.
problem Designs that maximize parameter learning may not maximize downstream quantity prediction.
method Likelihood-free goal-oriented optimal experimental design (LF-GO-OED) using ABC density ratio estimation.
result LF-GO-OED maximizes the expected information gain for downstream quantities.
PGAE uses predictions to guide active experimentation.
problem Efficiently guiding experimental sampling based on predictions.
method PGAE framework that combines predictions and actual outcomes.
result PGAE achieves asymptotic optimality and efficiency.
The paper tackles long-term treatment effects with persistent confounders using sequential short-term outcomes.
problem Estimating long-term treatment effects with persistent unmeasured confounders.
method Exploiting the sequential structure of short-term outcomes, the paper develops three novel identification strategies and corresponding estimators.
result The proposed methods outperform existing approaches in handling persistent confounders.
We develop a method for user-controllable semantic image inpainting: Given an arbitrary set of observed pixels, the unobserved pixels can be imputed in a user-controllable range of possibilities, each of which is semantically coherent and locally consistent with the observed pixels. We achieve this using a deep generat…
Optimizes experimental design using synthetic controls for better outcomes.
problem Estimating average treatment effects in studies with pre-treatment data.
method Mixed-integer programming for selecting treated and control units and weights.
result Improves mean squared error and statistical power compared to simple alternatives.
SOAD model improves data assimilation for nonlinear systems.
problem Challenges in classical data assimilation with high nonlinearity.
method State-Observation Augmented Diffusion (SOAD) model for data-driven assimilation.
result SOAD model matches true posterior distribution under mild assumptions.
Bayesian sOED uses PG reinforcement learning for efficient experiment design.
problem Optimizing sequential experiments for nonlinear models with limited data.
method Formulated as POMDP, solved via PG methods with neural network parameterization.
result Demonstrated advantages over batch and greedy designs in contaminant source inversion.
The paper tackles intervention generalization using factor graph models.
problem Generalizing from past experiments to novel conditions is hard due to combinatorial space of possible interventions.
method The approach is based on intervention factor models (IFMs) and factor graph models.
result Conditions for identifiability of expected outcomes of new regimes are derived.
Investigates price dynamics of two assets with and without bubbles, deriving conditions for equilibrium prices.
problem Understanding price dynamics and bubbles in multi-asset markets.
method Derives sufficient and necessary conditions for average equilibrium price dynamics in a two-asset model.
result Assets with positive average dividends display hump-shaped bubbles, while those with constant fundamental values show misvaluation effects.
New method uses observational data to improve trial design efficiency.
problem Scarce randomized controlled trials; inefficiency of using observational data.
method Active Residual Learning, R-Design framework, R-EPIG criterion.
result Efficiently estimating residuals to correct observational bias improves trial design.
Adaptive calibration improves model accuracy with fewer simulations.
problem Inefficient calibration of complex models using fixed designs.
method Bayesian adaptive experimental design to optimize simulation runs.
result The method achieves better parameter estimation with fewer simulations.
Peer effects, in which the behavior of an individual is affected by the behavior of their peers, are posited by multiple theories in the social sciences. Other processes can also produce behaviors that are correlated in networks and groups, thereby generating debate about the credibility of observational (i.e. nonexper…
Proposes a thermodynamic work minimization framework for guiding generative models.
problem Guiding generative models in sparse-data regimes with limited target samples or constraints.
method Regularization framework inspired by thermodynamic work, introducing Path Guidance and Observable Guidance.
result Improves sample efficiency and reduces bias in molecular simulations.
GEAR uses auxiliary data to estimate optimal decisions in studies with limited primary outcomes.
problem Estimating optimal decisions when primary outcomes are not available in experimental samples.
method GEAR uses augmented inverse propensity weighting to estimate optimal decisions based on auxiliary data.
result GEAR estimators and value estimators have established asymptotic properties and are validated in simulations and a real application.
Study analyzes Echo State Network parameters for Rossler attractor dynamics.
problem Understanding the influence of network type on Echo State Network performance.
method Experimental analysis of Echo State Network parameters using Rossler attractor.
result Exploration of how network type affects Echo State Network performance.
Dan Reznik found, by computer experimentation, a number of conserved quantities associated with periodic billiard trajectories in ellipses. We prove some of his observations using a non-standard generating function for the billiard ball map. In this way, we also obtain some identities valid for all smooth convex billia…
This study optimizes covariate density and propensity score for efficient ATE estimation.
problem Efficiently estimating average treatment effects (ATEs) with minimal variance.
method Adaptive experiment optimizing both covariate density and propensity score.
result Proposed method minimizes the semiparametric efficiency bound for ATE estimation.
Motivated by the widespread adoption of large-scale A/B testing in industry, we propose a new experimentation framework for the setting where potential experiments are abundant (i.e., many hypotheses are available to test), and observations are costly; we refer to this as the experiment-rich regime. Such scenarios requ…
A new framework designs experiments for better decision-making.
problem Suboptimal experimental designs for downstream decision-making.
method Amortized decision-aware Bayesian Experimental Design (BED) with Transformer Neural Decision Process (TNDP).
result TNDP effectively designs experiments and facilitates accurate decision-making.