Novel AMP framework for multi-environment transfer learning.
problem Characterizing risk of Lasso-based transfer learning estimators.
method Multi-Environment Generalized Long AMP (multi-environment GLAMP) framework.
result Precise characterization of the risk of three Lasso-based transfer learning estimators.
Bayesian Invariant Prediction models stable features from multi-environment data.
problem Analyzing stable features across multiple environments for better prediction and understanding.
method Developed Bayesian Invariant Prediction (BIP) model that encodes invariant feature indices as latent variables and infers them via posterior inference.
result BIP and its variational approximation (VI-BIP) outperform existing methods in accuracy and scalability for invariant prediction.
Proposes method to learn state abstractions that generalize across environments.
problem Learning abstractions that generalize in block MDPs.
method Invariant causal prediction to learn model-irrelevant state abstractions (MISA).
result Proves high probability of outputting a state abstraction corresponding to causal feature set for return.
Bayesian model for multi-environment prediction with latent variable changes.
problem Prediction in environments with changing latent variable distributions.
method Bayesian model with empirical Bayes prior and amortized variational algorithm.
result Method outperforms previous approaches in new environments.
New methods improve prediction intervals across multiple environments.
problem Valid confidence intervals and sets in multi-environment prediction.
method Extended jackknife and split-conformal methods, with resizing for problem difficulty.
result Distribution-free coverage achieved in non-traditional data scenarios.
Paper proposes EILLS for invariant linear regression across environments.
problem Estimating true parameter and important variable set in multi-environment settings.
method Environment invariant linear least squares (EILLS) objective function.
result EILLS estimator achieves variable selection consistency and efficient estimation.
Estimator improves prediction with missing data in multi-environment settings.
problem Handling missing data in multi-environment settings for robust prediction.
method Derive an estimator from invariance objective under missing outcomes.
result The estimator achieves lower prediction error despite using a biased imputation model.
Bayesian framework improves variance component estimation in MET data.
problem Inaccurate estimation of variance components in MET data.
method Proposes a Bayesian updating framework using historical data.
result Stabilizes variance component estimation and quantifies uncertainty.
We study causal inference in a multi-environment setting, in which the functional relations for producing the variables from their direct causes remain the same across environments, while the distribution of exogenous noises may vary. We introduce the idea of using the invariance of the functional relations of the vari…
CRL learns causal representations from unstructured data without supervision.
problem Learning causal models from high-dimensional, unstructured data.
method Combines ML and causality by learning representations in latent variables.
result Identifiability conditions for CRL in different settings.
The paper proposes a method to learn from both simulation and real-world data.
problem Training autonomous systems in simulation and applying them to real-world environments.
method Balancing samples from simulation and real-world data using a replay buffer.
result The method achieves better performance in real-world tasks compared to training only in simulation.
Free Random Projection enhances reinforcement learning by naturally incorporating hierarchical structure.
problem Improving reinforcement learning algorithms for better generalization and adaptability.
method Introduces Free Random Projection, a method that uses free probability theory to create random orthogonal matrices encoding hierarchical structure.
result Empirically shows consistent improvement in generalization over standard methods on multi-environment benchmarks.
Interpretable meta-learning for physical systems reduces computational costs and improves interpretability.
problem Challenges in learning from heterogeneous experimental data.
method Affine structure learning model for multi-environment generalization.
result Proves the model can identify physical parameters and demonstrates competitive performance.
New method learns chaotic dynamics from single noisy trajectory.
problem Chaos in complex systems is hard to model accurately with machine learning.
method Adversarial optimal transport objectives to learn summary statistics and emulator from single noisy data.
result Emulators trained with proposed objectives have significantly improved long-term statistical fidelity.
This research tackles sample complexity in causal graph recovery with temporal heterogeneity.
problem Recovering a unique causal graph from observational data with temporal heterogeneity.
method Integrates time-series dynamics and multi-environment heterogeneity to constrain the problem, enabling a rigorous analysis of statistical limits.
result Unified necessary identifiability conditions and explicit information-theoretic bounds quantify the sample complexity under different noise distributions.
The paper tackles policy learning in dynamic environments using causal methods.
problem Existing reinforcement learning algorithms assume static mechanisms, but real-world systems often have changing mechanisms.
method The paper introduces multi-environment contextual bandits and policy invariance to handle environmental shifts.
result An optimal invariant policy is guaranteed to generalize across environments under suitable assumptions.
New method identifies causal structure in exchangeable data.
problem Existing causal discovery methods struggle with i.i.d. data.
method Exchangeable data provides richer conditional independence structure.
result Exchangeable data allows for unique causal structure identification.
Bayesian approach learns causal concepts from diverse social surveys.
problem Inferring causal concepts from heterogeneous data with sparse changes.
method Hierarchical Bayesian model with sequential Monte Carlo sampling.
result Model infers meaningful causal concepts and plausible relations.
New method identifies causal variables from multi-node interventions, expanding on previous single-node approaches.
problem Inferring high-level causal variables from low-level observations under multiple interventions.
method Exploits variance trace of ground truth causal variables and regularizes for sparsity.
result First identifiability result for causal representation learning with multiple node interventions.
ATLAS separates invariant and transferable latent factors across diverse environments.
problem Transfer learning and robust prediction in heterogeneous environments.
method ATLAS leverages invariance principle to disentangle latent factors and uses auxiliary labels for robust prediction.
result Near-oracle performance and robust transferable prediction in new environments.