Deep neural networks improve proximal inference for causal effects.
problem Estimating causal effects in the presence of unmeasured confounders.
method Flexible deep neural network to estimate the bridge function.
result Achieves state-of-the-art performance on benchmarks.
Unified framework for causal inference with reliable uncertainty quantification.
problem Causal inference under unobserved confounding with unreliable uncertainty quantification.
method Deconditional Gaussian Process (DGP) framework for uncertainty-aware causal learning.
result Strong predictive performance and informative uncertainty quantification.
DML-CMR estimator reduces bias in CMR problems using deep neural networks.
problem Solving conditional moment restrictions with deep neural networks.
method Double/debiased machine learning framework for unbiased estimation.
result Achieves minimax optimal convergence rate of O ( N − 1 / 2 ) O(N^{-1/2}) O ( N − 1/2 ) . Extends robust methods for causal inference, improving estimator performance.
problem Estimating causal effects in the presence of latent confounders.
method Minimax kernel machine learning for doubly robust functionals.
result Proposed method leads to robust and high-performance estimators.
New methods estimate causal effects through mediators, handling confounding without strict assumptions.
problem Estimating causal effects through mediators while accounting for unmeasured confounding.
method Developed four nonparametric identification strategies using proximal confounding bridge functions, efficient influence function, and quadruply robust estimator. Proposed proximal debiased machine learning approach for high-dimensional nuisance parameters.
result Achieved n \sqrt{n} n -consistency and asymptotic normality for path-specific effect estimation. Develops methods for personalized treatment decisions in the presence of unmeasured factors.
problem Personalized treatment decisions in the presence of unmeasured confounding.
method Proximal learning approaches to estimate optimal individualized treatment regimes (ITRs).
result Established identification results for different classes of ITRs, improving decision-making value function.
Proximal Mediation Analysis with Hidden Recanting Witnesses
problem Identifying path-specific effects in mediation analysis when recanting witnesses are unknown
method Proximal causal inference and semiparametric inference framework
result Developed three novel identification strategies and a semiparametric inference framework
Optimal treatment regime uses proxy variables to improve decision-making.
problem Insufficient covariates in observational data lead to confounding issues.
method Proximal causal inference framework and outcome/treatment confounding bridges.
result The proposed optimal treatment regime outperforms existing ones.
PRL improves off-policy evaluation in partially observed MDPs.
problem Confounding and bias in offline reinforcement learning with unobserved state factors.
method Extends proximal causal inference to POMDPs, identifying and estimating target policy value.
result Semiparametrically efficient estimators for PRL in partially observed MDPs.
New method improves structure learning on sparse graphs.
problem Structure learning on sparse directed acyclic graphs (DAGs).
method Bregman proximal gradient method to address non-convex, high-curvature problem.
result Significantly improved convergence and efficiency.
Proposes methods for learning optimal dynamic treatment regimes robust to unconfoundedness violations.
problem Estimating optimal dynamic treatment regimes using historical observational data when unconfoundedness is violated.
method Utilizes proximal causal inference framework to propose three nonparametric identification methods, a (K+1)-robust method, and establish a semiparametric efficiency bound.
result Establishes the (K+1)-robust method for learning optimal dynamic treatment regimes, validating its efficiency and multiple robustness through numerical experiments.
Interpretable framework evaluates structure learning methods for causal discovery from observational data.
problem Evaluation of structure learning methods under assumption violations in causal discovery.
method Six-dimensional evaluation metric (DOS) tailored for causal discovery.
result Amortized causal discovery delivers results with high proximity to the optimal solution.
Proxy methods adapt to distribution shifts without explicitly modeling latent confounders.
problem Adapting to distribution shifts under latent variable confounding.
method Proximal causal learning, two-stage kernel estimation.
result Proxy methods outperform other methods in adapting to complex distribution shifts.
SPACY discovers causal graphs from spatiotemporal data using variational inference.
problem Inferring causal relationships from high-dimensional spatiotemporal data with complex correlations.
method SPACY uses variational inference to model latent time series and their causal relationships, incorporating spatial factors to aggregate correlated data.
result SPACY outperforms state-of-the-art methods on synthetic and real-world data, identifying key causal phenomena.
Extends causal inference to hidden mediators with proxies.
problem Identifying causal effects with hidden mediators and error-prone proxies.
method Established causal hidden mediation analysis and hidden front-door criterion.
result Identification of population intervention indirect effect possible with hidden mediators.
Causal Imitation Learning handles noisy measurements and distribution shifts.
problem Learning from noisy state observations and distributional shifts.
method Causal inference framework and adversarial RKHS learning.
result Improved robustness to distribution shifts compared to standard methods.
New methods identify causal effects without needing complete proxy variables.
problem Identifying causal effects in the presence of unmeasured confounders.
method Partial identification methods that do not require completeness of proxy variables.
result Obtain bounds on causal effects using available proxy variables.
A method to detect spillover effects and select valid donors for synthetic control models.
problem Identifying valid donors in synthetic control models when spillover effects are possible.
method Theoretical grounding and practical method using pre-intervention data to identify donor values and debias causal estimates.
result A Theorem that identifies assumptions for identifying donor values and debias causal estimates.
The structure of return spillovers is examined by constructing Granger causality networks using daily closing prices of 20 developed markets from 2nd January 2006 to 31st December 2013. The data is properly aligned to take into account non-synchronous trading effects. The study of the resulting networks of over 94 sub-…
Proposes P-learner for estimating treatment effects with proxy variables.
problem Estimating treatment effect heterogeneity in settings with unverifiable exchangeability.
method Two-stage loss function for learning heterogeneous treatment effects with proxy variables.
result P-learner satisfies an oracle bound on estimated error.
New method identifies causal effects with categorical unobserved confounders.
problem Estimating causal effects in the presence of unobserved confounders.
method Mixture learning and tensor decomposition for consistent estimation.
result Causal effects are identifiable with categorical unobserved confounders under suitable conditions.
New method for causal inference with observed covariates improves learning rates.
problem Causal inference with observed covariates in nonparametric instrumental variable regression.
method Introduces novel Fourier measure for partial smoothing and adapts kernel lengthscales for anisotropic smoothness.
result Upper and lower learning rates for KIV-O show interpolation between NPIV and NPR rates.
A method learns representations for conditional moment models with controlled ill-posedness.
problem Efficient estimation of nonparametric conditional moment models with flexible models is challenging.
method Proposes a procedure that learns spectral representations with controlled measures of ill-posedness.
result The proposed method can efficiently estimate representations from data and is L2 consistent.
Unified framework for estimating indirect effects in observational studies with unmeasured confounding.
problem Challenges in evaluating indirect effects due to unmeasured confounding and unethical exposures.
method Developed a unified identification and estimation framework using proximal causal inference.
result Unified identification and estimation of PIIE and causal effect of an intervening variable in settings with pervasive unmeasured confounding.
EPNE models evolving network patterns for better predictions.
problem Capturing evolving patterns in dynamic networks.
method EPNE models temporal network evolution using causal convolutions and a temporal objective function.
result EPNE outperforms other methods in various prediction tasks.
In machine learning research, the proximal gradient methods are popular for solving various optimization problems with non-smooth regularization. Inexact proximal gradient methods are extremely important when exactly solving the proximal operator is time-consuming, or the proximal operator does not have an analytic sol…
Structural equation models (SEMs) have been widely adopted for inference of causal interactions in complex networks. Recent examples include unveiling topologies of hidden causal networks over which processes such as spreading diseases, or rumors propagate. The appeal of SEMs in these settings stems from their simplici…
Extends RF proximities to all supervised distance-based machine learning contexts.
problem Limited utility of RF proximities in various machine learning tasks.
method Introduces generalized Proximity Forest (PF) model and variant for regression.
result Demonstrates unique advantages over RF and k-nearest neighbors models.
Improved random forest proximities capture data geometry.
problem Inaccurate random forest proximities do not reflect learned data geometry.
method Introduce RF-GAP: Geometry- and Accuracy-Preserving proximities.
result RF-GAP improves geometric representation in tasks like data imputation.
Combining experimental and observational data for long-term causal effects.
problem Estimating causal effects of treatment on long-term outcomes using mixed data types.
method Three approaches for fusing experimental and observational data: equal confounding, shared confounder, and proxy variables.
result Developed estimators for each approach and analyzed their robustness.
New method for inference on strongly identified functionals even when nuisance functions are weakly identified.
problem Inference on continuous linear functionals of weakly identified nuisance functions defined by conditional moment restrictions.
method Proposes penalized minimax estimators for both the primary and debiasing nuisance functions, which can converge to fixed limits regardless of nuisance identifiability.
result Proves the asymptotic normality of a debiased estimator for the functional of interest, leading to asymptotically valid confidence intervals.
Stochastic version of proximal distance algorithm analyzed and validated.
problem Optimization of constrained estimation problems.
method Stochastic proximal distance algorithm, with convergence guarantees and finite error bounds.
result Convergence guarantees and finite error bounds for the first time.
In this paper we develop proximal methods for statistical learning. Proximal point algorithms are useful in statistics and machine learning for obtaining optimization solutions for composite functions. Our approach exploits closed-form solutions of proximal operators and envelope representations based on the Moreau, Fo…
Generative flows learn distributions on low-dimensional manifolds robustly via Wasserstein proximals.
problem Learning distributions supported on low-dimensional manifolds robustly.
method Combining Wasserstein-1 and Wasserstein-2 proximal operators to formulate well-posed continuous-time generative flows.
result The combination of Wasserstein-1 and Wasserstein-2 proximals ensures the well-posedness of generative flows, leading to unique and robust learning.
APO optimizes neural network parameters by amortizing proximal point methods.
problem Optimizing neural network parameters online and adaptively.
method APO framework that meta-learns proximal point parameters.
result APO can recover and outperform existing optimizers and schedules.
Paper proposes a new method for supervised manifold learning using random forest proximities.
problem Existing supervised manifold learning methods fail to uncover meaningful embeddings due to using class-conditional distances.
method Proposes a data-geometry-preserving variant of random forest proximities as an initialization for manifold learning methods.
result Local and global structure preservation is near universal across manifold learning approaches using diffusion-based algorithms.
Introduces a new divergence measure for optimal transport.
problem Optimal transport distances and information divergences.
method Infimal convolution formulation of proximal optimal transport divergence.
result Establishes connections to dynamic formulations and partial differential equations.
Proposes a new metric learning method for image recognition.
problem Improving image recognition performance using learned distance representations.
method Introduces a Generalized Hybrid Metric Loss (GHM-Loss) to learn hybrid proximity features combining geometric and probabilistic spaces.
result Demonstrates superior performance compared to existing methods on public datasets.
Variational Proximal Policy Optimization improves reinforcement learning from human feedback.
problem Policy mode collapse and brittle exploration loops in reinforcement learning.
method Particle-based variational inference framework with Mixture-of-Experts architecture.
result Significant improvements in complex reasoning benchmarks.
Complex embeddings handle non-metric proximity data better than traditional methods.
problem Proximities not always metric or inner product-based, causing convergence issues.
method Proposes complex-valued embeddings for non-vectorial data.
result Complex embeddings outperform traditional techniques on benchmarks.
Improves RL algorithms with two techniques.
problem Enhance off-policy RL performance.
method Formulates RL as proximal point iteration; uses value functions for improved action value estimate.
result Significant performance improvement on RL benchmarks.
PDNS tackles multimodal sampling challenges using proximal point method.
problem Multimodal distributions with significant barriers between modes.
method Proximal point method on path measures, decomposing into simpler subproblems.
result PDNS effectively promotes thorough exploration across modes.
EPINE enhances network embedding by improving adjacency matrix-based high-order proximity.
problem Inaccurate and poorly designed calculation of high-order proximity in network embedding.
method EPINE redefines high-order proximity intuitively and proposes a scalable algorithm for accurate calculation.
result EPINE outperforms existing methods in network reconstruction, link prediction, and node classification.
Inserts proximal mapping into deep networks for better regularization.
problem Effective regularization of deep learning models to handle adversarial perturbations and correlations between modalities.
method Proposes a new layer that directly produces regularized hidden layer outputs using proximal mapping.
result Outperforms state-of-the-art methods in robust temporal learning and multiview modeling.
Enhances Bayesian model selection for high-dimensional problems.
problem Bayesian model selection for high-dimensional problems.
method Proximal nested sampling with data-driven priors.
result Improves model selection for log-convex likelihood models.
We generalize Newton-type methods for minimizing smooth functions to handle a sum of two convex functions: a smooth function and a nonsmooth function with a simple proximal mapping. We show that the resulting proximal Newton-type methods inherit the desirable convergence behavior of Newton-type methods for minimizing s…
Many machine learning techniques sacrifice convenient computational structures to gain estimation robustness and modeling flexibility. However, by exploring the modeling structures, we find these "sacrifices" do not always require more computational efforts. To shed light on such a "free-lunch" phenomenon, we study the…
Develops minibatch stochastic proximal gradient for large-scale learning models.
problem Finding optimal predictors with complex regularizers in large-scale learning models.
method Minibatch variants of stochastic proximal gradient algorithm for composite objective functions.
result Minibatch size N N N after O ( 1 N ε ) \mathcal{O}(\frac{1}{Nε}) O ( N ε 1 ) iterations achieves ε − ε- ε − suboptimality in expected quadratic distance.