Proposes Causal-Batle for estimating treatment effects in small high-dimensional datasets.
problem Estimating treatment effects with small high-dimensional datasets.
method Adopts transfer learning techniques for causal inference.
result Improves treatment effect estimates in small high-dimensional datasets.
New insights into neural network complexity reveal better generalization performance.
problem Mysterious generalization in deep models despite high parameter counts.
method Effective dimensionality as a measure of parameter space complexity.
result Double descent behavior in generalization as a function of parameters explained.
This paper explores how effective sample size, dimensionality, and model performance are related in covariate shift adaptation.
problem Understanding the relationship between effective sample size, dimensionality, and generalization in covariate shift adaptation.
method Building a unified theory connecting effective sample size, data dimensionality, and generalization in the context of covariate shift adaptation.
result Dimensionality reduction or feature selection can increase effective sample size, supporting the practice of reducing dimensionality before covariate shift adaptation.
Bayesian tree ensemble model for estimating treatment effects in high-dimensional survival data.
problem Estimating heterogeneous treatment effects in censored survival data with many covariates.
method Developed a Bayesian tree ensemble model with a horseshoe prior for adaptive shrinkage.
result Accurately estimates treatment effects in high-dimensional covariate spaces and non-linear functions.
New method learns unbiased treatment representations from structured high-dimensional data.
problem Estimating causal effects from high-dimensional, structured treatments.
method Contrastive learning approach to learn unbiased treatment representations.
result The method identifies causal factors and discards non-causal ones, leading to unbiased causal effect estimates.
Exploration is an extremely challenging problem in reinforcement learning, especially in high dimensional state and action spaces and when only sparse rewards are available. Effective representations can indicate which components of the state are task relevant and thus reduce the dimensionality of the space to explore.…
Proposes a method for interpreting time-varying causal effect moderation in high-dimensional data.
problem Interpreting causal effect moderation in high-dimensional data with interpretability and avoiding false positives.
method Two-step method: 1) Selects a smaller model for linear causal effect moderation using Gaussian randomization, 2) Conditions on selection to construct a pivot for uniformly asymptotic semi-parametric inference.
result Consistently achieves valid coverage rates and shorter, bounded intervals in time-varying causal effect moderation.
New DR method improves robustness in high-dimensional treatment effects.
problem Estimating dynamic treatment effects with high-dimensional confounders.
method Proposes a novel DR representation for intermediate conditional outcome models.
result Achieves superior robustness guarantees with high-dimensional confounders.
The paper analyzes SGD in high-dimensional networks, revealing new scaling limits.
problem Understanding SGD dynamics in high-dimensional networks.
method Analyzing the effective dynamics of SGD using recent work on the subject.
result A new correction term emerges at the critical scaling regime, changing the phase diagram.
We describe a method for inferring linear causal relations among multi-dimensional variables. The idea is to use an asymmetry between the distributions of cause and effect that occurs if both the covariance matrix of the cause and the structure matrix mapping cause to the effect are independently chosen. The method wor…
Paper develops a new estimator for dynamic treatment effects in high-dimensional settings.
problem Time-varying confounding and model misspecification in estimating dynamic treatment effects.
method Sequential model doubly robust estimator with moment-targeting estimates.
result Root-N inference achieved under model misspecification, even with high-dimensional covariates.
We study the problem of treatment effect estimation in randomized experiments with high-dimensional covariate information, and show that essentially any risk-consistent regression adjustment can be used to obtain efficient estimates of the average treatment effect. Our results considerably extend the range of settings …
A new method corrects weight values to improve treatment effect estimation.
problem Estimating heterogeneous treatment effects in high-dimensional data with sample selection bias.
method Differentiable Pareto-Smoothed Weighting (DPSW) framework.
result Our method outperforms existing methods in treatment effect estimation.
CausalEGM estimates causal effects by encoding confounders, improving performance in high-dimensional settings.
problem Challenges in estimating causal effects with high-dimensional confounders.
method CausalEGM framework using generative modeling to decouple confounders and estimate causal effects.
result CausalEGM outperforms existing methods in binary and continuous treatment settings, especially with large sample sizes and high-dimensional confounders.
The paper analyzes side effects of learning from low-dimensional data embedded in a Euclidean space.
problem Learning from data distributed in a linear subspace of high-dimensional space.
method Derives estimates on the variation of the learning function and studies regularization effects.
result Potential regularization effects associated with network depth and noise in codimension of data manifold.
This paper explores saturation effects in spectral algorithms over large dimensions.
problem Saturation effects in spectral algorithms over large dimensions.
method Improved minimax lower bound and gradient flow with early stopping strategy.
result Exact convergence rates of spectral algorithms in large dimensional settings.
New method estimates treatment effects from high dimensional data.
problem Estimating treatment effects from high dimensional data with confounders.
method Generative modeling approach to backdoor adjustment in variational inference.
result Empirically, estimates interventional likelihood in high dimensional settings.
Let M be a compact, connected symplectic 2n-dimensional manifold on which an(n-2)-dimensional torus T acts effectively and Hamiltonianly. Under the assumption that there is an effective complementary 2-torus acting on M with symplectic orbits, we show that the Duistermaat-Heckman measure of the T-action is log-concave.…
Effective dimensionality reduction improves accuracy and reduces costs in estimating option Greeks.
problem Estimating Greeks for barrier and arithmetic average Asian options.
method Global sensitivity analysis, Chebyshev interpolation, conditional pathwise method, randomized Quasi Monte Carlo, Brownian bridge discretization, importance sampling.
result Reduced effective dimensionality enhances convergence rate and accuracy of randomized Quasi Monte Carlo integration.
This work studies scaling laws for low-precision training in high-dimensional linear regression.
problem Optimizing trade-off between model quality and training costs in high-dimensional linear regression.
method Theoretical study of scaling laws for low-precision training within a high-dimensional sketched linear regression framework, analyzing multiplicative and additive quantization.
result Multiplicative quantization maintains full-precision model size, while additive quantization reduces effective model size.
New theory shows deep networks adapt to data's intrinsic dimensionality even when data isn't on a low-dimensional manifold.
problem Existing theories on deep nonparametric regression assume data lie on a low-dimensional manifold, which is often not the case in real-world applications.
method Introduces effective Minkowski dimension to characterize the intrinsic dimension of data subsets and proves sample complexity depends on this new complexity notation.
result Deep neural networks can adapt to the effective Minkowski dimension of data, circumventing the curse of dimensionality for moderate sample sizes.
Paper proposes inference method for high-dimensional censored quantile regression.
problem Identifying heterogeneous effects of high-dimensional genetic biomarkers on survival outcomes.
method Combines low-dimensional model estimates based on multi-sample splittings and variable selection.
result Proposed estimator is consistent and asymptotically follows a Gaussian process.
Method detects effects of synthesis parameters on plutonium oxide microstructure.
problem Detecting effects of synthesis parameters on material microstructure.
method Copula theory, high dimensional distribution distances, and permutational statistics.
result Effects of strike order and oxalic acid feed on plutonium oxide microstructure detected.
EBM reduces dimensionality for estimating heterogeneous CATEs.
problem Estimating CATEs requires many confounding variables, increasing sample complexity.
method Proposes an EBM that learns a low-dimensional representation of variables.
result EBM representations keep CATE estimates consistent and perform better than other methods.
This paper concerns the development of an inferential framework for high-dimensional linear mixed effect models. These are suitable models, for instance, when we have n repeated measurements for M subjects. We consider a scenario where the number of fixed effects p is large (and may be larger than M), but the n…
NICE model estimates causal effects for image treatments.
problem Challenges in causal effect estimation for multi-dimensional treatments.
method Proposes NICE model for image treatments, incorporating rich multidimensional information.
result NICE significantly outperforms existing models in estimating causal effects for image treatments.
SCBMs model causal effects using low-dimensional bottlenecks.
problem Causal effect estimation in high-dimensional systems.
method Structural causal models with low-dimensional summary statistics.
result SCBMs provide a flexible framework for task-specific dimension reduction.
ISOKANN learns collective variables and effective dynamics for metastable transitions.
problem Understanding metastable transitions in complex molecular systems.
method Integrates Koopman operators with neural networks to extract CVs and effective dynamics.
result Reconstructs coarse-grained kinetics and reproduces transition times across barriers.
Extends SGM to functional spaces for multimodal data.
problem Modeling densities in functional spaces.
method Represent data in spectral space, dissociate stochastic and space-time components, use SGM for sampling.
result Demonstrates effectiveness on multimodal datasets.
According to the work of Laitinen, Morimoto, Oliver and Pawałowski, a finite group G has a smooth effective one fixed point action on some sphere if and only if G is an Oliver group. For some finite Oliver groups G of order up to 216, and for G=A5×Cn for n=3,5,7, we present a strategy of excluding o…
Estimating causal effects for survival outcomes in the high-dimensional setting is an extremely important topic for many biomedical applications as well as areas of social sciences. We propose a new orthogonal score method for treatment effect estimation and inference that results in asymptotically valid confidence int…
Proposes a robust estimator for high-dimensional data with heterogeneous treatment effects.
problem Estimating heterogeneous treatment effects with many more regressors than observations.
method Doubly robust two-stage semiparametric difference-in-difference estimator using machine learning for propensity score estimation.
result Valid inference for heterogeneous treatment effects with bias correction procedures.
Peer effects, in which the behavior of an individual is affected by the behavior of their peers, are posited by multiple theories in the social sciences. Other processes can also produce behaviors that are correlated in networks and groups, thereby generating debate about the credibility of observational (i.e. nonexper…
New KNN test improves association analysis of high-dimensional sequencing data.
problem Challenges in using neural networks for high-dimensional sequencing data analysis.
method Kernel-based neural network (KNN) test for complex association analysis.
result KNN test outperforms SKAT in detecting non-linear and interaction effects.
A scalable model for high-dimensional longitudinal data.
problem Modeling high-dimensional, non-linear, time-varying longitudinal data.
method LMM-VAE, combining linear mixed models and amortized variational inference.
result Competitive performance across simulated and real-world datasets.
Efficiently simulates slow dynamics of high-dimensional stochastic systems.
problem Simulating high-dimensional stochastic systems with slow dynamics and fast modes.
method Designs an algorithm to estimate an invariant manifold and its dynamics, averaging out fast modes.
result Efficient simulator of effective dynamics on low-dimensional invariant manifold.
Every design choice will have different effects on different units. However traditional A/B tests are often underpowered to identify these heterogeneous effects. This is especially true when the set of unit-level attributes is high-dimensional and our priors are weak about which particular covariates are important. How…
Reduces high granularity and dimensionality in hierarchical categorical variables.
problem Overfitting and estimation issues in predictive models due to high granularity and dimensionality.
method Entity embedding and top-down clustering algorithm to reduce granularity and dimensionality.
result The reduced hierarchy improves model fit and complexity balance.
The paper tackles counterfactual inference with multioutput deep kernels in high-dimensional settings.
problem Performing counterfactual inference with observational data in high-dimensional settings with multiple actions and outcomes.
method The paper presents a general class of counterfactual multi-task deep kernels models based on Structural Causal Models (SCM) and Gaussian Processes.
result The models estimate causal effects and learn policies efficiently, scaling well with high dimensions.
Framework tests CATE homogeneity across trials and evaluates confounding.
problem Assessing treatment effect consistency across randomized and observational studies.
method Leverages multiple randomized trials to test CATE homogeneity and compares with observational data.
result Identifies potential confounding and effect heterogeneity in treatment effects.
The paper extends kernel ridge regression to product kernels and reveals new convergence behaviors.
problem Understanding kernel ridge regression in large dimensions with various kernels.
method Established a broad family of large dimensional kernels and derived convergence rates.
result Revealed new phenomena including minimax optimality, saturation effect, and multiple descent behavior.
The paper uses neural networks to estimate treatment effects even with many confounders.
problem Estimating treatment effects with a growing number of confounders.
method General optimization framework using neural networks to approximate nuisance functions.
result Neural networks can handle a diverging number of confounders and alleviate the curse of dimensionality.
We obtain a topological and weakly equivariant classification of closed three-dimensional Alexandrov spaces with an effective isometric circle action. As an application of the classification we prove a version of the Borel conjecture for closed three-dimensional Alexandrov spaces with circle symmetry.
In this article the package High-dimensional Metrics (\texttt{hdm}) is introduced. It is a collection of statistical methods for estimation and quantification of uncertainty in high-dimensional approximately sparse models. It focuses on providing confidence intervals and significance testing for (possibly many) low-dim…
ACI uses Bayesian data assimilation to trace causes from effects in complex systems.
problem Capturing instantaneous, time-evolving causal relationships in complex, high-dimensional systems.
method Assimilative causal inference (ACI) leverages Bayesian data assimilation to trace causes backward from observed effects.
result ACI provides online tracking of causal roles that may reverse intermittently and reveals how far effects propagate.
An algorithm reduces breast cancer detection data complexity using effect sizes.
problem Improving accuracy in breast cancer detection.
method Statistical feature selection and SVM classifier with linear kernel.
result SVM classifier achieved over 90% accuracy.
Investigates projections onto explicit subspaces and their variance effects.
problem Understanding the variance preservation in explicit subspace projections.
method Investigates projections onto explicit subspaces of varying dimensionality and analyzes the variance effects.
result Developed new bounds for Euclidean distances and inner products.
R package xtdml uses DML for panel data models with fixed effects.
problem Estimating structural parameters in panel data models with fixed effects.
method Combines machine learning with statistical estimation for inference.
result Demonstrates improved performance in learning nuisance functions.