DNA-SE uses deep learning to solve semiparametric problems efficiently.
problem Solving semiparametric integral equations in high dimensions.
method Formulates semiparametric estimation as a bi-level optimization problem and uses DNN to approximate solutions.
result Demonstrates numerical and statistical advantages over traditional methods.
Semiparametric method removes bias in functional bilevel gradient estimation.
problem First-order bias in plug-in hypergradient when lower-level problem is nonparametric.
method Semiparametric debiasing theory based on efficient influence function leads to cross-fitted orthogonal hypergradient estimator.
result Asymptotic normality and uniform control over outer parameter established for the estimator.
New estimators improve sparse semiparametric additive modeling.
problem Sparse semiparametric additive modeling with structured sparsity.
method Combines group subset selection with shrinkage for nonconvex optimization.
result New estimators outperform alternatives in synthetic and real-world data.
Bayesian method estimates QTEs from observational data.
problem Estimating nuanced characteristics of counterfactual distributions.
method Bayesian semiparametric conditional distribution regression model with double balancing score.
result Proposed method provides more accurate QTE estimates than other methods.
To better understand the spatial structure of large panels of economic and financial time series and provide a guideline for constructing semiparametric models, this paper first considers estimating a large spatial covariance matrix of the generalized m-dependent and β-mixing time series (with J variables and T…
Improves DRL for long-term causal inference with semiparametric methods.
problem Efficient inference for policy values in nonparametric MDPs with stringent conditions.
method Semiparametric Double Reinforcement Learning (DRL) with superefficient nonparametric estimators.
result Relaxes overlap conditions and reduces high-dimensional density-ratio estimation.
New method estimates treatment effects from treated and unlabeled units.
problem Estimating ATEs with missing data and weak supervision.
method Develops semiparametric efficient estimators for ATE in PU learning.
result Constructs estimators that achieve semiparametric efficiency bounds.
New estimator optimizes black-box model errors in semiparametric estimation.
problem How nuisance estimation errors affect low-dimensional target parameters in semiparametric models.
method Proposed a new estimator achieving a sharper rate of convergence.
result The first-order stochastic error of nuisance estimation can be eliminated.
We propose a new high dimensional semiparametric principal component analysis (PCA) method, named Copula Component Analysis (COCA). The semiparametric model assumes that, after unspecified marginally monotone transformations, the distributions are multivariate Gaussian. COCA improves upon PCA and sparse PCA in three as…
Bayesian methods improve DiD analysis for ATT estimation.
problem Estimating ATT in DiD designs with improved accuracy.
method Semiparametric Bayesian outcome regression and doubly robust adjustment.
result Bayesian methods provide strong finite-sample performance.
New method improves robustness of double robust estimators under complete misspecification.
problem Improper performance of double robust estimators when all nuisance functions are misspecified.
method DR+ACC, an adaptive correction clipping method.
result DR+ACC ensures bounded error and maintains semiparametric efficiency.
Framework for multi-task learning with semiparametric models and nuisance parameters.
problem Improving parameter estimation from diverse, heterogeneous datasets.
method Late fusion multi-task learning framework with two-step process: individual task learning followed by adaptive aggregation.
result The method achieves faster convergence rates compared to individual task learning when tasks share similar parametric components.
We study deep neural networks and their use in semiparametric inference. We establish novel rates of convergence for deep feedforward neural nets. Our new rates are sufficiently fast (in some cases minimax optimal) to allow us to establish valid second-step inference after first-step estimation with deep learning, a re…
Semiparametric Bayesian networks combine parametric and nonparametric models for flexible data analysis.
problem Combining the advantages of parametric and nonparametric models for flexible data analysis.
method Semiparametric Bayesian networks combining parametric and nonparametric conditional probability distributions. Modifications of two algorithms for structure learning from data.
result Accurately learns the combination of parametric and nonparametric components, comparable to state-of-the-art methods.
The paper proposes an efficient method for estimating ATEs using adaptive experiments.
problem Estimating average treatment effects (ATEs) with minimal sample size and high accuracy.
method The paper defines and uses the efficient treatment-assignment probability to sequentially assign treatments, estimating ATEs using an Adaptive Augmented Inverse Probability Weighting (A2IPW) estimator.
result The proposed experimental design and A2IPW estimator achieve the minimized semiparametric efficiency bound and provide anytime valid confidence intervals for early stopping.
Optimal online data collection for semiparametric inference reduces regret.
problem Sequential data collection decisions for efficient estimation under budget constraints.
method Online Moment Selection framework; Explore-then-Commit and Explore-then-Greedy policies.
result Online data collection policies achieve zero regret relative to an oracle policy.
Semiparametric STAR model improves mental health data analysis.
problem Overdispersed, zero-inflated, bounded count data in self-reported mental health surveys.
method STAR transformation and rounding of latent Gaussian model, nonparametric transformation estimation, EM algorithm for maximum likelihood.
result Substantial improvements in goodness-of-fit compared to existing models.
New method estimates Gaussian copulas with missing data using EM algorithm.
problem Estimating Gaussian copulas with missing data and prior assumptions.
method Rigorous application of the Expectation Maximization (EM) algorithm for marginal distributions and dependence structure.
result Joint distribution learned is closer to the underlying distribution.
Recent methods for estimating sparse undirected graphs for real-valued data in high dimensional problems rely heavily on the assumption of normality. We show how to use a semiparametric Gaussian copula--or "nonparanormal"--for high dimensional inference. Just as additive models extend linear models by replacing linear …
Proposes a robust estimator for high-dimensional data with heterogeneous treatment effects.
problem Estimating heterogeneous treatment effects with many more regressors than observations.
method Doubly robust two-stage semiparametric difference-in-difference estimator using machine learning for propensity score estimation.
result Valid inference for heterogeneous treatment effects with bias correction procedures.
New method handles missing data using AI for efficient inference.
problem Parameter estimation and inference with blockwise missing data.
method Tractable solution using AI models and semiparametric theory.
result IBM(RAY) and IBM(Adaptive) estimators achieve efficiency gains.
DeepMed uses DNNs to estimate causal mediation effects without sparsity constraints.
problem Estimating Natural Direct and Indirect Effects in mediation analysis.
method DeepMed employs deep neural networks to cross-fit infinite-dimensional nuisance functions.
result DeepMed achieves semiparametric efficiency bound and adapts to low-dimensional nuisance structures.
New method improves treatment effect estimation in adaptive experiments with noncompliance.
problem Estimating average treatment effect in adaptive experiments with binary instrumental variable.
method AMRIV estimator that balances outcome noise and compliance variability.
result AMRIV achieves semiparametric efficiency bound and is robust to noncompliance.
This study optimizes covariate density and propensity score for efficient ATE estimation.
problem Efficiently estimating average treatment effects (ATEs) with minimal variance.
method Adaptive experiment optimizing both covariate density and propensity score.
result Proposed method minimizes the semiparametric efficiency bound for ATE estimation.
Deep learning method for semiparametric regression of spatial data.
problem Estimating relationships between response and covariates in spatially dependent data.
method A sparsely connected deep neural network with ReLU activation function.
result The method is consistent and can handle large datasets.
A new model avoids the PH assumption for right-censored survival data.
problem Inflexibility of Cox model when PH assumption fails.
method Deep partially linear transformation model (DPLTM) for right-censored data.
result The DPLTM avoids the curse of dimensionality and retains interpretability.
ULFS-KDPE estimates parameters efficiently without influence functions.
problem Estimating pathwise differentiable parameters in nonparametric models.
method Kernel debiased plug-in estimator based on universal least favorable submodel.
result Semiparametric efficiency achieved without influence function derivation.
Knowledge distillation improves model accuracy by mimicking teacher model probabilities.
problem Improving model accuracy through model compression.
method Casting knowledge distillation as a semiparametric inference problem, deriving new guarantees, and developing enhancements.
result Enhancements improve student performance by mitigating teacher overfitting and underfitting.
Efficient inference for adaptive data with directional stability condition.
problem Efficient inference on scalar targets after adaptive data collection.
method Introduces directional stability, a weaker condition than i.i.d. data, and shows asymptotic normality and efficiency of estimators.
result Estimators remain asymptotically normal and semiparametrically efficient under directional stability.
Bayesian method corrects bias in treatment effect estimation.
problem Estimating treatment effects from observational data with high-dimensional nuisance parameters.
method Bayesian debiasing, targeted modeling, sample splitting.
result Marginal posterior for ATE satisfies Bernstein-von Mises theorem under correct nuisance model specification.
Proposes a method for valid inference in GPLSIMs with longitudinal data.
problem Challenges in longitudinal data inference due to within-subject correlation and unstable variance estimation.
method Profile estimating-equation approach using spline approximation and block empirical likelihood.
result Block empirical likelihood ratio statistic with Wilks-type chi-square limit for joint inference.
Bayesian method for estimating ATE with robustness to model misspecification.
problem Estimating average treatment effects under unconfoundedness.
method Double robust Bayesian inference using adjusted prior and posterior distributions.
result Bayesian credible sets form asymptotically exact confidence intervals.
Efficient inference method for adaptive experiments with tighter confidence sequences.
problem Efficient inference of Average Treatment Effect in a changing policy sequential experiment.
method Semiparametric efficient inference using Adaptive Augmented Inverse-Probability Weighted estimator and asymptotic confidence sequences.
result Derives tighter confidence sequences for adaptive experiments under data-dependent stopping times.
The paper proposes a method to construct well-calibrated prediction sets for correlated target variables.
problem Constructing well-calibrated prediction sets for correlated target variables.
method The method uses vine copulas to estimate the joint cumulative distribution function of non-conformity scores and improves the asymptotic efficiency of the quantile estimate.
result The method guarantees asymptotically exact coverage and competitive efficiency on real-world regression problems.
While model selection is a well-studied topic in parametric and nonparametric regression or density estimation, selection of possibly high-dimensional nuisance parameters in semiparametric problems is far less developed. In this paper, we propose a selective machine learning framework for making inferences about a fini…
As the dynamic structure of the financial markets is subject to dramatic changes, a model capable of providing consistently accurate volatility estimates must not make strong assumptions on how prices change over time. Most volatility models impose a particular parametric functional form that relates an observed price …
This paper presents a problem of model learning for the purpose of learning how to navigate a ball to a goal state in a circular maze environment with two degrees of freedom. The motion of the ball in the maze environment is influenced by several non-linear effects such as dry friction and contacts, which are difficult…
New method embeds bipartite graphs into vectors, overcoming nonlinear challenges.
problem Learning vector representations for bipartite graphs with nonparametric components.
method Semiparametric exponential family distribution, pseudo-likelihood objective, gradient descent.
result Gradient descent achieves linear convergence rate and robust to model misspecification.
Paper develops a new estimator for rough volatility parameters.
problem Estimating rough volatility parameters from high-frequency data.
method Develops a semiparametric estimator for H in rough volatility models. result The estimator achieves optimal convergence rate in minimax sense.
In this paper, we study statistical properties of semi-supervised learning, which is considered as an important problem in the community of machine learning. In the standard supervised learning, only the labeled data is observed. The classification and regression problems are formalized as the supervised learning. In s…
Discussing hybrid models in Bayesian networks.
problem Improving accuracy in network modeling.
method Hybrid semiparametric Bayesian approach.
result Enhanced model performance in complex networks.
Method estimates joint distribution of bivariate outcomes.
problem Modeling dependence between bivariate outcomes.
method Semiparametric distribution regression.
result Method performs similarly or better than alternatives in finite samples.
New method estimates tempered stable Lévy models with high accuracy.
problem Estimating volatility and jump intensity of tempered stable Lévy processes.
method Iterative method combining Truncated Realized Quadratic Variations and small-time approximations.
result Method outperforms existing alternatives in various scenarios.
Proposes adversarial method to estimate Riesz representer.
problem Estimating causal parameters as linear functionals of an underlying regression.
method Adversarial framework using general function spaces.
result Nonasymptotic mean square rate proved for neural networks, random forests, and RKHS.
A new causal graph framework identifies treatment effects without adjusting for confounders.
problem Invalid identification of causal effects due to unmeasured confounders.
method Developed the Napkin graph to identify causal effects through a ratio of g-formulas, using influence-function-based estimators.
result Demonstrated substantial efficiency gains in estimating causal effects using the Napkin graph.
Unified theory for semiparametric data fusion with individual-level data.
problem Handling data fusion problems, especially in settings with diverse data sources and designs.
method Extending a comprehensive theory to handle conditional and marginal distribution alignments, providing universal results for influence functions and efficient influence functions.
result Paves the way for machine-learning debiased, semiparametric efficient estimation.
Proximal Mediation Analysis with Hidden Recanting Witnesses
problem Identifying path-specific effects in mediation analysis when recanting witnesses are unknown
method Proximal causal inference and semiparametric inference framework
result Developed three novel identification strategies and a semiparametric inference framework
Proposes methods to identify and estimate counterfactual distributions with confounding.
problem Estimating counterfactual distributions in the presence of confounding.
method Nonparametric identification and semiparametric estimation using conditional copulas and machine learning.
result Valid inference for individual-level effects and nonparametric identifiability of latent confounding subspace.