New random forest method provides optimal rates and confidence bands.
problem Improving random forest regression rates and constructing confidence bands.
method Proposed Ehrenfest centered purely random forests achieve optimal rates; used Gaussian approximation for supremum of empirical processes.
result Explicit asymptotic uniform confidence bands constructed for both random forest types.
The paper creates nonparametric confidence bands for band-limited functions.
problem Estimating confidence bands for band-limited functions with finite samples and unknown noise.
method Uses Paley-Wiener reproducing kernel Hilbert spaces and gradient-perturbation methods.
result Non-asymptotic guarantees for confidence regions without assuming a parametric model.
New method constructs confidence bands for ODE models with unknown regulatory effects.
problem Building confidence bands for ODE models with unknown regulatory relations is challenging.
method Localized kernel learning approach combined with de-biasing method.
result The constructed confidence band has the desired asymptotic coverage probability and accurately recovers the regulatory network.
We develop a novel procedure for constructing confidence bands for components of a sparse additive model. Our procedure is based on a new kernel-sieve hybrid estimator that combines two most popular nonparametric estimation methods in the literature, the kernel regression and the spline method, and is of interest in it…
This article studies local and global inference for smoothing spline estimation in a unified asymptotic framework. We first introduce a new technical tool called functional Bahadur representation, which significantly generalizes the traditional Bahadur representation in parametric models, that is, Bahadur [Ann. Inst. S…
The paper improves nonparametric confidence bands for band-limited functions.
problem Constructing nonparametric simultaneous confidence bands with nonasymptotic and distribition-free guarantees.
method Based on Paley-Wiener reproducing kernel Hilbert spaces, the paper relaxes assumptions, improves noise estimation, and tightens constraints.
result Enhanced confidence bands with improved efficiency and tighter constraints.
Paper proposes a method to estimate confidence bands for survival random forests.
problem No statistically valid and computationally feasible approach for estimating confidence bands for survival random forests.
method Extending recent developments in infinite-order incomplete U-statistics, the paper proposes an unbiased confidence band estimation.
result The proposed method accurately estimates the confidence band and achieves desired coverage rate.
Confidence bands for tuning curves improve hyperparameter comparison in NLP.
problem Ambiguity in comparing hyperparameter tuning methods.
method Constructs exact, simultaneous, and distribution-free confidence bands for tuning curves.
result Confidence bands provide a robust basis for comparing methods rigorously.
Efficiently constructs prediction bands with minimal assumptions.
problem Uncertainty quantification for nonparametric, heteroscedastic data.
method Semi-definite programming for data-adaptive prediction bands.
result Strong non-asymptotic coverage properties with minimal distributional assumptions.
Develops methods for estimating and providing confidence bands in sparse high-dimensional additive models.
problem Estimating and providing reliable confidence bands for nonparametric components in high-dimensional additive models.
method Integrates sieve estimation into a high-dimensional Z-estimation framework, employing a multiplier bootstrap procedure.
result Constructs uniformly valid confidence bands for the target component f1 in sparse high-dimensional additive models. The paper improves the empirical bootstrap method for non-normal estimators.
problem Theoretical properties of empirical bootstrap for non-asymptotically normal estimators.
method Establishing limiting distribution, deriving consistency conditions, proposing alternative methods.
result The empirical bootstrap method can be asymptotically consistent under stability conditions.
The paper constructs optimal confidence bands for kernel gradient flow estimators.
problem Estimating generalization error and constructing confidence bands for kernel gradient flows.
method Established convergence rates and constructed optimal confidence bands under capacity-source condition.
result Optimal confidence bands for kernel gradient flows have shrinkage rates close to minimax optimal rates.
The paper improves confidence regions for band-limited functions using tighter norm bounds and majority voting.
problem Constructing reliable confidence regions for band-limited functions from noisy data.
method Improved norm bounds using Hoeffding's inequality and empirical Bernstein bound, majority voting to aggregate intervals.
result Confidence intervals retain their simultaneous coverage guarantee even when aggregated from random subsamples.
New methods for estimating and inferring nonparametric structural functions and elasticities.
problem Estimating and inferring nonparametric structural functions and their derivatives.
method Data-driven sieve dimension choice and uniform confidence bands construction.
result Optimal estimation and inference procedures with minimax rates of convergence.
Paper proposes efficient data-driven confidence bands for distributed nonparametric regression.
problem High computational complexity in nonparametric regression for large datasets.
method Divide and conquer approach, averaging local estimates, with data-driven uncertainty quantification.
result Frequentist L2-confidence bands and minimax-optimal high-probability bounds for averaged estimator. New calibration bands for various distributions improve testing for auto-calibration.
problem Testing for auto-calibration in finite samples is challenging.
method Construct calibration bands for the exponential dispersion family using finite sample properties.
result Calibration bands allow for various tests for calibration and auto-calibration.
New method for accurate uncertainty estimation in deep learning predictions.
problem Insufficient methods for assessing prediction uncertainty in deep learning.
method Valid non-parametric bootstrap method for deep neural networks.
result Accurate confidence intervals and simultaneous confidence bands for survival data.
Extend CPS to non-exchangeable settings with observation-specific permutation weights
problem Calibrated predictive bands under distributional shifts
method Encoding distributional shifts through observation-specific permutation weights
result Shift-aware predictive systems remain valid
We use PDPs with confidence bands to explain HPO results.
problem Lack of explainable insights into HPO results.
method Use IML techniques, specifically PDPs, with estimated confidence bands.
result Increased quality of PDPs in relevant sub-regions.
Kernel ridge regression inference for nonstandard data.
problem Inferential theory for kernel ridge regression with nonstandard data.
method Constructs valid and sharp confidence sets using anti-symmetric multipliers.
result Develops a test for match effects in school matching mechanisms.
Many problems that appear in biomedical decision making, such as diagnosing disease and predicting response to treatment, can be expressed as binary classification problems. The costs of false positives and false negatives vary across application domains and receiver operating characteristic (ROC) curves provide a visu…
We explore the role that random arbitrage opportunities play in hedging financial derivatives. We extend the asymptotic pricing theory presented by Fedotov and Panayides [Stochastic arbitrage return and its implication for option pricing, Physica A 345 (2005), 207-217] for the case of hedging a derivative when arbitrag…
Electricity production via solar energy is tackled via short-term forecasts and risk management. Our main tool is a new setting on time series. It allows the definition of "confidence bands" where the Gaussian assumption, which is not satisfied by our concrete data, may be abandoned. Those bands are quite convenient an…
Method provides statistical guarantees for identifying subgroups in ML studies.
problem Bias and noise in estimating conditional average treatment effects (CATE).
method Develops uniform confidence bands (GATES) for estimating group average treatment effects (GATEs).
result Identifies subgroups with statistical guarantees, regardless of effect size.
Comparing counterfactual distributions can provide more nuanced and valuable measures for causal effects, going beyond typical summary statistics such as averages. In this work, we consider characterizing causal effects via distributional distances, focusing on two kinds of target parameters. The first is the counterfa…
The paper analyzes LETF option markets using moneyness scaling to find statistical arbitrage opportunities.
problem Statistical discrepancies between levered and unlevered ETF option implied volatility smiles.
method Bootstrap uniform confidence bands, dynamic semiparametric factor model, moneyness scaling, Heston stochastic volatility.
result Trading opportunities exist on LETF market, and a statistical arbitrage strategy generates positive returns.
Proposes a Varying-Coefficient MoE model for analyzing dynamic data.
problem Inadequate constant coefficients in MoE models for dynamic settings.
method Varying-Coefficient Mixture of Experts (VCMoE) model with varying coefficients in gating and expert models.
result Established identifiability and consistency of the VCMoE model.
Develops local population-risk certificates for model updates
problem Model updates in machine learning
method Certify population-risk increments around a model
result Certified upper endpoint yields a risk-controlled update rule
The paper provides bounds on the CDF of a variable under nonstationary conditions.
problem Estimating the complete distribution of a random variable under nonstationary conditions.
method Time-uniform and value-uniform bounds on the CDF of the running averaged conditional distribution.
result Presented computationally efficient bounds that are always valid and sometimes trivial.
Two conformal methods create flexible conditional predictive bands without strong assumptions.
problem Achieving asymptotic conditional coverage without strong dependence assumptions.
method Flexible distribution-free conditional predictive bands using density estimators.
result Methods achieve better control of conditional coverage and smaller length than previous methods.
We provide adaptive inference methods, based on ℓ1 regularization, for regular (semi-parametric) and non-regular (nonparametric) linear functionals of the conditional expectation function. Examples of regular functionals include average treatment effects, policy effects, and derivatives. Examples of non-regular f…
New flexible confidence sequences for robust statistical inference.
problem Creating robust statistical inference methods that work under mild assumptions.
method Proposed a new class of asymptotic time-uniform confidence sequences.
result Sharp asymptotic time-uniform confidence sequences achieved under mild assumptions.
The paper provides guarantees for high-dimensional DML estimators in observational studies.
problem Estimating treatment effects in observational settings with many covariates.
method Debiased machine learning (DML) with finite-sample guarantees.
result Bounding the deviation of finite-sample distribution from asymptotic Gaussian approximation.
The functional significance of resting state networks and their abnormal manifestations in psychiatric disorders are firmly established, as is the importance of the cortical rhythms in mediating these networks. Resting state networks are known to undergo substantial reorganization from childhood to adulthood, but wheth…
Prove first-band large-diameter asymptotics for Dirichlet spectrum on horoconvex domains in real hyperbolic space.
problem Prove first-band large-diameter asymptotics for Dirichlet spectrum on horoconvex domains in real hyperbolic space.
method Prove first-band large-diameter asymptotics for Dirichlet spectrum on horoconvex domains in real hyperbolic space.
result Prove first-band large-diameter asymptotics for Dirichlet spectrum on horoconvex domains in real hyperbolic space.
As adversarial attacks pose a serious threat to the security of AI system in practice, such attacks have been extensively studied in the context of computer vision applications. However, few attentions have been paid to the adversarial research on automatic path finding. In this paper, we show dominant adversarial exam…
This paper introduces time-uniform CLT-based confidence intervals for statistical inference.
problem Developing valid statistical inference methods for sequential data.
method Time-uniform central limit theory and strong invariance principles.
result Asymptotic confidence sequences (CSs) that are uniformly valid over time.
Researchers prove rigidity of first conformal Steklov eigenvalue on specific shapes.
problem Rigidity of the first conformal Steklov eigenvalue on annuli and Möbius bands.
method Proof relies on uniqueness results, compactness theorem, and asymptotic control of Steklov eigenvalues.
result Rigidity of the first conformal Steklov eigenvalue on annuli and Möbius bands proved.
New method improves GP uncertainty quantification for misspecified priors.
problem Uncertainty quantification for GPs under incorrect priors.
method Constructs a confidence sequence using martingale techniques.
result Empirically outperforms standard GP methods in robustness and utility for Bayesian Optimization.
Constructs non-asymptotic confidence regions for unknown functions in RKHS.
problem Global probabilistic confidence regions for unknown functions in RKHS.
method Reduces confidence region construction to estimating RKHS norm.
result Valid confidence regions can be constructed non-asymptotically.
Define mass invariant for asymptotically hyperbolic 3-manifolds with toroidal infinity.
problem Define mass invariant for asymptotically hyperbolic 3-manifolds with toroidal infinity.
method Define mass invariant for asymptotically hyperbolic 3-manifolds with toroidal infinity.
result Define mass invariant for asymptotically hyperbolic 3-manifolds with toroidal infinity.
Develops confidence intervals for ECE, a measure of model calibration.
problem Ensuring the calibration of probabilistic predictions in machine learning models.
method Develops confidence intervals for the ℓ2 Expected Calibration Error (ECE), considering top-1-to-k calibration. result Shows asymptotic normality and different convergence rates for calibrated and miscalibrated models, developing methods to construct valid confidence intervals.
The paper bridges stochastic control and deep hedging for European call options with transaction costs.
problem Hedging and pricing European call options with proportional transaction costs.
method Complementary perspectives: stochastic control and deep hedging. Two architectures proposed: NTBN-Delta and WW-NTBN.
result WW-NTBN converges faster, matches no-transaction bands more closely, and generalizes well across transaction cost regimes.
Optimal trading strategy with predictor and costs, derived equations and shape.
problem Optimal trading strategy in presence of price predictor, costs, and risk control.
method Path-integral method to derive equations for band edges, solved explicitly for Ornstein-Uhlenbeck predictor.
result Explicit equations and shape of the optimal band strategy derived and analyzed.
Proposes a new method for analyzing multimodal neuroimaging data.
problem Combining interpretability and flexibility in multimodal data analysis.
method Orthogonalized kernel debiased machine learning approach.
result Established consistency and asymptotic normality of the estimated primary parameter.
The paper proposes a new model for predicting and analyzing economic variables.
problem Predicting and analyzing economic variables in developed regions.
method Time-varying parameter global vector autoregressive (TVP-GVAR) framework combined with machine learning models.
result The proposed model provides high precision out-of-sample predictions and novel insights into economic variable connectedness.
The study improves life insurance surrender risk modeling using various machine learning techniques.
problem Accurate modeling of surrender risk in life insurance to meet Solvency II directive requirements.
method Extensive experiments with XGBoost, random forest, GLM, and neural networks; resampling analysis; time-dependent confidence bands.
result Models trained on resampled data predict significantly biased event probabilities, highlighting the need for complementary assessments.
We derive formulas for F measures' standard error and confidence intervals.
problem Estimating F measures' accuracy with confidence.
method Analytic formulas based on asymptotic normality.
result Valid formulas for sample size planning.