Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,695 papers · 148 categories

Trend · papers per month

3671107142 · May 202619922001200920172026
48 results for nonparametric corrections

The paper examines when importance weighting is needed for nonparametric and misspecified models.

problem When is importance weighting correction needed for covariate shift adaptation?
method Analysis of IW-corrected kernel ridge regression in various settings.
result The importance weighting correction is needed for nonparametric and misspecified models to obtain the best approximation of the true unknown function.

New method improves Bayesian inference for parametric models, robust to misspecification.

problem Inference can be untrustworthy when parametric models are wrong.
method Adaptive nonparametric corrections for parametric Bayesian models using generalized Bayes.
result The method achieves robustness and efficiency, converging fast when the parametric model is close to true.

NP-iMCMC algorithm for nonparametric models in universal PPLs.

problem Developing inference algorithms for arbitrary nonparametric models in universal PPLs.
method Unifying involutive MCMC framework with a general procedure for state movement.
result Proves the correctness of the NP-iMCMC sampler and shows significant performance improvements.

The study examines methods to correct measurement error in nutritional epidemiology studies.

problem Measurement error in nutritional studies leads to biased and underconfident estimates.
method The article reviews various bias-correction models for exposure variables in nutritional epidemiology.
result Bias-correction methods are essential for accurate inference in nutritional studies.

A debiasing method improves nonparametric regression's statistical properties.

problem Lack of theoretical guarantees for modern nonparametric regression methods.
method Model-free debiasing method incorporating a correction term.
result Debiased estimator satisfies pointwise and uniform risk convergence, asymptotic normality.

Perturbation theory improves nonparametric instrumental variable estimation accuracy.

problem Improving nonparametric instrumental variable estimation accuracy in high-dimensional settings.
method Perturbative approach based on physics perturbation theory, extending kernel ridge methods with higher-order corrections.
result First-order perturbative corrections reduce prediction error by up to 99% in high-dimensional ill-defined cases.

NP-HMC extends HMC for nonparametric models in probabilistic programming.

problem Inference for nonparametric models in probabilistic programming.
method Introduces NP-HMC, a generalization of HMC for nonparametric models using tree representable functions.
result Empirically shows significant performance improvements over existing approaches.

New method calibrates probabilistic regression models without restrictive assumptions.

problem Ensuring predictive distributions accurately reflect true uncertainty.
method Nonparametric re-calibration algorithm based on conditional kernel mean embeddings.
result Consistently outperforms prior re-calibration approaches across various benchmarks.

Proposes SD-KDE for density estimation using debiased kernel density with score-based adjustments.

problem Density estimation with bias in kernel density estimation.
method Adjusts data points by taking a step along the estimated score function, then applies standard KDE with modified bandwidth.
result Significantly reduces mean integrated squared error compared to standard Silverman KDE, especially with noisy score function estimates.

Framework LiLY recovers latent causal variables from time-series data under distribution shifts.

problem Learning and correcting models under unknown distribution shifts in time-series data.
method LiLY framework that recovers latent causal variables and identifies their relations from temporal data under different distribution shifts.
result The framework reliably identifies time-delayed latent causal influences from observed variables under different distribution changes.

The study identifies latent concepts from diverse observations without assuming specific models.

problem Lack of general theoretical support for concept learning.
method Develops a nonparametric framework for identifying latent concepts from multiple classes of observations.
result Correctness guarantees for concept identification without parametric assumptions.

We study the problems related to the estimation of the Gini index in presence of a fat-tailed data generating process, i.e. one in the stable distribution class with finite mean but infinite variance (i.e. with tail index α(1,2)α\in(1,2)). We show that, in such a case, the Gini coefficient cannot be reliably estimated usin…

2017-07-05abs ↗pdf ↗

Paper develops PGMM framework for debiased inference on nonparametric IV estimators.

problem Automatic debiased inference on nonparametric IV functionals.
method Penalized GMM (PGMM) framework for functionals of IV estimators.
result PGMM-based debiased estimator performs well, achieving near-nominal coverage.

New nonparametric estimators improve causal effect estimation.

problem Estimation of causal effects with selection bias.
method Undersmoothing of the highly adaptive lasso for estimating the weighting mechanism.
result Asymptotic efficiency and convergence to nonparametric efficiency bound.

Deep neural networks with adversarial training achieve sup-norm convergence for nonparametric regression.

problem Achieving sup-norm convergence for deep neural network estimators in nonparametric regression.
method Developed an adversarial training scheme to address the sup-norm convergence issue.
result Deep neural network estimators achieve optimal sup-norm convergence with the proposed adversarial training.

New matching estimators correct bias in multivariate settings without smoothing parameters.

problem Bias in nearest-neighbor and matching estimators in multiple dimensions.
method Polynomial least squares fits on Voronoi tessellations.
result Novel estimators converge at n\sqrt{n} rate under mild smoothness assumptions.

We consider nonparametric estimation of L2L_2, Renyi-αα and Tsallis-αα divergences between continuous distributions. Our approach is to construct estimators for particular integral functionals of two densities and translate them into divergence estimators. For the integral functionals, our estimators are based on cor…

2014-02-12abs ↗pdf ↗

Paper develops methods to estimate derivative of dose-response curve for continuous treatments.

problem Estimating the derivative of the dose-response curve for continuous treatments.
method Doubly robust (DR) inference method using kernel smoothing, bias-corrected IPW and DR estimators.
result Proposes novel bias-corrected IPW and DR estimators for continuous treatments.

Paper develops estimators for unbounded density ratios with applications in error control.

problem Estimating density ratios with unbounded domains and ranges.
method Least squares and logistic regression loss functions for density ratio estimation.
result Established upper bounds on estimation errors with optimal rates for unbounded density ratios.

While most Bayesian nonparametric models in machine learning have focused on the Dirichlet process, the beta process, or their variants, the gamma process has recently emerged as a useful nonparametric prior in its own right. Current inference schemes for models involving the gamma process are restricted to MCMC-based …

2014-10-04abs ↗pdf ↗

We identify and analyze selection structure in sequential data.

problem Selection biases in sequential data can distort analysis and hide underlying generation processes.
method Nonparametric identifiability of selection structure without interventional experiments.
result Selection structure is identifiable in sequential data without parametric assumptions.

Proposes new methods for inference in GLMs without assuming model correctness.

problem Inference for GLMs assumes model correctness, leading to uncertainty and bias.
method Develops nonparametric estimands and uses influence curves with flexible procedures.
result Inference for GLM parameters is improved without model correctness assumptions.

Gaussian process models improve MJO predictions with better uncertainty quantification.

problem Lack of uncertainty quantification in MJO predictions by machine learning models.
method Developed a nonparametric strategy based on Gaussian process models, calibrating them using empirical correlations and proposing a posteriori covariance correction.
result Gaussian process models provide better prediction skills and extended probabilistic coverage for MJO forecasts.

A nonparametric approach for policy learning for POMDPs is proposed. The approach represents distributions over the states, observations, and actions as embeddings in feature spaces, which are reproducing kernel Hilbert spaces. Distributions over states given the observations are obtained by applying the kernel Bayes' …

2012-10-16abs ↗pdf ↗

Unified framework for automatic debiased machine learning for various statistical parameters.

problem Inference on smooth functionals of nonparametric M-estimands.
method Unified framework using gradient, Hessian, and linear approximation; solves two risk minimization problems.
result Efficient autoDML estimators with double robustness and robustness to misspecification.

In most adaptive signal processing applications, system linearity is assumed and adaptive linear filters are thus used. The traditional class of supervised adaptive filters rely on error-correction learning for their adaptive capability. The kernel method is a powerful nonparametric modeling tool for pattern analysis a…

2015-08-28abs ↗pdf ↗

Proposes LRR and LRLR for improving stock prediction accuracy.

problem Improving stock prediction accuracy through nonparametric classification.
method Local radial regression and logistic regression variant.
result LRLR outperforms LPoR and MS-kk-NN in real-world stock datasets.

Neural Diffusion Intensity Models simplify Cox processes inference.

problem Intractable nonparametric estimation and posterior inference of latent stochastic intensity in Cox processes.
method Variational framework using neural SDEs, with theoretical guarantee of ELBO maximization coinciding with maximum likelihood estimation.
result Accurate recovery of latent intensity dynamics and posterior paths with significant speedup.

New method reduces bias in estimating causal effects from discretized variables.

problem Bias in estimating causal effects from discretized continuous variables.
method Proposes a bias-reduced functional that evaluates outcome regression at within-bin conditional means.
result Demonstrates substantial bias reduction and near-nominal confidence interval coverage.

Entropy regularization improves interpretability of probabilistic clustering models.

problem Bayesian nonparametric mixture models often produce unbalanced cluster frequencies.
method Interpreting the posterior as penalized likelihood, entropy regularization reduces sparsely-populated clusters.
result The proposed entropy-regularized estimator enhances interpretability without sacrificing computational convenience.

A new method tests variable significance without assuming model correctness.

problem Testing variable significance in the presence of complex interactions.
method Flexible nonparametric or machine learning methods to estimate conditional mean independence.
result Achieves minimax optimal rate in nonparametric testing problem.

Unified framework for output analysis using Monte Carlo sampling.

problem Accurately assess the quality of estimated values in predictive models.
method Unified output analysis framework through Monte Carlo sampling, leveraging fast iterative bootstrap sampling and higher-order influence functions.
result Clear advantage in building more robust confidence intervals with higher coverage probability.

We propose a geometric algorithm for topic learning and inference that is built on the convex geometry of topics arising from the Latent Dirichlet Allocation (LDA) model and its nonparametric extensions. To this end we study the optimization of a geometric loss function, which is a surrogate to the LDA's likelihood. Ou…

2016-10-27abs ↗pdf ↗

Bayesian approaches have become increasingly popular in causal inference problems due to their conceptual simplicity, excellent performance and in-built uncertainty quantification ('posterior credible sets'). We investigate Bayesian inference for average treatment effects from observational data, which is a challenging…

2019-09-26abs ↗pdf ↗

This paper tackles structure learning in indirect observations of Gaussian and non-Gaussian random vectors.

problem Learning the graphical structure of random vectors indirectly observed through a sensing matrix and corrupted noise.
method Parametric and non-parametric approaches for Gaussian and non-Gaussian distributions, respectively.
result Correct graphical structure can be recovered under indefinite sensing systems with insufficient samples.

This chapter provides a self-contained introduction to the use of Bayesian inference to extract large-scale modular structures from network data, based on the stochastic blockmodel (SBM), as well as its degree-corrected and overlapping generalizations. We focus on nonparametric formulations that allow their inference i…

2017-05-29abs ↗pdf ↗