Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,695 papers · 148 categories

Trend · papers per month

182364546728 · Jun 202019922001200920172026
48 results for normal mean estimation

Unified framework for shrinkage, thresholding, and regularization in normal mean estimation and linear regression.

problem Estimation of normal mean in multivariate settings with correlated observations.
method Approximate risk minimization over a functional class of shrinkage-thresholding rules.
result Unified estimator NOMAD for shrinkage, thresholding, and regularization.

We provide an efficient algorithm for the classical problem, going back to Galton, Pearson, and Fisher, of estimating, with arbitrary accuracy the parameters of a multivariate normal distribution from truncated samples. Truncated samples from a dd-variate normal N(μ,Σ){\cal N}(\mathbfμ,\mathbfΣ) means a samples is only re…

2018-09-11abs ↗pdf ↗

The Normal Means problem plays a fundamental role in many areas of modern high-dimensional statistics, both in theory and practice. And the Empirical Bayes (EB) approach to solving this problem has been shown to be highly effective, again both in theory and practice. However, almost all EB treatments of the Normal Mean…

2018-12-18abs ↗pdf ↗

We solve the mean parametrization of von Mises-Fisher distribution.

problem No closed-form normalization function for mean parameters exists.
method Derived a second-order ODE for mean normalizer and provided approximations.
result Rapid evaluation of densities and natural parameters in terms of mean parameters.

Proposes a new framework for deep learning conditional mean estimation with confidence regions.

problem Lack of asymptotic properties in deep nonparametric regression models.
method Transforms deep estimation into conditional diffusion model for conditional mean estimation.
result Developed end-to-end convergence rate and asymptotic normality for conditional diffusion model.

Study improves BN TTA under distribution shift using higher-order asymptotics.

problem Improving BN TTA for changing data distributions.
method Integrates Edgeworth expansion and saddlepoint approximation with one-step M-estimation.
result Derives optimal weighting parameter for minimized mean-squared error.

New method constructs synthetic treatment groups without mean exchangeability assumption.

problem Violations of mean exchangeability assumption in randomized controlled trials.
method Weighted mixture of treatment groups from source populations, minimizing conditional maximum mean discrepancy.
result Asymptotic normality of synthetic treatment group estimator established.

Stochastic Volatility in Mean models with heavy-tailed distributions using Hidden Markov Models

problem Accurate inference for Stochastic Volatility in Mean models with heavy-tailed distributions
method Numerically stable estimation procedure and parallel computing
result Significant reduction in computational times

Paper improves statistical efficiency of median-of-means estimator for Byzantine robust distributed inference.

problem Byzantine robustness in distributed learning systems.
method Variance reduced median-of-means (VRMOM) estimator for Byzantine robust distributed inference.
result Achieves a fast convergence rate with only a constant number of rounds of communications.

While the authors of Batch Normalization (BN) identify and address an important problem involved in training deep networks-- \textit{Internal Covariate Shift}-- the current solution has certain drawbacks. For instance, BN depends on batch statistics for layerwise input normalization during training which makes the esti…

2015-05-21abs ↗pdf ↗

The paper uses deep neural networks to estimate and infer ATE without needing to know the dimension of the data.

problem Estimating and inferring the average treatment effect (ATE) in complex data settings.
method The paper uses deep neural networks to estimate the mean regression function and then calculates the ATE. It establishes consistency and asymptotic normality of the estimators.
result The deep neural network estimates of ATE are consistent and asymptotically normal, providing dimension-free rates.

Proposes a new method to estimate Bayesian neural network depth.

problem Estimating the depth of Bayesian neural networks.
method Uses a discrete truncated normal distribution to learn depth mean and variance, inferring posterior distributions by minimizing variational free energy.
result Improves test accuracy and reduces posterior depth variance on the spiral dataset.

CPME embeds counterfactual outcomes in RKHS for flexible policy evaluation.

problem Estimating counterfactual policy outcomes for decision-making.
method Counterfactual Policy Mean Embedding (CPME) framework in RKHS, plug-in and doubly robust estimators, kernel test statistic.
result Doubly robust estimator improves convergence rates and asymptotic normality.

We provide a unified treatment of a broad class of noisy structure recovery problems, known as structured normal means problems. In this setting, the goal is to identify, from a finite collection of Gaussian distributions with different means, the distribution that produced some observed data. Recent work has studied s…

2015-06-25abs ↗pdf ↗

Although consistency is a minimum requirement of any estimator, little is known about consistency of the mean partition approach in consensus clustering. This contribution studies the asymptotic behavior of mean partitions. We show that under normal assumptions, the mean partition approach is consistent and asymptotic …

2015-12-18abs ↗pdf ↗

Paper shows robust estimators converge to true risk minimizers at optimal rates.

problem Understanding asymptotic properties of robust risk minimizers.
method Investigates robust analogues of empirical risk minimization, focusing on median of means estimator.
result Robust minimizers converge to true minimizers at optimal rates and have similar asymptotic variance.

In this overview report we generalize Erhard Heinz' curvature estimate for minimal graphs in R^3 to graphs in R^n of prescribed mean curvature. Secondly, we analyse these problems in the frame of the outer differential geometry which leads us to the notions of normal torsion and normal curvature for immersions in R^4.

2005-10-24abs ↗pdf ↗

New analysis of annealing paths in sampling and estimation.

problem Sampling from complex distributions and estimating normalization constants.
method Extending known results on Bregman divergence to quasi-arithmetic means under monotonic embedding.
result Analogous result for quasi-arithmetic means, highlighting the interplay between means, parametric families, and divergence functionals.

The paper analyzes the risk of CV-tuned regularized estimators and connects it to SURE.

problem Understanding the risk of CV-tuned regularized estimators.
method Derives asymptotic risk function of CV-tuned estimators and connects it to SURE.
result The risk function provides a more detailed picture of predictive performance than uniform bounds.

We propose an empirical Bayes estimator based on Dirichlet process mixture model for estimating the sparse normalized mean difference, which could be directly applied to the high dimensional linear classification. In theory, we build a bridge to connect the estimation error of the mean difference and the misclassificat…

2017-02-16abs ↗pdf ↗

The study compares parametric and nonparametric models for estimating mean-variance mixtures and finds that nonparametric models perform better.

problem Estimating the distribution of a normal mean-variance mixture under uncertainty.
method Comparison of six parametric mixing laws with a grid nonparametric maximum likelihood estimator, using a paired block bootstrap for score comparison.
result Nonparametric models outperform parametric models in estimating the distribution of a normal mean-variance mixture.

New algorithms reduce communication for sparse mean estimation in noisy distributed systems.

problem Sparse normal means estimation with limited communication in a distributed setting.
method Two distributed algorithms for estimating a sparse mean vector with sublinear communication.
result Correct support of the sparse mean can be recovered with significantly less communication than previously required.

New research shows shrinkage methods re-scale portfolio efficient frontiers under distributional misspecification.

problem Poor performance of mean-variance portfolio decisions under distributional assumptions.
method Investigation of shrinkage methods under different distributional assumptions (auto-correlation, skewness, excess kurtosis).
result Shrinkage methods re-scale the sample efficient frontier, implying standard comparison methods are flawed.

The paper analyzes kk-means clustering for missing data, proving statistical guarantees under MCAR.

problem Statistical guarantees for kk-means clustering with missing data, especially under Missing Completely at Random (MCAR).
method Established n\sqrt{n}-excess risk bound and consistency of cluster centers under general missing mechanisms; derived n\sqrt{n}-convergence rate and asymptotic normality for MCAR.
result Achieving n\sqrt{n}-rate and converging to true cluster centers requires distinct true cluster centers in every dimension under MCAR.

Utilizing a weight matrix we study surfaces of prescribed weighted mean curvature which yield a natural generalisation to critical points of anisotropic surface energies. We first derive a differential equation for the normal of immersions with prescribed weighted mean curvature, generalising a result of Clarenz and vo…

2007-11-15abs ↗pdf ↗

New insights into empirical Bayes and compound decision problems with improved regret bounds.

problem Estimating means of normally or Poisson distributed vectors under squared loss.
method Combines Bayesian and frequentist approaches using data-driven estimators.
result Optimal regret bounds for Poisson and normal mean models, resolving conjectures.

Proves a special type of submanifolds in a curved space.

problem Characterizing submanifolds with specific properties in a curved space.
method Uses the properties of flat normal bundle and parallel mean curvature to prove the submanifolds are warped products.
result Einstein submanifolds with flat normal bundle and parallel mean curvature are warped product of isometric immersions.

Improved estimation of higher order integrals using shrinkage techniques.

problem Estimating higher order Bochner integrals in non-parametric settings.
method Shrinkage of U-statistic towards a target element, considering kernel degeneracy.
result Consistent shrinkage estimators with fast rates of convergence, even for non-degenerate kernels.

New framework reduces private mean estimation error with optimal efficiency.

problem Locally private mean estimation of high-dimensional vectors.
method ProjUnit framework: random projections, normalization, and optimal algorithm execution in lower dimensions.
result Optimal error up to a 1+o(1)-factor with computational efficiency and low communication complexity.

We prove mean curvature and volume comparison estimates on smooth metric measure spaces when their integral Bakry-Émery Ricci tensor bounds, extending Wei-Wylie's comparison results to the integral case. We also apply comparison results to get diameter estimates, eigenvalue estimates and volume growth estimates on smoo…

2016-10-13abs ↗pdf ↗

Layer normalization (LayerNorm) has been successfully applied to various deep neural networks to help stabilize training and boost model convergence because of its capability in handling re-centering and re-scaling of both inputs and weight matrix. However, the computational overhead introduced by LayerNorm makes these…

2019-10-16abs ↗pdf ↗