We relate two notions of local error for integration schemes on Riemannian homogeneous spaces, and show how to derive global error estimates from such local bounds. In doing so, we prove for the first time that the Lie-Butcher theory of Lie group integrators leads to global error estimates.
On-device research index
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
168,932 papers · 148 categories
Trend · papers per month
48 results for “global error estimates”
Analyzes error sources in global feature effect estimation methods.
problem Unexplored error sources in global feature effect estimation methods.
method Systematic, estimator-level analysis of bias and variance.
result Holdout data is theoretically cleanest, but estimation variance depends on sample size and model characteristics.
The problem of estimation error of Expected Shortfall is analyzed, with a view of its introduction as a global regulatory risk measure.
Develops a chain rule for ReLU networks and extends approximation theory to global error estimates.
problem Applying standard chain rule to ReLU networks and extending approximation results globally.
method Introduces a derivative for ReLU networks and converts bounded domain results to global estimates.
result Extends neural network approximation theory to include regularity properties for ReLU networks.
Clustering stocks reduces estimation error in global minimum variance portfolio.
problem High estimation error in covariance matrix estimation.
method Bounded clustering to limit maximum cluster size.
result Reduction in out-of-sample volatility and gap between in-sample and out-of-sample volatility.
Global optimization for low-dimensional switching linear regression and bounded-error estimationcs.LG
The paper provides global optimization algorithms for two particularly difficult nonconvex problems raised by hybrid system identification: switching linear regression and bounded-error estimation. While most works focus on local optimization heuristics without global optimality guarantees or with guarantees valid only…
The study analyzes how covariance estimation errors affect the global minimum-variance portfolio under heavy-tailed distributions.
problem The impact of covariance estimation errors on the global minimum-variance portfolio under heavy-tailed distributions.
method Characterization of covariance-estimation error's effect on GMVP suboptimality, derivation of regret identity and bound, application to heavy-tailed returns.
result The decision geometry of GMVP regret is invariant to a (p-1)-dimensional projection of the error matrix, with invariance to the covariance-scale direction as an exact special case.
This letter presents an improved version of diffusion least mean ppower (LMP) algorithm for distributed estimation. Instead of sum of mean square errors, a weighted sum of mean square error is defined as the cost function for global and local cost functions of a network of sensors. The weight coefficients are updated b…
JSRT improves regression tree performance by incorporating global node information.
problem Regression tree performance relies on local node means, ignoring global node information.
method Proposes JSRT by integrating global mean information from different nodes.
result Demonstrates superior performance and efficiency compared to other regression tree methods.
We show that if is a convex class of functions that is -subgaussian, the error rate of learning problems generated by independent noise is equivalent to a fixed point determined by `local' covering estimates of the class, rather than by the gaussian averages. To that end, we establish new sharp upper and lower e…
GIV methodology extends instrumental variable estimation for high-dimensional data.
problem Estimating structural parameters in high-dimensional models with endogeneity and latent factors.
method Extends GIV methodology to large N and T, treats factors and loadings as unknown, and uses additional instruments for efficiency.
result Efficiency gains and negligible sampling errors in estimated instrument and factors.
Estimating Covariance for Global Minimum Variance Portfolio: A Decision-Focused Learning Approachq-fin.PM
Paper uses DFL to optimize portfolio risk and outperforms conventional methods.
problem Optimizing portfolio risk and return under uncertainty.
method Decision-focused learning (DFL) to derive global minimum variance portfolio (GMVP).
result DFL-based methods consistently deliver superior decision performance in portfolio optimization.
Adaptive method improves prediction intervals with global coverage guarantees and local error distribution.
problem Global coverage guarantees of conformal regression are often violated by local error distributions.
method Adaptive Conformal Regression with Jackknife+ Rescaled Scores
result Improves local coverage without sacrificing global coverage, especially in low-data regimes.
Neural networks can approximate complex stochastic equations well.
problem Approximating general stochastic differential equations.
method Identified neural network classes approximating continuous functions.
result Neural stochastic differential equations can approximate general stochastic differential equations arbitrarily well.
Optimal Robust Estimation under Local and Global Corruptions: Stronger Adversary and Smaller Errorcs.DS
New algorithm optimizes robust estimation under mixed local and global corruptions.
problem Combining local and global corruptions in robust statistics.
method Information-theoretic approach using sliced-Wasserstein metric.
result Optimal error achieved in polynomial time for stronger local perturbations.
Calibrated probabilistic solvers improve accuracy of ODE estimates.
problem Uncertainty in probabilistic ODE solutions is not well-calibrated for adaptive step sizes.
method Introduce and assess several calibration methods for probabilistic ODE solvers.
result Calibration methods interact efficiently with adaptive step-size selection, improving posteriors.
Develops a computationally tractable high-dimensional differential privacy estimator.
problem Differential privacy in high dimensions is computationally intractable.
method Combines high-dimensional robust statistics with differential privacy techniques.
result A computationally tractable algorithm with dimension-independent privacy loss.
The paper reduces estimation error in predicting borrower repayment by accounting for lender's credit decisions.
problem Estimation error in predicting borrower repayment due to confounding effects.
method Proposes new estimators to reduce estimation error, combining theoretical analysis and numerical testing.
result The proposed estimators are unbiased, consistent, and robust, showing substantial reduction in estimation error.
Learning a Class of Mixed Linear Regressions: Global Convergence under General Data Conditionsstat.ML
Paper addresses global convergence of MLR estimation under weak data conditions.
problem Learning mixed linear regression models with general data conditions.
method Two-step recursive identification algorithm using least squares and EM principles.
result Global convergence and optimal clustering performance established under general data conditions.
We prove Gronwall-type estimates for the distance of integral curves of smooth vector fields on a Riemannian manifold. Such estimates are of central importance for all methods of solving ODEs in a verified way, i.e., with full control of roundoff errors. Our results may therefore be seen as a prerequisite for the gener…
Regularization of minimization for dealing with outliers and noise in Statistics and Signal Recoverymath.OC
We study the robustness properties of norm minimization for the classical linear regression problem with a given design matrix and contamination restricted to the dependent variable. We perform a fine error analysis of the estimator for measurements errors consisting of outliers coupled with noise. We…
Density ratio estimation is a vital tool in both machine learning and statistical community. However, due to the unbounded nature of density ratio, the estimation procedure can be vulnerable to corrupted data points, which often pushes the estimated ratio toward infinity. In this paper, we present a robust estimator wh…
Robust estimation methods find global minima efficiently via quasi-gradients.
problem Efficiently solving robust estimation problems with non-convex optimization.
method Identifying generalized quasi-gradients to guarantee low-regret algorithms.
result Generalized quasi-gradients ensure efficient approximation of global minima.
New methods bound estimation error in high-dimensional statistical problems.
problem Fundamental limits of first order methods in high-dimensional estimation.
method Introduces general first order methods for high-dimensional regression and low-rank matrix estimation.
result Derives optimal lower bounds on estimation error for these methods.
Active learning method improves local model validity estimation.
problem Ensuring local model validity in machine learning applications.
method Learning model error to estimate local validity using active learning.
result The proposed method can estimate local validity with a small amount of data.
Improved manifold-adaptive dimension estimator for better data complexity assessment.
problem Estimating intrinsic dimensionality of complex data.
method Revised and improved Farahmand-Szepesvári-Audibert (FSA) estimator, incorporating probability density function and median.
result Median-FSA estimator outperforms existing methods in accuracy and robustness.
New framework analyzes deep learning optimization with finite width networks, revealing generalization gaps and excess risks.
problem Analyzing generalization error of deep learning with finite width networks.
method Formulating neural network training as transportation map estimation and analyzing via infinite dimensional Langevin dynamics.
result Achieves fast learning rate and minimax optimal rates for classification and regression problems.
Novel Fréchet regression method handles errors-in-variables with low-rank covariates.
problem Regression with noisy and limited covariate data.
method Combines global Fréchet regression and principal component regression for low-rank structure.
result Improved efficiency and accuracy in high-dimensional and noisy data settings.
A new method assesses regression models' global optimality.
problem Challenges in evaluating regression models without access to true data.
method Information Teacher framework based on Shannon mutual information.
result Demonstrates capability to detect global optimality.
How PC-based Methods Err: Towards Better Reporting of Assumption Violations and Small Sample Errorsstat.ML
The study analyzes and mitigates errors in PC-based causal discovery methods.
problem Errors in PC-based causal discovery methods can lead to incorrect graphs.
method The study introduces coherency scores to detect assumption violations and small sample errors in PC-based methods.
result The coherency scores can detect errors that other methods cannot, bridging between global and local error detection.
Accelerates convergence in global non-convex optimization with reversible diffusion.
problem Global non-convex optimization challenges.
method Utilizes reversible diffusion processes with adaptive diffusion coefficients.
result Accelerated convergence with reduced discretization error.
Estimating global pairwise interaction effects, i.e., the difference between the joint effect and the sum of marginal effects of two input features, with uncertainty properly quantified, is centrally important in science applications. We propose a non-parametric probabilistic method for detecting interaction effects of…
Rank aggregation systems collect ordinal preferences from individuals to produce a global ranking that represents the social preference. Rank-breaking is a common practice to reduce the computational complexity of learning the global ranking. The individual preferences are broken into pairwise comparisons and applied t…
Communication-Constrained Distributed Quantile Regression with Optimal Statistical Guaranteesstat.ME
Optimal inference in distributed quantile regression without stringent scaling conditions.
problem Challenges in achieving optimal inference in distributed quantile regression due to the non-smooth nature of the QR loss function.
method Double-smoothing approach applied to local and global objective functions, with a trade-off between communication cost and statistical error.
result Established a finite-sample theoretical framework for distributed QR estimators, showing a trade-off between communication cost and statistical error.
A method improves Cryo-EM 3D map refinement by regularizing rotation estimation.
problem Noise-robustness vs. data-consistency in Cryo-EM 3D map reconstruction.
method Ellipsoidal support lifting (ESL) for regularizing and approximating the global minimizer over Riemannian manifolds.
result The induced bias due to regularizing effect of ESL estimates better rotations than global optimisation.
A new distance metric derived from information theory and estimation theory.
problem Developing a robust distance metric for complex signal distributions.
method Information-Estimation Metric (IEM) derived from continuous probability density and denoising errors.
result The IEM is a valid global distance metric that adapts to the geometry of complex distributions.
The paper explores privacy-preserving methods for counting unique elements in distributed settings.
problem Counting unique elements in a distributed setting while maintaining privacy.
method Analyzes and proves lower bounds for differentially private protocols in various settings.
result Achieves optimal error bounds for multi-message shuffle protocols in estimating distinct elements.
GRAF uses global partitioning to improve ensemble classifier performance.
problem Improving ensemble classifier performance.
method GRAF extends oblique decision trees to global partitioning.
result GRAF reduces generalization error and improves performance on benchmark datasets.
Data-driven optimization improves mean-variance portfolios by penalizing norms.
problem Estimation error in mean-variance optimization.
method Augment MVO with norm penalties, use neural networks for optimization, and compute derivatives implicitly.
result Data-driven optimization reduces portfolio risk compared to standard MVO.
We propose SEARNN, a novel training algorithm for recurrent neural networks (RNNs) inspired by the "learning to search" (L2S) approach to structured prediction. RNNs have been widely successful in structured prediction applications such as machine translation or parsing, and are commonly trained using maximum likelihoo…
We study distributed learning with the least squares regularization scheme in a reproducing kernel Hilbert space (RKHS). By a divide-and-conquer approach, the algorithm partitions a data set into disjoint data subsets, applies the least squares regularization scheme to each data subset to produce an output function, an…
We study the error landscape of deep linear and nonlinear neural networks with the squared error loss. Minimizing the loss of a deep linear neural network is a nonconvex problem, and despite recent progress, our understanding of this loss surface is still incomplete. For deep linear networks, we present necessary and s…
This work analyzes policy gradient methods in reinforcement learning, providing convergence and approximation guarantees.
problem Theoretical convergence and approximation error of policy gradient methods in reinforcement learning.
method Analysis of policy gradient methods in discounted MDPs, focusing on tabular and parametric policy classes.
result Provably characterizations of computational, approximation, and sample size properties of policy gradient methods.
Obtaining accurate and well calibrated probability estimates from classifiers is useful in many applications, for example, when minimising the expected cost of classifications. Existing methods of calibrating probability estimates are applied globally, ignoring the potential for improvements by applying a more fine-gra…
Estimates growth loss in fund models and proposes a shrinkage method.
problem Estimating growth loss in fund models under frequentist and Bayesian estimation.
method Proposes a shrinkage method to target maximal growth with minimal deviation.
result Empirical evidence shows shrinkage gives a stable estimate closer to growth potential.
Auto-regressive models learn latent states from partially observed linear dynamical systems.
problem Understanding how auto-regressive models learn latent representations from partially observed linear dynamical systems.
method Empirical risk minimization on partially observed linear dynamical systems.
result Two-layer linear auto-regressive models learn to approximate Kalman filtering, coinciding with optimal state estimates.
New framework optimizes complex systems decisions via simulation.
problem Optimizing strategic, tactical, and operational decisions in complex systems.
method Global-local metamodel assisted two-stage optimization via simulation.
result Framework efficiently searches for optimal decisions with unknown objective.
The paper provides results regarding the computational complexity of hybrid system identification. More precisely, we focus on the estimation of piecewise affine (PWA) maps from input-output data and analyze the complexity of computing a global minimizer of the error. Previous work showed that a global solution could b…