We relate two notions of local error for integration schemes on Riemannian homogeneous spaces, and show how to derive global error estimates from such local bounds. In doing so, we prove for the first time that the Lie-Butcher theory of Lie group integrators leads to global error estimates.
On-device research index
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
169,051 papers · 148 categories
Trend · papers per month
48 results for “global error bound”
Global optimization for low-dimensional switching linear regression and bounded-error estimationcs.LG
The paper provides global optimization algorithms for two particularly difficult nonconvex problems raised by hybrid system identification: switching linear regression and bounded-error estimation. While most works focus on local optimization heuristics without global optimality guarantees or with guarantees valid only…
Clustering stocks reduces estimation error in global minimum variance portfolio.
problem High estimation error in covariance matrix estimation.
method Bounded clustering to limit maximum cluster size.
result Reduction in out-of-sample volatility and gap between in-sample and out-of-sample volatility.
GRAF uses global partitioning to improve ensemble classifier performance.
problem Improving ensemble classifier performance.
method GRAF extends oblique decision trees to global partitioning.
result GRAF reduces generalization error and improves performance on benchmark datasets.
Framework verifies global correctness of neural networks for perception tasks.
problem Verifying robustness of neural networks is insufficient; global correctness needs to be ensured.
method Specified a state space and observation process to define the target input space. Tiled the spaces and compared ground truth and network output bounds to deliver error bounds.
result Framework can verify error bounds globally over the target input space and detect illegal inputs.
Develops a chain rule for ReLU networks and extends approximation theory to global error estimates.
problem Applying standard chain rule to ReLU networks and extending approximation results globally.
method Introduces a derivative for ReLU networks and converts bounded domain results to global estimates.
result Extends neural network approximation theory to include regularity properties for ReLU networks.
Adaptive method improves prediction intervals with global coverage guarantees and local error distribution.
problem Global coverage guarantees of conformal regression are often violated by local error distributions.
method Adaptive Conformal Regression with Jackknife+ Rescaled Scores
result Improves local coverage without sacrificing global coverage, especially in low-data regimes.
New method for multiclass classification reduces error bounds.
problem High-dimensional multiclass classification with sparse coefficients.
method Sparse multinomial logistic regression with convex penalties.
result Plug-in classifiers achieve minimax generalization error bounds.
Sharp bounds on ERM's minimal error in regression.
problem Understanding ERM's performance in regression tasks.
method Sharp lower bounds for ERM in random and fixed design settings.
result ERM's performance depends on the global or local complexity of the model.
Optimized AIS scheme reduces bias and MSE for general proposals.
problem Performing Monte Carlo integration with general proposals.
method Global optimization of χ²-divergence using stochastic gradient Langevin dynamics.
result Explicit theoretical guarantees for uniform-in-time MSE reduction.
Paper solves open problem of first-order algorithms for filtering-clustering models.
problem Understanding convergence property of first-order algorithms for filtering-clustering models.
method Identifies a global error bound condition and designs a generalized dual gradient ascent algorithm.
result Proposes optimal first-order algorithms in deterministic, finite-sum, and online settings.
The paper explores privacy-preserving methods for counting unique elements in distributed settings.
problem Counting unique elements in a distributed setting while maintaining privacy.
method Analyzes and proves lower bounds for differentially private protocols in various settings.
result Achieves optimal error bounds for multi-message shuffle protocols in estimating distinct elements.
New diffusions help globally optimize non-convex functions.
problem Optimizing non-convex functions globally.
method Euler discretization of Langevin diffusion.
result Different diffusions optimize different convex and non-convex functions.
Global Convergence and Generalization Bound of Gradient-Based Meta-Learning with Deep Neural Netscs.LG
GBML with deep nets converges globally and generalizes well.
problem Theoretical guarantees for few-shot learning with deep nets.
method Proving global convergence and generalization bounds for GBML with over-parameterized DNNs.
result GBML with over-parameterized DNNs converges globally to the optimum at a linear rate and achieves good generalization.
New framework analyzes deep learning optimization with finite width networks, revealing generalization gaps and excess risks.
problem Analyzing generalization error of deep learning with finite width networks.
method Formulating neural network training as transportation map estimation and analyzing via infinite dimensional Langevin dynamics.
result Achieves fast learning rate and minimax optimal rates for classification and regression problems.
Generalization Error Bounds of Gradient Descent for Learning Over-parameterized Deep ReLU Networkscs.LG
Gradient descent achieves good generalization for over-parameterized deep ReLU networks.
problem Understanding good generalization in over-parameterized deep neural networks.
method Algorithm-dependent generalization error bound for deep ReLU networks using gradient descent.
result Gradient descent with proper initialization can achieve arbitrarily small generalization error for over-parameterized DNNs.
We study distributed learning with the least squares regularization scheme in a reproducing kernel Hilbert space (RKHS). By a divide-and-conquer approach, the algorithm partitions a data set into disjoint data subsets, applies the least squares regularization scheme to each data subset to produce an output function, an…
Combining diffusion models with Langevin dynamics improves posterior sampling efficiency.
problem Sampling from noisy posterior distributions efficiently.
method Annealed Langevin dynamics combined with diffusion models.
result Achieves posterior sampling in polynomial time with a weaker score error bound.
The study analyzes how covariance estimation errors affect the global minimum-variance portfolio under heavy-tailed distributions.
problem The impact of covariance estimation errors on the global minimum-variance portfolio under heavy-tailed distributions.
method Characterization of covariance-estimation error's effect on GMVP suboptimality, derivation of regret identity and bound, application to heavy-tailed returns.
result The decision geometry of GMVP regret is invariant to a (p-1)-dimensional projection of the error matrix, with invariance to the covariance-scale direction as an exact special case.
Stochastic linear optimization never overfits with quadratically-bounded losses on general datacs.LG
New bounds show linear predictors rarely overfit with certain optimization methods.
problem Bounding test error for linear predictors with stochastic optimization methods.
method Coupling argument for fixed point methods like stochastic and batch mirror descent.
result Locally-adapted rates that depend on predictor properties, not global problem structure.
New sampling algorithms for complex distributions without log-concavity.
problem Efficient sampling from complex, high-dimensional distributions.
method Randomized splitting Langevin Monte Carlo (RSLMC) algorithm.
result Uniform-in-time error bounds for RSLMC and RLMC algorithms.
The paper analyzes error bounds and KL properties for noisy matrix recovery problems.
problem Noisy low-rank matrix recovery problems.
method Squared F-norm regularization, accelerated alternating minimization method.
result Established error bounds and KL properties for critical points and global minimizers.
We study streaming principal component analysis (PCA), that is to find, in space, the top eigenvectors of a hidden matrix with online vectors drawn from covariance matrix . We provide convergence for Oja's algorithm which is popularly used in practice but lacks t…
New methods bound estimation error in high-dimensional statistical problems.
problem Fundamental limits of first order methods in high-dimensional estimation.
method Introduces general first order methods for high-dimensional regression and low-rank matrix estimation.
result Derives optimal lower bounds on estimation error for these methods.
New bounds for transfer learning in linear models, improving generalization.
problem Understanding when auxiliary data helps in improving generalization in linear models.
method Derivation of exact error bounds and optimal task weights for linear regression and linear neural networks.
result First non-vacuous sufficient conditions for beneficial auxiliary learning in linear neural networks.
Based on a new coupling approach, we prove that the transition step of the Hamiltonian Monte Carlo algorithm is contractive w.r.t. a carefully designed Kantorovich (L1 Wasserstein) distance. The lower bound for the contraction rate is explicit. Global convexity of the potential is not required, and thus multimodal targ…
New algorithms learn stability certificates from data, avoiding complex dynamics.
problem Synthesizing stability certificates from complex dynamical systems.
method Developed algorithms to learn certificate functions from trajectory data, establishing generalization error bounds.
result Efficiently learned certificates can be used for adaptive control.
Study analyzes error in neural network solving PDEs, providing convergence and error bounds.
problem Error analysis of neural network solving PDEs.
method Three-layer tanh neural network with projected gradient descent (PGD).
result Comprehensive error analysis including approximation, generalization, and optimization errors.
Optimal Robust Estimation under Local and Global Corruptions: Stronger Adversary and Smaller Errorcs.DS
New algorithm optimizes robust estimation under mixed local and global corruptions.
problem Combining local and global corruptions in robust statistics.
method Information-theoretic approach using sliced-Wasserstein metric.
result Optimal error achieved in polynomial time for stronger local perturbations.
How PC-based Methods Err: Towards Better Reporting of Assumption Violations and Small Sample Errorsstat.ML
The study analyzes and mitigates errors in PC-based causal discovery methods.
problem Errors in PC-based causal discovery methods can lead to incorrect graphs.
method The study introduces coherency scores to detect assumption violations and small sample errors in PC-based methods.
result The coherency scores can detect errors that other methods cannot, bridging between global and local error detection.
This paper studies the problem of inferring a global preference based on the partial rankings provided by many users over different subsets of items according to the Plackett-Luce model. A question of particular interest is how to optimally assign items to users for ranking and how many item assignments are needed to a…
Accelerates convergence in global non-convex optimization with reversible diffusion.
problem Global non-convex optimization challenges.
method Utilizes reversible diffusion processes with adaptive diffusion coefficients.
result Accelerated convergence with reduced discretization error.
A new method for unsupervised domain adaptation using manifold learning.
problem Leveraging rich source domain information to target domain without labeled data.
method Discriminative Manifold Embedding and Alignment framework.
result Consistent transferability and discriminability achieved through manifold metric alignment.
VISTA learns causal structures by integrating local subgraphs, improving accuracy and efficiency.
problem Efficiently learning causal structures from high-dimensional observational data.
method VISTA decomposes the global causal structure learning problem into local subgraphs based on Markov Blankets, integrating them via a weighted voting mechanism.
result VISTA achieves notable improvements in accuracy and efficiency over existing methods.
More frequent model updates in FL increase generalization error.
problem Negative impact of frequent communication on FL model generalization.
method Analyzed the effect of the number of rounds of model aggregation on generalization error.
result Generalization error increases with more frequent model updates.
Study of regularized least squares in RKKS with indefinite kernels.
problem Asymptotic properties of regularized least squares with indefinite kernels in RKKS.
method Introducing a bounded hyper-sphere constraint, theoretical demonstration of globally optimal solution, modified error decomposition techniques, matrix perturbation theory.
result Derivation of learning rates in RKKS, same as RKHS under certain conditions.
Kinetic Langevin MCMC Sampling Without Gradient Lipschitz Continuity -- the Strongly Convex Casemath.PR
New algorithms sample from log concave distributions without gradient Lipschitz continuity.
problem Sampling from log concave distributions without gradient Lipschitz continuity.
method Two algorithms based on monotone polygonal (tamed) Euler schemes.
result Non-asymptotic 2-Wasserstein distance bounds between the process and target measure.
This paper studies how label noise affects Federated Learning.
problem The impact of label noise on Federated Learning.
method The paper derives an upper bound for the generalization error and conducts experiments on MNIST and CIFAR-10 datasets.
result The global model accuracy decreases linearly with increasing label noise, consistent with theoretical analysis.
Paper addresses group synchronization with incomplete measurements and proves linear convergence of GPM.
problem Orthogonal group synchronization with incomplete measurements and additive noise.
method Generalized power method (GPM) with local error bound analysis.
result Linear convergence of GPM to a global maximizer under general additive noise model.
Active learning method improves local model validity estimation.
problem Ensuring local model validity in machine learning applications.
method Learning model error to estimate local validity using active learning.
result The proposed method can estimate local validity with a small amount of data.
The problem of estimation error of Expected Shortfall is analyzed, with a view of its introduction as a global regulatory risk measure.
New findings show score matching's accuracy doesn't ensure numerical stability in diffusion sampling.
problem Numerical stability issues in diffusion sampling despite small forward-marginal error.
method Constructing a smooth score field with arbitrarily small forward-marginal error, showing nonexplosive behavior and moments of every order.
result Euler--Maruyama discretizations can converge in probability even when moments diverge, demonstrating failure of weak convergence.
New method improves solving combinatorial optimization problems with smoothed policies.
problem Solving combinatorial optimization problems repeatedly with varying instances.
method Smoothed policies with controlled random perturbations to linear oracle, leading to differentiable surrogate risk.
result Generalization bound decomposes excess risk into bias, estimation, and optimization components.
Analytic networks with bounded coefficients can't outperform polynomial approximations.
problem Approximation limits of neural networks with analytic activation functions under coefficient constraints.
method Deterministic analysis using comparison argument and Bernstein-type estimates.
result Networks with analytic activation functions and controlled coefficients cannot outperform classical polynomial approximation rates on non-analytic targets.
We study the error landscape of deep linear and nonlinear neural networks with the squared error loss. Minimizing the loss of a deep linear neural network is a nonconvex problem, and despite recent progress, our understanding of this loss surface is still incomplete. For deep linear networks, we present necessary and s…
Many optimization algorithms converge to stationary points. When the underlying problem is nonconvex, they may get trapped at local minimizers and occasionally stagnate near saddle points. We propose the Run-and-Inspect Method, which adds an "inspect" phase to existing algorithms that helps escape from non-global stati…
Develops a computationally tractable high-dimensional differential privacy estimator.
problem Differential privacy in high dimensions is computationally intractable.
method Combines high-dimensional robust statistics with differential privacy techniques.
result A computationally tractable algorithm with dimension-independent privacy loss.
JSRT improves regression tree performance by incorporating global node information.
problem Regression tree performance relies on local node means, ignoring global node information.
method Proposes JSRT by integrating global mean information from different nodes.
result Demonstrates superior performance and efficiency compared to other regression tree methods.