Lie group integrators improve global error estimates.
problem Global error estimates for Lie group integrators.
method Relate local error to global error, derive from bounds.
result Lie-Butcher theory proves global error estimates for Lie group integrators.
New locally private algorithm for k-means clustering reduces additive error significantly.
problem Designing a locally private algorithm for k-means clustering with reduced additive error.
method Local differential privacy approach, reducing additive error to nearly n1/2. result Achieves O(1) multiplicative error and n1/2+a additive error, nearly optimal. Study analyzes error in ReLU networks with local connections.
problem Improving neural network performance and understanding approximation errors.
method Analyzed approximation error of ReLU networks with local connections.
result Error estimate depends on depth and width of hidden layers.
New method trains neural networks with local error signals, outperforming global methods.
problem Training neural networks with global error signals.
method Layer-wise training with local error signals.
result Layer-wise training with local error signals can approach state-of-the-art performance.
Proposes a new learning mechanism for deep networks using local errors.
problem Learning using delayed and non-local errors is hard for biological neural networks.
method Generates local errors in each layer using fixed, random auxiliary classifiers.
result Approaches standard backpropagation performance on MNIST, CIFAR10, and SVHN datasets.
Active learning method improves local model validity estimation.
problem Ensuring local model validity in machine learning applications.
method Learning model error to estimate local validity using active learning.
result The proposed method can estimate local validity with a small amount of data.
Study proposes local effective dimension to measure model capacity and generalization error.
problem Capturing the generalization power of machine learning models.
method Proposes local effective dimension as a capacity measure.
result Local effective dimension bounds the generalization error and correlates well with it.
Localized inference for large graphs with error bounds.
problem Efficiently answering queries in large graphical models.
method Localized algorithm with error bounds based on Dobrushin's theorem.
result Localized inference provides fast and accurate approximations for large models.
New techniques improve distributed training with compressed gradients.
problem Gradient mismatch problem in local error feedback.
method Step-ahead error feedback and error averaging techniques.
result Our methods handle gradient mismatch and train faster than full-precision training.
New estimator adapts to various error distributions.
problem Adapting to different error distributions in nonparametric regression.
method Introduces outrigger local polynomial estimator with modified weighted least squares.
result Minimax optimal over Hölder classes with multiplicative factor.
New analysis shows Local SGD can achieve error scaling with only fixed number of communications.
problem Speeding up SGD by parallelizing across multiple workers with reduced communication overhead.
method Proposed and analyzed Local SGD method with a fixed number of communications independent of the number of steps.
result Achieves an error scaling as 1/(nT) with only a fixed number of communications (Ω(n)).
Hamiltonian Monte Carlo on ReLU networks is inefficient due to large local error.
problem Inefficiency of Hamiltonian Monte Carlo on ReLU neural networks.
method Analysis of Hamiltonian Monte Carlo with leapfrog integrator for Bayesian neural network inference.
result Leapfrog HMC for ReLU networks has a large local error rate of Ω(ε), leading to inefficiency. Improved GPS accuracy in urban areas.
problem Urban GPS inaccuracies due to environmental factors.
method Probabilistic model to learn and compensate for environmental biases.
result Localization error less than 10 meters in LTE networks.
Reduces sound event localization error by 2.6x with hybrid parametric-deep learning.
problem Sound event localization and detection accuracy.
method Hybrid approach combining parametric spatial audio analysis and deep learning.
result Reduction of localization error by 2.6x compared to baseline.
New proof shows how to identify DAGs with weakly increasing errors.
problem Identifying the true DAG in models with weakly increasing error variances.
method Minimum-trace DAG method and hill climbing algorithm with R2R neighborhood.
result Hill climbing algorithm without strict local optima under weakly increasing error variances.
Localized sum-of-norms clustering separates balls in data.
problem Clustering arbitrarily close data points in multivariate data.
method Localized sum-of-norms optimization for clustering.
result Proves a bound on clustering error in stochastic ball model.
A framework assesses the trustworthiness of probabilistic classifiers using local calibration error.
problem Assessing the trustworthiness of probabilistic classifiers beyond traditional metrics.
method I-trustworthy framework linking local calibration to trustworthiness; Kernel Local Calibration Error (KLCE) method for hypothesis testing.
result The effectiveness of the proposed test statistic demonstrated through simulated and real-world datasets.
New method improves Euler approximation for local stochastic volatility models.
problem Well-posedness of Euler approximation for local stochastic volatility models.
method Start with a well-defined Euler approximation to the formal McKean-Vlasov equation, followed by a half-step scheme.
result Showed weak order one for the Euler discretization, plus error terms.
CSER improves SGD efficiency by resetting errors and partial synchronization.
problem Limited scalability of Distributed Stochastic Gradient Descent (SGD) due to communication bottlenecks.
method Introduces 'error reset' technique and partial synchronization for gradients and models.
result Proves convergence for smooth non-convex problems and accelerates distributed training significantly.
Adaptive method improves prediction intervals with global coverage guarantees and local error distribution.
problem Global coverage guarantees of conformal regression are often violated by local error distributions.
method Adaptive Conformal Regression with Jackknife+ Rescaled Scores
result Improves local coverage without sacrificing global coverage, especially in low-data regimes.
RFA-LCF improves clustering accuracy by robustly handling noise and errors.
problem Inaccurate representation and clustering results due to noise and hard constraints.
method Integrates robust flexible CF, sparse local-coordinate coding, and adaptive weighting into a unified model.
result Delivers state-of-the-art clustering results on public databases.
We introduce the speculate-correct method to derive error bounds for local classifiers. Using it, we show that k nearest neighbor classifiers, in spite of their famously fractured decision boundaries, have exponential error bounds with O(sqrt((k + ln n) / n)) error bound range for n in-sample examples.
The study analyzes and mitigates errors in PC-based causal discovery methods.
problem Errors in PC-based causal discovery methods can lead to incorrect graphs.
method The study introduces coherency scores to detect assumption violations and small sample errors in PC-based methods.
result The coherency scores can detect errors that other methods cannot, bridging between global and local error detection.
Study problem-dependent rates in statistical learning theory, achieving optimal generalization error bounds.
problem Generalization error in statistical learning theory.
method Uniform localized convergence framework.
result Optimal generalization error bounds for various learning problems.
We show that if F is a convex class of functions that is L-subgaussian, the error rate of learning problems generated by independent noise is equivalent to a fixed point determined by `local' covering estimates of the class, rather than by the gaussian averages. To that end, we establish new sharp upper and lower e…
Sparse elasticity reconstruction from local displacements reduces error.
problem Reconstructing elasticity from limited data.
method Sparse elasticity reconstruction theory, local clustering, alternating optimization.
result Higher spatial resolution elasticity distribution estimation.
New method controls error in low-dimensional marginals of spatial models.
problem Inaccurate approximation of low-dimensional marginals in spatial models.
method Stein's method with δ-locality condition for spatial models.
result Uniform error bound for marginals of approximate distributions.
Efficiently learns a single neuron with adversarial noise, improving on prior work.
problem Learning a single neuron with adversarial label noise.
method Efficient algorithm using local error bounds from optimization theory.
result Approximates optimal L22-error within a constant factor. New algorithm optimizes robust estimation under mixed local and global corruptions.
problem Combining local and global corruptions in robust statistics.
method Information-theoretic approach using sliced-Wasserstein metric.
result Optimal error achieved in polynomial time for stronger local perturbations.
This letter presents an improved version of diffusion least mean ppower (LMP) algorithm for distributed estimation. Instead of sum of mean square errors, a weighted sum of mean square error is defined as the cost function for global and local cost functions of a network of sensors. The weight coefficients are updated b…
Localized diffusion models reduce training complexity by exploiting low-dimensional structure.
problem Training diffusion models is computationally expensive due to the curse of dimensionality.
method Localized neural networks and localized score matching loss to estimate low-dimensional score functions.
result Localized diffusion models can circumvent the curse of dimensionality with reduced sample complexity.
New quantum codes improve error correction with local tests.
problem Improving quantum error correction efficiency.
method Introducing hemicubic codes and exploiting their local testability.
result Quantum codes with improved local testability and error correction.
New framework reduces private mean estimation error with optimal efficiency.
problem Locally private mean estimation of high-dimensional vectors.
method ProjUnit framework: random projections, normalization, and optimal algorithm execution in lower dimensions.
result Optimal error up to a 1+o(1)-factor with computational efficiency and low communication complexity.
Quantized Decentralized Gradient Descent (QDGD) solves distributed optimization with quantized communications.
problem Minimizing the sum of smooth and strongly convex functions over a network of distributed agents with quantized communications.
method Proposes QDGD algorithm combining quantized and local information for decentralized gradient descent.
result Achieves vanishing mean solution error under strong convexity and smoothness assumptions.
RQMC improves QMC by providing practical error bounds for financial applications.
problem Lack of practical error estimates in QMC methods.
method Combines Sobol LDS with randomized scrambling methods.
result RQMC outperforms standard QMC in convergence rates and provides error bounds.
Neural networks for binary classification have zero training error at all local minima under certain conditions.
problem Understanding the loss surface of neural networks for binary classification.
method Analyzing single-layered neural networks with smooth hinge loss function, providing conditions for zero training error at all local minima.
result Zero training error at all local minima is achieved under specific conditions (strict convexity of neurons and smooth hinge loss).
Paper introduces a new network learning method with local propagation.
problem Learning in complex, multi-path networks with multiple goals.
method Locally decoupled network parameter learning with local propagation.
result Advantages in learning time and network size compared to state-of-the-art methods.
AdaComm optimizes SGD by dynamically adjusting communication frequency for faster convergence.
problem Achieving optimal error-runtime trade-off in distributed SGD.
method Adaptive communication strategy that starts with infrequent averaging to save delay and improve speed, then increases frequency.
result AdaComm reduces training time by 3x while maintaining the same final loss.
New findings show privacy affects generalization error in a non-monotonic way.
problem Privacy and robustness in distributed learning.
method Theoretical analysis and matching lower/upper bounds on algorithmic stability.
result Generalization error is non-monotonically affected by privacy, depending on noise level.
We use smoothed analysis techniques to provide guarantees on the training loss of Multilayer Neural Networks (MNNs) at differentiable local minima. Specifically, we examine MNNs with piecewise linear activation functions, quadratic loss and a single output, under mild over-parametrization. We prove that for a MNN with …
A reliable, accurate, and affordable positioning service is highly required in wireless networks. In this paper, the novel Message Passing Hybrid Localization (MPHL) algorithm is proposed to solve the problem of cooperative distributed localization using distance and direction estimates. This hybrid approach combines t…
New study shows deep networks generalize well due to loss surface geometry.
problem Why deep networks generalize well despite many parameters.
method Analyzed local geometry of loss surface and its effect on SGD.
result SGD stays close to low-dimensional subspace, leading to better generalization bounds.
SCORE resolves the robustness vs accuracy trade-off by redefining robust error.
problem The inherent trade-off between robustness and accuracy in adversarial training.
method SCORE defines local equivariance as the ideal robust behavior, leading to a new robust error metric.
result SCORE reconciles robustness and accuracy, improving model performance on RobustBench.
Berestovskii and Plaut introduced the concept of a coverable uniform space when developing their theory of generalized universal covering maps for uniform spaces. Brodskiy, Dydak, LaBuz, and Mitra introduced the concept of a locally uniformly joinable uniform space when developing their theory of generalized uniform co…
The Local Volatility model is a well-known extension of the Black-Scholes constant volatility model whereby the volatility is dependent on both time and the underlying asset. This model can be calibrated to provide a perfect fit to a wide range of implied volatility surfaces. The model is easy to calibrate and still ve…
We study theoretical properties of regularized robust M-estimators, applicable when data are drawn from a sparse high-dimensional linear model and contaminated by heavy-tailed distributions and/or outliers in the additive errors and covariates. We first establish a form of local statistical consistency for the penalize…
New algorithms for estimating linear queries with local differential privacy.
problem Estimating linear queries under local differential privacy constraints.
method Developed new offline and adaptive algorithms for linear queries estimation.
result Achieved optimal L2 and L∞ error bounds for linear queries estimation. TransNet improves community detection on target networks using privacy-preserved source networks.
problem Community detection on sensitive network data with privacy constraints.
method Spectral clustering framework leveraging locally distributed privacy-preserved auxiliary networks via randomized response and adaptive weighting.
result TransNet delivers strong gains in community detection across various privacy levels and heterogeneity patterns.