Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

169,341 papers · 148 categories

Trend · papers per month

51102152203 · Jun 202019922001200920182026
48 results for noisy updates

Unified framework for analyzing batch updating methods with noisy gradients.

problem Analyzing convergence of batch updating methods with noisy gradients and approximations.
method Unified framework using convergence of stochastic processes.
result Establishes a general theorem for most known convergence results.

The study examines backward compatibility issues in ML systems, especially with noisy data.

problem Backward compatibility challenges in ML systems, especially with noisy data.
method Empirical analysis of ML systems across different architectures and datasets, focusing on data shifts and noise.
result Backward compatibility issues arise even without data shift due to optimization stochasticity and training on large-scale noisy datasets can significantly decrease compatibility.

SFPO optimizes LLM reasoning by repositioning before updating, improving stability and efficiency.

problem Noisy gradients from low-quality rollouts cause instability and inefficient exploration in on-policy RL algorithms.
method Decomposes each step into three stages: a short fast trajectory, repositioning, and slow correction, preserving the objective and rollout process unchanged.
result SFPO consistently improves stability, reduces rollouts, and accelerates convergence, outperforming GRPO on math reasoning benchmarks.

PIE-PINN estimates elastic properties from noisy, low-res displacement data.

problem Estimating heterogeneous elastic properties from low-resolution, noisy data.
method Probabilistic Physics-Informed Neural Network (PIE-PINN) framework combining B-spline and hierarchical scale model.
result Robust estimation of Young's modulus and Poisson's ratio from noisy, low-resolution displacement data.

New method tackles noisy and incomplete observations in reinforcement learning.

problem Noisy and incomplete observations in reinforcement learning with continuous control.
method Model-based approach using surrogate loss function and belief imputation.
result The method outperforms compared methods on benchmark tasks.

JoCoR improves deep learning with noisy labels by reducing network diversity.

problem Learning with noisy labels in deep learning.
method JoCoR uses two networks to make predictions, calculates a joint loss with Co-Regularization, and updates both networks simultaneously.
result JoCoR outperforms state-of-the-art approaches in learning with noisy labels.

A new numerical scheme approximates nonlinear filtering densities for noisy and partial measurements.

problem Approximating nonlinear filtering densities for noisy and partial measurements.
method Deep splitting scheme applied to the Fokker--Planck equation followed by Bayes' formula.
result Convergence rate established for the numerical scheme under parabolic Hörmander condition.

Learning with noisy labels is one of the hottest problems in weakly-supervised learning. Based on memorization effects of deep neural networks, training on small-loss instances becomes very promising for handling noisy labels. This fosters the state-of-the-art approach "Co-teaching" that cross-trains two deep neural ne…

2019-01-14abs ↗pdf ↗

Gradient filters track moving parameters under noisy data and misspecification.

problem Tracking multidimensional time-varying parameters under noisy observations and model misspecification.
method Gradient-based filters update parameters using the gradient of a postulated objective function, evaluated at either the predicted or updated parameters.
result Novel sufficient conditions for exponential stability of the filtered parameter path, and finite-sample and asymptotic mean squared error bounds.

PBA solves root-finding problems with noisy responses, converging slower than stochastic approximation.

problem Solving stochastic root-finding problems with noisy responses.
method Probabilistic bisection algorithm with power-one test for noisy responses.
result The extended PBA converges at a rate arbitrarily close to, but slower than, the canonical square root rate of stochastic approximation.

Locally private reinforcement learning protects individual environments from reverse engineering.

problem Protecting private information in distributed reinforcement learning environments.
method Locally differentially private algorithms that protect local agents' models from adversarial reverse engineering.
result Demonstrated that the proposed algorithm performs well under local differential privacy (LDP).

New method for asynchronous stochastic approximation converges in reinforcement learning.

problem Finding solutions to equations with noisy measurements in reinforcement learning.
method Batch Asynchronous Stochastic Approximation (BASA) with conditions for convergence and rate of convergence.
result Sufficient conditions for convergence and rate of convergence of BASA.

DONE algorithm optimizes unknown functions with noisy measurements.

problem Online optimization of unknown functions with costly and noisy measurements.
method Uses a random Fourier expansion to maintain a surrogate function and iteratively update it with new measurements.
result DONE algorithm is significantly faster than Bayesian optimization while achieving similar or better performance.

New algorithms minimize noisy, irregular functions without gradients.

problem Minimizing noisy, irregular, and algebraically intractable functions.
method Generalized gradient descent recursion with smooth approximations.
result Convergence results under weak assumptions on function regularity.

A new method for efficient neural network fine-tuning using queryable low-rank update atoms.

problem Rigidity of static low-rank adaptation methods when input and depth-wise computation vary.
method A shared queryable memory of low-rank update atoms, allowing dynamic and context-sensitive adaptation.
result Improves final test performance and training stability compared to standard low-rank adaptation.

Study evaluates GP metamodels and sequential designs for noisy level set estimation.

problem Efficiently reconstructing the level set of a noisy function.
method Investigates Gaussian process (GP) and Student-t process (TP) metamodels, along with various acquisition functions.
result GPs with Student-t observations and TPs perform better than classification GPs in noisy conditions.

SAUNA filters out noisy samples to boost RL performance.

problem Improving RL performance by filtering out non-informative samples.
method SAUNA selects samples based on the fraction of variance explained by the value function, rejecting non-informative transitions.
result SAUNA significantly improves RL performance on benchmark problems.

Study tackles nonlinear factor models with unknown monotone links from incomplete and noisy data.

problem Learning nonlinear factor models with unknown monotone links from incomplete and noisy data.
method Formulated as joint recovery of low-rank factors, loadings, and nonlinear link function; proposed BCD algorithm with regularization.
result Established convergence guarantees and sublinear regret bounds for link-function updates.

We develop methods for parameter estimation in settings with large-scale data sets, where traditional methods are no longer tenable. Our methods rely on stochastic approximations, which are computationally efficient as they maintain one iterate as a parameter estimate, and successively update that iterate based on a si…

2015-09-22abs ↗pdf ↗

Improves scalability and robustness of dynamic graph clustering.

problem Scalability and robustness issues in matrix factorization methods for dynamic graphs.
method Temporal separated matrix factorization, bi-clustering regularization, selective embedding updating.
result Demonstrated scalability, robustness, and effectiveness on synthetic and real-world benchmarks.

New algorithm detects and discards faulty updates in federated learning.

problem Byzantine failures, biased local datasets, and poisoning attacks in federated learning.
method Adaptive Federated Averaging with Hidden Markov Model for quality update detection.
result Significantly more robust to faulty, noisy, and malicious participants.

A new method approximates expected empirical loss for stochastic deep learning tasks.

problem Determining optimal step sizes for stochastic gradient descent in deep learning.
method Applying one-dimensional function fitting to noisy losses of vertical cross sections to approximate expected empirical loss.
result The method leads to a robust and straightforward optimization method that performs well across datasets and architectures.

Neural networks learn clean data patterns first, then noisy data, leading to improved performance initially but deteriorating later.

problem Improvement in prediction error on clean data during early training of neural networks with noisy labels.
method Theoretical analysis and experiments to explore the dynamics of gradient descent and the impact of clean and noisy data.
result Neural networks prioritize learning clean data patterns first, leading to improved performance initially but deteriorating later due to diminishing gradient dominance of clean samples over noisy ones.

A framework for navigating environments with spatially correlated obstacles and uncertain blockage status.

problem Navigation in environments with spatially correlated obstacles of uncertain blockage status.
method Modeling spatial correlation with Gaussian Random Field, developing Bayesian belief updates, proposing a two-stage learning framework with offline and online phases.
result Consistent performance gains over baselines in environments with adversarial interruptions or clustered natural hazards.

Paper tackles federated linear bandit learning with AirComp for noisy channels.

problem Minimize cumulative regret in federated linear bandit learning.
method Proposes a federated linear bandits scheme using over-the-air computation (AirComp) over noisy fading channels.
result Determines the regret bound of the proposed scheme.

Aims to improve neural network training with weak labels by weighting updates based on a confidence network.

problem Training deep neural networks with limited labeled data.
method Proposes a two-network approach: a target network trained on weak labels and a confidence network trained on true labels to inform the target network about label quality.
result Improves model performance and speeds up learning from weak labels.

The question of how to incorporate curvature information in stochastic approximation methods is challenging. The direct application of classical quasi- Newton updating techniques for deterministic optimization leads to noisy curvature estimates that have harmful effects on the robustness of the iteration. In this paper…

2014-01-27abs ↗pdf ↗

Online learning framework for inverse optimization improves decision-making in noisy data.

problem Real-time decision-making with noisy data and limited historical information.
method Developed an online learning algorithm with implicit update rule for noisy data.
result Algorithm converges at O(1/T)\mathcal{O}(1/\sqrt{T}) rate and is statistically consistent.

Stochastic Gradient Descent (SGD) has become one of the most popular optimization methods for training machine learning models on massive datasets. However, SGD suffers from two main drawbacks: (i) The noisy gradient updates have high variance, which slows down convergence as the iterates approach the optimum, and (ii)…

2015-12-09abs ↗pdf ↗

A-FADMM improves FL scalability and privacy via wireless channel perturbations and interference.

problem Challenges in model training due to wireless channel randomness and interference.
method Formulated a novel constrained optimization problem and proposed A-FADMM framework.
result Proves convergence and privacy guarantees for A-FADMM under time-varying channels.