Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,657 papers · 148 categories

Trend · papers per month

4489133177 · Jun 202019922001200920172026
48 results for Newton-Schulz iterations

AuON is a linear-time optimizer that improves upon Muon's performance without approximate orthogonal matrices.

problem High memory and computational costs of orthogonal momentum updates.
method AuON uses normalized nonlinear scaling and a 'emergency brake' to handle exploding attention logits.
result AuON achieves strong performance without approximate orthogonal matrices, preserving structural alignment and reconditioning.

Method recovers complex-valued signals from speckle-noised measurements.

problem Recovering complex-valued signals from speckle-noised measurements.
method Bagged Deep Image Priors integrated with projected gradient descent and Newton-Schulz algorithm.
result Achieves state-of-the-art performance in MSE reduction.

The paper addresses speckle noise in coherent imaging systems.

problem Speckle noise degrades image quality in coherent imaging systems.
method Theoretical and algorithmic analysis of likelihood-based approaches for multilook coherent imaging.
result Established the first theoretical upper bound on MSE of the maximum likelihood estimator.

MuonEq improves training of matrix-valued parameters by rebalancing momentum before orthogonalization.

problem Training matrix-valued parameters with orthogonalized-update optimizers like Muon.
method MuonEq introduces three lightweight pre-orthogonalization equilibration schemes: two-sided row/column normalization (RC), row normalization (R), and column normalization (C).
result Row/column normalization acts as a zeroth-order surrogate for whitening and improves the geometry seen by orthogonalization.

Paper analyzes iterates in high-dimensional linear models and proposes estimators for their generalization error.

problem Analyzing iterates in high-dimensional linear models with comparable feature and sample sizes.
method Novel estimators for generalization error, debiasing corrections, and valid confidence intervals.
result Estimators are n\sqrt{n}-consistent and can be used for early stopping.

Paper analyzes iterative learning for concept classes and learns half-spaces.

problem Learning concept classes efficiently with iterative learners.
method Analyzes various settings of iterative learning and provides a constructive algorithm for half-spaces.
result Constructive iterative algorithm for learning half-spaces from informant.

WaveFit uses fixed-point iteration to create high-quality neural vocoders.

problem Creating high-quality neural vocoders with fast inference.
method Integrates GANs' adversarial training into a DDPM-like iterative framework based on fixed-point iteration.
result WaveFit synthesizes speech with naturalness comparable to human speech, and is significantly faster than existing methods.

In this paper, we introduce the notions of an iterated planar Lefschetz fibration and an iterated planar open book decomposition and prove the Weinstein conjecture for contact manifolds supporting an open book that has iterated planar pages. For n1n\geq 1, we show that a (2n+1)(2n+1)-dimensional contact manifold MM suppor…

2017-10-20abs ↗pdf ↗

Sharp analysis of power iteration for tensor PCA, improving convergence and stopping criteria.

problem Analyzing the power iteration algorithm for tensor PCA to improve convergence and stopping criteria.
method Sharp bounds on the number of iterations, revealing a smaller algorithmic threshold, proposing a stopping criterion.
result Sharp bounds on the number of iterations required for power method to converge, revealing a smaller algorithmic threshold than previously conjectured.

We deduce from the work of Chen, that the restriction morphism from closed free iterated integrals to closed iterated integrals on loops is onto. We use this to show that the module of higher order invariants of smooth functions is generated by free closed iterated integrals.

2010-11-15abs ↗pdf ↗

Adaptive optimal control of nonlinear dynamic systems with deterministic and known dynamics under a known undiscounted infinite-horizon cost function is investigated. Policy iteration scheme initiated using a stabilizing initial control is analyzed in solving the problem. The convergence of the iterations and the optim…

2015-05-20abs ↗pdf ↗

Iterative method learns unknown constraints for MPC control.

problem Learning to satisfy unknown polyhedral state constraints in iterative MPC.
method Collects and improves estimates of unknown constraints using collected data, designs an MPC controller to satisfy the estimated constraints.
result Robust and probabilistic guarantees of constraint satisfaction as a function of task iterations.

Value iteration is a fixed point iteration technique utilized to obtain the optimal value function and policy in a discounted reward Markov Decision Process (MDP). Here, a contraction operator is constructed and applied repeatedly to arrive at the optimal solution. Value iteration is a first order method and therefore …

2019-05-10abs ↗pdf ↗

In this paper we investigate what kind of manifolds arise as the total spaces of iterated S1S^1-bundles. A real Bott tower studied in \cite{CMO}, \cite{KM} and \cite{KN} is an example of an iterated S1S^1-bundle. We show that the total space of an iterated S1S^1-bundle is homeomorphic to an infra-nilmanifold. A real Bo…

2011-08-01abs ↗pdf ↗

DSPI connects natural policy gradient to policy iteration, proving global convergence.

problem Optimizing policies in reinforcement learning.
method DSPI framework, combining smoothed policy iteration and natural policy gradient.
result DSPI achieves geometric convergence and optimal complexity for policy optimization.

Strong stability of ergodic iterations proven without ergodic driving sequence.

problem Ensuring strong stability of ergodic iterations under non-ergodic driving sequences.
method Revisiting processes driven by stationary ergodic sequences, proving strong stability under mild conditions on recursive maps.
result Strong stability of iterations proven without ergodic driving sequence.

Policy iteration is a family of algorithms that are used to find an optimal policy for a given Markov Decision Problem (MDP). Simple Policy iteration (SPI) is a type of policy iteration where the strategy is to change the policy at exactly one improvable state at every step. Melekopoglou and Condon [1990] showed an exp…

2019-11-28abs ↗pdf ↗

New convergence rates for shuffling gradient methods without strong convexity.

problem Theoretical gap between shuffling gradient methods' empirical success and established convergence rates.
method Proved last-iterate convergence rates for shuffling gradient methods using function value gap.
result First last-iterate convergence rates for shuffling gradient methods without strong convexity.

Paper refutes conjecture on tensor power iteration convergence in overcomplete models.

problem Understanding convergence of tensor power iteration in overcomplete random tensors.
method Analysis of tensor power iteration dynamics from random initialization.
result Polynomially many steps are necessary for convergence, refutes logarithmic conjecture.

We study iteration maps of recurrence relations arising from mutation periodic quivers of arbitrary period. Combining tools from cluster algebra theory and (pre)symplectic geometry, we show that these cluster iteration maps can be reduced to symplectic maps on a lower dimensional submanifold, provided the matrix repres…

2013-07-01abs ↗pdf ↗

The Ricci iteration is a discrete analogue of the Ricci flow. We give the first study of the Ricci iteration on a class of Riemannian manifolds that are not Kähler. The Ricci iteration in the non-Kähler setting exhibits new phenomena. Among them is the existence of so-called ancient Ricci iterations. As we show, these …

2016-06-16abs ↗pdf ↗

Last SGD iterate bounds for overparameterized linear regression.

problem Analyzing the last iterate risk bounds of SGD with decaying stepsize for overparameterized linear regression.
method Problem-dependent analysis of last iterate risk bounds of SGD with geometrically decaying stepsize.
result Proved nearly matching upper and lower bounds on the excess risk for last iterate SGD with geometrically decaying stepsize.

We consider the infinite-horizon discounted optimal control problem formalized by Markov Decision Processes. We focus on several approximate variations of the Policy Iteration algorithm: Approximate Policy Iteration, Conservative Policy Iteration (CPI), a natural adaptation of the Policy Search by Dynamic Programming a…

2014-05-12abs ↗pdf ↗

We give a definition of higher dimensional iterated integrals based on integration over membranes. We prove basic properties of this definition and formulate a conjecture which extends Chen's de Rham Theorem for iterated integrals to the membrane case.

2012-03-16abs ↗pdf ↗

A well-known issue of Batch Normalization is its significantly reduced effectiveness in the case of small mini-batch sizes. When a mini-batch contains few examples, the statistics upon which the normalization is defined cannot be reliably estimated from it during a training iteration. To address this problem, we presen…

2020-02-13abs ↗pdf ↗

Improved matching for multiple objects using a novel reweighting method.

problem Current multi-object matching methods have limitations and are not robust.
method Proposes a novel iterative reweighting strategy using the graph connection Laplacian.
result Demonstrates superior performance over state-of-the-art methods.

OptEx accelerates first-order optimization with parallelized iterations.

problem Inefficiencies in first-order optimization algorithms for complex tasks.
method Approximately parallelized iterations using kernelized gradient estimation.
result OptEx achieves substantial efficiency improvements with an effective acceleration rate of Ω(N)Ω(\sqrt{N}).