Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,657 papers · 148 categories

Trend · papers per month

126253379505 · Jun 202019922001200920172026
48 results for convergence theory

Quantum Lefschetz theorem by Coates and Givental gives a relationship between the genus 0 Gromov-Witten theory of X and the twisted theory by a line bundle L on X. We prove the convergence of the twisted theory under the assumption that the genus 0 theory for original X converges. As a byproduct, we prove the semi-simp…

2005-06-13abs ↗pdf ↗

The abstract discusses convergence properties of Lipschitz functions and sets defined by equations.

problem Convergence of Lipschitz functions and sets defined by equations.
method Painlevé-Kuratowski convergence applied to Lipschitz functions and sets defined by equations.
result Generalizations and reverses of classical theorems on convergence of functions and sets.

The paper examines convergence of currents and forms under smooth diffeomorphisms.

problem Analyzing convergence of currents and forms under C0C^0-limits of diffeomorphisms.
method Geometric analysis, measure theory, homotopy theory.
result Pushforwards of rectifiable currents converge in the flat norm.

Paper refutes EM convergence theory and introduces a new EM algorithm.

problem The convergence theory of the EM algorithm is incorrect and affects its performance.
method Proposes a new EM algorithm called the Channel Matching (CM) EM algorithm and provides an initialization map.
result The locally maximal Q can affect the convergent speed but not the global convergence.

New framework for neural networks converging to low loss without overparameterization.

problem Training deep neural networks without overparameterization assumptions.
method Construction of random sparse lifts and analysis using algebraic topology and random graph theory.
result Provable convergence to low loss for large sparse neural networks.

New theory explains how self-supervised learning converges, advancing AI research.

problem Lack of precise theoretical explanation for self-supervised learning convergence.
method Synthesized Identifiability Theory with empirical evidence to propose Singular Identifiability Theory (SITh).
result SITh provides deeper insights into SSL's implicit data assumptions and advances representation learning.

The abstract discusses convergent realizations of Lie subalgebras in control theory.

problem Characterizing Lie subalgebras that can be realized as convergent vector fields.
method Generalizations and reformulations of algebraic properties for output realization.
result Recovery and clarification of previous results on control-affine systems and realization of Chen-Fliess series.

Computational topology is a vibrant contemporary subfield and this article integrates knot theory and mathematical visualization. Previous work on computer graphics developed a sequence of smooth knots that were shown to converge point wise to a piecewise linear (PL) approximant. This is extended to isotopic convergenc…

2016-03-28abs ↗pdf ↗

The paper improves theoretical bounds on deep neural networks' convergence.

problem Understanding convergence of over-parameterized deep neural networks.
method Surrogate network construction with fixed activation patterns.
result Convergence to a global minimum guaranteed for networks with quadratic width and linear depth.

It is shown that under mild conditions, Benjamini-Schramm convergence of lattices in locally compact groups is equivalent to spectral convergence. Next both notions are extended to the relative case and are then expressed in terms of relative L2-theory.

2018-05-18abs ↗pdf ↗

Gradient descent proves global convergence for 4-layer matrix factorization.

problem Global convergence of gradient descent on four-layer matrix factorization under random initialization.
method New techniques to show saddle-avoidance properties and extend eigenvalue theories.
result Polynomial-time global convergence guarantee for randomly initialized gradient descent on four-layer matrix factorization.

New insights into continual learning for deep models, showing convergence issues but local linear solutions.

problem Challenges in continual learning for homogeneous deep models.
method Sequential projections onto task margin sets, leveraging nonconvex projection theory.
result Local linear convergence under certain conditions for homogeneous deep networks.

New Hermite approximations accelerate convergence with adaptive coordinate transformations.

problem Accelerating convergence of spectral approximations for Hermite expansions.
method Using normalizing flows for adaptive coordinate transformations and deriving error estimates.
result Error estimates for Hermite expansions under adaptive coordinate transformations.

This work improves the convergence theory of diffusion models for generating samples from complex distributions.

problem Improving theoretical understanding of diffusion models, particularly their convergence analysis.
method Developed an instance-dependent convergence rate that adapts to the smoothness of target distributions.
result Established an iteration complexity of min{d,d2/3L1/3,d1/3L}ε2/3\min\{d,d^{2/3}L^{1/3},d^{1/3}L\}\varepsilon^{-2/3} for generating high-quality samples.

New theory improves diffusion model convergence for generating data.

problem Improving convergence of diffusion models for data generation.
method Developed a non-asymptotic convergence theory for probability flow ODEs.
result Proves d/εd/\varepsilon iterations suffice for approximating target distributions.

Deep networks converge in direction, with implications for predictions and margins.

problem Understanding convergence and alignment in deep learning networks.
method Developed a theory of unbounded nonsmooth Kurdyka-Łojasiewicz inequalities for functions definable in an o-minimal structure.
result Network weights, predictions, training errors, and margin distribution converge in direction and align with gradient flow.

The paper analyzes deep neural networks using control theory to set a time limit for their convergence.

problem Understanding the finite-time convergence of deep neural networks.
method Lyapunov based analysis of the loss function, control theory framework, finite-time control of non-linear systems.
result A priori guarantees of finite-time convergence for deep neural networks are provided.

Neural networks' weights don't converge to stationary points but training loss stabilizes.

problem The disconnect between theoretical analyses and neural network training practice.
method An invariant measure perspective inspired by ergodic theory of dynamical systems.
result The distribution of weights converges to an approximate invariant measure, explaining loss stabilization.

Study approximates sub-Riemannian structures with Riemannian metrics and analyzes spectral convergence.

problem Approximating sub-Riemannian structures for analysis.
method Constructing Riemannian metrics tailored to sub-Riemannian structures and studying spectral convergence.
result Riemannian volumes converge to Popp's volume and spectral convergence of Laplace operators is studied.

Paper establishes fast convergence theory for diffusion models under minimal assumptions.

problem Establish theoretical guarantees for diffusion models under minimal assumptions.
method Developed a convergence theory for denoising diffusion probabilistic models (DDPM) under minimal assumptions.
result Achieved convergence rate of O(d/T) for target distributions with finite first-order moment.

Local convergence theory for mildly over-parameterized neural nets.

problem Understanding why over-parameterization works in neural networks.
method Developed a local convergence theory for two-layer neural nets, showing neuron convergence under certain conditions.
result All student neurons converge to one of teacher neurons when the loss is below a threshold.

pFedGame uses game theory for decentralized federated learning in dynamic networks.

problem Performance bottlenecks, data bias, model convergence issues, and model poisoning attacks in federated learning.
method pFedGame employs game theory to decentralize federated learning, avoiding a central aggregation server and addressing dynamic network challenges.
result pFedGame achieves higher accuracy (over 70%) in heterogeneous data compared to existing methods.

In the previous paper [GLM2018], we showed that the theory of harmonic maps between Riemannian manifolds may be discretized by introducing triangulations with vertex and edge weights on the domain manifold. In the present paper, we study convergence of the discrete theory to the smooth theory when taking finer and fine…

2019-10-17abs ↗pdf ↗

Paper offers a fast convergence theory for offline decision making.

problem Offline decision making problems, including reinforcement learning and off-policy evaluation.
method Introduces a framework (DMOF) and algorithm (EDD) with a fast convergence guarantee.
result Demonstrates a fast convergence guarantee with a lower bound complement.

Extends spectral number variance convergence to random matrix ensembles for twisted Laplacians.

problem Spectral number variance convergence for twisted Laplacians and Dirac operators.
method Extends Rudnick's approach to Gaussian ensembles for twisted Laplacians and Dirac operators.
result Convergence to Gaussian ensembles for twisted Laplacians and Dirac operators.

The paper studies non-integer curvature flows and proves convergence to spheres under specific conditions.

problem Analyzing the convergence of non-integer curvature flows on rotationally symmetric surfaces.
method Spectral theory of singular Sturm-Liouville operators to construct an eigenbasis and prove convergence.
result The flow converges to a round sphere if the focal points coincide at the poles, otherwise to a non-round Hopf sphere.

The paper develops a new algorithm for RBMs using dynamical mean-field theory.

problem Learning in Restricted Boltzmann Machines (RBMs) with complex dependencies.
method Dynamical mean-field theory applied to RBMs with rectangular coupling matrices drawn from a bi-rotation invariant ensemble.
result The algorithm converges globally under a stability criterion, with rates matching numerical simulations.

The paper develops a theory of conformal density at infinity for groups with contracting elements.

problem Understanding conformal dynamics at infinity for groups with contracting elements.
method Introducing a class of convergence boundary and establishing the basic theory of conformal density on it.
result Unified theory of conformal density on various boundaries for different types of groups.