Study shows gap between uniform convergence and test error in random feature models.
problem Understanding the gap between uniform convergence and test error in random feature models.
method Analytical expressions for uniform convergence over norm balls, interpolators, and minimum norm interpolator risk derived and proved.
result Uniform convergence over interpolators still gives a non-trivial bound of test error even when classical uniform convergence is vacuous.
Proves weak convergence equals mean convergence in GGC.
problem Proving convergence in GGC distributions.
method Using generalized gamma convolution (GGC) and expected utility maximization.
result Weak convergence implies mean convergence in GGC.
Sharp bounds on weak convergence rate for rough volatility models.
problem Understanding the convergence rate in discretizing rough volatility models.
method Analyzing general and linear models to derive bounds.
result Sharper bound of \(H + 1/2\) for linear models.
New technique explains convergence in ML models with data modifications.
problem Understanding convergence of ML models under data changes.
method Analogue of Fatou's lemma and gamma-convergence.
result Relevance and applications in general ML tasks and domain adaptation.
Study on interest rate model with jumps, proving strong convergence in simulations.
problem Analytical solutions for complex interest rate models with jumps are difficult.
method Employed truncated Euler-Maruyama techniques to prove strong convergence.
result Justified strong convergence for Monte Carlo calibration and valuation.
New insights into continual learning for deep models, showing convergence issues but local linear solutions.
problem Challenges in continual learning for homogeneous deep models.
method Sequential projections onto task margin sets, leveraging nonconvex projection theory.
result Local linear convergence under certain conditions for homogeneous deep networks.
Study proves convergence of interest rate model approximations.
problem Investigating convergence of stochastic interest rate models.
method Developed analytical tools for true and truncated EM solutions, proving convergence in probability.
result True solution converges in probability to truncated EM solution as step size approaches zero.
Improved convergence rates for MLE in mixture models using penalized log-likelihood.
problem Convergence rates for MLE in finite mixture models.
method Penalizing log-likelihood to discourage vanishing mixing weights, using Wasserstein distance and new loss functions.
result Improved convergence rates for some mixture components, faster than traditional methods.
Generative models converge to data distribution but not principal latent factors.
problem Understanding when generative models converge to the true data distribution.
method Analytical characterisation of transition from memorisation to generalisation in linear generative models.
result Convergence captures matching the bulk of the data distribution but not principal latent factors.
This paper studies convergence behavior of latent mixing measures that arise in finite and infinite mixture models, using transportation distances (i.e., Wasserstein metrics). The relationship between Wasserstein distances on the space of mixing measures and f-divergence functionals such as Hellinger and Kullback-Leibl…
New algorithms accelerate value function convergence in MDPs.
problem Accelerating convergence of value functions in Markov Decision Processes (MDPs).
method Operator Splitting Value Iteration (OS-VI) and OS-Dyna.
result Achieves much faster convergence rate with accurate models.
Semi-supervised EM improves convergence rate with labeled samples.
problem Improving convergence rate in EM algorithm with labeled and unlabeled data.
method Analysis of semi-supervised EM algorithm for Gaussian mixture models.
result Labeled samples significantly improve the convergence rate for the EM algorithm.
New proof shows local wealth condensation in economic models with biases.
problem Economic models with biases leading to wealth condensation.
method Elementary proof based on properties of wealth distributions.
result Local wealth condensation observed in models with wealth or poverty advantages.
The paper resolves a counterexample showing convergence of expected utility in binomial models.
problem The convergence of expected utility under binomial models was previously shown to fail in certain cases.
method The paper provides a positive result on convergence using fine estimates from the Central Limit Theorem.
result A general positive result of convergence of expected utility is provided in symmetric binomial models.
Gradient EM converges globally for over-parameterized Gaussian mixtures.
problem Global convergence of gradient EM for Gaussian mixtures with more than 2 components.
method Likelihood-based convergence analysis framework.
result Gradient EM converges globally with a sublinear rate of O(1/√t).
The Type IIA flow converges on symplectic manifolds, with singularity models identified.
problem Little was known about the singularities of the Type IIA flow.
method Formulated and proved convergence theorems for the Type IIA flow.
result Identified singularity models for the Type IIA flow.
EM algorithm converges to global max in latent Gaussian tree models.
problem Optimizing log-likelihood in latent Gaussian tree models.
method Analyzed the optimization landscape and convergence of EM algorithm.
result EM algorithm converges to global maximum in latent Gaussian tree models.
This work analyzes SGGMs, offering convergence insights and practical design tips.
problem Theoretical convergence analysis for SGGMs with a system of coupled SDEs.
method Non-asymptotic convergence analysis for three graph generation paradigms.
result Unique factors affecting convergence in SGGMs and practical hyperparameter selection.
Stochastic gradient descent achieves polynomial convergence rates for noiseless linear models.
problem Convergence analysis of stochastic gradient descent in noiseless linear models.
method Fixed step-size stochastic gradient descent on least-square risk.
result Polynomial convergence rates depend on the regularities of the optimum and feature vectors.
Neural networks trained with actor-critic algorithms converge to ODEs under weak convergence analysis.
problem Challenges in convergence analysis due to changing data distributions in online learning.
method Geometric ergodicity of data samples, Poisson equation, weak convergence techniques.
result Actor and critic networks converge to solutions of ODEs with random initial conditions.
This paper analyzes discrete diffusion models, deriving convergence bounds for their generated samples.
problem Theoretical guarantees for discrete-state diffusion models remain under-explored.
method Continuous Time Markov Chain (CTMC) framework and discrete-time sampling algorithm.
result Convergence bounds for KL divergence and TV distance are derived, showing linear dependence on dimension.
Exact inference in the linear regression model with spike and slab priors is often intractable. Expectation propagation (EP) can be used for approximate inference. However, the regular sequential form of EP (R-EP) may fail to converge in this model when the size of the training set is very small. As an alternative, we …
The Expectation-Maximization algorithm is perhaps the most broadly used algorithm for inference of latent variable problems. A theoretical understanding of its performance, however, largely remains lacking. Recent results established that EM enjoys global convergence for Gaussian Mixture Models. For Mixed Linear Regres…
The paper calculates how fast optimal investment strategies approach CRRA strategies in stochastic factor models.
problem Understanding convergence rates of optimal investment strategies in stochastic factor models.
method Analyzes optimal feedback functions in nonlinear and quadratic term structure models, considering decay of bond prices and power-like utility at high wealth levels.
result Convergence rates of optimal investment strategies to CRRA strategies are determined by bond price decay and power-like utility behavior.
In this paper, we study a popular method for inference of the Bradley-Terry model parameters, namely the MM algorithm, for maximum likelihood estimation and maximum a posteriori probability estimation. This class of models includes the Bradley-Terry model of paired comparisons, the Rao-Kupper model of paired comparison…
This research analyzes and accelerates score-based diffusion models using discretization and Hessian information.
problem Theoretical foundations and convergence analysis of score-based diffusion models.
method Investigation of various discretization schemes, including Euler, exponential integrators, and midpoint randomization. Proposal of an accelerated sampler based on local linearization method.
result Hessian-based approach achieves faster convergence rates of order $\widetilde{\mathcal{O}}\left(\frac{1}{\varepsilon}
ight)$, significantly improving upon vanilla diffusion models.
TOLD++ improves convergence of diffusion models by critically damping the forward transition matrix.
problem Improving the convergence of Denoising Diffusion Probabilistic Models.
method Critically damping the Third-Order Langevin Dynamics (TOLD) forward transition matrix using eigen-analysis.
result TOLD++ converges faster than TOLD, verified on toy and real datasets.
Modeling tech transfer to explain convergence in Central and Eastern Europe.
problem Understanding mechanisms of technological diffusion in developing economies.
method Introducing a herding-based mechanism to model technological adoption and productivity growth.
result Explicit analytical solution showing nonlinear convergence to a moving frontier.
Efficient poisoning attack converges to any target classifier with provable convergence.
problem Inducing a corrupted model that misbehaves in favor of an adversary.
method Online convex optimization to find poisoning points incrementally.
result Provably converges to any attainable target classifier.
The multinomial logistic regression (MLR) model is widely used in statistics and machine learning. Stochastic gradient descent (SGD) is the most common approach for determining the parameters of a MLR model in big data scenarios. However, SGD has slow sub-linear rates of convergence. A way to improve these rates of con…
This work proves a strong convergence result for a geometric EM scheme on Riemannian manifolds.
problem Convergence of numerical schemes for manifold-valued SDEs.
method Geometric Euler-Maruyama scheme for Riemannian manifolds.
result Strong convergence of order 1/2 for the geometric EM scheme on Riemannian manifolds.
MaxEnt Model Correction improves reinforcement learning model accuracy.
problem Improving reinforcement learning model accuracy and convergence.
method MaxEnt Model Correction (MoCo) procedure to correct model's next-state distributions.
result MoCoVI and MoCoDyna algorithms converge faster and effectively use approximate models.
Cyclic coordinate descent identifies models in finite time and converges linearly.
problem Model identification in composite nonsmooth optimization problems.
method Cyclic coordinate descent for a wide class of functions.
result Explicit local linear convergence rates for coordinate descent.
Discrete geometry model approximates Willmore energy.
problem Approximating the Willmore energy for triangulated surfaces.
method A discrete energy defined in the spirit of discrete differential geometry converges to the Willmore energy.
result The discrete energy converges to the Willmore energy in the sense of Γ-convergence. Paper analyzes convergence of DDPM for general distributions.
problem Theoretical understanding of DDPM's convergence properties remains limited.
method Introduced a relaxed smoothness condition and proved near-optimal convergence rates.
result Established a convergence rate of \( \widetilde{O}\left(\frac{d\min\{d,L^2\}}{T^2}
ight) \) in Kullback-Leibler divergence.
This paper extends the convergence rate of DEQs with ReLU to any general activation.
problem Proving global convergence rate for DEQs with general activations.
method Developed a novel population Gram matrix and new form of dual activation with Hermite polynomial expansion.
result Gradient descent converges to a globally optimal solution at a linear rate for DEQs with general activations.
Paper analyzes convergence of PAM method for low-rank factorization models.
problem Convergence analysis of PAM method with subspace correction for low-rank factorization models.
method Majorized proximal alternating minimization (PAM) method with subspace correction.
result Established full convergence of PAM method under KL property and column ℓ2,0-norm condition. AdaLoss optimizes adaptive learning rates for efficient convergence in various models.
problem Efficiently optimizing adaptive learning rates for gradient descent methods.
method AdaLoss uses loss function information to dynamically adjust step sizes.
result AdaLoss achieves linear convergence in linear regression and robust global convergence in neural networks.
New analysis improves convergence guarantees for diffusion-based samplers in Wasserstein distance.
problem Improving convergence guarantees for diffusion-based generative models.
method Simple framework to analyze discretization, initialization, and score estimation errors.
result First Wasserstein convergence bound for the Heun sampler and improved results for Euler sampler.
Improved neural network convergence with causal Bayesian modeling in retail performance.
problem Improving neural network convergence in retail performance models.
method Causal Bayesian neural network implementation, removal of weakest SEM path, Flipout layers, Vadam optimizer.
result Neural network convergence improved with removal of the weakest SEM path.
New ODE models show saddle-point optimization methods converge differently, with last-iterate convergence for OGDA.
problem Analyzing convergence properties of saddle-point optimization methods.
method High-Resolution Differential Equations (HRDEs) to design differential equation models for saddle-point optimization methods.
result HRDEs reveal last-iterate convergence for Optimistic Gradient Descent Ascent (OGDA) in bilinear games.
This work improves the convergence theory of diffusion models for generating samples from complex distributions.
problem Improving theoretical understanding of diffusion models, particularly their convergence analysis.
method Developed an instance-dependent convergence rate that adapts to the smoothness of target distributions.
result Established an iteration complexity of min{d,d2/3L1/3,d1/3L}ε−2/3 for generating high-quality samples. The paper provides convergence guarantees for ODE-based generative models using transformers.
problem Theoretical guarantees for ODE-based generative models.
method A pre-trained autoencoder maps inputs to a latent space, and a transformer predicts the velocity field.
result The distribution of samples generated via estimated ODE flow converges to the target distribution in Wasserstein-2 distance.
Study proves existence and convergence of discrete-time Kyle models with multiple insiders.
problem Existence and convergence of discrete-time Kyle models with multiple informed traders.
method Proves existence and convergence of discrete-time Kyle models with multiple informed traders using mathematical proofs.
result Equilibrium exists and converges to continuous-time equilibrium as the number of trading times increases.
DEQs converge to optimal solutions with mild over-parameterization.
problem Training over-parameterized deep equilibrium models.
method Solves equilibrium point directly, uses gradient descent, and analyzes convergence via linear rate.
result Gradient descent converges to a globally optimal solution at a linear rate for quadratic loss.
Formula for European option pricing under jump diffusion model.
problem Option pricing under complex stochastic processes.
method Infinite series of Black-Scholes terms for Levy-driven processes.
result Series solution converges with a radius of convergence.
New KSDs control moments in approximations, improving diagnostics and tests.
problem Inability of standard KSDs to control moment convergence.
method Developed alternative diffusion KSDs under sufficient conditions.
result First KSDs to exactly characterize q-Wasserstein convergence.
Paper studies particle method for LSV model calibration, proving convergence and error bounds.
problem Calibration of local-stochastic volatility models with open well-posedness question.
method Regularized Euler--Maruyama scheme for particle approximation of McKean--Vlasov dynamics.
result Strong convergence of the Euler--Maruyama scheme with rate 1/2 in step-size.