Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,742 papers · 148 categories

Trend · papers per month

3837661,1491,532 · Jun 202019922001200920172026
48 results for algorithm generalization

The paper analyzes how optimization algorithms affect the generalization of minimax models.

problem The generalization performance of minimax models trained with different optimization algorithms.
method Analysis of gradient descent ascent (GDA) and proximal point method (PPM) algorithms under convex concave and non-convex non-concave settings.
result The PPM algorithm ensures a bounded excess risk in convex concave problems, while GDA's generalization depends on solving subproblems simultaneously.

Study on meta-reinforcement learning generalization in high-dimensional tasks.

problem Generalization performance of meta-reinforcement learning algorithms in high-dimensional tasks.
method High-dimensional, procedurally generated environments.
result Meta-reinforcement learning algorithms exhibit strong overfitting on challenging tasks.

Paper tightens privacy and generalization bounds for iterative learning.

problem Balancing privacy and generalization in iterative learning algorithms.
method Established alignment between generalization and privacy, derived composition theorems for iterative algorithms.
result Generalization bounds for iterative learning algorithms are strictly tighter than existing works.

The paper analyzes generalization bounds for NC-SC/NC-C stochastic minimax optimization.

problem Generalization analysis of nonconvex-(strongly)-concave stochastic minimax optimization.
method Established algorithm-agnostic and algorithm-dependent generalization bounds via uniform convergence and stability arguments.
result Sample complexities and generalization bounds for NC-SC and NC-C settings.

Study examines how decoding algorithms affect fairness in language generation models.

problem Impact of decoding algorithms on fairness in open-ended language generation.
method Systematic analysis of top-pp, top-kk, and temperature decoding algorithms.
result Decoding algorithms significantly impact fairness across demographic groups.

The paper analyzes generalization of noisy iterative algorithms using communication theory.

problem Generalization of models trained by noisy iterative algorithms under different distributions.
method Connecting noisy iterative algorithms to additive noise channels in communication theory.
result Distribution-dependent generalization bounds for noisy iterative algorithms.

This work bounds the generalization error of private algorithms for discrete data.

problem Bounding the generalization error of private algorithms for discrete data.
method Information-theoretic approach using relative entropy and the method of types.
result Explicit upper bounds on the generalization error of stable private algorithms for discrete data.

Generative algorithms learn high-dimensional data efficiently and generate new samples.

problem Learning from scarce high-dimensional data.
method Lipschitz-regularized gradient flows and particle-based algorithms.
result Correctly transports gene expression data points with high dimensionality.

New algorithms for clustering and synthetic data generation of heterogeneous tabular datasets.

problem Clustering and generating synthetic data from heterogeneous tabular datasets with hidden cluster structure.
method Developed MMM and MMMsynth algorithms for clustering and synthetic data generation.
result MMMsynth algorithm outperforms other literature tabular-data generators and approaches real data performance.

MadEvolve optimizes trading algorithms using LLMs, achieving significant improvements in feature generation and trading strategy optimization.

problem Optimizing trading algorithms for better performance and feature generation.
method A framework inspired by Alpha-Evolve, using LLMs to evolve trading strategies and feature pipelines.
result Significant improvements in trading performance across various tasks, including feature generation and trading strategy optimization.

Paper proposes an unsupervised feature selection algorithm with stability guarantees.

problem Feature selection for dimension reduction and interpretability.
method Proposes a novel unsupervised feature selection algorithm with stability guarantees.
result The algorithm has superior generalization performance and stable selected features.

PAC-Bayesian theory applied to learning optimization algorithms with generalization guarantees.

problem Learning optimization algorithms with provable generalization guarantees and explicit trade-offs.
method PAC-Bayes theory applied to learning-to-optimize, reformulating the learning procedure into a one-dimensional minimization problem.
result Learned optimization algorithms outperform deterministic worst-case analysis algorithms, even in the limit case of guaranteed convergence.

The Gibbs algorithm's generalization error is bounded, improving with prior volume in low temperatures.

problem Bounding the generalization error of the Gibbs algorithm in low temperature regimes.
method Analyzes the Gibbs algorithm's performance, extending known high-temperature bounds to low-temperature scenarios.
result With high probability, the generalization error decreases with the total prior volume of similar hypotheses.

We explore in some detail the notion of algorithmic stability as a viable framework for analyzing the generalization error of learning algorithms. We introduce the new notion of training stability of a learning algorithm and show that, in a general setting, it is sufficient for good bounds on generalization error. In t…

2012-12-12abs ↗pdf ↗

In statistical learning theory, generalization error is used to quantify the degree to which a supervised machine learning algorithm may overfit to training data. Recent work [Xu and Raginsky (2017)] has established a bound on the generalization error of empirical risk minimization based on the mutual information $I(S;…

2018-01-12abs ↗pdf ↗

We show how to take any two parameter-free online learning algorithms with different regret guarantees and obtain a single algorithm whose regret is the minimum of the two base algorithms. Our method is embarrassingly simple: just add the iterates. This trick can generate efficient algorithms that adapt to many norms s…

2019-02-24abs ↗pdf ↗

New entropy flow method extends generalization bounds for all Markov algorithms.

problem Understanding generalization error for Markov algorithms.
method Unified framework using continuous-time approximation and modified logarithmic Sobolev inequalities.
result Established new connections between generalization error and ergodic properties of Markov processes.

Paper analyzes stability and generalization of SCO algorithms.

problem Understanding how SCO algorithms perform on unseen data.
method Algorithmic stability analysis in statistical learning theory.
result Derives dimension-independent excess risk bounds for SCGD and SCSC.

The paper examines domain generalization algorithms and finds empirical risk minimization performs well.

problem Comparing domain generalization algorithms is difficult due to inconsistent experimental conditions.
method Implemented DomainBed, a testbed for domain generalization with seven datasets and model selection criteria.
result Empirical risk minimization shows state-of-the-art performance across all datasets.

Study MAML's generalization in varying tasks, proving bounds on error.

problem Bounding MAML's generalization error across tasks.
method Characterizes MAML's generalization error from two perspectives: recurring and unseen tasks.
result MAML's generalization error depends on the number of tasks and samples per task.

Online learning to rank is a sequential decision-making problem where in each round the learning agent chooses a list of items and receives feedback in the form of clicks from the user. Many sample-efficient algorithms have been proposed for this problem that assume a specific click model connecting rankings and user b…

2018-06-06abs ↗pdf ↗

Optimal transport with ff-divergence regularization using generalized Sinkhorn algorithm.

problem Optimal transport with ff-divergence regularization.
method Generalized Sinkhorn algorithm for solving optimal transport problems with various ff-divergences.
result Strong duality holds, optimums are attained, and convergence to an optimal solution is guaranteed under certain conditions.

New bounds explain modern machine learning algorithms' generalization.

problem Explaining generalization behavior of modern machine learning algorithms.
method Proposes a new complexity measure based on empirical Rademacher complexity of an algorithm- and data-dependent hypothesis class.
result Obtains novel bounds with finite fractal dimension, simplifies proofs, and recovers known results.

Generalized algorithm for translation and scale-invariant prediction.

problem Sequential prediction with expert advice, focusing on translation and scale invariance.
method Designing a generalized online algorithm using the universal prediction perspective to compete against a generic class of expert selection strategies.
result No preliminary knowledge of loss sequences is required; performance bounds are stable under arbitrary scalings and translations.

This paper extends stability analysis to non-convergent neural network training.

problem Generalization of neural networks whose training does not converge to fixed points.
method Introduces statistical algorithmic stability (SAS) to study non-convergent algorithms and their generalization.
result Stability of non-convergent training dynamics correlates with generalization performance.

New algorithms achieve uniform stability for empirical risk minimization.

problem Designing uniformly stable optimization algorithms for empirical risk minimization.
method Black-box conversion of smooth optimization algorithms and development of Mirror Descent for smooth optimization.
result Optimal algorithms with uniform stability and convergence rates for smooth optimization.

Study on selecting between base algorithms in stochastic bandit problems.

problem Model selection in stochastic environments with contextual information.
method Developed a meta-algorithm-base algorithm abstraction with a smoothing transformation for optimal O(T)O(\sqrt{T}) guarantees.
result Optimal O(T)O(\sqrt{T}) model selection guarantees for stochastic contextual bandit problems.

While statistics and machine learning offers numerous methods for ensuring generalization, these methods often fail in the presence of adaptivity---the common practice in which the choice of analysis depends on previous interactions with the same dataset. A recent line of work has introduced powerful, general purpose a…

2018-06-15abs ↗pdf ↗

Cluster-wise linear regression (CLR), a clustering problem intertwined with regression, is to find clusters of entities such that the overall sum of squared errors from regressions performed over these clusters is minimized, where each cluster may have different variances. We generalize the CLR problem by allowing each…

2016-07-05abs ↗pdf ↗

New algorithm minimizes expert selection regret in partial bandit feedback.

problem Minimizing expert selection regret in partial bandit feedback.
method Develops a sequential minimax optimal algorithm for a generalized partial monitoring setting.
result Second order regret bounds against a general expert selection sequence.

Study links fractal structure to generalization in stochastic optimization.

problem Understanding generalization in stochastic optimization algorithms.
method Represented stochastic optimization algorithms as random iterated function systems (IFS) and used dynamical systems theory.
result Proved that generalization error can be bounded based on fractal structure of invariant measure.

We analyze Gibbs-based transfer learning algorithms using information theory.

problem Understanding the generalization error of transfer learning.
method Information-theoretic analysis focusing on αα-weighted-ERM and two-stage-ERM.
result Exact characterization of generalization behavior using conditional symmetrized KL information.

New algorithms solve inverse problems using deep learning, converging faster than traditional methods.

problem Solving inverse problems with deep learning models.
method Simple non-convex algorithm for linear and nonlinear inverse problems, with theoretical and empirical support.
result The proposed algorithms converge faster than conventional techniques for certain inverse problems.

Proposes GAGA algorithm for automatic hyperparameter learning in signal recovery.

problem Difficulty in selecting hyperparameters in traditional signal recovery methods.
method Global Adaptive Generative Adjustment (GAGA) algorithm for automatic hyperparameter learning and signal estimate.
result Consistency of model selection and signal estimate output.

A fast algorithm for generalized matrix regression improves machine learning performance.

problem Efficiently solving generalized matrix regression problems in machine learning.
method Utilizes sketching technique to achieve (1+ε)(1+ε) relative error with sketching sizes of order $\cO(ε^{-1/2})$.
result The Fast GMR algorithm achieves better performance in symmetric positive definite matrix approximation and single pass singular value decomposition.