Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,657 papers · 148 categories

Trend · papers per month

1122 · Dec 201519922001200920172026
40 results for stagnation

Gradient descent stagnates in low-precision, but unbiased rounding schemes improve convergence.

problem Stagnation of gradient descent in low-precision computation.
method Proposed unbiased stochastic rounding schemes that trade zero bias for larger probability of preserving small gradients.
result Unbiased rounding methods typically improve convergence rate of gradient descent for convex problems.

Data describing historical growth of income per capita [Gross Domestic Product per capita (GDP/cap)] for the world economic growth and for the growth in Western Europe, Eastern Europe, Asia, former USSR, Africa and Latin America are analysed. They follow closely the linearly-modulated hyperbolic distributions represent…

2016-03-05abs ↗pdf ↗

Historical economic growth in Asia (excluding Japan) is analysed. It is shown that Unified Growth Theory is contradicted by the data, which were used (but not analysed) during the formulation of this theory. Unified Growth Theory does not explain the mechanism of economic growth. It explains the mechanism of Malthusian…

2015-12-16abs ↗pdf ↗

This paper designs sensor arrays for estimating unsteady flows efficiently.

problem Estimating high-dimensional unsteady flow fields with limited sensor placement.
method Combines data-driven modeling, Kalman Filter design, and sparsification for sensor selection.
result Proposed sensor arrays are highly effective for flow-field estimation across various conditions.

Data describing historical economic growth are analysed. Included in the analysis is the world and regional economic growth. The analysis demonstrates that historical economic growth had a natural tendency to follow hyperbolic distributions. Parameters describing hyperbolic distributions have been determined. A search …

2015-09-09abs ↗pdf ↗

A simple but useful method of reciprocal values is introduced, explained and illustrated. This method simplifies the analysis of hyperbolic distributions, which are causing serious problems in the demographic and economic research. It allows for a unique identification of hyperbolic distributions and for unravelling co…

2017-08-29abs ↗pdf ↗

Proposes r2SGLD for efficient constrained exploration in non-convex learning.

problem Stagnation in high-temperature chains of reSGLD in distribution tails.
method r2SGLD: replica exchange with reflection steps in a bounded domain.
result Reflection steps enhance mixing rates with quadratic improvement in domain diameter.

Machine learning improves RNA secondary structure prediction.

problem Stagnant performance of RNA secondary structure prediction methods.
method Machine learning, especially deep learning, is used to predict RNA secondary structures.
result Machine learning methods have improved the prediction of RNA secondary structures.

New sampler tackles complex discrete energy landscapes efficiently.

problem Stagnation in gradient-based discrete samplers for non-convex settings.
method DREXEL sampler with Replica Exchange and Adjusted Metropolis.
result Proves samplers satisfy detailed balance and converge to target distribution.

Gradient descent with biased rounding errors converges faster under certain conditions.

problem Stagnation or negative impact of rounding errors in neural network training with low precision.
method Analysis of gradient descent with stochastic fixed-point rounding errors under the Polyak-Lojasiewicz inequality.
result Biased rounding errors can improve convergence rates, especially when the Polyak-Lojasiewicz inequality holds.

Fairness in machine learning has predominantly been studied in static classification settings without concern for how decisions change the underlying population over time. Conventional wisdom suggests that fairness criteria promote the long-term well-being of those groups they aim to protect. We study how static fairne…

2018-03-12abs ↗pdf ↗

Study compares altcoins to Bitcoin, analyzing their features and market performance.

problem Comparing altcoins to Bitcoin to understand market performance and features.
method Used Google Trend data, price, volume, and market capitalization data from coinmarketcap.com.
result Features of Litecoin, Zcash, Bitcoin Cash, Ethereum, and Bitcoin Gold affect market performance and user preferences.

The so-called great divergence in the income per capita is described in the Unified Growth Theory as the mind-boggling and unresolved mystery about the growth process. This mystery has now been solved: the great divergence never happened. It was created by the manipulation of data. Economic growth in various regions is…

2016-03-28abs ↗pdf ↗

As the performance of computer systems stagnates due to the end of Moore's Law, there is a need for new models that can understand and optimize the execution of general purpose code. While there is a growing body of work on using Graph Neural Networks (GNNs) to learn representations of source code, these representation…

2019-06-17abs ↗pdf ↗

This paper improves bandwidth selectors for SPBNs to enhance their performance.

problem Suboptimal density estimation and reduced predictive performance in SPBNs due to normal rule bandwidth selection.
method Theoretical framework for state-of-the-art bandwidth selectors (cross-validation and plug-in methods) are established and evaluated.
result Cross-validation selectors outperform the normal rule, especially in high sample size scenarios.

New findings show Bregman proximal algorithms can get stuck near non-stationary points.

problem Bregman proximal algorithms can get stuck near non-stationary points, misleadingly suggesting convergence.
method Analysis of Bregman proximal algorithms and their behavior near non-stationary points.
result Bregman proximal algorithms can get stuck near spurious stationary points, even in convex problems.

VINNAS uses variational inference to avoid mode collapse in neural architecture search.

problem Mode collapse in gradient-based NAS methods, leading to suboptimal architectures.
method Differentiable variational inference with variational dropout and automatic relevance determination.
result State-of-the-art accuracy with up to twice fewer non-zero parameters.

Optimizes solving complex min-max problems with stochastic and nonconvex elements.

problem Min-max problems with stochastic and nonconvex elements.
method Combines conic nonexpansiveness, refined inexact Halpern iteration, and multilevel Monte Carlo estimator.
result Optimal or best-known complexity guarantees for $ρ< rac{1}{L}$, improving previous results.

The paper analyzes RLVR's training dynamics, proving convergence depends on aligning update direction with Gradient Gap.

problem Understanding why RLVR works and its limitations.
method Analysis of RLVR's training process at trajectory and token levels, introducing Gradient Gap.
result Convergence depends on aligning update direction with Gradient Gap, with a sharp step-size threshold.

Kolmogorov-Arnold Networks promise scalable performance in high dimensions.

problem Curse of dimensionality in multilayer perceptrons.
method Kolmogorov-Arnold representation theorem and interpolation methods.
result Kolmogorov-Arnold Networks achieve true freedom from the curse of dimensionality.

SAGE enhances reinforcement learning by injecting hints to prevent model stagnation.

problem Sparse rewards cause large language models to stall under relative policy optimization.
method SAGE injects privileged hints during training to increase within-group outcome diversity.
result SAGE consistently outperforms GRPO on 6 benchmarks with LLMs, achieving significant improvements.

PRUDEX-Compass evaluates FinRL methods on 6 axes for financial market investments.

problem Insufficient evaluation of FinRL methods in financial markets.
method Introduces PRUDEX-Compass with 6 axes and 17 measures for evaluation.
result Demonstrates the effectiveness of PRUDEX-Compass on 4 real-world datasets.

Satellite images predict U.S. county mortality rates.

problem Predicting mortality rates in U.S. counties using satellite imagery.
method Convolutional neural network trained on crude mortality rates, learned features interpreted using Shapley Additive Feature Explanations.
result Predicted mortality from satellite images correlated strongly with true mortality rates (Pearson r=0.72).

Neural networks plateau during training, identified and quantified.

problem Plateau phenomenon in gradient descent training of ReLU networks.
method Identification and quantification of plateau phenomenon; new iterative training method ANLS.
result Plateaux correspond to periods of constant activation patterns; quantification of gradient flow dynamics; characterization of stationary points.

Signed compression progress on a sealed audit is goodhart-resistant.

problem Intrinsic motivation for agents to improve their world models by compressing experience.
method Rewarding agents for the signed decrease of a fixed sealed-audit loss.
result Cumulative reward telescopes exactly to endpoint audit improvement, preventing infinite reward push while true audit performance stagnates.

Deep RL evaluation underestimates uncertainty, leading to misleading conclusions.

problem Statistical uncertainty in deep RL performance evaluations is underestimated, leading to misleading conclusions.
method Advocates for reporting interval estimates of aggregate performance and proposes performance profiles to account for variability.
result Substantial discrepancies in prior performance comparisons are revealed, highlighting the need for more rigorous evaluation methods.