Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

169,051 papers · 148 categories

Trend · papers per month

3.7%7.3%11.0%14.6% · Apr 199919922001200920182026
48 results for critical slowing down

Crypto crashes show no consistent early warning signal, suggesting they are abrupt shocks rather than critical transitions.

problem Identifying early warning signals for crypto crashes.
method Analysis of seven major BTC liquidation cascades using minute-level price and leverage/order-flow data.
result No variable is event-invariant, and the critical-slowing-down signature is present in only five out of seven events.

This thesis optimizes neuromorphic systems by slowing down their dynamics, improving performance.

problem Timescale mismatch between analog neuromorphic circuits and real-time sensory inputs.
method Proposes and tests solutions to slow down the dynamics of spiking neural networks.
result Spiking neural networks on analog neuromorphic systems can achieve significant performance boosts.

Although gradient descent (GD) almost always escapes saddle points asymptotically [Lee et al., 2016], this paper shows that even with fairly natural random initialization schemes and non-pathological functions, GD can be significantly slowed down by saddle points, taking exponential time to escape. On the other hand, g…

2017-05-29abs ↗pdf ↗

The paper analyzes why Gaussianization slows down with higher dimensions and proposes a solution.

problem The convergence rate of Gaussianization slows down as the dimension increases.
method Analytical and empirical analysis of Gaussianization with random rotations.
result The number of required layers scales linearly with the dimension for Gaussian input.

When applied to training deep neural networks, stochastic gradient descent (SGD) often incurs steady progression phases, interrupted by catastrophic episodes in which loss and gradient norm explode. A possible mitigation of such events is to slow down the learning process. This paper presents a novel approach to contro…

2017-09-05abs ↗pdf ↗

Gradient descent slows significantly in over-parameterized single neuron learning.

problem Learning a single neuron with over-parameterization and square loss.
method Analysis of gradient descent dynamics, proving convergence rates and lower bounds.
result Over-parameterization can exponentially slow down the convergence rate of gradient descent.

A new sampler tackles critical phenomena by leveraging scale invariance.

problem Scale invariance at criticality causes sampling difficulties in Monte Carlo simulations.
method RiGCS combines MLMC-HB with generative models to improve sampling efficiency.
result RiGCS achieves significantly higher effective sample size than existing methods.

Study uses DNM theory to detect early warning signals of market instability.

problem Detecting early warning signals of financial market instability.
method Applying Dynamical Network Marker (DNM) theory to trading data from the Tokyo Stock Exchange.
result Early warning signals of large price movements can be detected on a daily time scale.

The paper proves unique blow-down for critical points of a Yang-Mills-Higgs functional.

problem Proving uniqueness of blow-down for critical points of a Yang-Mills-Higgs functional.
method Using an Allard-type improvement of flatness to establish co-dimension-two analogue of Savin's theorem.
result Entire critical points have unique blow-down, two-dimensional in ambient dimensions 2-4 or any dimension assuming local minimizer.

The study uses Gaussian mixture models to estimate pipe wall thickness from partial scans.

problem Estimating remaining wall thickness of critical water mains in non-destructive evaluation.
method Developed a robotic vehicle for pipe inspections. Used Gaussian Processes and Gaussian Mixture Models to infer RWT at unseen sections.
result Gaussian mixture models effectively capture the probability of RWT values in inspected data.

The explosion in workload complexity and the recent slow-down in Moore's law scaling call for new approaches towards efficient computing. Researchers are now beginning to use recent advances in machine learning in software optimizations, augmenting or replacing traditional heuristics and data structures. However, the s…

2018-03-06abs ↗pdf ↗

Machine learning finds a compact fixed point action for SU(3) gauge theory.

problem Finding accurate and compact parametrizations of fixed point actions for SU(3) gauge theory.
method Used machine learning, specifically a gauge equivariant convolutional neural network.
result Obtained a superior parametrization of a fixed point action for SU(3) gauge theory.

Near a birth-death critical point in a one-parameter family of gradient flows, there are precisely two Morse critical points of index difference one on the birth side. This paper gives a self-contained proof of the folklore theorem that these two critical points are joined by a unique gradient trajectory up to time-shi…

2017-06-23abs ↗pdf ↗

Paper analyzes convergence of FedAvg on non-iid data and provides theoretical guarantees.

problem Analyzing convergence of Federated Averaging on non-iid data.
method Theoretical analysis of convergence rate and trade-offs between communication-efficiency and convergence rate.
result Established a convergence rate of O(1T)\mathcal{O}(\frac{1}{T}) for strongly convex and smooth problems.

Dealing with the shear size and complexity of today's massive data sets requires computational platforms that can analyze data in a parallelized and distributed fashion. A major bottleneck that arises in such modern distributed computing environments is that some of the worker nodes may run slow. These nodes a.k.a.~str…

2018-03-31abs ↗pdf ↗

A new gradient descent method speeds up in flat regions and slows in steep directions.

problem Improving the speed and stability of gradient descent algorithms.
method Introducing a 'power gradient' where each gradient component is replaced by its HH-th power, with 0<H<10<H<1.
result The new gradient descent methods achieve significantly better performances, especially for Nesterov accelerated gradient and AMSGrad.

PrecGD restores linear convergence in over-parameterized nonconvex matrix factorization.

problem Slow convergence of local search algorithms in over-parameterized nonconvex matrix factorization.
method Preconditioned Gradient Descent (PrecGD) with an inexpensive 2\ell_2 regularization.
result PrecGD restores linear convergence rate even in the over-parameterized case.

A critical and challenging problem in reinforcement learning is how to learn the state-action value function from the experience replay buffer and simultaneously keep sample efficiency and faster convergence to a high quality solution. In prior works, transitions are uniformly sampled at random from the replay buffer o…

2018-04-23abs ↗pdf ↗

This study improves convergence of two-timescale SA under Markovian noise in reinforcement learning.

problem Stability and convergence of two-timescale stochastic approximations under Markovian noise.
method Introduced a new control strategy for the fast timescale parameter.
result Established almost sure convergence of TDC with eligibility traces under off-policy learning with linear function approximation.

Develops variational inference for Neyman-Scott processes for faster sampling.

problem Slow mixing time in MCMC for posterior sampling in Neyman-Scott processes.
method Variational inference algorithm for Neyman-Scott processes, minimizing KL divergence.
result Achieves better prediction performance than MCMC with limited computational time.

New method estimates and samples high-dimensional probability distributions avoiding optimization and approximation curse.

problem Estimating high-dimensional probability distributions from data samples.
method Hierarchic probability flow from coarse to fine scales, defined by conditional probabilities across scales.
result Sampling hierarchic models avoids critical slowing down at phase transitions and generates turbulence and dark matter images.

Proposes CLRS-Text, a new benchmark for evaluating LM reasoning capabilities.

problem Lack of transferable benchmarks for evaluating reasoning capabilities of language models.
method Developed a textual version of the CLRS benchmark, generating diverse algorithmic tasks.
result Demonstrates a novel challenge for the LM reasoning community and validates prior work.

Accelerates optimal transport computation by 10x with spectral insights.

problem Exponential slow-down of convergence in Entropic Optimal Transport as regularization weakens.
method Spectral insights and spectral warm-start strategy to mitigate convergence issues.
result Faster convergence compared to the reference method Sinkhorn algorithm.

Learning the distribution of natural images is one of the hardest and most important problems in machine learning. The problem remains open, because the enormous complexity of the structures in natural images spans all length scales. We break down the complexity of the problem and show that the hierarchy of structures …

2015-10-27abs ↗pdf ↗

The ability to learn tasks in a sequential fashion is crucial to the development of artificial intelligence. Neural networks are not, in general, capable of this and it has been widely thought that catastrophic forgetting is an inevitable feature of connectionist models. We show that it is possible to overcome this lim…

2016-12-02abs ↗pdf ↗
Critical Crashescond-mat.stat-mech

We argue that the word ``critical'' in the title is not purely literary. Based on our and other previous work on nonlinear complex dynamical systems, we summarize present evidence, on the Oct. 1929, Oct. 1987, Oct. 1987 Hong-Kong, Aug. 1998 global market events and on the 1985 Forex event, for the hypothesis advanced f…

1999-01-06abs ↗pdf ↗

Study reveals conditions for neural networks to forget learned features.

problem Understanding feature unlearning in neural networks.
method Infinite-width limit analysis with stochastic gradient descent, fast-slow dynamics.
result Conditions for feature unlearning are determined by the strength of nonlinear terms and initial weights.