On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,657 papers · 148 categories

Trend · papers per month

count % of corpus

2 results for “AdaScale”

AdaScale SGD: A User-Friendly Algorithm for Distributed Trainingcs.LG

AdaScale SGD adapts learning rates for large-batch training efficiently.

problem Adapting learning rates for large-batch training to balance speed-ups and model quality.

method Adaptive learning rate adaptation based on gradient variance.

result AdaScale achieves reliable speed-ups for a wide range of batch sizes without degrading model quality.

AdaScale SGD Large-batch training Learning rate adaptation Gradient variance

2020-07-09abs ↗pdf ↗

Rethinking Trust Region Bayesian Optimization in High Dimensionsstat.ML

AdaScale-TuRBO improves high-dimensional Bayesian optimization by dynamically scaling the GP lengthscale.

problem Inappropriate lengthscale design in TuRBO's local GP model causes suboptimal performance in high dimensions.

method Proposes AdaScale-TuRBO, which scales the GP lengthscale with both problem dimension and trust region size.

result AdaScale-TuRBO robustly outperforms standard TuRBO and other methods on synthetic and real-world tasks.

Bayesian Optimization Trust Region High Dimensions Gaussian Process Lengthscale

2026-04-24abs ↗pdf ↗