Research

On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,742 papers · 148 categories

Trend · papers per month

count % of corpus

1 result for “Random-top-k”

Variance Reduction with Sparse Gradientscs.LG

New sparsity operator reduces variance reduction methods' computational cost.

problem Reduce computational cost of variance reduction methods.

method Introduce random-top-k operator to estimate gradient sparsity and reduce operations per update.

result Our algorithm consistently outperforms SpiderBoost in various tasks.

Variance reduction Sparse gradients Random-top-k Gradient sparsity Stochastic gradient descent

2020-01-27abs ↗pdf ↗