Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

169,042 papers · 148 categories

Trend · papers per month

count% of corpus
0.3%0.5%0.8%0.1% · Jun 201919922001200920172026
1 result for “MedianSGD”
Distributed Training with Heterogeneous Data: Bridging Median- and Mean-Based Algorithmscs.LG

This study analyzes signSGD and medianSGD for heterogeneous data and proposes a noise correction mechanism.

problem The convergence of signSGD and medianSGD is non-convergent in distributed settings with heterogeneous data.
method The study analyzes signSGD and medianSGD for heterogeneous data and proposes a noise correction mechanism to overcome the convergence gap.
result The proposed noise correction mechanism provably closes the gap between mean and median of the gradients, leading to global convergence to stationary solutions.
Federated LearningMedian-based AlgorithmsSignSGDMedianSGDHeterogeneous Data
2019-06-04abs ↗pdf ↗