Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,695 papers · 148 categories

Trend · papers per month

count% of corpus
0111 · Jun 202019922001200920172026
1 result for “GShard”
GShard: Scaling Giant Models with Conditional Computation and Automatic Shardingcs.CL

GShard enables scaling of large neural networks with automatic sharding and lightweight APIs.

problem Scaling neural networks to handle vast training data and compute efficiently.
method GShard uses lightweight annotation APIs and XLA compiler extensions for parallel computation.
result GShard successfully trained a 600 billion parameter model on 2048 TPUs in 4 days.
neural networksscalingGShardTransformerTPU
2020-06-30abs ↗pdf ↗