Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

169,051 papers · 148 categories

Trend · papers per month

count% of corpus
0.3%0.5%0.8%0.1% · Nov 201819922001200920182026
1 result for “Mesh-TensorFlow”
Mesh-TensorFlow: Deep Learning for Supercomputerscs.LG

Mesh-TensorFlow enables efficient deep learning on large clusters.

problem Memory constraints and inefficiency in batch-splitting for large models.
method Introduces Mesh-TensorFlow for specifying general tensor computations across a multi-dimensional mesh of processors.
result Trains Transformer models with up to 5 billion parameters on TPU meshes of up to 512 cores.
Mesh-TensorFlowDeep LearningData-ParallelismModel-ParallelismTransformer
2018-11-05abs ↗pdf ↗