On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,932 papers · 148 categories

Trend · papers per month

count % of corpus

4 results for “BFLOAT16”

A Study of BFLOAT16 for Deep Learning Trainingcs.LG

BFLOAT16 achieves SOTA results in deep learning training without hyper-parameter tuning.

problem Ensuring deep learning training achieves SOTA results without hyper-parameter tuning.

method Implemented a method to emulate BFLOAT16 operations in various frameworks.

result BFLOAT16 achieves SOTA results in deep learning training without hyper-parameter tuning.

BFLOAT16 Deep Learning TensorFlow Caffe2 IntelCaffe

2019-05-29abs ↗pdf ↗

K-TanH: Efficient TanH For Deep Learningcs.LG

K-TanH is a fast, efficient deep learning activation function.

problem Improving the speed and efficiency of deep learning models.

method K-TanH is a novel, highly accurate, low-precision integer approximation of TanH.

result K-TanH achieves up to 5x speedup over Intel SVML and is more efficient.

Deep Learning Activation Functions Efficiency Integer Arithmetic BFloat16

2019-09-17abs ↗pdf ↗

Revisiting BFloat16 Trainingcs.LG

New techniques improve 16-bit training accuracy without 32-bit units.

problem Training deep learning models with only 16-bit floating-point units.

method Studied BFloat16 units and applied stochastic rounding and Kahan summation techniques.

result Up to 7% absolute validation accuracy gain in 16-bit-FPU training.

BFloat16 16-bit training stochastic rounding Kahan summation deep learning

2020-10-13abs ↗pdf ↗

MIOpen: An Open Source Library For Deep Learning Primitivescs.LG

MIOpen optimizes deep learning operators for GPUs, accelerating research.

problem Optimizing deep learning operators for efficient GPU execution.

method Highly optimized implementations, fusion, auto-tuning, bfloat16 support.

result Accelerates time to discovery in deep learning research.

deep learning GPU optimization open-source fused operators auto-tuning

2019-09-30abs ↗pdf ↗