Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,695 papers · 148 categories

Trend · papers per month

count% of corpus
0111 · Dec 202319922001200920172026
1 result for “FP6”
ZeroQuant(4+2): Redefining LLMs Quantization with a New FP6-Centric Strategy for Diverse Generative Taskscs.CL

FP6 quantization outperforms INT4 in diverse generative tasks for LLMs.

problem Limited performance of 4-bit quantization methods in diverse generative tasks.
method Proposes a 4+2 design for FP6 quantization to achieve similar latency to INT4.
result FP6 quantization outperforms INT4 in various generative tasks, including code generation and summarization.
LLMsQuantizationFP6INT4Generative Tasks
2023-12-14abs ↗pdf ↗