Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,695 papers · 148 categories

Trend · papers per month

1122 · May 202619922001200920172026
7 results for bit-budget

This work optimizes quantization of linear models to reduce memory usage.

problem Optimizing memory usage for high-dimensional linear models.
method Information-theoretic framework with randomized embedding-based algorithms.
result Matching upper and lower bounds for minimax risk under quantization constraints.

New constraints on space and adaptivity in bandits force more batches and memory use.

problem Simultaneous space and adaptivity constraints in stochastic bandits.
method Proved lower bounds and constructed an algorithm with near-minimax regret.
result Near-minimax regret requires more batches and memory than previously thought.

CALDERA compresses large language models by approximating weight matrices with low-rank, low-precision factors.

problem The large sizes of Large Language Models (LLMs) hinder deployment on edge devices.
method CALDERA approximates weight matrices W\mathbf{W} as Q+LR\mathbf{Q} + \mathbf{L}\mathbf{R}, where L\mathbf{L} and R\mathbf{R} are low-rank factors quantized to low precision.
result CALDERA achieves better zero-shot performance than existing techniques, especially with low bit precision.

Algorithm compresses large matrices by approximating them as low rank and low precision factors.

problem Efficiently storing and processing large matrices with billions of elements.
method Randomized sketching and quantization of matrix columns to achieve low rank and low precision factorization.
result Achieves compression ratios as low as one bit per matrix coordinate while maintaining or improving performance.

New algorithm tackles batched stochastic linear bandits with 1-bit communication constraints.

problem Stochastic linear bandits with 1-bit communication constraints.
method Phased-elimination algorithms based on G-optimal designs and 1-bit mean estimation.
result Achieves near-optimal regret bounds for broad scaling regimes.