Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,695 papers · 148 categories

Trend · papers per month

0111 · Nov 200519922001200920172026
4 results for Extreme-Activation

We give a quick tour through many of the classical results in the field of minimal submanifolds, starting at the definition. The field of minimal submanifolds remains extremely active and has very recently seen major developments that have solved many longstanding open problems and conjectures; for more on this, see th…

2005-11-18abs ↗pdf ↗

DORA analyzes deep neural networks' internal representations to detect spurious correlations.

problem Detecting spurious correlations in deep neural networks' internal representations.
method DORA uses Extreme-Activation (EA) distance measure to assess representation similarities.
result Identifies internal representations capable of detecting spurious correlations.

Improved LLM pre-training performance through better weight and variance control.

problem Improper weight and variance control in LLM pre-training affects downstream task performance.
method Introduced Layer Index Rescaling (LIR) and Target Variance Rescaling (TVR) techniques.
result Substantial improvements in downstream task performance (up to 4.6%) and reduced extreme activation values.

Improved EXACT strategy reduces GNN memory consumption and runtime.

problem Efficiently training large-scale GNNs with reduced memory usage.
method Block-wise quantization of intermediate activation maps with improved variance minimization.
result Further reduction in memory consumption (>15%) and runtime speedup (5%) with similar performance trade-offs.