Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

169,341 papers · 148 categories

Trend · papers per month

0111 · Feb 201619922001200920182026
3 results for npm

Weibull framework diagnoses transformer weight distributions, revealing distinct patterns across modules.

problem Diagnosing weight distributions in transformer models for better understanding of training dynamics.
method Applied Weibull distribution to diagnose weight magnitude distributions in transformer models, fitting each weight matrix independently.
result Distinct patterns of weight distributions across different transformer modules were identified.

Weibull weight-scale parameter λλ evolves during AdamW training, with alignment, injection, and decay forces driving its growth and relaxation.

problem Understanding the evolution of the Weibull weight-scale parameter λλ during AdamW training.
method Deriving a leading-order three-force decomposition of the squared weight norm from AdamW updates.
result The alignment force dominates the rise phase, contributing 88-94% of the absolute force budget across four random seeds.