Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,695 papers · 148 categories

Trend · papers per month

count% of corpus
0111 · Jan 201919922001200920172026
3 results for “model-parameter-count”
4+3 Phases of Compute-Optimal Neural Scaling Lawsstat.ML

New phases identified in neural scaling laws with compute limits.

problem Understanding neural scaling laws under compute constraints.
method Solved neural scaling model with stochastic gradient descent, derived loss curves, analyzed model-parameter-count phases.
result Identified 4 phases (+3 subphases) in data-complexity/target-complexity phase-plane, derived exponents.
neural scalingcompute-limitedstochastic gradient descentscaling lawsmodel-parameter-count
2024-05-23abs ↗pdf ↗
Equivariant Transformer Networkscs.CV

How can prior knowledge on the transformation invariances of a domain be incorporated into the architecture of a neural network? We propose Equivariant Transformers (ETs), a family of differentiable image-to-image mappings that improve the robustness of models towards pre-defined continuous transformation groups. Throu…

2019-01-25abs ↗pdf ↗
Hitting the High-Dimensional Notes: An ODE for SGD learning dynamics on GLMs and multi-index modelsmath.OC

Analyzes SGD dynamics in high-dimensional settings for GLMs and multi-index models.

problem Understanding SGD learning in high-dimensional settings for generalized linear models and multi-index models.
method Deterministic equivalent of SGD as ODEs and simplified SDE for analysis.
result Obtained learning rate thresholds and convergence guarantees for SGD.
SGDhigh-dimensionalGLMsmulti-index modelsordinary differential equations
2023-08-17abs ↗pdf ↗