Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,695 papers · 148 categories

Trend · papers per month

count% of corpus
0.3%0.5%0.8%0.1% · Jun 202119922001200920172026
1 result for “hypoactivation”
The Future is Log-Gaussian: ResNets and Their Infinite-Depth-and-Width Limit at Initializationstat.ML

ResNets approximate log-Gaussian at initialization, improving network performance.

problem Understanding the initialization behavior of deep neural networks like ResNets.
method Analyzing ReLU ResNets in the infinite-depth-and-width limit, showing log-Gaussian behavior.
result ResNets at initialization exhibit hypoactivation and interlayer correlations, which are not captured by Gaussian limits.
ResNetslog-Gaussianinfinite-depth-and-widthhypoactivationinterlayer correlations
2021-06-07abs ↗pdf ↗