On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

169,181 papers · 148 categories

Trend · papers per month

count % of corpus

2 results for “chrono-initialized”

The unreasonable effectiveness of the forget gatecs.NE

A forget-gate-only LSTM outperforms standard LSTM on benchmark datasets.

problem The necessity of all gates in LSTM networks.

method A forget-gate-only LSTM with chrono-initialized biases.

result The forget-gate-only LSTM outperforms standard LSTM on MNIST and pMNIST datasets.

forget gate LSTM gate-only chrono-initialized benchmark datasets

2018-04-13abs ↗pdf ↗

Can recurrent neural networks warp time?cs.LG

New method improves learning of long-term dependencies in recurrent models.

problem Improving learning of long-term dependencies in recurrent neural networks.

method Proves learnable gates in recurrent models provide quasi-invariance to time transformations and recovers part of LSTM architecture from axiomatic approach.

result New chrono initialization of gate biases greatly improves learning of long-term dependencies.

Recurrent Neural Networks Long Short-Term Memory (LSTM)Gated Recurrent Units (GRUs)Time Transformations Quasi-Invariance

2018-03-23abs ↗pdf ↗