Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,742 papers · 148 categories

Trend · papers per month

count% of corpus
0111 · Feb 202419922001200920172026
1 result for “Mixture-of-MLPs”
Approximation Rates and VC-Dimension Bounds for (P)ReLU MLP Mixture of Expertsstat.ML

Paper analyzes approximation and learning of MoEs with (P)ReLU activation.

problem Scaling up deep learning models with MoEs and (P)ReLU activation.
method Approximation and learning-theoretic analysis of MoMLPs with (P)ReLU.
result MoMLPs can uniformly approximate Lipschitz functions with ε\varepsilon accuracy using O(ε−1)\mathcal{O}(\varepsilon^{-1}) parameters.
Mixture-of-ExpertsReLuApproximationLearning-theoreticMixture-of-MLPs
2024-02-05abs ↗pdf ↗