Gated attention improves performance by using a hierarchical mixture of experts.
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
Trend · papers per month
Gated attention improves model curvature, enhancing performance on nonlinear tasks.
Deep Sets improve reinforcement learning agent's object-centered navigation and generalization.
Although deep neural networks generally have fixed network structures, the concept of dynamic mechanism has drawn more and more attention in recent years. Attention mechanisms compute input-dependent dynamic attention weights for aggregating a sequence of hidden states. Dynamic network configuration in convolutional ne…
In medical real-world study (RWS), how to fully utilize the fragmentary and scarce information in model training to generate the solid diagnosis results is a challenging task. In this work, we introduce a novel multi-instance neural network, AMI-Net+, to train and predict from the incomplete and extremely imbalanced da…
LSTM improves cross-network recommendations by capturing user preference changes and irregular time intervals.
Ground-A-Video edits videos without training, preserving intended changes.
A new Hopfield model reduces inefficiency in large transformer models.