On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,695 papers · 148 categories

Trend · papers per month

count % of corpus

2 results for “Pseudo-Tokens”

Gridded Transformer Neural Processes for Large Unstructured Spatio-Temporal Datastat.ML

Improved weather forecasting with gridded pseudo-token TNPs.

problem Handling large-scale, unstructured spatio-temporal data in weather forecasting.

method Introducing gridded pseudo-token transformer neural processes (TNPs) with efficient attention mechanisms.

result Consistently outperforms baselines on various synthetic and real-world regression tasks involving large-scale data.

weather forecasting spatio-temporal data transformer neural processes efficient attention large-scale data

2024-10-09abs ↗pdf ↗

In-Context In-Context Learning with Transformer Neural Processescs.LG

Enhances neural processes to learn from multiple related datasets.

problem Improving predictions from datasets with shared similarities.

method Developed the in-context in-context learning pseudo-token TNP (ICICL-TNP) to condition on both sets of datapoints and sets of datasets.

result Demonstrated the importance and effectiveness of in-context in-context learning.

Neural Processes Transformer Neural Processes In-Context Learning Meta-Learning Pseudo-Tokens

2024-06-19abs ↗pdf ↗