On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,695 papers · 148 categories

Trend · papers per month

count % of corpus

3 results for “seq-to-seq”

SeaD: End-to-end Text-to-SQL Generation with Schema-aware Denoisingcs.CL

Paper improves text-to-SQL models with schema-aware denoising.

problem Text-to-SQL models struggle with schema linking and grammar correctness.

method Adapts transformer-based seq-to-seq model with SeaD denoising objectives and clause-sensitive decoding.

result Improves seq-to-seq model performance on WikiSQL benchmark.

text-to-SQL schema-aware denoising transformer seq-to-seq

2021-05-17abs ↗pdf ↗

Data Transfer Approaches to Improve Seq-to-Seq Retrosynthesiscs.LG

This paper examines data transfer methods to improve off-the-shelf Transformer models for retrosynthesis.

problem Improving prediction models for retrosynthesis using small datasets.

method Systematic examination of data transfer approaches on end-to-end generative models.

result Pre-training plus fine-tuning boosts the accuracy of a Transformer baseline, achieving state-of-the-art results.

retrosynthesis Transformer data transfer generative models chemical prediction

2020-10-02abs ↗pdf ↗

Not All Attention Is Needed: Gated Attention Network for Sequence Datacs.LG

Although deep neural networks generally have fixed network structures, the concept of dynamic mechanism has drawn more and more attention in recent years. Attention mechanisms compute input-dependent dynamic attention weights for aggregating a sequence of hidden states. Dynamic network configuration in convolutional ne…

2019-12-01abs ↗pdf ↗