Modeling human language learning with multi-checkpoint machine translation.
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
Trend · papers per month
Microbial clades modeling is a challenging problem in biology based on microarray genome sequences, especially in new species gene isolates discovery and category. Marker family genome sequences play important roles in describing specific microbial clades within species, a framework of support vector machine (SVM) base…
Sequence-to-sequence models, such as attention-based models in automatic speech recognition (ASR), are typically trained to optimize the cross-entropy criterion which corresponds to improving the log-likelihood of the data. However, system performance is usually measured in terms of word error rate (WER), not log-likel…
Although the sequence-to-sequence (encoder-decoder) model is considered the state-of-the-art in deep learning sequence models, there is little research into using this model for recovering missing sensor data. The key challenge is that the missing sensor data problem typically comprises three sequences (a sequence of o…
Classifies intrinsically linked tournaments by their score sequences.
Enhances sequence memory capacity in neural networks.
Deep generative models have been successfully used to learn representations for high-dimensional discrete spaces by representing discrete objects as sequences and employing powerful sequence-based deep models. Unfortunately, these sequence-based models often produce invalid sequences: sequences which do not represent a…
Equivalent condition found for q-holonomic sequences.
The abstract discusses a spectral sequence for Lie algebroids.
Many machine learning tasks can be expressed as the transformation---or \emph{transduction}---of input sequences into output sequences: speech recognition, machine translation, protein secondary structure prediction and text-to-speech to name but a few. One of the key challenges in sequence transduction is learning to …
Mining tasks over sequential data, such as clickstreams and gene sequences, require a careful design of embeddings usable by learning algorithms. Recent research in feature learning has been extended to sequential data, where each instance consists of a sequence of heterogeneous items with a variable length. However, m…
Paper proposes using LSTM for LSH-based sequence alignment.
Study on continuous sequence classification with distribution uncertainty.
Deep learning models optimize protein sequences.
Sequence classification is an important data mining task in many real world applications. Over the past few decades, many sequence classification methods have been proposed from different aspects. In particular, the pattern-based method is one of the most important and widely studied sequence classification methods in …
We study the Thompson sampling algorithm in an adversarial setting, specifically, for adversarial bit prediction. We characterize the bit sequences with the smallest and largest expected regret. Among sequences of length with zeros, the sequences of largest regret consist of alternating zeros and …
Unimodal sequences of moves connect 3-manifold triangulations.
This paper presents a novel end-to-end approach to program repair based on sequence-to-sequence learning. We devise, implement, and evaluate a system, called SequenceR, for fixing bugs based on sequence-to-sequence learning on source code. This approach uses the copy mechanism to overcome the unlimited vocabulary probl…
This work compresses sequences by treating them as continuous-time processes, enabling efficient discretization.
Characterizes sequences from two-component link diagrams.
In order to study large variations or fluctuations of finite or infinite sequences (time series), we bring to light an 1868 paper of Crofton and the (Cauchy-)Crofton theorem. After surveying occurrences of this result in the literature, we introduce the inconstancy of a sequence and we show why it seems more pertinent …
Generative adversarial nets (GAN) has been successfully introduced for generating text to alleviate the exposure bias. However, discriminators in these models only evaluate the entire sequence, which causes feedback sparsity and mode collapse. To tackle these problems, we propose a novel mechanism. It first segments th…
Researchers develop flexible kernels for biological sequences with guaranteed reliability.
A convolutional sequence to sequence non-intrusive load monitoring model is proposed in this paper. Gated linear unit convolutional layers are used to extract information from the sequences of aggregate electricity consumption. Residual blocks are also introduced to refine the output of the neural network. The partiall…
Using sequence to sequence algorithms for query expansion has not been explored yet in Information Retrieval literature nor in Question-Answering's. We tried to fill this gap in the literature with a custom Query Expansion engine trained and tested on open datasets. Starting from open datasets, we built a Query Expansi…
P3BO optimizes biological sequence design by combining multiple methods.
Undirected neural sequence models such as BERT (Devlin et al., 2019) have received renewed interest due to their success on discriminative natural language understanding tasks such as question-answering and natural language inference. The problem of generating sequences directly from these models has received relativel…
New concordance invariant from spectral sequence on Khovanov homology.
The availability of large amounts of time series data, paired with the performance of deep-learning algorithms on a broad class of problems, has recently led to significant interest in the use of sequence-to-sequence models for time series forecasting. We provide the first theoretical analysis of this time series forec…
nTreeClus clusters categorical sequences using tree-based learners and k-mers.
New sequences prove some link diagrams can't be transformed by specific moves.
Sequence-to-Sequence (seq2seq) modeling has rapidly become an important general-purpose NLP tool that has proven effective for many text-generation and sequence-labeling tasks. Seq2seq builds on deep neural language modeling and inherits its remarkable accuracy in estimating local, next-word distributions. In this work…
Existence of an infinite sequence of harmonic maps between spheres of certain dimensions was proven by Bizon and Chmaj. This sequence shares many features of the Bartnik-McKinnon sequence of solutions to the Einstein-Yang-Mills equations as well as sequences of solutions that have arisen in other physical models. We ap…
New flexible confidence sequences for robust statistical inference.
Deep learning techniques have been hugely successful for traditional supervised and unsupervised machine learning problems. In large part, these techniques solve continuous optimization problems. Recently however, discrete generative deep learning models have been successfully used to efficiently search high-dimensiona…
For any prime power and any dimension , a new construction of -sequences in base using global function fields is presented. The construction yields an analog of Halton sequences for global function fields. It is the first general construction of -sequences that is not based on the digital metho…
Spectral sequence connects knot homologies via algebraic geometry.
Graphs from van der Corput sequence embed into Chamanara surface.
The problem of universal outlying sequence detection is studied, where the goal is to detect outlying sequences among sequences of samples. A sequence is considered as outlying if the observations therein are generated by a distribution different from those generating the observations in the majority of the sequenc…
Sequence feature embedding is a challenging task due to the unstructuredness of sequence, i.e., arbitrary strings of arbitrary length. Existing methods are efficient in extracting short-term dependencies but typically suffer from computation issues for the long-term. Sequence Graph Transform (SGT), a feature embedding …
Improves sequence modeling with a flow-based recurrent mixture density network.
Predicts node sequences in graphs using multi-order network models.
Incompatible operations affect Khovanov homology and spectral sequences.
The paper extends confidence sequences for infinite variance data.
Inferring the structural properties of a protein from its amino acid sequence is a challenging yet important problem in biology. Structures are not known for the vast majority of protein sequences, but structure is critical for understanding function. Existing approaches for detecting structural similarity between prot…
The spectral sequence's -page is a link invariant for .
ProGen models protein sequences for synthetic biology.
FIGARO generates symbolic music with fine-grained control.