Consider a general machine learning setting where the output is a set of labels or sequences. This output set is unordered and its size varies with the input. Whereas multi-label classification methods seem a natural first resort, they are not readily applicable to set-valued outputs because of the growth rate of the o…
On-device research index
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
168,932 papers · 148 categories
Trend · papers per month
48 results for “sequence sets”
Seq-SetNet processes sequence sets directly, improving protein structure prediction.
problem Processing sequence sets (MSAs) for structural inference without considering sequence order.
method Developed a symmetric function module to integrate features from MSAs.
result Seq-SetNet outperforms state-of-the-art approaches by 3.6% in precision.
Set-Sequence model learns cross-sectional dynamics directly from time series data.
problem Predicting large cross-sections of time series data with latent cross-sectional dynamics.
method A model that learns cross-sectional structure directly, enhancing expressivity and eliminating manual feature engineering.
result Significantly outperforms strong baselines in equity portfolio optimization and loan risk prediction.
Study Thompson Sampling in adversarial bit prediction, finding regret bounds and optimal sequences.
problem Adversarial bit prediction with varying error weights.
method Thompson Sampling, analyzing sequences with largest and smallest regret.
result Regret bounds for adversarial bit prediction sequences, including optimal and worst-case scenarios.
A novel transformer model improves classification of partially ordered sequences.
problem Classification of partially ordered sequences with uncertainty in timestamps.
method Developed a transformer-based model for partially ordered sequences, benchmarked against set models.
result Transformer-based model outperforms set models on three datasets.
Study continuity of limit sets in symmetric spaces.
problem Continuity of limit sets for geometrically finite subgroups in symmetric spaces.
method Extended geometrically finite representations theory.
result Limit sets vary continuously with respect to Hausdorff distance under strong convergence.
Data of practical interest - such as personal records, transaction logs, and medical histories - are sequential collections of events relevant to a particular source entity. Recent studies have attempted to link sequences that represent a common entity across data sets to allow more comprehensive statistical analyses a…
Sequences have become first class citizens in supervised learning thanks to the resurgence of recurrent neural networks. Many complex tasks that require mapping from or to a sequence of observations can now be formulated with the sequence-to-sequence (seq2seq) framework which employs the chain rule to efficiently repre…
We obtain an index of the complexity of a random sequence by allowing the role of the measure in classical probability theory to be played by a function we call the generating mechanism. Typically, this generating mechanism will be a finite automata. We generate a set of biased sequences by applying a finite state auto…
Predicting Sequences of Traversed Nodes in Graphs using Network Models with Multiple Higher Orderscs.LG
Predicts node sequences in graphs using multi-order network models.
problem Predicting sequences of node traversals in graphs.
method Combines multiple higher-order network models into a multi-order model, fitting and selecting the optimal maximum order.
result Outperforms state-of-the-art algorithms for next-element and full sequence prediction.
Study concordance of decompositions from defining sequences in 3-sphere.
problem Understanding concordance and bordism of decompositions from defining sequences.
method Relate to invariants of toroidal decompositions and cobordism of homology manifolds.
result At least uncountably many concordance classes of decompositions in 3-sphere.
New algorithm minimizes expert selection regret in partial bandit feedback.
problem Minimizing expert selection regret in partial bandit feedback.
method Develops a sequential minimax optimal algorithm for a generalized partial monitoring setting.
result Second order regret bounds against a general expert selection sequence.
Using sequence to sequence algorithms for query expansion has not been explored yet in Information Retrieval literature nor in Question-Answering's. We tried to fill this gap in the literature with a custom Query Expansion engine trained and tested on open datasets. Starting from open datasets, we built a Query Expansi…
In this paper we consider monopoles on an asymptotically conical, oriented, Riemannian -manifold with one end. The connected components of the moduli space of monopoles in this setting are labeled by an integer called the charge. We analyse the limiting behavior of sequences of monopoles with fixed charg…
Rapid progress in deep learning has spurred its application to bioinformatics problems including protein structure prediction and design. In classic machine learning problems like computer vision, progress has been driven by standardized data sets that facilitate fair assessment of new methods and lower the barrier to …
Constructs Serre spectral sequence for bounded cohomology.
problem No specific problem stated; focuses on a new mathematical construction.
method Constructs the Serre spectral sequence for bounded cohomology.
result Obtains a non-isometric generalization of Gromov's mapping theorem and partial results on simplicial volume.
Machine learning and data mining techniques have been used extensively in order to detect credit card frauds. However, most studies consider credit card transactions as isolated events and not as a sequence of transactions. In this article, we model a sequence of credit card transactions from three different perspectiv…
Sequence to sequence learning has recently emerged as a new paradigm in supervised learning. To date, most of its applications focused on only one task and not much work explored this framework for multiple tasks. This paper examines three multi-task learning (MTL) settings for sequence to sequence models: (a) the onet…
Amino acid sequence portrays most intrinsic form of a protein and expresses primary structure of protein. The order of amino acids in a sequence enables a protein to acquire a particular stable conformation that is responsible for the functions of the protein. This relationship between a sequence and its function motiv…
Deep RL optimizes compiler passes for better performance.
problem Designing optimal compiler optimization sequences is hard and often suboptimal.
method Employed deep reinforcement learning to learn optimal pass orderings.
result Achieved up to 1.32x speedup on previously unseen programs.
Transformers can interpolate finite input sequences exactly.
problem Interpolating finite input sequences of arbitrary lengths.
method Constructing a transformer with alternating feed-forward and self-attention layers, and low-rank parameter matrices.
result Exact interpolation of datasets of finite input sequences in R^d with corresponding output sequences of smaller or equal length.
The problem of universal outlying sequence detection is studied, where the goal is to detect outlying sequences among sequences of samples. A sequence is considered as outlying if the observations therein are generated by a distribution different from those generating the observations in the majority of the sequenc…
Paper tackles embedding attributed sequences in unsupervised learning.
problem Mining tasks over attributed sequences with dependencies between sequences and attributes.
method Proposes a deep multimodal learning framework, NAS, for unsupervised learning of attributed sequences.
result NAS produces task-independent embeddings for various mining tasks on real-world datasets.
An adversarial detector identifies anomalous sequences in sequential data.
problem Detecting anomalous sequences in one-class settings with limited data.
method Solves a minimax problem to find an optimal detector against the worst-case sequences from a generator, using marked point process model.
result Demonstrated good performance on simulations and real credit card fraud datasets.
We suggest a novel method of clustering and exploratory analysis of temporal event sequences data (also known as categorical time series) based on three-dimensional data grid models. A data set of temporal event sequences can be represented as a data set of three-dimensional points, each point is defined by three varia…
ProGen models protein sequences for synthetic biology.
problem Generating proteins without structural annotations.
method Trained a 1.2B-parameter language model on 280M protein sequences.
result ProGen generates proteins with fine-grained control and accuracy.
This paper proposes a generative model, the latent Dirichlet hidden Markov models (LDHMM), for characterizing a database of sequential behaviors (sequences). LDHMMs posit that each sequence is generated by an underlying Markov chain process, which are controlled by the corresponding parameters (i.e., the initial state …
The paper solves the isoperimetric problem on noncompact metric spaces with lower Ricci bounds.
problem Solving the isoperimetric problem on noncompact metric spaces with lower Ricci bounds.
method Establishes a structure theorem for minimizing sequences, proving the limit of such sequences is identified by a finite collection of isoperimetric regions.
result The limit of a minimizing sequence is identified by a finite collection of isoperimetric regions possibly contained in pointed Gromov--Hausdorff limits of the ambient space.
Adversarial learning for mixture Hawkes processes improves performance.
problem Learning mixture models of Hawkes processes from event sequences.
method Iterative self-paced learning with adversarial self-paced mechanism.
result The proposed method outperforms traditional methods consistently.
Develops methods to create manifolds with positive scalar curvature.
problem Creating sequences of manifolds with positive scalar curvature.
method Two new methods of constructing sequences of manifolds with positive scalar curvature.
result Examples of sequences of manifolds with positive scalar curvature converge to limit spaces with pulled regions.
Differentiable losses for combinatorial optimization problems in sequence modeling.
problem Mismatch between training and inference objectives in sequence models.
method Gradient descent over linear programs representing combinatorial optimization problems.
result Gradient descent can be applied to combinatorial optimization problems efficiently.
The paper extends confidence sequences for infinite variance data.
problem Addressing confidence sequences for distributions with infinite variance.
method Establishing lower bounds and deriving tight confidence sequences for relaxed bounded -moment distributions.
result Derived confidence sequences are tighter than those using Dubins-Savage inequality.
Continuous MDS embeds sequences of dissimilarities in Euclidean space.
problem Embedding sequences of dissimilarities as increases.
method Continuous MDS reformulates MDS for sequences of dissimilarity matrices.
result Uniform convergence of interpolated embeddings.
Copy this Sentencecs.LG
Attention is an operation that selects some largest element from some set, where the notion of largest is defined elsewhere. Applying this operation to sequence to sequence mapping results in significant improvements to the task at hand. In this paper we provide the mathematical definition of attention and examine its …
For germs of subanalytic sets, we define two finite sequences of new numerical invariants. The first one is obtained by localizing the classical Lipschitz-Killing curvatures, the second one is the real analogue of the evanescent characteristics introduced by M. Kashiwara. We show that each invariant of one sequence is …
Optimal Farey sequence for with upper bound .
problem Finding an optimal Farey sequence for the congruence subgroup .
method Proving the existence of a Farey sequence with specific properties and uniqueness.
result The upper bound of the Farey sequence is optimal and equals .
The paper develops a convex parameterization for robust RNNs ensuring stability and robustness.
problem Lack of stability and robustness guarantees in RNNs for sequence-to-sequence mapping applications.
method Formulated convex sets of RNNs with stability and robustness guarantees using incremental quadratic constraints.
result The proposed model structure ensures global exponential stability and bounds on incremental gain.
We present methods for online linear optimization that take advantage of benign (as opposed to worst-case) sequences. Specifically if the sequence encountered by the learner is described well by a known "predictable process", the algorithms presented enjoy tighter bounds as compared to the typical worst case bounds. Ad…
We show that for a strongly convergent sequence of purely loxodromic finitely generated Kleinian groups with incompressible ends, Cannon-Thurston maps, viewed as maps from a fixed base limit set to the Riemann sphere, converge uniformly. For algebraically convergent sequences we show that there exist examples where eve…
Paper proposes using LSTM for LSH-based sequence alignment.
problem Sequence alignment using deep learning models.
method Deep bidirectional LSTM for feature learning and LSH-based sequence alignment.
result Higher accuracy achieved with LSTM-based model.
When analyzing the genome, researchers have discovered that proteins bind to DNA based on certain patterns of the DNA sequence known as "motifs". However, it is difficult to manually construct motifs due to their complexity. Recently, externally learned memory models have proven to be effective methods for reasoning ov…
Given a sequence of curves on a surface, we provide conditions which ensure that (1) the sequence is an infinite quasi-geodesic in the curve complex, (2) the limit in the Gromov boundary is represented by a nonuniquely ergodic ending lamination, and (3) the sequence divides into a finite set of subsequences, each of wh…
Transformers can simulate MLE for Bayesian network sequences.
problem Understanding transformers' capabilities in Bayesian network sequence generation.
method In-context maximum likelihood estimation (MLE) for autoregressive sequence generation.
result A simple transformer model can estimate Bayesian network probabilities and generate new samples.
Learned factor graphs improve inference from time sequences using neural networks.
problem Inference from time sequences with limited labeled data.
method Combines model-based algorithms and data-driven ML tools for stationary time sequences.
result Learned factor graphs can accurately infer from small training sets.
Improved algorithms for stochastic linear bandits using tighter confidence sequences.
problem Stochastic linear bandits with improved worst-case regret guarantees.
method Novel tail bound for adaptive martingale mixtures to construct tighter confidence sequences.
result Linear bandit algorithm achieves competitive worst-case regret.
Study SGD dynamics in sequence models, revealing training phases and influence of sequence length.
problem Understanding SGD in sequence models like attention networks.
method Derived closed-form population loss and analyzed SGD dynamics for SSI models.
result Two distinct training phases: escape from uninformative initialization and alignment with target subspace.
Random Fragments Classification of Microbial Marker Clades with Multi-class SVM and N-Best Algorithmq-bio.QM
Microbial clades modeling is a challenging problem in biology based on microarray genome sequences, especially in new species gene isolates discovery and category. Marker family genome sequences play important roles in describing specific microbial clades within species, a framework of support vector machine (SVM) base…
P3BO optimizes biological sequence design by combining multiple methods.
problem Variability in performance of black-box optimization methods for biological sequence design.
method Population-Based Black-Box Optimization (P3BO) that samples sequences from an ensemble of methods, weighting by past performance.
result P3BO outperforms individual methods, proposing higher quality and more diverse sequences.