Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,878 papers · 148 categories

Trend · papers per month

86173259345 · Jun 202019922001200920172026
48 results for numeric sequences

Improves E2E ASR performance on numeric sequences with additional training data and denormalization.

problem Challenges in recognizing numeric sequences out-of-vocabulary in ASR systems.
method Uses text-to-speech for additional numeric training data and a small-footprint neural network for denormalization.
result Reduction of WER by up to a factor of 8 in the longest numeric sequences.

Proves solution uniqueness for biomembrane shape prediction.

problem Proving solution uniqueness for the genus one Canham variational problem.
method Combining numeric analytic continuation and singularity analysis to prove non-negativity of a sequence.
result Proves positivity of the sequence, leading to solution uniqueness.

Deep neural networks struggle with numerical instability during training.

problem Numerical instability in gradient descent training of deep neural networks.
method Analysis of floating-point arithmetic and gradient descent in ReLU neural networks.
result It is highly unlikely for ReLU networks to maintain a superlinear number of affine pieces during training.

Neural networks struggle with long sequences, but a new method improves their performance.

problem Neural networks struggle to generalize to longer sequences and unseen data.
method Proposed a learned conditional masking mechanism and binary encoding for numbers.
result Models can now generalize far outside their training range with near-perfect accuracy.

New method improves Robbins-Monro algorithm convergence with prior information.

problem Improving convergence speed of Robbins-Monro algorithm.
method Integrates prior information into Robbins-Monro iteration without regression model.
result Prior-information Robbins-Monro sequence converges faster than standard.

A learning algorithm optimizes SOR solver parameters for a sequence of linear systems efficiently.

problem Optimizing solver parameters for a sequence of related linear systems without extra computations.
method Bandit and contextual bandit algorithms for online learning of optimal parameters.
result The overall cost approaches the best fixed parameter as the sequence length increases.

HARMLESS meta-learning method models short event sequences with relational information.

problem Learning heterogeneous point process models from short event sequence data.
method Hierarchical Bayesian mixture Hawkes process model with stochastic variational meta expectation maximization.
result HARMLESS outperforms existing methods in predicting future events.

Several machine learning problems arising in natural language processing can be modeled as a sequence labeling problem. We provide Gaussian process models based on pseudo-likelihood approximation to perform sequence labeling. Gaussian processes (GPs) provide a Bayesian approach to learning in a kernel based framework. …

2014-12-25abs ↗pdf ↗

nTreeClus clusters categorical sequences using tree-based learners and k-mers.

problem Challenges in clustering categorical and sequential data.
method nTreeClus uses Tree-based Learners, k-mers, and autoregressive models for categorical time series.
result nTreeClus outperformed baseline methods in various validation metrics.

For germs of subanalytic sets, we define two finite sequences of new numerical invariants. The first one is obtained by localizing the classical Lipschitz-Killing curvatures, the second one is the real analogue of the evanescent characteristics introduced by M. Kashiwara. We show that each invariant of one sequence is …

2007-06-27abs ↗pdf ↗

Bayesian model predicts sequences better than LSTMs by identifying underlying rules.

problem Current RNNs struggle to generalize from limited training data and identify underlying rules in sequences.
method Bayesian model that learns underlying concepts from sequences and generalizes to new data.
result Bayesian model predicts sequences better than traditional LSTMs.

Paper shows how online betting algorithms' regret can be used to create tight confidence sequences.

problem Estimating the expectation of random variables from samples and creating time-uniform confidence sequences.
method Converts the regret guarantee of universal portfolio algorithms into time-uniform concentration inequalities and confidence sequences.
result Numerically obtained confidence sequences are never vacuous and satisfy the law of iterated logarithm.

Given a sequential learning algorithm and a target model, sequential machine teaching aims to find the shortest training sequence to drive the learning algorithm to the target model. We present the first principled way to find such shortest training sequences. Our key insight is to formulate sequential machine teaching…

2018-10-15abs ↗pdf ↗

Understanding optimal prompts for binary sequence predictors is challenging.

problem Finding good prompts for binary sequence predictors is difficult.
method Viewing prompting as finding the best conditioning sequence on a near-optimal sequence predictor, using empirical and statistical analysis.
result Optimal prompts can be better understood given the pretraining distribution, which is not usually available.

An adversarial detector identifies anomalous sequences in sequential data.

problem Detecting anomalous sequences in one-class settings with limited data.
method Solves a minimax problem to find an optimal detector against the worst-case sequences from a generator, using marked point process model.
result Demonstrated good performance on simulations and real credit card fraud datasets.

The paper solves complex swing option pricing equations with numerical methods.

problem Valuation of swing options with jumps under a mean-reverting model.
method Proposes second-order numerical methods to solve PIDEs convection-dominated and with nonlocal integral terms.
result Numerical methods confirm second-order convergence behavior.

We study q-holonomic sequences that arise as the colored Jones polynomial of knots in 3-space. The minimal-order recurrence for such a sequence is called the (non-commutative) A-polynomial of a knot. Using the "method of guessing", we obtain this polynomial explicitly for the K_p = (-2, 3, 3+2p) pretzel knots for p = -…

2011-01-14abs ↗pdf ↗

Reservoir Computing (RC) refers to a Recurrent Neural Networks (RNNs) framework, frequently used for sequence learning and time series prediction. The RC system consists of a random fixed-weight RNN (the input-hidden reservoir layer) and a classifier (the hidden-output readout layer). Here we focus on the sequence lear…

2017-06-24abs ↗pdf ↗

AbDiffuser generates full-atom antibodies with sequence and structure fidelity.

problem Generating high-fidelity antibodies with both structure and sequence information.
method Equivariant and physics-informed diffusion model with novel protein structure representation.
result AbDiffuser generates antibodies with sequence and structural properties matching a reference set.

l1 reweighting algorithms are very popular in sparse signal recovery and compressed sensing, since in the practice they have been observed to outperform classical l1 methods. Nevertheless, the theoretical analysis of their convergence is a critical point, and generally is limited to the convergence of the functional to…

2018-12-07abs ↗pdf ↗

Numerical computations suggest that each point on a certain optimized shape called the ideal trefoil is in contact with two other points. We consider sequences of such contact points, such that each point is in contact with its predecessor and call it a billiard. Our numerics suggest that a particular billiard on the i…

2011-03-18abs ↗pdf ↗

S3^3Attention improves long sequence attention with smoothed skeleton sketching.

problem Quadratic complexity of vanilla Attention makes it unsuitable for long sequence tasks.
method S3^3Attention uses smoothing and matrix sketching to balance information preservation and computation.
result S3^3Attention significantly outperforms vanilla Attention and other Attention variants.

When learning a hidden Markov model (HMM), sequen- tial observations can often be complemented by real-valued summary response variables generated from the path of hid- den states. Such settings arise in numerous domains, includ- ing many applications in biology, like motif discovery and genome annotation. In this pape…

2015-12-16abs ↗pdf ↗

Lobb observed in [arXiv:1103.1412] that each equivariant sl(N) Khovanov-Rozansky homology over C[a] admits a standard decomposition of a simple form. In the present paper, we derive a formula for the corresponding Lee-Gornik spectral sequence in terms of this decomposition. Based on this formula, we give a simple alter…

2012-11-28abs ↗pdf ↗

Generation of pseudorandom numbers from different probability distributions has been studied extensively in the Monte Carlo simulation literature. Two standard generation techniques are the acceptance-rejection and inverse transformation methods. An alternative approach to Monte Carlo simulation is the quasi-Monte Carl…

2014-03-22abs ↗pdf ↗

We present a new theory which describes the collection of all tunnels of tunnel number 1 knots in the 3-sphere (up to orientation-preserving equivalence in the sense of Heegaard splittings) using the disk complex of the genus-2 handlebody and associated structures. It shows that each knot tunnel is obtained from the tu…

2006-11-29abs ↗pdf ↗

Framework for renewable energy forecasting and feature engineering.

problem Forecasting and feature extraction for multivariate processes in renewable energy.
method Derivative-free optimization, ensemble of sequence-to-sequence networks, additive resampling, Bootstrap aggregating.
result The proposed method outperforms other machine learning techniques in long-term forecasts and feature selection.

Proposes a method to train neural networks directly on compressed text data.

problem Training neural networks on compressed text data without decompression.
method Introduces composer modules to encode symbols from grammar compression rules into vector representations.
result Demonstrates that the proposed method can achieve both memory and computational efficiency while maintaining moderate performance.

Deep learning model forecasts PV power production with high accuracy.

problem Accurate forecasting of photovoltaic power production is needed for electricity infrastructure.
method Sequence to sequence model with attention mechanism using weather predictions and historical data.
result The model outperforms existing methods in forecast skill score.

AverageTime uses simple averaging to enhance long-term time series forecasting.

problem Long-term time series forecasting with improved intra-sequence and cross-channel dependencies.
method Proposes AverageTime, a simple, efficient, and scalable forecasting model that reframes channel extraction as a stackable architecture.
result AverageTime surpasses state-of-the-art models in forecasting performance with near-linear complexity.

SDE Matching eliminates simulation for training Latent SDEs, achieving similar performance.

problem Training Latent SDEs with adjoint sensitivity methods is computationally expensive and limited.
method SDE Matching, inspired by Score- and Flow Matching, eliminates simulation for training Latent SDEs.
result SDE Matching achieves performance comparable to adjoint sensitivity methods while reducing computational complexity.