This work compresses sequences by treating them as continuous-time processes, enabling efficient discretization.
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
Trend · papers per month
Deep generative models have been successfully used to learn representations for high-dimensional discrete spaces by representing discrete objects as sequences and employing powerful sequence-based deep models. Unfortunately, these sequence-based models often produce invalid sequences: sequences which do not represent a…
Proposes OC4Seq for detecting anomalies in discrete event sequences.
Deep learning techniques have been hugely successful for traditional supervised and unsupervised machine learning problems. In large part, these techniques solve continuous optimization problems. Recently however, discrete generative deep learning models have been successfully used to efficiently search high-dimensiona…
Study of discrete analogues of Atiyah sequence in principal bundles.
GMM-HMMs improve malware classification compared to discrete HMMs.
The paper examines special Q-nets that terminate after a finite number of Laplace steps.
Generative Adversarial Networks (GAN) have limitations when the goal is to generate sequences of discrete elements. The reason for this is that samples from a distribution on discrete objects such as the multinomial are not differentiable with respect to the distribution parameters. This problem can be avoided by using…
We study discrete conjugate nets whose Laplace sequence is of period four. Corresponding points of opposite nets in this cyclic sequence have equal osculating planes in different net directions, that is, they correspond in an asymptotic transformation. We show that this implies that the connecting lines of correspondin…
Proposes a continuous relaxation for discrete Bayesian optimization.
Anderson and Canary have shown that if the algebraic limit of a sequence of discrete, faithful representations of a finitely generated group into PSL(2,C) does not contain parabolics, then it is also the sequence's geometric limit. We construct examples that demonstrate the failure of this theorem for certain sequences…
We propose a discretization of classical confocal coordinates. It is based on a novel characterization thereof as factorizable orthogonal coordinate systems. Our geometric discretization leads to factorizable discrete nets with a novel discrete analog of the orthogonality property. A discrete confocal coordinate system…
Sequence-to-sequence text-to-speech (TTS) is dominated by soft-attention-based methods. Recently, hard-attention-based methods have been proposed to prevent fatal alignment errors, but their sampling method of discrete alignment is poorly investigated. This research investigates various combinations of sampling methods…
Connections on principal bundles play a fundamental role in expressing the equations of motion for mechanical systems with symmetry in an intrinsic fashion. A discrete theory of connections on principal bundles is constructed by introducing the discrete analogue of the Atiyah sequence, with a connection corresponding t…
This paper derives a diffusion approximation for a sequence of discrete-time one-sided limit order book models with non-linear state dependent order arrival and cancellation dynamics. The discrete time sequences are specified in terms of an -valued best bid price process and an -valued volume process. …
We consider sequences of finitely generated discrete subgroups Gamma_i=rho_i(Gamma) of a rank 1 Lie group G, where the representations rho_i are not necessarily faithful. We show that, for algebraically convergent sequences (Gamma_i), unless Gamma_i's are (eventually) elementary or contain normal finite subgroups of ar…
Normalizing flows are a powerful class of generative models for continuous random variables, showing both strong model flexibility and the potential for non-autoregressive generation. These benefits are also desired when modeling discrete random variables such as text, but directly applying normalizing flows to discret…
There are certain families of words and word sequences (words in the generators of a two-generator group) that arise frequently in the Teichm{ü}ller theory of hyperbolic three-manifolds and Kleinian and Fuchsian groups and in the discreteness problem for two generator matrix groups. We survey some of the families of su…
New algorithm estimates intrinsic dimension of discrete datasets.
Recurrent models for sequences have been recently successful at many tasks, especially for language modeling and machine translation. Nevertheless, it remains challenging to extract good representations from these models. For instance, even though language has a clear hierarchical structure going from characters throug…
New spectral sequences derived from shellable tilings.
Paper analyzes symbolic-dynamics inspired Markov modeling for time-series data.
A 2-manifold's group structure is deduced from orbit configuration spaces.
Survey and benchmark high-dimensional Bayesian optimization of discrete sequences.
Discretizes Helfrich-type energies on surfaces using triangular complexes.
DFMs enable flow-based models for multimodal discrete and continuous data.
SocialInteractionGAN generates realistic human interactions from low-dimensional data.
Branching Flows generates sequences of varying lengths using binary trees.
Deep network predicts action sequences for complex tasks from a scene image.
Two geometric tests for forward-flatness are shown to be dual.
This paper addresses the morphing of manifold-valued images based on the time discrete geodesic paths model of Berkels, Effland and Rumpf 2015. Although for our manifold-valued setting such an interpretation of the energy functional is not available so far, the model is interesting on its own. We prove the existence of…
A Darboux transformation for polarized space curves is introduced and its properties are studied, in particular, Bianchi permutability. Semi-discrete isothermic surfaces are described as sequences of Darboux transforms of polarized curves in the conformal n-sphere and their transformation theory is studied. Semi-discre…
We consider the class of compact n-dimensional Riemannian manifolds with cylindrical boundary, Ricci curvature bounded below by a given constant and injectivity radius bounded below by a positive constant, away from the boundary. For a manifold M of this class, we introduce a notion of discretization, leading to a grap…
We examine Kreps' (2019) conjecture that optimal expected utility in the classic Black--Scholes--Merton (BSM) economy is the limit of optimal expected utility for a sequence of discrete-time economies that "approach" the BSM economy in a natural sense: The th discrete-time economy is generated by a scaled -step r…
Process Monitoring involves tracking a system's behaviors, evaluating the current state of the system, and discovering interesting events that require immediate actions. In this paper, we consider monitoring temporal system state sequences to help detect the changes of dynamic systems, check the divergence of the syste…
Given a trivalent graph in the 3-dimensional Euclidean space, we call it a discrete surface because it has a tangent space at each vertex determined by its neighbor vertices. To abstract a continuum object hidden in the discrete surface, we introduce a subdivision method by applying the Goldberg-Coxeter subdivision and…
Researchers develop flexible kernels for biological sequences with guaranteed reliability.
Duality principle for approximation of geometrical objects (also known as Eudoxus exhaustion method) was extended and perfected by Archimedes in his famous tractate "Measurement of circle". The main idea of the approximation method by Archimedes is to construct a sequence of pairs of inscribed and circumscribed polygon…
A new dual test for forward-flatness simplifies computations.
The paper confirms a conjecture about optimal expected utility in markets with insider information.
A formula connects discrete harmonic surfaces to holomorphic functions.
Improved text generation with constraints using discrete auto-regressive biasing.
We study Betti numbers of sequences of Riemannian manifolds which Benjamini-Schramm converge to their universal covers. Using the Price inequalities we developed elsewhere, we derive two distinct convergence results. First, under a negative Ricci curvature assumption and no assumption on sign of the sectional curvature…
Given a finite set of points in and a radius parameter, we study the Čech, Delaunay-Čech, Delaunay (or Alpha), and Wrap complexes in the light of generalized discrete Morse theory. Establishing the Čech and Delaunay complexes as sublevel sets of generalized discrete Morse functions, we prove that the four…
We introduce a new neural architecture to learn the conditional probability of an output sequence with elements that are discrete tokens corresponding to positions in an input sequence. Such problems cannot be trivially addressed by existent approaches such as sequence-to-sequence and Neural Turing Machines, because th…
This primer explains diffusion models in general state spaces.
We present a new method for nonlinear prediction of discrete random sequences under minimal structural assumptions. We give a mathematical construction for optimal predictors of such processes, in the form of hidden Markov models. We then describe an algorithm, CSSR (Causal-State Splitting Reconstruction), which approx…
Kernel methods on discrete domains have shown great promise for many challenging data types, for instance, biological sequence data and molecular structure data. Scalable kernel methods like Support Vector Machines may offer good predictive performances but do not intrinsically provide uncertainty estimates. In contras…