Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,694 papers · 148 categories

Trend · papers per month

3597171,0761,434 · Jun 202019922001200920172026
48 results for Recognition Parameterised Model

InfoNCE objective is equivalent to ELBO in RPM, linking to self-supervised learning.

problem Improving self-supervised learning methods by connecting them to variational inference.
method Recognizing RPM and showing InfoNCE as a simplified lower bound on MI, equal to ELBO in infinite sample limit.
result The actual InfoNCE objective is equal to the ELBO (up to a constant) in the infinite sample limit.

We introduce a new approach to learning in hierarchical latent-variable generative models called the "distributed distributional code Helmholtz machine", which emphasises flexibility and accuracy in the inferential process. In common with the original Helmholtz machine and later variational autoencoder algorithms (but …

2018-05-28abs ↗pdf ↗

Probabilistic programming has emerged as a powerful paradigm in statistics, applied science, and machine learning: by decoupling modelling from inference, it promises to allow modellers to directly reason about the processes generating data. However, the performance of inference algorithms can be dramatically affected …

2019-06-07abs ↗pdf ↗

Wide neural networks with asymmetrical node scaling converge globally and learn features.

problem Global convergence and feature learning in over-parameterised shallow networks.
method Gradient-based optimisation of wide, shallow neural networks with asymmetrical node scaling.
result Gradient flow and gradient descent converge to a global minimum and learn features, unlike in the NTK parameterisation.

Extends hyperparameter transfer across model sizes and modules, improving training speed.

problem Training stability and performance of large-scale models with optimal hyperparameters.
method Complete(d)^{(d)} Parameterisation, per-module hyperparameter optimisation and transfer.
result Hyperparameter transfer holds even in the per-module hyperparameter regime, improving training speed.

Just as an explicit parameterisation of system dynamics by state, i.e., a choice of coordinates, can impede the identification of general structure, so it is too with an explicit parameterisation of system dynamics by control. However, such explicit and fixed parameterisation by control is commonplace in control theory…

2013-12-23abs ↗pdf ↗

The Gaussian process state space model (GPSSM) is a non-linear dynamical system, where unknown transition and/or measurement mappings are described by GPs. Most research in GPSSMs has focussed on the state estimation problem, i.e., computing a posterior of the latent state given the model. However, the key challenge in…

2017-05-30abs ↗pdf ↗

In this article we propose a generalisation of the recent work of Gatheral and Jacquier on explicit arbitrage-free parameterisations of implied volatility surfaces. We also discuss extensively the notion of arbitrage freeness and Roger Lee's moment formula using the recent analysis by Roper. We further exhibit an arbit…

2012-10-26abs ↗pdf ↗

New approach improves linear-time attention for language models.

problem Challenges of quadratic attention in long-sequence modelling, especially for discrete data.
method Reinterpreting linear attention through latent probabilistic graphical models, introducing asymmetric structure and recurrent parameterisation.
result Our model achieves competitive performance and outperforms existing linear attention variants on language modelling benchmarks.

Gating is a key technique used for integrating information from multiple sources by long short-term memory (LSTM) models and has recently also been applied to other models such as the highway network. Although gating is powerful, it is rather expensive in terms of both computation and storage as each gating unit uses a…

2018-06-18abs ↗pdf ↗

Wide stochastic networks show Gaussian behavior and improve training with PAC-Bayesian methods.

problem Analyzing and training over-parameterised neural networks with large width.
method Establishing Gaussian behavior for a stochastic architecture, applying PAC-Bayesian training.
result PAC-Bayesian training on large but finite-width networks outperforms standard methods.

Study constant mean curvature tori in R^3 using spectral data and Whitham deformations.

problem Parameterize spectral data of constant mean curvature tori in R^3.
method Use Whitham deformations, blowups, and spectral data analysis.
result Prove the Wente family is parameterized by the bisector of the right angle.

PRZI traders adapt their quote-prices based on a strategy parameter s, affecting market dynamics.

problem Understanding the dynamics of continuous double auction markets with adaptive traders.
method Introduced a new zero-intelligence trader PRZI that uses a parameterised probability distribution to generate quote-prices. Used a stochastic hill-climber algorithm to adapt strategies based on market conditions.
result The co-evolutionary dynamics of PRZI traders can lead to rich and complex market behaviors, including periods of stability and change.

Automatically learns flexible symmetry constraints in neural networks using gradients.

problem Fixed hard constraints on neural network functions that cannot be adapted.
method Improves parameterisations of soft equivariance and optimizes marginal likelihood using differentiable Laplace approximations.
result Achieves equivalent or improved performance on image classification tasks compared to baselines with hard-coded symmetry.

We study here the large-time behaviour of all continuous affine stochastic volatility models (in the sense of Keller-Ressel) and deduce a closed-form formula for the large-maturity implied volatility smile. Based on refinements of the Gartner-Ellis theorem on the real line, our proof reveals pathological behaviours of …

2012-03-22abs ↗pdf ↗

New kernel interprets 3D anisotropic data with rotations and improved predictions.

problem Capturing rotated anisotropy in 3D spatial fields.
method Introduces a Lie-algebraic kernel with three principal length-scales and an explicit rotation.
result Posterior recovers rotated anisotropy and improves prediction over axis-aligned kernels.

EmbraceNet fusion model for multi-sensor activity recognition.

problem Human activity recognition using multiple sensors is challenging.
method Independent processing of each sensor, feature fusion with EmbraceNet, post-processing, and additional processes.
result Improved performance in SHL recognition challenge.

With the recent renaissance of deep convolution neural networks, encouraging breakthroughs have been achieved on the supervised recognition tasks, where each class has sufficient training data and fully annotated training data. However, to scale the recognition to a large number of classes with few or now training samp…

2017-10-13abs ↗pdf ↗

A new method for discrete data normalizing flows using latent transformations.

problem Challenges in parameterizing bijective transformations for discrete data.
method Predict a distribution over latent transformations to make the marginal likelihood differentiable.
result Discrete-data normalizing flows can be trained using gradient-based learning with unbiased score function estimation.

In this paper we investigate whether electroencephalography (EEG) features can be used to improve the performance of continuous visual speech recognition systems. We implemented a connectionist temporal classification (CTC) based end-to-end automatic speech recognition (ASR) model for performing recognition. Our result…

2019-12-16abs ↗pdf ↗

Neural network framework for language recognition considers sequence information and improves accuracy.

problem Challenging task of automatic language identification in noisy conditions.
method Proposes a neural network framework with bidirectional LSTM and attention modeling for relevance weighting.
result Significant improvements over conventional methods in noisy conditions and multi-speaker speech.

This paper presents a novel method for structural data recognition using a large number of graph models. In general, prevalent methods for structural data recognition have two shortcomings: 1) Only a single model is used to capture structural variation. 2) Naive recognition methods are used, such as the nearest neighbo…

2017-03-08abs ↗pdf ↗

A new approach to unsupervised learning using recognition-parametrised models.

problem Discovering meaningful latent structure in observational data.
method Recognition-Parametrised Model (RPM) combining parametric and non-parametric components.
result Effective learning of latent structure without explicit generative models.

In this paper we demonstrate end-to-end continuous speech recognition (CSR) using electroencephalography (EEG) signals with no speech signal as input. An attention model based automatic speech recognition (ASR) and connectionist temporal classification (CTC) based ASR systems were implemented for performing recognition…

2019-06-17abs ↗pdf ↗

Bayesian approach optimizes quantum circuits for noisy hardware.

problem Optimizing parameterized quantum circuits on noisy quantum hardware.
method Reformulate classical optimisation as Bayesian posterior, combining cost function and prior distribution. Apply dimension reduction and posterior sampling strategies.
result Bayesian approach generates faster, less noisy circuits than classical methods.

Todays interactive devices such as smart-phone assistants and smart speakers often deal with short-duration speech segments. As a result, speaker recognition systems integrated into such devices will be much better suited with models capable of performing the recognition task with short-duration utterances. In this pap…

2019-07-22abs ↗pdf ↗

Today's proliferation of powerful facial recognition systems poses a real threat to personal privacy. As Clearview.ai demonstrated, anyone can canvas the Internet for data and train highly accurate facial recognition models of individuals without their knowledge. We need tools to protect ourselves from potential misuse…

2020-02-19abs ↗pdf ↗

VoiceFilter-Lite separates speech from background in real-time for on-device speech recognition.

problem Separate speech from background in real-time for on-device speech recognition.
method Asymmetric loss, adaptive runtime suppression, quantization to 8-bit.
result VoiceFilter-Lite achieves real-time speech separation and maintains speech recognition performance.

This paper presents a comparison of a traditional hybrid speech recognition system (kaldi using WFST and TDNN with lattice-free MMI) and a lexicon-free end-to-end (TensorFlow implementation of multi-layer LSTM with CTC training) models for German syllable recognition on the Verbmobil corpus. The results show that expli…

2019-09-19abs ↗pdf ↗

We study projective structures on a surface having poles of prescribed orders. We obtain a monodromy map from a complex manifold parameterising such structures to the stack of framed PGL2(C)\mathrm{PGL}_2(\mathbb{C}) local systems on the associated marked bordered surface. We prove that the image of this map is contained in…

2018-02-07abs ↗pdf ↗