Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

169,051 papers · 148 categories

Trend · papers per month

3897781,1671,556 · Jun 202019922001200920182026
48 results for filter learning

Filtering data with a pre-trained model improves multimodal contrastive learning performance.

problem Improving the quality of internet-scale multimodal datasets.
method Characterized the performance of filtered contrastive learning under a bimodal data generation model.
result Data filtering using a pre-trained model reduces contrastive learning error by a factor of η\sqrt{η} in the large ηη regime.

Develops Bayesian filtering for online learning and related problems.

problem Sequential machine learning challenges, especially non-stationarity, model misspecification, and high dimensionality.
method Modular adaptive framework, provably robust filter, and sequential parameter updates.
result Improved performance in dynamic, high-dimensional, and misspecified models.

The paper learns an autoregressive filter for unknown dynamical systems with robust guarantees.

problem Learning optimal predictions in an unknown dynamical system.
method Directly learns an autoregressive filter using an LL^\infty-based objective, regressing on both inputs and outputs.
result The algorithm has optimal sample complexity in terms of the rollout length.

RNF learns distinct representations for Bayesian filtering steps, improving time series prediction accuracy and uncertainty.

problem Improving time series prediction accuracy and uncertainty using distinct representations for Bayesian filtering steps.
method Introduces Recurrent Neural Filter (RNF) architecture that learns distinct representations for each Bayesian filtering step.
result RNF improves accuracy of one-step-ahead forecasts and provides realistic uncertainty estimates.

This paper proves long-time accuracy of ensemble Kalman filters for chaotic and machine-learned systems.

problem Ensuring long-term accuracy of ensemble Kalman filters for complex dynamical systems.
method Established conditions for long-time accuracy of ensemble Kalman filters for chaotic and machine-learned dynamical systems.
result Ensemble Kalman filters maintain small estimation error over long time horizons for chaotic and machine-learned systems.

A new ML-based filter improves data assimilation for nonlinear systems.

problem Improving data assimilation for nonlinear systems using ensemble methods.
method Developed a machine learning-based conditional mean filter (ML-EnCMF) integrating ANN and linear functions.
result ML-EnCMF outperforms EnKF and likelihood-based EnCMF in nonlinear systems.

Recursive KalmanNet combines neural networks with Kalman filters for precise state estimation.

problem State estimation in systems with noisy measurements and non-Gaussian noise.
method Recursive KalmanNet uses a recurrent neural network to estimate states with consistent error covariance, optimizing for Gaussian negative log-likelihood.
result Recursive KalmanNet outperforms conventional Kalman filters and deep learning-based estimators in non-Gaussian noise conditions.

NBF combines deep learning with classical filtering for better belief tracking.

problem Maintaining distributions over hidden states in partially observable systems.
method Trains neural networks to map beliefs to fixed-length vectors, updating them with incoming observations and dynamics.
result NBF efficiently tracks shifting, multimodal beliefs without particle impoverishment.

Convolutional neural networks (CNNs) have recently emerged as a popular building block for natural language processing (NLP). Despite their success, most existing CNN models employed in NLP share the same learned (and static) set of filters for all input sentences. In this paper, we consider an approach of using a smal…

2017-09-25abs ↗pdf ↗

Graph filtering framework improves semi-supervised learning efficiency.

problem Efficiently leverage unlabeled data with limited labeled data.
method Graph filtering to inject graph similarity into data features.
result Unified insights and improved modeling capabilities of label propagation and graph convolutional networks.

QFIL improves offline RL by filtering data to reduce bias and variance.

problem Improving offline reinforcement learning policies with limited data.
method QFIL uses a filtered dataset to improve policies, trading off bias and variance through quantile selection.
result QFIL provides a safe policy improvement step with function approximation and effectively balances bias and variance.

AD-EnKFs use machine learning to improve data assimilation in high-dimensional systems.

problem Data assimilation in high-dimensional, unknown dynamics systems.
method Auto-differentiable ensemble Kalman filters blending machine learning and ensemble Kalman filters.
result AD-EnKFs outperform existing methods in the Lorenz-96 model.

Data is said to follow the transform (or analysis) sparsity model if it becomes sparse when acted on by a linear operator called a sparsifying transform. Several algorithms have been designed to learn such a transform directly from data, and data-adaptive sparsifying transforms have demonstrated excellent performance i…

2018-03-06abs ↗pdf ↗

We generate transformation-invariant CNNs using context-aware filters.

problem Creating transformation-invariant neural networks for image recognition.
method Input-conditioned convolution filters combined with max-pooling and multi-instance learning.
result Significantly improved error rates on MNIST variations (1.13% on MNIST-rot-12k, 1.12% on Half-rotated MNIST, 0.68% on Scaling MNIST).

We cast Amari's natural gradient in statistical learning as a specific case of Kalman filtering. Namely, applying an extended Kalman filter to estimate a fixed unknown parameter of a probabilistic model from a series of observations, is rigorously equivalent to estimating this parameter via an online stochastic natural…

2017-03-01abs ↗pdf ↗

FLUID uses flows to unify filtering and smoothing for complex systems.

problem Bayesian filtering and smoothing for high-dimensional nonlinear systems.
method FLUID encodes observation histories into a fixed summary statistic, using flows for filtering and smoothing.
result FLUID provides accurate approximations of filtering and smoothing distributions.

Deep density methods improve filtering in high-dimensional systems.

problem Nonlinear filtering in high-dimensional systems.
method Two deep density methods based on Feynman-Kac formulas and neural networks.
result Logarithmic deep backward stochastic differential equation filter outperforms classical methods in high dimensions.

Extended Kalman Filter is shown to be a gradient descent in trajectory space.

problem Estimating state of dynamical systems from noisy measurements.
method Recovery of extended Kalman filter equations from Amari's natural gradient in trajectory space.
result Extended Kalman Filter is equivalent to natural gradient descent in trajectory space.

Enhanced ensemble filters use machine learning to improve accuracy in filtering models.

problem Accuracy limitations of traditional ensemble Kalman filters.
method Introduces a measure neural mapping (MNM) to map joint predicted state and observation to updated state estimates.
result Superior root-mean-square-error performance compared to leading methods in filtering models.

The paper explores modifications to filter banks for speech recognition.

problem Improving speech recognition accuracy using modified filter banks.
method The authors investigate replacing triangular filters with Gabor or Gammatone filters, and rearranging filter bank computations to integrate features over smaller time scales.
result No significant improvements in phone error rate were observed with the modifications.

Develops inverse EKF for non-linear systems with stability guarantees and learning unknown dynamics.

problem Estimating adversary's Kalman-filtered estimates in highly non-linear systems.
method Proposes inverse extended Kalman filter (I-EKF) for second-order, Gaussian sum, and dithered forward models. Uses reproducing kernel Hilbert space for learning unknown dynamics.
result Derives theoretical stability guarantees for inverse second-order EKF.

A Bloom filter approach combined with Transformer models improves accuracy for machine learning tasks on opaque IDs.

problem Improving accuracy for machine learning tasks on opaque IDs with large vocabulary sizes.
method Applying hash functions to map opaque IDs to multiple hash tokens, similar to a Bloom filter, and using a multi-layer Transformer to process these digests.
result Models outperform those without hashing and sampled softmax, achieving high accuracy with a smaller computational budget.

We propose a cloud-based filter trained to block third parties from uploading privacy-sensitive images of others to online social media. The proposed filter uses Distributed One-Class Learning, which decomposes the cloud-based filter into multiple one-class classifiers. Each one-class classifier captures the properties…

2018-02-10abs ↗pdf ↗

Gradient filters track moving parameters under noisy data and misspecification.

problem Tracking multidimensional time-varying parameters under noisy observations and model misspecification.
method Gradient-based filters update parameters using the gradient of a postulated objective function, evaluated at either the predicted or updated parameters.
result Novel sufficient conditions for exponential stability of the filtered parameter path, and finite-sample and asymptotic mean squared error bounds.