Adaptive Gaussian kernel filtering with updated parameters.
problem Improving kernel adaptive filtering for better performance.
method Adaptive updating of Gaussian kernel parameters on an SPD manifold.
result Validation of the proposed method through experimental results.
A new approach to kernel adaptive filters reduces sparsity for monotonic signals.
problem Kernel adaptive filters struggle with trivial monotonic signals, leading to inaccurate predictions and high computational complexity.
method Proposes a unit-norm Gaussian kernel and sparsification criterion to compare new observations against dictionary samples.
result The method achieves more accurate predictions and smaller dictionary size compared to standard KAF.
Paper presents a fast and adaptive filter for SI suppression in full-duplex transceivers.
problem Self-interference suppression in full-duplex transceivers with nonlinearity.
method Adaptive projected subgradient method (APSM) in a reproducing kernel Hilbert space (RKHS).
result The proposed method achieves favorable digital SIC performance compared to benchmarks.
A new asymmetric correntropy method improves robust adaptive filtering for asymmetric error distributions.
problem Inadequate handling of asymmetric error distributions in adaptive filtering.
method Proposes asymmetric correntropy using an asymmetric Gaussian kernel and develops a robust adaptive filtering algorithm.
result The proposed algorithm shows better steady-state convergence performance for asymmetric error distributions.
A probabilistic framework optimizes kernel adaptive filters for better performance.
problem Improving the performance of kernel adaptive filters.
method Formulating a probabilistic model with prior distributions over weights, dictionaries, and kernel parameters. Using gradient-based maximum-a-posteriori optimisation and Markov chain Monte Carlo methods.
result The framework outperformed standard KAFs in terms of mean square error and dictionary sparsity.
No-trick kernel adaptive filtering uses deterministic features for scalability and robustness.
problem Scalability issues in kernel methods for large datasets.
method Deterministic feature-map construction using polynomial-exact solutions.
result Deterministic features outperform random Fourier features in performance and scalability.
In most adaptive signal processing applications, system linearity is assumed and adaptive linear filters are thus used. The traditional class of supervised adaptive filters rely on error-correction learning for their adaptive capability. The kernel method is a powerful nonparametric modeling tool for pattern analysis a…
Proposes a Gaussian process for graph signals using adaptive spectral kernels.
problem Predicting signals on graph nodes with various structures.
method Spectral kernel learning approach that incorporates a polynomial function in the graph spectral domain.
result The model accurately recovers ground truth spectral filters and outperforms in real-world graph data.
Kernel learning FBSDE filter improves nonlinear filtering efficiency.
problem Nonlinear filtering problem in high-dimensional systems.
method Iterative and adaptive meshfree approach using forward backward SDE and KDE.
result Rigorous convergence analysis provided, supporting empirical results.
Kernel adaptive filters (KAF) are a class of powerful nonlinear filters developed in Reproducing Kernel Hilbert Space (RKHS). The Gaussian kernel is usually the default kernel in KAF algorithms, but selecting the proper kernel size (bandwidth) is still an open important issue especially for learning with small sample s…
As a robust nonlinear similarity measure in kernel space, correntropy has received increasing attention in domains of machine learning and signal processing. In particular, the maximum correntropy criterion (MCC) has recently been successfully applied in robust regression and filtering. The default kernel function in c…
The kernel least mean squares (KLMS) algorithm is a computationally efficient nonlinear adaptive filtering method that "kernelizes" the celebrated (linear) least mean squares algorithm. We demonstrate that the least mean squares algorithm is closely related to the Kalman filtering, and thus, the KLMS can be interpreted…
Paper adapts SVDD for 3D-shapes filtering and outlier detection.
problem Filtering and detecting outliers in 3D-shapes.
method Adapted SVDD to SimpleMKL, developing Slim-MK-SVDD for tighter boundaries.
result Slim-MK-SVDD produces a tighter boundary around data.
Appropriately designing the proposal kernel of particle filters is an issue of significant importance, since a bad choice may lead to deterioration of the particle sample and, consequently, waste of computational power. In this paper we introduce a novel algorithm adaptively approximating the so-called optimal proposal…
Nonlinear similarity measures defined in kernel space, such as correntropy, can extract higher-order statistics of data and offer potentially significant performance improvement over their linear counterparts especially in non-Gaussian signal processing and machine learning. In this work, we propose a new similarity me…
Study on discrepancy principle for learning algorithms in nonparametric regression.
problem Determining optimal iteration number in nonparametric regression with unknown optimal iteration.
method Investigates discrepancy principle and modified principles for kernelized spectral filters, using deviation inequalities and change-of-norm arguments.
result Classical discrepancy principle is adaptive for slow rates, while modified principles are adaptive for faster rates.
The paper develops a heat kernel expansion for Rockland operators on filtered manifolds.
problem Analyzing heat kernel expansions for non-commutative geometries.
method Established a universal heat kernel expansion for Rockland operators on closed filtered manifolds using a new calculus.
result Implications of the heat expansion for complex powers, heat trace asymptotics, and eigenvalue asymptotics are generalized to this new calculus.
Framework expands particle filtering to estimate states beyond prior boundaries.
problem Limitations of traditional particle filtering in estimating states outside prior support.
method Diffusion-Enhanced Particle Filtering Framework with adaptive diffusion, entropy-driven regularisation, and kernel-based perturbations.
result Framework significantly improves state estimation accuracy and success rates for out-of-boundary targets.
Large filters improve performance but are costly; this work uses learned box filters and summed-area tables.
problem Improving performance in dense prediction tasks like human pose estimation with large filters.
method Adopted learnable box filters and summed-area tables to reduce computational cost and maintain performance.
result Demonstrated competitive performance on human pose estimation benchmarks.
Kernel-based Bayesian filter for nonlinear systems using infinite-dimensional operators.
problem Modeling and predicting nonlinear dynamical systems.
method Functional Bayesian perspective, reproducing kernel Hilbert space, Gaussian kernel.
result Effective approximation and accurate results for nonlinear systems.
The kernel least-mean-square (KLMS) algorithm is an appealing tool for online identification of nonlinear systems due to its simplicity and robustness. In addition to choosing a reproducing kernel and setting filter parameters, designing a KLMS adaptive filter requires to select a so-called dictionary in order to get a…
In kernel methods, temporal information on the data is commonly included by using time-delayed embeddings as inputs. Recently, an alternative formulation was proposed by defining a gamma-filter explicitly in a reproducing kernel Hilbert space, giving rise to a complex model where multiple kernels operate on different t…
On-line estimation plays an important role in process control and monitoring. Obtaining a theoretical solution to the simultaneous state-parameter estimation problem for non-linear stochastic systems involves solving complex multi-dimensional integrals that are not amenable to analytical solution. While basic sequentia…
Proposes random Euler filters for efficient complex-valued nonlinear signal processing.
problem Efficiently processing complex-valued nonlinear signals with reduced computational cost.
method Introduces linear and widely-linear random Euler complex-valued filters with fixed network structures.
result Analytical minimum mean square error and optimum step-size derived for transient and steady-state performances.
New adaptive algorithms improve learning rate and reduce complexity.
problem Nonlinear system identification and prediction with large parameters.
method Data-selective adaptive kernel normalized least-mean square (KNLMS) algorithms.
result Proposed algorithms outperform existing methods in nonlinear system identification and prediction.
EnEMF uses Epanechnikov kernel for high-dimensional filtering, improving accuracy and robustness.
problem Suboptimal Gaussian mixture kernel density estimates in high-dimensional settings.
method Ensemble Epanechnikov mixture filter (EnEMF) using optimal Epanechnikov kernel.
result EnEMF reduces error per particle on high-dimensional systems like Lorenz '96.
Recently, the Frank-Wolfe optimization algorithm was suggested as a procedure to obtain adaptive quadrature rules for integrals of functions in a reproducing kernel Hilbert space (RKHS) with a potentially faster rate of convergence than Monte Carlo integration (and "kernel herding" was shown to be a special case of thi…
New filter bank regularization improves DCNNs by incorporating image priors.
problem Improving DCNNs' robustness and generality.
method Structured filter bank regularization of DCNN kernels.
result Filter bank regularization leads to faster convergence and better generalization.
This paper introduces the kernel mixture network, a new method for nonparametric estimation of conditional probability densities using neural networks. We model arbitrarily complex conditional densities as linear combinations of a family of kernel functions centered at a subset of training points. The weights are deter…
We propose a novel adaptive learning algorithm based on iterative orthogonal projections in the Cartesian product of multiple reproducing kernel Hilbert spaces (RKHSs). The task is estimating/tracking nonlinear functions which are supposed to contain multiple components such as (i) linear and nonlinear components, (ii)…
Unified analysis of kernel ridge regression methods for pairwise learning.
problem Theoretical analysis of kernel-based pairwise learning methods.
method Unified review and analysis of kernel ridge regression methods.
result Kronecker kernel ridge regression unifies and explains existing methods.
Latent FxLMS accelerates ANC by adapting along low-dimensional filter weights.
problem Improving active noise control with neural adaptive filters.
method Training an auto-encoder on filter coefficients, constraining weights to latent variables, and updating in latent space.
result Latent FxLMS converges in fewer steps with comparable error to standard FxLMS.
Paper develops a particle filter for rapid model parameter adaptation and change detection.
problem Rapidly adapting to changes in model parameters and distinguishing between regime shifts and stochastic volatility.
method Incorporates genetic algorithm elements into a particle filter for accelerated adaptation and change detection.
result The filter adapts to regime shifts extremely rapidly and provides a clear heuristic for distinguishing between regime shifts and stochastic volatility.
This paper uses Bayesian optimization to efficiently identify stochastic dynamical systems.
problem Efficiently identifying linear stochastic dynamical systems with unknown coefficients and noise variances.
method Adaptive Bayesian optimization with ensemble Gaussian processes (EGP) and Kalman filter recursion.
result BO-based estimator achieves RMSE below the Cramer-Rao bound, improving robustness and consistency.
We revisit the Bayesian online inference problems for the linear dynamic systems (LDS) under non- Gaussian environment. The noises can naturally be non-Gaussian (skewed and/or heavy tailed) or to accommodate spurious observations, noises can be modeled as heavy tailed. However, at the cost of such noise robustness, the…
DNNs improve SIMP method but not spatially invariant, study shows.
problem Improving SIMP method with DNNs but maintaining spatial invariance.
method Use of DNNs for density field generation, study of NTK filter properties.
result DNNs lead to a non-spatially invariant filter, requiring embeddings for spatial invariance.
New adaptive filters reduce energy consumption in electronic devices.
problem Reducing energy consumption in adaptive filtering algorithms.
method Data-selective adaptive filters, set-membership (SM) filters, trinion and quaternion systems, partial-updating, LMS and recursive LMS algorithms.
result Improved adaptive filtering algorithms with reduced computational complexity and enhanced stability.
This paper addresses the problem of filtering with a state-space model. Standard approaches for filtering assume that a probabilistic model for observations (i.e. the observation model) is given explicitly or at least parametrically. We consider a setting where this assumption is not satisfied; we assume that the knowl…
Adaptive filtering algorithms operating in reproducing kernel Hilbert spaces have demonstrated superiority over their linear counterpart for nonlinear system identification. Unfortunately, an undesirable characteristic of these methods is that the order of the filters grows linearly with the number of input data. This …
Transformers can approximate Kalman Filtering in linear systems with small error.
problem Approximating Kalman Filtering using Transformers for linear dynamical systems.
method Two-step reduction: 1) Softmax self-attention block approximates Nadaraya-Watson kernel smoothing, 2) This estimator approximates Kalman Filter.
result Constructs a Transformer that implements the Kalman Filter with small additive error, uniformly bounded in time.
In this paper we formally analyse the use of sparse filtering algorithms to perform covariate shift adaptation. We provide a theoretical analysis of sparse filtering by evaluating the conditions required to perform covariate shift adaptation. We prove that sparse filtering can perform adaptation only if the conditional…
Paper develops a graph-based method for reconstructing spatio-temporal signals.
problem Reconstructing space-time varying signals on graphs given limited data.
method Multi-kernel Kriged Kalman Filter combining graph-aware kernels and online selection.
result Superior reconstruction performance compared to existing methods.
Paper develops a method to identify graphs and filters from filtered signals.
problem Learning graphs and filters from filtered signals.
method Developed an algorithm to jointly identify a graph and a graph-based filter (GBF) from multiple signal/data observations.
result The proposed algorithm outperforms current state-of-the-art methods.
We propose a new formulation for pruning convolutional kernels in neural networks to enable efficient inference. We interleave greedy criteria-based pruning with fine-tuning by backpropagation - a computationally efficient procedure that maintains good generalization in the pruned network. We propose a new criterion ba…
Adaptive Heston model calibration using PCRLB and switching filters.
problem Estimating volatility in stochastic volatility models like Heston.
method Bayesian filtering (EKF, UKF, PF) with PCRLB for parameter estimation.
result Adaptive estimation of Heston model parameters improves volatility estimation.
New filters match advanced composition for adaptive privacy, with practical constants.
problem Limitations of existing adaptive composition methods.
method Constructed new filters and odometers that match advanced composition rates, including constants.
result Achieved fully adaptive privacy with practical filters and odometers.
ABO extends RLS for online learning in non-stationary time-series, improving accuracy and speed.
problem Online learning in non-stationary time-series with overparameterized models.
method QR-based exponentially weighted RLS algorithm with orthogonal-triangular updates.
result ABO maintains bounded residuals and stable condition numbers while achieving speed improvements.
CNNs become Gaussian processes with many filters, achieving state-of-the-art performance.
problem Training deep CNNs is computationally expensive.
method Showed that CNNs with many filters can be approximated by Gaussian processes, and computed the equivalent kernel efficiently.
result The kernel equivalent of a 32-layer ResNet achieves 0.84% classification error on MNIST.