A new filter design improves system identification accuracy.
problem Improving system identification accuracy for various system types.
method Generalized proportionate-type normalized subband adaptive filter (GPtNSAF) using least squares on subband errors with a sparsity penalty.
result GPtNSAF benefits from increasing subbands more than sparsity for quasi-sparse or dispersive systems, and both aspects are complementary for sparse systems.
Two sparsity-aware NSAF algorithms improve sparse system identification with lower complexity.
problem Sparse system identification with improved performance and lower complexity.
method Gradient descent method to minimize combined cost function and l1-norm penalty on filter coefficients.
result Proposed algorithms achieve comparable performance with lower computational complexity.
Recent advances in analysis of subband amplitude envelopes of natural sounds have resulted in convincing synthesis, showing subband amplitudes to be a crucial component of perception. Probabilistic latent variable analysis is particularly revealing, but existing approaches don't incorporate prior knowledge about the ph…
Unsupervised method removes satellite noise without paired data.
problem Image artifacts from satellite sensor noises affect quality and applications.
method Wavelet subband cycleGAN using adversarial and cycle-consistency losses.
result Effectively removes satellite noise while preserving high frequency features.
This paper presents a learning method for convolutional autoencoders (CAEs) for extracting features from images. CAEs can be obtained by utilizing convolutional neural networks to learn an approximation to the identity function in an unsupervised manner. The loss function based on the pixel loss (PL) that is the mean s…
We propose a low-complexity sub-banded DSP architecture for digital backpropagation where the walk-off effect is compensated using simple delay elements. For a simulated 96-Gbaud signal and 2500 km optical link, our method achieves a 2.8 dB SNR improvement over linear equalization.
AaSP improves audio self-supervised learning by addressing aliasing issues.
problem Alias issues in audio spectrogram transformers.
method AaSP combines aliasing-aware patch representation, teacher-student masked modeling, cross-attention predictor, and contrastive regularization.
result AaSP learns more stable representations that integrate high-frequency cues.
Latent FxLMS accelerates ANC by adapting along low-dimensional filter weights.
problem Improving active noise control with neural adaptive filters.
method Training an auto-encoder on filter coefficients, constraining weights to latent variables, and updating in latent space.
result Latent FxLMS converges in fewer steps with comparable error to standard FxLMS.
New adaptive filters reduce energy consumption in electronic devices.
problem Reducing energy consumption in adaptive filtering algorithms.
method Data-selective adaptive filters, set-membership (SM) filters, trinion and quaternion systems, partial-updating, LMS and recursive LMS algorithms.
result Improved adaptive filtering algorithms with reduced computational complexity and enhanced stability.
GA optimizes EEG feature selection for BCI systems, improving classification accuracy.
problem Finding optimal EEG features for accurate classification in BCI systems.
method Genetic Algorithm (GA) for feature selection and classifier optimization.
result Katz fractal feature with LDA yields highest fitness value.
In this paper we formally analyse the use of sparse filtering algorithms to perform covariate shift adaptation. We provide a theoretical analysis of sparse filtering by evaluating the conditions required to perform covariate shift adaptation. We prove that sparse filtering can perform adaptation only if the conditional…
This paper presents the construction of a particle filter, which incorporates elements inspired by genetic algorithms, in order to achieve accelerated adaptation of the estimated posterior distribution to changes in model parameters. Specifically, the filter is designed for the situation where the subsequent data in on…
Adaptive Heston model calibration using PCRLB and switching filters.
problem Estimating volatility in stochastic volatility models like Heston.
method Bayesian filtering (EKF, UKF, PF) with PCRLB for parameter estimation.
result Adaptive estimation of Heston model parameters improves volatility estimation.
New filters match advanced composition for adaptive privacy, with practical constants.
problem Limitations of existing adaptive composition methods.
method Constructed new filters and odometers that match advanced composition rates, including constants.
result Achieved fully adaptive privacy with practical filters and odometers.
A new asymmetric correntropy method improves robust adaptive filtering for asymmetric error distributions.
problem Inadequate handling of asymmetric error distributions in adaptive filtering.
method Proposes asymmetric correntropy using an asymmetric Gaussian kernel and develops a robust adaptive filtering algorithm.
result The proposed algorithm shows better steady-state convergence performance for asymmetric error distributions.
BankGCN improves graph convolution networks by handling multi-channel signals with adaptive filter banks.
problem Handling multi-channel graph signals with limited architectures.
method BankGCN decomposes multi-channel signals into subspaces and uses adapted filters for each subspace.
result BankGCN achieves excellent performance in graph classification on benchmark datasets.
Paper presents a fast and adaptive filter for SI suppression in full-duplex transceivers.
problem Self-interference suppression in full-duplex transceivers with nonlinearity.
method Adaptive projected subgradient method (APSM) in a reproducing kernel Hilbert space (RKHS).
result The proposed method achieves favorable digital SIC performance compared to benchmarks.
We study trend filtering, a recently proposed tool of Kim et al. [SIAM Rev. 51 (2009) 339-360] for nonparametric regression. The trend filtering estimate is defined as the minimizer of a penalized least squares criterion, in which the penalty term sums the absolute kth order discrete derivatives over the input points…
The present paper proposes generalized Gaussian kernel adaptive filtering, where the kernel parameters are adaptive and data-driven. The Gaussian kernel is parametrized by a center vector and a symmetric positive definite (SPD) precision matrix, which is regarded as a generalization of the scalar width parameter. These…
Optimizes particle filtering for non-stationary environments.
problem Tracking and adapting to non-stationary environments in online prediction.
method Formulated an efficient particle filtering method using online mirror descent algorithm.
result Achieves optimal particle efficiency in non-stationary environments.
Constrained adaptive filtering algorithms inculding constrained least mean square (CLMS), constrained affine projection (CAP) and constrained recursive least squares (CRLS) have been extensively studied in many applications. Most existing constrained adaptive filtering algorithms are developed under mean square error (…
Bayesian filtering unifies adaptive and non-adaptive neural network optimization methods.
problem Optimizing neural networks using standard methods like Adam and RMSprop.
method Formulated as Bayesian filtering, accounting for temporal dynamics of all parameters.
result Recover Adam and AdamW optimizers with competitive generalization performance.
Develops Bayesian filtering for online learning and related problems.
problem Sequential machine learning challenges, especially non-stationarity, model misspecification, and high dimensionality.
method Modular adaptive framework, provably robust filter, and sequential parameter updates.
result Improved performance in dynamic, high-dimensional, and misspecified models.
HKF uses neural networks to adapt Kalman filters for dynamic channel tracking.
problem Tracking channels with varying dynamics and Doppler values.
method Combines Kalman filters with hypernetworks for dynamic adaptation.
result HKF achieves up to 2dB gain over Kalman filters at high Doppler values.
We introduce a family of adaptive estimators on graphs, based on penalizing the ℓ1 norm of discrete graph differences. This generalizes the idea of trend filtering [Kim et al. (2009), Tibshirani (2014)], used for univariate nonparametric regression, to graphs. Analogous to the univariate case, graph trend filteri…
This paper presents a novel adaptive-filter approach for predicting assets on the stock markets. Concepts are introduced here, which allow understanding this method and computing of the corresponding forecast. This approach is applied, as an example, through the prediction over the actual valuation of the PETR3 shares …
Framework expands particle filtering to estimate states beyond prior boundaries.
problem Limitations of traditional particle filtering in estimating states outside prior support.
method Diffusion-Enhanced Particle Filtering Framework with adaptive diffusion, entropy-driven regularisation, and kernel-based perturbations.
result Framework significantly improves state estimation accuracy and success rates for out-of-boundary targets.
Graph Kalman filters adapt classical filters to graph data.
problem Adapting classical Kalman filters to graph data.
method Generalizes Kalman filters to attributed graphs, learning state-transition and readout functions end-to-end.
result Adapted Kalman filters can predict graph outputs.
Paper proposes an online adaptation algorithm for improving model performance.
problem Improving model fidelity in real-time for domain shift and time variance.
method Extended Kalman Filter with Exponential Moving Average and Dynamic Multi-Epoch strategy.
result Proposed algorithm outperforms existing methods in experiments.
Paper proposes a DNN-driven AF framework for improved generalization.
problem Generalization challenge in adaptive filtering.
method Structural embedding of DNN into AF system, using maximum likelihood as implicit cost function.
result Demonstrates improved generalization capability through extensive experiments.
We introduce a probabilistic approach to the LMS filter. By means of an efficient approximation, this approach provides an adaptable step-size LMS algorithm together with a measure of uncertainty about the estimation. In addition, the proposed approximation preserves the linear complexity of the standard LMS. Numerical…
A new filter adapts to heavy-tailed data without tuning, improving performance in challenging conditions.
problem Degraded performance of Kalman and EnKF in heavy-tailed distributions.
method Generalizes EnKF using t-distributions, estimating parameters via EM algorithm.
result Improves performance on challenging filtering problems with heavy-tailed noise.
Proposes a Kalman Filter modifier to improve neural network performance in changing environments.
problem Maintaining performance of neural networks in non-stationary environments.
method Kalman Filter based modifier to adapt to changes.
result The proposed model adapts better to changes with a 0.4% accuracy drop compared to 90% for conventional models.
New deep learning method approximates Benes filter model.
problem Approximating high-dimensional SPDEs for filtering.
method Deep learning mesh-free neural network representation.
result First study of neural network method for Benes model.
Extends DRFGP to make GPs more robust and adaptive for dynamic, noisy data.
problem Limited scalability, static targets, and brittleness to outliers in GPs.
method Introduces robust-filtering update and dynamic adaptation mechanism.
result Enhanced stability and accuracy in modeling dynamic, noisy data.
Proposes IFCDA framework to improve cross-domain adaptation.
problem Negative transfer and difficulty in handling category-irrelevant losses in DA.
method Importance filtered mechanism to generate filtered soft labels, combined with graph-based label propagation.
result Significantly improves performance in both Closed-Set and Open-Set DA scenarios.
We find a novel correlation structure in the residual noise of stock market returns that is remarkably linked to the composition and stability of the top few significant factors driving the returns, and moreover indicates that the noise band is composed of multiple subbands that do not fully mix. Our findings allow us …
Identifying the unknown underlying trend of a given noisy signal is extremely useful for a wide range of applications. The number of potential trends might be exponential, which can be computationally exhaustive even for short signals. Another challenge, is the presence of abrupt changes and outliers at unknown times w…
Kernel learning FBSDE filter improves nonlinear filtering efficiency.
problem Nonlinear filtering problem in high-dimensional systems.
method Iterative and adaptive meshfree approach using forward backward SDE and KDE.
result Rigorous convergence analysis provided, supporting empirical results.
New filters for non-linear systems achieve closed-form solutions.
problem Intractability of Bayesian filtering for non-linear systems.
method Gaussian PSD Models for efficient closed-form filtering.
result Closed-form filtering with strong theoretical guarantees and adaptive error.
A new method for tighter privacy loss accounting in adaptive analyses.
problem Ensuring individual privacy in adaptive analyses while staying within a privacy budget.
method A personalized privacy loss estimate and a Rényi differential privacy filter.
result Personalized privacy loss accounting can be practical and tighter than existing methods.
In most adaptive signal processing applications, system linearity is assumed and adaptive linear filters are thus used. The traditional class of supervised adaptive filters rely on error-correction learning for their adaptive capability. The kernel method is a powerful nonparametric modeling tool for pattern analysis a…
No-trick kernel adaptive filtering uses deterministic features for scalability and robustness.
problem Scalability issues in kernel methods for large datasets.
method Deterministic feature-map construction using polynomial-exact solutions.
result Deterministic features outperform random Fourier features in performance and scalability.
Kernel adaptive filters, a class of adaptive nonlinear time-series models, are known by their ability to learn expressive autoregressive patterns from sequential data. However, for trivial monotonic signals, they struggle to perform accurate predictions and at the same time keep computational complexity within desired …
We discuss the problem of adaptive discrete-time signal denoising in the situation where the signal to be recovered admits a "linear oracle" -- an unknown linear estimate that takes the form of convolution of observations with a time-invariant filter. It was shown by Juditsky and Nemirovski (2009) that when the $\ell_2…
Proposes a Gaussian process for graph signals using adaptive spectral kernels.
problem Predicting signals on graph nodes with various structures.
method Spectral kernel learning approach that incorporates a polynomial function in the graph spectral domain.
result The model accurately recovers ground truth spectral filters and outperforms in real-world graph data.
Study on sparsity in CNNs trained with adaptive methods.
problem Understanding and optimizing sparsity in CNNs trained with adaptive methods.
method Experimental study of filter level sparsity in CNNs with BN and ReLU, using adaptive gradient descent and L2 regularization.
result Implicit sparsity can improve CNN performance and speedup without modifications.
A Kalman filter reduces valuation risk in business valuation models.
problem Reducing valuation risk in business valuation models.
method Recursive FCFF model with Kalman filtering to adjust WACC.
result Significant reduction in valuation risk by implementing Kalman filter.