arXiv research

New method learns histograms using optimal transport barycenters.

Robust method learns nonlinear structures robustly to noise.

A novel dictionary-based approach for predicting functions.

New method uses compositions of ReLU neural networks for nonlinear approximation.

PERK speeds up MRI parameter estimation without needing a dictionary.

The kernel least-mean-square (KLMS) algorithm is an appealing tool for online identification of nonlinear systems due to its simplicity and robustness. In addition to choosing a reproducing kernel and setting filter parameters, designing a KLMS adaptive filter requires to select a so-called dictionary in order to get a…

The paper tackles energy disaggregation by improving dictionary learning with deep neural models.

Data sets are often modeled as point clouds in $R^D$, for $D$ large. It is often assumed that the data has some interesting low-dimensional structure, for example that of a $d$-dimensional manifold $M$, with $d$ much smaller than $D$. When $M$ is simply a linear subspace, one may exploit this assumption for encoding ef…

Paper proposes semi-supervised method for dictionary learning.

QENDy learns quadratic dynamics from nonlinear systems data.

We present a probabilistic framework for both (i) determining the initial settings of kernel adaptive filters (KAFs) and (ii) constructing fully-adaptive KAFs whereby in addition to weights and dictionaries, kernel parameters are learnt sequentially. This is achieved by formulating the estimator as a probabilistic mode…

In signal analysis and synthesis, linear approximation theory considers a linear decomposition of any given signal in a set of atoms, collected into a so-called dictionary. Relevant sparse representations are obtained by relaxing the orthogonality condition of the atoms, yielding overcomplete dictionaries with an exten…

Kernel adaptive filters, a class of adaptive nonlinear time-series models, are known by their ability to learn expressive autoregressive patterns from sequential data. However, for trivial monotonic signals, they struggle to perform accurate predictions and at the same time keep computational complexity within desired …

PSMF factorizes time-varying datasets into a dictionary and time-varying coefficients.

Adaptive filtering algorithms operating in reproducing kernel Hilbert spaces have demonstrated superiority over their linear counterpart for nonlinear system identification. Unfortunately, an undesirable characteristic of these methods is that the order of the filters grows linearly with the number of input data. This …

Modeling data with linear combinations of a few elements from a learned dictionary has been the focus of much recent research in machine learning, neuroscience and signal processing. For signals such as natural images that admit such sparse representations, it is now well established that these models are well suited t…

CDPL-Net integrates CNN and DL for better image representation.

This paper introduces a new shape-based image reconstruction technique applicable to a large class of imaging problems formulated in a variational sense. Given a collection of shape priors (a shape dictionary), we define our problem as choosing the right elements and geometrically composing them through basic set opera…

Classifiers based on sparse representations have recently been shown to provide excellent results in many visual recognition and classification tasks. However, the high cost of computing sparse representations at test time is a major obstacle that limits the applicability of these methods in large-scale problems, or in…

New adaptive algorithms improve learning rate and reduce complexity.

A new algorithm improves kernel-based sparse coding for better data representation.

Estimates signals from a continuous dictionary with sparse mixtures using optimization.

This paper is a follow up to the previous author's paper on convex optimization. In that paper we began the process of adjusting greedy-type algorithms from nonlinear approximation for finding sparse solutions of convex optimization problems. We modified there three the most popular in nonlinear approximation in Banach…

We propose a general matrix-valued multiple kernel learning framework for high-dimensional nonlinear multivariate regression problems. This framework allows a broad class of mixed norm regularizers, including those that induce sparsity, to be imposed on a dictionary of vector-valued Reproducing Kernel Hilbert Spaces. W…

We propose a general matrix-valued multiple kernel learning framework for high-dimensional nonlinear multivariate regression problems. This framework allows a broad class of mixed norm regularizers, including those that induce sparsity, to be imposed on a dictionary of vector-valued Reproducing Kernel Hilbert Spaces. W…

DeepCAM learns convolutional dictionaries for image processing.

Optimizes basis functions for learning dynamical systems from data.

Bayesian method improves dictionary learning for complex problems.

Paper improves dictionary learning by addressing local and global coherence issues.

We consider the problem of sparse coding, where each sample consists of a sparse linear combination of a set of dictionary atoms, and the task is to learn both the dictionary elements and the mixing coefficients. Alternating minimization is a popular heuristic for sparse coding, where the dictionary and the coefficient…

This work learns sparse tensor representations using mixtures of separable dictionaries.

NOODL solves dictionary and coefficient recovery for online learning.

DeepAM optimizes deep neural networks for image super-resolution.

We present a two-stage approach for learning dictionaries for object classification tasks based on the principle of information maximization. The proposed method seeks a dictionary that is compact, discriminative, and generative. In the first stage, dictionary atoms are selected from an initial dictionary by maximizing…

Many techniques in computer vision, machine learning, and statistics rely on the fact that a signal of interest admits a sparse representation over some dictionary. Dictionaries are either available analytically, or can be learned from a suitable training set. While analytic dictionaries permit to capture the global st…

CRsAE auto-encoder recovers convolutional dictionary from noisy signals.

Efficient algorithm selects atoms from dictionaries with complex sparsity constraints.

Paper proposes robust dictionary learning using concave losses.

Paper provides conditions for local recovery of tensor data's Kronecker-structured dictionaries.

A new DDR framework learns low-dimensional data representations using dynamical systems.

Sparse coding in learned dictionaries has been established as a successful approach for signal denoising, source separation and solving inverse problems in general. A dictionary learning method adapts an initial dictionary to a particular signal class by iteratively computing an approximate factorization of a training …

Study shows unique sharp local minimum in $\ell_1$-minimization for dictionary learning.

A dictionary connects symplectic to contact geometry, with applications to complex and G-structures.

A parallel algorithm learns efficient Kronecker product dictionaries.

Researchers find optimal dictionaries for minimizing average squared coefficients in random vector representations.

In sparse signal representation, the choice of a dictionary often involves a tradeoff between two desirable properties -- the ability to adapt to specific signal data and a fast implementation of the dictionary. To sparsely represent signals residing on weighted graphs, an additional design challenge is to incorporate …

Sparse representations using learned dictionaries are being increasingly used with success in several data processing and machine learning applications. The availability of abundant training data necessitates the development of efficient, robust and provably good dictionary learning algorithms. Algorithmic stability an…

The paper provides guarantees for an alternating minimization algorithm in dictionary learning.