Paper presents a new method for efficient deep learning with over-complete dictionaries.
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
Trend · papers per month
This paper proposes a subspace decomposition method based on an over-complete dictionary in sparse representation, called "Sparse Signal Subspace Decomposition" (or 3SD) method. This method makes use of a novel criterion based on the occurrence frequency of atoms of the dictionary over the data set. This criterion, wel…
New algorithm recovers dictionaries with arbitrary supports in polynomial time.
Paper proposes a method to solve sparse Bayesian learning problems efficiently.
Dictionary learning is a cutting-edge area in imaging processing, that has recently led to state-of-the-art results in many signal processing tasks. The idea is to conduct a linear decomposition of a signal using a few atoms of a learned and usually over-completed dictionary instead of a pre-defined basis. Determining …
Learning an encoding of feature vectors in terms of an over-complete dictionary or a information geometric (Fisher vectors) construct is wide-spread in statistical signal processing and computer vision. In content based information retrieval using deep-learning classifiers, such encodings are learnt on the flattened la…
A popular approach within the signal processing and machine learning communities consists in modelling signals as sparse linear combinations of atoms selected from a learned dictionary. While this paradigm has led to numerous empirical successes in various fields ranging from image to audio processing, there have only …
A popular approach within the signal processing and machine learning communities consists in modelling signals as sparse linear combinations of atoms selected from a learned dictionary. While this paradigm has led to numerous empirical successes in various fields ranging from image to audio processing, there have only …
The power of sparse signal modeling with learned over-complete dictionaries has been demonstrated in a variety of applications and fields, from signal processing to statistical inference and machine learning. However, the statistical properties of these models, such as under-fitting or over-fitting given sets of data, …
This paper improves 3D pose recovery from 2D images using non-convex regularization.
A new stochastic solver improves Convolutional Sparse Coding efficiency.
Sparse representations have proven their efficiency in solving a wide class of inverse problems encountered in signal and image processing. Conversely, enforcing the information to be spread uniformly over representation coefficients exhibits relevant properties in various applications such as digital communications. A…
We study Fredholm properties and index formulas for Dirac operators over complete Riemannian manifolds with straight ends. An important class of examples of such manifolds are complete Riemannian manifolds with pinched negative sectional curvature and finite volume.
DeepCAM learns convolutional dictionaries for image processing.
We generalize for pseudo-Riemannian metrics a classical result of Gallot and Tanno and use it to reprove a recent result of Alekseevsky, Cortes, Galaev and Leistner that decomposable cones over complete closed pseudo-Riemannian manifolds do not exist.
Bayesian method improves dictionary learning for complex problems.
Paper improves dictionary learning by addressing local and global coherence issues.
We consider the problem of sparse coding, where each sample consists of a sparse linear combination of a set of dictionary atoms, and the task is to learn both the dictionary elements and the mixing coefficients. Alternating minimization is a popular heuristic for sparse coding, where the dictionary and the coefficient…
This work learns sparse tensor representations using mixtures of separable dictionaries.
NOODL solves dictionary and coefficient recovery for online learning.
DeepAM optimizes deep neural networks for image super-resolution.
We present a two-stage approach for learning dictionaries for object classification tasks based on the principle of information maximization. The proposed method seeks a dictionary that is compact, discriminative, and generative. In the first stage, dictionary atoms are selected from an initial dictionary by maximizing…
Many techniques in computer vision, machine learning, and statistics rely on the fact that a signal of interest admits a sparse representation over some dictionary. Dictionaries are either available analytically, or can be learned from a suitable training set. While analytic dictionaries permit to capture the global st…
Sparse codes improve optimal control tasks with correlated inputs.
CRsAE auto-encoder recovers convolutional dictionary from noisy signals.
Efficient algorithm selects atoms from dictionaries with complex sparsity constraints.
Paper proposes robust dictionary learning using concave losses.
Paper provides conditions for local recovery of tensor data's Kronecker-structured dictionaries.
Sparse coding in learned dictionaries has been established as a successful approach for signal denoising, source separation and solving inverse problems in general. A dictionary learning method adapts an initial dictionary to a particular signal class by iteratively computing an approximate factorization of a training …
Study shows unique sharp local minimum in -minimization for dictionary learning.
A dictionary connects symplectic to contact geometry, with applications to complex and G-structures.
A parallel algorithm learns efficient Kronecker product dictionaries.
Researchers find optimal dictionaries for minimizing average squared coefficients in random vector representations.
In sparse signal representation, the choice of a dictionary often involves a tradeoff between two desirable properties -- the ability to adapt to specific signal data and a fast implementation of the dictionary. To sparsely represent signals residing on weighted graphs, an additional design challenge is to incorporate …
Sparse representations using learned dictionaries are being increasingly used with success in several data processing and machine learning applications. The availability of abundant training data necessitates the development of efficient, robust and provably good dictionary learning algorithms. Algorithmic stability an…
The paper provides guarantees for an alternating minimization algorithm in dictionary learning.
The paper tackles dictionary learning with almost sure error constraints.
We study the Dictionary Learning (aka Sparse Coding) problem of obtaining a sparse representation of data points, by learning \emph{dictionary vectors} upon which the data points can be written as sparse linear combinations. We view this problem from a geometry perspective as the spanning set of a subspace arrangement,…
Two algorithms converge to dictionary learning with geometric rate for non-uniform data.
The paper proposes a method to learn discriminative multilevel dictionaries for supervised image classification.
New algorithm reduces dictionary learning complexity.
Study on magnetic Dirac operators and their spectrum.
Unified analysis for robust PCA decomposition with sparse components in known dictionaries.
Dictionaries are collections of vectors used for representations of random vectors in Euclidean spaces. Recent research on optimal dictionaries is focused on constructing dictionaries that offer sparse representations, i.e., -optimal representations. Here we consider the problem of finding optimal dictionaries …
This article addresses the issue of representing electroencephalographic (EEG) signals in an efficient way. While classical approaches use a fixed Gabor dictionary to analyze EEG signals, this article proposes a data-driven method to obtain an adapted dictionary. To reach an efficient dictionary learning, appropriate s…
A new tree-based method for adaptive dictionary learning.
The kernel least-mean-square (KLMS) algorithm is an appealing tool for online identification of nonlinear systems due to its simplicity and robustness. In addition to choosing a reproducing kernel and setting filter parameters, designing a KLMS adaptive filter requires to select a so-called dictionary in order to get a…
We consider -way data arrays and low-rank tensor factorizations where the time mode is coded as a sparse linear combination of temporal elements from an over-complete library. Our method, Shape Constrained Tensor Decomposition (SCTD) is based upon the CANDECOMP/PARAFAC (CP) decomposition which produces -rank appr…