Paper presents a new method for efficient deep learning with over-complete dictionaries.
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
Trend · papers per month
This paper proposes a subspace decomposition method based on an over-complete dictionary in sparse representation, called "Sparse Signal Subspace Decomposition" (or 3SD) method. This method makes use of a novel criterion based on the occurrence frequency of atoms of the dictionary over the data set. This criterion, wel…
We study Fredholm properties and index formulas for Dirac operators over complete Riemannian manifolds with straight ends. An important class of examples of such manifolds are complete Riemannian manifolds with pinched negative sectional curvature and finite volume.
We generalize for pseudo-Riemannian metrics a classical result of Gallot and Tanno and use it to reprove a recent result of Alekseevsky, Cortes, Galaev and Leistner that decomposable cones over complete closed pseudo-Riemannian manifolds do not exist.
Sparse codes improve optimal control tasks with correlated inputs.
Paper proposes a method to solve sparse Bayesian learning problems efficiently.
New algorithm recovers dictionaries with arbitrary supports in polynomial time.
Study on magnetic Dirac operators and their spectrum.
We consider -way data arrays and low-rank tensor factorizations where the time mode is coded as a sparse linear combination of temporal elements from an over-complete library. Our method, Shape Constrained Tensor Decomposition (SCTD) is based upon the CANDECOMP/PARAFAC (CP) decomposition which produces -rank appr…
We introduce a notion of cobordism of Callias-type operators over complete Riemannian manifolds and prove that the index is preserved by such a cobordism. As an application we prove a gluing formula for Callias-type index. In particular, a usual index of an elliptic operator on a compact manifold can be computed as a s…
We propose a sparse-coding framework for activity recognition in ubiquitous and mobile computing that alleviates two fundamental problems of current supervised learning approaches. (i) It automatically derives a compact, sparse and meaningful feature representation of sensor data that does not rely on prior expert know…
Learning an encoding of feature vectors in terms of an over-complete dictionary or a information geometric (Fisher vectors) construct is wide-spread in statistical signal processing and computer vision. In content based information retrieval using deep-learning classifiers, such encodings are learnt on the flattened la…
We prove generalized lower Ricci curvature bounds for warped products over complete Finsler manifolds. On the one hand our result covers a theorem of Bacher and Sturm concerning euclidean and spherical cones. On the other hand it can be seen in analogy to a result of Bishop and Alexander in the setting of Alexandrov sp…
The paper constructs Einstein metrics on holomorphic bundles.
The popular Alternating Least Squares (ALS) algorithm for tensor decomposition is efficient and easy to implement, but often converges to poor local optima---particularly when the weights of the factors are non-uniform. We propose a modification of the ALS approach that is as efficient as standard ALS, but provably rec…
In this paper we study the asymptotic behaviour of the spectral function corresponding to the lower part of the spectrum of the Kodaira Laplacian on high tensor powers of a holomorphic line bundle. This implies a full asymptotic expansion of this function on the set where the curvature of the line bundle is non-degener…
We prove generalized lower Ricci bounds for Euclidean and spherical cones over complete Riemannian manifolds. These cones are regarded as complete metric measure spaces. In general, they will be neither manifolds nor Alexandrov spaces. We show that the Euclidean cone over an n-dimensional Riemannian manifold whose Ricc…
This paper introduces localized discrepancy theories for unsupervised domain adaptation.
Measurement error in the observed values of the variables can greatly change the output of various causal discovery methods. This problem has received much attention in multiple fields, but it is not clear to what extent the causal model for the measurement-error-free variables can be identified in the presence of meas…
In this paper we investigate the existence of a solution to the Poisson equation on complete manifolds with positive spectrum and Ricci curvature bounded from below. We show that if a function has decay for some where is the distance function to a fixed point, then t…
A new method to simplify deep neural networks by removing unnecessary parts.
Paper introduces a new regularization method for visual representations.
Dictionary learning is a cutting-edge area in imaging processing, that has recently led to state-of-the-art results in many signal processing tasks. The idea is to conduct a linear decomposition of a signal using a few atoms of a learned and usually over-completed dictionary instead of a pre-defined basis. Determining …
A popular approach within the signal processing and machine learning communities consists in modelling signals as sparse linear combinations of atoms selected from a learned dictionary. While this paradigm has led to numerous empirical successes in various fields ranging from image to audio processing, there have only …
A popular approach within the signal processing and machine learning communities consists in modelling signals as sparse linear combinations of atoms selected from a learned dictionary. While this paradigm has led to numerous empirical successes in various fields ranging from image to audio processing, there have only …
Essential spectrum of differential forms on curved manifolds is connected.
A new stochastic solver improves Convolutional Sparse Coding efficiency.
The power of sparse signal modeling with learned over-complete dictionaries has been demonstrated in a variety of applications and fields, from signal processing to statistical inference and machine learning. However, the statistical properties of these models, such as under-fitting or over-fitting given sets of data, …
Sparse representations have proven their efficiency in solving a wide class of inverse problems encountered in signal and image processing. Conversely, enforcing the information to be spread uniformly over representation coefficients exhibits relevant properties in various applications such as digital communications. A…
Paper proposes a new method for efficient exploration in reinforcement learning.
Proposes flexible auto-encoders for varying data dimensions.
Redundancy helps speed up slow nodes in distributed learning.
This paper tackles non-convex phase retrieval with structured assumptions.
New method detects causal relationships from noisy measurements.
One of the basic objects in the Morse theory of circle-valued maps is Novikov complex - an analog of the Morse complex of Morse functions. Novikov complex is defined over the ring of Laurent power series with finite negative part. The main aim of this paper is to present a detailed and self-contained exposition of the …
Non-convex optimization with local search heuristics has been widely used in machine learning, achieving many state-of-art results. It becomes increasingly important to understand why they can work for these NP-hard problems on typical data. The landscape of many objective functions in learning has been conjectured to …
Training-free method improves large language model sequence quality via reward-guided sampling.
Approximating Gaussian Whittle-Matern Fields over Well-Centered Triangulations of Riemannian Manifolds
This paper learns hierarchical compositional models for image synthesis.
Extracts airways from 3D CT data using graph refinement methods.
Automated method selects eye tracking variables for categorization tasks.
This paper improves 3D pose recovery from 2D images using non-convex regularization.