Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

169,181 papers · 148 categories

Trend · papers per month

1122 · Dec 201519922001200920182026
42 results for over-complete

Paper presents a new method for efficient deep learning with over-complete dictionaries.

problem Learning an over-complete basis for optimal reconstruction without optimization.
method Multiscale Residual Mixture of PCA with a hierarchical approach.
result Exponential decrease of error with depth in a recursive deep approach.

We study Fredholm properties and index formulas for Dirac operators over complete Riemannian manifolds with straight ends. An important class of examples of such manifolds are complete Riemannian manifolds with pinched negative sectional curvature and finite volume.

2010-11-10abs ↗pdf ↗

Sparse codes improve optimal control tasks with correlated inputs.

problem Optimal control tasks with correlated feature inputs.
method Used a sparse code to represent natural images in an optimal control task solved with neuro-dynamic programming.
result An over-complete sparse code increases memory capacity and learning speed beyond a complete code.

Paper proposes a method to solve sparse Bayesian learning problems efficiently.

problem Finding sparsest solutions in high-dimensional settings.
method Sparse Bayesian learning with screening test to identify and remove zero coefficients.
result The method accelerates the solution process for sparse Bayesian learning problems.

New algorithm recovers dictionaries with arbitrary supports in polynomial time.

problem Learning dictionaries with arbitrary supports in polynomial time.
method Semirandom model with a mix of arbitrary and random supports; polynomial time algorithm.
result Polynomial time recovery of incoherent over-complete dictionaries with arbitrary supports.

We introduce a notion of cobordism of Callias-type operators over complete Riemannian manifolds and prove that the index is preserved by such a cobordism. As an application we prove a gluing formula for Callias-type index. In particular, a usual index of an elliptic operator on a compact manifold can be computed as a s…

2015-12-12abs ↗pdf ↗

Learning an encoding of feature vectors in terms of an over-complete dictionary or a information geometric (Fisher vectors) construct is wide-spread in statistical signal processing and computer vision. In content based information retrieval using deep-learning classifiers, such encodings are learnt on the flattened la…

2017-03-18abs ↗pdf ↗

We prove generalized lower Ricci curvature bounds for warped products over complete Finsler manifolds. On the one hand our result covers a theorem of Bacher and Sturm concerning euclidean and spherical cones. On the other hand it can be seen in analogy to a result of Bishop and Alexander in the setting of Alexandrov sp…

2012-09-06abs ↗pdf ↗

The paper constructs Einstein metrics on holomorphic bundles.

problem Finding complete conformally Kähler Einstein metrics on holomorphic bundles.
method Explicit momentum construction via ODE methods and Calabi ansatz.
result Non-trivial complete conformally Kähler Einstein metrics on certain holomorphic bundles are found.

This paper introduces localized discrepancy theories for unsupervised domain adaptation.

problem Improving generalization bounds for unsupervised domain adaptation.
method Localized discrepancies defined on the hypothesis space after localization, leading to smaller and asymmetric values.
result Improved generalization bounds and sample complexity reduction.

A new method to simplify deep neural networks by removing unnecessary parts.

problem Overly complex deep neural networks require significant resource investment for size reduction.
method A fully differentiable sparsification method that optimizes a regularized objective function with stochastic gradient descent.
result The method can learn both the sparsified structure and weights of a network in an end-to-end manner.

Paper introduces a new regularization method for visual representations.

problem Learning sparse visual representations from over-complete data.
method Proposes leaky capped norm regularization (LCNR) and a majorization-minimization algorithm.
result LCNR outperforms 1\ell_1 regularization in monocular 3D shape recovery.

Dictionary learning is a cutting-edge area in imaging processing, that has recently led to state-of-the-art results in many signal processing tasks. The idea is to conduct a linear decomposition of a signal using a few atoms of a learned and usually over-completed dictionary instead of a pre-defined basis. Determining …

2016-05-25abs ↗pdf ↗

A popular approach within the signal processing and machine learning communities consists in modelling signals as sparse linear combinations of atoms selected from a learned dictionary. While this paradigm has led to numerous empirical successes in various fields ranging from image to audio processing, there have only …

2014-07-19abs ↗pdf ↗

Essential spectrum of differential forms on curved manifolds is connected.

problem Understanding the essential spectrum of differential forms on curved manifolds.
method Using Gromov-Hausdorff convergence and Weyl criterion, the authors show the essential spectrum is a connected interval.
result The essential spectrum of the Hodge Laplacian on differential forms is a connected interval over complete manifolds with vanishing curvature at infinity.

The power of sparse signal modeling with learned over-complete dictionaries has been demonstrated in a variety of applications and fields, from signal processing to statistical inference and machine learning. However, the statistical properties of these models, such as under-fitting or over-fitting given sets of data, …

2011-10-11abs ↗pdf ↗

Sparse representations have proven their efficiency in solving a wide class of inverse problems encountered in signal and image processing. Conversely, enforcing the information to be spread uniformly over representation coefficients exhibits relevant properties in various applications such as digital communications. A…

2015-12-18abs ↗pdf ↗

Paper proposes a new method for efficient exploration in reinforcement learning.

problem Sparse reward reinforcement learning challenges in exploration.
method Learn separate intrinsic and extrinsic task policies, schedule between them, and use successor feature control (SFC).
result Substantially improved exploration efficiency with SFC and hierarchical usage of intrinsic drives.

Redundancy helps speed up slow nodes in distributed learning.

problem Slow nodes (stragglers) bottleneck distributed optimization and learning performance.
method Encode data with redundancy, dynamically exclude stragglers, and compensate losses.
result Optimization algorithms converge to solutions even with straggling nodes.

New method detects causal relationships from noisy measurements.

problem Discover causal relationships from noisy, imperfect measurements.
method Transformed Independent Noise (TIN) condition and ordered group decomposition.
result Identifies causal graph structure without over-complete ICA.

One of the basic objects in the Morse theory of circle-valued maps is Novikov complex - an analog of the Morse complex of Morse functions. Novikov complex is defined over the ring of Laurent power series with finite negative part. The main aim of this paper is to present a detailed and self-contained exposition of the …

1998-12-29abs ↗pdf ↗

Non-convex optimization with local search heuristics has been widely used in machine learning, achieving many state-of-art results. It becomes increasingly important to understand why they can work for these NP-hard problems on typical data. The landscape of many objective functions in learning has been conjectured to …

2017-06-18abs ↗pdf ↗

Training-free method improves large language model sequence quality via reward-guided sampling.

problem Optimizing large language model sequence quality over token likelihood.
method Reward-augmented target distribution combined with Sequential Monte Carlo sampling.
result Significant gains in sequence generation and mathematical reasoning tasks.

Automated method selects eye tracking variables for categorization tasks.

problem Limited duration of infant cooperation and biases in handpicked eye tracking variables.
method Automated selection of eye tracking variables using statistical techniques.
result Same eye tracking variables classify category learners from non-learners in adults and infants with high accuracy.

This paper improves 3D pose recovery from 2D images using non-convex regularization.

problem 3D object pose recovery from 2D images.
method Proposes non-convex regularization with leaky capped ℓ1-norm (LCNR) and multi-stage optimization.
result Theoretical analysis shows estimation error decreases with optimization stages.