Sparse coding improves reinforcement learning representations.
problem Improving representation learning in reinforcement learning.
method Developed a supervised sparse coding objective for policy evaluation.
result Sparse coding representations outperform tile-coding representations.
Sparse representations improve reinforcement learning control policies.
problem Sparse representations are underused in reinforcement learning control.
method Incremental learning with sparse representations from neural networks, using distributional regularizers.
result Sparse representations avoid catastrophic interference and provide stable values for reinforcement learning.
Sparse representations improve network robustness and stability.
problem The benefits of sparse representations in artificial networks.
method Analysis of sparse networks with sparse weights and activations, simulations on MNIST and Google Speech Command Dataset.
result Sparse networks show significantly improved robustness and stability compared to dense networks.
Deep learning improves sparse representation for better classification.
problem Improving classification accuracy using sparse representation.
method A transductive deep learning network combining convolutional autoencoder and fully-connected layers.
result The proposed network achieves better classification results than state-of-the-art SRC methods.
This paper investigates learning sparse representations and action-value functions simultaneously in deep reinforcement learning.
problem Mitigating catastrophic interference and improving cumulative reward in deep reinforcement learning agents.
method Employing regularization techniques to learn sparse representations and action-value functions incrementally.
result Learning sparse representations can improve performance and robustness in deep reinforcement learning agents.
Sparse manifold transform linearizes non-linear signal transformations.
problem Non-linear signal transformations in sensory data.
method Combines sparse coding, manifold learning, and slow feature analysis.
result Models sparse discreteness and low-dimensional manifold structure in natural scenes.
Improves NILM with multi-label SRC, outperforming state-of-the-art.
problem Non-intrusive load monitoring (NILM) for energy disaggregation.
method Modified multi-label sparse representation based classification (SRC).
result Significant improvement over state-of-the-art techniques with minimal training data.
Sparse representations using data dictionaries provide an efficient model particularly for signals that do not enjoy alternate analytic sparsifying transformations. However, solving inverse problems with sparsifying dictionaries can be computationally expensive, especially when the dictionary under consideration has a …
Novel algorithm learns sparse signal representations over topological spaces.
problem Sparse representation of signals over combinatorial topological spaces.
method Leveraging Hodge theory, the paper embeds topology into a dictionary structure via concatenated sub-dictionaries, each as a polynomial of Hodge Laplacians, and optimizes the dictionary coefficients and sparse signal representation via iterative alternating algorithms.
result Efficiently learned sparse representations and underlying relational structure of topological signals.
This work proposes a method to learn sparse representations that are more efficient for large-scale data retrieval.
problem Efficient retrieval of high-dimensional representations from large databases is computationally challenging.
method The approach minimizes the number of floating-point operations (FLOPs) by learning sparse embeddings with uniform non-zero entries.
result The proposed method achieves a similar or better speed-vs-accuracy tradeoff compared to existing baselines.
New algorithms compare and improve convolutional dictionary learning methods.
problem Challenges in learning convolutional dictionaries.
method Comprehensive comparison and development of new algorithms.
result Identifies most effective methods for convolutional dictionary learning.
New model allows sparse graphs with many triangles to be represented.
problem Sparse graphs with many triangles cannot be accurately represented in finite dimensions.
method Infinite-dimensional inner product model with manifold representations.
result Local neighborhoods can be represented in lower dimensions.
Given an overcomplete dictionary A and a signal b that is a linear combination of a few linearly independent columns of A, classical sparse recovery theory deals with the problem of recovering the unique sparse representation x such that b=Ax. It is known that under certain conditions on A, x can be re…
Paper presents a hierarchical learning strategy for sparse data representation.
problem Sparse representation of multivariate datasets.
method Hierarchical approximation spaces at finer scales, stability and convergence analysis.
result Efficient data reconstruction and error minimization in prediction.
FI-GNNs learn expressive node representations from sparse features.
problem Sparse and high-dimensional node features limit GNN performance.
method Plug-and-play GNN framework that highlights informative feature interactions.
result FI-GNNs learn highly expressive node representations on feature-sparse graphs.
Proposes a Bayesian Autoencoder with sparse Gaussian process priors to capture data correlations.
problem Autoencoders' i.i.d. assumption of latent representations fails to capture data correlations.
method Imposes fully Bayesian sparse Gaussian Process priors on the latent space of a Bayesian Autoencoder and uses stochastic gradient Hamiltonian Monte Carlo for posterior estimation.
result Consistently outperforms alternatives relying on Variational Autoencoders on various tasks.
This work shows how disentangled and sparse representations improve multi-task learning.
problem Improving generalization in multi-task learning with disentangled and sparse representations.
method Proved a new identifiability result and proposed a practical approach using sparsity-promoting bi-level optimization.
result Maximally sparse base-predictors yield disentangled representations under certain conditions.
A new algorithm improves medical image grading accuracy.
problem Improving automatic grading of medical images for disease severity or risk score.
method Sparse range-constrained learning (SRCL) algorithm integrating sparse representation and grading.
result Improves accuracy in cup-to-disc ratio computation and cataract grading.
Proposes ℓ0-CCA for sparse CCA with improved representation learning.
problem CCA models break with too many variables, and sparsity is beneficial.
method Sparse CCA with stochastic gates and ℓ0-regularization. result Improves representation learning by gating nuisance variables.
Sparse representations improve reinforcement learning performance.
problem TD Learning struggles with large state spaces and simple control tasks.
method Learned sparse representations to reduce state space and support generalization.
result Sparse representations enhance reinforcement learning performance on challenging tasks.
Sparse VAE learns latent factors from high-dimensional data.
problem Unsupervised representation learning on high-dimensional data.
method Sparse VAE model that learns latent factors summarizing data associations.
result Sparse VAE can recover true model parameters with infinite data.
Graph-Dictionary model for sparse multivariate signal representation.
problem Capturing complex relational information in multivariate signals.
method Graph dictionaries and bilinear primal-dual splitting algorithm.
result Graph-dictionary model outperforms baselines in signal reconstruction and classification.
New RNN reconstructs video frames from sparse measurements.
problem Sequential signal reconstruction from compressive measurements.
method Unfolding proximal gradient method for l1-l1 minimization.
result Outperforms state-of-the-art RNN models in video frame reconstruction.
Sparse coding has been popularly used as an effective data representation method in various applications, such as computer vision, medical imaging and bioinformatics, etc. However, the conventional sparse coding algorithms and its manifold regularized variants (graph sparse coding and Laplacian sparse coding), learn th…
SANs use sparse activation functions to compress data representations.
problem Learning meaningful features without considering compression.
method Introduce φ metric, define activation functions, and present SANs.
result SANs achieve small description length and interpretable kernels.
Paper finds sparse representation of functions using inverse scale space flow.
problem Finding sparse representation of L2 functions. method Inverse scale space flow to minimize L2 loss. result Convergence to optimal solution in ideal and noisy cases.
Unsupervised methods have proven effective for discriminative tasks in a single-modality scenario. In this paper, we present a multimodal framework for learning sparse representations that can capture semantic correlation between modalities. The framework can model relationships at a higher level by forcing the shared …
Novel framework detects CKD in diabetic patients using sparse EHR representations.
problem Early detection of CKD in diabetic patients.
method Sparse longitudinal representations of EHR data.
result Proposed model achieves higher predictive performance than baselines.
New loss function for learning sparse representations from data.
problem Emergence of sparse representations in neural networks.
method Analysis of input data distribution and regularization.
result Introduction of a new loss function for sparse regularization.
New SRC algorithm for faster image recognition on graphs.
problem Image recognition on graphs with subspace assumptions.
method Sparse representation classifier with screening for graph classification.
result Consistent classification for random graphs, faster than original SRC.
Sparse representations help protect neural networks from adversarial attacks.
problem Adversarial attacks can mislead deep neural networks, leading to classification errors.
method Sparse representations are used to reduce the impact of adversarial perturbations.
result Sparse front ends can reduce adversarial distortion by a factor of K/N. Study confirms sparse coding in whole brain using MRI data.
problem Sparse coding in the whole brain's neural activities.
method Applied various matrix factorization methods to fMRI data.
result Sparse coding hypothesis in information representation in the whole human brain is confirmed.
Sparse coding has shown its power as an effective data representation method. However, up to now, all the sparse coding approaches are limited within the single domain learning problem. In this paper, we extend the sparse coding to cross domain learning problem, which tries to learn from a source domain to a target dom…
Simplicial learning improves classification by generating compact sparse representations.
problem Difficulty in distinguishing classes on the same subspace.
method Evolutionary simplicial learning approach to sparse representations.
result Evolutionary simplicial learning outperforms other methods in multi-class classification.
We propose a new method for learning word representations using hierarchical regularization in sparse coding inspired by the linguistic study of word meanings. We show an efficient learning algorithm based on stochastic proximal methods that is significantly faster than previous approaches, making it possible to perfor…
We develop a sparse representation method for neural network uncertainty.
problem Estimating model uncertainty in neural networks.
method Sparse representation of model uncertainty using inverse Multivariate Normal Distribution (MND), with a novel sparsification algorithm and analytical sampler.
result The information form of neural networks can be effectively applied for model uncertainty representation, showing competitive performance.
The paper tackles transfer learning for growing matrix representations, improving estimation accuracy.
problem Structured matrix estimation under growing ambient dimensions and latent representations.
method Proposes a general transfer framework decomposing target parameters into embedded source components, low-rank innovations, and sparse edits. Develops an anchored alternating projection estimator.
result Establishes deterministic error bounds that separate target noise, representation growth, and source estimation error, yielding improved rates.
New algorithm separates vocals from music recordings efficiently.
problem Separate vocal and instrumental parts in music recordings.
method Informed group-sparse representation for linear-time singing voice separation.
result Efficacy confirmed on iKala dataset; music accompaniment follows group-sparse structure.
STanHop predicts multivariate time series with memory-enhanced capabilities.
problem Predicting multivariate time series with memory-enhanced capabilities.
method Sparse Tandem Hopfield Network (STanHop) with two external memory modules.
result STanHop outperforms dense Hopfield models in memory retrieval error.
This paper improves OMP-based sparse subspace clustering with data-adaptive capability.
problem Existing OMP-based approaches lack data adaptiveness, leading to inaccurate data representation.
method Develops a parameter selection process to adjust OMP parameters based on data distribution and introduces a new SEA ratio metric.
result Proposed approach achieves better clustering accuracy, SEA ratio, and representation quality compared to other OMP-based methods.
New method uses random projections to estimate densities and modes efficiently.
problem Estimating densities and modes from sparse representations.
method Expand-and-sparsify representations followed by linear function and mode recovery algorithms.
result Optimal rates for density and mode estimation achieved.
We propose and analyze a novel framework for learning sparse representations, based on two statistical techniques: kernel smoothing and marginal regression. The proposed approach provides a flexible framework for incorporating feature similarity or temporal information present in data sets, via non-parametric kernel sm…
Proposes a method to boost deep reinforcement learning with sparse rewards.
problem Challenges in learning complex behaviors with long horizons and sparse rewards.
method Predictive coding for reward shaping.
result Achieves better learning by providing reward signals that understand environment dynamics and emphasize useful features.
Stochastic Sparse Subspace Clustering improves subspace clustering by reducing over-segmentation through dropout.
problem Over-segmentation in subspace clustering.
method Introducing dropout regularization to enforce denser connections between points from the same subspace.
result Stochastic Sparse Subspace Clustering effectively handles large datasets and reduces over-segmentation.
CtrlNS learns latent factors and distribution shifts from sparse transitions without prior knowledge.
problem Lack of prior knowledge of domain variables limits causal temporal representation learning.
method Sparse transition assumption and identifiability results from theoretical perspective.
result Effective in identifying distribution shifts and latent factors without prior knowledge.
RG-Flow combines RG and sparse priors for hierarchical image disentanglement.
problem Disentangling and manipulating image representations at different scales.
method Hierarchical flow model using RG and sparse prior distributions.
result RG-Flow enables semantic manipulation and style mixing at different image scales.
Efficiently learns sparse low-dimensional Markov chain representations.
problem Learning low-dimensional representations for large-scale Markov chains with sparse structures.
method Formulates as constrained nonnegative matrix factorization and uses gradient descent.
result Proves the effectiveness of the proposed method through convergence analysis.
Generates high-quality images using sparse DCT representations.
problem Challenges in generating images due to high dimensionality.
method Transformers trained on sparse DCT block sequences.
result Competitive image generation quality with state-of-the-art methods.