Sparse coding approximates the data sample as a sparse linear combination of some basic codewords and uses the sparse codes as new presentations. In this paper, we investigate learning discriminative sparse codes by sparse coding in a semi-supervised manner, where only a few training samples are labeled. By using the m…
On-device research index
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
169,291 papers · 148 categories
Trend · papers per month
48 results for “Sparse Sampling”
Sparse-TDA combines TDA and sparse sampling for multi-way classification.
problem Reconstructing shapes from high-dimensional data for multi-way classification.
method Sparse-TDA algorithm that selects sparse pixel samples from persistent features using QR pivoting.
result Sparse-TDA demonstrates promising performance on human posture recognition and image texture classification.
IDS improves sparse linear bandits by balancing information and regret.
problem Sparse linear bandits in high-dimensional decision-making.
method Information-directed sampling (IDS) with Bayesian regret bounds and empirical Bayesian sparse posterior sampling.
result IDS nearly matches existing lower bounds and significantly reduces regret.
Study shows inefficiency of sparse linear regression learning with fewer than Ω(k^2) samples.
problem Efficiency of sparse linear regression learning with minimal samples.
method Reduction to sparse PCA problems and lower bounds.
result Efficient algorithms for sparse linear regression require at least Ω(k^2) samples.
Sparse group Lasso optimizes sparse and grouped parameters in high-dimensional data.
problem Simultaneously sparse and grouped parameters in high-dimensional linear regression.
method Sparse group Lasso, debiased sparse group Lasso, statistical inference.
result Matching upper and lower bounds on sample complexity and estimation error.
Sparse support vector machine (SVM) is a popular classification technique that can simultaneously learn a small set of the most interpretable features and identify the support vectors. It has achieved great successes in many real-world applications. However, for large-scale problems involving a huge number of samples a…
Improved locally private sparse estimation with multiple samples per user.
problem Challenges in high-dimensional locally private sparse estimation.
method Proposes a framework for user-level locally private sparse linear regression with multiple samples per user.
result Eliminates the dependency of dimensionality on error bounds, achieving tighter error bounds.
SWCCA identifies specific subsets of samples for better correlation analysis.
problem Identify specific subsets of samples contributing to correlation between two data matrices.
method Proposes SWCCA with weights to regularize different samples, solves using alternating iterative algorithm.
result Demonstrates effectiveness and superiority over related methods on synthetic and real-world data.
This paper establishes conditions for sparse signal recovery with sparse measurements.
problem Recovering the support of a sparse signal using noisy projections with sparse measurement matrices.
method Establishes sufficient conditions for successful sparse recovery using sparse measurement matrices.
result A phase transition threshold for sparse recovery in the sparse setting is discovered, revealing a trade-off between sampling complexity and measurement sparsity.
New algorithm reduces sample complexity for sparse linear regression.
problem Sparse linear regression with correlated covariates and approximate dependencies.
method Polynomial-time algorithm that adapts the Lasso to tolerate approximate dependencies.
result Achieves near-optimal sample complexity for constant sparsity and ill-conditioned covariates.
Human advice improves deep learning from sparse samples.
problem Learning from sparse, noisy samples in deep models.
method Knowledge-augmented Column Networks using human advice.
result Significantly improved performance or faster convergence.
New algorithm reduces runtime for robust sparse mean estimation.
problem Efficiently estimating mean from corrupted data with sparse constraints.
method Subquadratic time algorithm using poly(k, log d, 1/ε) samples.
result First subquadratic time algorithm for robust sparse mean estimation.
Self-attention prefers sparse functions of input sequences, reducing sample complexity.
problem Understanding the inductive biases of self-attention in modeling long-range dependencies.
method Theoretical analysis and synthetic experiments to probe sample complexity of learning sparse functions with Transformers.
result Bounded-norm Transformer networks can represent sparse functions of the input sequence with logarithmic sample complexity.
Improved Thompson Sampling for high-dimensional sparse bandits.
problem Stochastic linear contextual bandits with high-dimensional features.
method Thompson Sampling with spike-and-slab priors and variational inference.
result Nearly optimal upper bound on expected cumulative regret.
Paper introduces S-SSE for stable sparse subspace embedding.
problem Inefficient sparse random projection matrices with uneven non-zero distribution.
method Uses uniform sampling without replacement to create a stable sparse subspace embedded matrix (S-SSE).
result S-SSE maintains Euclidean distance better after dimension reduction.
Improves content allocation in educational platforms with sparse data.
problem Imbalanced content allocation and delayed convergence in adaptive strategies.
method Introduces WAPTS, an algorithm that refines Thompson Sampling for data-sparse environments.
result Demonstrates earlier and more reliable identification of promising treatments.
Scalable algorithm for sampling Gaussian processes using sparse grids and preconditioners.
problem Generating high-dimensional Gaussian random vectors for GP sampling is computationally challenging.
method Proposes a scalable algorithm using inducing points approximation with sparse grids and additive Schwarz preconditioners.
result Demonstrates the efficacy and accuracy of the proposed method through experiments and comparisons.
Novel algorithm recovers sparse parameters in high-dimensional data with constant corruption.
problem Sparse regression with high dimensionality and constant fraction of corruptions.
method Robust Iterative Hard Thresholding, filtering algorithm for outlier removal.
result Near information-theoretically optimal error guarantee with sub-linear sample complexity.
Paper optimizes privacy-preserving distribution estimation for sparse data.
problem Sparse distribution estimation under local differential privacy constraints.
method Compressive sensing approaches for privacy-preserving estimation.
result Significant reduction in sample complexity for approximately sparse distributions.
New method for sparse PCA using random projections, non-iterative and fast.
problem Sparse principal component analysis (PCA)
method Axis-aligned random projections of sample covariance matrix
result Non-iterative method achieves optimal convergence rate in polynomial time
Paper identifies sparse linear systems with few samples, achieving exact recovery.
problem Sparse system identification with limited data.
method Block-regularized estimator for sparse linear systems.
result The estimator achieves small element-wise error with polynomially many samples relative to sparsity.
Efficiently estimates sparse mean from heavy-tailed data.
problem Robustly estimating sparse mean from heavy-tailed distributions.
method Stability-based approach adapted for heavy-tailed data.
result Optimal sample complexity with logarithmic dependence on dimension.
Quantum SVM uses fewer features for faster training.
problem Training high-dimensional SVMs efficiently.
method Quantum linear programming for sparse SVM training.
result Quantum sparse SVM can be trained in sublinear time.
Robust estimators for Gaussian sparse tasks with optimal error under contamination.
problem Robust mean estimation, PCA, and linear regression in the presence of Huber contamination.
method Novel multidimensional filtering method for sparse regime.
result Optimal error guarantees within constant factors for Gaussian robust -sparse mean estimation.
Proposes SVI for covariate-shift generalization with sparse variable independence.
problem Covariate-shift generalization with limited data and unstable variables.
method Introduces sparsity constraint and combines reweighting and selection in an iterative way.
result Improves covariate-shift generalization performance on synthetic and real-world datasets.
Online method learns sparse models efficiently in large scale settings.
problem Sparse model learning in large scale settings with high computational and memory costs.
method Online learning approach, mini-batch methods, hard thresholding based stochastic gradient algorithm.
result Sparsity promoted by batch methods is not preserved in online fashion.
PolytopeWalk library efficiently samples high-dimensional polytopes.
problem Sampling from high-dimensional polytopes efficiently.
method End-to-end solution including preprocessing and MCMC algorithms.
result Improved sampling efficiency and scalability to high dimensions.
CoT improves transformer sample efficiency by reducing input token dependencies and attention sparsity.
problem Transformer sample inefficiency in simple tasks.
method Demonstrated through parity-learning setup, showing CoT reduces required samples from exponential to polynomial.
result Transformer learns function within polynomial samples with CoT, requiring exponential samples without CoT.
Solving Statistical Mechanics on Sparse Graphs with Feedback Set Variational Autoregressive Networkscond-mat.stat-mech
Method converts sparse systems to dense ones for statistical mechanics problems.
problem Statistical mechanics on sparse graphs
method Extracts a Feedback Vertex Set, learns variational distribution, estimates free energy.
result More accurate and faster than existing methods for sparse systems.
LSDAT reduces query efficiency for decision-based adversarial attacks.
problem Improving query efficiency for decision-based adversarial attacks.
method Low-rank and sparse decomposition (LSD) to craft perturbations.
result LSDAT achieves superior fooling rates with fewer queries.
CDSSD detects sparse changes in partially observable data streams.
problem Online change detection of sparse changes in partially observable high-dimensional data streams.
method Smooth-sparse decomposition, spike-slab variational Bayesian inference, adaptive sampling via Thompson sampling.
result CDSSD effectively detects sparse changes in partially observable data streams.
Paper proposes a new method for recovering missing samples in images.
problem Missing sample recovery in image signals.
method Iterative sparse recovery algorithm using constrained -norm minimization with a new CSIM fidelity metric.
result Simulation results demonstrate the efficiency of the proposed method.
Improved sample complexity for Gaussian process approximations.
problem Efficiently approximating Gaussian processes with sparse spectrum.
method Improved sample complexity analysis and auto-encoding algorithm.
result Gaussian process predictions and model evidence can be well-approximated with low sample complexity.
New deep learning model for sparse, irregularly sampled multivariate time series.
problem Supervised learning with sparse and irregularly sampled multivariate time series.
method Interpolation-Prediction Networks: semi-parametric interpolation followed by a prediction network.
result Interpolation-Prediction Networks outperform baseline models in classification and regression tasks.
SAIL learns from sub-optimal demonstrations to improve sample efficiency in sparse reward tasks.
problem Reducing sample complexity in sparse-rewarded tasks.
method Self-Adaptive Imitation Learning (SAIL) that exploits sub-optimal demonstrations and efficient exploration.
result Significantly improved sample efficiency and better final performance across various tasks.
Framework learns continuous dynamics from sparse trajectories.
problem Learning dynamics from sparsely sampled and high-dimensional trajectories.
method Interpolative Multi-Marginal Flow Matching (IMMFM) framework.
result IMMFM outperforms existing methods in forecasting and downstream tasks.
The paper efficiently estimates parameters from truncated Gaussian and linear models.
problem Estimating parameters from truncated Gaussian and linear models.
method Minimizes finite population negative log-likelihood function with an l1-regularization term.
result Efficient estimation of parameters from truncated samples.
This work explores feature learning tradeoffs in neural networks.
problem Resource tradeoffs in neural feature learning.
method Theoretical and experimental investigation of offline sparse parity learning.
result Width improves sample efficiency in sparse feature learning.
Bayesian method clusters data and selects variables with shrinkage priors.
problem Sparse convex clustering with limited data accuracy issues.
method Bayesian approach using global-local shrinkage priors and Gibbs sampling.
result Improved estimation accuracy in sparse convex clustering.
New unsupervised learning method for fast imaging metal dendrites.
problem Fast imaging of metal dendrites in materials science.
method Unsupervised learning using Hierarchical Gaussian Mixture Models (HGMM) for dynamic sampling.
result Dynamic sampling of metal dendrites can be achieved efficiently using HGMM.
New method controls FDR for sparse GLMs, identifying positive and negative relationships.
problem Sparse GLMs with high-dimensional data and varying sample size.
method Debiased-Lasso estimator and CLIME method for precision matrix estimation.
result Asymptotically controls directional FDR and FDV for sparse GLMs.
New insights into statistical and computational limits for mixed sparse linear regression.
problem Recovering two sparse signals from noisy linear measurements.
method Analysis of low-degree polynomials and a simple thresholding algorithm.
result Identification of a smooth information-computation tradeoff and order-optimality of the thresholding algorithm.
High-dimensional near-optimal experiment design for drug discovery via Bayesian sparse samplingcs.LG
Bayesian methods improve drug discovery experiment design.
problem Optimizing drug screening experiments in high-dimensional data.
method Bayesian inference and optimisation with upper confidence bound algorithms, Thompson sampling, and sparse tree search.
result Sparse tree search techniques outperform other methods in drug toxicity screening.
Bagging improves sparse regression performance, especially with reduced sampling ratios.
problem Improving sparse regression performance in low measurement scenarios.
method Generalized Bagging with various bootstrap sampling ratios.
result Bagging outperforms L1 minimization and Bolasso in challenging sparse regression cases.
New method learns sparse distributions by thresholding samples, improving performance and efficiency.
problem Sparse coding optimization in high-dimensional problems is computationally expensive and inefficient.
method Proposes a new variational sparse coding approach that learns sparse distributions by thresholding samples.
result Shows superior performance, statistical efficiency, and gradient estimation compared to other sparse distributions.
Bayesian method assesses structural damage using sparse learning and Gibbs sampling.
problem Detecting spatially-sparse stiffness reductions in structures.
method Hierarchical sparse Bayesian learning, Gibbs sampling, incomplete modal data.
result Effective detection of spatially-sparse stiffness reductions in structures.
Sparse APCA identifies sparse factors in financial returns over time.
problem Analyzing co-movements of high-dimensional panel data over time.
method Sparse asymptotic PCA with truncated power method for sparse factors and sequential deflation for multi-factor cases.
result Identification of nine risk factors influencing the S&P 500 stock market.
Sparse GCA finds linear relationships in multiple datasets, using gradient descent.
problem Finding linear relationships across multiple datasets with sparse loading vectors.
method Formulated as generalized eigenvalue problems, used a thresholded gradient descent algorithm.
result Proposed algorithm yields tight estimation error bounds and demonstrates effectiveness on synthetic datasets.