This paper begins with considering the identification of sparse linear time-invariant networks described by multivariable ARX models. Such models possess relatively simple structure thus used as a benchmark to promote further research. With identifiability of the network guaranteed, this paper presents an identificatio…
On-device research index
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
169,181 papers · 148 categories
Trend · papers per month
48 results for “group sparse Bayesian learning”
New learning rule simplifies Bayesian updates for deep learning.
problem Bayesian learning rule's complexity and manifold constraints.
method Lie-group approach to simplify Bayesian updates.
result New algorithm learns sparse features in deep learning.
Paper proposes new Bayesian neural network models for efficient learning.
problem Efficient learning and model compression in deep neural networks.
method Proposes Spike-and-Slab Group Lasso (SS-GL) and Spike-and-Slab Group Horseshoe (SS-GHS) priors for structured sparsity in Bayesian neural networks.
result Establishes competitive performance in prediction accuracy, model compression, and inference latency compared to baseline models.
Proposes a method to identify key components for predicting epidemic dynamics with limited resources.
problem Predicting epidemic dynamics with limited surveillance resources.
method Developed a group sparse Bayesian learning algorithm to identify sentinel components for monitoring.
result The proposed algorithm effectively predicts epidemic dynamics using partial data from sentinel components.
Structural damage due to excessive loading or environmental degradation typically occurs in localized areas in the absence of collapse. This prior information about the spatial sparseness of structural damage is exploited here by a hierarchical sparse Bayesian learning framework with the goal of reducing the source of …
Bayesian method for feature selection with grouping info using expectation propagation.
problem Feature selection with grouping info and sparsity constraints.
method Sparse-group Bayesian feature selection using expectation propagation.
result Our method outperforms existing methods in terms of feature selection accuracy and computational efficiency.
In this paper we propose a novel framework for the construction of sparsity-inducing priors. In particular, we define such priors as a mixture of exponential power distributions with a generalized inverse Gaussian density (EP-GIG). EP-GIG is a variant of generalized hyperbolic distributions, and the special cases inclu…
Bayesian Lasso Sparse model provides sparse estimates in linear and nonlinear regression.
problem Sparse learning in regression models.
method Develops a new sparse learning model using type-II maximum likelihood procedure.
result The BLS model provides sparse estimates and is more precise, especially with noisy data.
Nonnegative matrix factorization (NMF) with group sparsity constraints is formulated as a probabilistic graphical model and, assuming some observed data have been generated by the model, a feasible variational Bayesian algorithm is derived for learning model parameters. When used in a supervised learning scenario, NMF …
Paper proposes a learning-based sparse Bayesian method for accurate off-grid DOA estimation.
problem One-bit off-grid direction of arrival (DOA) estimation in a single snapshot scenario.
method Formulated off-grid DOA estimation model, used Sparse Bayesian framework, proposed Learning-based Sparse Bayesian approach.
result Improved computational efficiency and accuracy in off-grid DOA estimation.
Bayesian method improves dictionary learning for complex problems.
problem Efficiently identifying relevant dictionary entries for complex inverse problems.
method Bayesian group sparsity coding and deflation steps to compress and identify relevant subdictionaries.
result Significant computational complexity reduction and improved glitch detection in LIGO experiment.
Bayesian method selects sparse models efficiently with less bias.
problem Sparse model selection and regularization in Gaussian graphical models.
method Continuous spike-and-slab framework with EM algorithm for fast explorations.
result Efficient selection of sparse models with less bias compared to other methods.
Proposes a Bayesian Autoencoder with sparse Gaussian process priors to capture data correlations.
problem Autoencoders' i.i.d. assumption of latent representations fails to capture data correlations.
method Imposes fully Bayesian sparse Gaussian Process priors on the latent space of a Bayesian Autoencoder and uses stochastic gradient Hamiltonian Monte Carlo for posterior estimation.
result Consistently outperforms alternatives relying on Variational Autoencoders on various tasks.
Sparse graph learning for dependent time series using ADMM.
problem Inferring conditional independence graph of sparse, high-dimensional stationary multivariate Gaussian time series.
method Sparse-group lasso-based frequency-domain formulation and alternating direction method of multipliers (ADMM) optimization.
result Convergence of inverse PSD estimators to true value under certain conditions.
Paper proposes an efficient algorithm for learning sparse Bayesian networks from discrete high-dimensional data.
problem Learning sparse structure Bayesian networks from high-dimensional discrete data.
method Score function for sparse DAG, block-wise stochastic coordinate descent with variance reduction.
result The proposed algorithm outperforms existing methods in synthetic data benchmarks.
Proposes a method to learn sparse deep neural networks with theoretical guarantees.
problem Over-parameterized deep neural networks cause training, prediction, and interpretation difficulties.
method Frequentist-like method for sparse DNNs under Bayesian framework.
result Consistent sparse DNNs with at most connections.
PROBE algorithm efficiently solves sparse high-dimensional linear regression.
problem Sparse high-dimensional linear regression models with complex parameter spaces.
method Partitioned empirical Bayes ECM algorithm for computationally efficient MAP estimation.
result PROBE algorithm provides robust and efficient coordinate-wise optimization.
Jointly learns feature and sample relevancies for robust sparse recovery.
problem Sparse recovery sensitivity to data contaminants like outliers or misspecified noise.
method Jointly learns feature and sample relevancies via marginal likelihood optimization.
result Consistent sparse and robust prediction models across diverse tasks.
Paper develops efficient variational inference for sparse deep learning with theoretical guarantees.
problem Sparse deep learning's challenge of huge storage consumption and sparse structure recovery.
method Bayesian treatment with spike-and-slab priors and continuous relaxation of Bernoulli distribution for computationally efficient variational inferences.
result Provides variational posterior contraction rate, justifying consistency of the proposed method.
Bayesian approach improves uncertainty in deep learning models.
problem Uncertainty quantification in deep learning models.
method Bayesian point of view, Gaussian approximability, semi-parametric Bernstein-von Mises theorems.
result Bayesian credible regions have valid frequentist coverage, providing theoretical justification for deep learning.
New Bayesian method for joint sparse parameter inference.
problem Inference of jointly sparse parameter vectors from multiple measurements.
method Hierarchical Bayesian learning with joint sparsity-promoting priors.
result New algorithms consistently outperform existing methods in numerical experiments.
Paper proposes a method to solve sparse Bayesian learning problems efficiently.
problem Finding sparsest solutions in high-dimensional settings.
method Sparse Bayesian learning with screening test to identify and remove zero coefficients.
result The method accelerates the solution process for sparse Bayesian learning problems.
Bayesian sparse reconstruction: a brute-force approach to astronomical imaging and machine learningastro-ph.IM
Bayesian framework for sparse signal reconstruction in astronomy and machine learning.
problem Signal reconstruction in noisy 1- and 2-dimensional signals, including astronomical images.
method Bayesian interpretation of sparse reconstruction, using priors and integer parameters for basis functions.
result Order-of-magnitude computational efficiency gains compared to traditional methods.
VASE uses Bayesian neural networks to improve exploration in sparse reward environments.
problem Exploration in environments with continuous control and sparse rewards.
method VASE uses a Bayesian neural network model of the environment dynamics and variational inference to alternately update the model's accuracy and policy.
result VASE outperforms other surprise-based exploration techniques in continuous control sparse reward environments.
Bayesian Additive Distribution Regression (DistBART) predicts distributions from grouped data.
problem Predicting distributions from grouped data with varying characteristics.
method Bayesian nonparametric approach using BART for modeling the regression function.
result Empirical and theoretical evidence supports DistBART's effectiveness in learning from low-dimensional marginals.
A novel method for learning Bayesian network structures from decentralized data, balancing privacy and efficiency.
problem Privacy and communication costs in learning Bayesian network structures from decentralized data.
method Fed-Sparse-BNSL, combining differential privacy with greedy updates targeting only a few relevant edges per participant.
result Achieves utility close to non-private baselines while offering stronger privacy and communication efficiency.
sBayFDNN bridges deep learning and functional data analysis for complex, structured data.
problem Challenges in functional data analysis, especially for complex, continuously structured data.
method Sparse Bayesian functional deep neural network (sBayFDNN) that learns adaptive functional embeddings and interpretable region selection.
result First theoretical guarantees for a Bayesian deep functional model, ensuring reliability and statistical rigor.
The focus in this paper is Bayesian system identification based on noisy incomplete modal data where we can impose spatially-sparse stiffness changes when updating a structural model. To this end, based on a similar hierarchical sparse Bayesian learning model from our previous work, we propose two Gibbs sampling algori…
Bayesian method infers network topology and dynamics from noisy, sparse measurements.
problem Learning network topology and dynamics from partial, noisy data.
method Developed method uses dynamical structure functions derived from linear stochastic differential equations.
result Method outperforms state-of-the-art methods in various network types.
Multi-task learning models using Gaussian processes (GP) have been developed and successfully applied in various applications. The main difficulty with this approach is the computational cost of inference using the union of examples from all tasks. Therefore sparse solutions, that avoid using the entire data directly a…
New method speeds up sparse Bayesian learning without covariance matrix.
problem Sparse coding problem with uncertainty quantification.
method Covariance-free expectation maximization (CoFEM) that avoids explicit covariance matrix computation.
result Up to thousands of times faster than existing methods without sacrificing accuracy.
Proposes efficient Bayesian logistic regression for large sparse datasets.
problem Infeasibility of theoretical Bayesian methods for large sparse feature sets.
method Low complexity analytical approximations for sparse online logistic and probit regressions.
result Empirical results show superior performance compared to more complex methods.
Many data-driven approaches exist to extract neural representations of functional magnetic resonance imaging (fMRI) data, but most of them lack a proper probabilistic formulation. We propose a group level scalable probabilistic sparse factor analysis (psFA) allowing spatially sparse maps, component pruning using automa…
The paper analyzes methods for sparse Bayesian regression in nonlinear system identification.
problem Learning sparse models in Bayesian regression with nonlinear applications.
method Two classes of methods: regularization and thresholding based, built on automatic relevance determination (ARD).
result Analytical demonstration of favorable performance with sparse solutions in linear problems.
New method groups genetic data into coherent topics for disease insights.
problem Analyzing large, multi-dimensional genetic data sets.
method Conditional Hierarchical Bayesian Tucker Decomposition for genetic data analysis.
result Our models are more coherent than baseline models.
We consider the problem of recovering block-sparse signals whose structures are unknown \emph{a priori}. Block-sparse signals with nonzero coefficients occurring in clusters arise naturally in many practical scenarios. However, the knowledge of the block structure is usually unavailable in practice. In this paper, we d…
Bayesian RL uses deep, sparse planning for efficient exploration.
problem Efficient Bayesian reinforcement learning with sparse exploration.
method Optimism-free Bayes-adaptive algorithm with candidate policy generator.
result Lower computational complexity and higher rewards in experiments.
New method tackles high-dimensional SBL without covariance matrices.
problem Sparse coding problem in high-dimensional settings.
method Parallel solution of multiple linear systems using conjugate gradient algorithm.
result Our method scales better in computation time and memory.
The popular Lasso approach for sparse estimation can be derived via marginalization of a joint density associated with a particular stochastic model. A different marginalization of the same probabilistic model leads to a different non-convex estimator where hyperparameters are optimized. Extending these arguments to pr…
Novel active learning framework using sparse approximation for efficient model training.
problem Efficient model training with limited labeled data.
method Formulates batch active learning as sparsity-constrained discontinuous optimization problems, using greedy or proximal iterative hard thresholding algorithms.
result Achieves competitive performance with lower computational complexity across different settings.
Study improves theoretical understanding of Bayesian deep learning for classification tasks.
problem Theoretical gap in understanding Bayesian approaches in deep learning for classification.
method PAC-Bayes bounds techniques and Spike-and-Slab priors for sparse deep learning.
result Established non-asymptotic results for prediction error, achieving minimax optimal rates.
Adaptive Bayesian method improves deep learning performance and robustness.
problem Ensuring sparsity in deep learning models to improve performance and robustness.
method Adaptive empirical Bayesian method with self-adaptive spike-and-slab priors and stochastic gradient MCMC optimization.
result The method achieves state-of-the-art performance on MNIST and Fashion MNIST and compression performance on CIFAR10.
New method uses generative priors for compressive sensing with sparse solutions.
problem Fundamental linear inverse problem in compressive sensing.
method Sparse Bayesian learning with conditional Gaussianity.
result Ability to learn from few compressed and noisy samples without optimization.
SSVI efficiently trains sparse Bayesian neural networks with minimal compression and performance loss.
problem Efficiently training Bayesian neural networks with uncertainty quantification.
method SSVI optimizes a sparse subspace basis selection and its parameters alternately, guided by weight distribution statistics.
result SSVI achieves significant compression (10-20x model size reduction) with minimal performance drop (under 3%) and FLOPs reduction (up to 20x) compared to dense Variational Inference.
New method reduces SBL complexity from cubic to linear, improving scalability.
problem Sparse Bayesian Learning's high computational complexity for large feature spaces.
method DQN-SBL, a diagonal Quasi-Newton method for SBL.
result DQN-SBL achieves competitive generalization with sparse models, scaling well to large-scale problems.
Sparse Signal Recovery with Temporally Correlated Source Vectors Using Sparse Bayesian Learningstat.ML
We address the sparse signal recovery problem in the context of multiple measurement vectors (MMV) when elements in each nonzero row of the solution matrix are temporally correlated. Existing algorithms do not consider such temporal correlations and thus their performance degrades significantly with the correlations. I…
New method recovers block-sparse signals with common sparsity patterns.
problem Recovering block-sparse signals with common sparsity patterns in MMV.
method Pattern-coupled hierarchical Gaussian prior model with EM framework.
result Proposed method automatically captures block sparse structure.
A Sparse Bayesian Learning Algorithm for Estimation of Interaction Kernels in Motsch-Tadmor Modelstat.ML
Sparse Bayesian learning algorithm for estimating interaction kernels in Motsch-Tadmor model.
problem Data-driven identification of asymmetric interaction kernels in the Motsch-Tadmor model.
method Variational framework reformulating kernel identification as a subspace identification problem; sparse Bayesian learning algorithm with informative priors.
result Accurate, robust, and interpretable estimation of interaction kernels across various noise levels and data regimes.