The paper extends and applies a new shrinkage prior in Bayesian factor analysis.
problem Estimating the number of factors in sparse Bayesian factor analysis.
method Introduces and extends a generalized cumulative shrinkage process (CUSP) prior.
result Exchangeable spike-and-slab shrinkage priors imply increasing shrinkage as the column index increases.
GRASP simplifies Bayesian regression with grouped predictors using an adaptive NBP prior.
problem Regression with grouped predictors and adaptive shrinkage.
method Normal Beta Prime (NBP) prior with tunable hyperparameters for flexible sparsity control.
result Empirical validation of robust and versatile GRASP across various sparsity and signal-to-noise ratios.
High-dimensional shrinkage risk depends on the default prior for the common scale.
problem Choosing the default prior for the common scale in high-dimensional shrinkage.
method Using radial-power benchmark to compare variance-flat and standard deviation-flat priors.
result The standard deviation-flat prior has a one-unit asymptotic risk advantage near the origin.
Proposes a tail-adaptive shrinkage method for robust sparse estimation.
problem Robust Bayesian methods for high-dimensional regression under diverse sparse regimes.
method Global-local-tail (GLT) Gaussian mixture distribution with tail-adaptive shrinkage.
result GLT posterior contracts at minimax optimal rate for sparse normal mean models.
The edge partition model (EPM) is a fundamental Bayesian nonparametric model for extracting an overlapping structure from binary matrix. The EPM adopts a gamma process (ΓP) prior to automatically shrink the number of active atoms. However, we empirically found that the model shrinkage of the EPM does not typically wo…
We construct geometric shrinkage priors for Kählerian signal filters. Based on the characteristics of Kähler manifolds, an efficient and robust algorithm for finding superharmonic priors which outperform the Jeffreys prior is introduced. Several ansätze for the Bayesian predictive priors are also suggested. In particul…
A VB method for high-dimensional regression with student-t priors achieves nearly optimal performance and computational efficiency.
problem High-dimensional linear model inferences with heavy-tailed shrinkage priors.
method Variational Bayesian (VB) procedure for high-dimensional linear models with student-t priors.
result The VB method achieves nearly optimal contraction rate and computational efficiency, outperforming MCMC methods.
R2D2-Net improves Bayesian neural networks by preventing over-shrinkage of important weights.
problem Bayesian neural networks struggle with choosing appropriate priors, leading to over-shrinkage or poor predictive performance.
method Proposes R2D2-Net with an R^2-induced Dirichlet Decomposition prior and variational Gibbs inference algorithm.
result R2D2-Net effectively shrinks irrelevant coefficients while preventing key features from over-shrinkage.
Proposes a new method to control FDR using frequentist-assisted horseshoe for high-dimensional testing.
problem Designing tests with frequentist false discovery rate control using horseshoe prior.
method Frequentist-assisted horseshoe procedure for high-dimensional normal means testing.
result Consistently achieves robust finite-sample FDR control in various sparse cases.
Guided adaptive shrinkage uses co-data to improve feature selection in genomic studies.
problem Feature selection challenges in high-dimensional genomics data, especially in clinical settings.
method Guided adaptive shrinkage methods that use co-data to adapt shrinkage parameters.
result Improves feature selection in genomic studies, demonstrated through comparisons and examples.
We forecast S&P 500 excess returns using a flexible Bayesian econometric state space model with non-Gaussian features at several levels. More precisely, we control for overparameterization via novel global-local shrinkage priors on the state innovation variances as well as the time-invariant part of the state space mod…
We propose a generalized double Pareto prior for Bayesian shrinkage estimation and inferences in linear models. The prior can be obtained via a scale mixture of Laplace or normal distributions, forming a bridge between the Laplace and Normal-Jeffreys' priors. While it has a spike at zero like the Laplace density, it al…
Proposes DSM priors for Bayesian neural networks to improve interpretability and robustness.
problem Bayesian neural networks struggle with interpretability, overconfidence, and adversarial attacks.
method Introduces Dirichlet scale mixture (DSM) priors to address these issues.
result DSM priors lead to sparse networks, robustness against adversarial attacks, and competitive predictive performance.
Dropout regularization of deep neural networks has been a mysterious yet effective tool to prevent overfitting. Explanations for its success range from the prevention of "co-adapted" weights to it being a form of cheap Bayesian inference. We propose a novel framework for understanding multiplicative noise in neural net…
PAS improves estimation of multiple means using ML predictions and shrinkage.
problem Improving statistical estimates with limited gold-standard data and noisy ML predictions.
method Prediction-Powered Adaptive Shrinkage (PAS) that combines PPI with empirical Bayes shrinkage.
result PAS adapts to the reliability of ML predictions and outperforms traditional methods in large-scale applications.
Model for dynamic relational data with regime changes.
problem Handling abrupt changes in dynamic relational data.
method Factorized fusion shrinkage model with global-local shrinkage priors.
result Posterior distribution attains minimax optimal rate up to logarithmic factors.
Study finds economic data may not be as sparse as previously thought.
problem Modeling economic relations with many variables and prior sensitivity issues.
method Bayesian approach with Spike-and-Slab prior to evaluate variable selection and shrinkage.
result Prior distribution affects detection of sparsity patterns in economic data.
Bayesian neural network achieves nearly optimal performance in Besov space.
problem Bayesian neural networks in Besov space.
method Spike-and-slab prior and shrinkage prior for posterior convergence rate.
result The posterior convergence rate is nearly minimax and adaptive to unknown smoothness.
The paper decouples shrinkage and selection in Bayesian Quantile Regression.
problem Improving prediction accuracy in high-dimensional Bayesian Quantile Regression.
method Two-step procedure: shrinkage through continuous priors, sparsification through SAVS.
result The method reduces bias and provides interpretable variable selection.
Sparse convex clustering is to cluster observations and conduct variable selection simultaneously in the framework of convex clustering. Although a weighted L1 norm is usually employed for the regularization term in sparse convex clustering, its use increases the dependence on the data and reduces the estimation acc…
Paper proposes new Bayesian neural network models for efficient learning.
problem Efficient learning and model compression in deep neural networks.
method Proposes Spike-and-Slab Group Lasso (SS-GL) and Spike-and-Slab Group Horseshoe (SS-GHS) priors for structured sparsity in Bayesian neural networks.
result Establishes competitive performance in prediction accuracy, model compression, and inference latency compared to baseline models.
HierGP improves emulator efficiency for sparse, structured data.
problem Sparse, structured data in expensive simulations.
method Hierarchical shrinkage GP framework with cumulative shrinkage priors.
result HierGP identifies structured sparse features from limited data.
Develops a sparsity-inducing Bayesian Causal Forest for estimating heterogeneous treatment effects.
problem Estimating heterogeneous treatment effects using observational data with varying degrees of sparsity.
method Introduces a sparsity-inducing version of Bayesian Causal Forests with additional priors to adjust covariate weights.
result Improves adaptability to sparse data generating processes and uncovering moderating factors driving heterogeneity.
BaGGLS models biological interactions using Bayesian shrinkage for interpretability.
problem Interpreting complex interactions in high-dimensional biological data.
method Bayesian group global-local shrinkage prior with variational approximation.
result BaGGLS outperforms other methods in interaction detection and scalability.
Bayesian method for dynamic correlation matrices improves accuracy and responsiveness.
problem Challenges in estimating time-varying correlation matrices, including slow adaptation, insufficient regularization, and diffuse uncertainty.
method Low-rank factor representation with dynamic shrinkage prior and multivariate factor stochastic volatility model.
result Improved accuracy and responsiveness compared to competing methods in various challenging scenarios.
HS-MoE selects sparse experts using adaptive priors and data-adaptive gating.
problem Sparse expert selection in mixture-of-experts architectures.
method Combines horseshoe prior with input-dependent gating for data-adaptive sparsity.
result Data-adaptive sparsity in expert usage.
A novel Bayesian method for dynamic sparsity in Gaussian dynamic linear regression.
problem Variable selection and shrinkage in time-varying regression models.
method Time-varying sparsity via Markov switching priors for coefficients' variances, extending spike-and-slab priors.
result Induces smoothness or shrinkage towards zero at each time point, leading to improved model performance.
We propose a new Bayesian model for flexible nonlinear regression and classification using tree ensembles. The model is based on the RuleFit approach in Friedman and Popescu (2008) where rules from decision trees and linear terms are used in a L1-regularized regression. We modify RuleFit by replacing the L1-regularizat…
Paper tackles infinite-dimensional optimization and Bayesian learning for stochastic differential equations.
problem Learning the drift function of stochastic differential equations with uncertainty quantification.
method Combines infinite-dimensional optimization results with Bayesian hierarchical framework, incorporating shrinkage priors for sparse learning.
result Systematic approach for accurate learning of stochastic differential equations with uncertainty quantification.
Proposes a hierarchical model for learning discrete Bayesian networks with shrinkage.
problem Learning discrete Bayesian networks with high-order interactions and cell probabilities.
method Hierarchical Dirichlet shrinkage model with Metropolis-adjusted Langevin algorithm for sampling.
result Efficiently learns graph structure and selects between DAGs from sparse count data.
Robust Bayes-Assisted Conformal Prediction improves prediction set sizes.
problem Misspecification of Bayesian working model and prior misalignment.
method RoBAS (Robust Bayes-Assisted Shrinkage) framework with two instantiations.
result Improves prediction set sizes in shifted settings.
Robust Bayes-Assisted Conformal Prediction improves prediction set sizes.
problem Misspecification of Bayesian working model and prior misalignment.
method RoBAS (Robust Bayes-Assisted Shrinkage) framework with two instantiations.
result Proposed scores adapt to prior quality, reducing interval widths in shifted settings.
A new shrinkage-based construction is developed for a compressible vector x∈Rn, for cases in which the components of $\xv$ are naturally associated with a tree structure. Important examples are when $\xv$ corresponds to the coefficients of a wavelet or block-DCT representation of data. The me…
New sparse GP model learns compositional kernels efficiently.
problem Learning accurate Gaussian Process models with complex kernel structures.
method MultiSVGP model with Horseshoe prior for kernel selection.
result Our model provides better fit and faster computation for large-scale data.
Extended study improves covariance matrix estimation for portfolio managers.
problem Limited sample sizes and poor performance of PCA estimator in high-dimensional returns.
method Developed a more general shrinkage framework targeting further information.
result Improves the PCA estimator of beta by shrinking it toward a target.
EigenBayes: A fast, adaptive Bayesian shrinkage approach for high-dimensional matrix factorization
problem Choosing the latent dimension k in factor models method Adaptive spectral shrinkage and empirical Bayes calibration
result Adapts to signal-to-noise ratio and shrinks superfluous components
In recent years, a rich variety of shrinkage priors have been proposed that have great promise in addressing massive regression problems. In general, these new priors can be expressed as scale mixtures of normals, but have more complex forms and better properties than traditional Cauchy and double exponential priors. W…
This paper develops a slice sampler for Bayesian linear regression models with arbitrary priors. The new sampler has two advantages over current approaches. One, it is faster than many custom implementations that rely on auxiliary latent variables, if the number of regressors is large. Two, it can be used with any prio…
Nash integrates covariate-specific side info into sparse regression via neural networks.
problem Sparse linear regression struggles with covariates exhibiting structure or coming from heterogeneous sources.
method Neural Adaptive Shrinkage (Nash) framework that integrates side information into sparse regression via neural networks. Uses split variational empirical Bayes algorithm.
result Nash improves accuracy and adaptability over existing methods in real data experiments.
We present a sparse estimation and dictionary learning framework for compressed fiber sensing based on a probabilistic hierarchical sparse model. To handle severe dictionary coherence, selective shrinkage is achieved using a Weibull prior, which can be related to non-convex optimization with p-norm constraints for $0…
Improved DSSMs for easier interpretable latent variables.
problem Complex and hard-to-interpret latent variables in DSSMs.
method Simplified predictive decoder and shrinkage priors.
result Interpretable latent variables improve forecasting performance.
In this paper we discuss Bayesian nonconvex penalization for sparse learning problems. We explore a nonparametric formulation for latent shrinkage parameters using subordinators which are one-dimensional Lévy processes. We particularly study a family of continuous compound Poisson subordinators and a family of discrete…
Bayesian neural networks improve macroeconomic forecasting and model nonlinearities.
problem Handling small T, big K macroeconomic datasets with temporal dependence.
method Developed Bayesian neural networks with mixture activation functions, shrinkage priors, and stochastic volatility.
result BNNs produce precise density forecasts, often better than other methods.
A new estimator corrects bias in high-dimensional predictive regressions.
problem Bias in high-dimensional predictive regressions.
method IVX-desparsified LASSO (XDlasso) estimator.
result Corrects both shrinkage and Stambaugh bias.
We introduce a distributionally robust maximum likelihood estimation model with a Wasserstein ambiguity set to infer the inverse covariance matrix of a p-dimensional Gaussian random vector from n independent samples. The proposed model minimizes the worst case (maximum) of Stein's loss across all normal reference d…
An efficient algorithm selects the correct number of latent dimensions in multidimensional probit models.
problem Determining the correct number of latent dimensions in multidimensional probit graded response models.
method Adaptive Bayesian dimension selection framework using cumulative ordered spike-and-slab (COSS) prior and Albert--Chib latent response augmentation.
result The proposed method accurately recovers latent structures and avoids repeated model fitting.
Bayesian methods improve causal effect estimation, offering shrinkage and sensitivity analysis.
problem Improving causal effect estimation in practical settings.
method Parametric and nonparametric Bayesian approaches.
result Priors induce shrinkage and sparsity in parametric models.
Flexible empirical Bayes for large-scale multiple linear regression.
problem Large-scale multiple linear regression with flexible priors and efficient computation.
method Adaptive shrinkage priors combined with variational approximations for hyperparameter estimation.
result The posterior mean from the empirical Bayes method solves a penalized regression problem.