Paper introduces variational inference for Bayesian inverse problems with gamma hyperpriors.
problem Bayesian inverse problems with sparse solutions.
method Variational iterative alternating scheme for hierarchical models with gamma hyperpriors.
result Accurate reconstruction and meaningful uncertainty quantification.
Bayesian hyperprior stabilizes image restoration for noisy and missing data.
problem Stability and adaptability in image restoration for noisy and missing data.
method Proposes a hyperprior approach to stabilize Bayesian image restoration.
result Effective restoration of high dynamic range images from a single sensor.
Bayesian optimization for probabilistic programs improves performance.
problem Optimizing probabilistic programs with arbitrary variable subsets.
method Code transformations and Bayesian optimization framework.
result Significant performance improvements over existing packages.
Bayesian neural networks are shown to be minimax and admissible under certain conditions.
problem Optimality of Bayesian neural networks in deep learning models.
method Analysis of decision rules induced by BNNs in the normal location model under quadratic loss.
result A hyperprior on the effective output variance yields a minimax and admissible decision rule.
Paper proposes fully Bayesian approach for RVM classification, improving accuracy especially in imbalanced data.
problem Difficulty in conducting RVM classification due to lack of closed-form solution for weight parameter posterior.
method Proposes Generic Bayesian and Fully Bayesian approaches with hierarchical hyperprior structure.
result Improves classification performance, especially in imbalanced data.
The paper studies sparsity in EBF with hyperpriors and proposes a PALM algorithm.
problem Promoting sparsity in sparse learning problems.
method Empirical Bayes framework, hyperpriors, proximal alternating linearized minimization (PALM) algorithm.
result Appropriate hyperpriors can significantly enhance sparsity and restoration accuracy.
Proposes a new hyperprior and predictive criterion for weakly informative hyperprior in relevance vector machine.
problem Capturing non-homogeneous data structure with limited kernel functions.
method Uses inverse gamma hyperprior with a shape parameter close to zero and a scale parameter not close to zero. Applies multiple kernel method with different widths. Proposes extended predictive information criterion for scale parameter selection.
result Obtains a multiple kernel relevance vector regression model with good predictive accuracy.
Our method enforces latent independence in deep generative models using a hyperprior.
problem Unsupervised disentanglement of latent representations in deep models.
method We augment VAE with an inverse-Wishart prior to enforce statistical independence in latent dimensions.
result Our approach outperforms state-of-the-art methods in disentanglement and reconstruction.
Paper proposes E3BM for robust few-shot learning with few examples.
problem Few-shot learning with limited data leads to poor model performance.
method Meta-learn ensemble of epoch-wise empirical Bayes models (E3BM).
result Top performance achieved using epoch-dependent transductive hyperprior learner.
A hierarchical Gaussian prior model improves low-rank matrix completion.
problem Low-rank matrix completion with improved structure exploitation.
method Hierarchical Gaussian prior model with GAMP embedded variational Bayesian inference.
result The proposed method outperforms state-of-the-art matrix completion methods.
Adaptive Bayesian model for covariate-dependent power spectra analysis.
problem Estimating complex relationships and interactions between covariates and power spectra.
method Bayesian sum of trees model with local power spectrum estimation and reversible-jump MCMC for tree modifications.
result The method can accurately recover both smooth and abrupt changes in power spectra across multiple covariates.
New method reduces bias in sparse Bayesian learning.
problem High sparsity in statistical models leads to significant bias.
method Variable-coefficient ℓ1 penalty with hyperpriors. result Reduces bias in sparse Bayesian learning.
Fast Bayesian inference with adaptable priors for real-time applications.
problem Intractable exact posterior computation limits Bayesian inference's adoption.
method Distribution Transformer architecture that learns mappings between priors and posteriors.
result Significant reduction in computation time from minutes to milliseconds.
Bayesian KANs achieve near-minimax posterior contraction rates in anisotropic Besov spaces.
problem Statistical foundation for Bayesian Kolmogorov-Arnold networks in anisotropic Besov spaces.
method Sparse Bayesian KANs with spike-and-slab priors, hyperprior on model size, and approximation complexity bounds.
result Posterior contraction rates depend on intrinsic anisotropic smoothness and effective dimension of the compositional structure.
We propose a method to classify the causal relationship between two discrete variables given only the joint distribution of the variables, acknowledging that the method is subject to an inherent baseline error. We assume that the causal system is acyclicity, but we do allow for hidden common causes. Our algorithm presu…
We investigate the choice of tuning parameters for a Bayesian multi-level group lasso model developed for the joint analysis of neuroimaging and genetic data. The regression model we consider relates multivariate phenotypes consisting of brain summary measures (volumetric and cortical thickness values) to single nucleo…
New method designs fairer transport plans with uncertainty.
problem Designing fair and balanced mass transport plans.
method Hierarchical fully probabilistic design (HFPD) for transport plans.
result Optimal hyperprior for transport plans with uncertain marginals.
Bayesian inference simplified for machine learning models.
problem Difficulty in specifying general prior belief in machine learning architectures.
method Parsimonious inference using information theory and Kolmogorov complexity.
result Framework quantifies model complexity and prediction information, reducing memorization.
CANDECOMP/PARAFAC (CP) tensor factorization of incomplete data is a powerful technique for tensor completion through explicitly capturing the multilinear latent factors. The existing CP algorithms require the tensor rank to be manually specified, however, the determination of tensor rank remains a challenging problem e…
Improves feature selection in high-dimensional data using LLM-generated weights.
problem Inaccurate LLM-generated weights degrade feature selection performance.
method Integrates LLM-generated weights into prior inclusion probabilities using LLM Sparsity Prior (LSP).
result Improves prediction accuracy and identifies clinically relevant features.
A principled approach to characterize the hidden structure of networks is to formulate generative models, and then infer their parameters from data. When the desired structure is composed of modules or "communities", a suitable choice for this task is the stochastic block model (SBM), where nodes are divided into group…
Paper improves deep point cloud compression techniques.
problem Efficiently compressing 3D point cloud data for various applications.
method Integrates scale hyperprior model, deeper transforms, focal loss, and optimal thresholding.
result Achieves significant BD-PSNR gains over existing methods.
Two algorithms improve GP bandits by selecting priors and minimizing regret.
problem Selecting appropriate GP priors for unknown functions.
method Developed two algorithms: Prior-Elimination GP-TS and HyperPrior GP-TS.
result Established sublinear regret bound for HyperPrior GP-TS.
High-dimensional shrinkage risk depends on the default prior for the common scale.
problem Choosing the default prior for the common scale in high-dimensional shrinkage.
method Using radial-power benchmark to compare variance-flat and standard deviation-flat priors.
result The standard deviation-flat prior has a one-unit asymptotic risk advantage near the origin.
Improved neural image compression with refined latent representations.
problem Sub-optimal results from variational autoencoders due to imperfect optimization and capacity limitations.
method Stochastic Gumbel Annealing (SGA) and its extensions (SGA+), including three different methods.
result Significant improvement in compression performance, especially on the R-D trade-off.
Unified Bayesian-AI framework improves epidemiological risk prediction and uncertainty quantification.
problem Lack of calibrated uncertainty in machine learning models for epidemiology.
method Combines Bayesian prediction with Bayesian hyperparameter optimization using logistic regression and Gaussian-process Bayesian optimization.
result Unified Bayesian-AI framework provides reliable coverage and improved calibration, enhancing epidemiological decision making.
We exhibit a strong link between frequentist PAC-Bayesian risk bounds and the Bayesian marginal likelihood. That is, for the negative log-likelihood loss function, we show that the minimization of PAC-Bayesian generalization risk bounds maximizes the Bayesian marginal likelihood. This provides an alternative explanatio…
ZhuSuan is a Python library for Bayesian deep learning.
problem Bayesian deep learning for probabilistic models.
method Bayesian inference, probabilistic programming, Tensorflow.
result Supports various probabilistic models including hierarchical and deep generative models.
Few Bayesian layers near output capture model uncertainty in deep learning.
problem Capturing model uncertainty in deep learning models.
method Varying the number and position of Bayesian layers in a network, comparing performance on active learning with MNIST dataset.
result Few Bayesian layers near the output can capture model uncertainty efficiently.
PAC-Bayesian bounds for MLPs with cross entropy loss validated.
problem Generalization bounds for MLPs with cross entropy loss.
method Introduced probabilistic explanations and proved PAC-Bayesian bounds using ELBO.
result MLPs with cross entropy loss inherently guarantee PAC-Bayesian generalization bounds.
Review of priors in Bayesian deep learning models.
problem The importance of prior choices in Bayesian deep learning models.
method Overview of different priors and methods of learning priors from data.
result Motivate practitioners to think carefully about prior specification.
Bayesian methods enhance deep learning models by improving reliability and uncertainty.
problem Improving reliability and uncertainty awareness in deep learning models.
method Approximate Bayesian inference techniques, including SG-MCMC and VI, applied to deep learning models.
result Enhanced posterior inference for deep learning models, particularly in neural networks and generative models.
Bayesian hybrid models correct for missing physics in machine learning.
problem Systematic bias in machine learning models.
method Fusing physics-based insights with machine learning constructs, using Bayesian calibration and stochastic programming.
result Bayesian hybrid models outperform pure machine learning approaches with less data.
Enhances robustness in experimental design through Generalised Bayesian inference.
problem Poor inference and estimates of information gain when statistical model is incorrectly specified.
method Generalised Bayesian (Gibbs) inference framework applied to experimental design.
result GBOED enhances robustness to outliers and incorrect assumptions about noise distribution.
Bayesian neural networks speed up numerical integration.
problem Scalability of Bayesian quadrature methods.
method Bayesian Stein networks using neural networks and Laplace approximation.
result Orders of magnitude speed-up on benchmark functions and real-world problems.
Bayesian uncertainty quantification is flawed, according to new research.
problem Flawed interpretation of Bayesian uncertainty quantification.
method Discussion of Bayesian updating and optimization-based perspective, proposing measures of quality.
result Bayesian uncertainty quantification is not coherent with optimization-based perspective.
Bayesian MAML outperforms MAML in meta learning tasks with theoretical guarantees.
problem Theoretical understanding of Bayesian MAML's superiority over MAML.
method Comparison of meta test risks between Bayesian MAML and MAML in meta linear regression.
result Bayesian MAML has provably lower meta test risks than MAML in both distribution agnostic and linear centroid cases.
Bayesian optimization uses shared latent variables for multiple systems.
problem Optimizing systems with limited data and unknown relationships.
method Shared latent variables, Bayesian inference, probabilistic metamodel.
result Performance improvement in zero-, one-, and few-shot settings.
The paper compares inference methods for Bayesian nonnegative matrix factorisation.
problem Improving prediction accuracy and pattern discovery in nonnegative matrix factorisation.
method Compared non-probabilistic, Gibbs sampling, variational Bayesian, and maximum-a-posteriori approaches.
result Variational Bayesian inference is a new and efficient approach for Bayesian nonnegative models.
Bayesian REX learns Atari games from demonstrations efficiently.
problem Bayesian reward learning for complex control problems is computationally intractable.
method Bayesian Reward Extrapolation (Bayesian REX) pre-trains a low-dimensional feature encoding and uses preferences to perform fast Bayesian inference.
result Bayesian REX learns Atari games from demonstrations in 5 minutes, competitive with state-of-the-art methods.
Bayesian coresets improve scalable Bayesian inference.
problem Efficiently approximating posterior inference with a subset of data.
method Sparsity constrained optimization and accelerated optimization methods.
result Explicit convergence rate guarantees and superior performance compared to state-of-the-art.
Nonlinear MCMC improves Bayesian machine learning sampling.
problem Sampling problems in Bayesian machine learning.
method Nonlinear MCMC technique with convergence guarantees.
result Improves sampling in Bayesian neural networks.
This paper improves deep learning by integrating Bayesian inference into network structure learning.
problem Bayesian inference in high-dimensional, over-parameterized neural networks.
method Developed an efficient stochastic variational inference approach to learn both network structure and weights.
result Empirically, the method exhibits competitive predictive performance and preserves Bayesian benefits.
Proposes OBS, a method to adaptively combine Bayesian models online.
problem Learning optimal combinations of Bayesian models in online learning.
method Empirical Bayes lens, Online Bayesian Stacking (OBS).
result Establishes a novel connection between OBS and portfolio selection.
FP-BMA improves generalization by encouraging flat posteriors in Bayesian Model Averaging.
problem Lack of flat posterior in approximate Bayesian inference methods hinders effective Bayesian Model Averaging.
method Proposes Flat Posterior-aware Bayesian Model Averaging (FP-BMA) and Flat Posterior-aware Bayesian Transfer Learning schemes.
result FP-BMA successfully captures flat posteriors, improving generalization performance.
Bayesian neural networks use temperature adjustments to improve predictive performance.
problem Lack of theoretical generalization guarantees for Bayesian neural networks.
method Temperature adjustments to balance likelihood and prior regularization.
result Improved predictive performance through temperature adjustments.
SCoreBO improves Bayesian optimization by learning hyperparameters and self-correcting.
problem Efficient hyperparameter tuning for Gaussian process models in Bayesian optimization.
method Introduces SAL and SCoreBO, which prioritize hyperparameter learning and perform simultaneous optimization and learning.
result SCoreBO outperforms state-of-the-art methods on traditional benchmarks and atypical tasks.
Discussing hybrid models in Bayesian networks.
problem Improving accuracy in network modeling.
method Hybrid semiparametric Bayesian approach.
result Enhanced model performance in complex networks.