Enhanced Bayesian target encoding uses sampling techniques to improve model performance.
problem Improving target encoding for better model performance in machine learning.
method Using sampling techniques in Bayesian target encoding to extract intra-category distribution information.
result Improves generalization and reduces target leakage in machine learning models.
Bayesian framework for encoding uncertainty and inducing sparsity.
problem Handling uncertainty and inducing sparsity in statistical models.
method General Bayesian framework with explicit encoding of uncertainty and sparsity-inducing approach.
result Effective in linear and logistic regression, and Bayesian neural networks.
Bayesian quadrature improves integration efficiency with invariant priors.
problem Efficient numerical integration with known structure.
method Invariance priors for bijective transformations in input domain.
result Superior performance in synthetic and real-world applications.
Hybrid Bayesian neural networks use function uncertainty for probabilistic inference.
problem Uncertainty in neural network weights is hard to specify and interpret.
method Integrates probabilistic layers with standard deterministic layers for function uncertainty.
result Improves probabilistic inference by encoding function uncertainty.
Applied Data Scientists throughout various industries are commonly faced with the challenging task of encoding high-cardinality categorical features into digestible inputs for machine learning algorithms. This paper describes a Bayesian encoding technique developed for WeWork's lead scoring engine which outputs the pro…
BLISS detects and separates astronomical sources quickly and accurately.
problem Detecting and separating overlapping astronomical sources in large images.
method Bayesian Light Source Separator (BLISS) using deep generative models and variational inference.
result BLISS can process megapixel images in seconds and produce highly accurate catalogs.
Graph structured data are abundant in the real world. Among different graph types, directed acyclic graphs (DAGs) are of particular interest to machine learning researchers, as many machine learning models are realized as computations on DAGs, including neural networks and Bayesian networks. In this paper, we study dee…
Non-negative tensor factorization models enable predictive analysis on count data. Among them, Bayesian Poisson-Gamma models can derive full posterior distributions of latent factors and are less sensitive to sparse count data. However, current inference methods for these Bayesian models adopt restricted update rules f…
A Bayesian network is a graphical model that encodes probabilistic relationships among variables of interest. When used in conjunction with statistical techniques, the graphical model has several advantages for data analysis. One, because the model encodes dependencies among all variables, it readily handles situations…
PriorVAE uses VAEs to efficiently encode spatial priors for small-area estimation.
problem Efficiently encoding spatial priors for small-area estimation using Gaussian processes.
method Approximating Gaussian process priors with a variational autoencoder (VAE).
result Efficient spatial inference through a low-dimensional latent Gaussian space representation.
Despite the recent popularity of deep generative state space models, few comparisons have been made between network architectures and the inference steps of the Bayesian filtering framework -- with most models simultaneously approximating both state transition and update steps with a single recurrent neural network (RN…
Paper proposes Adversarial CCA for multi-view alignment and generation.
problem Aligning multiple views in cross-view data analysis problems.
method Bayesian perspective, adversarial training for consistent latent encodings.
result ACCA model achieves superior performance in multi-view alignment and generation.
SplitWise enhances stepwise regression by adaptively encoding numeric predictors into binary features.
problem Capturing nonlinear relationships in regression models without sacrificing interpretability.
method Adaptive encoding of numeric predictors into binary features using shallow decision trees, assessed by AIC or BIC.
result Consistently produces more parsimonious and generalizable models than traditional techniques.
Extends VAEs to handle complex Bayesian network structures.
problem Handling complex dependency structures in Bayesian networks.
method Extends VAEs with graphical residual flows to model arbitrary dependency structures.
result Demonstrates improved performance on synthetic datasets.
Integrates neural encoders into GLMMs for multimodal data analysis.
problem Scalable Bayesian inference for GLMMs assumes low-dimensional tabular predictors and does not handle high-dimensional modalities.
method Jointly learns modality-specific neural encoders with GLMM objective, performs variance-corrected stochastic-gradient MCMC.
result Preserves interpretable fixed and random effects while scaling to large longitudinal datasets.
A new VAE approach solves inverse problems without explicit inverse mapping.
problem Solving inverse problems without explicit inverse mapping.
method Discarding the encoder in VAE architecture, directly optimizing latent variables.
result The latent variables can exhibit mutually independent properties without an encoding process.
Meta-learning improves Bayesian causal discovery by sampling from the posterior.
problem Difficulty in estimating the full posterior over causal structures due to large number of possible graphs and functional relationships.
method Proposes a Bayesian meta-learning model that encodes key properties of the posterior and allows for sampling causal structures.
result Meta-Bayesian causal discovery allows for reliable sampling from the posterior over causal structures.
In this paper we introduce ZhuSuan, a python probabilistic programming library for Bayesian deep learning, which conjoins the complimentary advantages of Bayesian methods and deep learning. ZhuSuan is built upon Tensorflow. Unlike existing deep learning libraries, which are mainly designed for deterministic neural netw…
The paper proposes using Autoencoders to learn summary statistics for Bayesian inference.
problem Approximating posterior distributions for models with intractable likelihood functions.
method Using Autoencoders to extract summary statistics that retain parameter information and cancel noise.
result The approach effectively learns summary statistics that improve posterior approximation.
Bayesian attention improves model performance and robustness.
problem Limited exploration of stochastic attention in neural networks.
method Introduces Bayesian attention belief networks using gamma and Weibull distributions.
result Outperforms deterministic and stochastic attention methods in accuracy and robustness.
A new method for Gaussian process regression with categorical inputs.
problem Challenges in building a predictive and computationally efficient Gaussian process with categorical inputs.
method Distributional encoding based on maximum mean discrepancy and Wasserstein distance.
result State-of-the-art predictive performance on various datasets.
Machine learning techniques improve Bayesian computation for complex data.
problem Infeasible posterior computation in high-dimensional models.
method Improving posterior computation using machine learning techniques.
result Potential to enhance Bayesian computation efficiency.
A new method tackles Bayesian inverse problems with complex PDEs.
problem Bayesian inverse problems with expensive forward model evaluations and high-dimensional priors.
method Domain-decomposed variational auto-encoder Markov chain Monte Carlo (DD-VAE-MCMC) method.
result The method efficiently solves Bayesian inverse problems in parallel and low-dimensional latent spaces.
Unified inference framework for spatiotemporal data.
problem Challenges in extracting mechanistic insights from complex spatiotemporal data.
method Vision transformer-driven variational encoding and likelihood-free Bayesian approach.
result Unified inference framework for identifying spatial and temporal patterns.
Bayesian method learns optimal momentum for landmark matching.
problem Finding a diffeomorphism between two sets of landmarks.
method Ensemble Kalman filter for derivative-free Bayesian inverse method.
result Efficient algorithm for various target shapes.
LLMs encode latent topic distributions, suggesting Bayesian inference.
problem Capturing topic structure from large language models.
method Connecting LLM optimization to implicit Bayesian inference and de Finetti's theorem.
result LLMs recover latent topic distributions, matching LDA-generated topics.
Quantum algorithm reduces CVA risk-neutral expectation estimation costs.
problem Reducing Monte Carlo sampling cost for CVA on real quantum hardware.
method Noise-aware quantum workflow combining market calibration, discretisation, and oracle construction.
result CABIQAE achieves lower classical post-processing runtime and more effective error exploitation.
Tensor decomposition is an important technique for capturing the high-order interactions among multiway data. Multi-linear tensor composition methods, such as the Tucker decomposition and the CANDECOMP/PARAFAC (CP), assume that the complex interactions among objects are multi-linear, and are thus insufficient to repres…
LOL-BO improves latent space Bayesian optimization over structured inputs.
problem Optimizing complex functions over high-dimensional, structured search spaces.
method Adapting trust regions from high-dimensional to structured settings, using a DAE to map inputs into a latent space.
result Achieves up to 20x improvement over state-of-the-art methods.
New method samples Jeffreys prior for objective Bayesian inference.
problem Sampling from Jeffreys prior is challenging.
method Metropolis-Adjusted Langevin Algorithm
result Samples can be directly used in Bayesian methods.
Novel method embeds generative model into Bayesian optimization for HD cardiac model parameter estimation.
problem High-dimensional optimization of patient-specific cardiac model parameters with limited data.
method Embeds a generative variational auto-encoder into the objective function of Bayesian optimization.
result Improves accuracy of parameter estimation with more than 10x gain in efficiency.
Paper presents first PAC-Bayesian bounds for KGRL methods.
problem Lack of theoretical analysis for KGRL methods.
method Proposes ReED framework for KGRL, covering 15 models.
result Provides theoretical grounding for KGRL methods.
Over the past half-decade, many methods have been considered for neural architecture search (NAS). Bayesian optimization (BO), which has long had success in hyperparameter optimization, has recently emerged as a very promising strategy for NAS when it is coupled with a neural predictor. Recent work has proposed differe…
PriorCVAE uses deep generative models to infer hyperparameters in MCMC.
problem Losing hyperparameter information in GP prior inference.
method Conditioning VAE on hyperparameters to encode and estimate them during inference.
result PriorCVAE enables efficient and distinct inference of hyperparameters.
Bayesian neural networks speed up numerical integration.
problem Scalability of Bayesian quadrature methods.
method Bayesian Stein networks using neural networks and Laplace approximation.
result Orders of magnitude speed-up on benchmark functions and real-world problems.
The process of dynamic state estimation (filtering) based on point process observations is in general intractable. Numerical sampling techniques are often practically useful, but lead to limited conceptual insight about optimal encoding/decoding strategies, which are of significant relevance to Computational Neuroscien…
Bayesian neural network (BNN) priors are defined in parameter space, making it hard to encode prior knowledge expressed in function space. We formulate a prior that incorporates functional constraints about what the output can or cannot be in regions of the input space. Output-Constrained BNNs (OC-BNN) represent an int…
The class of chain event graph models is a generalisation of the class of discrete Bayesian networks, retaining most of the structural advantages of the Bayesian network for model interrogation, propagation and learning, while more naturally encoding asymmetric state spaces and the order in which events happen. In this…
Unified notation simplifies information-theoretic concepts in machine learning.
problem Opaque notation for information-theoretic quantities in machine learning.
method Proposed a practical and unified notation for information-theoretic quantities.
result Unified notation facilitates new intuitions and rederivations in machine learning.
The structure of a Bayesian network encodes most of the information about the probability distribution of the data, which is uniquely identified given some general distributional assumptions. Therefore it's important to study the variability of its network structure, which can be used to compare the performance of diff…
Bayesian optimization learns DM preferences for multi-outcome experiments.
problem Optimizing expensive experiments with unknown utility functions and multiple outcomes.
method Alternates preference learning and Bayesian optimization, using pairwise comparisons.
result Preference exploration strategies improve Bayesian optimization performance.
In this paper, we propose a novel structure for a cross-modal data association, which is inspired by the recent research on the associative learning structure of the brain. We formulate the cross-modal association in Bayesian inference framework realized by a deep neural network with multiple variational auto-encoders …
New methods improve integration of external LMs with AED models.
problem Improving performance of AED models by integrating external LMs.
method Comparing and proposing novel methods to estimate implicit LM from AED models.
result Proposed methods outperform previous approaches.
New method improves uncertainty estimation in Bayesian deep learning models.
problem Underestimation of predictive uncertainty in Neural Linear Models (NLMs).
method Proposes a novel training method to capture useful predictive uncertainties and incorporate domain knowledge.
result Traditional training procedures for NLMs can drastically underestimate uncertainty in data-scarce regions.
We propose a family of novel hierarchical Bayesian deep auto-encoder models capable of identifying disentangled factors of variability in data. While many recent attempts at factor disentanglement have focused on sophisticated learning objectives within the VAE framework, their choice of a standard normal as the latent…
Bayesian model updating uses VAEs to approximate likelihood with small data.
problem Approximating likelihood for small data sets in structural analysis.
method Uses multimodal VAEs to approximate likelihood, suitable for high-dimensional correlated observations.
result Demonstrates computational efficiency and accuracy compared to original VAE approach.
Bayesian reward learning from demonstrations enables rigorous safety and uncertainty analysis when performing imitation learning. However, Bayesian reward learning methods are typically computationally intractable for complex control problems. We propose Bayesian Reward Extrapolation (Bayesian REX), a highly efficient …
DiBS learns Bayesian network structure and parameters efficiently.
problem Bayesian structure learning with uncertainty reasoning.
method Differentiable framework for continuous latent graph representation, agnostic to local conditional distributions.
result Significantly outperforms related approaches in posterior inference.