NBF combines deep learning with classical filtering for better belief tracking.
problem Maintaining distributions over hidden states in partially observable systems.
method Trains neural networks to map beliefs to fixed-length vectors, updating them with incoming observations and dynamics.
result NBF efficiently tracks shifting, multimodal beliefs without particle impoverishment.
Bayesian principles improve agentic AI decision-making.
problem Decision-making under uncertainty in agentic AI systems.
method Bayesian decision theory applied to the orchestration layer of agentic AI.
result Bayesian principles enhance agentic AI's ability to make decisions under uncertainty.
This paper introduces a new probabilistic model for online learning which dynamically incorporates information from stochastic gradients of an arbitrary loss function. Similar to probabilistic filtering, the model maintains a Gaussian belief over the optimal weight parameters. Unlike traditional Bayesian updates, the m…
Develops a framework for quantifying agentic AI model risk using LLM-inferred Bayesian state filters.
problem Quantifying the risk of agentic AI systems due to uncertain beliefs and actions.
method Representing the system as a partially observed Markov decision process with latent states, Bayesian belief updates, control-dependent losses, and tail-risk functionals.
result Develops a rigorous framework for separating uncertainty quantification from risk measurement.
Efficiently updates beliefs with virtual observations.
problem Incremental belief updates in Bayesian models.
method Constructs weighted virtual observations to match posterior.
result Reconstructed posterior matches original posterior closely.
New decision-theoretic characterization separates belief and decision posteriors.
problem Understanding the conditions under which loss-based updating coincides with Bayesian updating.
method Decision-theoretic approach to distinguish belief and decision posteriors.
result Generalized Bayes coincides with ordinary Bayesian updating only if the loss is proportional to negative log-likelihood.
LF-IBIS learns optimal policies online without explicit likelihood.
problem Bayesian RL challenges due to intractable likelihood functions.
method Combines ABC with IBIS for online belief updates.
result Approximates posterior distributions for policies and parameters.
A framework for navigating environments with spatially correlated obstacles and uncertain blockage status.
problem Navigation in environments with spatially correlated obstacles of uncertain blockage status.
method Modeling spatial correlation with Gaussian Random Field, developing Bayesian belief updates, proposing a two-stage learning framework with offline and online phases.
result Consistent performance gains over baselines in environments with adversarial interruptions or clustered natural hazards.
Bayesian neural networks update beliefs with soft evidence, improving accuracy and calibration.
problem Updating neural network weights with uncertain or soft evidence.
method Developed two algorithms to approximate Jeffrey's rule for updating neural network weights.
result Jeffrey-based methods outperform traditional approaches in accuracy and calibration, especially in noisy data.
In this paper we revisit the weighted likelihood bootstrap, a method that generates samples from an approximate Bayesian posterior of a parametric model. We show that the same method can be derived, without approximation, under a Bayesian nonparametric model with the parameter of interest defined as minimising an expec…
Information theory provides a mathematical foundation to measure uncertainty in belief. Belief is represented by a probability distribution that captures our understanding of an outcome's plausibility. Information measures based on Shannon's concept of entropy include realization information, Kullback-Leibler divergenc…
New method learns priors for Bayesian neural networks from datasets.
problem Lack of prior beliefs in Bayesian deep learning.
method Amortised variational inference to learn priors from datasets.
result Flexible Bayesian neural networks for meta-learning and within-task minibatching.
When banks choose similar investment strategies the financial system becomes vulnerable to common shocks. We model a simple financial system in which banks decide about their investment strategy based on a private belief about the state of the world and a social belief formed from observing the actions of peers. Observ…
Bayesian method improves few-shot classification accuracy.
problem Few-shot classification with small labeled datasets.
method Gaussian process classifier with Pólya-Gamma augmentation and one-vs-each softmax.
result Improved accuracy and uncertainty quantification.
This work investigates the case of a network of agents that attempt to learn some unknown state of the world amongst the finitely many possibilities. At each time step, agents all receive random, independently distributed private signals whose distributions are dependent on the unknown state of the world. However, it m…
We present the first PAC optimal algorithm for Bayes-Adaptive Markov Decision Processes (BAMDPs) in continuous state and action spaces, to the best of our knowledge. The BAMDP framework elegantly addresses model uncertainty by incorporating Bayesian belief updates into long-term expected return. However, computing an e…
Online DEM improves tracking of latent states in dynamic systems.
problem Tracking latent states in dynamic systems with online updates.
method Specializes DEM for online data assimilation, separating temporal scales.
result ODEM can track latent states of a non-linear generative model.
Bayesian framework improves trading robustness against market shifts.
problem Insufficient robustness and overfitting in trading models.
method Bayesian Robust Framework integrating macro-conditioned GAN and adversarial learning.
result Framework outperforms state-of-the-art models in diverse financial instruments.
SOLBP extends efficient inference to uncertain Bayesian networks.
problem Inference in uncertain Bayesian networks with second-order probabilities.
method Extends Loopy Belief Propagation to second-order Bayesian networks.
result Generates inferences consistent with sum-product networks, more efficient and scalable.
Bayesian approach helps update deep models without forgetting past data.
problem Updating deep models sequentially without forgetting past data.
method Bayesian inference for continual learning.
result Bayesian approach enables updating model beliefs with new data.
Develops a Bayesian framework for portfolio choice with a new posterior distribution.
problem Estimation risk in parametric portfolio policies.
method Generalized Bayesian framework with Gibbs posterior, utility maximization, and KNEEDLE algorithm.
result Optimal scaling parameter λ controls the balance between prior and data. Interpole learns transparent decision-making policies from data.
problem Understanding human decision-making in opaque environments.
method Interpole combines belief-update and belief-action mapping estimation.
result Interpole provides interpretable models of decision-making behavior.
We present a distributed (non-Bayesian) learning algorithm for the problem of parameter estimation with Gaussian noise. The algorithm is expressed as explicit updates on the parameters of the Gaussian beliefs (i.e. means and precision). We show a convergence rate of O(1/k) with the constant term depending on the numb…
Transformers mimic Bayesian reasoning in controlled settings, revealing geometric mechanisms.
problem Verifying if transformers perform Bayesian reasoning rigorously in natural data.
method Constructing Bayesian wind tunnels with known posteriors and proving memorization impossibility.
result Transformers achieve 10−3-10−4 bit accuracy in Bayesian posteriors, while MLPs fail. ColaBO accelerates optimization with user beliefs.
problem Optimizing expensive functions with limited prior knowledge.
method General Bayesian framework for incorporating user beliefs.
result Significant optimization acceleration with accurate prior information.
This paper explores semi-qualitative probabilistic networks (SQPNs) that combine numeric and qualitative information. We first show that exact inferences with SQPNs are NPPP-Complete. We then show that existing qualitative relations in SQPNs (plus probabilistic logic and imprecise assessments) can be dealt effectively …
Chance-constrained ActInf allows for small violations of constraints to drive goal-directed behavior.
problem Goal-directed behavior constrained by prior beliefs.
method Introducing chance constraints to ActInf, allowing for small violations of constraints.
result Chance-constrained ActInf allows for a trade-off between robust control and chance constraint violation.
Generative model improves sample quality on ImageNet32.
problem Improving sample quality in generative models.
method Iterative Gaussian posterior inference, treating generated sample as unknown variable.
result Improves sample quality on ImageNet32 over BFNs and VDMs.
Maximizes robustness in Bayesian experimental design under model uncertainty.
problem Brittleness of Bayesian experimental design under model misspecification.
method Formulates as a max--min game, uses Sibson's α-MI, and adopts PAC-Bayes framework.
result Establishes robust belief update and conditional information gain measure.
We analyze a model of learning and belief formation in networks in which agents follow Bayes rule yet they do not recall their history of past observations and cannot reason about how other agents' beliefs are formed. They do so by making rational inferences about their observations which include a sequence of independ…
POLAR learns efficient data acquisition policies using pretrained belief representations.
problem Challenges in learning effective policies for adaptive data acquisition.
method POLAR decouples representation learning from policy learning by leveraging pretrained predictive foundation models as belief-state encoders.
result POLAR outperforms state-of-the-art methods across diverse tasks while requiring fewer training samples.
BOFiP optimizes high-dimensional functions by distributing them into sub-spaces and using game theory.
problem Optimizing high-dimensional black box functions with computational complexity.
method BOFiP decomposes high-dimensional space into sub-spaces, searches within sub-spaces, and updates beliefs using game theory.
result BOFiP outperforms competitors in high-dimensional optimization problems.
We consider the problem of training a machine learning model over a network of nodes in a fully decentralized framework. The nodes take a Bayesian-like approach via the introduction of a belief over the model parameter space. We propose a distributed learning algorithm in which nodes update their belief by aggregate in…
A new filter reduces density fitting to a linear solve, improving performance on nonlinear systems.
problem Nonlinear Bayesian filtering challenges in representing belief distributions.
method Combines score matching with Stein's identity to avoid partition function evaluation.
result The Score Kalman Filter (SKF) outperforms existing methods on nonlinear systems.
Bayesian inference uses Stein discrepancy for robustness in intractable likelihoods.
problem Intractable likelihoods in Bayesian inference.
method Generalised Bayesian inference with Stein discrepancy as the loss function.
result Robust generalised posteriors with closed form or accessible using MCMC.
Bayesian approach improves online prediction accuracy without distributional assumptions.
problem Online construction of confidence sets for black-box models.
method Combines empirical distribution with Bayesian regularization to predict quantiles.
result Adaptive algorithm with low regret and correct coverage probability for iid data.
By elaborating on the notion of linear belief functions (Dempster 1990; Liu 1996), we propose an elementary approach to knowledge representation for expert systems using linear belief functions. We show how to use basic matrices to represent market information and financial knowledge, including complete ignorance, stat…
The paper analyzes when credal sets stabilize under iterative updates in machine learning.
problem When do credal sets stabilize under iterative updates in machine learning?
method Fixed-point theorems for credal set updates.
result The paper provides the first analysis of credal set stability.
A new framework for clustering with uncertainty quantification.
problem Lack of uncertainty quantification in clustering methods.
method Generalized Bayes framework using Gibbs posteriors and loss functions.
result Efficient algorithms for clustering and uncertainty quantification.
Two EP frameworks ensure integrable beliefs in Bayesian estimation problems.
problem Non-integrable beliefs in EP can lead to infeasible solutions.
method Proposes two EP frameworks to keep messages non-integrable.
result Ensures integrable beliefs in EP, even with non-integrable messages.
Bayesian neural networks use temperature adjustments to improve predictive performance.
problem Lack of theoretical generalization guarantees for Bayesian neural networks.
method Temperature adjustments to balance likelihood and prior regularization.
result Improved predictive performance through temperature adjustments.
Improved HGF networks avoid negative precision errors in volatility updates.
problem Negative posterior precision errors in volatility-coupled nodes of HGF networks.
method Introduced a modified quadratic approximation to variational energy.
result Robust update equations across parameter space that track posterior faithfully.
We study the Markowitz portfolio selection problem with unknown drift vector in the multidimensional framework. The prior belief on the uncertain expected rate of return is modeled by an arbitrary probability law, and a Bayesian approach from filtering theory is used to learn the posterior distribution about the drift …
A significant theoretical advantage of search-and-score methods for learning Bayesian Networks is that they can accept informative prior beliefs for each possible network, thus complementing the data. In this paper, a method is presented for assigning priors based on beliefs on the presence or absence of certain paths …
We consider a group of Bayesian agents who try to estimate a state of the world θ through interaction on a social network. Each agent v initially receives a private measurement of θ: a number Sv picked from a Gaussian distribution with mean θ and standard deviation one. Then, in each discrete time iteration,…
This paper presents a Bayesian image segmentation model based on Potts prior and loopy belief propagation. The proposed Bayesian model involves several terms, including the pairwise interactions of Potts models, and the average vectors and covariant matrices of Gauss distributions in color image modeling. These terms a…
The paper tackles approximate unlearning from a subset of training data using variational inference.
problem Unlearning from a small subset of erased training data while maintaining the posterior belief from the full data.
method Formulates unlearning as minimizing KL divergence, equivalent to minimizing an evidence upper bound. Uses variational inference to approximate posterior beliefs and proposes two tricks to handle challenges.
result Demonstrates the effectiveness of the proposed unlearning methods on various Bayesian models.
BAM integrates new data while selectively remembering past observations.
problem Slow adaptation and convergence to incorrect parameter values in non-stationary environments.
method Bayes' theorem with adaptive memory selection.
result BAM generalizes and demonstrates continuous adaptation in changing environments.