Developed a Particle-Gibbs sampler for Bayesian feature allocation models.
problem Intractable exact inference in Bayesian feature allocation models.
method Particle-Gibbs sampler for feature allocation matrix updates.
result PG sampler improves performance of feature allocation models.
New method optimizes Gaussian process allocation for BO.
problem Existing methods for inducing point allocation in BO hinder performance.
method Proposes a new allocation strategy using quality-diversity decomposition.
result Demonstrates improved BO performance through local high-fidelity modeling.
Paper calculates the exact error of LDA models.
problem Bayesian generalization error in Latent Dirichlet Allocation (LDA).
method Theoretical analysis of learning coefficient using algebraic geometry.
result Exact asymptotic form of LDA's generalization error.
New BAM model connects tensor factorization and topic models using Polya Urns.
problem Efficiently modeling and analyzing nonnegative tensors and topic distributions.
method Dynamic generative model BAM based on Poisson process and Polya-Bayes process.
result Developed efficient simulation algorithms for NTF and topic models.
clusterBMA combines clustering results from multiple models using Bayesian model averaging.
problem Uncertainty in model selection for clustering.
method Bayesian model averaging to combine results from multiple clustering algorithms.
result ClusterBMA offers probabilistic cluster allocations and quantifies model-based uncertainty.
Algorithm identifies best arm with prior info in structured bandits.
problem Bayesian fixed-budget best-arm identification in structured bandits.
method Prior-dependent allocations based on structure and prior information.
result Improved theoretical bounds and robust performance across diverse models.
Adaptive AI delegation framework for dynamic decision authority allocation.
problem Dynamic allocation of decision authority to AI-generated recommendations under evolving evidence quality and uncertainty.
method Formulated as a Governance-Aware POMDP, using Bayesian inference for informational state estimation and sequential optimization for authority allocation.
result Sequential Bayesian governance provides the strongest general-purpose policy across AI-quality regimes, adapting to evolving evidence.
Two models predict net loan losses using Bayesian and frequentist regression.
problem Predicting net loan losses using financial and sociological data.
method Bayesian and frequentist regression analysis.
result Improved understanding of net loan loss relationships.
New memory allocation scheme improves image generation performance.
problem Improving episodic and semantic memory representation in neural networks.
method Developed a hierarchical latent variable model with differentiable, locally block allocated latent memory.
result Improved conditional likelihood values on various datasets.
Combines multiple asset views with machine learning for better portfolio allocation.
problem Portfolio allocation with multiple uncertain asset views.
method Consistency-based data fusion techniques for combining Black-Litterman model with machine learning predictions.
result Improved portfolio allocation through fusion of multiple view estimates.
The paper tackles budget allocation for multiple campaigns using a novel combinatorial bandit approach.
problem Maximizing cumulative returns with limited budgets across various ad lines.
method Formulated as a multi-task combinatorial bandit problem, integrates Bayesian hierarchical models, and uses Thompson sampling.
result Demonstrates robustness and adaptability in maximizing overall cumulative returns.
Along with the advance of opinion mining techniques, public mood has been found to be a key element for stock market prediction. However, how market participants' behavior is affected by public mood has been rarely discussed. Consequently, there has been little progress in leveraging public mood for the asset allocatio…
Estimates expected information gain using density approximations and dimension reduction.
problem Estimating expected information gain in nonlinear and non-Gaussian settings.
method Flexible transport-based schemes for EIG estimation, optimal sample allocation, and gradient-based upper bounds on mutual information.
result Optimal sample allocation and dimension reduction schemes improve EIG estimation accuracy and convergence rate.
Bayesian optimization improved for large-scale problems.
problem Efficient optimization of expensive functions with many variables.
method Local Bayesian optimization using a collection of local models and a bandit approach for sample allocation.
result TuRBO algorithm outperforms state-of-the-art methods on various high-dimensional problems.
POCA optimizes hyperparameters with adaptive allocation for faster convergence.
problem Optimizing hyperparameters for machine learning models.
method Adaptive allocation of computational budget using Bayesian sampling.
result POCA finds strong configurations faster than its competitors.
We review three algorithms for Latent Dirichlet Allocation (LDA). Two of them are variational inference algorithms: Variational Bayesian inference and Online Variational Bayesian inference and one is Markov Chain Monte Carlo (MCMC) algorithm -- Collapsed Gibbs sampling. We compare their time complexity and performance.…
New method for MAP inference using Benders' decomposition.
problem Finite-time convergence guarantee for MAP inference.
method Sequentially adding constraints using Benders' decomposition.
result Higher optimal posterior value compared to other methods.
Hierarchical IBP model for Bayesian neural networks in continual learning.
problem Resource allocation in continual learning with dynamic network complexity.
method Indian Buffet process (IBP) and Hierarchical-IBP (H-IBP) priors for structure learning, online variational inference with reparameterization.
result Our model effectively learns the number of weights in each layer, overcoming overfitting and underfitting.
Study optimizes investment strategies in volatile markets using machine learning and Bayesian techniques.
problem Enhancing portfolio management in volatile markets.
method Market segmentation into ten volatility-based states, real-time asset allocation adjustments using Bayesian Markov switching model.
result Dynamic portfolio achieves significantly higher risk-adjusted returns and total returns.
Bayesian imputation optimizes bias-variance trade-off in time-series data.
problem Look-ahead bias in imputation of missing time-series data.
method Bayesian consensus posterior that fuses multiple posteriors to optimize bias and variance trade-off.
result Benefit of imputation for portfolio allocation with missing returns demonstrated.
We present a hybrid algorithm for Bayesian topic models that combines the efficiency of sparse Gibbs sampling with the scalability of online stochastic inference. We used our algorithm to analyze a corpus of 1.2 million books (33 billion words) with thousands of topics. Our approach reduces the bias of variational infe…
Bayesian approach improves AdaLoRA's performance and efficiency.
problem Improving the efficiency and performance of adaptive low-rank adaptation.
method Utilized Bayesian metrics and the Improved Variational Online Newton (IVON) optimizer for adaptive parameter budget allocation.
result Bayesian counterpart outperforms sensitivity-based importance metric and is faster than AdaLoRA.
GBC methods compute expected utility without needing the model's density.
problem Computing expected utility in complex models.
method Density-free generative method using quantile neural estimator.
result Efficient estimation of expected utility from simulated data.
Bayesian nonparametric model learns new categories without predefined limits.
problem Learning new categories unseen in labeled training data.
method Hierarchical Dirichlet process and latent Dirichlet allocation for automatic category inference.
result Nonparametric approach yields comparable performance to parametric methods with pre-specified new categories.
LDTA expands LDA's topic modeling capacity with tree-structured priors.
problem Limited expressiveness of Dirichlet priors in LDA for complex topic relationships.
method Introduces Latent Dirichlet-Tree Allocation (LDTA) with Dirichlet-Tree (DT) priors, and develops universal mean-field variational inference and Expectation Propagation.
result LDTA enables expressive, tree-structured priors over topic proportions, expanding modeling capacity of LDA.
Consensus Monte Carlo clusters big data with shared anchors.
problem Clustering and feature allocation in large datasets.
method Bayesian nonparametric models, Dirichlet process, Indian buffet process, consensus Monte Carlo.
result Valid for various sampling models and priors.
Bayesian inference for topics in documents with many potential causes.
problem Estimating topic distributions in documents with many potential causes and few observations.
method Exact Bayesian inference using a linear-time algorithm with a simple formula.
result Exact Bayesian inference can be computed in linear time for a given upper bound on observations.
Analyzing the underlying structure of multiple time-sequences provides insights into the understanding of social networks and human activities. In this work, we present the \emph{Bayesian nonparametric Poisson process allocation} (BaNPPA), a latent-function model for time-sequences, which automatically infers the numbe…
Unified framework for optimizing portfolios with distributions over weights, returns, and parameters.
problem Traditional portfolio optimization treats expected returns, covariances, and allocations as fixed. Modern practice replaces at least one with a distribution.
method Unified framework using Gamma_theta(dw,dr) coupling to organize Bayesian, robust, chance-constrained, stochastic-allocation, and distributional reinforcement-learning methods.
result Synthetic and structural contributions, including a portfolio specialization of Wasserstein-CVaR duality and a static no-randomization theorem.
Many modern data analysis problems involve inferences from streaming data. However, streaming data is not easily amenable to the standard probabilistic modeling approaches, which assume that we condition on finite data. We develop population variational Bayes, a new approach for using Bayesian modeling to analyze strea…
Bayesian VAR and Elliptical Black-Litterman models improve portfolio optimization during regime changes and heavy-tailed returns.
problem Portfolio optimization under market regime changes and heavy-tailed returns.
method BAVAR-BLED algorithm combining BAVAR and Black-Litterman models with Elliptical Distributions.
result Significant outperformance of state-of-the-art methods in Sharpe, Sortino ratios, and total returns.
This study uses HMM and RL to dynamically allocate equities, Treasuries, and gold based on market regimes.
problem Developing a dynamic portfolio allocation strategy for different market conditions.
method Characterizes market regimes using Markov switching models and HMM, then applies RL for allocation decisions.
result RL-based allocation outperforms passive strategies, providing lower drawdowns and higher Sharpe ratios.
Using nonparametric methods has been increasingly explored in Bayesian hierarchical modeling as a way to increase model flexibility. Although the field shows a lot of promise, inference in many models, including Hierachical Dirichlet Processes (HDP), remain prohibitively slow. One promising path forward is to exploit t…
New model identifies microbial subcommunities robustly, accounting for cross-sample heterogeneity.
problem Inference in LDA is sensitive to the number of subcommunities and often creates artificial ones.
method Incorporates logistic-tree normal (LTN) model into LDA to account for cross-sample heterogeneity.
result Restores robustness of inference and identifies meaningful subcommunities.
New method groups genetic data into coherent topics for disease insights.
problem Analyzing large, multi-dimensional genetic data sets.
method Conditional Hierarchical Bayesian Tucker Decomposition for genetic data analysis.
result Our models are more coherent than baseline models.
A scalable portfolio approach speeds up Bayesian optimization for noisy functions.
problem Efficiently selecting multiple designs in parallel for noisy, expensive black-box optimization.
method A portfolio approach that balances exploration and exploitation, using a scalable allocation strategy.
result Significant speed improvements over existing methods, with similar or better performance.
CBLN uses Bayesian Neural Networks to prevent forgetting in continual learning.
problem Catastrophic forgetting in neural networks when learning new tasks.
method CBLN uses Bayesian Neural Networks to allocate resources to new tasks without forgetting old knowledge.
result CBLN effectively addresses catastrophic forgetting in continual learning.
Bayesian predictive inference analyzes a dataset to make predictions about new observations. When a model does not match the data, predictive accuracy suffers. We develop population empirical Bayes (POP-EB), a hierarchical framework that explicitly models the empirical population distribution as part of Bayesian analys…
Recent advances in topic models have explored complicated structured distributions to represent topic correlation. For example, the pachinko allocation model (PAM) captures arbitrary, nested, and possibly sparse correlations between topics using a directed acyclic graph (DAG). While PAM provides more flexibility and gr…
Latent Dirichlet allocation (LDA) is useful in document analysis, image processing, and many information systems; however, its generalization performance has been left unknown because it is a singular learning machine to which regular statistical theory can not be applied. Stochastic matrix factorization (SMF) is a res…
Under a Bayesian framework, we formulate the fully sequential sampling and selection decision in statistical ranking and selection as a stochastic control problem, and derive the associated Bellman equation. Using value function approximation, we derive an approximately optimal allocation policy. We show that this poli…
This paper is about index policies for minimizing (frequentist) regret in a stochastic multi-armed bandit model, inspired by a Bayesian view on the problem. Our main contribution is to prove that the Bayes-UCB algorithm, which relies on quantiles of posterior distributions, is asymptotically optimal when the reward dis…
Performance of machine learning algorithms depends critically on identifying a good set of hyperparameters. While recent approaches use Bayesian optimization to adaptively select configurations, we focus on speeding up random search through adaptive resource allocation and early-stopping. We formulate hyperparameter op…
The article addresses a long-standing open problem on the justification of using variational Bayes methods for parameter estimation. We provide general conditions for obtaining optimal risk bounds for point estimates acquired from mean-field variational Bayesian inference. The conditions pertain to the existence of cer…
Optimizes active learning for machine learning models with Bayesian approach.
problem Efficiently allocate labeling resources to train machine learning models.
method Directly optimizes misclassification error using a Bayesian approach with conjugate prior.
result Superior performance compared to state-of-the-art selection strategies.
Product Kanerva Machines dynamically combine smaller models for better memory organization.
problem Limited organization in the Kanerva Machine.
method Introducing Product Kanerva Machines that dynamically combine multiple smaller Kanerva Machines.
result Product Kanerva Machines can discover spatial tunings that approximately factorize simple images by object.
Proposes a flexible feature allocation model for sparse factor analysis.
problem Sparse data and rigid assumptions in traditional exploratory tools.
method Adaptive latent feature sharing with control over feature sparsity.
result Derives a novel adaptive Factor analysis (aFA) and aPPCA for flexible dimensionality reduction.
We present K-Means Batch Bayesian Optimization (KMBBO), a novel batch sampling algorithm for Bayesian Optimization (BO). KMBBO uses unsupervised learning to efficiently estimate peaks of the model acquisition function. We show in empirical experiments that our method outperforms the current state-of-the-art batch alloc…