Nonlinear MCMC improves Bayesian machine learning sampling.
problem Sampling problems in Bayesian machine learning.
method Nonlinear MCMC technique with convergence guarantees.
result Improves sampling in Bayesian neural networks.
On-device research index
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
168,695 papers · 148 categories
Trend · papers per month
48 results for “Bayesian machine learning”
Proved a combinatorial conjecture in machine learning.
problem None explicitly stated in the abstract.
method Binomial and multinomial sums identities.
result Proved a combinatorial conjecture.
Machine learning techniques improve Bayesian computation for complex data.
problem Infeasible posterior computation in high-dimensional models.
method Improving posterior computation using machine learning techniques.
result Potential to enhance Bayesian computation efficiency.
Causal Inference with the Instrumental Variable Approach and Bayesian Nonparametric Machine Learningstat.ML
Bayesian nonparametric machine learning improves instrumental variable inference.
problem Estimating causal effects with nonlinear relationships.
method Bayesian Additive Regression Trees (BART) for estimating functions and Dirichlet Process mixtures for error terms.
result Dramatic improvements in inference with nonlinear data, no manual tuning required.
Bayesian approach to selecting data for machine learning.
problem Iterative data selection in machine learning algorithms.
method Embedding data selection into decision theory and deriving Bayes-optimal criteria.
result Mitigates confirmation bias in data selection.
Explosive growth in data and availability of cheap computing resources have sparked increasing interest in Big learning, an emerging subfield that studies scalable machine learning algorithms, systems, and applications with Big Data. Bayesian methods represent one important class of statistic methods for machine learni…
Bayesian optimization outperformed random search in machine learning hyperparameter tuning challenge.
problem Optimizing hyperparameters of machine learning models using derivative-free methods.
method Bayesian optimization vs. random search on real datasets.
result Bayesian optimization significantly outperformed random search in held-out objective functions.
Quantum Bayesian Computationstat.ML
QBC uses quantum computers to speed up Bayesian computation.
problem Exponential speed-up in Bayesian computation.
method Quantum von Neumann measurement for simulating ML algorithms.
result Quantum versions of regression, Gaussian processes, and SGD.
AutoBayes automates Bayesian graph exploration for robust machine learning.
problem Learning representations invariant to nuisance variations in machine learning.
method Automated Bayesian inference framework exploring different graphical models.
result Significant performance improvement with nuisance-invariant machine learning pipelines.
The paper connects three machine learning methods to reduce generalization errors.
problem Reducing generalization errors in machine learning models.
method Distributionally robust optimization, Bayesian methods, and regularization.
result Machine learning models can be characterized using distributional uncertainty and robustness measures.
Bayesian Optimization improves machine learning for detecting network attacks.
problem Detecting network attacks to secure critical information.
method Bayesian Optimization for tuning machine learning algorithms (SVM-RBF, RF, k-NN).
result The proposed framework achieves high accuracy and low false alarms.
FanG-HPO optimizes machine learning models for fairness and low energy consumption.
problem Bias in machine learning models and high energy consumption in hyperparameter optimization.
method Combines multi-objective and multiple information source Bayesian optimization.
result FanG-HPO identifies fair and energy-efficient machine learning models.
The Bayesian Learning Rulestat.ML
Bayesian learning rule unifies and generalizes various machine learning algorithms.
problem Machine learning algorithms are diverse and not always understood.
method Bayesian principles and natural gradients are used to derive algorithms.
result Derives a wide range of algorithms including classical and modern ones.
Develops methods for cooperative Bayesian inference.
problem Cooperation between learning agents.
method Sequential Bayesian inference approaches.
result Theoretical foundation for cooperative inference.
Bayesian optimization reduces materials design costs by 10x.
problem Expensive materials design search space with mixed variables.
method Uncertainty-aware machine learning models for mixed numerical and categorical variables.
result Frequentist and Bayesian models perform differently in mixed-variable BO.
Unified Bayesian Optimization framework for model selection balancing effectiveness and training efficiency.
problem Balancing model effectiveness and training efficiency in machine learning model selection.
method Proposes a unified Bayesian Optimization framework to jointly optimize model effectiveness and training efficiency.
result Models selected using the proposed framework significantly improve training efficiency while maintaining strong effectiveness.
Bayesian adversaries can outsmart traditional adversarial attacks.
problem Bayesian adversaries can manipulate machine learning models through small perturbations.
method Developed a continuous-time particle system (Abram) to approximate the gradient flow of the Bayesian adversarial robustness problem.
result Abram approximates the minimizer of the Bayesian adversarial robustness problem under certain assumptions.
Bayesian methods improve adversarial machine learning robustness.
problem Improving machine learning systems' security against adversarial manipulation.
method Integrating Bayesian perspectives to relax unrealistic assumptions in game-theoretic models.
result Bayesian approach provides more robust inferences about opponent's beliefs and interests.
Proposes a multi-fidelity machine learning strategy integrating low-fidelity deterministic and high-fidelity Bayesian models.
problem Addressing the accuracy-efficiency trade-off in machine learning with scarce high-fidelity data.
method Integrates a non-probabilistic regression model for low-fidelity with a Bayesian model for high-fidelity, trained in a staggered scheme.
result Achieves comparable performance in mean and uncertainty estimation with reduced training time and effective mitigation of overfitting.
Bayesian uncertainty quantification is flawed, according to new research.
problem Flawed interpretation of Bayesian uncertainty quantification.
method Discussion of Bayesian updating and optimization-based perspective, proposing measures of quality.
result Bayesian uncertainty quantification is not coherent with optimization-based perspective.
Bayesian hybrid models fuse physics-based insights with machine learning constructs to correct for systematic bias. In this paper, we compare Bayesian hybrid models against physics-based glass-box and Gaussian process black-box surrogate models. We consider ballistic firing as an illustrative case study for a Bayesian …
A novel Laplace-approximated Bayesian Tensor Network Kernel Machine (LA-TNKM) provides principled uncertainty estimates.
problem How to provide principled uncertainty estimates for tensor network kernel machines.
method Employing a linearized Laplace approximation for Bayesian inference.
result Consistently matches or surpasses Gaussian Processes and BNNs across diverse UCI regression benchmarks.
BARMPy offers a Python package for Bayesian Additive Regression Models.
problem Making complex Bayesian models accessible to machine learning practitioners.
method Object-oriented design compatible with SciKit-Learn, documentation and tutorial provided.
result Ease of use and compatibility with existing machine learning tools.
Solla discusses neural processing using statistical physics and Bayesian methods.
problem Understanding neural information processing through statistical physics.
method Bayesian inference, Gibbs description, Generalized Linear Models, dimensionality reduction.
result Connection between neural processing and statistical physics.
This paper explores evasion attacks against Bayesian models.
problem Bayesian predictive models are vulnerable to evasion attacks.
method Developed gradient-based attacks for specific point predictions and entire posterior distributions.
result Optimal evasion attacks can be designed against Bayesian models.
Study optimizes investment strategies in volatile markets using machine learning and Bayesian techniques.
problem Enhancing portfolio management in volatile markets.
method Market segmentation into ten volatility-based states, real-time asset allocation adjustments using Bayesian Markov switching model.
result Dynamic portfolio achieves significantly higher risk-adjusted returns and total returns.
Generative approach speeds hyperparameter tuning for machine learning models.
problem Computational infeasibility of cross-validation and difficulty of fully Bayesian hyper-parameter learning.
method Combines optimization-based approximations and amortization techniques.
result Rapid evaluation of hyper-parameters over grids or ranges, supporting predictive tuning and uncertainty quantification.
Enhanced Bayesian target encoding uses sampling techniques to improve model performance.
problem Improving target encoding for better model performance in machine learning.
method Using sampling techniques in Bayesian target encoding to extract intra-category distribution information.
result Improves generalization and reduces target leakage in machine learning models.
Utilizing variational autoencoders in the Bayesian inverse problem of photoacoustic tomographyphysics.comp-ph
Study uses machine learning to solve photoacoustic tomography's inverse problem.
problem Solving the full inverse problem in photoacoustic tomography.
method Developed an approach using variational autoencoders for Bayesian estimation of the posterior distribution.
result Evaluated the approach with numerical simulations and compared it to a Bayesian solution.
Optimizes active learning for machine learning models with Bayesian approach.
problem Efficiently allocate labeling resources to train machine learning models.
method Directly optimizes misclassification error using a Bayesian approach with conjugate prior.
result Superior performance compared to state-of-the-art selection strategies.
Bayesian inference corrects bias in supervised learning datasets.
problem Correcting bias in supervised machine learning datasets.
method Bayesian inference framework to adjust posterior distribution.
result Improved model fitting to original dataset.
To solve a machine learning problem, one typically needs to perform data preprocessing, modeling, and hyperparameter tuning, which is known as model selection and hyperparameter optimization.The goal of automated machine learning (AutoML) is to design methods that can automatically perform model selection and hyperpara…
Bayesian models can be tricked into believing false data.
problem Vulnerability of Bayesian inference to data poisoning attacks.
method Developed attacks to manipulate Bayesian posterior through deletion and replication of data.
result Demonstrated that Bayesian inference can be steered to target distributions.
Bayesian optimization is a powerful tool for fine-tuning the hyper-parameters of a wide variety of machine learning models. The success of machine learning has led practitioners in diverse real-world settings to learn classifiers for practical problems. As machine learning becomes commonplace, Bayesian optimization bec…
Bayesian framework mixes imperfect models for improved predictions.
problem Improving predictions of complex computational models in unknown domains.
method Local Bayesian Dirichlet mixing of imperfect models using the Dirichlet distribution.
result Global and local mixtures of models achieve excellent performance in prediction accuracy and uncertainty quantification.
EBLIME enhances model explanations using Bayesian ridge regression.
problem Improving model explanations for black-box machine learning models.
method EBLIME uses Bayesian ridge regression to explain feature importance.
result EBLIME provides more intuitive and accurate feature importance rankings.
Machine learning finds knots that bound ribbon disks.
problem Detecting ribbon knots in topology.
method Bayesian optimization and reinforcement learning.
result Successfully detected many ribbon knots up to 70 crossings.
Machine Learning, Linear and Bayesian Models for Logistic Regression in Failure Detection Problemscs.LG
In this work, we study the use of logistic regression in manufacturing failures detection. As a data set for the analysis, we used the data from Kaggle competition Bosch Production Line Performance. We considered the use of machine learning, linear and Bayesian models. For machine learning approach, we analyzed XGBoost…
Bayesian machine learning methods improve nowcasting with mixed frequency data.
problem Handling frequency mismatches and predicting short-term economic indicators.
method Developed Gaussian process (GP) methods for MIDAS regressions.
result Gaussian process-MIDAS methods offer gains in predictive accuracy.
Bayesian parametric matrix models provide uncertainty quantification for spectral learning.
problem Uncertainty quantification in spectral learning for safety-critical applications.
method Bayesian parametric matrix models (B-PMMs) that extend PMMs to provide uncertainty estimates.
result B-PMMs achieve exceptional uncertainty calibration (ECE < 0.05) while maintaining favorable scaling.
This paper provides a PAC-Bayesian bound for CVaR in machine learning.
problem Learning algorithms minimizing CVaR of empirical loss.
method Generalization bound of PAC-Bayesian type, reducing CVaR estimation to expectation estimation.
result The bound is small when empirical CVaR is small, providing concentration inequalities for CVaR.
Bayesian models explain human time perception biases.
problem Understanding human time perception using Bayesian inference.
method Agent-based machine learning models and empirical data analysis.
result Bayesian models can replicate human time estimation biases.
Bayesian approach for learning from synthetic data, improving model accuracy.
problem Lack of statistical properties and robust methods for learning from synthetic data.
method Bayesian paradigm to update model parameters considering synthetic data generating process and learning task.
result Novel approach outperforms standard methods in supervised learning and inference problems.
Study proposes learning optimal priors from data for better Bayesian inference.
problem Challenges the use of noninformative uniform priors in Bayesian inference.
method Machine learning approach to learn optimal priors from data using a target function.
result Study models consistently outperformed baseline models in Wikipedia category classification.
Paper proposes a new method to attack Bayesian forecasting models.
problem Lack of research on adversarial attacks against time series forecasting systems.
method Decision analysis based attacking strategy for Bayesian forecasting models.
result Demonstrates the vulnerability of Bayesian forecasting models to adversarial attacks.
Bayesian optimization has become a successful tool for hyperparameter optimization of machine learning algorithms, such as support vector machines or deep neural networks. Despite its success, for large datasets, training and validating a single configuration often takes hours, days, or even weeks, which limits the ach…
SMAC3 optimizes machine learning hyperparameters efficiently.
problem Optimizing hyperparameters for machine learning algorithms.
method Bayesian Optimization framework with facades for various use cases.
result Improves performance with minimal evaluations.
Bayesian optimization simplifies bioprocess engineering experiments.
problem Complex biological systems and experimental uncertainty.
method Adapts classical Bayesian optimization for bioprocess engineering.
result Provides accessible introduction to Bayesian optimization for practitioners.