Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,695 papers · 148 categories

Trend · papers per month

74149223297 · Jun 202019922001200920172026
48 results for Bayesian formulation

Paper proposes a QUBO formulation that reduces binary variables in Bayesian network learning.

problem Reducing the number of binary variables in QUBO formulations for Bayesian network learning.
method Proposes a new QUBO formulation that minimizes binary variables.
result Significantly reduces the number of binary variables required for Bayesian network structure learning.

This dissertation uses ILP to learn Bayesian network structures efficiently.

problem Learning the structure of Bayesian networks from data.
method Integer Linear Programming formulation with cluster constraints and cutting planes.
result The approach finds feasible solutions for Bayesian network structures efficiently.

New method reduces over-pessimism in Bayesian control under parameter uncertainty.

problem Over-pessimism in Bayesian control due to misspecified priors.
method Distributionally robust Bayesian control (DRBC) with strong duality and optimization.
result Validated algorithm on synthetic and real data, reducing over-pessimism.

This paper simplifies MTGP derivations for Gaussian processes.

problem Understanding the derivations of Multi-task Gaussian Process formulations and their gradients.
method Friendly derivations of Multi-task Gaussian Process formulations and their gradients.
result Simplified derivations of Multi-task Gaussian Process formulations and gradients.

Bayesian approach for handling incomplete clinical data.

problem Challenges in machine learning with multimodal, incomplete clinical data.
method Generative and discriminative learning, semi-supervised strategy, imputation of missing views.
result Automatic imputation of missing views and robust inference across different data sources.

Study evaluates posterior covariance matrix W for frequentist evaluation of Bayesian estimators.

problem Evaluating variability of posterior estimates in Bayesian models.
method Use of Bayesian Infinitesimal Jackknife approximation and W-kernel.
result Principal space of W is central to frequentist evaluation of Bayesian models.

Study clarifies Bayesian generalization error in CBM for 3-layered linear neural networks.

problem Understanding the generalization error in concept bottleneck models.
method Mathematical analysis of Bayesian generalization error and free energy in CBM for 3-layered linear neural networks.
result CBM significantly alters the parameter region and Bayesian generalization error compared to standard models.

We begin by reiterating that common neural network activation functions have simple Bayesian origins. In this spirit, we go on to show that Bayes's theorem also implies a simple recurrence relation; this leads to a Bayesian recurrent unit with a prescribed feedback formulation. We show that introduction of a context in…

2019-10-24abs ↗pdf ↗

A reciprocal LASSO (rLASSO) regularization employs a decreasing penalty function as opposed to conventional penalization approaches that use increasing penalties on the coefficients, leading to stronger parsimony and superior model selection relative to traditional shrinkage methods. Here we consider a fully Bayesian f…

2020-01-23abs ↗pdf ↗

WNVI solves inverse problems without forward models using neural networks.

problem Solving high-dimensional Bayesian inverse problems based on PDEs.
method WNVI uses weighted residuals and SVI with neural networks to infer state variables and unknowns.
result WNVI is more accurate and efficient than traditional methods and handles ill-posed problems.

Improves DRO with Bayesian Ambiguity Sets for model misspecification.

problem Overly conservative decisions due to misspecified models in DRO.
method Introduces DRO-RoBAS with robust posterior predictive distribution.
result Outperforms other Bayesian and empirical DRO approaches in out-of-sample performance.

A novel unified Bayesian framework for network detection is developed, under which a detection algorithm is derived based on random walks on graphs. The algorithm detects threat networks using partial observations of their activity, and is proved to be optimum in the Neyman-Pearson sense. The algorithm is defined by a …

2013-11-21abs ↗pdf ↗

Parallel-in-time solver reduces ODE simulation time from linear to logarithmic.

problem Efficiently solving ordinary differential equations (ODEs) with reduced computational cost.
method Formulated a parallel-in-time probabilistic numerical ODE solver using time-parallel formulation of iterated extended Kalman smoothers.
result Reduces span cost from linear to logarithmic in the number of time steps.

Stochastic VB improves nonlinear model inference speed and accuracy.

problem Bayesian inference of nonlinear models from noisy data.
method Stochastic Variational Bayesian (VB) inference for nonlinear models.
result Stochastic VB achieves comparable parameter recovery to analytical solution but is faster.

In this work, we introduce a novel probabilistic representation of deep learning, which provides an explicit explanation for the Deep Neural Networks (DNNs) in three aspects: (i) neurons define the energy of a Gibbs distribution; (ii) the hidden layers of DNNs formulate Gibbs distributions; and (iii) the whole architec…

2019-08-26abs ↗pdf ↗

New method uses constrained transport metric for robust Bayesian inference.

problem Flexible Bayesian models with many uninterpretable parameters.
method Exponentially tilted empirical likelihood with a novel Wasserstein metric, combined with a prior.
result Superior performance compared to state-of-the-art robust Bayesian inference methods.

The R package abn is designed to fit additive Bayesian models to observational datasets. It contains routines to score Bayesian networks based on Bayesian or information theoretic formulations of generalized linear models. It is equipped with exact search and greedy search algorithms to select the best network. It supp…

2019-11-20abs ↗pdf ↗

We consider the problem of recovering a function input of a differential equation formulated on an unknown domain MM. We assume to have access to a discrete domain Mn={x1,,xn}MM_n=\{x_1, \dots, x_n\} \subset M, and to noisy measurements of the output solution at pnp\le n of those points. We introduce a graph-based Bayesian inve…

2017-06-22abs ↗pdf ↗

Bayesian inference using stochastic neural networks ensembles.

problem Approximating Bayesian posterior distributions.
method Formulate stochastic ensembles of neural networks, train with variational inference, and evaluate using Monte Carlo dropout.
result Stochastic ensembles provide more accurate posterior estimates than other methods.

We present a formulation of the transaction cost analysis (TCA) in the Bayesian framework for the primary purpose of comparing broker algorithms using standardized benchmarks. Our formulation allows effective calculation of the expected value of trading benchmarks with only a finite sample of data relevant to practical…

2019-04-02abs ↗pdf ↗

Decision tree learning is a popular approach for classification and regression in machine learning and statistics, and Bayesian formulations---which introduce a prior distribution over decision trees, and formulate learning as posterior inference given data---have been shown to produce competitive performance. Unlike c…

2013-03-03abs ↗pdf ↗

Bayesian optimization tackles non-convex, two-stage stochastic problems efficiently.

problem Solving non-convex, two-stage stochastic optimization problems with expensive, black-box evaluations.
method Knowledge-gradient-based acquisition function for joint optimization of first- and second-stage variables.
result Comparable and superior empirical results compared to alternatives.

Generalization is essential for deep learning. In contrast to previous works claiming that Deep Neural Networks (DNNs) have an implicit regularization implemented by the stochastic gradient descent, we demonstrate explicitly Bayesian regularizations in a specific category of DNNs, i.e., Convolutional Neural Networks (C…

2019-10-22abs ↗pdf ↗

New research connects evolutionary dynamics to Bayesian learning.

problem Connecting evolutionary biology and Bayesian learning.
method Rigorous mathematical proof using Kushner-Stratonovich equation and gradient flows.
result Discrete time filtering equations converge to Stratonovich interpretation of Kushner-Stratonovich equation.

We formulate weighted graph clustering as a prediction problem: given a subset of edge weights we analyze the ability of graph clustering to predict the remaining edge weights. This formulation enables practical and theoretical comparison of different approaches to graph clustering as well as comparison of graph cluste…

2010-09-02abs ↗pdf ↗

Bayesian neural network (BNN) priors are defined in parameter space, making it hard to encode prior knowledge expressed in function space. We formulate a prior that incorporates functional constraints about what the output can or cannot be in regions of the input space. Output-Constrained BNNs (OC-BNN) represent an int…

2019-05-15abs ↗pdf ↗

The paper identifies network bottlenecks using minimax paths in stochastic networks.

problem Identifying bottlenecks in networks with stochastic weights.
method Modeling as combinatorial semi-bandit problem, applying combinatorial Thompson Sampling, and approximating the original objective due to computational intractability.
result Established an upper bound on Bayesian regret and evaluated Thompson Sampling performance on real-world networks.

Novel connections between Neyman-Scott processes and Bayesian nonparametric mixture models enable scalable inference.

problem Efficiently modeling and detecting clusters in spatiotemporal data.
method Adapting collapsed Gibbs sampling for Neyman-Scott processes via connections to mixture of finite mixture models.
result Demonstrated scalability and effectiveness on neural spike trains and document streams.

Bayesian optimization tackles expensive cascade processes.

problem Optimizing multistage decision-making processes with expensive costs.
method Formulated as Bayesian optimization framework with two types of acquisition functions.
result Demonstrated effectiveness through numerical experiments and a solar cell simulator application.

Time series of counts arise in a variety of forecasting applications, for which traditional models are generally inappropriate. This paper introduces a hierarchical Bayesian formulation applicable to count time series that can easily account for explanatory variables and share statistical strength across groups of rela…

2014-05-15abs ↗pdf ↗

We present a max-margin nonparametric latent feature model, which unites the ideas of max-margin learning and Bayesian nonparametrics to discover discriminative latent features for link prediction and automatically infer the unknown latent social dimension. By minimizing a hinge-loss using the linear expectation operat…

2012-06-18abs ↗pdf ↗

Unified Bayesian PINN framework for solving inverse problems in infrared image processing.

problem Solving inverse problems in high-dimensional settings with complex physics.
method Bayesian Physics-Informed Neural Networks (BPINN-IP) framework, incorporating physical laws and uncertainties.
result Unified framework for physical constraints, prior knowledge, and data-driven inference with uncertainty quantification.

Deep neural networks (DNN) are versatile parametric models utilised successfully in a diverse number of tasks and domains. However, they have limitations---particularly from their lack of robustness and over-sensitivity to out of distribution samples. Bayesian Neural Networks, due to their formulation under the Bayesia…

2019-12-03abs ↗pdf ↗