Binary classification models get more efficient predictive probabilities.
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
Trend · papers per month
SOLBP extends efficient inference to uncertain Bayesian networks.
This paper introduces PM and PMLP to enhance SSL by considering probability density and cluster assumptions.
While Gaussian probability densities are omnipresent in applied mathematics, Gaussian cumulative probabilities are hard to calculate in any but the univariate case. We study the utility of Expectation Propagation (EP) as an approximate integration method for this problem. For rectangular integration regions, the approx…
A framework uses free probability to analyze Transformer models.
The paper proposes a new framework for accurate uncertainty representation and propagation.
Validates composite systems using discrepancy propagation.
A novel method to propagate uncertainty through the soft-thresholding nonlinearity is proposed in this paper. At every layer the current distribution of the target vector is represented as a spike and slab distribution, which represents the probabilities of each variable being zero, or Gaussian-distributed. Using the p…
Inspired by recent interests of developing machine learning and data mining algorithms on hypergraphs, we investigate in this paper the semi-supervised learning algorithm of propagating "soft labels" (e.g. probability distributions, class membership scores) over hypergraphs, by means of optimal transportation. Borrowin…
Improved error correction using neural networks and belief propagation.
A number of problems in statistical physics and computer science can be expressed as the computation of marginal probabilities over a Markov random field. Belief propagation, an iterative message-passing algorithm, computes exactly such marginals when the underlying graph is a tree. But it has gained its popularity as …
Study probabilistic safety of BNNs under adversarial attacks.
We propose a feed-forward inference method applicable to belief and neural networks. In a belief network, the method estimates an approximate factorized posterior of all hidden units given the input. In neural networks the method propagates uncertainty of the input through all the layers. In neural networks with inject…
Modeling financial contagion through bank networks, revealing solvency correlations.
Improved diffusion map enhances manifold regularization for semi-supervised learning.
Synaptic strength can be seen as probability to propagate impulse, and according to synaptic plasticity, function could exist from propagation activity to synaptic strength. If the function satisfies constraints such as continuity and monotonicity, neural network under external stimulus will always go to fixed point, a…
Probabilistic graphical models compactly represent joint distributions by decomposing them into factors over subsets of random variables. In Bayesian networks, the factors are conditional probability distributions. For many problems, common information exists among those factors. Adding similarity restrictions can be v…
A new stochastic algorithm approximates optimal distributions without requiring propagation of chaos.
New algorithm for competing influence spread in unknown networks.
This work develops a particle system to approximate Fisher-Rao gradient flows in mean-field optimization.
Many neural networks use the tanh activation function, however when given a probability distribution as input, the problem of computing the output distribution in neural networks with tanh activation has not yet been addressed. One important example is the initialization of the echo state network in reservoir computing…
Bayesian methods improve group testing for identifying infected patients.
A fundamental computation for statistical inference and accurate decision-making is to compute the marginal probabilities or most probable states of task-relevant variables. Probabilistic graphical models can efficiently represent the structure of such complex data, but performing these inferences is generally difficul…
Community detection is considered for a stochastic block model graph of n vertices, with K vertices in the planted community, edge probability p for pairs of vertices both in the community, and edge probability q for other pairs of vertices. The main focus of the paper is on weak recovery of the community based on the …
New methods for uncertainty in neural networks with leaky ReLU activations.
Proposes a method to quantify uncertainty in graph neural networks for node classification.
This paper uses multivariate probability models to assess financial system risks.
Dropout has proven to be an effective technique for regularization and preventing the co-adaptation of neurons in deep neural networks (DNN). It randomly drops units with a probability during the training stage of DNN. Dropout also provides a way of approximately combining exponentially many different neural networ…
Several algorithms for solving constraint satisfaction problems are based on survey propagation, a variational inference scheme used to obtain approximate marginal probability estimates for variable assignments. These marginals correspond to how frequently each variable is set to true among satisfying assignments, and …
Using a rolling windows analysis of filtered and aligned stock index returns from 40 countries during the period 2006-2014, we construct Granger causality networks and investigate the ensuing structure of the relationships by studying network properties and fitting spatial probit models. We provide evidence that stock …
This paper uses probability tensors for efficient path planning in complex scenarios.
Algorithm maximizes revenue-risk by estimating price impact kernel and optimizing control problems.
Bayesian inference engines improve density estimation accuracy and scalability.
Network analysis improves risk assessment for surety bonds.
Uncertainty propagation in nonlinear dynamic systems remains an outstanding problem in scientific computing and control. Numerous approaches have been developed, but are limited in their capability to tackle problems with more than a few uncertain variables or require large amounts of simulation data. In this paper, we…
Factor graphs are important models for succinctly representing probability distributions in machine learning, coding theory, and statistical physics. Several computational problems, such as computing marginals and partition functions, arise naturally when working with factor graphs. Belief propagation is a widely deplo…
Method trains emulators to estimate posterior probabilities safely.
To address the sparsity and cold start problem of collaborative filtering, researchers usually make use of side information, such as social networks or item attributes, to improve recommendation performance. This paper considers the knowledge graph as the source of side information. To address the limitations of existi…
Unified Bayesian framework for uncertainty quantification in mechanics.
Python package cegpy models processes with asymmetries.
Study ruin probabilities in risk processes on stochastic networks.
A computer code can simulate a system's propagation of variation from random inputs to output measures of quality. Our aim here is to estimate a critical output tail probability or quantile without a large Monte Carlo experiment. Instead, we build a statistical surrogate for the input-output relationship with a modest …
Bayesian inference is a popular method to build learning algorithms but it is hampered by the fact that its key object, the posterior probability distribution, is often uncomputable. Expectation Propagation (EP) (Minka (2001)) is a popular algorithm that solves this issue by computing a parametric approximation (e.g: G…
Algorithm identifies missing data distributions in graphical models.
Optimal trading strategy derived for nonlinear price impact models.
Generalized belief propagation converges to optimal solutions on graphs with motifs.
Polynomial-time algorithm solves random parity games with high probability.
Ensemble clustering has been a popular research topic in data mining and machine learning. Despite its significant progress in recent years, there are still two challenging issues in the current ensemble clustering research. First, most of the existing algorithms tend to investigate the ensemble information at the obje…