A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
Generalized belief propagation converges to optimal solutions on graphs with motifs.
Belief propagation recovers backpropagation results.
A susceptibility propagation that is constructed by combining a belief propagation and a linear response method is used for approximate computation for Markov random fields. Herein, we formulate a new, improved susceptibility propagation by using the concept of a diagonal matching method that is based on mean-field app…
Variational inference is a powerful concept that underlies many iterative approximation algorithms; expectation propagation, mean-field methods and belief propagations were all central themes at the school that can be perceived from this unifying framework. The lectures of Manfred Opper introduce the archetypal example…
This paper proposes an alternating back-propagation algorithm for learning the generator network model. The model is a non-linear generalization of factor analysis. In this model, the mapping from the continuous latent factors to the observed signal is parametrized by a convolutional neural network. The alternating bac…
Study reveals decurve flows in graph propagation models.
Unified model combines feature and label propagation for semi-supervised classification.
Improved error correction using neural networks and belief propagation.
A new approach estimates propagators for trading risky assets.
This thesis investigates belief propagation's performance in graphical models with loops.
LNPE enhances local connections in embeddings using extended neighbor propagation.
Decoupled GCN is shown to be equivalent to label propagation.
The back-propagation algorithm is the cornerstone of deep learning. Despite its importance, few variations of the algorithm have been attempted. This work presents an approach to discover new variations of the back-propagation equation. We use a domain specific lan- guage to describe update equations as a list of primi…
A new method for target propagation using iterative approximations converges fast and is more biologically plausible.
Belief Propagation algorithms are instruments used broadly to solve graphical model optimization and statistical inference problems. In the general case of a loopy Graphical Model, Belief Propagation is a heuristic which is quite successful in practice, even though its empirical success, typically, lacks theoretical gu…
Global propagator for massless Dirac operator defined and analyzed.
The article constructs Feynman propagators for normally hyperbolic operators on curved spacetimes.
The paper proposes a scalable framework for uncertainty quantification and propagation in surrogate-based Bayesian inference.
We introduce propagation kernels, a general graph-kernel framework for efficiently measuring the similarity of structured data. Propagation kernels are based on monitoring how information spreads through a set of given graphs. They leverage early-stage distributions from propagation schemes such as random walks to capt…
Inspired by recent interests of developing machine learning and data mining algorithms on hypergraphs, we investigate in this paper the semi-supervised learning algorithm of propagating "soft labels" (e.g. probability distributions, class membership scores) over hypergraphs, by means of optimal transportation. Borrowin…
SOLBP extends efficient inference to uncertain Bayesian networks.
We consider a dynamical model of distress propagation on complex networks, which we apply to the study of financial contagion in networks of banks connected to each other by direct exposures. The model that we consider is an extension of the DebtRank algorithm, recently introduced in the literature. The mechanics of di…
New -BP algorithm improves belief propagation for graphs with loops.
New group testing method uses Belief Propagation for accurate screening.
Belief propagation (BP) can do exact inference in loop-free graphs, but its performance could be poor in graphs with loops, and the understanding of its solution is limited. This work gives an interpretable belief propagation rule that is actually minimization of a localized -divergence. We term this algorithm as $α…
We discuss positivity properties of `distinguished propagators', i.e. distinguished inverses of operators that frequently occur in scattering theory and wave propagation. We relate this to the work of Duistermaat and Hörmander on distinguished parametrices (approximate inverses), which has played a major role in quantu…
Study shows uniform-time chaos propagation in mean field Langevin dynamics.
As one of the most important types of (weaker) supervised information in machine learning and pattern recognition, pairwise constraint, which specifies whether a pair of data points occur together, has recently received significant attention, especially the problem of pairwise constraint propagation. At least two reaso…
Wave propagation framework using cone structures and observers' vector fields.
The paper simplifies FLRW photon propagators using geometric embeddings.
Symmetries in shrinking Ricci solitons spread outward.
Finding biologically plausible alternatives to back-propagation of errors is a fundamentally important challenge in artificial neural network research. In this paper, we propose a learning algorithm called error-driven Local Representation Alignment (LRA-E), which has strong connections to predictive coding, a theory t…
A novel method to propagate uncertainty through the soft-thresholding nonlinearity is proposed in this paper. At every layer the current distribution of the target vector is represented as a spike and slab distribution, which represents the probabilities of each variable being zero, or Gaussian-distributed. Using the p…
Uniform-in-time analysis for Stein Variational Gradient Descent across various metrics.
Artificial neural networks are most commonly trained with the back-propagation algorithm, where the gradient for learning is provided by back-propagating the error, layer by layer, from the output layer to the hidden layers. A recently discovered method called feedback-alignment shows that the weights used for propagat…
Extended Kalman Filtering (EKF) can be used to propagate and quantify input uncertainty through a Deep Neural Network (DNN) assuming mild hypotheses on the input distribution. This methodology yields results comparable to existing methods of uncertainty propagation for DNNs while lowering the computational overhead con…
Stochastic regularisation is an important weapon in the arsenal of a deep learning practitioner. However, despite recent theoretical advances, our understanding of how noise influences signal propagation in deep neural networks remains limited. By extending recent work based on mean field theory, we develop a new frame…
Geometric approach to Dirac operator evolution on spacetimes.
This paper investigates the computational complexity of sparse label propagation which has been proposed recently for processing network structured data. Sparse label propagation amounts to a convex optimization problem and might be considered as an extension of basis pursuit from sparse vectors to network structured d…
Generalizes neural network verification by adding arbitrary cutting planes.
Proposes QEP to mitigate quantization error propagation in layer-wise post-training quantization.
We improve neural network explainability by bypassing batch normalization.
This paper proposes the Mesh Neural Network (MNN), a novel architecture which allows neurons to be connected in any topology, to efficiently route information. In MNNs, information is propagated between neurons throughout a state transition function. State and error gradients are then directly computed from state updat…
In this paper, we investigate the geometric propagation and diffraction of singularities of solutions to the wave equation on manifolds with edge singularities.
GEnBP combines EnKF and GaBP for efficient high-dimensional inference.
NoProp learns neural networks without full back-propagation or forward-propagation.
Improved diffusion map enhances manifold regularization for semi-supervised learning.
Neural message passing algorithms for semi-supervised classification on graphs have recently achieved great success. However, for classifying a node these methods only consider nodes that are a few propagation steps away and the size of this utilized neighborhood is hard to extend. In this paper, we use the relationshi…