In the present work, eigenvalue distributions defined by a random rectangular matrix whose components are neither independently nor identically distributed are analyzed using replica analysis and belief propagation. In particular, we consider the case in which the components are independently but not identically distri…
On-device research index
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
168,982 papers · 148 categories
Trend · papers per month
48 results for “propagation identity”
GAIT-prop derives a biologically plausible learning rule from backpropagation.
problem Biological implausibility in traditional backpropagation for neural networks.
method GAIT-prop uses a top-down model to convert output error into plausible targets for weight updates.
result GAIT-prop and backpropagation give identical weight updates under certain conditions.
Conditions for conformal Killing vectors in vacuum spacetimes.
problem Finding conditions for conformal Killing vectors in vacuum spacetimes.
method Classical argument to identify a suitable propagation identity and check well-posedness of the initial value problem.
result Necessary and sufficient conditions for conformal Killing initial data (CKID) are found, extending known Killing initial data (KID).
A new method for target propagation using iterative approximations converges fast and is more biologically plausible.
problem Improving target propagation methods for neural networks.
method Iterative approximate inverses and local auto-encoders.
result The method converges exponentially fast under certain conditions.
Beyond Signal Propagation: Is Feature Diversity Necessary in Deep Neural Network Initialization?cs.LG
New method shows random, diverse initializations are not essential for deep neural networks.
problem The necessity of random, diverse initializations in deep neural networks.
method Constructed a deep convolutional network with identical features by initializing weights to 0, enabling signal propagation and stable gradients.
result Random, diverse initializations are not necessary for training neural networks.
The Score Kalman Filtereess.SY
A new filter reduces density fitting to a linear solve, improving performance on nonlinear systems.
problem Nonlinear Bayesian filtering challenges in representing belief distributions.
method Combines score matching with Stein's identity to avoid partition function evaluation.
result The Score Kalman Filter (SKF) outperforms existing methods on nonlinear systems.
Kernel analysis reveals rumor truth from diffusion patterns alone.
problem Detecting unverified rumors on Twitter using text and user identities.
method Graph kernels to extract diffusion patterns from Twitter cascade structures.
result Diffusion patterns are highly informative of rumor truth or falsehood.
Any two compact, complete, one-dimensional geodesic spaces with identical marked length spectrum have isometric -hull. The present version contains errors, notably in Lemmas 2.2 and 2.3 (path cancellations can be more complicated), which then propagate through the paper. The main result is correct as stated, and a…
Decomposing market impact into diffusive components
problem Market impact scaling
method Decomposing impact into realized and counterfactual returns
result Implication of square-root law in information-neutral regime
This paper extends ResNet theory to infinitely deep networks, linking them to diffusion processes.
problem Training infinitely deep ResNets with i.i.d. initializations leads to undesirable properties.
method Introduced doubly infinite ResNets with i.i.d. initializations, linking to diffusion processes.
result The dynamics of quantities of interest converge to deterministic limits in the limit of infinite depth.
A new neural network initialization method is proposed for faster and more accurate training.
problem Efficient initialization for training multi-layer feedforward neural networks.
method Initialization based on Stein's identity, using eigenvectors of cross-moment matrix.
result The SteinGLM method is faster and more accurate than other initialization methods.
To make deep neural networks feasible in resource-constrained environments (such as mobile devices), it is beneficial to quantize models by using low-precision weights. One common technique for quantizing neural networks is the straight-through gradient method, which enables back-propagation through the quantization ma…
We introduce backdrop, a flexible and simple-to-implement method, intuitively described as dropout acting only along the backpropagation pipeline. Backdrop is implemented via one or more masking layers which are inserted at specific points along the network. Each backdrop masking layer acts as the identity in the forwa…
This is an extensive (published) survey on CR geometry, whose major themes are: formal analytic reflection principle; generic properties of Systems of (CR) vector fields; pairs of foliations and conjugate reflection identities; Sussmann's orbit theorem; local and global aspects of holomorphic extension of CR functions;…
Generalized belief propagation converges to optimal solutions on graphs with motifs.
problem Understanding belief propagation on loopy graphs.
method Study of generalized belief propagation on graphs with motifs.
result Generalized belief propagation converges to the global optimum of the Bethe free energy.
Belief propagation recovers backpropagation results.
problem Connection between backpropagation and belief propagation poorly understood.
method Converted backpropagation input to belief propagation input and showed results.
result Backpropagation is a special case of belief propagation.
Susceptibility Propagation by Using Diagonal Consistencycond-mat.stat-mech
A susceptibility propagation that is constructed by combining a belief propagation and a linear response method is used for approximate computation for Markov random fields. Herein, we formulate a new, improved susceptibility propagation by using the concept of a diagonal matching method that is based on mean-field app…
Proposes D2D-LSTM for predicting mobile social network content diffusion paths.
problem Lack of accurate content popularity prediction considering time and location in mobile social networks.
method D2D-LSTM, a deep neural network combining user social features and files features.
result Significantly improved prediction accuracy (up to 85.858%) and faster convergence (less than 100 steps).
Expectation Propagationstat.ML
Variational inference is a powerful concept that underlies many iterative approximation algorithms; expectation propagation, mean-field methods and belief propagations were all central themes at the school that can be perceived from this unifying framework. The lectures of Manfred Opper introduce the archetypal example…
This paper proposes an alternating back-propagation algorithm for learning the generator network model. The model is a non-linear generalization of factor analysis. In this model, the mapping from the continuous latent factors to the observed signal is parametrized by a convolutional neural network. The alternating bac…
Study reveals decurve flows in graph propagation models.
problem Limitations of traditional graph analysis and propagation mechanisms.
method Introduces Generalized Propagation Neural Networks (GPNNs) and Continuous Unified Ricci Curvature (CURC).
result Observation of decurve flow during training of graph neural networks, revealing propagation dynamics.
Unified model combines feature and label propagation for semi-supervised classification.
problem Combining feature and label propagation for effective semi-supervised classification.
method Unified Message Passing Model (UniMP) using Graph Transformer and masked label prediction.
result Obtains new state-of-the-art results in Open Graph Benchmark (OGB).
Improved error correction using neural networks and belief propagation.
problem Inference in factor graphs with loops or poor approximations.
method Hybrid model combining FG-GNN and belief propagation.
result Hybrid model outperforms belief propagation in error correction tasks.
A new approach estimates propagators for trading risky assets.
problem Estimating price impact kernel from static data for optimal trading.
method Nonparametric estimation of propagator using offline reinforcement learning.
result Pessimistic trading strategy optimises execution costs under uncertainty.
This thesis investigates belief propagation's performance in graphical models with loops.
problem Belief propagation's performance and convergence guarantees in models with loops are uncertain.
method Investigates how model parameters affect belief propagation's performance, convergence, and approximation quality.
result Model parameters influence the number of fixed points, convergence properties, and approximation quality of belief propagation.
LNPE enhances local connections in embeddings using extended neighbor propagation.
problem Improving local connections and interactions in nonlinear dimensionality reduction.
method Inspired by GCN, LNPE extends 1-hop neighbors to n-hop neighbors in LLE.
result LNPE produces more faithful and robust embeddings with better topological and geometrical properties.
Decoupled GCN is shown to be equivalent to label propagation.
problem Improving semi-supervised node classification in graph learning.
method The paper proves the equivalence of decoupled GCN and label propagation, and proposes a new method named PTA.
result Decoupled GCN is equivalent to two-step label propagation and can automatically assign weights to pseudo-labels.
Backprop Evolutioncs.NE
The back-propagation algorithm is the cornerstone of deep learning. Despite its importance, few variations of the algorithm have been attempted. This work presents an approach to discover new variations of the back-propagation equation. We use a domain specific lan- guage to describe update equations as a list of primi…
Belief Propagation algorithms are instruments used broadly to solve graphical model optimization and statistical inference problems. In the general case of a loopy Graphical Model, Belief Propagation is a heuristic which is quite successful in practice, even though its empirical success, typically, lacks theoretical gu…
Global propagator for massless Dirac operator defined and analyzed.
problem Analyzing the massless Dirac operator on 3-manifolds.
method Constructing propagator as sum of oscillatory integrals, providing global definitions and small time expansions.
result Explicit calculation of propagators' symbols and coefficients in eigenvalue counting functions.
On microlocalisation and the construction of Feynman Propagators for normally hyperbolic operatorsmath.AP
The article constructs Feynman propagators for normally hyperbolic operators on curved spacetimes.
problem Constructing Feynman propagators for non-scalar geometric operators on curved spacetimes.
method Global microlocalisation constructions for normally hyperbolic operators on globally hyperbolic spacetimes.
result Feynman propagators can be constructed to satisfy a positivity property for selfadjoint normally hyperbolic operators.
The paper proposes a scalable framework for uncertainty quantification and propagation in surrogate-based Bayesian inference.
problem Uncertainty in surrogate models and its impact on inference and decision-making.
method Bayesian inference methods for surrogate models with measurement data.
result Scalable framework for uncertainty quantification and propagation in surrogate models.
Propagation Kernelsstat.ML
We introduce propagation kernels, a general graph-kernel framework for efficiently measuring the similarity of structured data. Propagation kernels are based on monitoring how information spreads through a set of given graphs. They leverage early-stage distributions from propagation schemes such as random walks to capt…
Inspired by recent interests of developing machine learning and data mining algorithms on hypergraphs, we investigate in this paper the semi-supervised learning algorithm of propagating "soft labels" (e.g. probability distributions, class membership scores) over hypergraphs, by means of optimal transportation. Borrowin…
Improved BP algorithm outperforms loopy BP in MAP inference.
problem Limited understanding and poor performance of belief propagation in graphs with loops.
method Introduced belief propagation, a minimization of localized -divergence.
result Significantly outperforms loopy BP in fully-connected graphs for MAP inference.
SOLBP extends efficient inference to uncertain Bayesian networks.
problem Inference in uncertain Bayesian networks with second-order probabilities.
method Extends Loopy Belief Propagation to second-order Bayesian networks.
result Generates inferences consistent with sum-product networks, more efficient and scalable.
We consider a dynamical model of distress propagation on complex networks, which we apply to the study of financial contagion in networks of banks connected to each other by direct exposures. The model that we consider is an extension of the DebtRank algorithm, recently introduced in the literature. The mechanics of di…
New -BP algorithm improves belief propagation for graphs with loops.
problem Uncertainty in belief propagation for graphs with loops.
method Derive -BP algorithm motivated by minimizing -divergence.
result Proves convergence conditions for -BP.
New group testing method uses Belief Propagation for accurate screening.
problem Efficiently identifying infected samples in large groups with minimal tests.
method Belief Propagation algorithm for inference in group testing schemes.
result Significantly increased accuracy of infection identification with fewer tests.
The Collective Graphical Model (CGM) models a population of independent and identically distributed individuals when only collective statistics (i.e., counts of individuals) are observed. Exact inference in CGMs is intractable, and previous work has explored Markov Chain Monte Carlo (MCMC) and MAP approximations for le…
New equations connect unit Killing vectors to initial data.
problem Characterizing initial data for Einstein vacuum with unit Killing vectors.
method Developed new equations (uKID) by eliminating scaling and using propagation identity.
result Found equations that are finite type and characterize unit normalized Killing vectors.
We discuss positivity properties of `distinguished propagators', i.e. distinguished inverses of operators that frequently occur in scattering theory and wave propagation. We relate this to the work of Duistermaat and Hörmander on distinguished parametrices (approximate inverses), which has played a major role in quantu…
Study shows uniform-time chaos propagation in mean field Langevin dynamics.
problem Understanding the convergence of marginal distributions in mean field dynamics.
method Assumed functional convexity of energy, used -convergence and Wasserstein metrics.
result Uniform-in-time propagation of chaos proved in both -Wasserstein and relative entropy.
This paper discovers new identities linking geodesic and orthogeodesic lengths on hyperbolic surfaces.
problem Understanding relationships between geodesic and orthogeodesic lengths on hyperbolic surfaces.
method Investigates a broad family of identities involving lengths of all closed geodesics and orthogeodesics.
result Introduces new identities that include lengths of all closed geodesics, contrasting with previous identities.
As one of the most important types of (weaker) supervised information in machine learning and pattern recognition, pairwise constraint, which specifies whether a pair of data points occur together, has recently received significant attention, especially the problem of pairwise constraint propagation. At least two reaso…
Belief Propagation outperforms other algorithms in reconstructing binary symmetric channel trees.
problem Reconstructing binary symmetric channel trees with bounded memory.
method Combining recursive reconstruction, information theory, and optimal transport.
result Any recursive algorithm with bounded memory for the reconstruction problem on binary symmetric channel trees has a phase transition strictly below the Belief Propagation threshold.
Paper introduces MNNs for efficient neural network training.
problem Training large-scale sparse neural networks efficiently.
method Formal derivation of MNN architecture with forward-only gradient propagation.
result MNNs can efficiently compute gradients without backward computation.
Wave propagation framework using cone structures and observers' vector fields.
problem Describing classic wave propagation in anisotropic media.
method Introduces a cone structure and an observers' vector field to describe wave propagation.
result Reduces the PDE for wavefronts to ODE for cone geodesics of .