Improved susceptibility propagation for Markov random fields using diagonal matching.
problem Approximate computation of Markov random fields with robustness across network structures.
method Combines belief propagation and linear response method with diagonal matching for inverse Ising problems.
result Proposed method reduces to standard susceptibility propagation and Thouless-Anderson-Palmer equation in specific cases.
Graph neural networks struggle to propagate long-range information, causing over-squashing.
problem Graph neural networks struggle to propagate long-range information.
method Identified over-squashing as the bottleneck in GNNs, demonstrated on various models.
result Breaking the bottleneck improves GNNs' performance on long-range problems.
Model quantifies how global economic shocks propagate through interconnected trade and investment networks.
problem Understanding and predicting the global propagation of economic crises.
method Coupled epidemic and internal contagion dynamics on a multiplex network of trade and investment interactions.
result Linear relation between a country's shock magnitude and its global impact, influenced by internal contagion and intercountry propagation.
Paper identifies classes vulnerable to adversarial attacks.
problem Adversarial attacks on deep learning models.
method Distance-based measures applied on trained models to identify susceptible classes.
result Identifies k most susceptible target classes for adversarial attacks.
New algorithm estimates past and future diffusion processes on networks.
problem Estimating past and future states of concurrent diffusion processes on networks.
method Extension of independent-cascade model, Belief-Propagation algorithm.
result Scalable and convergent algorithm for estimating diffusion processes.
Overparameterized linear model shows strong classification but weak regression, susceptible to adversarial perturbations.
problem Adversarial vulnerability of overparameterized linear models.
method Lifted Fourier feature map, analyzing overparameterized linear ensemble.
result Spatial localization leads to adversarial vulnerability in an intermediate classification regime.
Improved QSM maps from MRI using deep learning.
problem Inaccurate susceptibility maps due to ill-posed dipole inversion.
method 3D GAN with increased receptive field and WGAN with gradient penalty.
result Significantly better QSM maps from single orientation phase maps.
Spectral analysis of neighborhood graphs is one of the most widely used techniques for exploratory data analysis, with applications ranging from machine learning to social sciences. In such applications, it is typical to first encode relationships between the data samples using an appropriate similarity function. Popul…
CycleQSM uses deep learning to accurately map tissue magnetic susceptibility without needing paired data.
problem Accurately mapping magnetic susceptibility values from phase images using QSM.
method Unsupervised deep learning approach using physics-informed cycleGAN.
result The method provides more accurate QSM maps compared to existing deep learning approaches.
Accelerates DNN robustness verification with target labels.
problem Improving the robustness of deep neural networks against adversarial attacks.
method Guiding robustness verification with target labels, reducing search space and using symbolic interval propagation and linear relaxation.
result Significantly improves DNN verification speed by 36X, especially when perturbation distance is reasonable.
New method bounds membership inference attack success using mutual information.
problem Vulnerability of deep neural networks to membership inference attacks.
method Extended Fano's inequality to measure mutual information between inputs and activations.
result Empirical evaluation shows strong correlation between mutual information and model susceptibility.
Indoor localization based on SIngle Of Fingerprint (SIOF) is rather susceptible to the changing environment, multipath, and non-line-of-sight (NLOS) propagation. Building SIOF is also a very time-consuming process. Recently, we first proposed a GrOup Of Fingerprints (GOOF) to improve the localization accuracy and reduc…
Estimates latent topic structure from information diffusion events.
problem Estimating latent structure of social networks from cascade data.
method Proposes a node-topic model with influence and receptivity vectors.
result Consistent estimator of latent topic structure from cascades.
NDI enables high-quality QSM without parameter tuning.
problem Quantitative Susceptibility Mapping (QSM) with regularization tuning issues.
method Nonlinear Dipole Inversion (NDI) using a physics-based forward model and a Variational Network (VN).
result NDI achieves high-quality QSM from as few as 2-direction data.
Machine learning predicts flood risk across river basins.
problem Costly physics-based models are not generalizable.
method Supervised machine learning using remote sensing data.
result Machine learning models predict flood susceptibility.
Generalized belief propagation converges to optimal solutions on graphs with motifs.
problem Understanding belief propagation on loopy graphs.
method Study of generalized belief propagation on graphs with motifs.
result Generalized belief propagation converges to the global optimum of the Bethe free energy.
Belief propagation recovers backpropagation results.
problem Connection between backpropagation and belief propagation poorly understood.
method Converted backpropagation input to belief propagation input and showed results.
result Backpropagation is a special case of belief propagation.
Paper tackles anomaly detection and RCA in dynamical systems using ICODE Networks.
problem Anomalies in dynamical systems impact performance and reliability.
method Proposes ICODE Networks for anomaly detection, RCA, and type classification.
result Demonstrates the ability to accurately detect anomalies, classify types, and pinpoint origins.
Study prenatal PM2.5 exposure and 4th grade reading scores, identifying critical windows of susceptibility.
problem Understanding the impact of prenatal PM2.5 exposure on educational outcomes.
method Developed a locally adaptive Bayesian regression model with B-spline basis expansion and dynamic shrinkage priors.
result Prenatal PM2.5 exposure during early and late pregnancy is most adverse for 4th grade reading scores.
Belief Propagation solves a relaxed network flow problem.
problem Generalized Min-Cost Network Flow with relaxed flow conservation constraints.
method Extends Belief Propagation to solve a new class of network flow problems.
result Belief Propagation converges to the exact solution of the relaxed network flow problem.
New neural network units resist adversarial attacks effectively.
problem Adversarial attacks on machine learning models.
method Introduced MWD units, developed training techniques, and computed robustness.
result MWD networks are significantly more robust to adversarial attacks.
A time-dependent SIR model predicts COVID-19 spread and herd immunity.
problem Modeling and predicting COVID-19 spread and herd immunity.
method Time-dependent SIR model with 2 types of infected persons (detectable and undetectable).
result The model accurately predicts the turning point and herd immunity threshold.
Propagates soft labels on hypergraphs using optimal transportation.
problem Semi-supervised learning on hypergraphs.
method Wasserstein barycenters and message-passing algorithm.
result Generalization error bounds for 2-Wasserstein distance.
Variational inference is a powerful concept that underlies many iterative approximation algorithms; expectation propagation, mean-field methods and belief propagations were all central themes at the school that can be perceived from this unifying framework. The lectures of Manfred Opper introduce the archetypal example…
Advanced inference techniques allow one to reconstruct the pattern of interaction from high dimensional data sets. We focus here on the statistical properties of inferred models and argue that inference procedures are likely to yield models which are close to a phase transition. On one side, we show that the reparamete…
This paper proposes an alternating back-propagation algorithm for learning the generator network model. The model is a non-linear generalization of factor analysis. In this model, the mapping from the continuous latent factors to the observed signal is parametrized by a convolutional neural network. The alternating bac…
Study reveals decurve flows in graph propagation models.
problem Limitations of traditional graph analysis and propagation mechanisms.
method Introduces Generalized Propagation Neural Networks (GPNNs) and Continuous Unified Ricci Curvature (CURC).
result Observation of decurve flow during training of graph neural networks, revealing propagation dynamics.
New back-propagation rules discovered through evolutionary methods.
problem Improving the back-propagation algorithm for faster training.
method Evolutionary approach to discover new update equations.
result Several new update equations that train faster and perform similarly at convergence.
Unified model combines feature and label propagation for semi-supervised classification.
problem Combining feature and label propagation for effective semi-supervised classification.
method Unified Message Passing Model (UniMP) using Graph Transformer and masked label prediction.
result Obtains new state-of-the-art results in Open Graph Benchmark (OGB).
Improved error correction using neural networks and belief propagation.
problem Inference in factor graphs with loops or poor approximations.
method Hybrid model combining FG-GNN and belief propagation.
result Hybrid model outperforms belief propagation in error correction tasks.
Proposes a method to propagate uncertainty in neural networks for sparse coding.
problem Uncertainty in neural networks for sparse coding.
method Representing the target vector as a spike and slab distribution at each layer, deriving gradients of normalisation constants, and using Bayesian inference.
result Designs a novel Bayesian neural network for sparse coding.
A new approach estimates propagators for trading risky assets.
problem Estimating price impact kernel from static data for optimal trading.
method Nonparametric estimation of propagator using offline reinforcement learning.
result Pessimistic trading strategy optimises execution costs under uncertainty.
Valid certifies LLMs' domain adherence, bounding out-of-domain behavior.
problem Adversarial susceptibility of LLMs to generate out-of-domain outputs.
method VALID approach providing adversarial bounds as a certificate.
result Validates LLMs' domain adherence with meaningful certificates.
New control strategy minimizes infected individuals in SIS epidemics.
problem Developing effective control strategies for SIS epidemics.
method Stochastic optimal control of SDEs with jumps, using treatment intensities.
result Control strategy consistently outperforms alternatives in synthetic data.
This thesis investigates belief propagation's performance in graphical models with loops.
problem Belief propagation's performance and convergence guarantees in models with loops are uncertain.
method Investigates how model parameters affect belief propagation's performance, convergence, and approximation quality.
result Model parameters influence the number of fixed points, convergence properties, and approximation quality of belief propagation.
Paper proposes new neural network learning algorithms inspired by predictive coding.
problem Finding biologically plausible alternatives to back-propagation of errors.
method Error-driven Local Representation Alignment (LRA-E) and Difference Target Propagation.
result Both proposed algorithms yield stable performance and strong generalization in training deeper, highly nonlinear networks.
Decoupled GCN is shown to be equivalent to label propagation.
problem Improving semi-supervised node classification in graph learning.
method The paper proves the equivalence of decoupled GCN and label propagation, and proposes a new method named PTA.
result Decoupled GCN is equivalent to two-step label propagation and can automatically assign weights to pseudo-labels.
LNPE enhances local connections in embeddings using extended neighbor propagation.
problem Improving local connections and interactions in nonlinear dimensionality reduction.
method Inspired by GCN, LNPE extends 1-hop neighbors to n-hop neighbors in LLE.
result LNPE produces more faithful and robust embeddings with better topological and geometrical properties.
The paper analyzes the complexity of sparse label propagation on networks.
problem Computational complexity of sparse label propagation on network data.
method Characterization of iterations for achieving a prescribed accuracy using a first-order oracle model.
result An upper bound on iterations required for accuracy, showing sharpness for chain structures.
A new method for target propagation using iterative approximations converges fast and is more biologically plausible.
problem Improving target propagation methods for neural networks.
method Iterative approximate inverses and local auto-encoders.
result The method converges exponentially fast under certain conditions.
SUMER updates deployed models with new data, improving performance.
problem Updating deployed machine learning models with new data is difficult.
method SUMER uses semi-supervised learning and noise remediation to iteratively retrain models.
result SUMER improves model performance, especially with limited initial training data.
Global propagator for massless Dirac operator defined and analyzed.
problem Analyzing the massless Dirac operator on 3-manifolds.
method Constructing propagator as sum of oscillatory integrals, providing global definitions and small time expansions.
result Explicit calculation of propagators' symbols and coefficients in eigenvalue counting functions.
Neural networks improve cancer risk prediction from family history data.
problem Improving cancer risk prediction from family history data using machine learning.
method Developed and trained neural network models on large pedigrees to predict hereditary cancers.
result Neural networks can achieve nearly optimal prediction performance and outperform traditional models in misreported data.
The article constructs Feynman propagators for normally hyperbolic operators on curved spacetimes.
problem Constructing Feynman propagators for non-scalar geometric operators on curved spacetimes.
method Global microlocalisation constructions for normally hyperbolic operators on globally hyperbolic spacetimes.
result Feynman propagators can be constructed to satisfy a positivity property for selfadjoint normally hyperbolic operators.
The paper proposes a scalable framework for uncertainty quantification and propagation in surrogate-based Bayesian inference.
problem Uncertainty in surrogate models and its impact on inference and decision-making.
method Bayesian inference methods for surrogate models with measurement data.
result Scalable framework for uncertainty quantification and propagation in surrogate models.
We introduce propagation kernels, a general graph-kernel framework for efficiently measuring the similarity of structured data. Propagation kernels are based on monitoring how information spreads through a set of given graphs. They leverage early-stage distributions from propagation schemes such as random walks to capt…
Improved BP algorithm outperforms loopy BP in MAP inference.
problem Limited understanding and poor performance of belief propagation in graphs with loops.
method Introduced α belief propagation, a minimization of localized α-divergence. result Significantly outperforms loopy BP in fully-connected graphs for MAP inference.
SOLBP extends efficient inference to uncertain Bayesian networks.
problem Inference in uncertain Bayesian networks with second-order probabilities.
method Extends Loopy Belief Propagation to second-order Bayesian networks.
result Generates inferences consistent with sum-product networks, more efficient and scalable.