Neural networks that compute over graph structures are a natural fit for problems in a variety of domains, including natural language (parse trees) and cheminformatics (molecular graphs). However, since the computation graph has a different shape and size for every input, such networks do not directly support batched t…
On-device research index
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
169,051 papers · 148 categories
Trend · papers per month
48 results for “dynamic computation graphs”
FILDNE learns dynamic graph embeddings efficiently.
problem Learning node embeddings on evolving graphs.
method Integrates static graph learning methods into dynamic graphs using convex combination and alignment.
result FILDNE reduces memory and computational costs while improving downstream task performance.
We describe DyNet, a toolkit for implementing neural network models based on dynamic declaration of network structure. In the static declaration strategy that is used in toolkits like Theano, CNTK, and TensorFlow, the user first defines a computation graph (a symbolic representation of the computation), and then exampl…
Spectral clustering is a widely studied problem, yet its complexity is prohibitive for dynamic graphs of even modest size. We claim that it is possible to reuse information of past cluster assignments to expedite computation. Our approach builds on a recent idea of sidestepping the main bottleneck of spectral clusterin…
Dyn-VGAE learns evolving network structures.
problem Learning dynamic network representations.
method Dynamic joint Variational Graph Autoencoders (Dyn-VGAE).
result Dyn-VGAE captures temporal evolution in dynamic networks.
DySAT learns dynamic graph node representations capturing structural and temporal patterns.
problem Learning latent representations of nodes in dynamic graphs.
method Dynamic Self-Attention Network (DySAT) that combines self-attention layers for structural and temporal dimensions.
result DySAT outperforms state-of-the-art baselines in link prediction on dynamic graphs.
New approach models computer network activity as mixtures of sources.
problem Malicious activity detection in computer networks using standard algorithms is ineffective.
method Source separation approach to model short-term dynamics of computer network activity.
result Qualitative and quantitative experiments validate the approach.
Survey reviews recent advances in learning graph representations over time.
problem Challenges in learning and inference for evolving graphs.
method Categorizes models from encoder-decoder perspective, analyzes techniques.
result Highlights directions for future research in dynamic graph representation learning.
Efficiently updates vertex representations for dynamic graphs using random walks.
problem Updating vertex representations for dynamic graphs without re-generating them on each update.
method Proposes algorithms that extend random walk-based methods to dynamic graphs, considering the extent and rate of changes.
result Achieves competitive results to state-of-the-art methods while being computationally efficient.
Dynamic time warping applied to temporal graphs for pattern recognition.
problem Comparing temporal graphs using a proximity measure.
method Dynamic Time Warping (DTGW) on temporal graphs.
result DTGW is a flexible measure for temporal graph comparison, NP-hard in general but with polynomial-time solvable special cases.
Proposes a new graph representation method using tensor products.
problem Dynamic graph representation and theoretical properties.
method Bind-and-sum approach in hyperdimensional computing (HDC), tensor product as binding operation.
result Memory vs. size analysis of graph representation size scaling.
Improves scalability and robustness of dynamic graph clustering.
problem Scalability and robustness issues in matrix factorization methods for dynamic graphs.
method Temporal separated matrix factorization, bi-clustering regularization, selective embedding updating.
result Demonstrated scalability, robustness, and effectiveness on synthetic and real-world benchmarks.
Graph neural networks are extended to continuous-depth models using differential equations.
problem Improving graph neural networks for static and dynamic graph data.
method Formalizing GNNs as GDEs, blending discrete structures with differential equations.
result GDEs offer computational advantages in static settings and improved performance in dynamic settings.
A new method uses matrix sketches for efficient graph clustering in dynamic environments.
problem Efficiently clustering large, dynamic graphs in distributed memory systems.
method Inspired by spectral clustering, the approach uses random dimension-reducing projections to derive matrix sketches.
result The method produces embeddings that yield performant clustering results in a fully-dynamic stochastic block model stream.
BLISS: Bandit Layer Importance Sampling Strategy for Efficient Training of Graph Neural Networkscs.LG
BLISS optimizes GNN training by adaptively sampling nodes.
problem High computational costs in training GNNs on large graphs.
method Uses Bandit Layer Importance Sampling to dynamically select nodes.
result Improves GNN performance with reduced computational cost.
A novel approach to computing barycenters on graph-supported probability measures.
problem Computing weighted averages of measures on graphs.
method Dynamic optimal transport formulation on the simplex, gradient descent on the probability simplex.
result Intrinsic gradient descent provides a coherent framework for synthesizing and analyzing measures on graphs.
New kernel speeds up graph regression in physics.
problem Handling large, sparse graphs with continuous node attributes in physics.
method Introduced Sliced Wasserstein Weisfeiler-Lehman (SWWL) graph kernel for Gaussian process regression.
result The SWWL kernel is efficient and positive definite, reducing complexity.
ChainNet uses blockchain graph topological features to predict cryptocurrency prices.
problem Capturing network dynamics of blockchain graphs to predict cryptocurrency prices.
method Persistent homology for computing topological features of blockchain graphs.
result Topological features outperform standard graph features in predicting cryptocurrency price dynamics.
Pointer Graph Networksstat.ML
PGNs dynamically infer and use graph structures to improve model generalization.
problem Static graph structures inferred by machine learning practitioners are often suboptimal for tasks.
method PGNs augment graphs with dynamically inferred pointers for improved model generalization.
result PGNs outperform unrestricted GNNs and Deep Sets on dynamic graph connectivity tasks.
Hybrid model combines neural networks and fluid dynamics for efficient, generalized simulations.
problem Inefficient and poor generalization of deep learning approximations of fluid dynamics.
method Combines graph neural networks with a differentiable PDE solver inside a neural network.
result Hybrid model generalizes well to new scenarios and outperforms both neural network and traditional methods.
LOCAL learns dynamic causal structures from time series data efficiently.
problem Challenges in discovering DAG from time series data due to dynamic nature and nonlinear interactions.
method LOCAL proposes a quasi-maximum likelihood-based score function and adaptive modules ACML and DGPL.
result LOCAL significantly outperforms existing methods in dynamic causal discovery.
DMGNN predicts 3D human motions using adaptive multiscale graphs.
problem Predicting 3D skeleton-based human motions accurately.
method Dynamic multiscale graph neural networks (DMGNN) with adaptive multiscale graphs and MGCU.
result DMGNN outperforms state-of-the-art methods in short and long-term predictions.
Identifying critical residues of a protein using meaningfully-thresholded Random Geometric Graphsq-bio.BM
Researchers identify critical protein residues using advanced graph theory.
problem Identifying essential residues in proteins for function.
method Learning Random Geometric Graphs (RGG) with Cramer's V correlation and organic thresholding.
result Advanced RGG methods accurately identify critical residues compared to existing techniques.
ContinuousNet generalizes ResNets to continuous dynamical systems.
problem ResNets fail to be meaningful dynamical integrators.
method Embedding continuous dynamical systems into higher-order numerical integration schemes (Runge Kutta).
result ContinuousNet exhibits invariance to discrete time step sizes and numerical integration schemes.
Develops a new method for efficient probabilistic inference.
problem Efficient inference for models with dynamic computation graphs.
method Introduces combinator library for Probabilistic Torch framework.
result Models can be trained using stochastic methods that optimize variational or wake-sleep objectives.
Pyramidal GNN combines RC and pooling for efficient graph embeddings.
problem Efficiently embedding graphs while maintaining accuracy.
method Alternates RC layers with pooling to reduce complexity.
result Formally shows how pooling reduces complexity and speeds convergence.
Deep NLP models benefit from underlying structures in the data---e.g., parse trees---typically extracted using off-the-shelf parsers. Recent attempts to jointly learn the latent structure encounter a tradeoff: either make factorization assumptions that limit expressiveness, or sacrifice end-to-end differentiability. Us…
Attack graphs are a powerful tool for security risk assessment by analysing network vulnerabilities and the paths attackers can use to compromise network resources. The uncertainty about the attacker's behaviour makes Bayesian networks suitable to model attack graphs to perform static and dynamic analysis. Previous app…
Improved graph convolutional networks using perturbed graph Laplacian.
problem Improving graph convolutional networks' generalization.
method Minimizing loss with perturbed graph Laplacian eigendecomposition.
result Consistent improvement on semi-supervised node classification tasks.
Paper forecasts dynamic transportation networks using probabilistic models.
problem Forecasting temporal evolution of transportation networks.
method Probabilistic latent network model with Bayesian inference.
result Models accurately predict future network states and community structures.
ADMP-GNN dynamically adjusts message-passing layers for better graph learning performance.
problem Fixed message-passing steps in GNNs do not account for nodes' varying computational needs.
method Proposes ADMP-GNN, which dynamically adjusts the number of message-passing layers for each node.
result Improves performance on node classification tasks compared to baseline GNN models.
Online Graph Topology Learning via Time-Vertex Adaptive Filters: From Theory to Cardiac Fibrillationeess.SP
AdaCGP learns dynamic graph topology from time series data, improving over existing methods.
problem Learning dynamic graph topology from time-varying signals, especially in real-time applications.
method AdaCGP is a sparsity-aware adaptive algorithm that recursively estimates the Graph Shift Operator (GSO) through variable splitting.
result AdaCGP outperforms state-of-the-art methods in GSO estimation, achieving improvements exceeding 83%.
New model learns graph spectra accurately, outperforming existing methods.
problem Graph diffusion models struggle to distinguish certain graph families and their spectra.
method Leveraged random matrix theory to analytically extract spectral properties, introducing Dyson Diffusion Model.
result Dyson Diffusion Model learns graph spectra accurately and outperforms existing models.
New approach for open ad hoc teamwork using graph-based policy learning.
problem Designing autonomous agents to collaborate with changing teams without prior coordination.
method Graph-based policy learning to adapt to dynamic team compositions.
result Successfully models the effects of other agents, leading to robust adaptation and superior performance.
Proposes a THGNN for dynamic financial time series prediction.
problem Challenges in predicting stock market price movements.
method Temporal and heterogeneous graph neural network (THGNN) approach.
result Significantly improved prediction performance compared to state-of-the-art methods.
DGNN models dynamic graphs by capturing sequential edge information.
problem Lack of models for dynamic graphs with evolving structure.
method Proposes DGNN, a dynamic graph neural network framework.
result DGNN effectively models dynamic graphs and improves performance.
The behaviour of many real-world phenomena can be modelled by nonlinear dynamical systems whereby a latent system state is observed through a filter. We are interested in interacting subsystems of this form, which we model by a set of coupled maps as a synchronous update graph dynamical systems. Specifically, we study …
New algorithm updates eigenvectors of evolving graphs efficiently.
problem Updating eigenvectors of dynamic graphs.
method Subspace projection based on Rayleigh-Ritz projections.
result Strong performance in eigenvector approximation and downstream tasks.
Inference of space-time varying signals on graphs emerges naturally in a plethora of network science related applications. A frequently encountered challenge pertains to reconstructing such dynamic processes, given their values over a subset of vertices and time instants. The present paper develops a graph-aware kernel…
Paper develops a new model for dynamic graph representation learning.
problem Learning over dynamic graphs with changing topology and node attributes.
method Hierarchical variational model with latent random variables and semi-implicit variational inference.
result SI-VGRNN and VGRNN outperform existing methods in dynamic link prediction.
EvoNet predicts the evolution of dynamic graphs using a graph neural network and recurrent architecture.
problem Predicting the evolution of dynamic graphs is challenging and underexplored.
method EvoNet uses a graph neural network and recurrent architecture to predict the evolution of dynamic graphs.
result EvoNet effectively predicts the evolution of dynamic graphs on both artificial and real-world datasets.
A new method for stochastic optimization using virtual gradients.
problem Stochastic optimization challenges in computational efficiency and memory usage.
method Inspired by dynamic programming, SVGD uses a computational graph and automatic differentiation for efficient optimization.
result Experimental results show SVGD outperforms other methods on multiple datasets and network models.
SteinGen generates diverse graph samples from a single example.
problem Generating graphs with characteristic structures and diversity from a single example.
method Combines Stein's method and MCMC with Glauber dynamics and re-estimation of the Stein operator.
result High distributional similarity to the original data, combined with high sample diversity.
Paper studies efficient regression for dynamic graphs.
problem Regression over dynamic graphs.
method Update-efficient matrix embedding, O(nm) time complexity for updates.
result Exact optimal solution can be updated efficiently in dynamic graphs.
We propose and systematically evaluate three strategies for training dynamically-routed artificial neural networks: graphs of learned transformations through which different input signals may take different paths. Though some approaches have advantages over others, the resulting networks are often qualitatively similar…
Multi-fidelity graph-based neural networks architectures to learn Navier-Stokes solutions on non-parametrized 2D domainsphysics.flu-dyn
Framework predicts Navier-Stokes solutions on 2D domains using graph neural networks.
problem Predicting stationary Navier-Stokes solutions in non-parametrized 2D geometries.
method Graph-based multi-fidelity learning framework combining reduced-order models, Transformers, and Mamba architectures.
result Mamba architecture reduces computational cost while maintaining performance.
CTGCN learns dynamic graph embeddings preserving both local and global graph structure.
problem Learning node representations for evolving graphs while preserving both local and global graph structure.
method CTGCN uses k-core based temporal graph convolutional network to learn dynamic graph embeddings.
result CTGCN outperforms existing methods in link prediction and structural role classification.
A new metric based on hitting probabilities for directed graphs and Markov chains.
problem Lack of metrics specifically adapted to asymmetric structure of directed graphs and Markov chains.
method Metric based on hitting probabilities, insensitive to shortest and average walk distances.
result New structural theory of directed graphs and utility for various applications.