Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,786 papers · 148 categories

Trend · papers per month

8.3%16.7%25.0%33.3% · Jan 199319922001200920172026
48 results for graph benchmarks

Benchmark data sets are an indispensable ingredient of the evaluation of graph-based machine learning methods. We release a new data set, compiled from International Planning Competitions (IPC), for benchmarking graph classification, regression, and related tasks. Apart from the graph construction (based on AI planning…

2019-05-15abs ↗pdf ↗

TUDataset provides benchmark datasets for graph learning.

problem Lack of meaningful benchmark datasets and standardized evaluation procedures for graph learning.
method Collection and standardization of 120 graph datasets from various applications.
result Standardized evaluation procedures and baseline experiments provided.

Graph learning is often unnecessary for common benchmarks, as node features can suffice.

problem The necessity of graph learning in common graph benchmarks is often assumed.
method We compared graph learning to feature-only models on seven datasets and found that graph structure often adds little to performance.
result Node features can often suffice for common graph benchmarks, challenging the orthodoxy.

Wiki-CS dataset benchmarks Graph Neural Networks using Wikipedia articles.

problem Benchmarking Graph Neural Networks on a new domain with structural differences.
method Derived from Wikipedia, nodes represent Computer Science articles, edges from hyperlinks, 10 classes for different branches, evaluated semi-supervised node classification and link prediction.
result Graph Neural Networks perform well on Wiki-CS, showing structural differences from earlier benchmarks.

BeGIN benchmarks GNNs for instance-dependent label noise in graphs.

problem Instance-dependent label noise in graph data.
method BeGIN introduces a benchmark with various noise types and evaluates noise-handling strategies across GNN architectures.
result Challenges of instance-dependent noise, especially LLM-based corruption, and the importance of node-specific parameterization.

This paper evaluates LLMs on large graph property estimation tasks.

problem Limited context length of LLMs limits their evaluation on large graphs.
method Developed EstGraph dataset and introduced four tasks for LLMs to estimate large graph properties.
result LLMs perform better on graph property estimation tasks when provided with context-rich prompts based on random walks.

GNNs improve supply chain analytics with real-world benchmarks.

problem Limited research on applying GNNs to supply chain management.
method Conceptual discussions, detailed formulations, examples, mathematical definitions, and task guidelines.
result GNN-based models outperform other methods by 10-40% in various supply chain tasks.

New framework assesses graph-learning datasets for better evaluation.

problem Insufficient evaluation of graph-learning datasets and methods.
method Introduces Rings framework for dataset ablations and proposes performance separability and mode complementarity measures.
result Demonstrates utility of Rings framework for graph-learning dataset evaluation.

New approach learns graph representations by contrasting first-order neighbors and graph diffusion views.

problem Learning node and graph level representations from graph data.
method Self-supervised approach using contrastive learning of multi-scale encodings.
result Achieves state-of-the-art performance on 8 out of 8 benchmarks.

This work benchmarks neural embeddings for link prediction in evolving knowledge graphs.

problem Evaluating the robustness of neural embeddings in changing knowledge graphs.
method Proposes an open-source evaluation pipeline using relation-centric connectivity measures.
result Demonstrates the importance of simulating embedding accuracy for frequently updated knowledge graphs.

Architectures for sparse hierarchical representation learning have recently been proposed for graph-structured data, but so far assume the absence of edge features in the graph. We close this gap and propose a method to pool graphs with edge features, inspired by the hierarchical nature of chemistry. In particular, we …

2019-08-06abs ↗pdf ↗

The study analyzes and benchmarks graph conformal prediction methods.

problem Uncertainty quantification in graph node classification.
method Analysis and scaling of existing graph conformal prediction methods.
result Justified recommendations for future graph conformal prediction research.

Study logical generalization in GNNs using a new benchmark.

problem Understanding how GNNs adapt to new logical tasks.
method Developed GraphLog benchmark suite for logical tasks, evaluated GNNs in supervised, pretraining, and continual learning settings.
result Logical diversity during training affects GNNs' ability to generalize.

Simpler GNNs with low-rank non-parametric aggregators perform well on graph benchmarks.

problem Over-engineering in GNN architectures for common semi-supervised node classification datasets.
method Replacing feature aggregation with a non-parametric learner to streamline GNN design.
result Non-parametric regression is effective for semi-supervised learning on sparse, directed networks.

Revises GNN neighborhood aggregation for more accurate node classification.

problem Flaws in benchmark GNN models for node classification.
method Statistical signal processing approach to neighborhood aggregation.
result Novel insights for designing more efficient GNN models.

Unified benchmark for GLAD and GLOD methods across 35 datasets.

problem Gap between GLAD and GLOD research due to distinct evaluation setups.
method Comprehensive evaluation framework that unifies GLAD and GLOD.
result Multi-dimensional analyses of existing methods' strengths and limitations.

This paper explores different graph neural network functions to improve graph isomorphism.

problem Lack of robust implementation for graph neural networks due to limited analysis of underlying functions.
method Examines various alternative functions for different modules in GNNs using benchmark datasets.
result Generally used underlying techniques do not always capture the overall graph structure.

Recent advances in representation learning on graphs, mainly leveraging graph convolutional networks, have brought a substantial improvement on many graph-based benchmark tasks. While novel approaches to learning node embeddings are highly suitable for node classification and link prediction, their application to graph…

2018-11-03abs ↗pdf ↗

We recently proposed a new ensemble clustering algorithm for graphs (ECG) based on the concept of consensus clustering. We validated our approach by replicating a study comparing graph clustering algorithms over benchmark graphs, showing that ECG outperforms the leading algorithms. In this paper, we extend our comparis…

2019-03-19abs ↗pdf ↗

A new benchmark task for evaluating policy learning in complex, high-dimensional action spaces.

problem Lack of a commonly accepted benchmark for evaluating policy learning in hierarchical tasks with high-dimensional action spaces.
method Proposed DinerDash Gym benchmark and Decomposed Policy Graph Modelling (DPGM) algorithm.
result DPGM achieves significant improvement over baselines and effectively injects domain knowledge.

HGNet improves GNNs' ability to handle long-range interactions in graphs.

problem Insufficiency of GNNs in capturing long-range interactions.
method Introduces hierarchical message passing models with multi-resolution graph representations.
result HGNet outperforms conventional GNNs in molecular property prediction.

Deep GNNs and self-supervision boost graph learning at scale.

problem Efficiently deploying GNNs at large scale remains challenging.
method Two large-scale GNNs: a deep transductive node classifier and a very deep inductive graph regressor.
result Award-level performance on MAG240M and PCQM4M benchmarks.

New benchmarks for RNA 3D structure-function modeling.

problem Lack of standardized benchmarks for RNA deep learning.
method Developed seven benchmark datasets, provided tools for data handling, and offered a user-friendly environment for model comparison.
result Demonstrated utility with baseline results using a relational graph neural network.

Recently, graph neural networks (GNNs) have revolutionized the field of graph representation learning through effectively learned node embeddings, and achieved state-of-the-art results in tasks such as node classification and link prediction. However, current GNN methods are inherently flat and do not learn hierarchica…

2018-06-22abs ↗pdf ↗

Graph neural networks perform better with more features and training data.

problem Comparing graph neural networks to simple models in semi-supervised node classification.
method Empirical evaluation of graph neural network architectures in various settings.
result More complex graph networks outperform simple models in settings with fewer features and more training data.

New algorithms improve causal graph discovery with adaptive interventions, even under worst-case interventional costs.

problem Discover causal relationships from data with adaptive interventions and node-dependent costs.
method Define new benchmarks and provide adaptive search algorithms for causal graph discovery.
result Logarithmic approximations achieved under various settings: atomic, bounded size interventions and generalized cost objectives.

LGKDE learns graph density using neural networks and perturbations.

problem Graph density estimation challenges in capturing structural patterns and semantic variations.
method LGKDE uses graph neural networks to represent graphs as discrete distributions and learns graph metrics via maximum mean discrepancy.
result LGKDE outperforms state-of-the-art baselines in graph anomaly detection.

This work aims at recovering signals that are sparse on graphs. Compressed sensing offers techniques for signal recovery from a few linear measurements and graph Fourier analysis provides a signal representation on graph. In this paper, we leverage these two frameworks to introduce a new Lasso recovery algorithm on gra…

2015-06-19abs ↗pdf ↗

We present graph wavelet neural network (GWNN), a novel graph convolutional neural network (CNN), leveraging graph wavelet transform to address the shortcomings of previous spectral graph CNN methods that depend on graph Fourier transform. Different from graph Fourier transform, graph wavelet transform can be obtained …

2019-04-12abs ↗pdf ↗