Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,695 papers · 148 categories

Trend · papers per month

95189284378 · Jun 202019922001200920172026
48 results for principal graph encoder

The paper introduces a method for detecting principal communities and embedding vertices.

problem Detecting and embedding vertices in graphs with community structure.
method Principal graph encoder embedding method that detects principal communities and produces vertex embeddings.
result The method successfully detects principal communities and produces accurate vertex embeddings.

The paper identifies saddlepoints in unsupervised auto-encoding neural nets.

problem The risk landscape of unsupervised least squares in auto-encoding neural nets.
method Established an equivalence between unsupervised least squares and principal manifolds, discussed regularization strategies for auto-encoders.
result All non-trivial critical points in auto-encoding are saddlepoints, which are degenerate in overcomplete auto-encoding.

DGA and DVGA learn disentangled graph representations to improve graph analysis.

problem Holistic graph auto-encoders fail to capture latent factors effectively.
method Design disentangled graph convolutional network and component-wise flow, impose independence constraints.
result Improved disentangled graph representations enhance graph analysis tasks.

In many physical, statistical, biological and other investigations it is desirable to approximate a system of points by objects of lower dimension and/or complexity. For this purpose, Karl Pearson invented principal component analysis in 1901 and found 'lines and planes of closest fit to system of points'. The famous k…

2008-09-02abs ↗pdf ↗

Auto-encoders have emerged as a successful framework for unsupervised learning. However, conventional auto-encoders are incapable of utilizing explicit relations in structured data. To take advantage of relations in graph-structured data, several graph auto-encoders have recently been proposed, but they neglect to reco…

2019-05-26abs ↗pdf ↗

Principal components analysis (PCA) is the optimal linear auto-encoder of data, and it is often used to construct features. Enforcing sparsity on the principal components can promote better generalization, while improving the interpretability of the features. We study the problem of constructing optimal sparse linear a…

2015-02-23abs ↗pdf ↗

The (variational) graph auto-encoder and its variants have been popularly used for representation learning on graph-structured data. While the encoder is often a powerful graph convolutional network, the decoder reconstructs the graph structure by only considering two nodes at a time, thus ignoring possible interaction…

2019-11-26abs ↗pdf ↗

Transformer adapts to graphs with adaptive attention and auto-regressive decoding.

problem Transformers struggle with graph data due to non-sequential nature.
method Proposes GRAT, a Transformer variant with adaptive attention and auto-regressive decoding.
result GRAT achieves state-of-the-art performance on molecule property predictions and generation tasks.

We introduce the variational graph auto-encoder (VGAE), a framework for unsupervised learning on graph-structured data based on the variational auto-encoder (VAE). This model makes use of latent variables and is capable of learning interpretable latent representations for undirected graphs. We demonstrate this model us…

2016-11-21abs ↗pdf ↗

Novel PCA method for high-dimensional inverse problems.

problem Optimizing large-scale random fields with gradient information.
method Gradient-Sensitive Principal Component Analysis (Gradient-SPCA) that modifies PCA using objective function gradients.
result Improvements in encoding quality for objective function minimization and field distribution.

FVNNs use graph convolutions on fair covariance estimates to improve fairness in machine learning.

problem Data-driven methods can encode biases in sample covariance matrices, leading to unfair treatment of different subpopulations.
method FVNNs perform graph convolutions on fair covariance estimates and use a fairness regularizer in the loss function.
result FVNNs provide a flexible model that is intrinsically fairer than PCA approaches and can handle low sample regimes.

A method to uniformly sample graph-encoded surfaces of fixed size.

problem Sampling uniformly from combinatorial isomorphism types of balanced triangulations of surfaces.
method Relies on connections between graph-encoded surfaces and permutations, and basic properties of the symmetric group.
result Empirical mean genus of the sample is very close to a specific formula as nn increases.

Derives formulae for general permutation equivariant layers and presents a second order graph variational encoder.

problem Tackles the limitation of previous equivariant neural networks by considering permutations of matrices.
method Derives formulae for general permutation equivariant layers, including matrix permutations. Presents a second order graph variational encoder.
result Latent distribution of equivariant generative models must be exchangeable.

Just like Atiyah Lie algebroids encode the infinitesimal symmetries of principal bundles, exact Courant algebroids are believed to encode the infinitesimal symmetries of S1S^1-gerbes. At the same time, transitive Courant algebroids may be viewed as the higher analogue of Atiyah Lie algebroids, and the non-commutative a…

2017-01-04abs ↗pdf ↗

We construct a series of finitely presented semigroups. The centers of these semigroups encode uniquely up to rigid ambient isotopy in 3-space all non-oriented spatial graphs. This encoding is obtained by using three-page embeddings of graphs into the product of the line with the cone on three points. By exploiting thr…

2004-07-19abs ↗pdf ↗

We present two instances, L-GAE and L-VGAE, of the variational graph auto-encoding family (VGAE) based on separating feature propagation operations from graph convolution layers typically found in graph learning methods to a single linear matrix computation made prior to input in standard auto-encoder architectures. Th…

2019-10-18abs ↗pdf ↗

Graph auto-encoder predicts unobserved node features from biological networks and omics data.

problem Integrating biological networks and continuous node features for better prediction.
method Graph neural networks and feature auto-encoders trained on feature reconstruction.
result Graph feature auto-encoder outperforms auto-encoders trained on graph reconstruction for predicting unobserved node features.

Paper proposes LCP for structural encodings, outperforming existing methods.

problem Improving Graph Neural Networks performance through effective structural encodings.
method Geometric perspective, Local Curvature Profiles (LCP) for structural encodings, combining with global positional encodings, comparing with rewiring techniques.
result LCP significantly outperforms existing structural encodings and combining LCP with global positional encodings improves performance.

Can neural networks learn to compare graphs without feature engineering? In this paper, we show that it is possible to learn representations for graph similarity with neither domain knowledge nor supervision (i.e.\ feature engineering or labeled graphs). We propose Deep Divergence Graph Kernels, an unsupervised method …

2019-04-21abs ↗pdf ↗

Semi-implicit graph variational auto-encoder (SIG-VAE) is proposed to expand the flexibility of variational graph auto-encoders (VGAE) to model graph data. SIG-VAE employs a hierarchical variational framework to enable neighboring node sharing for better generative modeling of graph dependency structure, together with …

2019-08-19abs ↗pdf ↗

Graph-based clustering plays an important role in the clustering area. Recent studies about graph convolution neural networks have achieved impressive success on graph type data. However, in general clustering tasks, the graph structure of data does not exist such that the strategy to construct a graph is crucial for p…

2020-02-20abs ↗pdf ↗

Paper explores embedding methods for detecting pseudo-cliques in random graphs, showing limitations and potential.

problem Detecting planted pseudo-cliques in random dot product graphs.
method Adjacency Spectral Embedding (ASE) and Graph Encoder Embedding (GEE).
result These methods can localize pseudo-cliques with additional clean network data, but not without it.

A novel approach is put forth that utilizes data similarity, quantified on a graph, to improve upon the reconstruction performance of principal component analysis. The tasks of data dimensionality reduction and reconstruction are formulated as graph filtering operations, that enable the exploitation of data node connec…

2018-09-25abs ↗pdf ↗

Improved graph embedding through refined linear transformation and community recovery.

problem Identifying meaningful latent communities in graph data.
method Refined graph encoder embedding via linear transformation, self-training, and latent community recovery.
result Improved vertex embedding and better decision boundaries for vertex classification.

Generative networks have made it possible to generate meaningful signals such as images and texts from simple noise. Recently, generative methods based on GAN and VAE were developed for graphs and graph signals. However, the mathematical properties of these methods are unclear, and training good generative models is di…

2018-09-28abs ↗pdf ↗

Two CSSL-based methods improve graph classification with limited labeled data.

problem Limited labeled data for graph classification leads to overfitting.
method Contrastive self-supervised learning (CSSL) for graph encoders pretraining and regularization.
result CSSL methods reduce overfitting and improve graph classification accuracy.

This paper explores GNN functions on random graphs, highlighting the importance of node Positional Encodings.

problem Understanding the expressive power of GNNs on large random graphs.
method General convergence notions, input node features, and Positional Encodings (PEs).
result GNNs can converge to certain functions on large random graphs, emphasizing the role of PEs.

A checkerboard graph of a special diagram of an oriented link is made a directed, edge-weighted graph in a natural way so that a principal minor of its Laplacian matrix is a Seifert matrix of the link. Doubling and weighting the edges of the graph produces a second Laplacian matrix such that a principal minor is an Ale…

2018-09-18abs ↗pdf ↗

Paper rigorously defines Feynman graph integrals on Kähler manifolds.

problem Establishing convergence of Feynman graph integrals on Kähler manifolds.
method Using Getzler's rescaling technique, graph integrands are extended to forms with divisorial-type singularities in the compactification of configuration spaces.
result Feynman graph integrals are rigorously defined as Cauchy principal value integrals.

New method shows ignoring morphological graph info improves reinforcement learning performance.

problem Improving reinforcement learning performance in incompatible environments.
method Transformer-based approach (Amorpheus) that ignores morphological graph information.
result Transformer-based approach outperforms GNN-based methods that use morphological information.

Paper connects probability density cuts to graph theory eigenfunctions.

problem Developing sparse cuts for probability densities.
method Defines sparse cuts and principal eigenfunctions for probability densities, proving Cheeger and Buser inequalities.
result No such inequalities hold for prior definitions, proving new inequalities for probability densities.

New approach learns graph representations by contrasting first-order neighbors and graph diffusion views.

problem Learning node and graph level representations from graph data.
method Self-supervised approach using contrastive learning of multi-scale encodings.
result Achieves state-of-the-art performance on 8 out of 8 benchmarks.