Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,695 papers · 148 categories

Trend · papers per month

81162243324 · Jun 202019922001200920172026
48 results for Weibull graph autoencoders

Develops scalable autoencoder for document networks.

problem Sparse and skewed latent node representations in document relational networks.
method Combines graph Poisson factor analysis with Weibull-based graph inference networks.
result Extracts high-quality hierarchical latent document representations.

To train an inference network jointly with a deep generative topic model, making it both scalable to big corpora and fast in out-of-sample prediction, we develop Weibull hybrid autoencoding inference (WHAI) for deep latent Dirichlet allocation, which infers posterior samples via a hybrid of stochastic-gradient MCMC and…

2018-03-04abs ↗pdf ↗

Develops a flexible deep autoencoding topic model with scalable hybrid Bayesian inference.

problem Flexible and interpretable document analysis models.
method DATM with hybrid Bayesian inference, including topic-layer-adaptive stochastic gradient Riemannian MCMC and Weibull variational encoder.
result Demonstrates scalability and efficacy on big corpora in unsupervised and supervised learning tasks.

Improved concentration inequalities for sub-Weibull variables enhance statistical and machine learning applications.

problem Improving concentration inequalities for sub-Weibull random variables.
method Developed new concentration inequalities for sums of independent sub-Weibull random variables, including a new sub-Weibull parameter.
result New concentration inequalities with sharper constants and a mixture of sub-Gaussian and sub-Weibull tails.

AEGCN uses autoencoder constraints to improve graph node classification.

problem Node classification on graph domains with reduced information loss.
method Autoencoder-constrained graph convolutional network (AEGCN).
result Adding autoencoder constraints significantly improves graph convolutional network performance.

Adversarial training improves graph autoencoder generalization.

problem Improving graph autoencoder generalization.
method Formulated L2 and L1 adversarial training for graph autoencoders and variational graph autoencoders.
result Adversarial training boosts graph autoencoder and variational graph autoencoder generalization.

AFTNet uses a network-constrained Weibull model for biomarker discovery.

problem Discovering biomarkers from survival data with correlated predictors.
method Survival analysis method based on Weibull AFT model, incorporating network constraints and penalized likelihood for variable selection.
result Theoretical consistency and efficient algorithm for AFTNet estimator validated on synthetic and real data.

Tiered latent representations and latent spaces for molecular graphs provide a simple but effective way to explicitly represent and utilize groups (e.g., functional groups), which consist of the atom (node) tier, the group tier and the molecule (graph) tier. They can be learned using the tiered graph autoencoder archit…

2019-08-22abs ↗pdf ↗

Weibull weight-scale parameter λλ evolves during AdamW training, with alignment, injection, and decay forces driving its growth and relaxation.

problem Understanding the evolution of the Weibull weight-scale parameter λλ during AdamW training.
method Deriving a leading-order three-force decomposition of the squared weight norm from AdamW updates.
result The alignment force dominates the rise phase, contributing 88-94% of the absolute force budget across four random seeds.

A new model for multiview data analysis using graph autoencoders.

problem Nonlinear multiview canonical correlation analysis for large datasets.
method Variational approach with graph convolutional neural networks.
result Competitive performance on classification, clustering, and recommendation tasks.

Graphon autoencoder generates graphs with arbitrary sizes using Chebyshev filters.

problem Generating graphs with arbitrary sizes and arbitrary structures.
method Induces graphons from observed graphs, uses Chebyshev filters for latent representation, and learns encoder and decoder to minimize Wasserstein distance.
result Graphon autoencoder provides a new paradigm for graph generation with good generalizability and transferability.

Efficiently estimates covariance for sub-Weibull vectors with sub-Gaussian rate.

problem Outliers in high-dimensional covariance estimation.
method Cross-Fitted Norm-Truncated Estimator for Sub-Weibull distributions.
result Achieves optimal sub-Gaussian rate with O(Nd2)O(Nd^2) operations.

New concentration inequalities for tensors with heavy-tailed coefficients.

problem Developing bounds for Euclidean functions of tensors with sub-Weibull distributions.
method Extending concentration inequalities to sub-Weibull random tensors, using new inequalities for heavy-tailed random variables and martingale analysis.
result Established a phase transition between sub-gaussian and heavy-tailed regimes for Euclidean functions of tensors.

Weibull framework diagnoses transformer weight distributions, revealing distinct patterns across modules.

problem Diagnosing weight distributions in transformer models for better understanding of training dynamics.
method Applied Weibull distribution to diagnose weight magnitude distributions in transformer models, fitting each weight matrix independently.
result Distinct patterns of weight distributions across different transformer modules were identified.

Graph autoencoders (AE) and variational autoencoders (VAE) are powerful node embedding methods, but suffer from scalability issues. In this paper, we introduce FastGAE, a general framework to scale graph AE and VAE to large graphs with millions of nodes and edges. Our strategy, based on an effective stochastic subgraph…

2020-02-05abs ↗pdf ↗

We present RL-VAE, a graph-to-graph variational autoencoder that uses reinforcement learning to decode molecular graphs from latent embeddings. Methods have been described previously for graph-to-graph autoencoding, but these approaches require sophisticated decoders that increase the complexity of training and evaluat…

2019-04-18abs ↗pdf ↗

In this paper, we present a general framework to scale graph autoencoders (AE) and graph variational autoencoders (VAE). This framework leverages graph degeneracy concepts to train models only from a dense subset of nodes instead of using the entire graph. Together with a simple yet effective propagation mechanism, our…

2019-02-23abs ↗pdf ↗

PieClam autoencodes graphs into communities, improving graph anomaly detection.

problem Graph anomaly detection and universal graph autoencoding.
method Probabilistic graph model with overlapping inclusive and exclusive communities.
result PieClam is a universal autoencoder that uniformly approximates any graph.

Learning network representations is a fundamental task for many graph applications such as link prediction, node classification, graph clustering, and graph visualization. Many real-world networks are interpreted as dynamic networks and evolve over time. Most existing graph embedding algorithms were developed for stati…

2019-10-04abs ↗pdf ↗

DefenseVGAE defends graph neural networks against adversarial attacks.

problem Vulnerability of GNNs to adversarial structural perturbations.
method Variational Graph Autoencoder (VGAE) to reconstruct graph structure.
result DefenseVGAE reduces adversarial perturbations and boosts GCN performance.

Graph autoencoders (AE) and variational autoencoders (VAE) recently emerged as powerful node embedding methods. In particular, graph AE and VAE were successfully leveraged to tackle the challenging link prediction problem, aiming at figuring out whether some pairs of nodes from a graph are connected by unobserved edges…

2019-05-23abs ↗pdf ↗

Improved community detection and link prediction with GAE and VGAE.

problem Jointly improving community detection and link prediction with graph autoencoders.
method Introducing a community-preserving message passing scheme and doping encoders with Louvain-based prior communities.
result Empirical effectiveness of Modularity-Aware GAE and VGAE on various real-world graphs.

EVGAE improves VGAE's latent representation learning by mitigating over-pruning.

problem Over-pruning in VGAE limits latent variable capacity and diversity.
method EVGAE uses epitomic approach with multiple sparse VGAE models (epitomes) to increase active latent units and improve generative ability.
result EVGAE outperforms VGAE in generative ability and link prediction on citation networks.

Graph embedding is an effective method to represent graph data in a low dimensional space for graph analytics. Most existing embedding algorithms typically focus on preserving the topological structure or minimizing the reconstruction errors of graph data, but they have mostly ignored the data distribution of the laten…

2018-02-13abs ↗pdf ↗

We examine two fundamental tasks associated with graph representation learning: link prediction and semi-supervised node classification. We present a novel autoencoder architecture capable of learning a joint representation of both local graph structure and available node features for the multi-task learning of link pr…

2018-02-23abs ↗pdf ↗

A deep learning model organizes RNA graphs to reveal folding patterns and properties.

problem Organizing and understanding the complex folding patterns of RNA secondary structures.
method Geometric scattering autoencoder (GSAE) network for learning graph embeddings.
result GSAE accurately reflects bistable RNA structures and can sample new folding trajectories.

GAEs are shown to be implicitly contrastive learners, revealing new design axes.

problem Understanding and improving graph autoencoders.
method Reinterpret GAEs as contrastive learners, identifying asymmetric views.
result Interpreting GAEs as contrastive learners offers clearer model understanding and design guidance.

DECAF-GAD improves fairness in autoencoder-based GAD models without sacrificing performance.

problem Fairness in autoencoder-based GAD models for node-level anomaly detection.
method DECAF-GAD uses a structural causal model to disentangle sensitive attributes from learned representations, along with a fairness-guided loss function.
result DECAF-GAD significantly enhances fairness metrics while maintaining anomaly detection performance.

Estimates change points in Weibull time series with copulas.

problem Change-point estimation for nonlinear Weibull time series with copula-based Markov models.
method Copula-based Markov chain model with Weibull marginal distributions, incorporating asymmetric dependence structures through Clayton and Joe copulas.
result Proposed method performs well in estimating change points and model parameters, demonstrated through extensive numerical studies and empirical application.

VACA models graph data for causal inference without hidden confounders.

problem Causal inference in observational data with hidden confounders.
method Variational graph autoencoders for structural causal models.
result Accurately approximates interventional and counterfactual distributions.

Over the last few years, graph autoencoders (AE) and variational autoencoders (VAE) emerged as powerful node embedding methods, with promising performances on challenging tasks such as link prediction and node clustering. Graph AE, VAE and most of their extensions rely on multi-layer graph convolutional networks (GCN) …

2020-01-21abs ↗pdf ↗

Study on hidden units in finite Bayesian neural networks and their tail properties.

problem Understanding the behavior of hidden units in finite Bayesian neural networks.
method Introduced a generalized Weibull-tail property to describe hidden units tails.
result Unit priors become heavier-tailed going deeper, providing insights into finite Bayesian neural networks.

A novel disentangled graph autoencoder improves treatment effect estimation from networked observational data.

problem Treatment effect estimation from observational data is challenging due to unconfoundedness assumption and latent confounders.
method Proposes a disentangled variational graph autoencoder to disentangle latent factors and enforce factor independence.
result Extensive experiments show superior performance compared to state-of-the-art approaches.

We improve a graph generation model to accurately recover Barabási-Albert graph parameters.

problem Recover Barabási-Albert graph parameters from graph data.
method Use a disentanglement-focused deep autoencoding framework with a sequential LSTM decoder trained on graph data.
result Successfully recover Barabási-Albert graph parameters.