Develops a deep multi-factor model for factor investing with clear financial insights.
problem Lack of interpretability and unclear financial insights in non-linear factor models.
method Industry and market neutralization modules, graph attention modules, factor-attention module.
result Demonstrates effectiveness in factor investing with real-world stock market data.
Efficiently learns deep factor graphs using Gaussian belief propagation.
problem Learning in deep factor graphs with efficient inference.
method Treats all relevant quantities as random variables, uses belief propagation for inference.
result Efficiently solves training and prediction problems in deep factor graphs with belief propagation.
A new recommendation method combining deep learning and graph analysis improves performance.
problem Challenges in recommender systems like cold-start and sparsity.
method Matrix Factorization, deep Autoencoders, and deep embedding methods.
result The proposed method outperforms existing state-of-the-art methods.
Data-driven factor graphs improve BCJR detection robustness.
problem Implementing BCJR detection with accurate channel model knowledge.
method Learn factor graph using machine learning from labeled data.
result BCJRNet learns to implement BCJR detection from small training sets.
Extract common latent factors from graphs for better representation learning.
problem Graph-level representation learning challenges due to limited labeled data and poor negative sample selection.
method Graph-wise Common Latent Factor Extraction (GCFX) using deepGCFX model.
result Improved graph-level and node-level tasks performance compared to state-of-the-art methods.
DeepVir uses deep matrix factorization to predict antivirals for COVID-19.
problem Predicting effective antivirals for COVID-19 using known drug-virus associations.
method Graphical deep matrix factorization with HyPALM optimization.
result DeepVir outperforms state-of-the-art techniques in predicting antivirals for COVID-19.
NePTuNe combines neural and tensor methods for efficient link prediction in knowledge graphs.
problem Incomplete knowledge graphs, especially in link prediction.
method Hybrid model combining neural and tensor factorization methods.
result NePTuNe achieves state-of-the-art performance on FB15K-237 and near state-of-the-art on WN18RR datasets.
End-to-end graph-based SSL learns all graph factors dynamically.
problem Learning quality of graph in SSL is crucial but difficult.
method Proposes an end-to-end approach to optimize all graph factors.
result Demonstrates effectiveness on benchmark datasets.
New framework for disentangling graph node and edge features.
problem Learning disentangled representations for attributed graphs with node and edge features.
method Proposes a novel variational objective and architecture for node and edge deconvolutions to disentangle latent factors.
result Demonstrates effectiveness of the proposed model and its extensions on synthetic and real-world datasets.
Learned factor graphs improve inference from time sequences using neural networks.
problem Inference from time sequences with limited labeled data.
method Combines model-based algorithms and data-driven ML tools for stationary time sequences.
result Learned factor graphs can accurately infer from small training sets.
Most of the successful deep neural network architectures are structured, often consisting of elements like convolutional neural networks and gated recurrent neural networks. Recently, graph neural networks have been successfully applied to graph structured data such as point cloud and molecular data. These networks oft…
New method predicts dynamic relationships in terrorist networks.
problem Dynamic co-evolution of multiplex graphs and nodal attributes in terrorism networks.
method Time-varying stochastic latent factor models with neural network Gaussian processes.
result Superior performance in predicting unobserved dynamic relationships.
The paper explores stability and generalization of deep GCNs.
problem Understanding the stability and generalization of deep GCNs from a theoretical perspective.
method Theoretical analysis of stability and generalization properties of deep GCNs.
result The stability and generalization of deep GCNs are influenced by the maximum absolute eigenvalue of the graph filter operators and the depth of the network.
Proposes deep graph persistence to address neural persistence issues in deep learning.
problem Variance of weights and lack of spatial structure in deep neural networks impact neural persistence.
method Extends neural persistence to the whole network, considering interactions between layers.
result Deep graph persistence alleviates variance-related issues and captures persistent paths through the network.
Proposes a new model for directed graphs combining deep learning and latent variable models.
problem Graph representation learning for directed graphs.
method Deep Latent Space Model (DLSM) integrating GCN encoder and stochastic decoder with hierarchical variational auto-encoder architecture.
result Achieves state-of-the-art performance on link prediction and community detection tasks.
NCFA uses deep learning and causal discovery to analyze complex data.
problem Analyzing complex, interdependent data with causal relationships.
method NCFA combines latent causal discovery and variational autoencoders.
result NCFA outperforms standard VAEs in sparsity, complexity, and causal interpretability.
DS2CF-Net learns hierarchical representations with deep coupled factorization and enriched prior.
problem Learning deep hierarchical representations from data.
method Dual-constrained Deep Semi-Supervised Coupled Factorization Network (DS2CF-Net) with enriched prior.
result DS2CF-Net achieves state-of-the-art performance in representation learning and clustering.
Proposes a graph neural network for futures price prediction.
problem Challenges in high-frequency trading of futures prices.
method Heterogeneous Continual Graph Neural Network (STGNN) integrating multi-factor pricing theories.
result Outperforms other models in prediction accuracy on 49 commodity futures.
Graph neural networks speed up nonnegative matrix factorization.
problem Efficiently factorize nonnegative matrices for various applications.
method Developed a graph neural network that combines bipartite self-attention with ADMM updates.
result Significant acceleration achieved in nonnegative matrix factorization.
Study abelian factors in Lie algebras from graph edge labels.
problem Understanding abelian factors in Lie algebras from graph edge labels.
method Analyzing 2-step nilpotent Lie algebras constructed from graphs, computing abelian factors, and studying singularity properties.
result Explicit computation of abelian factors for various graph families.
Extends graph factor system to quasi-median graphs.
problem Constraint relaxation for combinatorial HHS machinery.
method Relaxing domain constraints on combinatorial HHS machinery and extending factor system to quasi-median graphs.
result Factor system applied to quasi-median graphs.
A wide class of machine learning algorithms can be reduced to variable elimination on factor graphs. While factor graphs provide a unifying notation for these algorithms, they do not provide a compact way to express repeated structure when compared to plate diagrams for directed graphical models. To exploit efficient t…
New aggregation method improves GNN robustness to structural perturbations.
problem Graph Neural Networks (GNNs) are vulnerable to adversarial attacks that manipulate graph structure.
method Proposes a robust aggregation function with a breakdown point of 0.5, inspired by robust statistics.
result Improves GNN robustness by a factor of 3 on Cora ML and 5.5 on Citeseer, and 8 for low-degree nodes.
Rank concepts help explain deep learning's effectiveness.
problem Limited formal understanding of deep learning.
method Introducing rank concepts to explain generalization and expressiveness.
result Gradient-based training induces low rank in neural networks.
We address the issue of the factors driving startup success in raising funds. Using the popular and public startup database Crunchbase, we explicitly take into account two extrinsic characteristics of startups: the competition that the companies face, using similarity measures derived from the Word2Vec algorithm, as we…
Deep Gaussian Processes model functions on DAGs with partially observed data.
problem Reconstructing and inferring from partially observed functions on DAGs with noisy measurements.
method Place priors over functions on DAGs, theoretically study prior-collapse behavior, and offer a structured variational approximation.
result Almost-sure lower bounds on the preservation of input distinctions and interpretability of simulator hierarchies.
The free factor graph for Aut(F_N) is not hyperbolic.
problem Characterizing the geometry of the free factor graph for Aut(F_N).
method Analyzing the quasi-isometric embedding of orbits in the graph of free factors.
result The free factor graph for Aut(F_N) is not hyperbolic.
DGA and DVGA learn disentangled graph representations to improve graph analysis.
problem Holistic graph auto-encoders fail to capture latent factors effectively.
method Design disentangled graph convolutional network and component-wise flow, impose independence constraints.
result Improved disentangled graph representations enhance graph analysis tasks.
Improves performance of deep GCNs by controlling node feature variance.
problem Performance degradation in deep Graph Convolutional Networks (GCNs).
method Experimentally examined the role of TRANs and PROPs in GCNs, introduced Node Normalization (NodeNorm).
result Node Normalization effectively controls node feature variance, improving GCN performance in deep models.
Deep learning speeds up protein mapping entropy calculation.
problem Efficiently calculating the mapping entropy of protein structures.
method Deep graph networks for accelerating mapping entropy computation.
result Deep graph networks achieve a speedup factor of up to 10^5.
New approach to deeper graph neural networks to avoid performance degradation.
problem Performance degradation of graph neural networks when going deeper.
method Decoupling representation transformation and propagation in graph convolution operations.
result Deeper graph neural networks can be used to learn graph node representations from larger receptive fields.
Deep learning predicts stock movements using social media data.
problem Predicting stock movements with traditional methods is challenging.
method Graph neural network combining financial data and social media.
result Improvement of 28% in cumulative returns.
PGRec improves recommendation by modeling user-item preferences as a graph and embedding it for better predictions.
problem Sparse user-item data in recommender systems.
method PGRec models user-item preferences as a PrefGraph, then uses deep learning and factorization to embed and predict user preferences.
result PGRec outperforms state-of-the-art methods by up to 3.2% in NDCG@10.
The paper refines 2-factor homology to a stable homotopy type for planar trivalent graphs with perfect matchings.
problem Developing a stable homotopy type for planar trivalent graphs with perfect matchings.
method Defining a cover functor from the 2-factor flow category to the cube flow category, realizing the 2-factor spectrum, and showing it's an invariant.
result The stable homotopy type of the 2-factor spectrum is an invariant of planar trivalent graphs with perfect matchings.
The paper extends NUP representations to factor graphs for better estimation.
problem Nontrivial model-based estimation problems.
method Augmenting factor graphs with convex-dual variables and NUP representations; proposing a new iterative algorithm.
result A new dual algorithm for state space problems.
EPFGNN models graph connections for better node classification.
problem Graph node classification issues due to feature aggregation.
method EPFGNN models graph as a Markov Random Field with explicit pairwise factors and a GNN backbone.
result EPFGNN improves semi-supervised node classification performance.
Enhances graph neural networks with random walks to improve performance.
problem Limited input to graph neural networks, especially for molecular data.
method Random walk data processing to enrich graph neural network input.
result Shallow network outperforms deep GNNs using only node features.
PGMax automates PGM inference on GPUs, improving quality and speed.
problem Efficient inference in complex discrete PGMs.
method Factor graph specification and loopy belief propagation in JAX.
result Higher-quality inference with up to 3x speedups.
The existing graph neural networks (GNNs) based on the spectral graph convolutional operator have been criticized for its performance degradation, which is especially common for the models with deep architectures. In this paper, we further identify the suspended animation problem with the existing GNNs. Such a problem …
Study on factorizations of knot polynomials for up to 12 crossings.
problem Understanding factorizations of HOMFLY polynomials for knots and links.
method Computer analysis of knots up to 12 crossings; irreducibility criterion for 2-connected plane graphs.
result Found 17 non-trivial factorizations of knots with up to 12 crossings.
Improved error correction using neural networks and belief propagation.
problem Inference in factor graphs with loops or poor approximations.
method Hybrid model combining FG-GNN and belief propagation.
result Hybrid model outperforms belief propagation in error correction tasks.
Factor graphs have recently gained increasing attention as a unified framework for representing and constructing algorithms for signal processing, estimation, and control. One capability that does not seem to be well explored within the factor graph tool kit is the ability to handle deterministic nonlinear transformati…
Method solves Gaussian graphical models on ladder graphs efficiently.
problem Solving Gaussian graphical models on ladder graphs efficiently.
method Proposes a method that depends on the position of zeros in local covariance matrices.
result Efficiently solves Gaussian graphical models on ladder graphs under certain conditions.
We propose a new nonlinear factorization model for graphs that are with topological structures, and optionally, node attributes. This model is based on a pseudometric called Gromov-Wasserstein (GW) discrepancy, which compares graphs in a relational way. It estimates observed graphs as GW barycenters constructed by a se…
Deep NLP models benefit from underlying structures in the data---e.g., parse trees---typically extracted using off-the-shelf parsers. Recent attempts to jointly learn the latent structure encounter a tradeoff: either make factorization assumptions that limit expressiveness, or sacrifice end-to-end differentiability. Us…
Improves scalability and robustness of dynamic graph clustering.
problem Scalability and robustness issues in matrix factorization methods for dynamic graphs.
method Temporal separated matrix factorization, bi-clustering regularization, selective embedding updating.
result Demonstrated scalability, robustness, and effectiveness on synthetic and real-world benchmarks.
New Ricci flow method for directed graphs with balancing factor.
problem Analyzing asymmetry in directed networks.
method Rigorous formulation of Ricci flow on directed weighted graphs with balancing factor.
result Existence and uniqueness of discrete Ricci flow solutions.
We show that the Gromov boundary of the free factor graph for the free group Fn with n>2 generators is the space of equivalence classes of minimal very small indecomposable projective Fn-trees without point stabilizer containing a free factor equipped with a quotient topology. Here two such trees are equivalent if the …