Study compares hypergraph and graph-level models for higher-order relational learning.
problem Evaluating effectiveness of hypergraph-level vs. graph-level models in relational learning.
method Systematic evaluation of various hypergraph and graph-level architectures.
result Graph-level models applied to hypergraph expansions outperform hypergraph-level models.
Extends RRR to capture nonlinear interactions in multi-response regression.
problem Complex relationships in real-world data cannot be adequately modeled by linear interactions.
method Introduces Higher Order Reduced Rank Regression (HORRR) using tensor representations and Tucker decomposition.
result HORRR can capture nonlinear interactions in multi-response regression.
Wavelets model complex interactions in spatial transcriptomics.
problem Capturing higher-order relationships in spatial transcriptomics data.
method Hypergraph diffusion wavelets for representing hyperedges.
result Wavelets effectively represent disease-relevant cellular niches in Alzheimer's disease.
Neural network learns from higher-order connections in molecules.
problem Graph neural networks fail to account for local and hidden structures in graphs.
method Developed a neural network that can pass messages and aggregate information across higher-order paths.
result The model improves molecular property prediction.
Paper proposes a new method to identify causal graphs with latent variables using higher-order cumulants.
problem Estimating causal directed acyclic graphs with latent confounders.
method Uses higher-order cumulants to identify causal structures among observed and latent variables.
result Validates the proposed algorithm through simulations and real-world data.
Proposes new embeddings for bipartite graphs to better capture indirect relationships.
problem Typical graph embeddings fail to capture type-specific features in bipartite graphs.
method Develops two types of embeddings (FOBE and HOBE) that decompose edges into indirect relationships and uses algebraic distance for higher-order sampling.
result Ensemble embeddings improve performance over individual methods in link prediction and recommendation tasks.
Topo-MLP learns network representations without message passing.
problem Lack of efficient higher-order network modeling methods.
method Proposes Topo-MLP, a simplicial neural network algorithm using MLP and HONC loss.
result Demonstrates improved robustness and efficiency in representation learning.
Simplicial neural networks extend graph neural networks to handle higher-order interactions.
problem Handling higher-order interactions in complex data structures.
method Define a convolution operation for simplicial complexes and use it to construct convolutional neural networks.
result SNNs effectively impute missing data in coauthorship complexes.
A new method predicts higher-order interactions in evolving graphs using simplicial complexes.
problem Predicting higher-order interactions in dynamic graphs with theoretical guarantees.
method Capturing higher-order interactions as simplices, modeling neighborhoods with face-vectors, and developing a nonparametric kernel estimator.
result Our method outperforms existing higher-order prediction methods and is theoretically consistent.
TGCCA analyzes higher-order tensors using orthogonal rank-R CP decomposition.
problem Handling higher-order structures in multi-block data analysis.
method Tensor Generalized Canonical Correlation Analysis (TGCCA) with orthogonal rank-R CP decomposition.
result TGCCA outperforms state-of-the-art methods on simulated and real data.
New method uses information theory to uncover causal relationships in complex systems.
problem Discovering causal relationships in multivariate systems, especially in Bayesian networks and hypergraphs.
method Partial Information Decomposition (PID) to explicitly model higher-order interactions.
result PID components reveal direct causal neighbors and collider relationships in Bayesian networks and multi-tail hyperedges in causal hypergraphs.
Novel higher-order group synchronization for noisy local measurements on hypergraphs.
problem Synchronizing higher-order local measurements on hyperedges to global estimates on nodes.
method Message passing algorithm for global synchronization of higher-order measurements.
result Higher-order method outperforms standard pairwise synchronization methods in certain applications.
We develop a theory of higher-order feature attribution for complex models.
problem Interpreting feature contributions in models with interactions is challenging.
method We extend Integrated Gradients (IG) to higher-order feature attributions.
result We establish natural connections to statistics and topological signal processing.
The geometry of jets of submanifolds is studied, with special interest in the relationship with the calculus of variations. A new intrinsic geometric formulation of the variational problem on jets of submanifolds is given. Working examples are provided.
Mixes higher-order simplicial complexes for data augmentation.
problem Lack of labeled data for complex systems with multiway interactions.
method Proposes mixup mechanisms for simplicial complexes, including linear and nonlinear mixup, and a convex clustering mixup.
result Synthetic simplicial complexes interpolate between existing data based on homomorphism densities.
New method aggregates bootstrapped DAGs for causal discovery.
problem Aggregation of bootstrapped DAGs ignores higher-order structures.
method Theoretical framework and new DAG aggregation algorithm.
result Proposed method outperforms state-of-the-art solutions.
Tutorials on signal processing on higher-order networks like simplicial complexes and hypergraphs.
problem Processing complex data structures with polyadic relationships.
method Introduction to simplicial complexes and hypergraphs, Fourier analysis, signal denoising, interpolation, embeddings, neural networks.
result Multi-relational operators like the Hodge Laplacian for simplicial complexes and tensor representations for hypergraphs.
Extends graph theory to hypergraphs with manifold-valued nodes.
problem Representing complex N-ary relationships on manifolds.
method Defined function spaces and symmetric products for manifold-valued nodes and edges.
result Generalized hypergraph Laplacians to manifold-valued hypergraphs.
New hypergraph neural network learns variable-sized hyperedges.
problem Learning representations for non-uniform hypergraphs with variable cardinalities.
method Developed a hypergraph neural network exploiting incidence structure.
result Significant improvement in accuracy on real-world hypergraph datasets.
MACE uses higher-order messages to create fast, accurate force fields.
problem Creating fast and accurate force fields in computational chemistry and materials science.
method Introducing MACE, an equivariant MPNN model that uses four-body messages.
result MACE reduces the required number of message passing iterations to just two, achieving state-of-the-art accuracy.
SmoothGrad and VarGrad are techniques that enhance the empirical quality of standard saliency maps by adding noise to input. However, there were few works that provide a rigorous theoretical interpretation of those methods. We analytically formalize the result of these noise-adding methods. As a result, we observe two …
SMART combines decision trees and MARS for better regression modeling.
problem High variance in decision trees for continuous relationships, poor performance in MARS for discontinuities.
method SMART uses a decision tree to identify subsets with distinct continuous relationships, then applies MARS to fit these relationships independently.
result SMART improves regression performance over state-of-the-art methods in capturing discontinuities and continuous relationships.
Concepts and techniques from the theory of G-structures of higher order are applied to the study of certain structures (volume forms, conformal structures, linear connections and projective structures) defined on a pseudo-Riemanniann manifold. Several relationships between the structures involved have been investigated…
Existing popular methods for semi-supervised learning with Graph Neural Networks (such as the Graph Convolutional Network) provably cannot learn a general class of neighborhood mixing relationships. To address this weakness, we propose a new model, MixHop, that can learn these relationships, including difference operat…
The paper develops a spectral theory for hypergraphs with edge-dependent vertex weights using random walks.
problem Lack of spectral theory for hypergraphs with edge-dependent vertex weights.
method Random walks on hypergraphs with edge-dependent vertex weights, deriving a random walk-based hypergraph Laplacian.
result Random walks on hypergraphs with edge-dependent vertex weights can capture higher-order relationships in data.
We give a short introduction to the theory of twisted Alexander polynomials of a 3--manifold associated to a representation of its fundamental group. We summarize their formal properties and we explain their relationship to twisted Reidemeister torsion. We then give a survey of the many applications of twisted invarian…
LATTE tackles heterogeneous network embedding challenges with layer-stacked attention.
problem Aggregating higher-order indirect relations in heterogeneous networks.
method Layer-stacked ATTention Embedding (LATTE) that decomposes meta relations at each layer.
result LATTE achieves state-of-the-art performance on benchmark datasets.
This paper describes the relationship between the first non-vanishing Milnor invariants of a classical link and the intersection invariant of a twisted Whitney tower. This is a certain 2-complex in the 4-ball, built from immersed disks bounded by the given link in the 3-sphere together with finitely many `layers' of Wh…
Recently, graph neural networks have attracted great attention and achieved prominent performance in various research fields. Most of those algorithms have assumed pairwise relationships of objects of interest. However, in many real applications, the relationships between objects are in higher-order, beyond a pairwise …
Bi-linear feature learning models, like the gated autoencoder, were proposed as a way to model relationships between frames in a video. By minimizing reconstruction error of one frame, given the previous frame, these models learn "mapping units" that encode the transformations inherent in a sequence, and thereby learn …
Hypergraphs allow one to encode higher-order relationships in data and are thus a very flexible modeling tool. Current learning methods are either based on approximations of the hypergraphs via graphs or on tensor methods which are only applicable under special conditions. In this paper, we present a new learning frame…
A conformal description of Poincare-Einstein manifolds is developed: these structures are seen to be a special case of a natural weakening of the Einstein condition termed an almost Einstein structure. This is used for two purposes: to shed light on the relationship between the scattering construction of Graham-Zworski…
Proposes LSR-IGRU for improved stock trend prediction.
problem Challenges in stock price prediction due to complex relationships and nonlinear dynamics.
method Long short-term relationships matrix and improved GRU input for better temporal and relationship integration.
result Significantly improved accuracy in predicting stock trend changes.
Let M be a connected smooth manifold, let Aut(p) be the group automorphisms of the bundle p:R×M→R, and let q:J1(R,M)×R→J1(R,M) be the canonical projection. Invariant functions on Jr(q) under the natural action of $\op…
It is still an open question whether a compact embedded hypersurface in the Euclidean space R^{n+1} with constant mean curvature and spherical boundary is necessarily a hyperplanar ball or a spherical cap, even in the simplest case of surfaces in R^3. In a recent paper the first and third authors have shown that this i…
Self-supervised pretraining for heterogeneous hypergraphs improves graph-based tasks.
problem Capturing higher-order relations in heterogeneous hypergraphs.
method SPHH framework for self-supervised pretraining of heterogeneous HyperGNNs.
result SPHH consistently outperforms state-of-the-art baselines in various downstream tasks.
New quantum states capture more information, enabling advanced processing tasks.
problem Quantum information processing challenges with limited statistical information.
method Introducing Random-Coefficient Pure States (RCPS) and exploiting their higher-order statistics.
result RCPS provide richer information than density operators, enabling new quantum tasks.
Insider trading is one of the numerous white collar crimes that can contribute to the instability of the economy. Traditionally, the detection of illegal insider trades has been a human-driven process. In this paper, we collect the insider tradings made available by the US Securities and Exchange Commissions (SEC) thro…
This paper describes grope and Whitney tower filtrations on the set of concordance classes of classical links in terms of class and order respectively. Using the tree-valued intersection theory of Whitney towers, the associated graded quotients are shown to be finitely generated abelian groups under a (surprisingly) we…
Paper develops a new framework for analyzing certainty equivalents and dynamic risk premia using Malliavin calculus and Wiener chaos analysis.
problem Limitations of Arrow-Pratt approximation for arbitrary sequences of vanishing risks.
method Develops a new framework based on Malliavin calculus and Wiener chaos analysis, combining Itô calculus, the Clark--Ocone representation, and the Wiener chaos decomposition.
result Establishes a unified framework linking expected utility theory, stochastic analysis, and Wiener chaos expansions, revealing higher-order certainty equivalents and dynamic risk premia.
In previous work with Schoenfeld, we considered a string-type chain complex of curves on surfaces, with differential given by resolving crossings, and computed the homology of this complex for discs. In this paper we consider the corresponding "string homology" of annuli. We find this homology has a rich algebraic stru…
New method explains GNN predictions using walks.
problem GNNs are black-boxes and hard to explain.
method Nested attribution scheme using relevant walks.
result Extracts meaningful explanations from GNNs.
New method uses kernel deviance measures to discover causal relationships in heterogeneous data.
problem Discovering causal relationships in complex, heterogeneous datasets.
method KIIM-HT, a novel score measure based on heterogeneous transformations of RKHS embeddings.
result KIIM-HT outperforms previous methods in causal discovery tasks.
Graphs improve theorem proving in higher-order logic.
problem Challenges in converting higher-order logic formulas into graph-based representations.
method Used graph neural networks (GNNs) to represent and search higher-order logic.
result GNNs outperform state-of-the-art methods in higher-order theorem proving.
Paper introduces techniques to learn higher-order programs, improving predictive accuracy and reducing learning times.
problem Expressing and learning complex programs in ILP.
method Extending meta-interpretive learning to support higher-order definitions as background knowledge.
result Learning higher-order programs reduces hypothesis space and sample complexity, improving predictive accuracy and reducing learning times.
For certain classes of knots we define geometric invariants called higher-order genera. Each of these invariants is a refinement of the slice genus of a knot. We find lower bounds for the higher-order genera in terms of certain von Neumann ρ-invariants, which we call higher-order signatures. The higher-order genera o…
A fundamental property of complex networks is the tendency for edges to cluster. The extent of the clustering is typically quantified by the clustering coefficient, which is the probability that a length-2 path is closed, i.e., induces a triangle in the network. However, higher-order cliques beyond triangles are crucia…
Stability of capillary hypersurfaces with higher order mean curvature.
problem Stability of capillary hypersurfaces with constant higher order mean curvature.
method Generalization of classical stability theory for capillary hypersurfaces.
result Results on stability for capillary hypersurfaces with higher order mean curvature.