A new GCN model learns higher-order neighbors without explicit adjacency matrix computation.
problem GCN's performance drops for deeper structures due to limited neighborhood information.
method Assumes higher-order neighbors are similar to first-order neighbors, learns weights through Lasso to minimize feature loss.
result HWGCN achieves state-of-the-art results on various datasets.
Unified tensor factorization for efficient 3D convolutions in spatio-temporal emotion analysis.
problem Training deep 3D convolutions is computationally expensive and requires large datasets.
method Tensor factorization framework for separable higher-order convolutions.
result Improved spatio-temporal emotion estimation on large datasets.
Simplicial neural networks extend graph neural networks to handle higher-order interactions.
problem Handling higher-order interactions in complex data structures.
method Define a convolution operation for simplicial complexes and use it to construct convolutional neural networks.
result SNNs effectively impute missing data in coauthorship complexes.
A hybrid model reduces graph complexity for improved classification accuracy.
problem High computational complexity and large number of parameters in higher-order graph convolutional networks.
method Weight sharing mechanism and novel fusion pooling layer to reduce parameters and complexity.
result The proposed model achieves highest classification accuracy with fewer trainable parameters.
New method shows fully-connected networks can learn convolutional structures from data.
problem How to learn convolutional structures from translation-invariant data.
method Data-driven emergence of convolutional structure in neural networks.
result Initially fully-connected networks can learn convolutional structures from their inputs.
BScNets expands graph learning to higher-order interactions.
problem Link prediction on graphs with higher-order interactions.
method Proposes a new SNN using block Hodge-Laplacian and block simplicial complexes.
result BScNets outperforms state-of-the-art models in link prediction.
Proposes a 2-WL-based graph convolution for improved graph classification.
problem Limitations of current GNN architectures in discriminative power.
method Introduces a novel 2-dimensional Weisfeiler-Lehman graph convolution.
result 2-WL-GNN architecture is more discriminative than existing GNN approaches.
HOTCAKE compresses CNNs by decomposing kernels into smaller parts.
problem Compressing deep CNNs without significant accuracy loss.
method Input channel decomposition, guided Tucker rank selection, higher order Tucker decomposition, fine-tuning.
result HOTCAKE produces highly compressed CNN models with good accuracy.
Learning a similarity metric has gained much attention recently, where the goal is to learn a function that maps input patterns to a target space while preserving the semantic distance in the input space. While most related work focused on images, we focus instead on learning a similarity metric for neuroimages, such a…
MixHop learns complex neighborhood relationships in graphs.
problem Existing graph neural networks cannot learn certain neighborhood mixing relationships.
method MixHop repeatedly mixes feature representations of neighbors at various distances.
result MixHop outperforms on challenging baselines and visualizes neighborhood information prioritization.
Paper proposes a new LSTM model for spatio-temporal learning.
problem Challenging video tasks require learning long-term spatio-temporal correlations.
method Introduces a higher-order convolutional LSTM model with tensor train decomposition.
result Model achieves state-of-the-art performance with significantly fewer parameters.
PAGTN improves molecular property prediction by leveraging longer-range graph dependencies.
problem Local aggregation in GCNs misses higher-order graph properties.
method PAGTN uses path features and global attention layers to capture longer-range dependencies.
result PAGTN outperforms GCNs on various molecular property prediction datasets.
Combines neural networks and probabilistic graphical models for efficient higher-order inference.
problem Lack of efficient higher-order relational information in graph neural networks and probabilistic graphical models.
method Derives efficient approximate sum-product loopy belief propagation for higher-order PGMs, embeds into neural network, proposes methods for constructing higher-order factors.
result Substantially outperforms state-of-the-art k-order graph neural networks in molecular datasets.
In this paper, a geometric framework for neural networks is proposed. This framework uses the inner product space structure underlying the parameter set to perform gradient descent not in a component-based form, but in a coordinate-free manner. Convolutional neural networks are described in this framework in a compact …
Recently, graph neural networks have attracted great attention and achieved prominent performance in various research fields. Most of those algorithms have assumed pairwise relationships of objects of interest. However, in many real applications, the relationships between objects are in higher-order, beyond a pairwise …
FGNN generalizes graph neural networks to capture higher-order dependencies.
problem Capturing higher-order dependencies in graph-structured data.
method Introducing a factor graph neural network (FGNN) that can represent Max-Product Belief Propagation.
result FGNN effectively represents Max-Product Belief Propagation and performs well on both synthetic and real datasets.
Tensor methods have emerged as a powerful paradigm for consistent learning of many latent variable models such as topic models, independent component analysis and dictionary learning. Model parameters are estimated via CP decomposition of the observed higher order input moments. However, in many domains, additional inv…
The convolution method for the numerical solution of forward-backward stochastic differential equations (FBSDEs), introduced in [21], uses a uniform space grid. In this paper we utilize a tree-like spatial discretization that approximates the BSDE on the tree, so that no spatial interpolation procedure is necessary. In…
Unified framework for convolution and attention models.
problem Complex neural network structures and their parameter control.
method Unified framework for convolution and attention models.
result Attention models are a special case of convolution with adaptive structure.
New AI model improves grid planning efficiency and reliability.
problem Improving distribution grid planning with AI for energy sustainability.
method Hyperstructures Graph Convolutional Neural Networks (Hyper-GCNNs) with attention mechanism.
result Hyper-GCNNs outperforms existing models in computational efficiency and accuracy.
New methods improve translation-equivariant neural processes for modeling unknown functions.
problem Modeling unknown latent functions from irregularly sampled measurements.
method Volterra series and set Fourier convolutions to address translation-equivariance and efficiency.
result Improved translation-equivariant neural processes with analytical transparency and linear scalability.
A new method for state estimation on complex networks.
problem Reconstructing latent dynamics from multivariate time-series on topological cell complexes.
method Topology-aware state space framework derived from stochastic partial differential equations, with state evolution following heat-like topological diffusion.
result The proposed method successfully recovers latent states and topological structures in real-world networks.
DCIts interprets complex time series data with interpretable coefficients.
problem Interpreting nonlinear multivariate time series data.
method Deep convolutional architecture with a Focuser and Modeler components.
result DCIts provides interpretable coefficients and interaction patterns.
In this paper, we show that feedforward and recurrent neural networks exhibit an outer product derivative structure but that convolutional neural networks do not. This structure makes it possible to use higher-order information without needing approximations or infeasibly large amounts of memory, and it may also provid…
TSSC images enhance chaotic signal classification using ConvNets.
problem Classifying chaotic signals accurately and robustly.
method Triad State Space Construction (TSSC) for image encoding, Convolutional Neural Network (ConvNet) for classification.
result TSSC-ConvNet achieves high accuracy and robustness in chaotic signal classification.
New method classifies nonlinear time series using deep CNNs and bispectra.
problem Classifying nonlinear time series data effectively.
method Combines HOSA with deep CNNs.
result Effective classification of nonlinear time series data.
MDF represents time series motifs as images for improved classification.
problem Classifying time series data with high-order patterns.
method Motif Difference Field (MDF) using Fully Convolutional Networks (FCN).
result MDF outperforms other methods on UCR time series datasets.
Graphs improve theorem proving in higher-order logic.
problem Challenges in converting higher-order logic formulas into graph-based representations.
method Used graph neural networks (GNNs) to represent and search higher-order logic.
result GNNs outperform state-of-the-art methods in higher-order theorem proving.
Paper introduces techniques to learn higher-order programs, improving predictive accuracy and reducing learning times.
problem Expressing and learning complex programs in ILP.
method Extending meta-interpretive learning to support higher-order definitions as background knowledge.
result Learning higher-order programs reduces hypothesis space and sample complexity, improving predictive accuracy and reducing learning times.
For certain classes of knots we define geometric invariants called higher-order genera. Each of these invariants is a refinement of the slice genus of a knot. We find lower bounds for the higher-order genera in terms of certain von Neumann ρ-invariants, which we call higher-order signatures. The higher-order genera o…
Given a graph where every node has certain attributes associated with it and some nodes have labels associated with them, Collective Classification (CC) is the task of assigning labels to every unlabeled node using information from the node as well as its neighbors. It is often the case that a node is not only influenc…
A fundamental property of complex networks is the tendency for edges to cluster. The extent of the clustering is typically quantified by the clustering coefficient, which is the probability that a length-2 path is closed, i.e., induces a triangle in the network. However, higher-order cliques beyond triangles are crucia…
Stability of capillary hypersurfaces with higher order mean curvature.
problem Stability of capillary hypersurfaces with constant higher order mean curvature.
method Generalization of classical stability theory for capillary hypersurfaces.
result Results on stability for capillary hypersurfaces with higher order mean curvature.
New methods for faster ranking and link prediction using higher-order motifs.
problem Real-time ranking and link prediction in applications like web search.
method Higher-order ranking and link prediction methods based on closing higher-order network motifs.
result The methods are faster and more efficient than existing methods based on closing triangles.
The paper improves CR Sobolev inequalities and classifies minimizers.
problem Higher-order CR Sobolev inequalities on the CR sphere.
method Improvement through vanishing higher order moments of the volume element.
result New direct proof of minimizers' classification and existence of minimizers in C2k(N). In this paper we develop a geometric approach to higher order mechanics on graded bundles in both, the Lagrangian and Hamiltonian formalism, via the recently discovered weighted algebroids. We present the corresponding Tulczyjew triple for this higher order situation and derive in this framework the phase equations fro…
The paper glosses different forms of an introducing of higher order tangent-like functors, especially functors derived from higher order nonholonomic tangent functors. A special attention is devoted to higher order osculating bundles: their identification with higher order tangent bundles is demonstrated as the main re…
A new method predicts higher-order interactions in evolving graphs using simplicial complexes.
problem Predicting higher-order interactions in dynamic graphs with theoretical guarantees.
method Capturing higher-order interactions as simplices, modeling neighborhoods with face-vectors, and developing a nonparametric kernel estimator.
result Our method outperforms existing higher-order prediction methods and is theoretically consistent.
Novel higher-order group synchronization for noisy local measurements on hypergraphs.
problem Synchronizing higher-order local measurements on hyperedges to global estimates on nodes.
method Message passing algorithm for global synchronization of higher-order measurements.
result Higher-order method outperforms standard pairwise synchronization methods in certain applications.
Higher-order tangent bundles have geometric structures compatible with their iterated bundle structure.
problem Connection towers and Sasaki metrics on higher-order tangent bundles
method Introduce the notion of a connection tower and study the geometric structures induced by such towers.
result Connection towers determine multiconnections, adapted splittings, and canonical vector bundle structures.
We use the Frölicher-Nijenhuis formalism to reformulate the inverse problem of the calculus of variations for a system of differential equations of order 2k in terms of a semi-basic 1-form of order k. Within this general context, we use the homogeneity proposed by Crampin and Saunders in [14] to formulate and discuss t…
We construct new examples of algebraic curvature tensors so that the Jordan normal form of the higher order Jacobi operator is constant on the Grassmannian of subspaces of type (r,s) in a vector space of signature (p,q). We then use these examples to establish some results concerning higher order Osserman and highe…
Study on bias-variance trade-off in hierarchical models with higher-order interactions.
problem Understanding the bias-variance trade-off in hierarchical probabilistic models with higher-order interactions.
method Proposed an efficient inference algorithm using Gibbs sampling and annealed importance sampling for log-linear higher-order Boltzmann machine.
result Higher-order interactions produce less variance for smaller sample size and comparable error with hidden layers.
After defining cohomologically higher order BRST and anti-BRST operators for a compact simple algebra {\cal G}, the associated higher order Laplacians are introduced and the corresponding supersymmetry algebra Σ is analysed. These operators act on the states generated by a set of fermionic ghost fields transforming u…
HONEM learns embeddings for higher-order networks, improving performance in various tasks.
problem Existing methods fail to capture non-Markovian higher-order dependencies in networks.
method HONEM is a higher-order network embedding method designed for HON, capturing non-Markovian dependencies.
result HONEM outperforms other methods in node classification, network reconstruction, link prediction, and visualization.
State-of-the-art methods in convex and non-convex optimization employ higher-order derivative information, either implicitly or explicitly. We explore the limitations of higher-order optimization and prove that even for convex optimization, a polynomial dependence on the approximation guarantee and higher-order smoothn…
Introduce Collapsed Effective Operators for higher-order structures.
problem Existing spectral operators decompose topology into separate ranks, leaving practitioners to fuse information back to vertices.
method Introduce Collapsed Effective Operators via Schur complementation of a graded Laplacian.
result Preserves positive semi-definiteness, lowers system energy under higher-order connectivity.
Given a closed, oriented, connected 3-manifold, M, we define higher-order linking forms on the higher-order Alexander modules of M. These higher-order linking forms generalize similar linking forms for knots previously studied by the author, which were themselves generalizations of the classical Blanchfield linking for…