New method improves graph neural networks by considering different types of relations in sampling.
problem Current graph neural networks ignore relation types in biomedical graphs, leading to suboptimal performance.
method Proposes relation-dependent sampling for multi-relational graphs to balance relation frequency and importance.
result State-of-the-art graph neural networks achieve better accuracy and efficiency with relation-dependent sampling.
GMNN combines conditional random fields and graph neural networks for relational data.
problem Semi-supervised object classification in relational data.
method Combines conditional random fields and graph neural networks. Uses variational EM algorithm for training.
result GMNN achieves state-of-the-art results on object classification, link classification, and unsupervised node representation learning.
Feed-forward nets fail to learn equality relations, but adding DR units helps.
problem Feed-forward neural networks struggle to learn equality relations reliably.
method Introduced differential rectifier (DR) units to create an inductive bias.
result DR units enable feed-forward nets to learn equality relations reliably.
Bayesian weight priors improve neural network learning of identity relations.
problem Neural networks struggle to learn abstract and systematic relations, especially identity relations.
method Extended RBP approach using Bayesian weight priors as a regularization term.
result Bayesian weight priors lead to perfect generalization for identity relations and do not hinder standard neural network learning.
Neural networks enhance relation extraction from biomedical literature.
problem Automated extraction of relations between biomedical concepts.
method Use of multichannel architectures in deep neural networks with biomedical ontologies.
result State-of-the-art results in relation extraction tasks.
Graph Neural Networks improve machine learning on relational databases.
problem Training machine learning models on relational databases requires costly data extraction and feature engineering.
method Uses Graph Neural Networks to extract features from relational databases.
result Outperforms state-of-the-art automatic feature engineering methods.
Improved GNN handles long-range dependencies in multi-relational graphs.
problem Vanishing gradients in GNNs for multi-relational graphs.
method Proposes a Gated Graph Neural Network with improved long-range dependency handling.
result Outperforms popular GNN models in synthetic tasks.
Improves neural machine translation by learning better source representations with relation networks.
problem Forgetting distant information and disregarding relationship between source words in neural machine translation.
method Introduces relation networks to learn better source representations by associating source words with each other and retaining their relationships.
result Significantly improves translation performance over conventional encoder-decoder models and outperforms approaches involving supervised syntactic knowledge.
We investigate graph neural networks for multi-relational data.
problem Understanding and improving graph neural networks for multi-relational data.
method Aligning Relational GCN and Compositional GCN with the Weisfeiler-Leman test to understand their expressive power and introduce a new k-RN architecture. result The k-RN architecture overcomes the expressiveness limitations of Relational GCN and Compositional GCN. Enhances graph neural networks with Relational Pooling for better graph classification.
problem Improving graph neural networks for better graph classification.
method Relational Pooling (RP) based on finite partial exchangeability theory.
result Improved performance on graph classification tasks.
Neural networks struggle with identity relations; DR units improve generalization.
problem Neural networks fail to generalize identity relations.
method Exploring various factors in neural network architecture and learning process, including number of hidden layers, activation function, and data representation.
result DR units improve generalization, leading to almost perfect test accuracy in mid fusion setting.
Investigates how neural network graph structure impacts predictive performance.
problem Lack of understanding between neural network graph structure and predictive performance.
method Developed relational graph representation to analyze neural networks, identifying a 'sweet spot' for improved performance.
result Identified a 'sweet spot' in relational graph structure that significantly improves neural network predictive performance.
Over 50 million scholarly articles have been published: they constitute a unique repository of knowledge. In particular, one may infer from them relations between scientific concepts, such as synonyms and hyponyms. Artificial neural networks have been recently explored for relation extraction. In this work, we continue…
NMLNs use neural networks to learn relational structure from data.
problem Learning implicit rules from data without explicit logic rules.
method Combines Markov logic with neural networks to learn relational structure.
result NMLNs can predict in settings without explicit logic rules.
Deep neural networks solve Raven's Progressive Matrices with high accuracy.
problem Testing relational reasoning in machine learning systems.
method Combining Wild Relation Networks with Multi-Layer Relation Networks and introducing Magnitude Encoding.
result Deep neural networks achieve 98.0 percent accuracy, significantly improving over previous methods.
A neural network learns relational representations from raw data.
problem Learning reusable representations from raw pixel data.
method Explicitly relational neural network architecture trained on visual relational tasks.
result The architecture outperforms baselines on unseen tasks.
DREAM model improves computational efficiency for non-linear effects in relational event models.
problem Efficiently modeling non-linear effects in dynamic relational networks.
method Introduces Deep Relational Event Additive Model (DREAM) using Neural Additive Models.
result Demonstrates superior computational efficiency compared to traditional REM approaches.
A new GRNN tackles multi-relational data learning.
problem Scalable semi-supervised learning from complex, multi-relational data.
method Graph Recurrent Neural Network (GRNN) with learnable weights and graph-based regularizers.
result GRNN outperforms competing alternatives in real data sets.
New memory module improves relational reasoning in neural networks.
problem Standard memory architectures struggle with relational reasoning tasks.
method Introduce a new memory module called Relational Memory Core (RMC) using multi-head dot product attention.
result Achieves state-of-the-art results on various datasets, including WikiText-103, Project Gutenberg, and GigaWord.
Paper uses neural networks to solve complex transport problems.
problem Optimal transport and related hedging problems.
method Penalization and neural networks to solve optimization problems.
result Effective solution to multi-marginal, martingale optimal transport problems.
ENN neural network learns logical syllogisms using Euler diagrams.
problem Traditional neural networks struggle with logical reasoning, especially syllogisms.
method ENN represents logical relations as Euler diagrams, optimizing syllogism structures with a novel back-propagation algorithm.
result ENN can precisely represent and reason with all 24 syllogism structures.
MCLNN improves sound recognition by learning frequency bands.
problem Sound recognition from neural networks often misses environmental sound specifics.
method MCLNN incorporates filterbank behavior and automates feature combination exploration.
result MCLNN outperforms state-of-the-art methods on ESC-10 dataset.
This work formalizes and solves GNN extraction, a new type of attack.
problem Extracting the underlying model from a black-box GNN with API access.
method Formalizes GNN extraction, presents a solution with preliminary results.
result Preliminary results show the feasibility of GNN extraction.
Relational Graph Neural Networks improve fraud detection in Super-Apps.
problem Fraud detection in Super-Apps using alternative data.
method Relational Graph Convolutional Networks applied to heterogeneous graphs.
result Added value in fraud detection when considering alternative data and interactions.
A new complexity measure for neural networks improves upon classical methods.
problem Lack of a refined complexity measure for comparing different neural network architectures, especially permutation-invariant ones.
method Introduced an equivalence relation among linear functions and counted them relative to this relation.
result The new complexity measure clearly distinguishes between different models and increases exponentially with depth.
Study challenges neural models in compositional learning tasks.
problem Challenges in neural models for compositional and relational learning.
method Introduced ConceptWorld environment for generating images from compositional concepts, tested various neural architectures.
result Neural models struggle with longer compositional chains and substitutivity tests.
This paper presents a novel latent variable recurrent neural network architecture for jointly modeling sequences of words and (possibly latent) discourse relations between adjacent sentences. A recurrent neural network generates individual words, thus reaping the benefits of discriminatively-trained vector representati…
Graph Neural Networks (GNN) learn from graph data by sharing weights over vertices of different types.
problem Learning from graph data with relational structures.
method Revisit and generalize the Graph Neural Network (GNN) model by partitioning vertices into types.
result GNN generalizes many recent models and can assign embeddings to vertices, edges, and global graph attributes.
Paper analyzes neural network complexity for planning problems.
problem Understanding neural network complexity for planning policies.
method Circuit complexity analysis for relational neural networks.
result Three classes of planning problems identified based on network complexity.
Improved neural networks for relational reasoning by projecting high-dimensional data to low-dimensional manifolds.
problem Out-of-distribution generalization in complex relational reasoning tasks.
method Neuroscience-inspired inductive-biased module projecting high-dimensional object representations to low-dimensional manifolds.
result Significantly better out-of-distribution generalization performance on relational reasoning tasks.
This study approximates neural network features for modeling relations and attention mechanisms.
problem Approximating neural network features for modeling relations and attention mechanisms.
method Analyzes inner products of multi-layer perceptrons for universal approximation of symmetric and asymmetric relation functions.
result Universal approximation of relation functions and attention mechanisms using inner products of neural networks.
Automatically learns hierarchical soft concepts for LRNNs.
problem Lack of automated rule learning in LRNNs.
method Iterative top-down search through hypothesis space of Horn clauses.
result Automatically induced hierarchical soft concepts lead to deep LRNNs with competitive predictive power.
SRN improves set representations for relational reasoning.
problem Set permutational invariance limitations in existing approaches.
method Proposed a Set Refiner Network (SRN) to respect set invariance.
result Substantial gains in prediction performance and robustness on relational reasoning tasks.
Graph neural networks improve combinatorial optimization by leveraging inductive bias.
problem Combinatorial optimization problems often arise from related data distributions.
method Using graph neural networks to enhance or solve combinatorial tasks.
result Graph neural networks effectively encode combinatorial and relational input.
RWTNs improve NTN performance in SRL tasks.
problem Improving NTN performance in SRL tasks.
method Randomly weighted, untrained tensors in NTN encoder network.
result RWTNs outperform LTNs in SII tasks.
A new scaling calculus helps design and initialize ReLU networks more effectively.
problem Optimizing the design and initialization of ReLU neural networks.
method Proposes a scaling constant for neural network layers and weights, relating it to optimizability.
result A network with a uniform scaling constant is easier to train, and the geometric mean of fan-in and fan-out is a better initialization variance.
Graph Neural Network improves volatility forecasting for 500 S&P stocks.
problem Forecasting short-term realized volatility in a multivariate setting.
method Graph Transformer Network for Volatility Forecasting.
result Our model outperforms benchmarks on 500 S&P stocks.
Study variation spaces for neural networks, linking them to approximation theory.
problem Understanding the variation spaces of shallow neural networks.
method Examined variation spaces defined by convex hulls and integral representations for a dictionary of functions.
result Found that Barron space, spectral Barron space, and Radon BV space are variation spaces for certain neural networks.
New benchmarks improve model performance by accounting for isomorphism classes in multi-relational datasets.
problem Synthetic multi-relational datasets lack isomorphism class awareness, leading to overestimation of model performance.
method Proposed isomorphism-aware synthetic benchmarks and a prioritisation scheme to improve model performance and stability.
result Isomorphism classes can be utilised to improve model performance, stability during training, and reduce training time.
NLM combines neural networks and logic programming for complex reasoning.
problem Complex reasoning tasks involving logic and properties.
method Neural-symbolic architecture combining neural networks and logic programming.
result NLM achieves perfect generalization on various tasks.
Simulation and neural network analysis predict fiber laydown in spunbond processes.
problem Predicting fiber laydown quality in spunbond processes.
method Design of experiments, blocked neural network analysis.
result Prediction of fiber laydown characteristics and ranking of influencing effects.
Tail-GNNs improve protein function prediction using relational reinforcement.
problem Predicting hierarchical protein functions from sequence data.
method Combining Tail-GNNs with dilated convolutional networks for multi-task learning.
result Significant improvement in F_1 score for protein function prediction.
LSNN improves CNN by smoothing local receptive fields.
problem Limited capturing of local receptive fields in CNN.
method LSNN represents kernel and smoother to capture local fields' importance and relations.
result LSNN outperforms CNN and locally connected layer on MNIST variants.
This paper uses NARX neural networks for macroeconomic forecasting and goal setting.
problem Improving accuracy in macroeconomic forecasting and goal setting.
method Literature review and construction of specific NARX neural networks for macroeconomic indicators.
result NARX neural networks can be trained to make accurate predictions for macroeconomic indicators and national goals.
Neural networks struggle with abstract patterns, new RBP structures improve performance.
problem Neural networks fail to learn abstract patterns based on identity rules.
method Proposed Relation Based Pattern (RBP) extensions to neural network structures.
result Neural networks with RBP structures achieve perfect performance on synthetic and real-world sequence prediction tasks.
Paper proposes a neural network to improve traffic flow forecasting.
problem Forecasting future traffic flow distribution in an area.
method Position-aware convolutional neural network integrating data features and position information.
result Our approach outperforms previous methods even with fewer data sources.
Proposes JBNN for multi-label classification with improved efficiency and performance.
problem Multi-label classification with dependencies and heavy computational load.
method Joint Binary Neural Network (JBNN) that synchronously performs multiple binary classifications and captures label relations via joint binary cross entropy (JBCE) loss.
result Significantly better performance and computational efficiency compared to state-of-the-art methods.
HighwayGraph models long-distance node relations in GNNs with improved performance.
problem Limited-layer information propagation in GNNs hinders long-distance node relation modeling.
method Proposes two solutions: implicit and explicit modeling of long-distance node relations using shallow GNN architectures and a self-training framework.
result HighwayGraph achieves consistent and significant improvements over four GNNs on three benchmark datasets.