Study benchmarks embedding-based entity alignment methods for KGs.
problem Align entities across different KGs using embeddings.
method Survey and categorize 23 embedding-based methods, propose new KG sampling algorithm, develop open-source library.
result Understood strengths and limitations of embedding-based methods.
Multi-label classification has received considerable interest in recent years. Multi-label classifiers have to address many problems including: handling large-scale datasets with many instances and a large set of labels, compensating missing label assignments in the training set, considering correlations between labels…
Embedding-based methods for knowledge base completion (KBC) learn representations of entities and relations in a vector space, along with the scoring function to estimate the likelihood of relations between entities. The learnable class of scoring functions is designed to be expressive enough to cover a variety of real…
New methods predict links in hypergraphs with multiple entities.
problem Link prediction in knowledge hypergraphs with non-binary relations.
method Introduce HSimplE and HypE embedding-based methods for hypergraphs.
result Proposed methods outperform baselines in hypergraph prediction.
Although nonstationary data are more common in the real world, most existing causal discovery methods do not take nonstationarity into consideration. In this letter, we propose a kernel embedding-based approach, ENCI, for nonstationary causal model inference where data are collected from multiple domains with varying d…
This paper proposes an embedding-based neural network for more accurate investment return prediction.
problem Accurately predicting investment returns requires understanding industry knowledge and news, as well as leveraging relevant theories.
method The approach uses embedding to encode investment IDs into low-dimensional vectors, leveraging dual branches to separate different information, and employs the swish activation function.
result The proposed embedding-based dual branch model outperforms traditional machine learning models like Xgboost, Lightgbm, and Catboost on the Ubiquant Market Prediction dataset.
GraIL predicts relations by reasoning over subgraphs, outperforming embeddings.
problem Relation prediction in knowledge graphs using latent representations is limited.
method Graph neural network with inductive bias to learn entity-independent relational semantics.
result GraIL outperforms existing rule-induction baselines in the inductive setting.
DeepLight accelerates CTR predictions in ad serving by 46X.
problem Significantly increased serving delay and high memory usage for ad serving.
method Explicitly searching feature interactions, pruning layers, promoting sparsity.
result Accelerates model inference by 46X on Criteo dataset.
Transformer models improve query-document retrieval efficiency and accuracy.
problem Efficiently retrieve relevant documents from large corpora for query matching.
method Designed paragraph-level pre-training tasks to optimize embedding-based Transformer models.
result Transformer models significantly outperform BM-25 and non-Transformer embedding models.
The reproducing kernel Hilbert space (RKHS) embedding of distributions offers a general and flexible framework for testing problems in arbitrary domains and has attracted considerable amount of attention in recent years. To gain insights into their operating characteristics, we study here the statistical performance of…
Paper proposes KE-GCN for better graph embedding.
problem Efficiently leveraging complex graphs with heterogeneous entities and relations.
method Combines GCNs and knowledge embedding methods.
result Advantages in knowledge graph alignment and entity classification.
The thesis introduces methods to use semantic hierarchy in image classification.
problem Limited work in training image classifiers with non-conventional external guidance.
method Injects label hierarchy knowledge into arbitrary classifiers and uses order-preserving embeddings for image classification.
result Both embedding-based models and CNN-classifiers with hierarchical information outperform a hierarchy-agnostic model.
LectureBank helps students find the right NLP course sequence.
problem Finding the right NLP course sequence for students with no background.
method Embedding-based method and neural graph-based networks to learn prerequisite relations.
result LectureBank dataset aids in educational and application purposes.
LOLA uses LLMs to optimize content delivery, outperforming traditional methods.
problem Identifying the most engaging headlines for user engagement.
method LOLA integrates LLMs with adaptive experimentation to optimize content delivery.
result LOLA outperforms traditional methods in optimizing user engagement.
This study compares 16 embedding-based link prediction methods for knowledge graphs.
problem KG incompleteness and missing facts prediction.
method Embedding-based link prediction methods compared.
result Effective and efficient comparison of 16 embedding-based LP methods.
Manifold learning and dimensionality reduction techniques are ubiquitous in science and engineering, but can be computationally expensive procedures when applied to large data sets or when similarities are expensive to compute. To date, little work has been done to investigate the tradeoff between computational resourc…
Link prediction is a popular research topic in network analysis. In the last few years, new techniques based on graph embedding have emerged as a powerful alternative to heuristics. In this article, we study the problem of systematic biases in the prediction, and show that some methods based on graph embedding offer le…
Sketch-GNN reduces GNN training time and memory usage to sublinear scales.
problem Training GNNs on large graphs is computationally expensive and memory-intensive.
method Develops a sketch-based algorithm that trains GNNs on compact sketches of graph adjacency and node embeddings.
result Training time and memory usage grow sublinearly with respect to graph size.
This paper compares hypernetworks and embedding methods for function approximation.
problem Learning to map inputs to functions efficiently for each instance.
method Compared embedding-based and hypernetwork methods using expressivity and complexity.
result Hypernetworks can be more efficient in terms of trainable parameters for certain functions.
Inferring user characteristics such as demographic attributes is of the utmost importance in many user-centric applications. Demographic data is an enabler of personalization, identity security, and other applications. Despite that, this data is sensitive and often hard to obtain. Previous work has shown that purchase …
We examine a class of embeddings based on structured random matrices with orthogonal rows which can be applied in many machine learning applications including dimensionality reduction and kernel approximation. For both the Johnson-Lindenstrauss transform and the angular kernel, we show that we can select matrices yield…
Advances deep network embedding through multi-filtering GCN.
problem Existing attribute embedding methods fail to capture different aspects of node features.
method Multi-filtering Graph Convolution Neural Network (GCN) framework.
result Significant improvement in link prediction and node classification tasks with limited training data.
OPORP combines permutation and random projection for efficient data vector compression.
problem Efficiently estimating cosine similarity in embedding-based retrieval applications.
method OPORP uses a permutation followed by a random vector dot product, then aggregates and normalizes the results into bins.
result OPORP improves the estimation of cosine similarity, reducing variance and improving accuracy.
Paper proposes a new word embedding method optimizing word similarity.
problem Optimizing word similarity in embedding space.
method Two-step random walks between words via topics to learn an optimal embedding simplex.
result Our method outperforms existing approaches in various queries.
Embedding-based Knowledge Base Completion models have so far mostly combined distributed representations of individual entities or relations to compute truth scores of missing links. Facts can however also be represented using pairwise embeddings, i.e. embeddings for pairs of entities and relations. In this paper we ex…
ExplaiNE offers explanations for NE-based link predictions.
problem Lack of transparency in NE methods for link prediction.
method Identifies counterfactual explanations for NE-based LP methods.
result Accuracy and scalability demonstrated for ExplaiNE.
MetaR learns few-shot link prediction in KGs by transferring relation-specific meta info.
problem Few-shot link prediction in KGs with limited associative triples.
method MetaR framework focusing on transferring relation-specific meta information.
result MetaR achieves state-of-the-art results on few-shot link prediction benchmarks.
Neural networks learn symbolic structure to perform compositional tasks.
problem How neural networks perform well on compositional tasks without explicit representations.
method ROLE analysis to uncover symbolic structure in recurrent neural networks.
result Neural networks converge to solutions that implicitly represent symbolic structure.
Sequence learning improves query expansion in information retrieval.
problem Improving query expansion in information retrieval systems.
method Used sequence to sequence algorithms to extract keywords from sentence embeddings and trained a neural network on open datasets.
result Sequence to sequence models can capture complex query expansion relations in word embeddings.
Representation learning has become an invaluable approach for learning from symbolic data such as text and graphs. However, while complex symbolic datasets often exhibit a latent hierarchical structure, state-of-the-art methods typically learn embeddings in Euclidean vector spaces, which do not account for this propert…
Byte-level machine translation outperforms embedding-based methods.
problem Improving machine translation without embedding layers.
method Replacing embedding layers with one-hot representations of bytes, and using decoder-input dropout.
result Byte-to-byte machine translation achieves BLEU scores comparable to character-level and subword-level models.
Knowledge graphs, on top of entities and their relationships, contain other important elements: literals. Literals encode interesting properties (e.g. the height) of entities that are not captured by links between entities alone. Most of the existing work on embedding (or latent feature) based knowledge graph analysis …
A new BO method tackles high-dimensional optimization without reconstruction.
problem Optimizing high-dimensional black-box functions is challenging, especially when low-dimensional structures are assumed.
method Tackles the problem in the original high-dimensional space using learned low-dimensional structure.
result Our method explores the high-dimensional space more effectively than existing approaches.
Proposes a framework to improve deep neural networks' robustness and generalization.
problem Vulnerability to adversarial attacks and difficulty in generalizing to novel images.
method Disentangled deep autoencoding regularization framework.
result Significantly improves robustness against adversarial attacks and generalization to novel test data.
News embeddings improve volatility forecasts.
problem Improving volatility forecasting accuracy.
method Transformed news text into embeddings, evaluated standalone and combined with benchmarks.
result News contains useful predictive information, especially for stock-related content.
MCE reduces embedding instability in nonlinear dimensionality reduction.
problem Embedding instability caused by random initialization.
method Median of multiple embeddings (MCE) based on large deviation theory.
result MCE achieves consistency at an exponential rate and effectively mitigates instability.
Estimator Vectors learns OOV word embeddings using subword and context clues.
problem Lack of OOV word representations in neural network models.
method Jointly learns word, subword, and context clue representations.
result Strong estimates for OOV words via combined subword and context clue embeddings.
Paper presents a novel neural network method for topic detection in micro-blogs.
problem Challenging topic detection without known topic count.
method Unsupervised neural sentence embedding model with attention mechanism.
result Improved clustering algorithm (RADBSCAN) discovers topics based on dataset character.
Unified model for reducing dimensions and clustering high-dimensional data.
problem High-dimensional data clustering and dimensionality reduction.
method Hierarchical mixtures of Gaussians (HMoGs) with closed-form likelihood and inference.
result Efficiently models hundreds of latent dimensions, improving clustering performance.
Most existing word embedding approaches do not distinguish the same words in different contexts, therefore ignoring their contextual meanings. As a result, the learned embeddings of these words are usually a mixture of multiple meanings. In this paper, we acknowledge multiple identities of the same word in different co…
A new method estimates rare failure events in complex systems.
problem Estimating the probability of rare failure events in non-linear systems.
method Stochastic Spectral Embedding (SSE) combined with modifications for efficient rare event estimation.
result Rare failure probability decomposed into conditional probabilities for easier computation.
PRODIGE maps data into weighted graphs for better representation learning.
problem Inadequate embedding space geometry leads to poor performance in machine learning.
method PRODIGE learns a weighted graph representation of data via gradient descent.
result PRODIGE outperforms existing embedding-based approaches in various tasks.
Linear encoding of sparse vectors is widely popular, but is commonly data-independent -- missing any possible extra (but a priori unknown) structure beyond sparsity. In this paper we present a new method to learn linear encoders that adapt to data, while still performing well with the widely used ℓ1 decoder. The …
A new method for federated learning with only positive labels.
problem Learning with only positive labels leads to poor classifier performance.
method Federated Averaging with Spreadout (FedAwS) framework.
result FedAwS can almost match the performance of conventional learning with negative labels.
A new method estimates multi-dimensional value distributions using Hilbert space embeddings.
problem Estimating value distributions in complex, multi-dimensional reinforcement learning settings.
method Hilbert space mappings and kernel mean embeddings to estimate the kernel mean embedding of multi-dimensional value distributions.
result Uniform convergence guarantees and robust off-policy evaluation demonstrated in simulations.
SELO model predicts link signs better than SDGNN using subgraph encoding and linear optimization.
problem Inferring the sign of links in signed networks with limited sign data.
method Subgraph Encoding via Linear Optimization (SELO) approach to learn edge embeddings.
result SELO model outperforms state-of-the-art methods on multiple real-world signed networks.
Proposes a new method for predicting missing relations in knowledge graphs.
problem Predicting missing relations between entities in knowledge graphs.
method Relational message passing method considering only edge features without entity IDs.
result PathCon method outperforms state-of-the-art methods significantly.
The paper uses a graph autoencoder to learn unbiased plant-pollinator interaction embeddings.
problem Sampling bias in citizen science data affects ecological network analysis.
method Bipartite graph variational autoencoder with HSIC for fairness.
result The method mitigates sampling bias and provides unbiased embeddings.