Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

169,051 papers · 148 categories

Trend · papers per month

66133199265 · Jun 202019922001200920172026
48 results for semantic relations

Service robots learn new tasks more efficiently with ISI, improving query performance and reducing training time.

problem Incremental learning of semantic concepts in multi-relational embeddings for service robots.
method Incremental Semantic Initialization (ISI) that allows new semantic concepts to be initialized in relation to previously learned embeddings.
result ISI improves immediate query performance by 41.4% and reduces the number of epochs to approach model convergence by 78.2%.

Paper tackles zero-shot learning for semantic image interpretation.

problem Extracting structured semantic descriptions from images requires complete training sets, which are often unavailable.
method Uses Logic Tensor Networks to leverage logical constraints and similarities among relationships in the training set.
result Background knowledge can alleviate the incompleteness of training sets, improving zero-shot learning performance.

Semantic TrueLearn uses semantic graphs to improve educational recommendation systems.

problem Challenges in handling semantic and hierarchical structure in knowledge areas.
method Introduces a novel learner model that exploits semantic relatedness between knowledge components using a Wikipedia link graph.
result Achieves statistically significant improvements in predictive performance for educational engagement.

We discuss memory models which are based on tensor decompositions using latent representations of entities and events. We show how episodic memory and semantic memory can be realized and discuss how new memory traces can be generated from sensory input: Existing memories are the basis for perception and new memories ar…

2017-08-09abs ↗pdf ↗

This paper proposes the continuous semantic topic embedding model (CSTEM) which finds latent topic variables in documents using continuous semantic distance function between the topics and the words by means of the variational autoencoder(VAE). The semantic distance could be represented by any symmetric bell-shaped geo…

2017-11-24abs ↗pdf ↗

The abstract explains how word and relation representations capture semantic meaning.

problem Understanding how word and relation representations capture semantic meaning.
method Theoretical justification and extension of geometric relationships between word embeddings and knowledge graph representations.
result The geometric relationships between word embeddings correspond to semantic relations between words and entities in knowledge graphs.

Motivation: The rapid growth of diverse biological data allows us to consider interactions between a variety of objects, such as genes, chemicals, molecular signatures, diseases, pathways and environmental exposures. Often, any pair of objects--such as a gene and a disease--can be related in different ways, for example…

2017-08-10abs ↗pdf ↗

The study categorizes knowledge graph relations and explains their embedding representations.

problem Understanding how knowledge graph relation representations capture semantic information.
method Categorizing knowledge graph relations into three types and deriving explicit requirements for their representations.
result Empirical properties of relation representations and the performance of methods are justified by the analysis.

The paper uses differentiable rendering to generate semantic counterexamples for improving neural network robustness.

problem Neural networks' brittleness to semantic transformations.
method Differentiable rendering for generating realistic images that model semantic changes, combined with adversarial machine learning attacks.
result Semantic counterexamples improve generalization, robustness, and transferability of neural networks.

It is very useful to integrate human knowledge and experience into traditional neural networks for faster learning speed, fewer training samples and better interpretability. However, due to the obscured and indescribable black box model of neural networks, it is very difficult to design its architecture, interpret its …

2018-09-29abs ↗pdf ↗

Probabilistic Latent Semantic Analysis is a novel statistical technique for the analysis of two-mode and co-occurrence data, which has applications in information retrieval and filtering, natural language processing, machine learning from text, and in related areas. Compared to standard Latent Semantic Analysis which s…

2013-01-23abs ↗pdf ↗

The paper tests deep music embeddings for semantic consistency.

problem Ensuring deep music embeddings capture meaningful musical semantics.
method Proposes a systematic method to test deep music representations for semantic consistency, considering both input audio space and latent deep space.
result Distance consistency between related points is maintained in both input audio space and latent deep space.

Proposes a graph-based text representation for improved sentiment analysis.

problem Lack of effective methods to encode semantic relations in textual data for sentiment analysis.
method Sentence-level graph-based text representation with deep neural network.
result Significantly outperforms existing sentiment analysis approaches on benchmark datasets.

Proposes a novel framework for multi-label text classification.

problem Lack of coherent consideration of non-consecutive and long-distance semantics and hierarchical relations among labels.
method Hierarchical taxonomy-aware and attentional graph capsule recurrent CNNs framework.
result Significantly improves multi-label text classification performance.

SemSentSum uses embeddings to link facts across documents efficiently.

problem Linking facts across documents is challenging due to language variability.
method Develops SemSentSum, a fully data-driven model using universal and domain-specific sentence embeddings to build a semantic relation graph.
result SemSentSum achieves competitive results on multi-document summarization tasks.

This work benchmarks neural embeddings for link prediction in evolving knowledge graphs.

problem Evaluating the robustness of neural embeddings in changing knowledge graphs.
method Proposes an open-source evaluation pipeline using relation-centric connectivity measures.
result Demonstrates the importance of simulating embedding accuracy for frequently updated knowledge graphs.

HAKE embeds entities in polar coordinates to model semantic hierarchies in knowledge graphs.

problem Lack of modeling semantic hierarchies in knowledge graph embeddings.
method HAKE embeds entities in a polar coordinate system, where the radial coordinate represents hierarchy levels and the angular coordinate distinguishes entities at the same level.
result HAKE significantly outperforms existing methods on link prediction tasks in knowledge graphs.

TCT learns multimodal sequence representations by translating from related sequences.

problem Challenges in learning semantic representations from multimodalities.
method Transformer based Cross-modal Translator (TCT) combined with Multimodal Transformer Network (MTN).
result Proposed method achieves new state-of-the-art performance on video-grounded dialogue.

The human face constantly conveys information, both consciously and subconsciously. However, as basic as it is for humans to visually interpret this information, it is quite a big challenge for machines. Conventional semantic facial feature recognition and analysis techniques are already in use and are based on physiol…

2015-12-02abs ↗pdf ↗

New approach decouples skill learning and language grounding for autonomous agents.

problem Autonomous acquisition of skills without external instructions and feedback.
method Language-Goal-Behavior (LGB) architecture with semantic representation.
result Decouples skill learning and language grounding, enabling diversity and strategy switching.

Enhances uncertainty estimation in medical image segmentation.

problem Frequency-related noise in medical imaging leads to biased uncertainty estimates.
method Extends MC-Dropout to the frequency domain for better uncertainty estimation.
result MC-Frequency Dropout improves calibration and uncertainty in semantic segmentation.

Continuous vector representations of words and objects appear to carry surprisingly rich semantic content. In this paper, we advance both the conceptual and theoretical understanding of word embeddings in three ways. First, we ground embeddings in semantic spaces studied in cognitive-psychometric literature and introdu…

2015-09-18abs ↗pdf ↗

An increasing number of people are using online social networking services (SNSs), and a significant amount of information related to experiences in consumption is shared in this new media form. Text mining is an emerging technique for mining useful information from the web. We aim at discovering in particular tweets s…

2016-03-24abs ↗pdf ↗

In this paper we present a unified framework for modeling multi-relational representations, scoring, and learning, and conduct an empirical study of several recent multi-relational embedding models under the framework. We investigate the different choices of relation operators based on linear and bilinear transformatio…

2014-11-14abs ↗pdf ↗

SEMASIA provides a large dataset of latent representations for model comparison.

problem Difficulty in comparing semantic structures across different neural network models.
method Collection of latent representations from 1700 pretrained models across various benchmarks.
result Consistent semantic organization across models and datasets.

Even in the absence of any explicit semantic annotation, vast collections of audio recordings provide valuable information for learning the categorical structure of sounds. We consider several class-agnostic semantic constraints that apply to unlabeled nonspeech audio: (i) noise and translations in time do not change t…

2017-11-06abs ↗pdf ↗

We seek to better understand the difference in quality of the several publicly released embeddings. We propose several tasks that help to distinguish the characteristics of different embeddings. Our evaluation of sentiment polarity and synonym/antonym relations shows that embeddings are able to capture surprisingly nua…

2013-01-15abs ↗pdf ↗

IdBench benchmarks semantic representations of identifiers, revealing strengths and weaknesses.

problem Evaluating semantic representations of identifiers in source code.
method Created a benchmark using developer ratings, evaluated natural language and source code embeddings, and compared lexical string distance functions.
result No single technique provides a satisfactory representation of semantic similarities, but ensemble models can improve performance.

In the field of Natural Language Processing (NLP), we revisit the well-known word embedding algorithm word2vec. Word embeddings identify words by vectors such that the words' distributional similarity is captured. Unexpectedly, besides semantic similarity even relational similarity has been shown to be captured in word…

2018-06-20abs ↗pdf ↗