Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

169,291 papers · 148 categories

Trend · papers per month

123246368491 · Jun 202019922001200920182026
48 results for semantic analysis

Probabilistic Latent Semantic Analysis is a novel statistical technique for the analysis of two-mode and co-occurrence data, which has applications in information retrieval and filtering, natural language processing, machine learning from text, and in related areas. Compared to standard Latent Semantic Analysis which s…

2013-01-23abs ↗pdf ↗

SAM adds semantic attributes to language models for better interpretation and style variation.

problem Improving text interpretation and style variation in language models.
method SAM includes document attributes, scores them, and embeds them into the model's input space.
result SAM generates interpretable texts and shows superior performance on various datasets.

Top2Vec finds topic vectors from documents and words without needing stop words or custom settings.

problem Topic modeling weaknesses, including needing known topics, stop words, and custom settings.
method Joint document and word semantic embedding to find topic vectors automatically.
result Top2Vec finds more informative and representative topics than probabilistic models.

Unsupervised scheme ranks sentences in text documents based on semantic importance.

problem Ranking sentences in text documents without labeled data.
method Extracts essential words and phrases, constructs semantic phrase and sentence graphs, applies PageRank, combines scores, and optimizes for topic diversity.
result SSR outperforms individual judges and compares favorably with combined rankings on benchmarks.

This survey analyzes deep learning methods for real-time semantic image segmentation.

problem Efficient and accurate semantic image segmentation for real-time applications.
method Comprehensive analysis of deep learning architectures and techniques for fast inference.
result Best-performing architectures and techniques for real-time semantic image segmentation.

The human face constantly conveys information, both consciously and subconsciously. However, as basic as it is for humans to visually interpret this information, it is quite a big challenge for machines. Conventional semantic facial feature recognition and analysis techniques are already in use and are based on physiol…

2015-12-02abs ↗pdf ↗

Paper uses neural word embeddings to analyze UN speeches for policy preferences and voting behavior.

problem Analyzing policy preferences and paradigm shifts in international politics.
method Applied neural word embeddings (Word2vec) to UN General Debate speeches.
result Found statistical relation between speech semantic content and voting behavior, contrary to hypothesis.

In accessibility tests for digital preservation, over time we experience drifts of localized and labelled content in statistical models of evolving semantics represented as a vector field. This articulates the need to detect, measure, interpret and model outcomes of knowledge dynamics. To this end we employ a high-perf…

2016-08-03abs ↗pdf ↗

Sherlock uses deep learning to accurately detect data types from column headers.

problem Detecting accurate semantic types of data columns for data science tasks.
method Sherlock is a multi-input deep neural network trained on a corpus of 686,765 data columns.
result Sherlock achieves a support-weighted F1 score of 0.89, outperforming existing methods.

This study analyzes data science vocabulary changes over 13 years.

problem Understanding evolution of data science terms over time.
method Exploratory Data Analysis, Latent Semantic Analysis, Latent Dirichlet Analysis, N-grams Analysis.
result Identified new vocabulary and its incorporation into scientific literature.

This work shows how transformers use multi-concept word semantics for efficient in-context learning.

problem Understanding the connection between transformer-based LLMs' multi-concept semantic representation and their innovative in-context learning abilities.
method A concept-based low-noise sparse coding prompt model, leveraging advanced techniques to analyze the exponential convergence of 0-1 loss over non-convex training dynamics.
result Transformers leverage multi-concept word semantics to enable powerful and excellent out-of-distribution in-context learning.

Linear Discriminant Analysis (LDA) is a well-known method for dimensionality reduction and classification. Previous studies have also extended the binary-class case into multi-classes. However, many applications, such as object detection and keyframe extraction cannot provide consistent instance-label pairs, while LDA …

2013-09-21abs ↗pdf ↗

ST-STORM separates semantic and appearance features for robust representation learning.

problem Traditional SSL methods fail to capture appearance cues in critical applications.
method Hybrid SSL framework with two latent streams, Content and Style, disentangled through gating mechanisms.
result The Style branch effectively isolates complex appearance phenomena without degrading semantic performance.

The paper improves semantic interpolation in latent spaces of implicit models.

problem Interpolating between latent points in implicit models requires careful distributional matching.
method Proposes modifying the prior code distribution to concentrate more probability mass near the origin.
result Linear interpolation paths are shortest and pass through high-density regions, improving sample quality and semantics.

Qwant Research improves clinical case matching and information retrieval.

problem Matching and retrieving relevant clinical cases and discussions.
method Approach based on language models and preprocessings, information extraction system using neural networks and linguistic analysis.
result Very encouraging results in information extraction accuracy.

Paper proposes a new method to learn code semantics using an Intermediate Representation (IR) and embeddings.

problem Lack of robust methods to comprehend program semantics robustly.
method Defines an embedding space (inst2vec) based on IR of code, leveraging both data- and control-flow.
result A single RNN architecture and fixed inst2vec embeddings outperform specialized approaches on various tasks.

This paper presents the current state of a work in progress, whose objective is to better understand the effects of factors that significantly influence the performance of Latent Semantic Analysis (LSA). A difficult task, which consists in answering (French) biology Multiple Choice Questions, is used to test the semant…

2008-11-02abs ↗pdf ↗

Novel CNN-based gaze scanpath comparison distinguishes experts from novices in dental radiograph interpretation.

problem Distinguishing expertise in dental radiograph interpretation based on gaze behavior.
method Convolutional neural networks (CNN) process scene information at the fixation level, using image patches as input to compare gaze scanpaths.
result 93% accuracy in distinguishing experts from novices using image patch features.

Sparse Transformers degrade semantic information first, with early layers encoding more.

problem Understanding how sparse Transformers affect learned representations and semantic information.
method Probed Transformers with progressively pruned weights to observe changes in semantic information and model behavior.
result Complex semantic information is first to degrade in sparse Transformers, with early layers encoding more.

Coarse ground truth improves semantic segmentation accuracy for some classes.

problem Efficiently preparing high-quality datasets for autonomous driving.
method Comparative analysis of fine and coarse ground truth annotations on Cityscapes dataset using PSPNet.
result Coarse ground truth annotations can improve semantic segmentation accuracy for some classes without significant loss.

Proposes a graph-based text representation for improved sentiment analysis.

problem Lack of effective methods to encode semantic relations in textual data for sentiment analysis.
method Sentence-level graph-based text representation with deep neural network.
result Significantly outperforms existing sentiment analysis approaches on benchmark datasets.

This paper proposes synthetic augmentation for nuclei image segmentation in medical pathology.

problem Rare and time-consuming labeling of tumor nuclei images for semantic segmentation.
method Label-to-image translation to generate synthetic images.
result Synthetic augmentation improves segmentation accuracy.

Paper aims to bridge semantic gap between ML and InfoSec by labeling malware datasets with behavioral features.

problem Semantic gap between ML and InfoSec communities hinders ML's impact in InfoSec.
method Surveyed existing malware datasets and features, labeled with behavioral features using threat reports.
result Behavioral labeling alters analysis from intent to executable behavior, bridging semantic gap.

A new text clustering method using NMF and LSA improves stability and performance.

problem Text data's large, sparse term-document matrix makes clustering difficult.
method Proposes a new feature agglomeration method based on NMF and deterministic K-Means initialization.
result Significantly improves clustering performance and stability.

This paper detects function-level obfuscation in binary code using graph-based methods.

problem Detecting and characterizing function-level obfuscation in binary code.
method Graph-based approaches, including GNNs, are compared on various datasets.
result GNNs outperform baselines in function-level obfuscation detection, especially in a 11-class classification task.

Semantic TrueLearn uses semantic graphs to improve educational recommendation systems.

problem Challenges in handling semantic and hierarchical structure in knowledge areas.
method Introduces a novel learner model that exploits semantic relatedness between knowledge components using a Wikipedia link graph.
result Achieves statistically significant improvements in predictive performance for educational engagement.

An increasing number of people are using online social networking services (SNSs), and a significant amount of information related to experiences in consumption is shared in this new media form. Text mining is an emerging technique for mining useful information from the web. We aim at discovering in particular tweets s…

2016-03-24abs ↗pdf ↗

CAggNet improves medical image segmentation by fusing coarse and fine features.

problem Medical image segmentation accuracy and efficiency.
method Crossing Aggregation Network with nested skip connections and weighted aggregation.
result CAggNet achieves more accurate and efficient segmentation compared to existing methods.

IdBench benchmarks semantic representations of identifiers, revealing strengths and weaknesses.

problem Evaluating semantic representations of identifiers in source code.
method Created a benchmark using developer ratings, evaluated natural language and source code embeddings, and compared lexical string distance functions.
result No single technique provides a satisfactory representation of semantic similarities, but ensemble models can improve performance.

SEMASIA provides a large dataset of latent representations for model comparison.

problem Difficulty in comparing semantic structures across different neural network models.
method Collection of latent representations from 1700 pretrained models across various benchmarks.
result Consistent semantic organization across models and datasets.