Mathematical theory explains neural network semantic development.
problem Understanding how neural networks acquire and organize abstract knowledge.
method Mathematical analysis of deep linear networks.
result Exact solutions reveal principles of semantic development.
IdBench benchmarks semantic representations of identifiers, revealing strengths and weaknesses.
problem Evaluating semantic representations of identifiers in source code.
method Created a benchmark using developer ratings, evaluated natural language and source code embeddings, and compared lexical string distance functions.
result No single technique provides a satisfactory representation of semantic similarities, but ensemble models can improve performance.
Paper improves robustness of semantic segmentation models.
problem Improving robustness of semantic segmentation models for safer interactions.
method Analyzes and corrects softmax function mappings to improve model robustness.
result Improves robustness with minimal performance impact and code changes.
CoNCRA uses CNN to find code snippets matching developer intent.
problem Finding relevant code snippets using general search engines.
method Convolutional Neural Network approach to code retrieval.
result Improved code retrieval by 5% on average, top 3 positions 80% of the time.
Proposes CSG model to separate semantic and variation factors for OOD prediction.
problem Out-of-distribution examples cause conventional models to mix semantic and variation factors, leading to poor performance.
method Causal Semantic Generative model (CSG) based on causal reasoning, using variational Bayes for efficient learning and prediction.
result CSG can identify semantic factor and improve OOD prediction performance.
New algorithms improve semantic similarity in mobile datasets by incorporating context.
problem Traditional models fail to capture external context in mobile datasets.
method Developed new algorithms to integrate external features into sentence embeddings and semantic similarity scores.
result Applying PCA with eight components and appending multimodal features improves semantic understanding in tweets.
In iterative supervised learning algorithms it is common to reach a point in the search where no further induction seems to be possible with the available data. If the search is continued beyond this point, the risk of overfitting increases significantly. Following the recent developments in inductive semantic stochast…
We develop a method for user-controllable semantic image inpainting: Given an arbitrary set of observed pixels, the unobserved pixels can be imputed in a user-controllable range of possibilities, each of which is semantically coherent and locally consistent with the observed pixels. We achieve this using a deep generat…
System identifies health risks using semantic and machine learning.
problem Identifying risk factors associated with health conditions in subpopulations.
method Developed a combined semantic and machine learning system using a health risk ontology and knowledge graph.
result Dynamic discovery of risk factors and their subpopulations.
The paper teaches robots to navigate by learning costs from expert demonstrations.
problem Teaching robots to navigate autonomously using only expert observations.
method Developed a map encoder and cost encoder to infer semantic class probabilities and a cost function from expert observations.
result Robots can learn to follow traffic rules in a simulator using only semantic observations.
Techniques for data-mining, latent semantic analysis, contextual search of databases, etc. have long ago been developed by computer scientists working on information retrieval (IR). Experimental scientists, from all disciplines, having to analyse large collections of raw experimental data (astronomical, physical, biolo…
New framework aligns latent representations over-the-air using intelligent metasurfaces.
problem Heterogeneous transmitter-receiver models produce misaligned latent representations in semantic communication.
method Intelligent metasurfaces (SIM) emulate supervised and zero-shot semantic aligners directly in the wave domain.
result SIMs achieve up to 90% task accuracy in high SNR regimes, robust to low SNR.
GASC models semantic change in Ancient Greek texts using genre metadata.
problem Associating correct meanings in historical Ancient Greek texts.
method Develops a dynamic semantic change model leveraging genre metadata.
result Improves predictive performance on semantic change in Ancient Greek texts.
The paper explains how continuous language models can produce discrete, interpretable meanings.
problem Semantic collapse in continuous systems of large language models.
method Formalizing large language models as Continuous State Machines (CSMs) and analyzing the associated transfer operator.
result The leading eigenfunctions of the transfer operator induce a finite number of invariant meaning basins, explaining how continuous computation can produce discrete, interpretable semantics.
Paper proposes a weak supervision technique for CNN semantic segmentation of lung diseases using partially annotated data.
problem Creating annotated datasets for semantic segmentation of lung diseases is laborious and time-consuming.
method Proposes a weak supervision technique that utilizes partially annotated datasets to improve CNN semantic segmentation accuracy.
result Significantly improved segmentation accuracy using partially annotated datasets.
Paper develops a framework for generating coherent image captions using visual features and hierarchical topics.
problem Generating semantically coherent paragraphs to describe image content.
method Plug-and-play hierarchical-topic-guided image paragraph generation framework integrating visual extractor and deep topic model.
result Proposed models can distill interpretable multi-layer semantic topics and generate diverse and coherent captions.
The paper explores how semantic independence can be captured in text embeddings using partial orthogonality.
problem Capturing semantic independence in text embeddings.
method Developed a theory and methods based on partial orthogonality to demonstrate semantic independence.
result Partial orthogonality captures semantic independence in text embeddings.
This survey analyzes deep learning methods for real-time semantic image segmentation.
problem Efficient and accurate semantic image segmentation for real-time applications.
method Comprehensive analysis of deep learning architectures and techniques for fast inference.
result Best-performing architectures and techniques for real-time semantic image segmentation.
Algorithm adapts pretrained semantic segmentation models to new domains.
problem Adapting pretrained models to new, unlabeled domains without source data.
method Learn prototypical distribution in embedding space, align target domain with source domain.
result Method achieves competitive performance on benchmark tasks.
Import2vec creates embeddings for software libraries to improve learning tasks.
problem Developing semantic representations for software libraries.
method Applied word embedding techniques from NLP to library packages.
result Library vectors capture meaningful relationships among libraries.
The paper explores how AI systems use information geometry to encode semantic structure.
problem How AI systems encode semantic structure into geometric representation spaces.
method Focuses on softmax distributions and develops dual steering method for robust concept manipulation.
result Dual steering optimally modifies target concepts while minimizing off-target changes.
Many methods have been proposed for detecting emerging events in text streams using topic modeling. However, these methods have shortcomings that make them unsuitable for rapid detection of locally emerging events on massive text streams. We describe Spatially Compact Semantic Scan (SCSS) that has been developed specif…
Proposes a multi-modal attention network for better stock price prediction.
problem Predicting future stock movements using historical records and social media.
method Extracts semantic information from social media, estimates credibility, and integrates with numeric features.
result Significantly improved prediction accuracy and trading profits compared to previous methods.
Model improves BERT for answering multiple-choice questions in large texts.
problem Improving machine comprehension of large text corpora for question answering.
method Developed a model using BERT with a semantic similarity attention layer to extract key sentences.
result Outperforms leading models in MovieQA challenge with 87.79% test accuracy.
Unified theory explains how data augmentation improves deep learning models.
problem Understanding why data augmentation improves model generalization.
method Unified theoretical framework explaining two key effects: partial semantic feature removal and feature mixing.
result Data augmentation enhances generalization through partial semantic feature removal and feature mixing.
The use of robo-readers to analyze news texts is an emerging technology trend in computational finance. In recent research, a substantial effort has been invested to develop sophisticated financial polarity-lexicons that can be used to investigate how financial sentiments relate to future company performance. However, …
Paper develops a new unsupervised scoring function for cross-lingual document alignment.
problem Aligning documents across different languages for NLP tasks.
method Uses cross-lingual sentence embeddings to compute semantic distances and guides document alignment.
result The proposed scoring function outperforms current methods by 7-22% on various language pairs.
Enhances machine learning interpretability using category theory.
problem Improving machine learning interpretability and social implementation.
method Develops a categorical framework for structured understanding of supervised learning.
result Introduces the Gauss-Markov Adjunction for clarifying residuals and parameters.
Convolutional Neural Networks (CNNs) are propelling advances in a range of different computer vision tasks such as object detection and object segmentation. Their success has motivated research in applications of such models for medical image analysis. If CNN-based models are to be helpful in a medical context, they ne…
The objective of this paper is to define an effective strategy for building an ensemble of Genetic Programming (GP) models. Ensemble methods are widely used in machine learning due to their features: they average out biases, they reduce the variance and they usually generalize better than single models. Despite these a…
Develops a power-calibrated framework for LLM watermarking, optimizing tradeoffs between detectability and distortion.
problem The trade-off between detectability and semantic distortion in logit-based watermarking.
method Power-calibrated statistical framework for watermark hyperparameters, establishing explicit relationships.
result Derives practical parameter selection procedures achieving optimal tradeoffs under constraints.
Early detection and precise characterization of emerging topics in text streams can be highly useful in applications such as timely and targeted public health interventions and discovering evolving regional business trends. Many methods have been proposed for detecting emerging events in text streams using topic modeli…
The paper proposes a method of financial time series forecasting taking into account the semantics of news. For the semantic analysis of financial news the sampling of negative and positive words in economic sense was formed based on Loughran McDonald Master Dictionary. The sampling included the words with high frequen…
DKPCA improves WSD accuracy with scarce labeled data.
problem Word sense disambiguation in natural language processing.
method DKPCA combines Kernel PCA and Semantic Diffusion Kernel.
result DKPCA outperforms SVM and KPCA on SensEval data.
Deep learning is currently the subject of intensive study. However, fundamental concepts such as representations are not formally defined -- researchers "know them when they see them" -- and there is no common language for describing and analyzing algorithms. This essay proposes an abstract framework that identifies th…
Semantic TrueLearn uses semantic graphs to improve educational recommendation systems.
problem Challenges in handling semantic and hierarchical structure in knowledge areas.
method Introduces a novel learner model that exploits semantic relatedness between knowledge components using a Wikipedia link graph.
result Achieves statistically significant improvements in predictive performance for educational engagement.
Word evolution refers to the changing meanings and associations of words throughout time, as a byproduct of human language evolution. By studying word evolution, we can infer social trends and language constructs over different periods of human history. However, traditional techniques such as word representation learni…
Word2Vec embedding for Italian language developed.
problem Lack of word embedding for Italian language.
method Parameter tuning of Word2Vec for Italian language.
result An embedding for Italian language created.
Enhances transfer learning with semantic reasoning for robust predictions.
problem Improving robustness of transfer learning models.
method Integrates semantic representations for better knowledge transfer.
result Demonstrated robustness in bus delay and air quality forecasting.
SEMASIA provides a large dataset of latent representations for model comparison.
problem Difficulty in comparing semantic structures across different neural network models.
method Collection of latent representations from 1700 pretrained models across various benchmarks.
result Consistent semantic organization across models and datasets.
SemGANs generate pixel-level accurate semantic images.
problem Generating semantic images with pixel-level accuracy.
method Semantic Generative Adversarial Networks (SemGANs).
result SemGANs outperform standard GANs in semantic image generation tasks.
Proposes a new RNN for language generation capturing long-range dependencies.
problem Capturing long-range word dependencies and sentence order in text corpora.
method Recurrent Hierarchical Topic-Guided RNN with dynamic deep topic model.
result Outperforms larger-context RNN-based language models and learns interpretable topics.
This paper develops a novel methodology for using symbolic knowledge in deep learning. From first principles, we derive a semantic loss function that bridges between neural output vectors and logical constraints. This loss function captures how close the neural network is to satisfying the constraints on its output. An…
KiTS19 dataset offers 300 kidney tumor cases with CT data and outcomes.
problem Difficulty in quantifying kidney tumor morphometry due to data scarcity and manual labor.
method Presented KiTS19 dataset with multi-phase CT imaging, segmentation masks, and clinical outcomes.
result Automated segmentation of kidney tumors is now possible with this dataset.
Graph-RISE learns image embeddings for ultra-fine-grained semantics.
problem Learning image representations for fine-grained semantics.
method Graph-regularized neural graph learning framework.
result Graph-RISE outperforms state-of-the-art on image classification and triplet ranking.
Low-dimensional vectors improve semantic understanding of music and language.
problem Noise in shared semantics due to individual brain biases.
method Jointly model multiple brains to learn low-dimensional vector embeddings.
result These embeddings outperform high-dimensional fMRI data in music and language classification.
This paper presents a Semantic Attribute Modulation (SAM) for language modeling and style variation. The semantic attribute modulation includes various document attributes, such as titles, authors, and document categories. We consider two types of attributes, (title attributes and category attributes), and a flexible a…
The paper shows how integrating categorical semantics can enhance unsupervised domain translation.
problem Improving unsupervised domain translation between perceptually different domains.
method Learning invariant categorical semantic features in an unsupervised manner and conditioning them on the style encoder.
result Conditioning the style encoder on learned categorical semantics improves translation and stylization.