Anomaly detection plays an important role in modern data-driven security applications, such as detecting suspicious access to a socket from a process. In many cases, such events can be described as a collection of categorical values that are considered as entities of different types, which we call heterogeneous categor…
On-device research index
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
169,051 papers · 148 categories
Trend · papers per month
48 results for “Entity Detection”
Improved QA-RNN model with noun-tagging for better accuracy.
problem Improving accuracy of QA-RNN model for entity detection and relation prediction.
method Fine-tuned a 2-layer LSTM and GRU RNN models, removed non-noun words, and used 1-layer LSTM for entity detection.
result Achieved 0.984 accuracy on entity detection and 0.80 accuracy on relation prediction.
The article proposes an expert system for detection, and subsequent investigation, of groups of collaborating automobile insurance fraudsters. The system is described and examined in great detail, several technical difficulties in detecting fraud are also considered, for it to be applicable in practice. Opposed to many…
Paper detects review abuse using tensor decomposition.
problem Detecting review abuse by sellers and reviewers.
method Semi-supervised binary multi-target tensor decomposition.
result The model achieves higher precision and recall.
A system predicts future malicious behavior of network entities.
problem Prioritizing alert data and understanding attack recurrence.
method Machine learning-based network entity reputation database system.
result It is possible to precisely estimate future attack probabilities.
Model improves email-based conversational agents' ability to extract relevant information.
problem Asynchronous email communication makes it hard for agents to detect intents and extract relevant entities.
method Neural model for scoping relevant information from large queries.
result Improves performance of intent detection and entity extraction tasks by 35% in precision.
STANCE learns string similarity using optimal transport alignment.
problem Computing similarity between strings for record linkage and entity resolution.
method Character encoding, optimal transport alignment, convolutional neural network scoring.
result STANCE outperforms state-of-the-art models on alias detection datasets.
New method detects communities in hypergraphs by embedding them into a vector space.
problem Detecting communities in hypergraphs with multi-way interactions.
method Augmenting non-uniform hypergraphs, embedding into a vector space, using an alternative updating scheme.
result Asymptotic consistencies in community detection and hypergraph estimation established.
MedCAT extracts valuable medical information from unstructured text.
problem Extracting structured information from unstructured biomedical documents.
method Unsupervised machine learning for disambiguation of entities.
result Improved entity detection and linking compared to existing tools.
DeepTrax learns embeddings for financial transactions graphs.
problem Large and sparse bipartite graphs of financial transactions are hard to analyze.
method Graph representation learning to embed account and merchant entities into vectors.
result Effective embeddings for account and merchant entities, validated by link prediction metrics.
New approach detects and ranks novel and developing cyber threats in Twitter.
problem Detecting and ranking novel and developing cyber threats in Twitter streams.
method Unsupervised machine learning approach focusing on novelty and trendiness.
result Ranking of cyber threat events based on importance score using extracted terms.
New method detects overlapping communities in weighted graphs without pure nodes assumption.
problem Detect overlapping communities in weighted graphs without making pure nodes assumption.
method Convex optimization-based approach for weighted graphs.
result Success on artificial and real-world datasets.
The paper tackles uniform sampling from databases with duplicates.
problem Sampling uniformly from entities with duplicate records.
method Two-stage process: frequency estimation followed by rejection sampling.
result Efficient sampling algorithms under various data properties.
Deep neural networks detect cyberthreats from Twitter.
problem Scalable processing of cybersecurity information from social media.
method Convolutional and bidirectional LSTM networks for tweet classification and named entity recognition.
result Pipeline achieves high true positive and F1-score rates for threat detection.
Greek POS Tagger and Entity Recognizer built using spaCy.
problem Developing a machine learning model for Greek language POS tagging and named entity recognition.
method Machine learning approach with spaCy platform, focusing on morphological features and token classification.
result The Greek spaCy platform improved performance in part-of-speech tagging and named entity recognition.
Efficient autoregressive entity linking with correction for faster, more accurate results.
problem High computational cost and non-parallelizable decoding in autoregressive entity linking.
method Parallelizes autoregressive linking across all mentions, uses a shallow decoder, and adds a discriminative correction term.
result 70 times faster and more accurate than previous methods, outperforming state-of-the-art approaches.
In many applications that involve processing high-dimensional data, it is important to identify a small set of entities that account for a significant fraction of detections. Rather than formalize this as a clustering problem, in which all detections must be grouped into hard or soft categories, we formalize it as an i…
Same but Different: Distant Supervision for Predicting and Understanding Entity Linking Difficultycs.CL
Paper proposes a method to predict EL difficulty using consensus-based labels.
problem Challenges in automatically identifying and resolving ambiguous entity mentions.
method Consensus-based method to generate difficulty labels, supervised classification with various features.
result EL difficulty can be accurately predicted with high accuracy.
Bayesian approach for multifile record linkage and duplicate detection.
problem Challenges in merging overlapping datafiles with duplicates.
method Bayesian approach with novel partition representation and loss functions.
result Proposes a flexible prior for partitions and uncertain unresolved portions.
A wide variety of application domains are concerned with data consisting of entities and their relationships or connections, formally represented as graphs. Within these diverse application areas, a common problem of interest is the detection of a subset of entities whose connectivity is anomalous with respect to the r…
Efficiently estimates uncertainty for LLM-based entity linking in tabular data.
problem Accurate and reliable uncertainty estimates for LLM-based entity linking in tabular data.
method Self-supervised approach using token-level features for single-shot inference.
result Effective uncertainty estimates detected at a fraction of computational cost.
Detects and traces masterminds behind cryptocurrency pump-and-dump schemes.
problem Identifying and tracing the entities organizing cryptocurrency manipulation.
method Collects real-time data from social networks and cryptocurrency markets, constructs temporal attributed graphs, and uses GNN to identify masterminds.
result Achieves higher F1 scores and precision than state-of-the-art fraud detection methods, detects 438 masterminds.
Paper introduces a method to assess liquidity risk in meme tokens using entity-linked address analysis.
problem High market volatility and vulnerability to manipulation in meme tokens.
method Multi-dimensional approach integrating fund flow analysis, behavioral similarity, and anomalous transaction detection.
result Significant disparities between apparent and actual liquidity in meme token markets.
New framework detects outliers in non-IID categorical data.
problem Existing outlier detection methods fail in non-IID data.
method Value-value graph-based representation and outlierness propagation.
result Significant improvement in AUC on complex data sets.
While many models are purposed for detecting the occurrence of significant events in financial systems, the task of providing qualitative detail on the developments is not usually as well automated. We present a deep learning approach for detecting relevant discussion in text and extracting natural language description…
Discovering causal relations is fundamental to reasoning and intelligence. In particular, observational causal discovery algorithms estimate the cause-effect relation between two random entities and , given samples from . In this paper, we develop a framework to estimate the cause-effect relation bet…
Analyzes news graphs to predict financial market dislocations.
problem Predicting financial market dislocations using news content.
method Extracts entities from news articles, aggregates them into graphs, applies network analysis, and uses sentiment analysis.
result Identifies high entropy in news graphs correlates with financial market dislocations.
Given a collection of entities (or nodes) in a network and our intermittent observations of activities from each entity, an important problem is to learn the hidden edges depicting directional relationships among these entities. Here, we study causal relationships (excitations) that are realized by a multivariate Hawke…
Detects missing tensor signals in a KS subspace with high probability.
problem Detecting tensor signals with many missing entities in a KS subspace.
method Projecting the signal onto the KS subspace and bounding residual energy.
result Reliable detection is possible if the missing signal cardinality exceeds KS subspace dimensions.
Method quantifies relation similarity using entity pair distributions.
problem Measuring similarity between relations in knowledge bases.
method Simple neural network parameterizes conditional probability distributions over entity pairs. Sampling-based approximation for similarity computation.
result Approximation correlates with human judgments and detects redundant relations.
A model for entity relatedness considering time and context.
problem Time and context influence entity relatedness.
method Flexible model using time-aware and corpus-specific word embeddings.
result The model generates accurate entity relatedness lists.
A new system learns entity representations to improve local entity disambiguation.
problem Local entity disambiguation in text.
method Entity-ELMo (E-ELMo) approach for contextual entity representation.
result Outperforms state-of-the-art models by 0.5% on AIDA test-b.
GENRE retrieves entities autoregressively, improving efficiency and accuracy.
problem Retrieving entities from queries efficiently and accurately.
method Autoregressive generation of entity names, reducing memory footprint and improving context encoding.
result Significantly improved performance on entity disambiguation, linking, and retrieval tasks.
Improves biomedical entity linking with latent type modeling.
problem Lack of fine-grained type information for entity disambiguation.
method Jointly models entity disambiguation and latent type learning without direct supervision.
result Significant performance improvements over state-of-the-art techniques.
New method tests weighted networks without thresholding, improving accuracy.
problem Testing and anomaly detection on weighted network data.
method Hierarchical Bayesian hypothesis testing framework for weighted networks.
result Method shows lower Type I error and higher statistical power compared to alternatives.
Neural model for dynamic entity relatedness ranking.
problem Dynamic entity relationships in real-world applications.
method A neural network-based approach leveraging collective attention as supervision.
result Our model achieves better results than competitive baselines on large-scale datasets.
Community detection in multi-relational data with restricted multi-layer stochastic blockmodelstat.ML
In recent years there has been an increased interest in statistical analysis of data with multiple types of relations among a set of entities. Such multi-relational data can be represented as multi-layer graphs where the set of vertices represents the entities and multiple types of edges represent the different relatio…
Improves cross-lingual NER by projecting entities from one language to another.
problem Limited annotated corpora for named entity recognition in many languages.
method Uses machine translation twice: first for sentences, then for entities; matches based on ortho- and phonetic similarity; identifies matches using distributional statistics.
result Improves cross-lingual NER by an average of 4.1 points on 5 diverse languages.
Hungarian text processing improved with efficient, accurate NLP pipelines.
problem Improving text processing for Hungarian language.
method Implemented in spaCy framework, focusing on efficiency and accuracy.
result Near state-of-the-art performance in all text preprocessing steps.
LAD detects anomalies in dynamic graphs using Laplacian matrix.
problem Anomaly detection in temporal graphs for real-world applications.
method LAD uses the spectrum of the Laplacian matrix to model graph snapshots and temporal dependencies.
result LAD outperforms state-of-the-art methods in synthetic and real-world datasets.
Network detection is an important capability in many areas of applied research in which data can be represented as a graph of entities and relationships. Oftentimes the object of interest is a relatively small subgraph in an enormous, potentially uninteresting background. This aspect characterizes network detection as …
Enhances Ponzi scheme detection on Ethereum using time-aware metapaths.
problem Lack of temporal information in heterogeneous transaction graphs.
method Time-aware Metapath Feature Augmentation (TMFAug) module.
result Significant performance improvements in Ponzi scheme detection.
Survey on ML advances for personalized prediction considering entity characteristics.
problem Sub-optimal performance in personalized prediction due to heterogeneity in data across entities.
method Organized current literature on entity-aware modeling based on characteristics availability and training data amount.
result Recent innovations in uncertainty quantification, fairness, and knowledge-guided machine learning can improve entity-aware modeling.
Study introduces UEBA framework using Deep Autoencoders for anomaly detection.
problem Detecting security incidents in cybersecurity.
method Combines Deep Autoencoders with Doc2Vec for anomaly detection.
result Demonstrates effective detection of real and synthetic anomalies.
GUIDE detects anomalies in attributed networks by reconstructing node attributes and higher-order structures.
problem Lack of effective mechanisms for detecting anomalies in complex network interactions.
method GUIDE uses attribute and structure autoencoders, graph attention, and reconstruction errors to identify anomalies.
result GUIDE significantly outperforms state-of-the-art methods on multiple real-world datasets.
Neural production systems learn visual dynamics by applying rule templates to entities.
problem Modeling interactions among entities in structured visual environments.
method Inspired by production systems, the paper uses rule templates to bind placeholder variables to specific entities, scoring and applying the best fitting rules to update entity properties.
result The architecture achieves robust future-state prediction and extrapolation from simple to complex environments, outperforming GNNs.
Study benchmarks embedding-based entity alignment methods for KGs.
problem Align entities across different KGs using embeddings.
method Survey and categorize 23 embedding-based methods, propose new KG sampling algorithm, develop open-source library.
result Understood strengths and limitations of embedding-based methods.
Named-entity recognition (NER) aims at identifying entities of interest in a text. Artificial neural networks (ANNs) have recently been shown to outperform existing NER systems. However, ANNs remain challenging to use for non-expert users. In this paper, we present NeuroNER, an easy-to-use named-entity recognition tool…