This article reviews datasets for COVID-19 detection using ML.
problem Lack of accessible datasets for COVID-19 detection research.
method Analyzed 96 papers on COVID-19 detection from January 2020 to June 2020.
result Identified and summarized datasets used in COVID-19 detection studies.
Paper proves mathematically that poisoning datasets can be detected.
problem Detecting data poisoning attacks in datasets.
method Mathematical definition and Conformal Separability Test.
result Dataset poisoning can be effectively detected.
Study examines how discretization affects anomaly detection in datasets.
problem Detecting six types of anomalies in datasets using different discretization methods.
method Conducted experiments with SECODA, a general-purpose algorithm for unsupervised anomaly detection.
result Different discretization methods favor the discovery of certain anomaly types.
Paper proposes a new dataset for group anomaly detection in physics.
problem Group anomaly detection in physics.
method Development of a synthetic benchmark dataset and comparison of anomaly detection techniques.
result Demonstrated performance of anomaly detection techniques on the new dataset.
Enhances anomaly detection using multiple reference datasets.
problem Lack of performance with multiple reference datasets.
method Generalizes existing techniques CWoLa and SALAD for multiple reference datasets.
result Improved performance across various settings.
ARIMA model detects credit card fraud in unbalanced datasets.
problem Unsupervised credit card fraud detection in unbalanced datasets.
method ARIMA model applied to customer spending patterns for anomaly detection.
result ARIMA model outperforms benchmark anomaly detection methods.
Paper introduces a fraud detection dataset benchmark.
problem Unique challenges in fraud detection datasets.
method Compilation of publicly available fraud datasets.
result Demonstrates applications of the Fraud Dataset Benchmark.
Unsupervised method detects earthquakes from raw waveforms, generalizing across datasets.
problem Lack of labeled data for earthquake detection.
method Uses deep autoencoders with cross-covariance triggering at bottleneck.
result Performance comparable to supervised methods, with strong cross-dataset generalization.
CHAODA detects anomalies in high-dimensional data.
problem Anomaly detection in high-dimensional spaces.
method Hierarchical clustering, manifold mapping, transfer learning.
result CHAODA outperforms other algorithms on 16 out of 18 datasets.
Capsule networks improve anomaly detection in high-dimensional datasets.
problem Anomaly detection in high-dimensional, class-imbalanced datasets.
method Used a capsule network architecture with autoencoder pre-training and dynamic routing.
result Capsule network outperformed other models in anomaly detection.
Outlier detection is a fundamental task in data mining and has many applications including detecting errors in databases. While there has been extensive prior work on methods for outlier detection, modern datasets often have sizes that are beyond the ability of commonly used methods to process the data within a reasona…
Fake engagement is one of the significant problems in Online Social Networks (OSNs) which is used to increase the popularity of an account in an inorganic manner. The detection of fake engagement is crucial because it leads to loss of money for businesses, wrong audience targeting in advertising, wrong product predicti…
GWHD dataset offers 4,700 high-res images of wheat heads.
problem Challenges in wheat head detection from high-resolution imagery.
method Large, diverse dataset with detailed metadata.
result Benchmark for wheat head detection methods.
This paper proposes a real-time embedded fall detection system using a DVS(Dynamic Vision Sensor) that has never been used for traditional fall detection, a dataset for fall detection using that, and a DVS-TN(DVS-Temporal Network). The first contribution is building a DVS Falls Dataset, which made our network to recogn…
Machine learning and data mining techniques have been used extensively in order to detect credit card frauds. However purchase behaviour and fraudster strategies may change over time. This phenomenon is named dataset shift or concept drift in the domain of fraud detection. In this paper, we present a method to quantify…
Deep Autoencoder outperforms in anomaly detection for building energy data.
problem Automated detection of faulty data in learning applications.
method Training and comparison of Simple, Deep, and Supervised Deep Autoencoders on ASHRAE building energy dataset.
result Supervised Deep Autoencoder outperforms in total anomalies detected.
Advances in sensor technology have enabled the collection of large-scale datasets. Such datasets can be extremely noisy and often contain a significant amount of outliers that result from sensor malfunction or human operation faults. In order to utilize such data for real-world applications, it is critical to detect ou…
EHBOS enhances HBOS by capturing feature interactions, improving anomaly detection.
problem Limited ability of HBOS to detect anomalies in datasets with feature interactions.
method Incorporates two-dimensional histograms to capture feature pair dependencies.
result EHBOS outperforms HBOS on datasets with critical feature interactions, achieving notable improvements in ROC AUC.
Two novel dataset optimization strategies improve malware traffic detection accuracy.
problem Redundant and irrelevant information in network traffic datasets increases computational cost and noise.
method Feature selection and dimensional reduction techniques using mutual information and autoencoders.
result Optimized dataset leads to improved accuracy of Multi Layer Perceptron for malware detection.
Proposes a novel Out-of-Bag anomaly detection method for ML systems.
problem Challenges of detecting data anomalies in real-world datasets.
method Model-based approach decomposing unsupervised problem into ensemble models using Out-of-Bag estimates.
result Demonstrates state-of-the-art performance and improved accuracy in ML systems.
Anomaly detection is challenging, especially for large datasets in high dimensions. Here we explore a general anomaly detection framework based on dimensionality reduction and unsupervised clustering. We release DRAMA, a general python package that implements the general framework with a wide range of built-in options.…
Automates OD model selection via meta-learning.
problem Selecting effective OD models for new datasets.
method Meta-learning approach based on past model performances.
result MetaOD selects models significantly outperforming existing methods.
Deep learning improves community detection in graph datasets.
problem Community detection in graph datasets using deep learning.
method Proposes a deep learning approach using Gumbel Softmax for clustering graph nodes.
result The new approach significantly outperforms traditional clustering methods.
New outlier detection method using graph Laplacian spectrum boosts performance.
problem Detecting outliers in large datasets efficiently.
method Boosted outlier detection based on graph Laplacian spectrum.
result Outperforms existing methods on synthetic datasets.
Paper proposes a framework to detect distribution shifts using embedding space geometry.
problem Detecting distribution shifts in candidate datasets to improve model generalizability.
method Non-parametric framework using embedding space geometry for two tests: robustness boundary and in-distribution/out-of-distribution classification.
result Both tests successfully detect distribution shifts in various scenarios for both synthetic and real-world datasets.
Robust detection and tracking of objects is crucial for the deployment of autonomous vehicle technology. Image based benchmark datasets have driven development in computer vision tasks such as object detection, tracking and segmentation of agents in the environment. Most autonomous vehicles, however, carry a combinatio…
A novel approach ODAR detects outliers for clustering.
problem Outliers interfere with clustering algorithms, leading to unreliable results.
method Feature transformation to separate outliers and normal objects into distinct clusters.
result ODAR improves clustering accuracy on 7 out of 10 datasets.
Outlier detection has received special attention in various fields, mainly for those dealing with machine learning and artificial intelligence. As strong outliers, anomalies are divided into the point, contextual and collective outliers. The most important challenges in outlier detection include the thin boundary betwe…
KOD detects outliers in high-dimensional data.
problem Challenges in outlier detection in high-dimensional settings.
method Kernel transformation followed by projection pursuit approach with ensemble of directions and result combination.
result Empirical evaluations show effectiveness on various datasets.
Paper presents a novel neural network method for topic detection in micro-blogs.
problem Challenging topic detection without known topic count.
method Unsupervised neural sentence embedding model with attention mechanism.
result Improved clustering algorithm (RADBSCAN) discovers topics based on dataset character.
A drift detection method for large datasets without labels.
problem Early detection of concept drift in large, unlabeled datasets.
method Classical statistical process control in a label-less setting.
result Better statistical power than previous methods under computational constraints.
Paper proposes TBSD for efficient anomaly detection in textured images.
problem Challenges in anomaly detection for textured images, especially in manufacturing systems.
method Texture basis integrated smooth decomposition (TBSD) approach.
result TBSD surpasses benchmarks with less misidentification and superior performance.
Generative adversarial networks are a class of generative algorithms that have been widely used to produce state-of-the-art samples. In this paper, we investigate GAN to perform anomaly detection on time series dataset. In order to achieve this goal, a bibliography is made focusing on theoretical properties of GAN and …
SVMs improve forest fire detection accuracy on challenging datasets.
problem Rapid and accurate detection of forest fires.
method Training SVMs on labeled fire image datasets, focusing on data preprocessing, feature extraction, and model training.
result SVMs enhance detection accuracy on complex datasets, revealing key parameters affecting performance.
Study detects anomalies in robot vision data to predict hazards.
problem Detecting unexpected hazards in robot exploration data.
method Anomaly detection using autoencoders at different scales.
result Autoencoders improve anomaly detection performance on diverse robot scenarios.
Paper revisits PCA for anomaly detection in network security.
problem Understanding and improving anomaly detection in network security.
method Revisit probabilistic PCA model and its connection to MSNM framework.
result Mathematical model connects PCA to MSNM for anomaly detection.
Study detects concept shift in online data using martingales.
problem Detecting concept shift in online datasets.
method Exchangeable martingales and conformal prediction techniques.
result Decomposes concept shift into detectable components.
Deep learning detects diabetic retinopathy stages from single fundus photos.
problem Early detection of diabetic retinopathy for treatment success.
method Convolutional neural networks (CNN) for automatic stage detection.
result Sensitivity and specificity of 0.99 on APTOS 2019 Blindness Detection Dataset.
A framework for evaluating and benchmarking concept drift detection methods
problem Data stream mining challenged by concept drift
method A novel benchmarking framework
result Fair comparisons of drift detection methods
ADSAGE detects anomalies in graph edge sequences for insider threat detection.
problem Detecting insider threats in fine-grained audit logs using graph and text features.
method Anomaly detection at edge level, supporting numeric, categorical, and text attributes.
result ADSAGE detects anomalies in authentications and email communications effectively.
Study benchmarks label noise detection methods, identifying best practices.
problem Label noise in real-world datasets affects model performance and evaluation reliability.
method Decomposed detection methods into label agreement, aggregation, and information gathering components; introduced a unified benchmark task and novel metric.
result In-sample probability aggregation with logit margin label agreement function achieves best results across scenarios.
Increasing numbers of software vulnerabilities are discovered every year whether they are reported publicly or discovered internally in proprietary code. These vulnerabilities can pose serious risk of exploit and result in system compromise, information leaks, or denial of service. We leveraged the wealth of C and C++ …
Detects domain shifts in datasets using interpretable feature subspaces.
problem Detecting subtle differences in dataset probability distributions.
method Localised density anomaly detection in high-dimensional feature spaces.
result Extracts interpretable feature subspaces for domain shifts.
We introduce two challenging datasets that reliably cause machine learning model performance to substantially degrade. The datasets are collected with a simple adversarial filtration technique to create datasets with limited spurious cues. Our datasets' real-world, unmodified examples transfer to various unseen models …
Method enhances anomaly detection using contrastive learning and out-of-distribution data.
problem Improving anomaly detection in datasets with limited out-of-distribution data.
method Proposes a contrastive learning method that incorporates out-of-distribution data to enhance anomaly detection performance.
result The method significantly improves anomaly detection performance, even with limited out-of-distribution data.
T2IVAE detects anomalies in time series data with high accuracy.
problem Detecting anomalies in noisy, complex time series data.
method Unsupervised model based on NVAE and GANs, transforming 1D to 2D images.
result T2IVAE outperforms other models on various datasets.
This paper proposes an approach for rapid bounding box annotation for object detection datasets. The procedure consists of two stages: The first step is to annotate a part of the dataset manually, and the second step proposes annotations for the remaining samples using a model trained with the first stage annotations. …
Unsupervised deep learning detects and localizes crop leaf diseases.
problem Automated detection and localization of crop diseases.
method Three types of autoencoders (CAE, CVAE, VQ-VAE) applied to an open-source dataset.
result VQ-VAE autoencoder outperforms in image reconstruction, anomaly removal, detection, and localization.