DCC separates marginal estimation from dependence modeling for improved classification accuracy.
problem Classifying with strong dependence between features.
method Deep Copula Classifier using neural copula densities.
result Achieves excess-risk O(n−r/(2r+d)) for r-smooth copulas. Improves ROC/AUC for multi-class classification.
problem Lack of sensible plots, sensitivity to imbalanced data, inability to specify mis-classification cost, and lack of evaluation uncertainty quantification.
method Factorizes multi-class ROC into a one-dimensional vector representation for visualization and summary.
result Provides a binary AUC-equivalent summary and mis-classification weights specification.
Deep neural networks predict earthquake locations with high accuracy.
problem Predicting the location of earthquakes with high precision.
method Recurrent Convolutional Neural Networks (R-CNN) model that accounts for spatio-temporal dependencies.
result Neural networks model outperforms baseline models in predicting earthquakes with ROC AUC 0.975 and PR AUC 0.0890.
Study reveals significant performance flips in GLOD using repurposed graph classification datasets.
problem Performance discrepancies in graph-level outlier detection using repurposed classification datasets.
method Repurposed binary classification datasets for GLOD; analyzed ROC-AUC performance.
result Performance of GLOD models significantly flips depending on which class is down-sampled.
Proposes a method to evaluate classifiers with missing labels using multiple imputation.
problem Missing labels during model evaluation can introduce bias, especially in Missing Not At Random (MNAR) data.
method Develops a multiple imputation technique to estimate and provide predictive distributions for metrics like precision, recall, and ROC-AUC.
result The predictive distribution's location and shape are generally correct, even in the MNAR regime.
TrialGraph uses graph machine learning to improve clinical trial design and predict side effects.
problem Complexity and cost in clinical trials hinder drug development.
method Curated clinical trial data set converted to graph-structured formats, applied graph machine learning algorithms.
result MetaPath2Vec algorithm performed exceptionally well, improving prediction accuracy.
Deep learning improves forensic matching of casings.
problem Identifying if two casings came from the same firearm.
method Contrastive neural networks trained on casings dataset.
result Contrastive learning achieved better ROC AUC than CMC.
This report examines the Pinned AUC metric introduced and highlights some of its limitations. Pinned AUC provides a threshold-agnostic measure of unintended bias in a classification model, inspired by the ROC-AUC metric. However, as we highlight in this report, there are ways that the metric can obscure different kinds…
In many situations, we need to build and deploy separate models in related environments with different data qualities. For example, an environment with strong observation equipments (e.g., intensive care units) often provides high-quality multi-modal data, which are acquired from multiple sensory devices and have rich-…
Deep neural networks classify T2D from retinal images with high accuracy.
problem Detecting early-stage Type 2 Diabetes from retinal images.
method Employed deep neural networks and multi-target learning to differentiate T2D from healthy individuals.
result Classification performance improved to AUC = 0.758 [±0.003] using images from both eyes. In this work, we ask two questions: 1. Can we predict the type of community interested in a news article using only features from the article content? and 2. How well do these models generalize over time? To answer these questions, we compute well-studied content-based features on over 60K news articles from 4 communit…
Rapid overlay of chemical structures (ROCS) is a standard tool for the calculation of 3D shape and chemical ("color") similarity. ROCS uses unweighted sums to combine many aspects of similarity, yielding parameter-free models for virtual screening. In this report, we decompose the ROCS color force field into "color com…
Fingerprint deep neural networks by conferrable adversarial examples.
problem Detecting model stealing attacks in machine learning as a service.
method Extract conferrable adversarial examples to fingerprint deep neural networks.
result First method to reach 1.0 ROC AUC in verifying surrogates.
Study evaluates MRIQC pipeline's generalization on large multi-center datasets.
problem Generalizing MRI QC methods to new, unseen data.
method Evaluated MRIQC preprocessing steps on ABIDE and CATI datasets.
result Model without preprocessing yields best results on unseen data.
Anomaly detection scores from VAE gradients improve tumor detection.
problem Improving anomaly detection in medical imaging.
method Using Variational Autoencoders to approximate anomaly ratings.
result Variance Autoencoder gradient-based ratings outperform other methods in tumor detection.
Study compares AI models for stock price prediction using financial news.
problem Predicting stock price movements using financial news.
method Used FinBERT, GPT-4, and Logistic Regression for sentiment analysis and prediction.
result Logistic Regression outperformed FinBERT and GPT-4, achieving 81.83% accuracy.
HED Score improves temporal evaluation of detection accuracy.
problem Temporal agnosticism in existing evaluation frameworks for non-stationary processes.
method Measure-theoretic HED Score integrating exponentially decaying kernel over posterior probability stream.
result HED Score achieves 388.8% improvement over ROC/AUC on NSL-KDD benchmark.
Unsupervised learning can leverage large-scale data sources without the need for annotations. In this context, deep learning-based auto encoders have shown great potential in detecting anomalies in medical images. However, state-of-the-art anomaly scores are still based on the reconstruction error, which lacks in two e…
Area under ROC (AUC) is an important metric for binary classification and bipartite ranking problems. However, it is difficult to directly optimizing AUC as a learning objective, so most existing algorithms are based on optimizing a surrogate loss to AUC. One significant drawback of these surrogate losses is that they …
RECol generates error columns to improve outlier detection.
problem Outlier detection in data with complex relationships.
method Generates reconstruction error columns for leave-one-out feature sets.
result Improves ROC-AUC and PR-AUC values of common outlier detection methods.
Deep neural networks (DNNs) are powerful nonlinear architectures that are known to be robust to random perturbations of the input. However, these models are vulnerable to adversarial perturbations--small input changes crafted explicitly to fool the model. In this paper, we ask whether a DNN can distinguish adversarial …
Graph neural network predicts new bank client interactions using transaction data.
problem Predicting new interactions in the network of bank clients.
method Proposes a graph neural network model that uses both network topology and time-series data.
result The model outperforms existing approaches in link prediction and credit scoring.
In this paper, the effectiveness and capability of convolutional neural networks have been studied in the classification of 8 skin diseases. Different pre-trained state-of-the-art architectures (DenseNet 201, ResNet 152, Inception v3, InceptionResNet v2) were used and applied on 10135 dermoscopy skin images in total (H…
Proposes a new prior for VAEs to improve out-of-distribution detection.
problem Probabilistic generative models struggle with out-of-distribution detection.
method Introduces an exponentially tilted Gaussian prior for VAEs.
result Achieves state-of-the-art results on ROC-AUC metric.
Learning node embeddings that capture a node's position within the broader graph structure is crucial for many prediction tasks on graphs. However, existing Graph Neural Network (GNN) architectures have limited power in capturing the position/location of a given node with respect to all other nodes of the graph. Here w…
Graphs models are vulnerable to distribution shifts, which this work explains and mitigates.
problem Graph Neural Networks (GNNs) are susceptible to distribution shift, leading to performance degradation.
method Theoretical analysis quantifying conditional shift, proposing an approach to estimate and minimize it.
result The proposed approach demonstrates up to 10% absolute ROC AUC improvement under various distribution shifts.
We present a method for metric optimization in the Large Deformation Diffeomorphic Metric Mapping (LDDMM) framework, by treating the induced Riemannian metric on the space of diffeomorphisms as a kernel in a machine learning context. For simplicity, we choose the kernel Fischer Linear Discriminant Analysis (KLDA) as th…
New activation function BrownianReLU improves LSTM network performance on financial time series.
problem Gradient instability in noisy financial time series data.
method Introduces BrownianReLU, a stochastic activation function based on Brownian motion.
result Significantly improved predictive accuracy and generalization on financial datasets.
EHBOS enhances HBOS by capturing feature interactions, improving anomaly detection.
problem Limited ability of HBOS to detect anomalies in datasets with feature interactions.
method Incorporates two-dimensional histograms to capture feature pair dependencies.
result EHBOS outperforms HBOS on datasets with critical feature interactions, achieving notable improvements in ROC AUC.
The paper analyzes recalibration methods for binary classifiers under distribution shift.
problem Recalibrating binary classifiers to match a target prior probability.
method Analysis of distribution shift assumptions and proposal of new recalibration methods.
result QMM methods provide conservative results for risk weights functions.
In this paper we study the stability and its trade-off with optimization error for stochastic gradient descent (SGD) algorithms in the pairwise learning setting. Pairwise learning refers to a learning task which involves a loss function depending on pairs of instances among which notable examples are bipartite ranking,…
Electronic medical records (EMRs) supports the development of machine learning algorithms for predicting disease incidence, patient response to treatment, and other healthcare events. But insofar most algorithms have been centralized, taking little account of the decentralized, non-identically independently distributed…
SLEEPER combines deep learning with expert rules for accurate sleep staging.
problem Manual sleep staging is tedious and requires expert time.
method SLEEPER uses convolutional neural networks and expert rules to generate interpretable models.
result SLEEPER achieves comparable accuracy to human experts and deep neural networks.
This paper compares machine and deep learning algorithms for IoT data classification.
problem Classifying IoT data using machine and deep learning algorithms.
method Evaluation of 11 machine and deep learning algorithms on six IoT datasets using multiple performance metrics.
result Random Forests outperformed other machine learning models, while ANN and CNN performed well among deep learning models.
We compare features for dynamic time warping (DTW) when used to bootstrap keyword spotting (KWS) in an almost zero-resource setting. Such quickly-deployable systems aim to support United Nations (UN) humanitarian relief efforts in parts of Africa with severely under-resourced languages. Our objective is to identify aco…
The paper analyzes RfQ processes on MD2C platforms using probabilistic models.
problem Analyzing the negotiation process on MD2C platforms to ensure dealers' profitability.
method Probabilistic graphical models and causal inference.
result Generative models can match predictive accuracy of discriminative models while enforcing business requirements.
New algorithms improve boosting by optimizing chance-corrected measures.
problem Improving boosting algorithms to use chance-corrected measures effectively.
method Developed new algorithms (AdaBook and Multibook) that optimize chance-corrected measures.
result AdaBook and Multibook outperform standard Multiboost or AdaBoost in multiclass situations.
Recommendation problems with large numbers of discrete items, such as products, webpages, or videos, are ubiquitous in the technology industry. Deep neural networks are being increasingly used for these recommendation problems. These models use embeddings to represent discrete items as continuous vectors, and the vocab…
ECLIPSE detects AI hallucinations in finance with high accuracy.
problem Hallucinations in AI-generated answers limit safe deployment in finance.
method Combines entropy estimation and perplexity decomposition to measure model evidence use.
result ECLIPSE achieves ROC AUC of 0.89 and average precision of 0.90 on financial QA dataset.
GUIDE detects anomalies in attributed networks by reconstructing node attributes and higher-order structures.
problem Lack of effective mechanisms for detecting anomalies in complex network interactions.
method GUIDE uses attribute and structure autoencoders, graph attention, and reconstruction errors to identify anomalies.
result GUIDE significantly outperforms state-of-the-art methods on multiple real-world datasets.
Many applications of machine learning require a model to make accurate pre-dictions on test examples that are distributionally different from training ones, while task-specific labels are scarce during training. An effective approach to this challenge is to pre-train a model on related tasks where data is abundant, and…
MOTGNN integrates multi-omics data for disease classification with improved accuracy and interpretability.
problem Challenges in integrating multi-omics data due to high dimensionality, heterogeneity, and lack of reliable interaction networks.
method MOTGNN uses XGBoost for graph construction, modality-specific GNNs for representation learning, and a deep feedforward network for cross-omics integration.
result MOTGNN outperforms state-of-the-art baselines by 5-10% in accuracy, ROC-AUC, and F1-score across three real-world disease datasets.
KACDP model improves credit default prediction with enhanced interpretability.
problem Insufficient interpretability and limited performance in credit default prediction.
method Kolmogorov-Arnold Networks (KANs) for handling complex multi-dimensional data.
result KACDP model outperforms mainstream models in performance metrics.
In this study, we systematically investigate the impact of class imbalance on classification performance of convolutional neural networks (CNNs) and compare frequently used methods to address the issue. Class imbalance is a common problem that has been comprehensively studied in classical machine learning, yet very lim…
Quantum method detects financial stress regimes from market data.
problem Detecting financial stress regimes from market data.
method Adapted Pauli Correlation Encoding to quantum topological data analysis.
result Quantum method can recover Betti numbers exactly at every scale.
CHAODA detects anomalies in high-dimensional data.
problem Anomaly detection in high-dimensional spaces.
method Hierarchical clustering, manifold mapping, transfer learning.
result CHAODA outperforms other algorithms on 16 out of 18 datasets.
ECGDetect uses deep learning to detect ischemia in heart ECGs.
problem Detecting early signs of acute coronary syndrome in patients.
method Developed a deep learning model using the LTST database.
result Deep neural network achieved 90.31% ROC-AUC, 89.34% sensitivity, 87.81% specificity.
HGCN uses hyperbolic geometry to improve graph node embeddings.
problem Distortion in Euclidean embeddings of real-world graphs.
method Derives GCN operations in hyperbolic space and maps Euclidean features to hyperbolic embeddings.
result HGCN achieves up to 63.1% error reduction in ROC AUC for link prediction.