Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,742 papers · 148 categories

Trend · papers per month

235470704939 · Jun 202019922001200920172026
48 results for deep ROC analysis

Deep ROC analysis improves model selection and interpretation in medical and AI applications.

problem Inadequate performance measures for binary classifiers.
method Deep ROC analysis, translating AUC and partial AUC into balanced average accuracy and post-test measures.
result Deep ROC analysis provides balanced average accuracy, average sensitivity, and average specificity.

Deep learning uses ROC cost functions to improve virtual screening accuracy.

problem Challenges in training deep learning models for virtual screening, especially class imbalance and lack of ground truth labels.
method Proposes using ROC cost functions to optimize deep learning models for virtual screening, introduces new training schemes and cost functions.
result Demonstrates improved performance of ROC-based approaches on PubChem datasets.

The study improves the assessment of fairness in face recognition using ROC curves and statistical guarantees.

problem Improving the assessment of fairness in face recognition systems.
method Proves asymptotic guarantees for empirical ROC curves and fairness metrics, and introduces a recentering technique to avoid bootstrap pitfalls.
result Demonstrates the practical relevance of the methods for assessing fairness in face recognition systems.

Improves ROC/AUC for multi-class classification.

problem Lack of sensible plots, sensitivity to imbalanced data, inability to specify mis-classification cost, and lack of evaluation uncertainty quantification.
method Factorizes multi-class ROC into a one-dimensional vector representation for visualization and summary.
result Provides a binary AUC-equivalent summary and mis-classification weights specification.

Neural network models improve ROC curve evaluation of biomarkers, focusing on age's role in physical activity-mortality association.

problem Improving biomarker evaluation using machine learning for complex relationships.
method Proposes neural network-based covariate-adjusted ROC modeling.
result Age has distinct effects on mortality outcomes when physical activity is measured as total activity time.

CP-ROC bands improve graph classification accuracy and uncertainty quantification.

problem Uncertainty quantification and robustness to distributional shifts in graph classification.
method Conditional Prediction ROC (CP-ROC) bands for graph classification, developed for TGNNs and adaptable to GNNs.
result Statistically guaranteed coverage for CP-ROC under local exchangeability condition, improving prediction reliability.

Rapid overlay of chemical structures (ROCS) is a standard tool for the calculation of 3D shape and chemical ("color") similarity. ROCS uses unweighted sums to combine many aspects of similarity, yielding parameter-free models for virtual screening. In this report, we decompose the ROCS color force field into "color com…

2016-06-06abs ↗pdf ↗

Geometric analysis of ROC and PR curves for binary classification.

problem Understanding classifier behavior and selection of optimal operating points.
method Geometric perspective on ROC and PR curves, focusing on the composition function GG.
result Many binary classification metrics are functions of G=FpFn1G = F_p \circ F_n^{-1}, facilitating better classifier optimization.

Deep neural networks predict earthquake locations with high accuracy.

problem Predicting the location of earthquakes with high precision.
method Recurrent Convolutional Neural Networks (R-CNN) model that accounts for spatio-temporal dependencies.
result Neural networks model outperforms baseline models in predicting earthquakes with ROC AUC 0.975 and PR AUC 0.0890.

The fuzzy ROC extends Receiver Operating Curve (ROC) visualization to the situation where some data points, falling in an indeterminacy region, are not classified. It addresses two challenges: definition of sensitivity and specificity bounds under indeterminacy; and visual summarization of the large number of possibili…

2019-03-04abs ↗pdf ↗

Optimizes partial AUC across various FPRs for machine learning models.

problem Lack of scalable algorithms for optimizing partial AUC in a range of FPRs.
method Formulated as a non-smooth DC program, developed an efficient approximated gradient descent method using Moreau envelope smoothing.
result Achieved a complexity of O(1/ε6)O(1/ε^6) for finding nearly εε-critical solutions.

The Receiver Operating Characteristic (ROC) curve is a representation of the statistical information discovered in binary classification problems and is a key concept in machine learning and data science. This paper studies the statistical properties of ROC curves and its implication on model selection. We analyze the …

2019-05-05abs ↗pdf ↗

This review examines deep learning in financial fraud detection over 5 years.

problem Improving deep learning techniques for financial fraud detection.
method Systematic literature review of 57 studies using performance metrics.
result Deep learning models enhance fraud detection across various financial domains.

Paper estimates optimal ROC curve arc length and AUC, improving classification performance.

problem Estimating optimal ROC curve arc length and AUC in imbalanced binary classification.
method Expresses arc length and AUC as variational objectives, estimating using positive and negative samples.
result Proposed classification procedure maximizes an approximate lower bound of maximal AUC.

AUC used as a measure of clustering quality in unsupervised learning.

problem Using AUC to evaluate clustering quality in unsupervised learning.
method Developed AUCC as a measure of clustering quality, derived theoretical expected values, and compared with Gamma criterion.
result AUCC has a consistent expected value under random clustering, making it a reliable measure.

Modified AUC improves CNN training by considering model confidence.

problem Improving binary classifier performance metrics.
method Proposes a modified AUC metric that incorporates model confidence into BCE loss for CNN training.
result Demonstrates improved performance on three datasets: MNIST, prostate MRI, and brain MRI.

This paper compares machine and deep learning algorithms for IoT data classification.

problem Classifying IoT data using machine and deep learning algorithms.
method Evaluation of 11 machine and deep learning algorithms on six IoT datasets using multiple performance metrics.
result Random Forests outperformed other machine learning models, while ANN and CNN performed well among deep learning models.

New optimization method improves AUC for binary classification and changepoint detection.

problem Non-convex AUC and sub-optimal points in ROC curves.
method AUM (Area Under Min(FP, FN)) surrogate loss function based on sorting and summing ROC curve points.
result AUM minimization learning algorithm improves AUC and speeds up compared to previous methods.

ABROCA assesses algorithmic bias, revealing skewed distributions that inflate results.

problem Detecting nuanced performance differences in classifier fairness.
method Study of ABROCA metric's statistical properties under various conditions.
result ABROCA distributions are skewed, inflating results by chance in imbalanced classes.

Study finds AUC is most consistent across different prevalence in binary classification.

problem Consistency of model evaluation metrics across varying prevalence in binary classification.
method Analysis of 156 data scenarios with 18 metrics, 5 models, and a random guess model.
result AUC has the smallest variance in evaluating individual models and ranking of models.

Feature selection aims to select the smallest subset of features for a specified level of performance. The optimal achievable classification performance on a feature subset is summarized by its Receiver Operating Curve (ROC). When infinite data is available, the Neyman- Pearson (NP) design procedure provides the most e…

2013-01-16abs ↗pdf ↗

In Machine Learning as a Service, a provider trains a deep neural network and gives many users access. The hosted (source) model is susceptible to model stealing attacks, where an adversary derives a surrogate model from API access to the source model. For post hoc detection of such attacks, the provider needs a robust…

2019-12-02abs ↗pdf ↗

Improved FDAM algorithms for heterogeneous data with constant communication complexity.

problem Maximizing AUC for imbalanced data classification in federated learning.
method Solving non-convex strongly-concave min-max formulation in a distributed fashion.
result Communication complexity is a constant, independent of number of machines and accuracy level.

Study evaluates data augmentation methods for prostate cancer detection in MRI.

problem Limited data for prostate cancer detection in MRI.
method Static application of five augmentation techniques (rotation, flip, crop, translation) to MRI dataset.
result Rotation method improved 2D slice-based AUC to 0.85.

The variational autoencoder (VAE) is a generative model with continuous latent variables where a pair of probabilistic encoder (bottom-up) and decoder (top-down) is jointly learned by stochastic gradient variational Bayes. We first elaborate Gaussian VAE, approximating the local covariance matrix of the decoder as an o…

2016-04-18abs ↗pdf ↗

Study reveals significant performance flips in GLOD using repurposed graph classification datasets.

problem Performance discrepancies in graph-level outlier detection using repurposed classification datasets.
method Repurposed binary classification datasets for GLOD; analyzed ROC-AUC performance.
result Performance of GLOD models significantly flips depending on which class is down-sampled.

We investigate a long-debated question, which is how to create predictive models of recidivism that are sufficiently accurate, transparent, and interpretable to use for decision-making. This question is complicated as these models are used to support different decisions, from sentencing, to determining release on proba…

2015-03-26abs ↗pdf ↗

Thousands of security vulnerabilities are discovered in production software each year, either reported publicly to the Common Vulnerabilities and Exposures database or discovered internally in proprietary code. Vulnerabilities often manifest themselves in subtle ways that are not obvious to code reviewers or the develo…

2018-02-14abs ↗pdf ↗

Study compares AI models for stock price prediction using financial news.

problem Predicting stock price movements using financial news.
method Used FinBERT, GPT-4, and Logistic Regression for sentiment analysis and prediction.
result Logistic Regression outperformed FinBERT and GPT-4, achieving 81.83% accuracy.