Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,932 papers · 148 categories

Trend · papers per month

25.0%50.0%75.0%100.0% · Jun 199319922001200920172026
48 results for Precision-Recall curves

Revises precision-recall curves for generative models.

problem Improves evaluation of generative models by distinguishing mode-collapse and quality issues.
method Generalizes PR curve formulation to arbitrary measures, exposes a bridge to error rates, proposes a new algorithm to approximate precision-recall curves.
result Demonstrates the interest of the new formulation over the original approach on multi-modal datasets.

Geometric analysis of ROC and PR curves for binary classification.

problem Understanding classifier behavior and selection of optimal operating points.
method Geometric perspective on ROC and PR curves, focusing on the composition function GG.
result Many binary classification metrics are functions of G=FpFn1G = F_p \circ F_n^{-1}, facilitating better classifier optimization.

Reanalysis of bioactivity prediction models suggests SVM performance is competitive with deep learning.

problem Benchmarking and validation of machine learning models in drug discovery.
method Reanalysis of a large-scale comparison of machine learning models for bioactivity prediction, using numerical experiments to question ROC curve relevance and suggest precision-recall curve.
result Support vector machines show competitive performance with deep learning methods in bioactivity prediction.

This paper introduces a new method to train normalizing flows using precision-recall divergences.

problem Training generative models with mode dropping and low-quality samples.
method Introduces PR-divergences and proposes a novel generative model to minimize precision-recall trade-offs.
result Normalizing flows can be trained to achieve specific precision-recall trade-offs using PR-divergences.

Unified four trade-off curves for assessing generative model proximity.

problem Quantitative assessment of proximity between two probability distributions.
method Unified four existing curves: PR, Lorenz, ROC, and Rényi divergence frontiers.
result Explicit relationship between PR and Lorenz curves with domain adaptation bounds.

The paper proposes a method to calibrate metrics for better interpretability and fairness in machine learning models.

problem Machine learning metrics are biased by class priors and vary across subpopulations.
method Calibration of precision-based metrics (F1-score, AUC-PR) to make them invariant to class priors.
result Calibrated metrics improve interpretability and provide better control over model performance.

Paper introduces a new evaluation framework for generative models using Rényi divergences.

problem Lack of tools to diagnose and assess generative models' performance.
method Develops a general evaluation framework using Rényi divergences to measure precision and recall.
result Extends existing techniques to continuous and discrete models with efficient algorithms.

New DTI model using self-attention molecule representation outperforms state-of-the-art.

problem Predicting drug-target interactions to reduce costs and improve personalized medicine.
method Proposes a new molecule representation using self-attention and a new DTI model.
result Our DTI model outperforms state-of-the-art by up to 4.9% points in precision-recall.

The ROC curve is widely used to assess the quality of prediction/classification/ranking algorithms, and its properties have been extensively studied. The precision-recall (PR) curve has become the de facto replacement for the ROC curve in the presence of imbalance, namely where one class is far more likely than the oth…

2018-10-19abs ↗pdf ↗

Study develops algorithm to detect subtle respiratory events from PSG recordings.

problem Detecting non-apneic and non-hypopneic arousals in polysomnography recordings.
method Bidirectional LSTM classifier with 465 multi-domain features.
result 0.50 AUPRC on hidden test dataset, tied for second-best score in 2018 PhysioNet challenge.

A common approach in positive-unlabeled learning is to train a classification model between labeled and unlabeled data. This strategy is in fact known to give an optimal classifier under mild conditions; however, it results in biased empirical estimates of the classifier performance. In this work, we show that the typi…

2017-02-02abs ↗pdf ↗

Outlier detection methods have become increasingly relevant in recent years due to increased security concerns and because of its vast application to different fields. Recently, Pauwels and Lasserre (2016) noticed that the sublevel sets of the inverse Christoffel function accurately depict the shape of a cloud of data …

2018-06-18abs ↗pdf ↗

Study predicts startup outcomes like funding, patenting, IPOs using machine learning.

problem Forecasting startup success metrics like funding, patenting, IPOs.
method Developed interpretable machine learning framework, used preprocessing, class imbalance handling, and compared multiple models.
result Achieved high AUROC values for patent, funding, and exit predictions.

Electronic medical records (EMRs) supports the development of machine learning algorithms for predicting disease incidence, patient response to treatment, and other healthcare events. But insofar most algorithms have been centralized, taking little account of the decentralized, non-identically independently distributed…

2019-03-22abs ↗pdf ↗

In most machine learning applications, classification accuracy is not the primary metric of interest. Binary classifiers which face class imbalance are often evaluated by the FβF_β score, area under the precision-recall curve, Precision at K, and more. The maximization of many of these metrics can be expressed as a con…

2018-02-28abs ↗pdf ↗

Thousands of security vulnerabilities are discovered in production software each year, either reported publicly to the Common Vulnerabilities and Exposures database or discovered internally in proprietary code. Vulnerabilities often manifest themselves in subtle ways that are not obvious to code reviewers or the develo…

2018-02-14abs ↗pdf ↗

Proposes a method to evaluate classifiers with missing labels using multiple imputation.

problem Missing labels during model evaluation can introduce bias, especially in Missing Not At Random (MNAR) data.
method Develops a multiple imputation technique to estimate and provide predictive distributions for metrics like precision, recall, and ROC-AUC.
result The predictive distribution's location and shape are generally correct, even in the MNAR regime.

The paper critiques and expands on common evaluation metrics in machine learning.

problem The common evaluation metrics like Precision, Recall, F-Measure, and Rand Accuracy are biased and misleading.
method The paper introduces new measures like Informedness, Markedness, and Correlation to better reflect the quality of predictions.
result A system that performs worse in terms of Informedness can appear better using common measures like Precision and Recall.

A new method for optimizing non-decomposable metrics with constraints.

problem Optimizing complex machine learning objectives with thresholded constraints.
method Formulate rate-constrained optimization using the Implicit Function theorem and solve with gradient-based methods.
result Demonstrated effectiveness over existing methods on benchmark datasets.

Model predicts treatment initiation from clinical data using patient-clinician relations.

problem Predicting treatment initiation from clinical time series data considering patient-clinician relations.
method Graph-Augmented Time-Sensitive Model using top eigenvectors of graph Laplacian.
result Relational similarity improves prediction over baselines, e.g., 5% improvement in AUPRC.

Modern retrieval systems are often driven by an underlying machine learning model. The goal of such systems is to identify and possibly rank the few most relevant items for a given query or context. Thus, such systems are typically evaluated using a ranking-based performance metric such as the area under the precision-…

2016-08-16abs ↗pdf ↗

Deep ROC analysis improves model selection and interpretation in medical and AI applications.

problem Inadequate performance measures for binary classifiers.
method Deep ROC analysis, translating AUC and partial AUC into balanced average accuracy and post-test measures.
result Deep ROC analysis provides balanced average accuracy, average sensitivity, and average specificity.

Sleep arousals transition the depth of sleep to a more superficial stage. The occurrence of such events is often considered as a protective mechanism to alert the body of harmful stimuli. Thus, accurate sleep arousal detection can lead to an enhanced understanding of the underlying causes and influencing the assessment…

2019-03-01abs ↗pdf ↗

Study evaluates three class imbalance techniques across diverse datasets.

problem Class imbalance in binary classification tasks.
method Synthetic Minority Over-sampling Technique (SMOTE), Class Weights tuning, Decision Threshold Calibration.
result Decision Threshold Calibration is the most consistently effective technique.