The ROC curve is widely used to assess the quality of prediction/classification/ranking algorithms, and its properties have been extensively studied. The precision-recall (PR) curve has become the de facto replacement for the ROC curve in the presence of imbalance, namely where one class is far more likely than the oth…
On-device research index
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
168,657 papers · 148 categories
Trend · papers per month
48 results for “PR curves”
Proposes MCC-F1 curve for better binary classification evaluation.
problem Misleading performance evaluations with ROC and PR curves for imbalanced data.
method Introduces MCC-F1 curve combining MCC and F1 score.
result MCC-F1 curve provides clearer classifier differentiation.
Geometric analysis of ROC and PR curves for binary classification.
problem Understanding classifier behavior and selection of optimal operating points.
method Geometric perspective on ROC and PR curves, focusing on the composition function .
result Many binary classification metrics are functions of , facilitating better classifier optimization.
Unified four trade-off curves for assessing generative model proximity.
problem Quantitative assessment of proximity between two probability distributions.
method Unified four existing curves: PR, Lorenz, ROC, and Rényi divergence frontiers.
result Explicit relationship between PR and Lorenz curves with domain adaptation bounds.
In this article we revisit the definition of Precision-Recall (PR) curves for generative models proposed by Sajjadi et al. (arXiv:1806.00035). Rather than providing a scalar for generative quality, PR curves distinguish mode-collapse (poor recall) and bad quality (poor precision). We first generalize their formulation …
When sufficient labeled data are available, classical criteria based on Receiver Operating Characteristic (ROC) or Precision-Recall (PR) curves can be used to compare the performance of un-supervised anomaly detection algorithms. However , in many situations, few or no data are labeled. This calls for alternative crite…
Assessing the performance of a learned model is a crucial part of machine learning. However, in some domains only positive and unlabeled examples are available, which prohibits the use of most standard evaluation metrics. We propose an approach to estimate any metric based on contingency tables, including ROC and PR cu…
This paper introduces and solves the simultaneous source separation and phase retrieval (SPR) problem. SPR is an important but largely unsolved problem in a number application domains, including microscopy, wireless communication, and imaging through scattering media, where one has multiple independent coherent…
Multiplicative deformations of spectrale triples associated to left invariant metrics on Lie groupsmath.DG
We study the triple $(G,π,\prs)$ where is a connected and simply connected Lie group, and $\prs$ are, respectively, a multiplicative Poisson tensor and a left invariant Riemannian metric on such that the necessary conditions, introduced by Hawkins, to the existence of a non commutative deformation (in the d…
Classifies solutions to vacuum weighted Einstein equations on pr-waves.
problem Classifying solutions to vacuum weighted Einstein field equations on pr-waves.
method Classifying solutions using smooth metric measure spacetimes of dimension 4.
result Provides examples of solutions with special geometric properties.
The broad set of deep generative models (DGMs) has achieved remarkable advances. However, it is often difficult to incorporate rich structured domain knowledge with the end-to-end DGMs. Posterior regularization (PR) offers a principled framework to impose structured constraints on probabilistic models, but has limited …
Pliable rejection samplingstat.ML
PRS improves rejection sampling by learning better proposals.
problem High rejection rate in traditional rejection sampling.
method PRS uses a kernel estimator to learn better sampling proposals.
result PRS guarantees a low number of accepted samples.
A garland based on a manifold is a finite set of manifolds homeomorphic to with some of them glued together at marked points. Fix a manifold and consider a space $\NN$ of all smooth mappings of garlands based on into . We construct operations and on the bordism groups $\bor_*(\NN)$ …
Let X be a geodesic metric space. Gromov proved that there exists k>0 such that if every sufficiently large triangle T satisfies the Rips condition with constant k times pr(T), where pr(T) is the perimeter T, then X is hyperbolic. We give an elementary proof of this fact, also giving an estimate for k. We also show tha…
In this paper we define a Poincaré-Reidemeister scalar product on the determinant line of the cohomology of any flat vector bundle over a closed orientable odd-dimensional manifold. It is a combinatorial "torsion-type" invariant which refines the PR-metric, introduced earlier by the first author, and contains an additi…
New metrics fail adversarial tests, with some more robust than others.
problem Evaluation metrics for time-series anomaly detection were improved but not fully robust.
method Adversarial stress-testing of 12 adopted metrics on real benchmarks.
result Some metrics are more robust than others, with ROC-based metrics being gamed more often.
PR-GNN identifies salient brain regions for ASD biomarkers.
problem Identifying brain regions associated with neurological disorders.
method Pooling Regularized Graph Neural Network (PR-GNN) with novel salient region selection.
result PR-GNN outperforms baseline methods in ASD classification accuracy.
Correction for Error estimates for binomial approximations of game options [math.PR/0607123]
New method detects inconsistencies in AHP matrices using triadic preference reversals.
problem Challenges in assessing consistency in AHP pairwise comparison matrices.
method Triadic preference reversals to detect inconsistencies between pairs of elements.
result 97% accuracy in detecting inconsistencies, significantly surpassing traditional methods.
The paper tackles performative risk optimization under weak convexity assumptions.
problem Optimizing performative risk in a closed-loop prediction system with weak convexity.
method Relaxing convexity assumptions to maintain optimization feasibility.
result Iterative optimization methods remain applicable even with weakened convexity conditions.
New PSDMF algorithms derived from PR and ARM methods.
problem Positive semidefinite matrix factorization (PSDMF) challenges.
method Design PSDMF algorithms based on phase retrieval (PR) and affine rank minimization (ARM) methods.
result New PSDMF algorithms inherit numerical properties from PR and ARM methods.
Classifies Morse flows on 3-sphere with specific saddle connections.
problem Classifying Morse-Smale flows on a 3-sphere with specific saddle connections.
method Used generalized Heegaard diagrams (Pr-diagrams) to classify flows.
result Found all possible, up to homeomorphism, ways to embed two circles in a 2-sphere with no more than 10 points of transversal intersection.
Machine learning models deployed in real-world applications are often evaluated with precision-based metrics such as F1-score or AUC-PR (Area Under the Curve of Precision Recall). Heavily dependent on the class prior, such metrics make it difficult to interpret the variation of a model's performance over different subp…
We describe an effective method for simultaneously computing of -invariants of infinite families of Brieskorn spheres with .
DCC separates marginal estimation from dependence modeling for improved classification accuracy.
problem Classifying with strong dependence between features.
method Deep Copula Classifier using neural copula densities.
result Achieves excess-risk for -smooth copulas.
Optimal spectral initializers impact phase retrieval phase transitions.
problem Understanding the limits of phase retrieval algorithms.
method Developed Random duality theory (RDT) to characterize optimal spectral initializers.
result Optimal spectral initializers can fall into flat regions of the phase retrieval manifold, making phase retrieval difficult.
Study symplectic embeddings of 4-manifolds using Lefschetz fibrations.
problem Proper symplectic and iso-symplectic embeddings of 4-manifolds in 6-manifolds.
method Use Lefschetz fibrations to study symplectic embeddings.
result Closed orientable smooth 4-manifolds admitting Lefschetz fibrations over CP^1 can be embedded symplectically in (CP^1 × CP^1 × CP^1, ω_pr).
We propose a general technique for improving alternating optimization (AO) of nonconvex functions. Starting from the solution given by AO, we conduct another sequence of searches over subspaces that are both meaningful to the optimization problem at hand and different from those used by AO. To demonstrate the utility o…
Study predicts startup outcomes like funding, patenting, IPOs using machine learning.
problem Forecasting startup success metrics like funding, patenting, IPOs.
method Developed interpretable machine learning framework, used preprocessing, class imbalance handling, and compared multiple models.
result Achieved high AUROC values for patent, funding, and exit predictions.
We study two-layer belief networks of binary random variables in which the conditional probabilities Pr[childlparents] depend monotonically on weighted sums of the parents. In large networks where exact probabilistic inference is intractable, we show how to compute upper and lower bounds on many probabilities of intere…
New method detects global factors near BBP phase transition in high-dimensional data.
problem Detecting the number of global factors in noisy high-dimensional correlation matrices.
method Iterative Global Factor (IGF) algorithm combining adaptive edge recalibration and PR delocalization filter.
result IGF algorithm successfully detects global factors near BBP transition, improving over eigenvalue-only methods.
Electronic medical records (EMRs) supports the development of machine learning algorithms for predicting disease incidence, patient response to treatment, and other healthcare events. But insofar most algorithms have been centralized, taking little account of the decentralized, non-identically independently distributed…
We construct new knot polynomials. Let be the standard solid torus in 3-space and let be its standard projection onto an annulus. Let be the space of all smooth oriented knots in such that the restriction of is an immersion (e.g. regular diagrams of a classical knot in the complement of its meridi…
Study evaluates machine learning methods for large-scale network reliability, revealing ANN's and PR's performance.
problem Tackles the NP-hard problem of approximating binary-state network reliability for large-scale systems.
method Compares 20 machine learning methods across three reliability regimes and evaluates their performance on large-scale networks.
result Large-scale networks with arc reliability ≥ 0.9 exhibit near-unity system reliability, enabling computational simplifications.
This work improves understanding of projection robust optimal transport distances.
problem Understanding the behavior of minimum Wasserstein estimators in high-dimensional and misspecified models.
method Adopting projection robust (PR) optimal transport, establishing statistical properties, proposing IPRW distance, and providing asymptotic guarantees.
result Established fundamental statistical properties and proposed new distances that outperform Wasserstein distances empirically.
The paper analyzes the performance of constant step-size stochastic approximation algorithms.
problem Approximating solutions to root finding problems in optimization and machine learning.
method Examines stochastic approximation algorithms with constant step-size, proving convergence and analyzing the limiting behavior of averaged estimates.
result The Polyak-Ruppert-style averaged estimates converge to the true solution with optimal covariance, providing insights for practitioners.
A new method avoids saddle points in Newton's method.
problem Avoiding saddle points in optimization problems.
method New Q-Newton's method with specific update rule.
result The method guarantees convergence to a critical point that is not a saddle point.
Paper analyzes LSA algorithm bias and error bounds with RR extrapolation.
problem Analyzing bias and high-order error bounds of LSA with Markovian noise.
method Polyak-Ruppert averaging, linearization, Richardson-Romberg extrapolation.
result RR extrapolation effectively cancels the leading bias term.
We consider -dimensional linear stochastic approximation algorithms (LSAs) with a constant step-size and the so called Polyak-Ruppert (PR) averaging of iterates. LSAs are widely applied in machine learning and reinforcement learning (RL), where the aim is to compute an appropriate (that is a…
A new method for nonparametric regression using mesh-based solutions.
problem Estimating regression functions non-parametrically with computational tractability.
method Mesh-based approximate solution (MBS) for penalized regression problems.
result MBS transforms NPR to a discrete convex minimization problem, making it computationally feasible.
This paper develops an ensemble learning-based linearization approach for power flow, which differs from the network-parameter based direct current (DC) power flow or other extended versions of linearization. As a novel data-driven linearization through data mining, it firstly applies the polynomial regression (PR) as …
Recently, deep learning approaches with various network architectures have achieved significant performance improvement over existing iterative reconstruction methods in various imaging problems. However, it is still unclear why these deep learning architectures work for specific inverse problems. To address these issu…
Enhances clinical trial predictions by quantifying uncertainty.
problem Uncertainty in medical diagnosis and drug discovery predictions.
method Selective classification integrated with Hierarchical Interaction Network (HINT).
result Significant improvement in PR-AUC, F1, ROC-AUC, and overall accuracy.
Bayesian optimization tackles expensive discrete and mixed parameter spaces.
problem Optimizing expensive functions with discrete and mixed parameters.
method Probabilistic reparameterization to maximize expectation of AF over continuous parameters.
result Our approach provably converges to a maximizer of the AF and enjoys the same regret bounds as standard BO.
In the present paper, we prove that a lower bound on the -weighted Ricci curvature is equivalent to a convexity of entropies on the Wasserstein space. Based on such characterization, we provide some interpolation inequalities such as the Pr'ekopa-Leindler inequality, the Borel-Branscamp-Lieb inequality, and the Brun…
In this paper we study the behavior of the scalar curvature of a complete hypersurface immersed with constant mean curvature into a Riemannian space form of constant curvature, deriving a sharp estimate for the infimum of . Our results will be an application of a weak Omori-Yau maximum principle due to Pigola, R…
When there is a family of complex structures on the phase space, parametrized by a set , the prequantum Hilbert spaces produced by geometric quantization, using the half-form correction, also depends on these parameters. This way we obtain a field of Hilbert spaces . We show that this field …
This paper introduces a new method to train normalizing flows using precision-recall divergences.
problem Training generative models with mode dropping and low-quality samples.
method Introduces PR-divergences and proposes a novel generative model to minimize precision-recall trade-offs.
result Normalizing flows can be trained to achieve specific precision-recall trade-offs using PR-divergences.