Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,786 papers · 148 categories

Trend · papers per month

0.4%0.8%1.2%1.6% · Jul 201919922001200920172026
48 results for inexact AUC

In this paper we present a convergence rate analysis of inexact variants of several randomized iterative methods. Among the methods studied are: stochastic gradient descent, stochastic Newton, stochastic proximal point and stochastic subspace ascent. A common feature of these methods is that in their update rule a cert…

2019-03-19abs ↗pdf ↗

Inexact Riemannian optimization converges to stationary points efficiently.

problem Analyzing convergence and complexity of inexact Riemannian optimization.
method Tangential Block Majorization-Minimization (tBMM) framework.
result tBMM converges to an ε-stationary point within O(ε⁻²) iterations.

Inexact acquisition solutions in BO lead to sublinear cumulative regret.

problem Inexact maximization of acquisition functions in Bayesian optimization.
method Define inaccuracy measure, establish cumulative regret bounds for GP-UCB and GP-TS.
result Inexact BO algorithms can achieve sublinear cumulative regret under appropriate inaccuracy conditions.

This paper analyzes the bias of inexact MCMC methods in high dimensions.

problem Understanding the bias of inexact MCMC methods in high-dimensional spaces.
method Establishing bounds on Wasserstein distances between inexact MCMC methods and target distributions.
result The asymptotic bias of ULA and uHMC depends on key quantities related to the target distribution or the stationary probability measure of the scheme.

New methods solve complex optimization problems in machine learning.

problem Challenges in stochastic bilevel optimization with constraints and high variables.
method Inexact bilevel stochastic gradient methods for constrained and unconstrained lower-level problems.
result Comprehensive convergence theory for both unconstrained and constrained cases.

Maximizing the area under the receiver operating characteristic curve (AUC) is a standard approach to imbalanced classification. So far, various supervised AUC optimization methods have been developed and they are also extended to semi-supervised scenarios to cope with small sample problems. However, existing semi-supe…

2017-05-04abs ↗pdf ↗

Modified AUC improves CNN training by considering model confidence.

problem Improving binary classifier performance metrics.
method Proposes a modified AUC metric that incorporates model confidence into BCE loss for CNN training.
result Demonstrates improved performance on three datasets: MNIST, prostate MRI, and brain MRI.

New algorithm tackles complex optimization problems with inexact and stochastic methods.

problem Solving complex optimization problems with inexact and stochastic methods.
method Developed ICGALP algorithm for composite minimization problems with inexact computations.
result Convergence of Lagrangian to an optimum and asymptotic feasibility of the affine constraint.

Optimizes solving complex min-max problems with stochastic and nonconvex elements.

problem Min-max problems with stochastic and nonconvex elements.
method Combines conic nonexpansiveness, refined inexact Halpern iteration, and multilevel Monte Carlo estimator.
result Optimal or best-known complexity guarantees for $ρ< rac{1}{L}$, improving previous results.

We propose novel first-order stochastic approximation algorithms for canonical correlation analysis (CCA). Algorithms presented are instances of inexact matrix stochastic gradient (MSG) and inexact matrix exponentiated gradient (MEG), and achieve εε-suboptimality in the population objective in $\operatorname{poly}(\fr…

2017-02-22abs ↗pdf ↗

New DAM method improves AUC scores in medical image classification.

problem Maximizing AUC in large-scale medical image classification.
method Proposes AUC margin loss for robust optimization, conducts extensive empirical studies.
result Improves performance on four medical image classification tasks, achieving 1st place on Stanford CheXpert.

FairPOT balances fairness and AUC performance by selectively transforming risk scores.

problem Balancing fairness and AUC performance in high-stakes domains.
method FairPOT uses proportional optimal transport to selectively transform risk scores.
result FairPOT consistently improves fairness with minimal AUC degradation or even positive gains.

New models improve classification model performance, especially robust to small training sets.

problem Improving classification model performance, especially robust to small training sets.
method Distributionally robust AUC maximization models using Kantorovich metric and hinge loss function.
result The proposed DR-AUC models outperform standard models in general and worst-case out-of-sample performance.

Second order Sobolev metrics are a useful tool in the shape analysis of curves. In this paper we combine these metrics with varifold-based inexact matching to explore a new strategy of computing geodesics between unparametrized curves. We describe the numerical method used for solving the inexact matching problem, appl…

2017-06-06abs ↗pdf ↗

AUC (Area under the ROC curve) is an important performance measure for applications where the data is highly imbalanced. Learning to maximize AUC performance is thus an important research problem. Using a max-margin based surrogate loss function, AUC optimization problem can be approximated as a pairwise rankSVM learni…

2016-12-27abs ↗pdf ↗

AUC (area under ROC curve) is an important evaluation criterion, which has been popularly used in many learning tasks such as class-imbalance learning, cost-sensitive learning, learning to rank, etc. Many learning approaches try to optimize AUC, while owing to the non-convexity and discontinuousness of AUC, almost all …

2012-08-03abs ↗pdf ↗

The paper breaks down AUC into cluster-level components for better model diagnostics.

problem Global AUC masks weaknesses in specific subpopulations, leading to financial or operational risks.
method Formal decomposition of AUC into intra- and inter-cluster components, comparing with other performance metrics.
result Allows practitioners to evaluate and diagnose model performance within and across clusters.

This report examines the Pinned AUC metric introduced and highlights some of its limitations. Pinned AUC provides a threshold-agnostic measure of unintended bias in a classification model, inspired by the ROC-AUC metric. However, as we highlight in this report, there are ways that the metric can obscure different kinds…

2019-03-05abs ↗pdf ↗

The paper studies the solution of stochastic optimization problems in which approximations to the gradient and Hessian are obtained through subsampling. We first consider Newton-like methods that employ these approximations and discuss how to coordinate the accuracy in the gradient and Hessian to yield a superlinear ra…

2016-09-27abs ↗pdf ↗

Study optimizes decisions in real-time using inexact simulation solutions.

problem Real-time decision-making in simulation optimization with inexact solutions.
method Optimize then predict (OTP) approach, analyzing bias and variance in simulation-optimization algorithms.
result Unified analysis framework for OTP, establishing convergence rates and optimal allocation of computational budget.

Adequate evaluation of an information retrieval system to estimate future performance is a crucial task. Area under the ROC curve (AUC) is widely used to evaluate the generalization of a retrieval system. However, the objective function optimized in many retrieval systems is the error rate and not the AUC value. This p…

2015-11-16abs ↗pdf ↗

This work optimizes model performance while ensuring fairness through AUC constraints.

problem Ensuring fairness in machine learning models, especially for protected populations.
method Formulates fairness-aware machine learning model training as AUC optimization subject to fairness constraints, solves using stochastic first-order methods.
result Demonstrates effectiveness of the approach on real-world data under different fairness metrics.

Improved analysis for fair federated learning reduces dependence on noise floor.

problem Asymptotic stationarity in group fair federated learning with reduced noise floor dependence.
method DS FedProxGrad framework with inexact local proximal solutions and fairness regularization.
result Algorithm converges asymptotically to stationarity without dependence on a noise floor.

Stochastic AUC maximization has garnered an increasing interest due to better fit to imbalanced data classification. However, existing works are limited to stochastic AUC maximization with a linear predictive model, which restricts its predictive power when dealing with extremely complex data. In this paper, we conside…

2019-08-28abs ↗pdf ↗

The study examines the generalization of Macro-AUC in multi-label learning, identifying label imbalance as a critical factor.

problem Theoretical understanding of Macro-AUC in multi-label learning is lacking.
method Characterization of generalization properties of learning algorithms based on surrogate losses w.r.t. Macro-AUC, identification of label imbalance as a critical factor.
result The widely-used univariate loss-based algorithm is more sensitive to label imbalance than pairwise and reweighted loss-based ones, implying worse performance.

Area under ROC (AUC) is an important metric for binary classification and bipartite ranking problems. However, it is difficult to directly optimizing AUC as a learning objective, so most existing algorithms are based on optimizing a surrogate loss to AUC. One significant drawback of these surrogate losses is that they …

2018-04-16abs ↗pdf ↗

Inexact subgradient methods work well for semialgebraic functions with additive errors.

problem Approximate gradients in machine learning and optimization.
method Inexact subgradient methods with persistent additive errors in semialgebraic functions.
result Iterates eventually fluctuate near the critical set with a proximity of O(ερ)O(ε^ρ), where εε is the magnitude of subgradient evaluation errors.

Deep Convolutional Neural Networks (DCNN) has shown excellent performance in a variety of machine learning tasks. This manuscript presents Deep Convolutional Neural Fields (DeepCNF), a combination of DCNN with Conditional Random Field (CRF), for sequence labeling with highly imbalanced label distribution. The widely-us…

2015-11-17abs ↗pdf ↗