Proposes a method for anomaly detection with inexact labels.
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
Trend · papers per month
The paper proposes methods to optimize pAUC for deep learning using DRO.
In machine learning research, the proximal gradient methods are popular for solving various optimization problems with non-smooth regularization. Inexact proximal gradient methods are extremely important when exactly solving the proximal operator is time-consuming, or the proximal operator does not have an analytic sol…
In this paper we present a convergence rate analysis of inexact variants of several randomized iterative methods. Among the methods studied are: stochastic gradient descent, stochastic Newton, stochastic proximal point and stochastic subspace ascent. A common feature of these methods is that in their update rule a cert…
Paper shows how gradient concentration helps in learning from inexact data.
New characterization limits sampling with inexact scores.
Inexact Riemannian optimization converges to stationary points efficiently.
Inexact acquisition solutions in BO lead to sublinear cumulative regret.
This paper analyzes the bias of inexact MCMC methods in high dimensions.
Evolutionary forms, as well as exterior forms, are skew-symmetric differential forms. But in contrast to the exterior forms, the basis of evolutionary forms is deforming manifolds (with unclosed metric forms). Such forms possess a peculiarity, namely, the closed inexact exterior forms are obtained from that. The closur…
New methods solve complex optimization problems in machine learning.
New algorithm solves phase retrieval with adaptive stopping criteria.
Maximizing the area under the receiver operating characteristic curve (AUC) is a standard approach to imbalanced classification. So far, various supervised AUC optimization methods have been developed and they are also extended to semi-supervised scenarios to cope with small sample problems. However, existing semi-supe…
Improves AUC for disadvantaged groups by adding features.
Paper proposes a new algorithm to minimize AUC disparities in machine learning models.
This paper surveys AUC maximization for big data and AI.
Modified AUC improves CNN training by considering model confidence.
New algorithm tackles complex optimization problems with inexact and stochastic methods.
Optimizes solving complex min-max problems with stochastic and nonconvex elements.
We propose novel first-order stochastic approximation algorithms for canonical correlation analysis (CCA). Algorithms presented are instances of inexact matrix stochastic gradient (MSG) and inexact matrix exponentiated gradient (MEG), and achieve -suboptimality in the population objective in $\operatorname{poly}(\fr…
New algorithm optimizes AUC for sparse high-dimensional data in online learning.
New DAM method improves AUC scores in medical image classification.
FairPOT balances fairness and AUC performance by selectively transforming risk scores.
New models improve classification model performance, especially robust to small training sets.
Second order Sobolev metrics are a useful tool in the shape analysis of curves. In this paper we combine these metrics with varifold-based inexact matching to explore a new strategy of computing geodesics between unparametrized curves. We describe the numerical method used for solving the inexact matching problem, appl…
AUC (Area under the ROC curve) is an important performance measure for applications where the data is highly imbalanced. Learning to maximize AUC performance is thus an important research problem. Using a max-margin based surrogate loss function, AUC optimization problem can be approximated as a pairwise rankSVM learni…
AUC (area under ROC curve) is an important evaluation criterion, which has been popularly used in many learning tasks such as class-imbalance learning, cost-sensitive learning, learning to rank, etc. Many learning approaches try to optimize AUC, while owing to the non-convexity and discontinuousness of AUC, almost all …
The paper breaks down AUC into cluster-level components for better model diagnostics.
This report examines the Pinned AUC metric introduced and highlights some of its limitations. Pinned AUC provides a threshold-agnostic measure of unintended bias in a classification model, inspired by the ROC-AUC metric. However, as we highlight in this report, there are ways that the metric can obscure different kinds…
In this paper, we consider the convergence of an abstract inexact nonconvex and nonsmooth algorithm. We promise a pseudo sufficient descent condition and a pseudo relative error condition, which are both related to an auxiliary sequence, for the algorithm; and a continuity condition is assumed to hold. In fact, a lot o…
The paper studies the solution of stochastic optimization problems in which approximations to the gradient and Hessian are obtained through subsampling. We first consider Newton-like methods that employ these approximations and discuss how to coordinate the accuracy in the gradient and Hessian to yield a superlinear ra…
In kernel methods, the kernels are often required to be positive definite, which restricts the use of many indefinite kernels. To consider those non-positive definite kernels, in this paper, we aim to build an indefinite kernel learning framework for kernel logistic regression. The proposed indefinite kernel logistic r…
Paper develops algorithms to maximize AUC in imbalanced classification.
The area under the ROC curve (AUC) is a widely used performance measure in machine learning. Increasingly, however, in several applications, ranging from ranking to biometric screening to medicine, performance is measured not in terms of the full area under the ROC curve, but in terms of the \emph{partial} area under t…
Study optimizes decisions in real-time using inexact simulation solutions.
Adequate evaluation of an information retrieval system to estimate future performance is a crucial task. Area under the ROC curve (AUC) is widely used to evaluate the generalization of a retrieval system. However, the objective function optimized in many retrieval systems is the error rate and not the AUC value. This p…
New algorithm improves convergence of AUC maximization.
This work optimizes model performance while ensuring fairness through AUC constraints.
DCC separates marginal estimation from dependence modeling for improved classification accuracy.
Improved analysis for fair federated learning reduces dependence on noise floor.
Augmentation improves machine learning model performance on small datasets.
Stochastic AUC maximization has garnered an increasing interest due to better fit to imbalanced data classification. However, existing works are limited to stochastic AUC maximization with a linear predictive model, which restricts its predictive power when dealing with extremely complex data. In this paper, we conside…
Proposes a stochastic method for solving trilevel optimization problems.
AUC is unreliable in rare event settings but stable with moderate numbers of events.
The study examines the generalization of Macro-AUC in multi-label learning, identifying label imbalance as a critical factor.
Area under ROC (AUC) is an important metric for binary classification and bipartite ranking problems. However, it is difficult to directly optimizing AUC as a learning objective, so most existing algorithms are based on optimizing a surrogate loss to AUC. One significant drawback of these surrogate losses is that they …
Inexact subgradient methods work well for semialgebraic functions with additive errors.
Deep Convolutional Neural Networks (DCNN) has shown excellent performance in a variety of machine learning tasks. This manuscript presents Deep Convolutional Neural Fields (DeepCNF), a combination of DCNN with Conditional Random Field (CRF), for sequence labeling with highly imbalanced label distribution. The widely-us…