Unified framework for Bayes-optimal classifiers under group fairness.
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
Trend · papers per month
New bounds for Neyman-Pearson region using -divergences.
New algorithm for precise changepoint localization without assumptions.
Adapts Neyman-Pearson classification for both source and target distribution shifts.
Combines cost-sensitive and Neyman-Pearson paradigms for better binary classification.
Neyman-Pearson testing improves goodness of fit in detecting new physics.
Characterizes distribution-free rates in unbalanced classification problems.
The paper tackles Neyman-Pearson classification control issues.
New method corrects bias in density ratio estimation for missing data.
Develops NPMC method for noisy labels, improving multiclass classification accuracy.
Develops algorithms for multi-class Neyman-Pearson classification with cost sensitivity.
Most existing binary classification methods target on the optimization of the overall classification risk and may fail to serve some real-world applications such as cancer diagnosis, where users are more concerned with the risk of misclassifying one specific class than the other. Neyman-Pearson (NP) paradigm was introd…
A neural network for online NP classification with reduced complexity.
Motivated by problems of anomaly detection, this paper implements the Neyman-Pearson paradigm to deal with asymmetric errors in binary classification with a convex loss. Given a finite collection of classifiers, we combine them and obtain a new classifier that satisfies simultaneously the two following properties with …
Optimal selective classification using likelihood ratios improves model reliability.
Motivated by optimal investment problems in mathematical finance, we consider a variational problem of Neyman-Pearson type for law-invariant robust utility functionals and convex risk measures. Explicit solutions are found for quantile-based coherent risk measures and related utility functionals. Typically, these solut…
In the problem of domain adaptation for binary classification, the learner is presented with labeled examples from a source domain, and must correctly classify unlabeled examples from a target domain, which may differ from the source. Previous work on this problem has assumed that the performance measure of interest is…
New algorithm controls type I error in NP classification under label noise.
Robust hypothesis testing designs a test for worst-case distributions using kernel methods.
Value-at-Risk (VaR) and Conditional Value-at-Risk (CVaR) are popular risk measures from academic, industrial and regulatory perspectives. The problem of minimizing CVaR is theoretically known to be of Neyman-Pearson type binary solution. We add a constraint on expected return to investigate the Mean-CVaR portfolio sele…
A new method validates generative models in high-dimensional data.
Paper introduces exact credible sets for classification problems.
Optimal classification requires choosing the right group symmetries, contrary to intuition.
This paper addresses the challenges in classifying textual data obtained from open online platforms, which are vulnerable to distortion. Most existing classification methods minimize the overall classification error and may yield an undesirably large type I error (relevant textual messages are classified as irrelevant)…
Robust test for distributions under Hellinger distance, simpler than optimal tests.
This paper proposes a novel optimization principle and its implementation for unsupervised anomaly detection in sound (ADS) using an autoencoder (AE). The goal of unsupervised-ADS is to detect unknown anomalous sound without training data of anomalous sound. Use of an AE as a normal model is a state-of-the-art techniqu…
Minimizes indecisions in selective classification to control misclassification rates.
New method improves certified robustness for classifier confidence.
We study nonzero-sum hypothesis testing games that arise in the context of adversarial classification, in both the Bayesian as well as the Neyman-Pearson frameworks. We first show that these games admit mixed strategy Nash equilibria, and then we examine some interesting concentration phenomena of these equilibria. Our…
Study tests whether trade-off functions are above or below benchmarks using finite samples.
Deep learning models are considered to be state-of-the-art in many offline machine learning tasks. However, many of the techniques developed are not suitable for online learning tasks. The problem of using deep learning models with sequential data becomes even harder when several loss functions need to be considered si…
The Neyman-Pearson (NP) paradigm in binary classification seeks classifiers that achieve a minimal type II error while enforcing the prioritized type I error controlled under some user-specified level . This paradigm serves naturally in applications such as severe disease diagnosis and spam detection, where people h…
The issue of constructing a risk minimizing hedge under an additional almost-surely type constraint on the shortfall profile is examined. Several classical risk minimizing problems are adapted to the new setting and solved. In particular, the bankruptcy threat of optimal strategies appearing in the classical risk minim…
Develops methods for fair classification under linear disparity constraints.
We compute exact values respectively bounds of "distances" - in the sense of (transforms of) power divergences and relative entropy - between two discrete-time Galton-Watson branching processes with immigration GWI for which the offspring as well as the immigration is arbitrarily Poisson-distributed (leading to arbitra…
Environmental acoustic sensing involves the retrieval and processing of audio signals to better understand our surroundings. While large-scale acoustic data make manual analysis infeasible, they provide a suitable playground for machine learning approaches. Most existing machine learning techniques developed for enviro…
In this work we address the problem of argument search. The purpose of argument search is the distillation of pro and contra arguments for requested topics from large text corpora. In previous works, the usual approach is to use a standard search engine to extract text parts which are relevant to the given topic and su…
New algorithm detects outliers from rare abnormal data.
A novel unified Bayesian framework for network detection is developed, under which a detection algorithm is derived based on random walks on graphs. The algorithm detects threat networks using partial observations of their activity, and is proved to be optimum in the Neyman-Pearson sense. The algorithm is defined by a …
This paper studies the concept of instantaneous arbitrage in continuous time and its relation to the instantaneous CAPM. Absence of instantaneous arbitrage is equivalent to the existence of a trading strategy which satisfies the CAPM beta pricing relation in place of the market. Thus the difference between the arbitrag…
Model change detection is studied, in which there are two sets of samples that are independently and identically distributed (i.i.d.) according to a pre-change probabilistic model with parameter , and a post-change model with parameter , respectively. The goal is to detect whether the change in the model is sign…
With the advancement in argument detection, we suggest to pay more attention to the challenging task of identifying the more convincing arguments. Machines capable of responding and interacting with humans in helpful ways have become ubiquitous. We now expect them to discuss with us the more delicate questions in our w…
Simplified argument for second order estimate in quaternionic Calabi-Yau problem.
Study benchmarks TSC algorithms in distinguishing diffusions using the likelihood ratio test.
This is a continuation of our first paper in [WY16]. There are two purposes of this paper: One is to give a proof of the main result in [WY16] without going through the argument depending on numerical effectiveness. The other one is to provide a proof of our conjecture, mentioned in [TY], where the assumption of negati…
For -holomorphic mappings for a strongly pseudo-convex manifold, we prove elliptic regularity by the argument of boots-strapping.
SpArX creates faithful explanations of neural networks' decision-making.
Killing fields on compact pseudo-Kähler manifolds are holomorphic.