arXiv research

New algorithm controls type I error in NP classification under label noise.

We formulate statistical watermarking as hypothesis testing and establish near-optimal bounds.

Despite the great success of deep neural networks, the adversarial attack can cheat some well-trained classifiers by small permutations. In this paper, we propose another type of adversarial attack that can cheat classifiers by significant changes. For example, we can significantly change a face but well-trained neural…

Combines cost-sensitive and Neyman-Pearson paradigms for better binary classification.

The Neyman-Pearson (NP) paradigm in binary classification seeks classifiers that achieve a minimal type II error while enforcing the prioritized type I error controlled under some user-specified level $α$. This paradigm serves naturally in applications such as severe disease diagnosis and spam detection, where people h…

FactTest assesses LLM factuality with Type I error control.

Most existing binary classification methods target on the optimization of the overall classification risk and may fail to serve some real-world applications such as cancer diagnosis, where users are more concerned with the risk of misclassifying one specific class than the other. Neyman-Pearson (NP) paradigm was introd…

Motivated by problems of anomaly detection, this paper implements the Neyman-Pearson paradigm to deal with asymmetric errors in binary classification with a convex loss. Given a finite collection of classifiers, we combine them and obtain a new classifier that satisfies simultaneously the two following properties with …

DP synthetic data may inflate statistical test results, caution advised.

SONAR improves outlier detection for streaming data with strong theoretical guarantees.

Optimal classification rules control error rates in multiclass mixture models.

Gaussian graphical model is a graphical representation of the dependence structure for a Gaussian random vector. It is recognized as a powerful tool in different applied fields such as bioinformatics, error-control codes, speech language, information retrieval and others. Gaussian graphical model selection is a statist…

Study detects signals in spiked Wigner models using log likelihood ratio.

DP-SPRT improves privacy in sequential tests with near-optimal error rates.

In regression settings where explanatory variables have very low correlations and there are relatively few effects, each of large magnitude, we expect the Lasso to find the important variables with few errors, if any. This paper shows that in a regime of linear sparsity---meaning that the fraction of variables with a n…

New method uses CDMs to improve CI testing without distributional assumptions.

We characterize the asymptotic performance of nonparametric one- and two-sample testing. The exponential decay rate or error exponent of the type-II error probability is used as the asymptotic performance metric, and an optimal test achieves the maximum rate subject to a constant level constraint on the type-I error pr…

WHOMP optimizes randomized controlled trials by minimizing subgroup bias.

The paper tackles data misappropriation in LLMs by embedding watermarks and testing for their presence.

Strict type-II blowup in harmonic map flow is proven to have Hölder continuous body map.

Paper proves uniqueness of Type II Yamabe metrics on manifolds.

This paper addresses the challenges in classifying textual data obtained from open online platforms, which are vulnerable to distortion. Most existing classification methods minimize the overall classification error and may yield an undesirably large type I error (relevant textual messages are classified as irrelevant)…

In this paper, we study stability and instability problem for type-II partitioning problem. First, we make a complete classification of stable type-II stationary hypersurfaces in a ball in a space form as totally geodesic $n$-balls. Second, for general ambient spaces and convex domains, we give some topological restric…

This review explores resampling techniques for imbalanced binary classification.

Efficient tests achieve best error rates in high-dimensional hypothesis testing.

Improved generalization bounds for SGD in non-convex learning.

In this paper, we propose a generalized scale mixture family of distributions, namely the Power Exponential Scale Mixture (PESM) family, to model the sparsity inducing priors currently in use for sparse signal recovery (SSR). We show that the successful and popular methods such as LASSO, Reweighted $\ell_1$ and Reweigh…

Identifying statistical dependence between the features and the label is a fundamental problem in supervised learning. This paper presents a framework for estimating dependence between numerical features and a categorical label using generalized Gini distance, an energy distance in reproducing kernel Hilbert spaces (RK…

Formula derived for sample complexity in binary hypothesis testing.

The paper proves rigidity theorems for Type II singularities in Lagrangian flows.

New metrics boost A/B-test power by up to 210%.

Type II (ancient) solutions to the Ricci flow on surfaces are not yet classified. It is conjectured that the Rosenau solution and the cigar are the only solutions, modulo scaling. In this paper, we mainly study the backward limit and the circumference at spatial infinity of Type II ancient solutions on noncompact surfa…

We study almost-calibrated, $O(n)$-equivariant Lagrangian mean curvature flow in $\mathbb{C}^n$, and prove structural theorems about the Type I and Type II blowups of finite-time singularities. In particular, we prove that any Type I blowup of such a flow must be a special Lagrangian pair of transversely intersecting p…

Numerical simulations show stability of Type-II singularities in noncompact hypersurfaces.

Sparse linear (or generalized linear) models combine a standard likelihood function with a sparse prior on the unknown coefficients. These priors can conveniently be expressed as a maximization over zero-mean Gaussians with different variance hyperparameters. Standard MAP estimation (Type I) involves maximizing over bo…

We construct new type II ancient compact solutions to the Yamabe flow. Our solutions are rotationally symmetric and converge, as $t \to -\infty$, to a tower of two spheres. Their curvature operator changes sign. We allow two time-dependent parameters in our ansatz. We use perturbation theory, via fixed point arguments,…

Kernel tests assess equivalence between distributions without assuming specific moments.

We propose a nonparametric sequential test that aims to address two practical problems pertinent to online randomized experiments: (i) how to do a hypothesis test for complex metrics; (ii) how to prevent type $1$ error inflation under continuous monitoring. The proposed test does not require knowledge of the underlying…

We introduce an up-down coloring of a virtual-link diagram. The colorabilities give a lower bound of the minimum number of Reidemeister moves of type II which are needed between two 2-component virtual-link diagrams. By using the notion of a quandle cocycle invariant, we determine the necessity of Reidemeister moves of…

Adapts Neyman-Pearson classification for both source and target distribution shifts.

Kähler-Ricci flow shows type II singularity on Fano threefolds.

New methods improve inference after prediction without strong model assumptions.

We study the statistical decision process of detecting the signal from a `signal+noise' type matrix model with an additive Wigner noise. We propose a hypothesis test based on the linear spectral statistics of the data matrix, which does not depend on the distribution of the signal or the noise. The test is optimal unde…

In this paper we prove the existence of Type II singularities for the Ricci flow on $S^{n+1}$ for all $n\geq 2$.

A list of possible holonomy groups contained the exceptional, non-compact Lie group $\mathrm{G}_2^{*}$ was provided by Fino and Kath. The classification is due to the corresponding holonomy algebras and divided into Type I, II and III, depending on the dimension of the socle being 1,2 or 3, respectively. It was also sh…

New methods improve anomaly detection with reduced false positives.

Sharp 2-Wasserstein bounds for DDPMs derived from Föllmer process.

Entropy asymmetry affects regularization in ERM, leading to biased solutions.