Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,695 papers · 148 categories

Trend · papers per month

67135202269 · Jun 202019922001200920172026
48 results for Type-II error

We formulate statistical watermarking as hypothesis testing and establish near-optimal bounds.

problem Statistical watermarking in the context of hypothesis testing.
method Formulated as a hypothesis testing problem, using coupling of output tokens and rejection regions.
result Established nearly matching upper and lower bounds on the number of i.i.d. tokens required for small Type I and Type II errors.

Despite the great success of deep neural networks, the adversarial attack can cheat some well-trained classifiers by small permutations. In this paper, we propose another type of adversarial attack that can cheat classifiers by significant changes. For example, we can significantly change a face but well-trained neural…

2018-09-03abs ↗pdf ↗

The Neyman-Pearson (NP) paradigm in binary classification seeks classifiers that achieve a minimal type II error while enforcing the prioritized type I error controlled under some user-specified level αα. This paradigm serves naturally in applications such as severe disease diagnosis and spam detection, where people h…

2018-02-07abs ↗pdf ↗

Optimal classification rules control error rates in multiclass mixture models.

problem Classifying observations in multiclass mixture models while controlling error rates.
method Finding optimal classification rules by searching an optimal region in the observation space, using Maximum A Posteriori (MAP) rule and heuristic computation.
result The FDR-like optimal rule can be significantly less conservative than thresholded MAP rules.

We characterize the asymptotic performance of nonparametric one- and two-sample testing. The exponential decay rate or error exponent of the type-II error probability is used as the asymptotic performance metric, and an optimal test achieves the maximum rate subject to a constant level constraint on the type-I error pr…

2019-08-27abs ↗pdf ↗

DP synthetic data may inflate statistical test results, caution advised.

problem Inflated Type I errors in statistical tests on DP-synthetic data.
method Evaluation of Mann-Whitney U test, t-test, chi-squared test, and median test on DP-synthetic data generated from real-world and simulated datasets using various DP-synthetic data generation methods.
result A large portion of evaluation results showed inflated Type I errors, especially at low privacy levels.

FactTest assesses LLM factuality with Type I error control.

problem Lack of rigorous factuality verification for LLMs.
method Formulates factuality testing as hypothesis testing, ensuring Type I and II error control.
result Improves model accuracy by over 40% in abstaining from unknown questions.

DP-SPRT improves privacy in sequential tests with near-optimal error rates.

problem Privacy constraints in sequential probability ratio tests.
method A wrapper for SPRT that uses a private mechanism to determine when to stop based on predefined intervals.
result DP-SPRT achieves near-optimal error rates and privacy guarantees.

In regression settings where explanatory variables have very low correlations and there are relatively few effects, each of large magnitude, we expect the Lasso to find the important variables with few errors, if any. This paper shows that in a regime of linear sparsity---meaning that the fraction of variables with a n…

2015-11-05abs ↗pdf ↗

Study detects signals in spiked Wigner models using log likelihood ratio.

problem Detecting signals in rank-one spiked Wigner models with non-Gaussian noise.
method Proved asymptotic normality of log likelihood ratio and computed error thresholds.
result Optimal signal-to-noise ratio threshold for reliable detection.

Kernel tests assess equivalence between distributions without assuming specific moments.

problem Traditional goodness-of-fit tests fail to detect meaningful distributional differences.
method Proposes kernel-based tests using kernel Stein discrepancy and Maximum Mean Discrepancy.
result Tests assess the absence of meaningful distributional differences under controlled error rates.

Gaussian graphical model is a graphical representation of the dependence structure for a Gaussian random vector. It is recognized as a powerful tool in different applied fields such as bioinformatics, error-control codes, speech language, information retrieval and others. Gaussian graphical model selection is a statist…

2017-01-09abs ↗pdf ↗

We construct new type II ancient compact solutions to the Yamabe flow. Our solutions are rotationally symmetric and converge, as tt \to -\infty, to a tower of two spheres. Their curvature operator changes sign. We allow two time-dependent parameters in our ansatz. We use perturbation theory, via fixed point arguments,…

2012-09-25abs ↗pdf ↗

Improved generalization bounds for SGD in non-convex learning.

problem Understanding generalization properties of SGD in non-convex settings.
method Introducing Type II perturbed SGD (T2pm-SGD) to analyze generalization error bounds.
result Tighter generalization error bounds for SGD in non-convex learning, especially for sub-Gaussian and bounded loss functions.

The paper tackles data misappropriation in LLMs by embedding watermarks and testing for their presence.

problem Detecting data misappropriation in LLMs trained on copyrighted data.
method Embedding watermarks, formulating as hypothesis testing, developing statistical framework, constructing test statistics, determining optimal thresholds, controlling errors, establishing asymptotic optimality.
result The proposed statistical testing framework effectively detects data misappropriation in LLMs.

In this paper, we study stability and instability problem for type-II partitioning problem. First, we make a complete classification of stable type-II stationary hypersurfaces in a ball in a space form as totally geodesic nn-balls. Second, for general ambient spaces and convex domains, we give some topological restric…

2019-02-25abs ↗pdf ↗

The paper proves rigidity theorems for Type II singularities in Lagrangian flows.

problem Understanding Type II singularities in Lagrangian flows with zero Maslov class.
method Rigidity theorems for blow-up limits of Type II singularities.
result Generalized previous results from 2D to arbitrary dimensions.

Identifying statistical dependence between the features and the label is a fundamental problem in supervised learning. This paper presents a framework for estimating dependence between numerical features and a categorical label using generalized Gini distance, an energy distance in reproducing kernel Hilbert spaces (RK…

2019-06-05abs ↗pdf ↗

Motivated by problems of anomaly detection, this paper implements the Neyman-Pearson paradigm to deal with asymmetric errors in binary classification with a convex loss. Given a finite collection of classifiers, we combine them and obtain a new classifier that satisfies simultaneously the two following properties with …

2011-02-28abs ↗pdf ↗

Type II (ancient) solutions to the Ricci flow on surfaces are not yet classified. It is conjectured that the Rosenau solution and the cigar are the only solutions, modulo scaling. In this paper, we mainly study the backward limit and the circumference at spatial infinity of Type II ancient solutions on noncompact surfa…

2006-11-10abs ↗pdf ↗

This review explores resampling techniques for imbalanced binary classification.

problem Imbalanced classes lead to poor prediction results in classification.
method Classical, cost-sensitive, and Neyman-Pearson paradigms with resampling techniques and classification methods.
result Complex dynamics among resampling techniques, base methods, metrics, and imbalance ratios.

New method uses CDMs to improve CI testing without distributional assumptions.

problem Testing conditional independence when the conditional distribution is unknown.
method Uses conditional diffusion models (CDMs) to approximate XZX|Z and a classifier-based CMI estimator.
result Proposed method performs better than GAN-based CI tests and controls type I and II errors.

In this paper, we prove that any solution of Kähler-Ricci flow on a Fano compactification MM of semisimple complex Lie group, is of type II, if MM admits no Kähler-Einstein metrics. As an application, we found two Fano compactifications of SO4(C)\mathrm{SO}_4(\mathbb{C}) and one Fano compactification of $\mathrm{Sp}_4(\m…

2018-07-24abs ↗pdf ↗

Sparse linear (or generalized linear) models combine a standard likelihood function with a sparse prior on the unknown coefficients. These priors can conveniently be expressed as a maximization over zero-mean Gaussians with different variance hyperparameters. Standard MAP estimation (Type I) involves maximizing over bo…

2012-07-10abs ↗pdf ↗

Numerical simulations show stability of Type-II singularities in noncompact hypersurfaces.

problem Stability of Type-II singularities in noncompact hypersurfaces with rotationally-symmetric perturbations.
method Adaptation of the overlap method to include angular dependence.
result MCF of noncompact hypersurfaces with angular dependence behaves similarly to rotationally-symmetric perturbations, developing Type-II or Type-I singularities.

We study almost-calibrated, O(n)O(n)-equivariant Lagrangian mean curvature flow in Cn\mathbb{C}^n, and prove structural theorems about the Type I and Type II blowups of finite-time singularities. In particular, we prove that any Type I blowup of such a flow must be a special Lagrangian pair of transversely intersecting p…

2019-10-14abs ↗pdf ↗

We study the geometry of type II supergravity compactifications in terms of an oriented vector bundle EE, endowed with a bundle metric of split signature and further datum. The geometric structure is associated with a so-called generalised GG-structure and characterised by an EE-spinor ρρ, which we can regard as a …

2006-10-11abs ↗pdf ↗

Study shows different behaviors of noncompact hypersurfaces under mean curvature flow.

problem Analyzing stability of noncompact hypersurfaces with curvature blowup.
method Numerical overlap method to construct global solutions.
result Existence of near and far classes of initial data leading to distinct behaviors.

Ancient solutions of Lagrangian mean curvature flow in C^n naturally arise as Type II blow-ups. In this extended note we give structural and classification results for such ancient solutions in terms of their blow-down and, motivated by the Thomas-Yau Conjecture, focus on the almost calibrated case. In particular, we c…

2019-01-16abs ↗pdf ↗

The study lifts certain Sasakian manifolds to quasi-Einstein spacetimes.

problem Understanding lifts of Sasakian manifolds to quasi-Einstein spacetimes.
method Analyzing smooth Sasakian manifolds and their lifts to 4D quasi-Einstein spacetimes.
result Smooth Sasakian manifolds can be lifted to quasi-Einstein shearfree spacetimes of Petrov type II or D.

The first part of these notes is a self-contained introduction to generalized complex geometry. It is intended as a `user manual' for tools used in the study of supersymmetric backgrounds of supergravity. In the second part we review some past and recent results on the generalized complex structure of supersymmetric ty…

2016-06-28abs ↗pdf ↗

We consider the weak detection problem in a rank-one spiked Wigner data matrix where the signal-to-noise ratio is small so that reliable detection is impossible. We propose a hypothesis test on the presence of the signal by utilizing the linear spectral statistics of the data matrix. The test is data-driven and does no…

2018-09-28abs ↗pdf ↗

Most existing binary classification methods target on the optimization of the overall classification risk and may fail to serve some real-world applications such as cancer diagnosis, where users are more concerned with the risk of misclassifying one specific class than the other. Neyman-Pearson (NP) paradigm was introd…

2015-08-13abs ↗pdf ↗

In previous work, Angenent, Isenberg, and Knopf created type-II Ricci flow neckpinch singularities. In this paper we construct solutions to Ricci flow whose initial data is the singular metric resulting from these singularities. We show in particular that the curvature decreases at the same rate at which it blew up. Th…

2014-11-13abs ↗pdf ↗