New test detects sparse alternatives in Gaussian random fields.
problem Detecting sparse alternatives in Gaussian random fields.
method Ad-hoc Kac Rice formula for second maximum distribution, exact spacing test.
result Exact t-spacing test for high power in detecting sparse alternatives. Proves sufficiency of countable test plans for BV functions on metric spaces.
problem Recovering BV functions and their measures on arbitrary metric spaces.
method Proves sufficiency of countable test plans on arbitrary metric measure spaces and geodesics on CD(K,N) spaces. result Countable test plans are sufficient for BV functions and their measures on metric spaces.
New theoretical tools simplify kernel-based tests analysis.
problem Asymptotic behavior of kernel-based tests in various scenarios.
method Avoids complex expansions and limit theorems, works directly with Hilbert spaces random functionals.
result Framework leads to simpler analysis with minimal regularity conditions.
New KCM tests improve specification testing via RKHS.
problem Improving specification tests for econometric models.
method Kernel conditional moment (KCM) tests based on RKHS.
result KCM tests have better finite-sample performance than existing tests.
Weighted log-rank tests are arguably the most widely used tests by practitioners for the two-sample problem in the context of right-censored data. Many approaches have been considered to make weighted log-rank tests more robust against a broader family of alternatives, among them, considering linear combinations of wei…
A probabilistic framework for online test-time adaptation
problem Adapting models to new data under distributional shift
method State-space modelling architecture
result Characterizing parameter learning, time evolution, prior tuning, and prediction
Neural network accuracy improves with denser training samples.
problem Improving neural network accuracy on unseen test samples.
method Bounding empirical training error smoothed across activation regions and using it to discard high-risk test samples.
result Discarding high-risk test samples based on error bounds improves prediction accuracy by up to 20%.
A test for comparing function samples using MMD.
problem Testing if two functional data samples come from the same distribution.
method Maximum Mean Discrepancy (MMD) for functional data, with theoretical scaling analysis.
result The proposed test is effective and robust to functional reconstructions.
Paper develops a minimax optimal test for goodness-of-fit using kernel Stein discrepancy.
problem Developing a robust goodness-of-fit test for general domains.
method Kernel Stein Discrepancy (KSD) with spectral regularization and adaptive testing.
result Proposed regularized test achieves minimax optimality up to a logarithmic factor.
New extremal metrics found on Kähler manifolds.
problem Constructing extremal metrics on Kähler manifolds.
method Test configurations for strictly semistable Kähler manifolds.
result Infinitely many new examples of manifolds with extremal Kähler metrics.
This paper proposes a method to generate realistic test cases for image classifiers.
problem Ensuring neural networks for image classification are correct with adequate realistic test data.
method Captures patterns in a large input data space using a manifold, then generates fault-revealing test cases.
result Generates thousands of realistic yet fault-revealing test cases efficiently for well-trained models.
We study the problem of distinguishing between two distributions on a metric space; i.e., given metric measure spaces (X,d,μ1) and (X,d,μ2), we are interested in the problem of determining from finite data whether or not μ1 is μ2. The key is to use pairwise distances between observat…
New tests for distributional causal effects using improved kernel estimators.
problem Testing for higher-order moments and multidimensional outcomes affected by treatment.
method Improved kernel estimators based on doubly robust mean embeddings.
result New permutation-based tests for distributional causal effects with improved convergence rates.
Geodesic rays and chordal distances link algebraic and geometric properties of positive metrics.
problem Understanding the geometry of the space of positive metrics at infinity.
method Using Monge-Ampère equations and test configurations, algebraic descriptions of geodesic rays and chordal distances are derived.
result The Mabuchi chordal distance between geodesic rays associated with ample test configurations equals the spectral distance between their filtrations.
This paper shows how to construct sequential tests with power one against weakly compact sets in Polish spaces.
problem Testing composite null hypotheses involving weakly compact sets in Polish spaces.
method Develops sequential tests for i.i.d. laws in Polish spaces, providing a sufficient condition for power one.
result Power-one sequential tests exist for weakly compact sets against their complements in i.i.d. laws in Polish spaces.
A new screening test for Lasso improves solution speed.
problem Improving the efficiency of Lasso solution methods.
method Safe region with dome geometry based on dual cutting half-spaces.
result The new screening test leads to significant acceleration.
A new kernel-based CI test improves on existing methods.
problem Testing conditional independence (CI) in a broad range of dependencies.
method Regression-model-agnostic kernel-based CI test using reproducing kernel Hilbert spaces.
result GKCM outperforms state-of-the-art CI tests in simulations.
Reduces identity testing of reversible Markov chains to simpler symmetric chain tests.
problem Testing identity of reversible Markov chains from a single trajectory.
method Using lumping-congruent Markov embeddings, the problem is simplified to testing symmetric chains over a larger state space.
result Achieves state-of-the-art sample complexity for identity testing.
The reproducing kernel Hilbert space (RKHS) embedding of distributions offers a general and flexible framework for testing problems in arbitrary domains and has attracted considerable amount of attention in recent years. To gain insights into their operating characteristics, we study here the statistical performance of…
sig-MMD tests compare path distributions using kernel methods.
problem Comparing path distributions in stochastic processes.
method Signature kernel for path space valued distributions.
result sig-MMD can lead to Type 2 errors in limited data settings.
MNIST and Fashion MNIST are extremely popular for testing in the machine learning space. Fashion MNIST improves on MNIST by introducing a harder problem, increasing the diversity of testing sets, and more accurately representing a modern computer vision task. In order to increase the data quality of FashionMNIST, this …
We introduce kernel nonparametric tests for Lancaster three-variable interaction and for total independence, using embeddings of signed measures into a reproducing kernel Hilbert space. The resulting test statistics are straightforward to compute, and are used in powerful interaction tests, which are consistent against…
We propose to investigate test statistics for testing homogeneity in reproducing kernel Hilbert spaces. Asymptotic null distributions under null hypothesis are derived, and consistency against fixed and local alternatives is assessed. Finally, experimental evidence of the performance of the proposed approach on both ar…
For smooth test configurations, there always exist C^{1,1} geodesic rays in Kahler metric space parallel to the algebraic ray. The ¥ invariant agrees with Futaki invariant, at least under nice assumptions. Explicit examples in Toric cases are calculated. On simple test configurations, Donaldson's correspondence be…
Paper proposes a framework to detect distribution shifts using embedding space geometry.
problem Detecting distribution shifts in candidate datasets to improve model generalizability.
method Non-parametric framework using embedding space geometry for two tests: robustness boundary and in-distribution/out-of-distribution classification.
result Both tests successfully detect distribution shifts in various scenarios for both synthetic and real-world datasets.
Two-sample tests improve on existing methods for microtubule data.
problem Testing differences between two groups of filament data.
method Optimal lifts and manifold stability theorem applied to microtubule data.
result New tests outperform existing methods on simulated and real data.
Develops a new method for neural network significance testing without strict constraints.
problem Testing neural networks without bounded weights or specific architectural constraints.
method Uses Rademacher complexity bounds, weakened Sobolev space membership conditions, and a modified sieve space construction.
result Achieves optimal convergence rates and valid asymptotic distributions for test statistics.
New test uses neural networks to compare distributions, outperforming traditional methods.
problem Comparing distributions in high dimensions and higher orders of smoothness.
method Integral probability metrics with Radon bounded variation functions and neural networks.
result The Radon-Kolmogorov-Smirnov (RKS) test outperforms traditional methods in distinguishing distributions.
We propose a new method to evaluate GANs, namely EvalGAN. EvalGAN relies on a test set to directly measure the reconstruction quality in the original sample space (no auxiliary networks are necessary), and it also computes the (log)likelihood for the reconstructed samples in the test set. Further, EvalGAN is agnostic t…
A statistical test of independence may be constructed using the Hilbert-Schmidt Independence Criterion (HSIC) as a test statistic. The HSIC is defined as the distance between the embedding of the joint distribution, and the embedding of the product of the marginals, in a Reproducing Kernel Hilbert Space (RKHS). It has …
Unified framework combines dependent microbiome tests.
problem Combining dependent microbiome association tests.
method Generalized meta-analysis framework for dependent tests.
result The vanilla Cauchy combination is a special case.
A new test assesses how well observed networks fit a specified ERGM model.
problem Testing the goodness of fit for ERGMs with a single network observation.
method Kernel Stein discrepancy combined with a discrete Stein operator for ERGMs, Monte Carlo simulation.
result The test provides theoretical and practical support for assessing ERGM fit.
A new test detects non-linear independence in censored survival data.
problem Detecting non-linear independence between survival times and covariates.
method A kernel log-rank test using reproducing kernel Hilbert spaces.
result The test correctly rejects the null hypothesis under any alternative.
New test for comparing high-dimensional text data.
problem Testing equality of multinomial distributions in high dimensions.
method Proposed a test statistic with asymptotic normality under null.
result Achieves optimal detection boundary across parameter space.
Kernel embeddings separate distinct probability distributions, simplifying testing.
problem Testing equality of non-atomic probability distributions.
method Kernel covariance embeddings and Gaussian measures in reproducing kernel Hilbert spaces.
result Testing for singularity between Gaussian measures is equivalent to testing for equality of non-atomic probability distributions.
Proves properness of K-moduli spaces for Fano varieties.
problem Proving properness of moduli spaces of K-polystable Fano varieties.
method Algebraic approach, studying test configurations, constructing stratification.
result Proves properness under specific divisorial valuation condition.
Optimizes two-sample tests for non-Euclidean domains using spectral regularization.
problem Optimizing two-sample tests for non-Euclidean domains.
method Spectral regularization of MMD test to achieve minimax optimality.
result Proposes a spectral regularization method that improves test optimality.
Deep neural nets optimize kernel parameters for non-parametric two-sample tests.
problem Determining if two samples come from the same distribution.
method Deep kernels trained to maximize test power, adapting to distribution smoothness and shape.
result Deep kernels outperform simpler kernels in high dimensions and complex data.
The paper classifies equivariant test configurations for spherical varieties.
problem Classifying equivariant test configurations for spherical varieties.
method Combinatorial data classification of equivariant normal R-test configurations.
result Finiteness theorem of central fibers of G-equivariant special R-test configurations.
Neural network architectures found by sophistic search algorithms achieve strikingly good test performance, surpassing most human-crafted network models by significant margins. Although computationally efficient, their design is often very complex, impairing execution speed. Additionally, finding models outside of the …
STAD adapts models to evolving time-based data shifts.
problem Gradual distribution shifts over time challenge existing test-time adaptation methods.
method Bayesian filtering method that learns time-varying dynamics in hidden features.
result STAD excels in handling small batch sizes and label shift on real-world data.
We consider the problem of asynchronous online testing, aimed at providing control of the false discovery rate (FDR) during a continual stream of data collection and testing, where each test may be a sequential test that can start and stop at arbitrary times. This setting increasingly characterizes real-world applicati…
We establish an integral test describing the exact cut-off between recurrence and transience for normally reflected Brownian motion in certain unbounded domains in a class of warped product manifolds. Besides extending a previous result by R. Pinsky, who treated the case in which the ambient space is flat, our result r…
New tests for VaR and ES forecast encompassing using flexible link functions.
problem Testing forecast encompassing for Value at Risk and Expected Shortfall.
method Flexible link functions for testing convex forecast combinations and nonstandard asymptotic theory for boundary parameters.
result Tests based on new link functions outperform unrestricted linear link functions for one-step and multi-step forecasts.
We propose a class of nonparametric two-sample tests with a cost linear in the sample size. Two tests are given, both based on an ensemble of distances between analytic functions representing each of the distributions. The first test uses smoothed empirical characteristic functions to represent the distributions, the s…
Study shows optimal rates for independence testing via U-statistic permutation tests.
problem Developing a valid test of independence for pairs with additional smoothness constraints.
method Defining a measure of dependence, using a permutation test based on a basis expansion and U-statistic estimator.
result Proves minimax optimality of the test in separation rates for certain cases.
Constraint-based (CB) learning is a formalism for learning a causal network with a database D by performing a series of conditional-independence tests to infer structural information. This paper considers a new test of independence that combines ideas from Bayesian learning, Bayesian network inference, and classical hy…
We propose a nonparametric statistical test for goodness-of-fit: given a set of samples, the test determines how likely it is that these were generated from a target density function. The measure of goodness-of-fit is a divergence constructed via Stein's method using functions from a Reproducing Kernel Hilbert Space. O…