Proves Gerber statistic is always non-negative.
problem Verifying the positive semi-definiteness of Gerber statistic.
method Analytical proof of both forms of Gerber statistic.
result Gerber statistic is positive semi-definite.
On-device research index
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
168,657 papers · 148 categories
Trend · papers per month
48 results for “statistical proof”
New model shows hierarchical proof structure helps theorem provers.
problem How to efficiently learn proofs from teacher traces.
method Model proof search as MDP, analyze imitation learning from traces.
result Hierarchical proof structure leads to more efficient learning.
Why Agentic Theorem Prover Works: A Statistical Provability Theory of Mathematical Reasoning Modelsstat.ML
Study improves understanding of why agentic theorem provers succeed.
problem Understanding which components of agentic theorem provers improve proof success.
method Statistical provability theory and finite-horizon reachability MDP model.
result Bounds provability gap and explains components' effectiveness.
Proofs Fisher-Rao distance on Gaussian covariance manifold.
problem Proving Fisher-Rao distance on Gaussian covariance manifold.
method Basic Riemannian geometry.
result Proof of Fisher-Rao distance on covariance cone.
We clarify measurability assumptions in the agnostic PAC learning theorem.
problem Measurability assumptions in the Fundamental Theorem of Statistical Learning.
method Measure-theoretic scrutiny of existing proofs to extract minimal assumptions.
result Sound statement and detailed proof of the Fundamental Theorem in the agnostic setting.
The Bonnet theorem is proven for statistical manifolds.
problem Locally embeddable statistical manifolds in flat spaces.
method Using statistical embedding and the Gauss--Codazzi--Ricci equations.
result Statistical manifolds with specific tensor properties are locally embeddable to flat statistical manifolds.
Paper develops PAC verification for hypothesis classes and statistical algorithms.
problem Verifying machine learning models interactively.
method Develops interactive proof for PAC verification, proves lower bounds, and introduces a generalization.
result Improved protocol for verifying unions of intervals and statistical query algorithms.
GOE statistics emerge from surface moduli space averages.
problem Understanding spectral statistics on hyperbolic surfaces.
method Defined a smooth linear statistic, averaged over moduli space, and analyzed variance.
result GOE statistics are recovered in the large genus and high energy limits.
In the first half of 2018, the Federal Statistical Office of Germany (Destatis) carried out a "Proof of Concept Machine Learning" as part of its Digital Agenda. A major component of this was surveys on the use of machine learning methods in official statistics, which were conducted at selected national and internationa…
Efficient Mean Estimation with Pure Differential Privacy via a Sum-of-Squares Exponential Mechanismcs.DS
Polynomial-time algorithm estimates mean with bounded covariance using differential privacy.
problem Estimating mean of a d-variate distribution with differential privacy constraints.
method Sum of Squares (SoS) exponential mechanism for polynomial-time differentially private estimation.
result First polynomial-time algorithm with samples for mean estimation under pure differential privacy.
The new field of adaptive data analysis seeks to provide algorithms and provable guarantees for models of machine learning that allow researchers to reuse their data, which normally falls outside of the usual statistical paradigm of static data analysis. In 2014, Dwork, Feldman, Hardt, Pitassi, Reingold and Roth introd…
New method combines score lists using joint CDFs, improving computation.
problem Combining non-comparable score lists over a common index set.
method New algorithm for computing joint CDF values, linear runtime.
result Improved computation of joint CDF values for N-dimensional order statistics.
Simplified proof for approximations of set systems.
problem Approximations of set systems in various fields.
method Modular, self-contained proof using Chernoff's bound.
result Accessible proof for a wider audience.
Deep learning used for parameter estimation in hard-to-infer models.
problem Parameter estimation in intractable models like max-stable processes.
method Train deep neural networks on simulated data to estimate parameters.
result Deep learning provides accurate and faster parameter estimation.
Estimation is the computational task of recovering a hidden parameter associated with a distribution , given a measurement sampled from the distribution. High dimensional estimation problems arise naturally in statistics, machine learning, and complexity theory. Many high dimensional estimation problems ca…
Chentsov's theorem characterizes the Fisher information metric on statistical models as essentially the only Riemannian metric that is invariant under sufficient statistics. This implies that each statistical model is naturally equipped with a geometry, so Chentsov's theorem explains why many statistical properties can…
Lecture notes on advanced linear regression methods.
problem Understanding the properties of linear regression estimators in high dimensions.
method Proposition-proof exploration of least squares, ridgeless, ridge, and lasso estimators.
result Detailed analysis of the existence, uniqueness, relations, computation, and non-asymptotic properties of these estimators.
New concentration inequality for U-statistics of Markov chains.
problem Proving a concentration inequality for U-statistics of order two in uniformly ergodic Markov chains.
method Inductive analysis using martingale techniques, uniform ergodicity, Nummelin splitting, and Bernstein's inequality.
result Recovery of convergence rate for U-statistics of independent random variables and canonical kernels, with improved results for dependent kernels.
Unified framework for AMP iterations using graph indexing.
problem Complex high-dimensional statistical inference problems.
method Graph-based indexing of AMP iterations, modular proof of state evolution.
result Unified SE equations for AMP iterations indexed by graphs.
Modified relative universality for unbiasedness and consistency in dimension reduction.
problem Gap in proof of unbiasedness and Fisher consistency in relative universality.
method Modified definition of relative universality using ǫ-measurability.
result Established unbiasedness and Fisher consistency rigorously.
The paper provides bounds for high-dimensional U-statistics with novel order-explicit inequalities.
problem Bounding the deviation of high-dimensional U-statistics from their Hájek projections.
method Develops novel order-explicit moment inequalities for higher-order Hoeffding components.
result The maximum deviation of a high-dimensional U-statistic from its Hájek projection is of order .
Range penalization enhances statistical accuracy and resource efficiency in federated learning.
problem Statistical accuracy and resource efficiency in federated learning.
method Range regularization and polar clustering.
result Enhanced statistical accuracy and reduced iteration complexity.
Paper proposes a statistical test for feature selection pipelines using selective inference.
problem Assessing the significance of feature selection pipelines in data analysis.
method Selective inference technique applied to feature selection pipelines composed of various algorithms.
result The proposed statistical test controls false positive feature selection probabilities.
This research simplifies verification of machine learning systems using reparameterization.
problem Reduce or eliminate serious bugs in machine learning systems.
method Use proof assistants to construct machine-checked proofs of correctness, leveraging reparameterization to handle probabilistic claims.
result Demonstrates broad applicability of reparameterization to verify different types of machine learning systems.
Quantum statistical models with singularities are studied for state estimation and model selection.
problem Understanding statistical properties of quantum singular models.
method Classical singular learning theory extended to quantum state estimation and model selection using algebraic geometrical methods.
result Asymptotically unbiased estimator (QWAIC) for quantum generalization loss constructed.
Study proposes a statistical testing framework for evaluating clustering pipelines.
problem Quantifying the statistical reliability of clustering results from data analysis pipelines.
method Selective inference-based statistical testing framework for clustering pipelines.
result The proposed test controls the type I error rate and is effective in validating clustering results.
The minimum message length principle is an information theoretic criterion that links data compression with statistical inference. This paper studies the strict minimum message length (SMML) estimator for -dimensional exponential families with continuous sufficient statistics, for all . The partition of an …
Paper solves outlier robust mean estimation near breakdown point.
problem Estimating mean in presence of adversarial outliers.
method Sum-of-Squares approach to optimize error rate efficiently.
result Achieves optimal error rate for all ε ∈ [0, 1/2).
Bayesian method improves star location and flux estimation from coadded images.
problem Statistical analysis of coadded astronomical images is complicated by pixel dependence.
method Bayesian approach that implicitly marginalizes single-exposure pixel intensities.
result Method outperforms single-exposure image training for star parameter estimation.
Improved Nyström approximation for kernel quadrature with theoretical guarantees.
problem Efficiently approximating positive definite kernels for large datasets.
method Refined sampling and subspace selection in Nyström approximation.
result Novel theoretical guarantees for non-i.i.d. landmark points in kernel quadrature.
New computational lower bounds for clustering and related problems.
problem Statistical-computational gaps in high-dimensional clustering problems.
method Investigation of low-degree polynomials in latent space models to derive lower bounds.
result New and sharper computational lower bounds for clustering, sparse clustering, and biclustering.
This work provides a simplified proof of the statistical minimax optimality of (iterate averaged) stochastic gradient descent (SGD), for the special case of least squares. This result is obtained by analyzing SGD as a stochastic process and by sharply characterizing the stationary covariance matrix of this process. The…
This thesis consists of two independent parts: random matrices, which form the first one-third of this thesis, and machine learning, which constitutes the remaining part. The main results of this thesis are as follows: a necessary and sufficient condition for the inverse moments of -Laguerre matrices and compo…
New methods tackle statistical inverse problems with random data.
problem Statistical inverse problems with random experimental design.
method Spectral regularization, regularization by projection, convex penalties.
result Minimax rates in expectation and probability for convergence.
We discuss equivalent axiomatic characterizations of distortion risk measures, and give a novel and concise proof of the characterization of elicitable distortion risk measures. Elicitability has recently been discussed as a desirable criterion for risk measures, motivated by statistical considerations of forecasting. …
Theoretical Insight into Batch Normalization: Data Dependant Auto-Tuning of Regularization Ratestat.ML
This paper explains how batch normalization auto-tunes the regularization parameter based on data statistics.
problem Batch normalization accelerates deep learning training but the exact relationship to regularization is unclear.
method Theoretical analysis and empirical validation of batch normalization's role in auto-tuning the regularization parameter.
result Batch normalization auto-tunes the regularization parameter based on data statistics.
Distributionally robust optimization (DRO) has attracted attention in machine learning due to its connections to regularization, generalization, and robustness. Existing work has considered uncertainty sets based on phi-divergences and Wasserstein distances, each of which have drawbacks. In this paper, we study DRO wit…
This paper bridges outlier-robust estimation in robotics and computer vision with robust statistics.
problem Outlier-robust estimation for geometric perception in robotics and computer vision.
method Adapting and extending robust linear regression and list-decodable regression to non-convex domains and vector-valued measurements.
result Performance guarantees for modern estimation algorithms in the presence of outliers.
Paper tightens statistical aggregation results using local complexity.
problem Combining predictors to achieve nearly optimal predictions.
method Replacing global complexity with local complexity, using PAC-Bayes localization.
result Localized versions of classical aggregation bounds proven, improving previous results.
A Jacobian inequality for gradient maps on the sphere and its application to directional statisticsmath.DG
In the field of optimal transport theory, an optimal map is known to be a gradient map of a potential function satisfying cost-convexity. In this paper, the Jacobian determinant of a gradient map is shown to be log-concave with respect to a convex combination of the potential functions when the underlying manifold is t…
We provide the first differentially private algorithms for controlling the false discovery rate (FDR) in multiple hypothesis testing, with essentially no loss in power under certain conditions. Our general approach is to adapt a well-known variant of the Benjamini-Hochberg procedure (BHq), making each step differential…
A note on extending Chernoff bound for unit interval random variables.
problem Extending the Chernoff bound to random variables in the unit interval.
method Proof of extension of the Chernoff bound.
result A proof provided for the extension of the Chernoff bound.
Large hyperbolic circlesmath.DS
Asymptotics for equidistribution of circles on hyperbolic surfaces.
problem Equidistribution of circles on hyperbolic surfaces.
method Spectral method and statistical limit theorems.
result Precise asymptotics for the rate of equidistribution of circles.
Biological systems are often modelled at different levels of abstraction depending on the particular aims/resources of a study. Such different models often provide qualitatively concordant predictions over specific parametrisations, but it is generally unclear whether model predictions are quantitatively in agreement, …
New voting rules protect against strategic voting by robust statistics.
problem Strategic voting can skew election outcomes.
method Revisit Mallows model, develop robust estimator.
result Efficient estimator achieves nearly optimal robustness.
The paper studies random covers of torus knot complements and their statistical properties.
problem Understanding the statistical behavior of finite covers of torus knot complements.
method Asymptotic subgroup growth analysis and Benjamini-Schramm limit theorems.
result Determination of the linear growth rate of Betti numbers for random covers of torus knot complements.
Unified methodology for statistical inference in least squares and PCA via randomized sketching.
problem Statistical inference in least squares and PCA problems.
method Randomized sketching and projections, asymptotic normality of quadratic forms.
result Unified statistical inference methods for various sketching distributions.
Deep-learning method improves hypothesis testing for independence.
problem Improving hypothesis testing for independence using deep learning.
method Proposes deep-testing, a novel procedure that uses a deep neural network to distinguish between data generated under and outside a given statistical model.
result Deep-testing achieves the highest overall power against nineteen competing methods across various dependence structures.