arXiv research

This paper tackles worst-class error rate in classification tasks.

Study controls error rates of binary classifiers using hypothesis testing.

We show how to compute the Bayes error-rate for speaker verifiers.

This research examines how the error rate of nearest neighbor classifiers varies with dataset size.

This paper reviews methods for constructing confidence intervals for error rates in 1:1 matching tasks.

Ex ante forecast outcomes should be interpreted as counterfactuals (potential histories), with errors as the spread between outcomes. Reapplying measurements of uncertainty about the estimation errors of the estimation errors of an estimation leads to branching counterfactuals. Such recursions of epistemic uncertainty …

This research analyzes the error convergence rate of GAN models.

Overrides of credit ratings are important correctives of ratings that are determined by statistical rating models. Financial institutions and banking regulators agree on this because on the one hand errors with ratings of corporates or banks can have fatal consequences for the lending institutions and on the other hand…

We consider least squares estimation in a general nonparametric regression model. The rate of convergence of the least squares estimator (LSE) for the unknown regression function is well studied when the errors are sub-Gaussian. We find upper bounds on the rates of convergence of the LSE when the errors have uniformly …

Optimal number of voters for a voting ensemble can be estimated from the distribution of classifier errors.

Crowdsourcing is an effective tool for human-powered computation on many tasks challenging for computers. In this paper, we provide finite-sample exponential bounds on the error rate (in probability and in expectation) of hyperplane binary labeling rules under the Dawid-Skene crowdsourcing model. The bounds can be appl…

This article studies the achievable guarantees on the error rates of certain learning algorithms, with particular focus on refining logarithmic factors. Many of the results are based on a general technique for obtaining bounds on the error rates of sample-consistent classifiers with monotonic error regions, in the real…

We address the problem of learning to benchmark the best achievable classifier performance. In this problem the objective is to establish statistically consistent estimates of the Bayes misclassification error rate without having to learn a Bayes-optimal classifier. Our learning to benchmark framework improves on previ…

Paper assesses error estimates of Random Forests classification.

Optimal classification rules control error rates in multiclass mixture models.

We carefully study how well minimizing convex surrogate loss functions, corresponds to minimizing the misclassification error rate for the problem of binary classification with linear predictors. In particular, we show that amongst all convex surrogate losses, the hinge loss gives essentially the best possible bound, o…

Hamiltonian Monte Carlo on ReLU networks is inefficient due to large local error.

Unified error analysis for discrete flow models.

OptiNet achieves near-minimax error rates with compression in Euclidean space.

A method for making predictions with a reject option using conformal prediction.

Study on error rates for approximating rough volatility models.

This paper studies the problem of estimating the grahpon model - the underlying generating mechanism of a network. Graphon estimation arises in many applications such as predicting missing links in networks and learning user preferences in recommender systems. The graphon model deals with a random graph of $n$ vertices…

The paper reconciles two conflicting fairness criteria in algorithmic risk scores.

Principal Component Analysis (PCA) is the most common nonparametric method for estimating the volatility structure of Gaussian interest rate models. One major difficulty in the estimation of these models is the fact that forward rate curves are not directly observable from the market so that non-trivial observational e…

Paper establishes universal lower bounds and optimal rates for clustering sub-exponential mixture models.

Paper develops an online learning algorithm for functional data models.

In this paper we consider the cluster estimation problem under the Stochastic Block Model. We show that the semidefinite programming (SDP) formulation for this problem achieves an error rate that decays exponentially in the signal-to-noise ratio. The error bound implies weak recovery in the sparse graph regime with bou…

GANs learn distributions well from samples, with rates depending on intrinsic dimension.

Study problem-dependent rates in statistical learning theory, achieving optimal generalization error bounds.

The stochastic gradient descent (SGD) optimization algorithm plays a central role in a series of machine learning applications. The scientific literature provides a vast amount of upper error bounds for the SGD method. Much less attention as been paid to proving lower error bounds for the SGD method. It is the key cont…

We analyze the errors arising from discrete readjustment of the hedging portfolio when hedging options in exponential Levy models, and establish the rate at which the expected squared error goes to zero when the readjustment frequency increases. We compare the quadratic hedging strategy with the common market practice …

Study shows exponential error reduction in multiclass classification without bias-variance trade-off.

For binary classification we establish learning rates up to the order of $n^{-1}$ for support vector machines (SVMs) with hinge loss and Gaussian RBF kernels. These rates are in terms of two assumptions on the considered distributions: Tsybakov's noise assumption to establish a small estimation error, and a new geometr…

Optimizes prediction error method for time-varying models.

A typical approach in estimating the learning rate of a regularized learning scheme is to bound the approximation error by the sum of the sampling error, the hypothesis error and the regularization error. Using a reproducing kernel space that satisfies the linear representer theorem brings the advantage of discarding t…

New bounds on majority voting's accuracy for multi-class classification problems.

Ensembling improves performance when classifiers disagree more than average.

Meta learning of optimal classifier error rates allows an experimenter to empirically estimate the intrinsic ability of any estimator to discriminate between two populations, circumventing the difficult problem of estimating the optimal Bayes classifier. To this end we propose a weighted nearest neighbor (WNN) graph es…

While active learning offers potential cost savings, the actual data efficiency---the reduction in amount of labeled data needed to obtain the same error rate---observed in practice is mixed. This paper poses a basic question: when is active learning actually helpful? We provide an answer for logistic regression with t…

Method estimates LLM error rates using Pareto optimization.

Paper develops error rates for physics-informed learning, comparing it to data-driven methods.

LALR adapts learning rate for faster convergence in regression and neural nets.

Non-volatile memory, such as resistive RAM (RRAM), is an emerging energy-efficient storage, especially for low-power machine learning models on the edge. It is reported, however, that the bit error rate of RRAMs can be up to 3.3% in the ultra low-power setting, which might be crucial for many use cases. Binary neural n…

The paper analyzes classification algorithms on Korobov space and derives learning rates.

Quantum codes on hyperbolic lattices outperform Euclidean ones with higher rates and lower overhead.

This paper corrects an error in [Keller-Ressel, M. and Steiner T. "Yield curve shapes and the asymptotic short rate distribution in affine one-factor models." Finance and Stochastics 12.2 (2008): 149-172]. The error concerns the correct expression for the boundary between normal and humped yield curve behavior in affin…

Paper establishes a universal growth rate for smooth surrogate losses in classification.

We find a deterministic equivalent for random feature regression's test error, independent of feature map dimension.