A new method combines simple binary classifiers to build complex multiclass classifiers, achieving performance limits in a Gaussian setting.
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
Trend · papers per month
Current techniques in machine learning are so far are unable to learn classifiers that are robust to adversarial perturbations. However, they are able to learn non-robust classifiers with very high accuracy, even in the presence of random perturbations. Towards explaining this gap, we highlight the hypothesis that $\te…
The paper classifies geodesic orbit spaces with simple isotropy groups.
We give an explicit simple construction for classifying spaces of maps obtained as hyperplane projections of immersions. We prove structure theorems for these classifying spaces.
Unhinged loss minimization fails to improve classifier accuracy for simple data.
In high dimension, low sample size (HDLSS)settings, the simple average distance classifier based on the Euclidean distance performs poorly if differences between the locations get masked by the scale differences. To rectify this issue, modifications to the average distance classifier was proposed by Chan and Hall (2009…
Random Hyperboxes is a simple yet effective ensemble classifier.
The classifying spaces of cobordisms of singular maps have two fairly different constructions. We expose a homotopy theoretical connection between them. As a corollary we show that the classifying spaces in some cases have a simple product structure.
We classify the simple sheaves microsupported along the conormal bundle of a knot. We also establish a correspondence between simple sheaves up to local systems and augmentations, explaining the underlying reason why knot contact homology representations detect augmentations.
We classify invariant almost complex structures on homogeneous manifolds of dimension 6 with semi-simple isotropy. Those with non-degenerate Nijenhuis tensor have the automorphism group of dimension either 14 or 9. An invariant almost complex structure with semi-simple isotropy is necessarily either of specified 6 homo…
In this paper we classify the reducible representations of compact simple Lie groups all of whose orbits are tautly embedded in Euclidean space with respect to Z_2 coefficients.
A simple method flags images as out-of-distribution based on their distance to nearest neighbors.
Support vector machines (SVM) and other kernel techniques represent a family of powerful statistical classification methods with high accuracy and broad applicability. Because they use all or a significant portion of the training data, however, they can be slow, especially for large problems. Piecewise linear classifie…
New uniqueness concept for adversarial Bayes classifier.
Simple mean and std-based classifier outperforms chance on 69 out of 128 time-series problems.
We introduce the notion of pointwise coverage to measure the explainability properties of machine learning classifiers. An explanation for a prediction is a definably simple region of the feature space sharing the same label as the prediction, and the coverage of an explanation measures its size or generalizability. Wi…
Classifies non-integrable distributions with simple infinite-dimensional Lie superalgebras of symmetries.
We consider the problem of binary classification where one can, for a particular cost, choose not to classify an observation. We present a simple proof for the oracle inequality for the excess risk of structural risk minimizers using a lasso type penalty.
Domain generation algorithms (DGAs) are commonly leveraged by malware to create lists of domain names which can be used for command and control (C&C) purposes. Approaches based on machine learning have recently been developed to automatically detect generated domain names in real-time. In this work, we present a novel …
Deep-learning based classification algorithms have been shown to be susceptible to adversarial attacks: minor changes to the input of classifiers can dramatically change their outputs, while being imperceptible to humans. In this paper, we present a simple hypothesis about a feature compression property of artificial i…
Study classifies Lie group representations with non-empty boundary orbit space.
Accurate calibration of probabilistic predictive models learned is critical for many practical prediction and decision-making tasks. There are two main categories of methods for building calibrated classifiers. One approach is to develop methods for learning probabilistic models that are well-calibrated, ab initio. The…
Classifies Zariski closures of positive representations in Lie groups.
We consider a discriminative learning (regression) problem, whereby the regression function is a convex combination of k linear classifiers. Existing approaches are based on the EM algorithm, or similar techniques, without provable guarantees. We develop a simple method based on spectral techniques and a `mirroring' tr…
We present a loop group description for curves in , and apply it to classify the circletons: Circles dressed by simple factors.
We show that a simple modification of the 1-nearest neighbor classifier yields a strongly Bayes consistent learner. Prior to this work, the only strongly Bayes consistent proximity-based method was the k-nearest neighbor classifier, for k growing appropriately with sample size. We will argue that a margin-regularized 1…
The paper proposes methods to estimate positive examples and learn classifiers from mixed data.
We propose Very Simple Classifier (VSC) a novel method designed to incorporate the concepts of subsampling and locality in the definition of features to be used as the input of a perceptron. The rationale is that locality theoretically guarantees a bound on the generalization error. Each feature in VSC is a max-margin …
Transfer learning assumes classifiers of similar tasks share certain parameter structures. Unfortunately, modern classifiers uses sophisticated feature representations with huge parameter spaces which lead to costly transfer. Under the impression that changes from one classifier to another should be ``simple'', an effi…
Algorithms are often used to produce decision-making rules that classify or evaluate individuals. When these individuals have incentives to be classified a certain way, they may behave strategically to influence their outcomes. We develop a model for how strategic agents can invest effort in order to change the outcome…
We classify those manifolds of positive euler characteristic on which a lie group G acts with cohomogeneity one, where G is classical simple
It has been argued that in supervised classification tasks, in practice it may be more sensible to perform model selection with respect to some more focused model selection score, like the supervised (conditional) marginal likelihood, than with respect to the standard marginal likelihood criterion. However, for most Ba…
Simpler classifiers are more robust to adversarial perturbations.
This paper classifies chiral graphs up to size 12.
Data discretization is an important step in the process of machine learning, since it is easier for classifiers to deal with discrete attributes rather than continuous attributes. Over the years, several methods of performing discretization such as Boolean Reasoning, Equal Frequency Binning, Entropy have been proposed,…
Defines explanations for classifier outcomes using causal concepts.
Classifiers based on sparse representations have recently been shown to provide excellent results in many visual recognition and classification tasks. However, the high cost of computing sparse representations at test time is a major obstacle that limits the applicability of these methods in large-scale problems, or in…
Enhances multi-tag classification using low-dimensional vector representations and virtual data.
New method quantifies classifier uncertainty, revealing large variability in performance metrics.
Paper proposes CCVR to improve classifier calibration in federated learning with non-IID data.
In his seminal work, Schapire (1990) proved that weak classifiers could be improved to achieve arbitrarily high accuracy, but he never implied that a simple majority-vote mechanism could always do the trick. By comparing the asymptotic misclassification error of the majority-vote classifier with the average individual …
A set of introductory notes on the subject of data classification using a linear classifier and least-squares cost function, and the negative effect of the presence of outliers on the decision boundary of the linear discriminant. We also show how a simple scaling could make the outlier less significant, thereby obtaini…
We develop a simple test for deviations from power law tails, which is based on the asymptotic properties of the empirical distribution function. We use this test to answer the question whether great natural disasters, financial crashes or electricity price spikes should be classified as dragon kings or 'only' as black…
Tangential families are 1-parameter families of rays emanating tangentially from smooth curves. We classify tangential family germs up to Left-Right equivalence: we prove that there are two infinite series and four sporadic simple singularities of tangential family germs (in addition to two stable singularities). We gi…
The nearest neighbor classifier fails in high dimensions, leading to this study.
In this paper, we classify three-locally-symmetric spaces for a connected, compact and simple Lie group. Furthermore, we give the classification of invariant Einstein metrics on these spaces.
Simple method improves deep classifier accuracy under noisy labels.
We show that a Hitchin representation is determined by the spectral radii of the images of simple, non-separating closed curves. As a consequence, we classify isometries of the intersection function on Hitchin components of dimension 3 and on the self-dual Hitchin components in all dimensions. As an important tool in t…