New classifier combines locally linear kernels for fast and accurate non-linear classification.
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
Trend · papers per month
Classifies local boundary conditions for Dirac-type operators on manifolds.
Deep neural networks are vulnerable to adversarial attacks and hard to interpret because of their black-box nature. The recently proposed invertible network is able to accurately reconstruct the inputs to a layer from its outputs, thus has the potential to unravel the black-box model. An invertible network classifier c…
We examine the local geometry of affine surfaces which are locally symmetric. There are 6 non-isomorphic local geometries. We realize these examples as Type A, Type B, and Type C geometries using a result of Opozda and classify the relevant geometries up to linear isomorphism. We examine the geodesic structures in this…
We study the robustness of classifiers to various kinds of random noise models. In particular, we consider noise drawn uniformly from the ball for and Gaussian noise with an arbitrary covariance matrix. We characterize this robustness to random noise in terms of the distance to the decisio…
This paper presents a phenomenon in neural networks that we refer to as \textit{local elasticity}. Roughly speaking, a classifier is said to be locally elastic if its prediction at a feature vector $\bx'$ is \textit{not} significantly perturbed, after the classifier is updated via stochastic gradient descent at a (labe…
Flexible classifier using Mahalanobis distances for non-elliptical distributions.
We classify and investigate locally conformally Kähler structures on four-dimensional solvable Lie algebras up to linear equivalence. As an application we can produce many examples in higher dimension, here including lcK structures on Oeljeklaus-Toma manifolds, and we also give a geometric interpretation of some of the…
In this paper, we propose a semi-supervised dictionary learning method that uses both the information in labelled and unlabelled data and jointly trains a linear classifier embedded on the sparse codes. The manifold structure of the data in the sparse code space is preserved using the same approach as the Locally Linea…
From linear classifiers to neural networks, image classification has been a widely explored topic in mathematics, and many algorithms have proven to be effective classifiers. However, the most accurate classifiers typically have significantly high storage costs, or require complicated procedures that may be computation…
Mathematical conditions and practical computations for adversarial robustness measures are established.
We give a new short self-contained proof of the result of Opozda [B. Opozda, A classification of locally homogeneous connections on 2-dimensional manifolds, Differential Geom. Appl. 21 (2004), 173-198.] classifying the locally homogeneous torsion free affine surfaces and the extension to the case of surfaces with torsi…
Efficiently checks local robustness in neural networks using geometric projections.
A new PU classifier PUAL tackles trifurcate data issues.
CRITS improves time series classification with interpretable local explanations.
The paper classifies involutions on S^4, proving linearities under certain conditions.
It has been widely recognized that adversarial examples can be easily crafted to fool deep networks, which mainly root from the locally non-linear behavior nearby input examples. Applying mixup in training provides an effective mechanism to improve generalization performance and model robustness against adversarial per…
Background: Functional magnetic resonance imaging (fMRI) provides non-invasive measures of neuronal activity using an endogenous Blood Oxygenation-Level Dependent (BOLD) contrast. This article introduces a nonlinear dimensionality reduction (Locally Linear Embedding) to extract informative measures of the underlying ne…
In recent years, the crucial importance of metrics in machine learning algorithms has led to an increasing interest for optimizing distance and similarity functions. Most of the state of the art focus on learning Mahalanobis distances (requiring to fulfill a constraint of positive semi-definiteness) for use in a local …
Anchors explains text classifiers by highlighting key words.
We present local discriminative Gaussian (LDG) dimensionality reduction, a supervised dimensionality reduction technique for classification. The LDG objective function is an approximation to the leave-one-out training error of a local quadratic discriminant analysis classifier, and thus acts locally to each training po…
PAC-Bayesian set up involves a stochastic classifier characterized by a posterior distribution on a classifier set, offers a high probability bound on its averaged true risk and is robust to the training sample used. For a given posterior, this bound captures the trade off between averaged empirical risk and KL-diverge…
The ability to characterize the color content of natural imagery is an important application of image processing. The pixel by pixel coloring of images may be viewed naturally as points in color space, and the inherent structure and distribution of these points affords a quantization, through clustering, of the color i…
We consider the problem of discriminative factor analysis for data that are in general non-Gaussian. A Bayesian model based on the ranks of the data is proposed. We first introduce a new {\em max-margin} version of the rank-likelihood. A discriminative factor model is then developed, integrating the max-margin rank-lik…
The study quantifies how many objects can be linearly classified under all views.
TaCo prevents non-linear classifiers from detecting sensitive attributes.
It is by now well-known that small adversarial perturbations can induce classification errors in deep neural networks. In this paper, we take a bottom-up signal processing perspective to this problem and show that a systematic exploitation of sparsity in natural data is a promising tool for defense. For linear classifi…
Linear classifiers in product space forms improve scRNA-seq data classification.
diproperm tests differences in HDLSS data with binary classifiers.
Classifies linear embeddings of grassmannians and ind-grassmannians.
Test assesses if a linear classifier is random or significant.
Support vector machines (SVM) and other kernel techniques represent a family of powerful statistical classification methods with high accuracy and broad applicability. Because they use all or a significant portion of the training data, however, they can be slow, especially for large problems. Piecewise linear classifie…
Many real-valued stochastic time-series are locally linear (Gassian), but globally non-linear. For example, the trajectory of a human hand gesture can be viewed as a linear dynamic system driven by a nonlinear dynamic system that represents muscle actions. We present a mixed-state dynamic graphical model in which a hid…
New image classifier uses hierarchical max-pooling with local pooling.
New insights into how linear classifiers and leaky ReLU networks can overfit without harming generalization.
Proposes dynamic model type recommendation for OLP technique.
We show that, for generative classifiers, conditional independence corresponds to linear constraints for the induced discrimination functions. Discrimination functions of undirected Markov network classifiers can thus be characterized by sets of linear constraints. These constraints are represented by a second order fi…
Based on the work of Adams and Stuck as well as on the work of Zeghib, we classify the Lie groups which can act isometrically and locally effectively on Lorentzian manifolds of finite volume. In the case that the corresponding Lie algebra contains a direct summand isomorphic to the two-dimensional special linear algebr…
Classifies surfaces with special curvature properties.
A framework assesses the trustworthiness of probabilistic classifiers using local calibration error.
New algorithms explain Naive Bayes classifiers in polynomial time and delay.
Recent studies on the adversarial vulnerability of neural networks have shown that models trained with the objective of minimizing an upper bound on the worst-case loss over all possible adversarial perturbations improve robustness against adversarial attacks. Beside exploiting adversarial training framework, we show t…
Multithreshold Entropy Linear Classifier (MELC) is a recent classifier idea which employs information theoretic concept in order to create a multithreshold maximum margin model. In this paper we analyze its consistency over multithreshold linear models and show that its objective function upper bounds the amount of mis…
This paper optimizes binary linear classifiers by tuning their weight vectors.
Despite outstanding contribution to the significant progress of Artificial Intelligence (AI), deep learning models remain mostly black boxes, which are extremely weak in explainability of the reasoning process and prediction results. Explainability is not only a gateway between AI and society but also a powerful tool t…
State-of-the-art machine learning models frequently misclassify inputs that have been perturbed in an adversarial manner. Adversarial perturbations generated for a given input and a specific classifier often seem to be effective on other inputs and even different classifiers. In other words, adversarial perturbations s…
Linear classifiers can resist adversarial attacks on Gaussian data.
Today's state-of-the-art image classifiers fail to correctly classify carefully manipulated adversarial images. In this work, we develop a new, localized adversarial attack that generates adversarial examples by imperceptibly altering the backgrounds of normal images. We first use this attack to highlight the unnecessa…