New reformulations for multiclass classification problems using optimal transport.
problem Adversarial multiclass classification problems.
method Multimarginal optimal transport formulation.
result Reveals geometric structure and extends binary classification results.
The number of possible methods of generalizing binary classification to multi-class classification increases exponentially with the number of class labels. Often, the best method of doing so will be highly problem dependent. Here we present classification software in which the partitioning of multi-class classification…
C-HMCNN(h) improves HMC classification by leveraging class hierarchy.
problem Hierarchical multi-label classification with class hierarchy constraints.
method Exploits class hierarchy to produce coherent predictions for multi-label classification.
result C-HMCNN(h) outperforms state-of-the-art models in HMC classification.
Estimates neural network errors for classification problems.
problem Binary and multi-class classification problems.
method Rademacher complexity estimates and direct approximation theorems.
result A priori error estimates for regularized loss functionals.
The cost-sensitive classification problem plays a crucial role in mission-critical machine learning applications, and differs with traditional classification by taking the misclassification costs into consideration. Although being studied extensively in the literature, the fundamental limits of this problem are still n…
Probabilistic learning for binary classification with categorical variables.
problem Binary classification with categorical covariates.
method Probabilistic analysis and two algorithms for learning boolean functions.
result Effective learning of boolean functions from binary data.
Introduces topological deep learning for neural network classification problems.
problem Classifying neural networks using minimal topological structures.
method Formalizes classification problems in a topological setting.
result Demonstrates conditions for the feasibility of classification problems in neural networks.
New NHCAs improve multi-category classification efficiency.
problem Efficient multi-category classification for real-world problems.
method Twin SVM (TWSVM), Generalized eigenvalue proximal SVM (GEPSVM), Regularized GEPSVM (RegGEPSVM), and Improved GEPSVM (IGEPSVM) with OAA, BT, and TDS approaches.
result TDS-TWSVM outperforms other methods in classification accuracy.
RFSVM uses learned RF similarity for HDLSS classification.
problem High dimension, low sample size classification problems.
method Transposes RFD approach to HDLSS classification using RF similarity as SVM kernel.
result RFSVM outperforms existing methods for HDLSS problems.
We show how binary classification methods developed to work on i.i.d. data can be used for solving statistical problems that are seemingly unrelated to classification and concern highly-dependent time series. Specifically, the problems of time-series clustering, homogeneity testing and the three-sample problem are addr…
This paper classifies solutions for a specific geometric problem.
problem Classifying solutions for the planar isotropic Lp dual Minkowski problem. method Converted the ODE for the solution into an integral and studied its asymptotic behavior, duality, and monotonicity.
result Complete classification of solutions for the equation.
Advances few-shot classification by treating it as supervised learning and proposing new training techniques.
problem Formulating the ability of humans to learn from limited data in machine learning.
method Formulated few-shot classification as a supervised learning problem and introduced multi-episode and cross-way training techniques.
result Proposed training strategies accelerate the training process without accuracy loss.
Graph-based multi-label classifier extends CULP for multi-label data.
problem Solving multi-label classification problems.
method Extends CULP algorithm to handle multi-label data.
result Competitive results compared to cutting-edge multi-label classifiers.
Proposes an angle-based framework for multicategory cost-sensitive classification.
problem Cost-sensitive multicategory classification challenges.
method Angle-based cost-sensitive classification framework without sum-to-zero constraint.
result Proposed boosting algorithms yield competitive classification performances.
LSTM network aids intent classification in QA.
problem Classifying intent in question-answering.
method Used LSTM architecture for intent classification.
result Effective and efficient intent classification achieved.
Solves regression problems with CP by converting to classification.
problem Challenges in CP for heteroscedastic, multimodal, or skewed regression outputs.
method Converts regression to classification, uses CP for classification to obtain CP sets for regression.
result Simple approach yields good results on practical problems.
Paper proposes a new efficient transport-based dissimilarity measure for time series classification.
problem Classifying time series with warping distortions.
method Defining a problem statement, proposing an Optimal Transport-based dissimilarity measure.
result The proposed method can solve the time series classification problem with reduced computational cost.
Developing classification algorithms that are fair with respect to sensitive attributes of the data has become an important problem due to the growing deployment of classification algorithms in various social contexts. Several recent works have focused on fairness with respect to a specific metric, modeled the correspo…
New method visualizes decision boundaries of classification models.
problem Difficulty in understanding how classification models interpret data.
method Hybrid supervised-unsupervised technique for visualizing decision boundaries.
result Provides interpretable maps for qualitative and quantitative analysis.
ICE algorithm solves exact 0-1 loss linear classification problem efficiently.
problem Exact solution to the 0-1 loss linear classification problem for non-linearly separable data.
method Incremental cell enumeration (ICE) algorithm, leveraging combinatorial and incidence relations.
result First provably optimal algorithm for exact 0-1 loss linear classification problem.
A new kNN imputation method improves classification performance on datasets with missing data.
problem Missing data in classification problems.
method Class weighted grey distance with MI weighting for kNN imputation.
result Improved classification performance compared to existing methods.
A novel feature selection method for SVM improves model accuracy and interpretability.
problem Feature selection in nonlinear SVM classification problems.
method Embedded min-max optimization problem, leveraging duality theory.
result Improves model accuracy and interpretability on benchmark data sets.
A new method for compressive classification using bridge regression.
problem Efficient pattern classification with compact representation.
method Proposed a deterministic bridge regression solution for compressive classification.
result Validation of the proposed solution through numerical studies on simulated and real-world data.
New approach improves classification guarantees by focusing on direction rather than regression risk.
problem Improving classification guarantees in binary classification problems.
method Establishing a geometric distinction between classification and regression, leveraging scale invariance.
result Improved guarantees for classification risk compared to regression risk.
We study realizations of Lie algebras by vector fields. A correspondence between classification of transitive local realizations and classification of subalgebras is generalized to the case of regular local realizations. A reasonable classification problem for general realizations is rigorously formulated and an algori…
Extends linear classification framework to nonlinear SVM-based ranking problems.
problem Maximizing performance on relevant samples in ranking problems.
method Dualization, kernel addition, componentwise dual ascent method.
result General framework for nonlinear classifiers in ranking problems.
A good classification method should yield more accurate results than simple heuristics. But there are classification problems, especially high-dimensional ones like the ones based on image/video data, for which simple heuristics can work quite accurately; the structure of the data in such problems is easy to uncover wi…
New method corrects skewed confidence for PbN classification.
problem Weakly supervised binary classification with biased negative data.
method Corrects skewed confidence in negative data to improve classifier.
result Reduces distortion in posterior probability for PbN classification.
Kernel extreme learning machine (KELM) is a novel feedforward neural network, which is widely used in classification problems. To some extent, it solves the existing problems of the invalid nodes and the large computational complexity in ELM. However, the traditional KELM classifier usually has a low test accuracy when…
Machine learning reveals hidden features in knot classification.
problem Classifying the topology of closed curves.
method Investigating shortcut methods used by ML for knot classification.
result Developed a dataset and code to remove non-topological features.
Regression or classification? This is perhaps the most basic question faced when tackling a new supervised learning problem. We present an Evolutionary Deep Learning (EDL) algorithm that automatically solves this by identifying the question type with high accuracy, along with a proposed deep architecture. Typically, a …
Neural networks improve functional data classification.
problem Lack of effective classification methods for functional data.
method Extended deep learning methodologies to functional data for classification.
result Demonstrated superior performance in spectrographic data classification.
Paper shows similarity learning can lead to strong binary classification performance.
problem How similarity learning can lead to good classification performance.
method Product-type formulation of similarity learning is connected to binary classification through an excess risk bound.
result Similarity learning can directly elicit a decision boundary for binary classification.
Bayesian online meta-learning framework tackles catastrophic forgetting in few-shot classification.
problem Catastrophic forgetting in few-shot classification problems.
method Bayesian online learning, meta-learning, Laplace approximation, variational inference.
result Framework effectively achieves goal of overcoming catastrophic forgetting in few-shot classification.
A new meta-meta classification method tackles few-shot learning tasks.
problem Learning with limited data in small-data settings.
method Designing an ensemble of learners for a large set of problems, then learning how to combine them for a new problem.
result Meta-meta classification outperforms traditional meta-learning and ensembling approaches in one-shot learning tasks.
Classification problems in security settings are usually contemplated as confrontations in which one or more adversaries try to fool a classifier to obtain a benefit. Most approaches to such adversarial classification problems have focused on game theoretical ideas with strong underlying common knowledge assumptions, w…
Proposes interpretable time series classification through extracted features.
problem Interpretable time series classification in complex problems.
method Extracts features from time series to improve interpretability of traditional classifiers.
result No statistically significant differences in accuracy compared to state-of-the-art models.
Study improves learning algorithms for convex polyhedra in Hilbert spaces.
problem Learning convex polyhedra in Hilbert spaces.
method Proposes an algorithm for learning a polyhedron in a Hilbert space.
result Correctly classifies at least 1-ε of the distribution with high probability.
High dimensional data analysis is known to be as a challenging problem. In this article, we give a theoretical analysis of high dimensional classification of Gaussian data which relies on a geometrical analysis of the error measure. It links a problem of classification with a problem of nonparametric regression. We giv…
This paper tackles tweet classification by identifying purpose and position.
problem Difficulties in determining user intention and attitude in short, informal tweets.
method Transformed tweet classification into a multi-label problem and applied a multi-label classification method with post-processing.
result The method effectively classifies tweet purpose and position, outperforming individual classification methods.
Random projections simplify complex data for classification.
problem Handling high-dimensional data in classification problems.
method Two techniques: ensemble of random projections and hashing/sketching.
result Approximate statistical efficiency with reduced complexity.
Classification is a fundamental problem in machine learning and data mining. During the past decades, numerous classification methods have been presented based on different principles. However, most existing classifiers cast the classification problem as an optimization problem and do not address the issue of statistic…
Binary classification is a common statistical learning problem in which a model is estimated on a set of covariates for some outcome indicating the membership of one of two classes. In the literature, there exists a distinction between hard and soft classification. In soft classification, the conditional class probabil…
Study shows exponential convergence in classification errors using random features and SGD.
problem Scalability issues in kernel methods for large datasets.
method Binary classification problem with random features and stochastic gradient descent.
result Exponential convergence rate of expected classification error achieved.
The classification of class VII surfaces is a very difficult classical problem in complex geometry. It is considered by experts to be the most important gap in the Enriques-Kodaira classification table for complex surfaces. The standard conjecture concerning this problem states that any minimal class VII surface with $…
A new framework for neural network classification using vector quantization.
problem Learning a neural network classifier under the IB principle.
method Aggregated Learning framework, combining vector quantization and variational techniques.
result The effectiveness of Aggregated Learning verified through experiments.
In this paper we consider three deeply connected classificational problems on four-dimensional manifolds. First we consider and describe locally regular distributions. Second we give a classification of almost complex structures of general position in terms of distributions. Finally we classify nondegenerate Monge-Ampe…
Classifiers based on sparse representations have recently been shown to provide excellent results in many visual recognition and classification tasks. However, the high cost of computing sparse representations at test time is a major obstacle that limits the applicability of these methods in large-scale problems, or in…