Paper proposes GEG to enhance fairness in binary and multi-class classification.
problem Fairness in multi-class classification tasks is under-explored.
method Formulates multi-objective problem between effectiveness and fairness constraints, proposes GEG algorithm.
result GEG improves fairness up to 92% and decreases accuracy up to 14%.
A double sampling strategy reduces multi-class to binary classification for large-scale text data.
problem Efficiently handling large-scale multi-class classification with long-tailed class distributions.
method Double sampling strategy on top of multi-class to binary reduction.
result The proposed approach reduces training and prediction time, memory consumption, and improves predictive performance.
This research sets limits on how complex multi-class learning problems can be.
problem Understanding the complexity of multi-class classification problems.
method Established upper bounds on Natarajan dimensions for specific function classes.
result Upper bounds on Natarajan dimensions for multi-class decision trees, random forests, and neural networks.
Single neurons can perform as well as dense networks in binary and multi-class recognition tasks.
problem Designing efficient neural networks for recognition tasks.
method Investigated the use of single or multiple neurons in neural networks for binary and multi-class recognition tasks.
result Sparse networks can be as efficient as dense networks in both binary and multi-class tasks.
No multi-class labels needed for multi-class classification.
problem Multi-class classification without requiring class-specific labels.
method Meta classification learning using pairwise similarity prediction.
result The method learns a multi-class classifier from binary classifier for pairwise similarity.
Study extends learnability equivalence to multi-class and regression, overcoming binary classification limits.
problem Equivalence of online and private learnability in multi-class and regression settings.
method Introduced a novel Littlestone dimension variant and threshold functions for multi-class classification.
result Online learnability implies private learnability in multi-class classification but not in regression.
The number of possible methods of generalizing binary classification to multi-class classification increases exponentially with the number of class labels. Often, the best method of doing so will be highly problem dependent. Here we present classification software in which the partitioning of multi-class classification…
New method calibrates multi-class predictions efficiently without sacrificing accuracy.
problem Efficiently calibrating multi-class predictions without sacrificing accuracy.
method Formulated robust projected smooth calibration and new recalibration algorithms.
result Achieves strong guarantees for binary classification tasks with polynomial complexity.
DSNC learns binary codes for multi-class classification with sublinear inference.
problem High inference complexity in one-vs-all methods for large multi-class classification.
method DSNC learns binary codes and mappings end-to-end without a priori tuning.
result DSNC achieves sublinear inference complexity and outperforms baselines.
A new method identifies class-specific covariates in multi-class prediction tasks.
problem Identifying covariates specifically associated with one or more outcome classes in multi-class prediction tasks.
method Introducing multi forests (MuFs) with multi-way and binary splits to measure class-associated discriminatory ability.
result The multi-class VIM specifically ranks class-associated covariates highly, unlike conventional VIMs.
Improves ROC/AUC for multi-class classification.
problem Lack of sensible plots, sensitivity to imbalanced data, inability to specify mis-classification cost, and lack of evaluation uncertainty quantification.
method Factorizes multi-class ROC into a one-dimensional vector representation for visualization and summary.
result Provides a binary AUC-equivalent summary and mis-classification weights specification.
Survey of multi-class classification methods and their performance.
problem Generalizing binary classification to multi-class problems.
method Recursive control language to describe partitioning strategies, manual and automatic design.
result One-vs.-one is generally the best solution, but adaptive methods can outperform it in some cases.
Develops algorithms for multi-class Neyman-Pearson classification with cost sensitivity.
problem Asymmetric misclassification costs in multi-class classification problems.
method Establishes connection with cost-sensitive learning, proposes two algorithms, extends NP oracle properties.
result Proposes algorithms with theoretical guarantees for multi-class Neyman-Pearson classification.
The volume of a credal set correlates with epistemic uncertainty in binary classification but not in multi-class.
problem Representing and quantifying epistemic uncertainty in machine learning.
method Examined the geometric representation of credal sets as d-dimensional polytopes and their volume as a measure of uncertainty. result The volume of a credal set is a meaningful measure of epistemic uncertainty in binary classification but not in multi-class.
The study analyzes multi-class teacher-student perceptron performance and generalization errors.
problem Analyzing multi-class classification with the teacher-student perceptron.
method Deriving asymptotic expressions for Bayes-optimal and empirical risk minimization (ERM) generalization errors.
result Regularised cross-entropy minimization yields close-to-optimal accuracy for multi-class classification.
Develops a multi-class classifier using quantum detection theory.
problem Improving multi-class classification models in machine learning.
method Inspired by quantum detection theory, develops a multi-class classifier.
result Demonstrates improved effectiveness of multi-class classification models.
This paper improves SVM classification using a differentiable loss function and a gradient method.
problem Improving SVM classification with a differentiable loss function.
method Uses the Huberized Support Vector Machine (HSVM) and Proximal Gradient (PG) method.
result The proposed method converges linearly and supports the solution in finite time.
We study consistency of learning algorithms for a multi-class performance metric that is a non-decomposable function of the confusion matrix of a classifier and cannot be expressed as a sum of losses on individual data points; examples of such performance metrics include the macro F-measure popular in information retri…
Orthogonal coding matrices improve multi-class classification accuracy across various datasets.
problem Improving multi-class classification accuracy using orthogonal coding matrices.
method Optimized orthogonal coding matrices for multi-class classification, compared with other methods.
result Orthogonal coding matrices generally outperform random ECCs and are faster than 1 vs. 1.
OTI extends OTP for inductive semi-supervised learning.
problem Inductive semi-supervised learning for out-of-sample data.
method Optimal transport-based approach extended to inductive tasks.
result OTI outperforms state-of-the-art methods in experiments.
Combines neural networks and STL for multi-class time-series classification.
problem Lack of interpretability in neural networks for time-series data.
method Proposes a method that uses neural networks to classify time-series data using STL specifications, introducing margin for multi-class classification and STL-based attributes for interpretability.
result Evaluations show improved interpretability and performance compared to state-of-the-art baselines.
Two different formulas for macro F1 lead to significant differences in classification evaluation.
problem Evaluation discrepancies in binary, multi-class, and multi-label classification problems.
method Comparison of two formulas for macro F1 metric.
result The two formulas can result in up to a 0.5 difference and different classifier rankings.
Improves predictive performance of nested dichotomies.
problem Improving the performance of multi-class classification problems.
method A simple, general method for improving nested dichotomies produced by random subset selection techniques.
result Improves root mean squared error of nested dichotomies.
Optimal binning method for numeric targets using mathematical programming.
problem Optimizing the discretization of numeric variables for classification.
method Mathematical programming formulation for binary, continuous, and multi-class targets with constraints.
result Convex mixed-integer programming formulations for all target types.
Due to myriads of classes, designing accurate and efficient classifiers becomes very challenging for multi-class classification. Recent research has shown that class structure learning can greatly facilitate multi-class learning. In this paper, we propose a novel method to learn the class structure for multi-class clas…
Improved GP models for fast training and good performance.
problem Training scalable Gaussian process models efficiently.
method Cross-validation and nearest neighbor truncation for scalable GP training.
result Our method offers fast training and excellent predictive performance.
A sequential classifier minimizes test samples for binary and multi-class classification.
problem Minimizing test samples for sequential classification with unknown distributions.
method Proposes a classifier for binary and multi-class problems, analyzing error probabilities and extending results.
result Significant advantage over non-sequential classifiers, achieving same exponents without rejection option.
Improves probability estimates for small datasets in multi-class problems.
problem Inaccurate probability estimates in classification tasks, especially on small datasets.
method Introduced Data Generation and Grouping algorithm to improve calibration on small datasets, then applied to multi-class problems.
result Calibration error can be decreased using the proposed approach.
Enhanced H-consistency bounds derived under relaxed conditions.
problem Quantifying the relationship between zero-one estimation error and surrogate loss estimation error.
method Relaxing the condition on the surrogate loss conditional regret and presenting a general framework for establishing enhanced H-consistency bounds. result Derivation of more favorable H-consistency bounds in various scenarios. New method estimates density ratio for well-separated distributions using multi-class logistic regression.
problem Challenges in estimating density ratio for well-separated distributions.
method Uses multi-class logistic regression with auxiliary densities to estimate log(p/q).
result Demonstrates superior performance on density ratio estimation, mutual information, and representation learning tasks.
The study optimizes machine learning classifiers for variable stars using CRTS data.
problem Classifying variable stars from CRTS data efficiently and accurately.
method Used multi-class, binary, and hierarchical ML schemes; optimized via cross-validation; applied Information Theory for feature selection.
result Random Forest classifier performs best in CRTS dataset, achieving balanced-accuracy of ~99% for δ-Scuti and ACEP. This paper tackles dynamic ensemble selection and data preprocessing for multi-class imbalance learning.
problem Class imbalance in multi-class datasets where majority class has more instances.
method Examined five preprocessing methods and four dynamic selection methods for multi-class imbalanced problems.
result Dynamic ensemble improves F-measure and G-mean compared to static ensemble.
Recent studies in the literature have paid much attention to the sparsity in linear classification tasks. One motivation of imposing sparsity assumption on the linear discriminant direction is to rule out the noninformative features, making hardly contribution to the classification problem. Most of those work were focu…
This paper analyzes dynamic ensemble selection and preprocessing for multi-class imbalanced datasets.
problem Class imbalance in multi-class datasets where majority classes have more instances.
method Examined dynamic selection techniques and data preprocessing methods for multi-class imbalanced problems.
result Dynamic ensemble improves AUC and G-mean compared to static ensemble.
We propose several novel methods for enhancing the multi-class SVMs by applying the generalization performance of binary classifiers as the core idea. This concept will be applied on the existing algorithms, i.e., the Decision Directed Acyclic Graph (DDAG), the Adaptive Directed Acyclic Graphs (ADAG), and Max Wins. Alt…
Symmetrizes loss functions to improve neural network robustness against noisy labels.
problem Designing robust loss functions for noisy labels in neural networks.
method Symmetrization of multi-class loss functions, focusing on cross-entropy and unhinged loss.
result The multi-class unhinged loss is the unique convex symmetric loss under suitable assumptions.
SOL is a scalable library for online learning algorithms.
problem Scalable online learning for high-dimensional data.
method Family of regular and sparse online learning algorithms implemented in C++.
result High efficiency and scalability for large-scale machine learning.
Friedman's method performs well for estimating class distributions.
problem Estimating prior class probabilities without label observations.
method Friedman's method and DeBias method for designing linear equation systems.
result Friedman's method performs well for binary and multi-class quantification.
Paper tackles cybersecurity attack detection with an ensemble approach.
problem Challenges in multi-class classification for cyber security breaches.
method Designing a multi-node multi-class classification ensemble approach.
result Proposed approach outperforms full-data approach in multi-node data-censoring cases.
A new multi-class active learning method combining informativeness and representativeness.
problem Efficiently labeling large datasets with limited resources.
method A hybrid informative and representative criterion approach for multi-class active learning.
result The proposed method outperforms state-of-the-art methods on multiple UCI datasets.
Study on H-consistency bounds for machine learning surrogates.
problem Estimating target loss error relative to surrogate loss error in machine learning.
method Developed H-consistency bounds for various surrogates and loss functions. result Stronger guarantees than existing methods, offering distribution-dependent and -independent bounds.
A new algorithm reduces imbalanced data classification errors in multi-class settings.
problem Imbalanced data classification, especially with noise and overlapping classes.
method MC-CCR algorithm combining cleaning and resampling.
result High robustness to noise and superior performance compared to state-of-the-art methods.
DCSVM efficiently classifies multi-class data using SVMs with smart partitioning.
problem Multi-class classification using SVMs with high computational cost.
method Divide and conquer approach with smart partitioning of data.
result Reduces the number of classes in each step, making final decisions in logarithmic or linear steps.
Extends PCVM for multi-class classification with improved accuracy.
problem Lack of probabilistic outputs and contradictory predictions in multi-class classification.
method Proposes mPCVM with two learning algorithms: top-down and bottom-up.
result Superior performance, especially with many classes, validated on synthetic and benchmark data.
New tree-based SVM methods for multi-class classification.
problem Efficient multi-class classification for large datasets.
method Entropy and generalization error estimation for binary classifiers in tree nodes.
result Proposed methods outperform traditional techniques in speed and accuracy.
This paper addresses the problem of learning a task from demonstration. We adopt the framework of inverse reinforcement learning, where tasks are represented in the form of a reward function. Our contribution is a novel active learning algorithm that enables the learning agent to query the expert for more informative d…
Introduces SoRR for aggregating losses in supervised learning.
problem Aggregating individual losses into a single output for machine learning models.
method Sum of ranked range (SoRR) minimization using DCA.
result Demonstrates effectiveness of AoRR and TKML in improving robustness of multi-label learning.
The paper analyzes consistency of graph-based semi-supervised learning methods for binary and multi-class classification.
problem Consistency of semi-supervised learning algorithms on graphs with noisy labels and well-clustered unlabelled data.
method The study examines graph-based probit and one-hot encoding methods for binary and multi-class classification, analyzing the consistency of optimization-based techniques.
result The analysis reveals insights into the rational function choice for optimization, improving the consistency of semi-supervised learning algorithms.