META-DES.H selects competent classifiers using meta-learning and dynamic weighting.
problem Selecting competent classifiers in dynamic ensemble selection.
method META-DES framework using meta-learning and dynamic weighting.
result Improvements in recognition accuracy on 30 datasets.
Proposes KNORA-B and KNORA-BI for DES, improving classification performance.
problem Selecting locally competent classifiers for new test samples.
method KNORA-B and KNORA-BI use nearest neighbors to reduce region of competence, maintaining at least one sample from each class.
result KNORA-BI outperforms state-of-the-art techniques on imbalance datasets.
Meta-DES uses meta-learning to dynamically select competent classifiers for ensemble learning.
problem Dynamic selection of classifiers based on limited training data.
method Meta-learning approach to estimate competence of classifiers using multiple meta-features.
result Meta-DES significantly improves classification accuracy compared to existing techniques.
META-DES framework selects best classifiers dynamically.
problem Dynamic selection of ensemble classifiers.
method Meta-learning approach to estimate classifier competence.
result META-DES framework improves classification performance.
Improved dynamic classifier selection by refining regions of competence.
problem Limited performance of dynamic selection systems due to noisy regions.
method Integrates a filter and an adaptive distance to enhance regions of competence.
result Significant increase in recognition performance and decrease in computational cost.
Paper improves competence estimation of machine learning models.
problem Estimating machine learning performance in real-world scenarios.
method ALICE Score: a pointwise competence estimator considering distributional, data, and model uncertainty.
result Significant improvements in competence prediction over state-of-the-art methods.
Enhances DES by removing noise and defining regions more accurately.
problem Incompetent classifier selection in noisy regions and true indecision regions.
method FIRE-DES++ uses equal number of samples from each class and removes noise to define regions more accurately.
result FIRE-DES++ outperforms FIRE-DES and state-of-the-art DES frameworks.
Prototype selection improves DS techniques' accuracy and reduces computational cost.
problem Improving the performance of dynamic selection techniques.
method Prototype selection techniques that edit validation data to remove noise and redundant instances.
result Improves DS techniques' classification accuracy and reduces computational cost.
A meta-learning framework for dynamic ensemble selection.
problem Improving dynamic ensemble selection for classification tasks.
method Proposes a three-step framework using meta-learning to select competent classifiers.
result Problem-dependent scenario yields the best performance.
Paper evaluates competence measures for DRS systems.
problem Choosing the best measure to quantify competence in DRS systems is challenging.
method Reviewed and adapted eight competence measures for regression problems, compared them on 15 datasets, and evaluated three DRS systems.
result DRS systems outperform individual regressors and static systems, but competence measure choice depends on the problem.
A method to correct binary classifier errors in multi-label pairwise models.
problem Improving the accuracy of binary classifiers in multi-label pairwise models.
method Computing competence and cross-competence measures to estimate and correct label errors.
result The proposed correction methods significantly outperform the reference method in terms of zero-one loss.
The study proposes a framework to accept OOD data based on competence scores.
problem Silent failures in Domain Generalization where models reject OOD data without proper justification.
method A learning to reject framework using proxy incompetence scores to predict trustworthiness.
result Increasing incompetence scores are predictive of reduced accuracy, but not always favorable for accuracy/rejection trade-off.
Flexible classifier using Mahalanobis distances for non-elliptical distributions.
problem Classifying non-elliptical and multimodal distributions.
method Semiparametric classifier based on Mahalanobis distances and generalized additive models.
result The proposed classifiers outperform traditional methods in high-dimensional, low-sample-size scenarios.
Proposes an online pool generation method for DCS to improve classifier selection accuracy.
problem Difficulty in selecting competent classifiers in dynamic classifier selection techniques.
method Online local pool generation method that considers classification difficulty of samples.
result Significantly greater recognition rates compared to other pool generation methods.
META-DES.Oracle uses meta-learning and feature selection to improve ensemble selection accuracy.
problem Dynamic Ensemble Selection (DES) issues with classifier competence estimation.
method META-DES.Oracle integrates multiple criteria and an Oracle-based meta-feature selection scheme.
result META-DES.Oracle significantly improves classification accuracy compared to previous methods.
A new weighting scheme corrects label ensembles in multi-label classification.
problem Improving the reliability of multi-label classification with imbalanced data.
method Proposed a novel weighting scheme based on fuzzy confusion matrix and information theory.
result The proposed method reduces the vulnerability to imbalanced class distribution and improves classification quality.
Bayesian model compares classifier accuracies across multiple datasets.
problem Shortcomings of null hypothesis significance tests in comparing classifier accuracies.
method Bayesian hierarchical model analyzing cross-validation results.
result Posterior probability of classifier accuracies being equivalent or different.
NCC is inefficient in higher dimensions, NCDA improves performance.
problem Inefficiency of NCC in higher dimensions.
method Combining NCC with LDA to create NCDA.
result NCDA outperforms NCC and competes with LDA and QDA.
The nearest neighbor classifier fails in high dimensions, leading to this study.
problem Failure of nearest neighbor classifier in high-dimensional data.
method Discussed and proposed new methods to address the issue.
result The proposed methods improve performance in high-dimensional data.
A new method aggregates predictions from decentralized learners using Gaussian copulas.
problem Learning from different data sets without sharing data.
method DELCO (Decentralized Ensemble Learning with COpulas) method using Gaussian copulas to aggregate predictions.
result Increased robustness and competitive accuracy in case of dependent classifiers.
Proposes dynamic model type recommendation for OLP technique.
problem Limited local competence of base-classifiers in uneven data distributions.
method Builds a multi-label meta-classifier to recommend model types based on local data complexity.
result Statistically similar performance to original OLP with fixed base-classifier model.
The paper explores fair machine learning policies for balancing competing objectives in noisy data.
problem Balancing competing objectives in noisy data.
method Analyzes a class of policies that trace an empirical Pareto frontier based on learned scores.
result Characterizes optimal strategies and bounds Pareto errors due to score inaccuracies.
The paper studies a stochastic majority vote approach to improve classifier accuracy.
problem Improving classifier accuracy over ensembles of classifiers.
method Minimizing a PAC-Bayes generalization bound with Dirichlet distributions.
result Achieves state-of-the-art accuracy and tight generalization bounds.
Ensembling improves performance when classifiers disagree more than average.
problem When do ensembles provide significant performance improvements in classification tasks?
method Theoretical and empirical analysis of ensemble improvement rate and disagreement-error ratio.
result Ensembling improves performance significantly when the disagreement rate is large relative to the average error rate.
Mathematical approach assesses human resource competences accurately.
problem Accurate assessment and representation of human resource competences.
method Detailed quantification scheme and mathematical approach.
result Flexible tools for optimal job assignment and recruitment.
MCAL reduces labeling costs by 6x for auto-labeling data sets.
problem Expensive human annotation for ground-truth data sets.
method Iterative approach that trains a classifier to auto-label part of the data set, determining which samples to label using humans and which to label using the classifier at each step.
result 6x lower overall cost compared to human labeling the entire data set, always cheaper than competing strategies.
A binary classifier learns to abstain from predictions to balance error and unnecessary abstentions.
problem Balancing error minimization with the need to avoid unnecessary abstentions.
method Characterizes and learns a classifier that optimally trades off errors and abstentions in a semi-supervised setting.
result An algorithm that optimally balances errors and abstentions, is efficient, and practical.
LEEP measures transferability of learned representations efficiently.
problem Evaluating the transferability of learned representations in machine learning.
method LEEP: Log Expected Empirical Prediction, a simple measure requiring one pass through the target data set.
result LEEP predicts transfer and meta-transfer learning performance and convergence speed, outperforming existing measures.
Certified robustness for ImageNet models with randomized smoothing.
problem Creating robust models against adversarial attacks.
method Randomized smoothing with Gaussian noise.
result Certified top-1 accuracy of 49% on ImageNet under small ℓ2 perturbations. Symmetry-electronic fingerprints reveal competing magnetic phases in two-dimensional materials.
problem Predicting magnetic ground states, moments, and anisotropy in two-dimensional magnets.
method Introduce the symmetry-electronic fingerprint (SEF), a physically interpretable representation that encodes crystallographic symmetry operations, Wyckoff-site geometry, and site-resolved electronic structure.
result SEF-trained models accurately classify magnetic ordering and regress moments alongside anisotropy energies.
End-to-end framework learns from imperfect annotations directly.
problem Training machine learning models on imperfect human annotations.
method End-to-end framework merging aggregation with model training and modeling annotator competencies.
result Accuracy gains of up to 25% over state-of-the-art annotation aggregation methods.
SSPN uses deep learning to estimate risk scores in survival analysis with competing risks.
problem Nonidentifiability of cause-specific survival curves in competing risk survival analysis.
method Siamese Survival Prognosis Network (SSPN) that avoids estimating cause-specific survival curves and optimizes an approximation to the C-discrimination index.
result SSPN estimates pairwise concordant time-dependent risks, improving risk scoring in survival analysis with competing risks.
Paper compares SVM and Bayesian Logistic Regression for breast cancer diagnosis.
problem Improving breast cancer diagnosis accuracy using machine learning.
method Used SVM, Bayesian Logistic Regression, and K-Nearest-Neighbors for classification.
result SVM outperformed other classifiers, closely matched by Bayesian Logistic Regression.
A new method compares image classifiers using adaptive sampling of natural images.
problem Evaluation of image classifiers on small, fixed test sets may not generalize to real-world images.
method Adaptive sampling from a large corpus of unlabeled images to maximize classifier discrepancies measured by WordNet hierarchy.
result Human labeling of model-dependent image sets reveals relative classifier performance.
A framework assesses the trustworthiness of probabilistic classifiers using local calibration error.
problem Assessing the trustworthiness of probabilistic classifiers beyond traditional metrics.
method I-trustworthy framework linking local calibration to trustworthiness; Kernel Local Calibration Error (KLCE) method for hypothesis testing.
result The effectiveness of the proposed test statistic demonstrated through simulated and real-world datasets.
A new copula estimation method using classification.
problem Estimating copula density from joint and marginal distributions.
method Train a classifier to distinguish joint density from product of marginals.
result Empirically outperforms existing copula estimators.
Amobee's system won 3rd place in Twitter sentiment classification.
problem Sentiment detection on Twitter using deep learning.
method RNN models trained on a sentiment treebank, combined with classifiers.
result 3rd place in SemEval 2017 task 4, 5-label classification.
Comprisk simplifies competing-risks analysis in Python.
problem Analyzing medical time-to-event data with competing risks.
method A scikit-learn-compatible toolkit for competing-risks survival analysis.
result Comprisk provides a unified API for various competing-risks methods.
Classifiers based on sparse representations have recently been shown to provide excellent results in many visual recognition and classification tasks. However, the high cost of computing sparse representations at test time is a major obstacle that limits the applicability of these methods in large-scale problems, or in…
We developed a framework to benchmark and compare competing risks survival models.
problem Limited systematic evaluation and adoption of competing risks survival models.
method Open-source reproducible benchmarking framework for comprehensive comparison.
result Systematic comparison across multiple datasets on various performance aspects.
XGBOD combines unsupervised and supervised methods for better outlier detection.
problem Enhanced outlier detection from normal observations in various datasets.
method Hybrid approach using unsupervised representation learning to improve a supervised classifier.
result XGBOD outperforms competing methods across seven datasets.
SurvivalBoost improves prediction of event times in competing risks scenarios.
problem Predicting event times in scenarios with multiple possible outcomes.
method Developed a strictly proper censoring-adjusted scoring rule for stochastic optimization of competing risks.
result SurvivalBoost outperforms 12 state-of-the-art models across various metrics.
Clarinet uses complementary labels to train classifiers with less source data.
problem Training classifiers with true-label data from source domain is costly.
method Proposes CLARINET to train classifiers with complementary-label source data and unlabeled target data.
result CLARINET significantly outperforms baselines in unsupervised domain adaptation.
This paper uses neural networks to accurately model competing risks in survival analysis.
problem Ignoring competing risks leads to biased survival estimation in machine learning models.
method The paper introduces constrained monotonic neural networks to model each competing survival distribution.
result The method ensures exact likelihood maximization with reduced computational cost.
Proposes and evaluates three diagnostic graphics for probabilistic classifiers.
problem Evaluating and comparing probabilistic classifiers.
method Triptych of diagnostic graphics: reliability diagram, ROC curve, Murphy diagram.
result Visual diagnostics reveal distinct aspects of forecast performance.
Competency questions help experts select best clustering for energy data.
problem Ad hoc and subjective selection of clustering structures by domain experts.
method Formalize expert knowledge and requirements with competency questions.
result Competency questions improve reproducibility and evaluation of clustering applications.
A new classification method using disjoint centroids and normalized distance.
problem Improving classification accuracy and feature selection.
method Nearest disjoint centroid classifier with normalized distance.
result Our method outperforms other classifiers in terms of misclassification rates and feature usage.
Study examines HTE estimation from time-to-event data with competing events.
problem Estimating HTEs from time-to-event data with competing events.
method Outcome modeling approach using plug-in estimators for potential outcomes.
result Competing events introduce new challenges for HTE estimation.