Discriminators can be good feature extractors despite their task focus.
problem Discriminators' features are often considered useless for downstream tasks.
method Theoretical analysis and feature space examination to understand discriminator's role.
result Discriminator features are robust and can prevent mode collapse, making them useful for transfer learning.
New findings show fixed-kernel discriminators are weaker than feature-learning ones.
problem Comparing performance of fixed-kernel and feature-learning discriminators.
method Using function classes F2 and F1, constructing pairs of distributions, and linking IPMs with sliced Wasserstein distances. result Fixed-kernel IPM and SD cannot discriminate certain distributions that feature-learning IPM and SD can.
Proposes joint domain alignment and discriminative feature learning for deep domain adaptation.
problem Reduces domain shift and misclassification of target domain samples.
method Instance-based and center-based discriminative feature learning methods.
result Learning discriminative features in shared feature space significantly boosts deep domain adaptation performance.
Mining discriminative features for graph data has attracted much attention in recent years due to its important role in constructing graph classifiers, generating graph indices, etc. Most measurement of interestingness of discriminative subgraph features are defined on certain graphs, where the structure of graph objec…
Feature learning forms the cornerstone for tackling challenging learning problems in domains such as speech, computer vision and natural language processing. In this paper, we consider a novel class of matrix and tensor-valued features, which can be pre-trained using unlabeled samples. We present efficient algorithms f…
Feature learning forms the cornerstone for tackling challenging learning problems in domains such as speech, computer vision and natural language processing. In this paper, we consider a novel class of matrix and tensor-valued features, which can be pre-trained using unlabeled samples. We present efficient algorithms f…
Smart Bayes integrates generative and discriminative features for improved classification.
problem Improving classification performance by combining generative and discriminative modeling.
method Integrates generative likelihood-ratio features into a logistic-regression-style classifier.
result Often outperforms logistic regression and Naive Bayes in simulations and real data.
A new method quantifies feature-map discriminativeness for efficient pruning of deep neural networks.
problem Efficiently pruning deep neural networks to reduce computation while maintaining accuracy.
method Presented a novel mathematical formulation (Discriminant Information, DI) to quantify feature-map discriminativeness, enabling efficient pruning and intra-layer mixed precision quantization.
result Our pruned ResNet50 achieves 44% FLOPs reduction without any Top-1 accuracy loss.
Paper presents a novel feature learning method using Encoder-Decoder type Deep Neural Nets.
problem Learning discriminative features from high-dimensional complex data.
method Training Encoder/Decoder type Deep Neural Nets for feature learning.
result The approach can learn discriminative features that perform better in pattern classification with limited training samples.
Enhances water disaggregation for parallel appliances using shape features and Bayesian Discriminative Sparse Coding.
problem Accurately discriminate and disaggregate water consumption patterns from parallel appliances.
method Bayesian Discriminative Sparse Coding (BDSC-LP) with Laplace Prior, shape features, Gibbs sampling.
result Extensive experiments validate the effectiveness of the proposed model.
Interventional domain adaptation improves feature transferability by removing spurious correlations.
problem Improper feature transferability due to spurious correlations in domain adaptation.
method Intervention strategy using unlabeled target data to generate counterfactual features and train discriminability invariance.
result Consistent performance improvements over state-of-the-art approaches in various domain adaptation tasks.
Proposes TFDF to learn transferable and discriminative features for unsupervised domain adaptation.
problem Difficult to induce supervised classifier without labeled data in unsupervised domain adaptation.
method TFDF optimizes transferability and discriminability by aligning distributions and minimizing class confusion.
result TFDF achieves better performance on real-world datasets compared to existing methods.
Paper enhances haptic signals distinguishability with boosted technique.
problem Lack of large datasets in haptics domain limits feature extraction.
method General framework for haptic signal analysis, using spectral features and boosted embedding.
result Framework needs less training data and outperforms state-of-the-art.
New model selects uncorrelated and discriminative features for unsupervised feature selection.
problem Selecting uncorrelated and discriminative features in high-dimensional data.
method Adaptive graph-based generalized regression model with uncorrelated constraint and ℓ2,1-norm regularization. result The model effectively selects uncorrelated and discriminative features, improving clustering performance.
New method optimizes kernel feature maps for better classification.
problem High computational and memory complexity of standard kernel methods.
method Discriminant Information criterion for optimizing kernel feature maps.
result Improved optimization and generalization performances over state-of-the-art methods.
Improves GANs by enforcing diverse feature learning.
problem GANs can collapse to a single configuration and be unstable.
method Enforces diverse feature learning by penalizing correlated features.
result Enforces diverse features, stabilizes training, and improves image synthesis.
A new method for high-dimensional data classification with improved feature selection.
problem High-dimensional data classification with limited interpretability and prediction accuracy.
method Integrates multiclass diagonal discriminant analysis with feature selection.
result Significantly improved prediction accuracy and feature interpretability.
IMKPL learns interpretable prototypes for better classification.
problem Efficient trade-offs between interpretability and prediction accuracy in kernel-based data.
method Local discrimination in feature space, condensed class-homogeneous neighborhoods, combined embedding.
result IMKPL achieves better interpretability and discriminative representation.
We introduce a new discriminant analysis method (Empirical Discriminant Analysis or EDA) for binary classification in machine learning. Given a dataset of feature vectors, this method defines an empirical feature map transforming the training and test data into new data with components having Gaussian empirical distrib…
Develops a method to interpret deep learning models by identifying key features.
problem Revealing the decision-making process of blackbox models from raw data to predictions.
method Adversarial attacks to localize discriminative features with statistical guarantees.
result Locally identified features are both biologically plausible and statistically significant.
DFSOS improves sparse discriminant analysis for high-dimensional data.
problem Sparse discriminant analysis in high-dimensional settings with feature selection.
method Deflation-Free Sparse Optimal Scoring (DFSOS) using Bregman iteration and orthogonality-constrained optimization.
result DFSOS achieves comparable or better classification accuracy than deflation-based methods.
Proposes L-Softmax loss for CNNs to improve feature discriminativeness.
problem Lack of explicit feature discriminativeness in cross-entropy loss.
method Introduces L-Softmax loss that encourages intra-class compactness and inter-class separability.
result Deeply learned features with L-Softmax loss are more discriminative, boosting performance.
CRDA improves gene selection in microarray studies by reducing feature space.
problem Gene selection in high-dimensional microarray datasets.
method CRDA combines ℓq,1 norm minimization and hard thresholding for feature elimination. result CRDA outperforms competitors in misclassification and feature selection accuracy.
A method classifies image-sets using convex cones based on CNN features.
problem Image-set classification using CNN features.
method Modeling CNN features as convex cones and measuring geometric similarity.
result Enhanced classification through discriminant space maximization of between-class variance.
Incorporating feature selection into a classification or regression method often carries a number of advantages. In this paper we formalize feature selection specifically from a discriminative perspective of improving classification/regression accuracy. The feature selection method is developed as an extension to the r…
The paper introduces a method to eliminate latent discrimination in predictive models.
problem Controlling for latent discrimination in predictive models.
method Defining a new fairness criterion inspired by omitted variable bias, and a training strategy that includes sensitive features during training and excludes them during testing.
result A simple yet effective strategy to eliminate latent discrimination in predictive models.
Kernel discriminant analysis uses nonlinear embeddings to improve classification.
problem Limited effectiveness of linear discriminant analysis in capturing nonlinear features.
method Study of nonlinear embeddings in kernel discriminant analysis using polynomial and Gaussian kernels, solving generalized eigenvalue problems.
result Polynomial and Gaussian discriminants capture class differences through population moments and randomized projections.
Sparse GEMINI selects relevant features for clustering without assumptions.
problem Feature selection in clustering with relevant clusters and variables.
method Discriminative clustering model maximizing GEMINI with l1 penalty.
result Sparse GEMINI selects relevant subsets of variables without prior hypotheses.
Paper introduces robust learning from feature feedback, even with annotator errors.
problem Learning from human feedback on discriminative features, especially when annotators make mistakes.
method Develops a robust framework for learning with imperfect feedback, deriving regret bounds in adversarial and stochastic settings.
result Regret bounds independent of feature number, showing robust learning is not reducible to non-robust settings.
Maximizes coding rate difference for robust, discriminative features.
problem Learning robust, discriminative features from high-dimensional data.
method Maximal Coding Rate Reduction (MCR^2) principle.
result Significantly more robust to label corruptions in classification.
KLSDA improves ERP-based BCI classification with sparse feature selection.
problem Binary pattern recognition in ERP-based BCI.
method Kullback-Leibler penalized sparse discriminant analysis (KLSDA).
result KLSDA outperforms standard SDA in ERP-EEG datasets.
New robust algorithms improve learning with feature feedback.
problem Interactive learning with discriminative feature feedback.
method Developed new robust interactive learning algorithms with improved mistake bounds.
result Achieved significantly lower mistake bounds in adversarial and stochastic settings.
VPFD uses vocoder features for adversarial training in VC.
problem Adversarial training on waveform data is time-consuming and memory-intensive.
method VPFD employs vocoder features for adversarial training.
result VPFD achieves VC performance comparable to waveform discriminators with reduced training time and memory.
GOLFS selects features for clustering by combining global and local information.
problem Feature selection for high-dimensional clustering without labels.
method Combines global and local information via manifold learning and regularized self-representation.
result Improves feature selection and clustering accuracy.
Improves GAN performance without changing network architecture.
problem Discriminator fails to guide generator effectively.
method Cascading Rejection (CR) module for discriminator.
result Significantly improves GAN performance in terms of FID.
Enhances hashing for cross-modal retrieval using multi-view features.
problem Limited improvement in single-view hashing for cross-modal retrieval.
method Exploits multiple views to enrich feature information, learning discriminative hash codes.
result Superior performance compared to state-of-the-art methods on various datasets.
This paper proposes an online knowledge distillation method that transfers feature map information in addition to class probabilities.
problem Previous online knowledge distillation methods only utilized class probabilities, missing feature map information.
method Adversarial training framework to transfer feature map information; multiple networks trained simultaneously with discriminators.
result Our method performs better than direct alignment methods and is more suitable for online distillation.
A new algorithm interprets DR dimensions and selects features.
problem Lack of interpretability in DR algorithms.
method I-KDR algorithm that maps data to a lower dimensional space with interpretable dimensions and feature selection.
result I-KDR provides better interpretations and higher discriminative performance.
Paper proposes a method to identify and treat latent discriminating features in machine learning models.
problem Fairness issues in machine learning models trained on historical data containing sensitive attributes.
method A novel algorithm that identifies and treats latent discriminating features, agnostic of the learning algorithm.
result Experimental results show near-ideal fairness measurement compared to other methods.
Method identifies key features for clustering in high-dimensional data.
problem Understanding hidden patterns in high-dimensional data.
method Unsupervised feature selection based on discriminative power.
result 27 key transcription factors identified, 18 known to define cell states.
TRAIL improves robot imitation learning by focusing on task-relevant features.
problem Discriminator networks learn spurious associations, providing poor reward signals.
method Constrained discriminator optimization to learn task-relevant rewards.
result TRAIL outperforms GAIL and behaviour cloning in robotic manipulation tasks.
Proposes a neural network approach to enforce direct supervision in hidden layers for better feature learning.
problem Gradient vanishing and lack of discriminative features in hidden layers of CNNs.
method Introduces a label consistency regularization loss for late hidden layers combined with classification error loss.
result Achieves state-of-the-art performance on public benchmarks for action and object recognition.
DSL learns discriminative subgraphs from graphs for robust prediction.
problem Learning discriminative subgraphs from graph data for robust prediction.
method Discriminative Subgraph Learning (DSL) framework that enforces sparsity, connectivity, and high discriminative power.
result DSL improves prediction accuracy by up to 16% compared to baselines.
This paper refines MMD for domain adaptation by balancing intra-class and inter-class distances.
problem Balancing intra-class and inter-class distances for better feature discriminability in domain adaptation.
method The paper theoretically proves two facts about MMD and proposes a novel discriminative MMD method to balance intra-class and inter-class distances.
result The proposed method improves feature discriminability and outperforms state-of-the-art methods.
Improves MKL for multi-class classification with better feature selection and representation.
problem Real-world multi-class classification problems with non-linear separations.
method Large-margin multiple kernel learning (LMMK) with sparsity term for discriminative feature selection.
result Competitive classification accuracy and sparse non-zero kernel weights.
New method improves OOD detection by integrating diffusion models into discriminator models.
problem Overconfidence in discriminator models leads to poor OOD detection.
method Integrates diffusion models into discriminator and generation models to mitigate overconfidence.
result Demonstrates significant improvement in AUROC scores for challenging datasets.
Develops interpretable low-dimensional kernels with conic discriminant functions.
problem Improving interpretability in kernel-based classification models.
method Gradually constructs simple feature maps leading to interpretable low-dimensional kernels.
result Obtains high accuracy results without extensive hyperparameter tuning.
Proposes KMvDA for object recognition from multi-view data.
problem Recognizing objects from different views, even when views are heterogeneous.
method Introduces kernel multi-view discriminant analysis (KMvDA) and uses random Fourier features (RFF) for large-scale learning.
result KMvDA and RFF approximation improve object recognition from multi-view data.