Kernel discriminant analysis uses nonlinear embeddings to improve classification.
problem Limited effectiveness of linear discriminant analysis in capturing nonlinear features.
method Study of nonlinear embeddings in kernel discriminant analysis using polynomial and Gaussian kernels, solving generalized eigenvalue problems.
result Polynomial and Gaussian discriminants capture class differences through population moments and randomized projections.
New robust discriminant analysis for non-Gaussian data.
problem Classical discriminant analysis struggles with non-Gaussian distributions and contaminated datasets.
method Each data point follows its own ES distribution with arbitrary scale, leading to robust classification.
result Maximum-likelihood estimation and classification are simple, fast, and robust.
We introduce a new discriminant analysis method (Empirical Discriminant Analysis or EDA) for binary classification in machine learning. Given a dataset of feature vectors, this method defines an empirical feature map transforming the training and test data into new data with components having Gaussian empirical distrib…
Unified framework for robust discriminant analysis overcomes Gaussian assumptions.
problem Challenges in linear and quadratic discriminant analysis with non-Gaussian or contaminated data.
method FEMDA framework considers arbitrary Elliptically Symmetrical (ES) distributions with flexible scale parameters.
result Maximum-likelihood parameter estimation and classification are robust and efficient.
The study analyzes large dimensional regularized discriminant analysis classifiers using Gaussian mixture models.
problem Understanding the performance of regularized discriminant analysis in large but finite dimensions.
method Large dimensional analysis using Gaussian mixture models and random matrix theory.
result The asymptotic classification error approaches a deterministic quantity dependent on class means and covariances.
Explains LDA and QDA for binary and multiple classes.
problem Classification methods in statistical and probabilistic learning.
method Optimization of decision boundaries, estimation of parameters, relation to other methods.
result Equivalence of LDA and Fisher discriminant analysis.
A new method for LDA using randomized Kaczmarz improves accuracy for large datasets.
problem Efficiently performing LDA on large datasets.
method Randomized Kaczmarz method applied to linear discriminant analysis.
result The method achieves comparable accuracy to full data LDA.
A new robust and flexible classification method for non-Gaussian data.
problem Robustness to scale changes and non-Gaussian distributions in classical discriminant analysis.
method FEMDA uses arbitrary Elliptically Symmetrical distributions and scale parameters for each data point.
result FEMDA is robust to scale changes and outperforms other methods.
Designs an MLP from LDA for multi-Gaussian class classification.
problem Classifying inputs with multiple Gaussian distributions.
method Interprets MLP as generalized LDA, using LDAs for half-space partitioning, neurons for subspace isolation, and merging for class-wise representation.
result Automatic feedforward design for MLP architecture and weights.
Proposes KMvDA for object recognition from multi-view data.
problem Recognizing objects from different views, even when views are heterogeneous.
method Introduces kernel multi-view discriminant analysis (KMvDA) and uses random Fourier features (RFF) for large-scale learning.
result KMvDA and RFF approximation improve object recognition from multi-view data.
A new neural network reduces high-dimensional time-series data for faster classification.
problem Classifying high-dimensional time-series patterns efficiently.
method Developed a time-series discriminant component network (TSDCN) using TSDCA for dimensionality reduction and classification.
result The TSDCN achieves high-accuracy classification and reduces training time.
A novel GPDA method for high-dimensional functional data.
problem Classification and feature selection challenges in high-dimensional, non-stationary functional data.
method Unified two-layer non-stationary Gaussian process with Ising prior for variable selection and classification.
result Demonstrated superior performance on simulated and proteomics datasets.
EFDA extends LDA to non-Gaussian models using exponential families.
problem Classifying non-Gaussian data with LDA's limitations.
method EFDA uses exponential families to derive closed-form estimators for natural parameters and a linear decision rule.
result EFDA matches LDA's accuracy while reducing ECE by 2-6x, proving asymptotic calibration and efficiency.
We present local discriminative Gaussian (LDG) dimensionality reduction, a supervised dimensionality reduction technique for classification. The LDG objective function is an approximation to the leave-one-out training error of a local quadratic discriminant analysis classifier, and thus acts locally to each training po…
We consider the problem of discriminative factor analysis for data that are in general non-Gaussian. A Bayesian model based on the ranks of the data is proposed. We first introduce a new {\em max-margin} version of the rank-likelihood. A discriminative factor model is then developed, integrating the max-margin rank-lik…
New method for tensor classification with missing data.
problem Handling incomplete tensor data in high-dimensional classification.
method High-dimensional tensor linear discriminant analysis with TGMM and Tensor LDA-MD.
result Established convergence rates and minimax optimal bounds for misclassification rate.
A new LDA variant improves multi-label classification performance.
problem Improving multi-label classification performance.
method Saliency-based weights redefine between-class and within-class scatter matrices for multi-label classification.
result The proposed method leads to performance improvements in various multi-label classification problems.
Proposes a sparse classifier for discriminative Gaussian Mixture Models.
problem Softmax-based discriminative models assume unimodality, leading to parameter redundancy.
method Sparse Bayesian learning for GMM-based discriminative model, reducing parameters and complexity.
result The SDGM outperforms existing softmax-based discriminative models.
LDA-GO improves LDA for high-dimensional data via gradient optimization.
problem LDA struggles in high-dimensional settings due to unreliable covariance matrix estimation.
method LDA-GO learns a low-rank precision matrix via gradient optimization, automatically selecting between Gaussian likelihood and cross-entropy loss.
result LDA-GO outperforms other LDA variants in sparse-signal high-dimensional regimes.
Study shows MDA's effectiveness even when more components are assumed than in actual data.
problem Classification error in overspecified Mixture Discriminant Analysis.
method Two-component Gaussian mixture model, EM algorithm, theoretical analysis of convergence and error rates.
result EM algorithm converges exponentially fast to Bayes risk with suitable initialization.
Fisher's linear discriminant analysis (FLDA) is an important dimension reduction method in statistical pattern recognition. It has been shown that FLDA is asymptotically Bayes optimal under the homoscedastic Gaussian assumption. However, this classical result has the following two major limitations: 1) it holds only fo…
The paper optimizes designs for distinguishing between Gaussian process models.
problem Discriminating between two Gaussian process models.
method Sequential and static design criteria, including Kullback Leibler divergences and log-likelihood ratios.
result Necessary conditions for optimal design measures are provided.
We consider an enlarged dimension reduction space in functional inverse regression. Our operator and functional analysis based approach facilitates a compact and rigorous formulation of the functional inverse regression problem. It also enables us to expand the possible space where the dimension reduction functions bel…
GIM uses neural networks with Gaussian distributions to detect out-of-distribution data.
problem Incorrect classification of out-of-distribution data by neural networks.
method GIM is a hybrid classifier based on neural networks with a new loss function that imposes Gaussian distributions on each class.
result GIM achieves state-of-the-art results on image recognition and sentiment analysis datasets.
We develop a class of rules spanning the range between quadratic discriminant analysis and naive Bayes, through a path of sparse graphical models. A group lasso penalty is used to introduce shrinkage and encourage a similar pattern of sparsity across precision matrices. It gives sparse estimates of interactions and pro…
Develops a method to discriminate between competing models using Gaussian process surrogates.
problem Discriminating between competing models when data is insufficient and models are non-analytical.
method Introduces Gaussian process surrogates to extend design of experiments methods to non-analytical models.
result Extends design of experiments methods to non-analytical models in a computationally efficient manner.
Reinterprets DNF as a deep generative LDA model for complex data.
problem Limited applicability of LDA in complex data scenarios.
method Proposes a discriminative normalization flow (DNF) model and interprets it as a deep generative LDA.
result DNF and its subspace version outperform conventional LDA in modeling complex data.
New algorithms improve robust estimation in contaminated Gaussian models.
problem Simultaneous estimation of location and variance matrix in contaminated Gaussian models.
method Tractable adversarial algorithms with spline discriminators for robust estimation.
result Achieve minimax optimal rates or near-optimal rates under Huber's contamination model.
GPdoemd optimizes experiments for model discrimination using Gaussian processes.
problem Discriminating between competing models when data is limited.
method Developed a new design criterion and Gaussian process surrogate method for black-box models.
result Demonstrated improved model discrimination using Gaussian process surrogates.
Enhances deep learning robustness to noise without sacrificing clean data accuracy.
problem Robustness of deep neural networks to input noise.
method Discriminative loss at penultimate layer and class-wise feature alignment with Gaussian noise.
result Improves robustness to various perturbations without degrading clean data accuracy.
The paper improves classification accuracy by leveraging a shared signal across domains in high-dimensional classification.
problem Improving classification accuracy in high-dimensional data with shared signals across domains.
method Transfer learning for linear discriminant analysis, decomposing mean differences into common and domain-specific components.
result Deterministic limits for transfer performance, leading to optimal weights and corrections for bias.
Multi-output Gaussian processes (MOGP) are probability distributions over vector-valued functions, and have been previously used for multi-output regression and for multi-class classification. A less explored facet of the multi-output Gaussian process is that it can be used as a generative model for vector-valued rando…
Unified analysis of multilabel Fisher discriminants with improved dimensionality and robustness.
problem Improving discriminant analysis for multilabel classification with enhanced dimensionality and robustness.
method Unified theoretical analysis of multilabel Fisher discriminants with algebraic and statistical guarantees.
result Unified characterization of multilabel Fisher objectives and their equivalence under orthogonality constraints.
Unified analysis of multilabel Fisher discriminants with improved dimensionality and robustness.
problem Improving discriminant analysis for multilabel classification with enhanced dimensionality and robustness.
method Unified algebraic and statistical analysis of multilabel Fisher discriminants with Stiefel orthogonality constraints.
result Equivalence of four Fisher objectives under the Stiefel constraint and improved discriminant dimensionality.
This study considers the multivariate segmentation procedure under the assumption of the multivariate Gaussian mixture. Jensen-Shannon divergence between two multivariate Gaussian distributions is employed as a discriminator and a recursive segmentation procedure is proposed. The daily log-return time series for 30 cur…
Global feature model improves early AD diagnosis accuracy.
problem Early diagnosis of mild cognitive impairment (MCI) using structural MRI images.
method Gaussian discriminant analysis (GDA) with dual high-dimensional decision spaces for global feature extraction.
result Achieved F1 score of 91.06% for MCI vs. CN group.
As increasing amounts of sensitive personal information is aggregated into data repositories, it has become important to develop mechanisms for processing the data without revealing information about individual data instances. The differential privacy model provides a framework for the development and theoretical analy…
Paper proposes distributed sparse multicategory discriminant analysis for classification.
problem Sparse multicategory classification with distributed data.
method Convex formulation, distributed setting, invariant discriminant subspace recovery.
result Distributed sparse multicategory linear discriminant analysis performs as good as centralized version after a few rounds of communications.
Proposes R2LDA for improved LDA classifier performance.
problem Poor performance of LDA classifiers in small to comparable data sizes.
method Doubly regularized LDA with automatic parameter selection.
result Consistent and effective performance in noisy test data.
This paper presents a novel approach to speaker subspace modelling based on Gaussian-Binary Restricted Boltzmann Machines (GRBM). The proposed model is based on the idea of shared factors as in the Probabilistic Linear Discriminant Analysis (PLDA). GRBM hidden layer is divided into speaker and channel factors, herein t…
A method detects abnormal samples and adversarial attacks.
problem Detecting abnormal samples and adversarial attacks in deep neural networks.
method Obtain class conditional Gaussian distributions and use Mahalanobis distance for confidence score.
result Achieves state-of-the-art performance for both out-of-distribution and adversarial samples.
The class of Schoenberg transformations, embedding Euclidean distances into higher dimensional Euclidean spaces, is presented, and derived from theorems on positive definite and conditionally negative definite matrices. Original results on the arc lengths, angles and curvature of the transformations are proposed, and v…
The paper examines Nash equilibrium in GANs for stationary Gaussian processes.
problem Existence and uniqueness of Nash equilibrium in GANs for stationary Gaussian processes.
method Analyzes the existence of Nash equilibrium in GANs for stationary Gaussian processes, considering different discriminator families.
result The existence of Nash equilibrium depends on the discriminator family and symmetry properties of the generator family.
Proposes a novel linear discriminant analysis for matrix-valued data.
problem Classification of high-dimensional matrix-valued data from imaging studies.
method Efficient nuclear norm penalized regression with low-rank structure.
result Superior performance compared to existing methods in simulations and EEG data.
Paper introduces a new probabilistic model for class-specific discriminant analysis.
problem Lack of multi-modal structure consideration in existing class-specific methods.
method Formulates a probabilistic model that incorporates multi-modal negative class structure.
result Proposed model can be directly used for class-specific probabilistic classification.
Paper proposes faster incremental subclass discriminant analysis.
problem Efficiently classify subclasses in incremental data.
method Exact and approximate linear and kernelized solutions.
result Superior training time and accuracy compared to existing methods.
Improved LDA method for better classification and dimensionality reduction.
problem Improving linear discriminant analysis for better classification performance.
method Integrates spectrally-corrected covariance matrix and regularized discriminant analysis.
result SRLDA has a linear classification global optimal solution under spiked model assumption.
PANDA improves linear discriminant analysis in high dimensions with minimal tuning.
problem Linear discriminant analysis in high-dimensional settings.
method PANDA: a tuning-insensitive method for linear discriminant analysis.
result PANDA achieves optimal convergence rates in estimation error and misclassification rate.