New technique reduces gender discrimination in credit lending models.
problem Bias and unfairness in credit lending predictions.
method Subgroup Threshold Optimizer (STO) technique.
result Reduces gender discrimination by over 90%.
FlipTest detects discrimination in classifiers using optimal transport.
problem Detecting discrimination in classifiers without causal information.
method Optimal transport to match individuals in different protected groups, creating similar pairs of in-distribution samples.
result FlipTest identifies subgroups that may be harmed by model discrimination, even when the model satisfies group fairness criteria.
The paper explores intersectional fairness in machine learning, proving bounds on it.
problem Intersectional fairness in machine learning, especially when multiple protected attributes are involved.
method Statistical analysis and bounds on intersectional fairness, leveraging marginal fairness.
result Theoretical bounds on intersectional fairness can be computed from marginal fairness and other statistical quantities.
The paper develops algorithms to detect stability and Morse properties in various groups.
problem Detecting stability and Morse properties in finitely generated groups.
method Various detection and decidability algorithms for stability and Morse properties in specific types of groups.
result The algorithms provide a way to determine if a subgroup is stable or Morse in specific group types.
The paper develops methods to create fair and transferable representations without subgroup discrimination.
problem Creating fair and transferable representations without discriminating subgroups in the population.
method The approach involves modifying data representations to meet fairness constraints, leveraging task similarities via low rank matrix factorization.
result The learned fair representation transfers well to novel tasks, improving prediction performance and fairness metrics.
We study the action of the Veech group of square-tiled surfaces of genus two on homology. This action defines the homology Veech group which is a subgroup of SL2(OD) where OD is a quadratic order of square discriminant. Extending a result of Weitze-Schmithüsen we show that also the h…
Paper proposes a method to identify and treat latent discriminating features in machine learning models.
problem Fairness issues in machine learning models trained on historical data containing sensitive attributes.
method A novel algorithm that identifies and treats latent discriminating features, agnostic of the learning algorithm.
result Experimental results show near-ideal fairness measurement compared to other methods.
Given a compact polarized Kähler manifold X↪CPN, the space of Bergman metrics on X, parameterized by SL(N+1,C), corresponds to a dense set in the space of Kähler potentials in the Kähler class as N→∞. Critical points of the kth K-energy functional, which is def…
Method learns representation invariant to subgroup support using adversarial matching.
problem Representational bias in training data leads to spurious correlations.
method Adversarial support-matching using semi-supervised clustering.
result Improves generalizability to unseen sources.
Prediction systems are successfully deployed in applications ranging from disease diagnosis, to predicting credit worthiness, to image recognition. Even when the overall accuracy is high, these systems may exhibit systematic biases that harm specific subpopulations; such biases may arise inadvertently due to underrepre…
Transformer model outperforms classical methods in childhood anemia prediction across diverse countries.
problem Generalizing childhood anemia prediction models across different countries and data scarcity.
method Transformer-based tabular foundation model compared to classical supervised methods using DHS data.
result Transformer model achieves lower Brier score and ECE in low-data settings, outperforming classical models.
Let L be a nonunimodular definite lattice. Using a theorem of Elkies we show that whether L embeds in the standard definite lattice of the same rank is completely determined by a collection of lattice correction terms, one for each metabolizing subgroup of the discriminant group. As a topological application this gives…
Recent work has explored how to train machine learning models which do not discriminate against any subgroup of the population as determined by sensitive attributes such as gender or race. To avoid disparate treatment, sensitive attributes should not be considered. On the other hand, in order to avoid disparate impact,…
Fairness in machine learning increases privacy risks, especially for underrepresented groups.
problem Privacy risks in fair machine learning models, particularly for underrepresented groups.
method Membership inference attacks to measure information leakage and analyze fairness vs. privacy trade-offs.
result Achieving fairness in machine learning models increases privacy risks, especially for underrepresented groups.
As algorithms increasingly inform and influence decisions made about individuals, it becomes increasingly important to address concerns that these algorithms might be discriminatory. The output of an algorithm can be discriminatory for many reasons, most notably: (1) the data used to train the algorithm might be biased…
Following related work in law and policy, two notions of disparity have come to shape the study of fairness in algorithmic decision-making. Algorithms exhibit treatment disparity if they formally treat members of protected subgroups differently; algorithms exhibit impact disparity when outcomes differ across subgroups,…
The study quantifies and compares aleatoric and epistemic discrimination in ML models.
problem Sources of discrimination in ML models and their impact on performance.
method Quantifying aleatoric and epistemic discrimination using statistical experiments and model accuracy.
result State-of-the-art fairness interventions are effective at removing epistemic discrimination but not aleatoric discrimination in datasets with missing values.
Discrimination-aware classification is receiving an increasing attention in data science fields. The pre-process methods for constructing a discrimination-free classifier first remove discrimination from the training data, and then learn the classifier from the cleaned data. However, they lack a theoretical guarantee f…
Discriminator guidance improves autoregressive diffusion models for generating molecular graphs.
problem Improving the accuracy of autoregressive diffusion models for generating molecular graphs.
method Deriving ways to use a discriminator with a pretrained generative model in the discrete case, including optimal and sub-optimal scenarios.
result Using a discriminator can correct pretrained models and improve exact sampling from the data distribution.
Solves GAN mode collapse by assigning minibatches to multiple discriminators.
problem Mode collapse in GANs where models generate similar samples.
method Multiple discriminators, microbatching, and changing tasks.
result Promotes sample diversity in generated sets.
Kernel discriminant analysis uses nonlinear embeddings to improve classification.
problem Limited effectiveness of linear discriminant analysis in capturing nonlinear features.
method Study of nonlinear embeddings in kernel discriminant analysis using polynomial and Gaussian kernels, solving generalized eigenvalue problems.
result Polynomial and Gaussian discriminants capture class differences through population moments and randomized projections.
Lower-dimensional video discriminators improve GAN performance.
problem High curvature in unconstrained video discriminator loss surfaces.
method Proposed Lower-Dimensional Video Discriminators (LDVD GANs).
result LDVD GANs double Temporal-GAN performance and achieve state-of-the-art performance.
Discriminative clustering uses mutual information to cluster data.
problem Clustering data into cohesive groups.
method Discriminative clustering using mutual information.
result Mutual information has been a cornerstone of discriminative clustering.
Pairwise discriminators stabilize adversarial training by ensuring the generator's alignment is preserved.
problem Stability issues in adversarial training when using sub-optimal discriminators.
method Introducing a family of objectives using pairwise discriminators, ensuring the generator's alignment is preserved.
result Only the generator needs to converge, and the alignment is preserved with any discriminator.
PBN combines generative and discriminative capabilities in a neural network.
problem Combining generative and discriminative capabilities in neural networks.
method Convolutional PBN, sharing FF-NN embodiment, combining generative and discriminative qualities.
result PBN shows excellent qualities from either generative or discriminative viewpoint.
Unified framework for fair decision-making across diverse groups.
problem Statistical brittleness in fairness testing for small subgroups.
method Size-adaptive hypothesis testing framework.
result Validated approach for interpretable, statistically rigorous decisions.
Study on GANs under and overfitting using discriminator unseen data.
problem Understanding and mitigating under and overfitting in GANs.
method Using discriminators unseen by the generator to measure generalization.
result Model capacity of the discriminator affects generator quality; large discriminator capacities do not prevent overfitting.
Study infinite Euclidean distance discriminants of algebraic varieties.
problem Understanding the structure of data points with infinitely many critical points in Euclidean distance correspondence.
method Developed computer code to compute discriminants and proved properties of fibers.
result Infinite Euclidean distance discriminants contain all data points with infinitely many critical points for the nearest-point problem.
Discriminators can be good feature extractors despite their task focus.
problem Discriminators' features are often considered useless for downstream tasks.
method Theoretical analysis and feature space examination to understand discriminator's role.
result Discriminator features are robust and can prevent mode collapse, making them useful for transfer learning.
Optimized GAN discriminator using polyharmonic interpolation.
problem Optimizing the discriminator in GANs with higher-order gradient regularization.
method Polyharmonic interpolation and variational calculus.
result The optimal discriminator is a polyharmonic radial basis function.
Generalized dual discriminator GANs improve upon traditional GANs by using two discriminators and a flexible loss function.
problem Mode collapse in GANs.
method Introducing dual discriminator α-GANs and extending the approach to arbitrary functions. result The approach reduces the optimization problem to a linear combination of an f-divergence and a reverse f-divergence. GNNs improve graph signal discrimination by adding nonlinearities.
problem Improving graph signal discrimination in physical networks.
method Analyzing the discriminability of GNNs and their relation to graph filter banks.
result GNNs are at least as discriminative as linear graph filter banks.
We study two important concepts in adversarial deep learning---adversarial training and generative adversarial network (GAN). Adversarial training is the technique used to improve the robustness of discriminator by combining adversarial attacker and discriminator in the training phase. GAN is commonly used for image ge…
Paper proposes distributed sparse multicategory discriminant analysis for classification.
problem Sparse multicategory classification with distributed data.
method Convex formulation, distributed setting, invariant discriminant subspace recovery.
result Distributed sparse multicategory linear discriminant analysis performs as good as centralized version after a few rounds of communications.
Generative Adversarial Networks (GANs) can successfully approximate a probability distribution and produce realistic samples. However, open questions such as sufficient convergence conditions and mode collapse still persist. In this paper, we build on existing work in the area by proposing a novel framework for trainin…
New method computes discriminative classifiers from generative models.
problem Discriminative vs generative classifiers are often seen as distinct, but this work shows they can be equivalent.
method General theoretical result showing generative classifiers can be computed discriminatively.
result Bayesian Maximum Posterior classifier from generative models matches discriminative classifier definition.
Proposes a curriculum-based dropout discriminator for domain adaptation.
problem Improving domain adaptation using deep learning networks trained on large labeled datasets.
method Introduces a curriculum-based dropout discriminator that gradually increases sample variance and uses reverse gradients to align source and target feature representations.
result The proposed model outperforms state-of-the-art results in domain adaptation tasks.
Proposes a sparse classifier for discriminative Gaussian Mixture Models.
problem Softmax-based discriminative models assume unimodality, leading to parameter redundancy.
method Sparse Bayesian learning for GMM-based discriminative model, reducing parameters and complexity.
result The SDGM outperforms existing softmax-based discriminative models.
New findings show fixed-kernel discriminators are weaker than feature-learning ones.
problem Comparing performance of fixed-kernel and feature-learning discriminators.
method Using function classes F2 and F1, constructing pairs of distributions, and linking IPMs with sliced Wasserstein distances. result Fixed-kernel IPM and SD cannot discriminate certain distributions that feature-learning IPM and SD can.
Paper formalizes anti-discrimination law in automated systems.
problem Algorithmic discrimination in legal contexts.
method Decision-theoretic framework grounded in UK anti-discrimination law.
result Introduced 'conditional estimation parity' metric for ML fairness.
Mining discriminative features for graph data has attracted much attention in recent years due to its important role in constructing graph classifiers, generating graph indices, etc. Most measurement of interestingness of discriminative subgraph features are defined on certain graphs, where the structure of graph objec…
The paper addresses instability in KL divergence estimation using a neural network discriminator.
problem Unstable estimation of KL divergence due to discriminator complexity.
method Using a Reproducing Kernel Hilbert Space (RKHS) to control discriminator complexity.
result Theoretical bound on error probability of KL estimates based on discriminator complexity in RKHS.
We consider a pseudo-Riemannian metric that changes signature along a smooth curve on a surface, called the discriminant curve. The discriminant curve separates the surface locally into a Riemannian and a Lorentzian domain. We study the local behaviour and properties of geodesics at a point on the discriminant where th…
A new method quantifies feature-map discriminativeness for efficient pruning of deep neural networks.
problem Efficiently pruning deep neural networks to reduce computation while maintaining accuracy.
method Presented a novel mathematical formulation (Discriminant Information, DI) to quantify feature-map discriminativeness, enabling efficient pruning and intra-layer mixed precision quantization.
result Our pruned ResNet50 achieves 44% FLOPs reduction without any Top-1 accuracy loss.
In this paper, we compute the subgroup distortion of all finitely generated subgroups of all finitely generated 3-manifold groups, and the subgroup distortion in this case can only be linear, quadratic, exponential and double exponential. It turns out that the subgroup distortion of a subgroup of a 3-manifold group is …
Naive Bayes can be used as a discriminative classifier, matching the definition of logistic regression.
problem The definition of generative and discriminative classifiers.
method Comparing Naive Bayes and logistic regression, showing they can be used in either generative or discriminative ways.
result Naive Bayes can be used as a discriminative classifier.
Regular subgroups of SL3(R) are identified and ruled out.
problem Identifying and characterizing regular subgroups of SL3(R).
method Using Kapovich–Leeb–Porti and Guichard–Wienhard divergent subgroups criteria, and Oh's results.
result Regular subgroups of SL3(R) are precisely lattices in minimal horospherical subgroups.
The standard practice in Generative Adversarial Networks (GANs) discards the discriminator during sampling. However, this sampling method loses valuable information learned by the discriminator regarding the data distribution. In this work, we propose a collaborative sampling scheme between the generator and the discri…