Bias in training data affects diagnostic algorithms' performance.
problem Bias in training data leads to biased predictions in diagnostic algorithms.
method Survey of MICCAI 2018 proceedings, analysis of a skin lesions dataset, adversarial training setup.
result Classifier performance varies significantly between subgroups based on age and sex.
Proposes a framework to create fair IDRs by enforcing demographic parity constraints.
problem Discrimination in IDRs trained on biased data.
method Incorporates DP and CDP constraints into IDR estimation.
result Theoretically optimal IDRs can be efficiently obtained through perturbations.
New framework tackles fairness in link prediction beyond demographic parity.
problem Systemic biases in link prediction can exacerbate societal inequalities.
method Formalizes limitations of existing fairness evaluations and proposes a new framework.
result Proposes a lightweight post-processing method combined with decoupled link predictors.
CondMTL improves toxicity detection by learning group-specific representations.
problem Algorithmic bias in toxic language detection across demographic groups.
method Conditional Multi-Task Learning (CondMTL) for demographic-specific tasks.
result CondMTL improves predictive recall for minority demographic groups.
We propose a novel algorithm for learning fair representations that can simultaneously mitigate two notions of disparity among different demographic subgroups in the classification setting. Two key components underpinning the design of our algorithm are balanced error rate and conditional alignment of representations. …
Traditional medicine typically applies one-size-fits-all treatment for the entire patient population whereas precision medicine develops tailored treatment schemes for different patient subgroups. The fact that some factors may be more significant for a specific patient subgroup motivates clinicians and medical researc…
Fair k-means algorithm ensures equitable costs for different groups.
problem K-means clustering can result in biased outcomes for subgroups of data.
method Presented a fair k-means objective and algorithm (Fair-Lloyd) to choose cluster centers that provide equitable costs for different groups.
result Fair-Lloyd algorithm ensures all groups have equal costs in the output k-clustering, with negligible increase in running time.
We consider the problem of learning representations that achieve group and subgroup fairness with respect to multiple sensitive attributes. Taking inspiration from the disentangled representation learning literature, we propose an algorithm for learning compact representations of datasets that are useful for reconstruc…
New benchmark predicts cardiometabolic risk from accelerometer data, with varying accuracy.
problem Lack of accurate tabular benchmarks for cardiometabolic risk from accelerometer data.
method Tabular learning methods (ridge regression, XGBoost, TabPFN v2) applied to NHANES data.
result TabPFN v2 achieves best performance, but triglycerides remain largely unpredictable.
The paper studies and mitigates accuracy disparity in regression models.
problem Accuracy disparity between different demographic subgroups in high-stakes domains.
method Error decomposition theorem and distribution alignment algorithm.
result The proposed algorithm effectively mitigates accuracy disparity while maintaining predictive power.
The growing capability and accessibility of machine learning has led to its application to many real-world domains and data about people. Despite the benefits algorithmic systems may bring, models can reflect, inject, or exacerbate implicit and explicit societal biases into their outputs, disadvantaging certain demogra…
Developing learning methods which do not discriminate subgroups in the population is a central goal of algorithmic fairness. One way to reach this goal is by modifying the data representation in order to meet certain fairness constraints. In this work we measure fairness according to demographic parity. This requires t…
A new method improves AI fairness assessment by estimating performance across intersectional subgroups.
problem Limited evaluation of AI systems across intersectional subgroups due to small sample sizes.
method Structured regression approach to disaggregated evaluation.
result Our method yields more accurate performance estimates, especially for small subgroups.
GAME improves matrix completion by considering subgroup-specific latent structures.
problem Heterogeneous data with overlapping categories, smoothing away subgroup-specific variation.
method Group-Aware Matrix Estimation (GAME) with overlapping nuclear-norm penalties.
result GAME outperforms global low-rank estimators in structured missingness regimes.
Proposes a method to select features for subgroup datasets with systematic missing data.
problem Feature selection for datasets with subgroup structure and systematic missing data.
method Develops a heterogeneous graph neural network to propagate information between feature-subgroup-target variable connections.
result Demonstrates improved feature selection performance and scalability.
FairWASP optimizes training data to reduce disparities across subgroups.
problem Reducing disparities in model outputs across different subgroups in machine learning.
method A novel pre-processing approach that minimizes Wasserstein distance to the original dataset while satisfying demographic parity.
result Integer weights are optimal, allowing FairWASP to be understood as duplicating or eliminating samples.
Unified framework for fair decision-making across diverse groups.
problem Statistical brittleness in fairness testing for small subgroups.
method Size-adaptive hypothesis testing framework.
result Validated approach for interpretable, statistically rigorous decisions.
Medical imaging models may encode demographic attributes without violating fairness, depending on the approach.
problem Discrimination in medical imaging models due to encoding demographic attributes.
method Examined marginal and class-conditional representation invariance, traditional fairness notions, and counterfactual fairness.
result Demographically invariant models may not necessarily be fair, and encoding demographic attributes can be advantageous.
Inferring user characteristics such as demographic attributes is of the utmost importance in many user-centric applications. Demographic data is an enabler of personalization, identity security, and other applications. Despite that, this data is sensitive and often hard to obtain. Previous work has shown that purchase …
Counterfactual fairness not equivalent to demographic parity, finds study.
problem Equivalence between causal and probabilistic concepts in fairness metrics.
method Close examination of recent claim about counterfactual fairness.
result Counterfactual fairness is not equivalent to demographic parity.
In this paper, we propose a new deep feature selection method based on deep architecture. Our method uses stacked auto-encoders for feature representation in higher-level abstraction. We developed and applied a novel feature learning approach to a specific precision medicine problem, which focuses on assessing and prio…
New methods target conditional demographic parity using optimal transport distances.
problem Auditing and enforcing conditional demographic parity (CDP) in models with complex conditioning variables.
method Developed novel measures of conditional demographic disparity (CDD) based on optimal transport distances and regularization-based approaches.
result Validated methods airbit{} and airlp{} effectively target CDP in real-world datasets with continuous model outputs.
DeepUnHide uses deep learning to reveal hidden demographic features in recommender systems.
problem Extracting hidden demographic features from recommender systems factors.
method Gradient-based localization in deep learning for feature extraction.
result DeepUnHide outperforms state-of-the-art feature selection methods.
A new method for survival analysis models that ensures fairness without using sensitive demographic data.
problem Ensuring fairness in survival analysis models without relying on sensitive demographic information.
method A worst-case error minimization approach using a training loss function that does not know sensitive demographic information.
result The proposed method often scores better on fairness metrics without a significant drop in prediction accuracy compared to baselines.
We find the optimal error for a constrained regression model under a linear model.
problem Minimizing error while adhering to demographic parity constraints.
method Proposed a minimax optimal error analysis for a demographic parity-constrained regression problem within a linear model.
result The minimax optimal error is characterized by $Θ( rac{dM}{n})$.
Study achieves fairness without demographic info, improving regression tasks.
problem Achieve fairness in models without prior demographic info.
method VFair method to minimize training loss variance, dynamic update approach.
result Regression tasks can achieve significant fairness improvement without prior demographics.
Paper develops a model to assess capital requirement for demographic risk using stochastic methods.
problem Quantifying capital requirement for demographic risk in life insurance contracts.
method Stochastic model extending local GAAP to Solvency II framework, proving market consistency.
result Model highlights main drivers of capital requirement evaluation, comparing to GAAP.
A new method uses model gradients to improve fairness without relying on demographic data.
problem Algorithmic fairness issues due to missing demographic information and complex interactions.
method Learning a graph of gradients to identify and improve group fairness robustly to noise.
result Significantly improves fairness without sacrificing overall accuracy.
In this paper, we consider the problem of predicting demographics of geographic units given geotagged Tweets that are composed within these units. Traditional survey methods that offer demographics estimates are usually limited in terms of geographic resolution, geographic boundaries, and time intervals. Thus, it would…
Algorithm ensures demographic parity in regression without sensitive attribute data.
problem Performing regression with demographic parity constraints.
method Post-processing algorithm using accurate estimates and sensitive attribute predictor.
result Generates predictions meeting demographic parity constraint.
Recent advances in Representation Learning and Adversarial Training seem to succeed in removing unwanted features from the learned representation. We show that demographic information of authors is encoded in -- and can be recovered from -- the intermediate representations learned by text-based neural classifiers. The …
Meta-theorems validate fair regression algorithms under demographic parity constraints.
problem Regression under demographic parity constraints.
method Meta-theorems and post-processing methods.
result Fair minimax optimal regression can be achieved through post-processing.
New method reduces variance in subpopulation model performance estimates.
problem High variance in subpopulation performance metrics for small groups.
method Using an evaluation model to form model-based metric (MBM) estimates.
result MBMs produce more accurate and lower variance estimates for small subpopulations.
Paper proposes a method to detect fair communities in graphs considering demographic attributes.
problem Inconsistent community detection violates fairness constraints for nodes with demographic attributes.
method Develops an ℓ1-regularized pseudo-likelihood approach for fair graphical model selection. result The method ensures demographic groups are fairly represented within detected communities.
FWC creates fair synthetic samples for machine learning tasks.
problem Addressing biases in machine learning models for fair decision-making.
method FWC uses an efficient majority minimization algorithm to minimize Wasserstein distance while enforcing demographic parity.
result FWC achieves a competitive fairness-utility tradeoff and reduces biases in predictions from large language models.
Study predicts U.S. county COVID-19 growth using demographic and social distancing data.
problem Predicting county-level COVID-19 growth during the pandemic.
method Spectral clustering, correlation matrix, demographic features, social distancing scores, LSTM model.
result Effective prediction of future county growth using demographic and social distancing data.
Integrates differential privacy and demographic parity in multi-class classification.
problem Ensuring fairness and privacy in sensitive applications.
method Designs DP2DP algorithm that enforces both demographic parity and differential privacy.
result DP2DP converges towards demographic parity at nearly the same rate as non-private methods, achieving state-of-the-art trade-offs.
New dataset for evaluating speech recognition fairness across demographics.
problem Lack of fairness metrics in speech recognition datasets.
method Developed Fair-Speech dataset with diverse demographic information.
result Helps evaluate ASR models for fairness across demographics.
Classifiers that achieve demographic balance by explicitly using protected attributes such as race or gender are often politically or culturally controversial due to their lack of individual fairness, i.e. individuals with similar qualifications will receive different outcomes. Individually and group fair decision crit…
The paper shows how demographic data can lead to biased predictions, proposing 'Affirmative Information' as a solution.
problem Bias in predictions due to demographic data.
method Characterization of error types and conditions leading to disparate impact.
result Demographic variables in data can lead to biased predictions, with higher average outcomes receiving higher false positive rates.
This research presents an analysis of the demographic risk related to future membership patterns in pension funds with restricted entrance, financed under a pay-as-you-go scheme. The paper, therefore, proposes a stochastic model for investigating the behaviour of the demographic variable "new entrants" and the influenc…
The study improves crime prediction using Foursquare and streetlight data with demographic info.
problem Improving crime prediction models using diverse data sources.
method Combining Foursquare and streetlight data with demographic info for crime prediction.
result The proposed model enhances classification performance in crime prediction.
New framework enforces demographic parity on distribution tails.
problem Enforcing demographic parity on entire distribution can degrade accuracy.
method Optimal transport theory, focusing on distribution tails.
result More nuanced and context-sensitive fairness interventions.
New approach to counterfactual reasoning avoids demographic interventions.
problem Limitations of traditional counterfactual reasoning in AI systems.
method Backtracking counterfactual approach instead of interventional.
result Allows addressing social concerns without demographic interventions.
Fair machine learning has become a significant research topic with broad societal impact. However, most fair learning methods require direct access to personal demographic data, which is increasingly restricted to use for protecting user privacy (e.g. by the EU General Data Protection Regulation). In this paper, we pro…
Model predicts human food choices based on demographics.
problem Predicting human food choices from demographic data.
method Non-deterministic model based on NHANES dataset and behavioral studies.
result Generates synthetic data similar to original dataset.
Unified framework for fair regression under demographic parity.
problem Ensuring fairness in regression tasks subject to demographic parity constraints.
method Proposes a unified framework applicable to various regression tasks with a broad spectrum of loss functions, derived a novel characterization of the fair risk minimizer, and established theoretical consistency and convergence rates.
result Effective minimization of risk while satisfying fairness constraints across various regression settings.
The paper explores fair regression and classification under demographic parity constraints.
problem Ensuring fairness in regression and classification models under demographic parity constraints.
method Characterizes the optimal fair regression function using a barycenter problem with optimal transport costs and studies the connection between fair classification and regression.
result The optimal fair regression function is derived from the solution to a barycenter problem with optimal transport costs, and the optimal fair cost-sensitive classifiers can be derived by applying thresholds to this function.