We present a novel subset scan method to detect if a probabilistic binary classifier has statistically significant bias -- over or under predicting the risk -- for some subgroup, and identify the characteristics of this subgroup. This form of model checking and goodness-of-fit test provides a way to interpretably detec…
On-device research index
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
168,695 papers · 148 categories
Trend · papers per month
48 results for “Subgroup Bias”
WHOMP optimizes randomized controlled trials by minimizing subgroup bias.
problem Minimizing subgroup bias in randomized controlled trials.
method Wasserstein Homogeneity Partition (WHOMP) method.
result WHOMP optimally minimizes type I and type II errors in trials.
A new metric MSD detects bias in datasets efficiently.
problem Detecting bias in AI systems and datasets.
method Introduced Maximum Subgroup Discrepancy (MSD) metric and a practical algorithm based on MIO.
result MSD provides a linear sample complexity for practical applications, distinguishing biases effectively.
This paper evaluates fairness in deep metric learning and proposes a method to reduce subgroup performance gaps.
problem The negative impact of deep metric learning representations on minority subgroup performance in downstream tasks.
method Definition of fairness in DML through inter-class, intra-class, and uniformity properties; finDML benchmark; Partial Attribute De-correlation (PARADE) method.
result Bias in DML representations propagates to downstream tasks, even with balanced training data.
The paper tackles fairness in forecasting and learning linear dynamical systems.
problem Under-representation bias in training data for multiple subgroups.
method Introducing subgroup-fair and instant-fair learning of LDS from multiple trajectories of varying lengths, using hierarchies of convexifications of non-commutative polynomial optimisation problems.
result Empirical results show both the beneficial impact of fairness considerations on statistical performance and encouraging effects of exploiting sparsity on run time.
The growing capability and accessibility of machine learning has led to its application to many real-world domains and data about people. Despite the benefits algorithmic systems may bring, models can reflect, inject, or exacerbate implicit and explicit societal biases into their outputs, disadvantaging certain demogra…
Resampling outperforms reweighting for correcting biased data in machine learning models.
problem Correcting sampling bias in machine learning models trained on biased data sets.
method Compared resampling and reweighting techniques, focusing on their performance with stochastic gradient algorithms.
result Resampling outperforms reweighting when combined with stochastic gradient algorithms.
Understanding challenges to the interpretation of disaggregated evaluations of algorithmic fairnessstat.ML
New framework for interpreting disaggregated fairness evaluations using causal models.
problem Misinterpretation of disaggregated fairness evaluations due to data representativeness and selection bias.
method Causal graphical models to characterize fairness properties and metric stability under different data generating processes.
result Disaggregated evaluations are unreliable without explicit assumptions regarding bias mechanisms.
New technique reduces gender discrimination in credit lending models.
problem Bias and unfairness in credit lending predictions.
method Subgroup Threshold Optimizer (STO) technique.
result Reduces gender discrimination by over 90%.
Novel strategy benchmarks observational studies against randomized trials.
problem Benchmarking observational studies for treatment effect bias.
method Statistical test for null hypothesis of treatment effect difference.
result Valid lower bound on maximum bias strength for any subgroup.
Active learning has long been a topic of study in machine learning. However, as increasingly complex and opaque models have become standard practice, the process of active learning, too, has become more opaque. There has been little investigation into interpreting what specific trends and patterns an active learning st…
ISP improves DNN uncertainty for better subgroup accuracy.
problem Improving accuracy-group robustness in deep neural networks.
method Introspective Self-play (ISP) adds an introspection task to improve bias-awareness and uncertainty.
result ISP improves the accuracy-group robustness trade-off of AL methods.
BICauseTree improves causal effect estimation by identifying clusters and balancing treatment allocation.
problem Improving interpretability and transparency in causal effect models from observational data.
method Hierarchical bias-driven stratification using decision trees with a customized objective function.
result BICauseTree provides interpretable causal effect estimation and is comparable to existing methods.
Interview study reveals considerations for designing semi-automated bias detection tools.
problem Detecting and mitigating machine learning biases.
method Interview study with 11 machine learning practitioners.
result Four considerations identified for tool design.
New methods improve subgroup analysis in trials with limited data.
problem Limited sample sizes in subgroup analyses of randomized controlled trials.
method Two TMLEs that borrow information from non-subgroup participants.
result Improved precision in subgroup-specific treatment effect estimates.
Randomized predictions ensure fair and accurate individual calibration in machine learning.
problem Systematic bias in typical calibration methods leads to unfair predictions for certain subgroups.
method Randomization of predictions to enforce individual calibration, trading off bias with variance.
result Randomized regression functions are more calibrated for arbitrary subgroups and achieve higher utility.
New holistic approach measures sample-level adversarial vulnerability for trustworthy systems.
problem Inherent bias in adversarial attacks across subgroups.
method Combining high-frequency feature reliance and sample-distance to decision boundary.
result Holistic approach improves adversarial vulnerability estimation and system trustworthiness.
Method learns representation invariant to subgroup support using adversarial matching.
problem Representational bias in training data leads to spurious correlations.
method Adversarial support-matching using semi-supervised clustering.
result Improves generalizability to unseen sources.
Simulation study evaluates causal ML models under confounding violations.
problem Assessing conditional exchangeability in causal machine learning models.
method Simulation study with varying confounding, sample size, and NCO structures.
result Causal ML models fail to recover true treatment effect heterogeneity under violations of conditional exchangeability.
With the aim of building machine learning systems that incorporate standards of fairness and accountability, we explore explicit subgroup sample complexity bounds. The work is motivated by the observation that classifier predictions for real world datasets often demonstrate drastically different metrics, such as accura…
Unified framework for intersectionally fair AI models using MIO.
problem Bias in AI models for high-risk domains.
method Mixed-Integer Optimization (MIO) for fairness and interpretability.
result Improved performance in detecting and mitigating bias at intersections.
SkewSize detects model biases by analyzing mistakes across subgroups.
problem Benchmarking model performance in the presence of spurious correlations.
method Introducing SkewSize, a metric that captures bias from model mistakes.
result SkewSize highlights biases not captured by other metrics.
The potential for learned models to amplify existing societal biases has been broadly recognized. Fairness-aware classifier constraints, which apply equality metrics of performance across subgroups defined on sensitive attributes such as race and gender, seek to rectify inequity but can yield non-uniform degradation in…
Framework reduces simplicity bias in NNs, improving OOD generalization and robustness.
problem Simplicity bias in deep learning models leads to biased predictions and poor OOD generalization.
method Proposes a framework that regularizes conditional mutual information to encourage use of diverse features.
result Demonstrates effectiveness in various settings, enhancing OOD generalization and robustness.
Improves fairness in machine learning by adding underrepresented group data.
problem Machine learning biases across subgroups due to under-representation or societal biases.
method Data augmentation via pairwise mixup across subgroups to balance subpopulations.
result Achieves fair outcomes with robust if not improved accuracy.
In this paper, we investigate the effect of machine learning based anonymization on anomalous subgroup preservation. In particular, we train a binary classifier to discover the most anomalous subgroup in a dataset by maximizing the bias between the group's predicted odds ratio from the model and observed odds ratio fro…
We found hidden convexity in FPCA and developed a faster algorithm.
problem Bias in PCA leading to unequal subgroup outcomes.
method Convex optimization via eigenvalue optimization.
result Faster and fairer PCA algorithm.
DCEM algorithm reduces bias in machine learning models trained on selective labels.
problem Bias in machine learning models trained on selective labels.
method Disparate Censorship Expectation-Maximization (DCEM) algorithm.
result DCEM improves bias mitigation without sacrificing discriminative performance.
Causal K-Means Clusteringstat.ME
Proposes Causal k-Means Clustering to identify subgroup effects.
problem Identifying subgroup effects with heterogeneous treatment effects.
method Leverages k-means clustering to uncover unknown subgroup structure.
result Developed bias-corrected estimator with fast root-n rates and asymptotic normality.
Bias in training data affects diagnostic algorithms' performance.
problem Bias in training data leads to biased predictions in diagnostic algorithms.
method Survey of MICCAI 2018 proceedings, analysis of a skin lesions dataset, adversarial training setup.
result Classifier performance varies significantly between subgroups based on age and sex.
The increasingly common use of neural network classifiers in industrial and social applications of image analysis has allowed impressive progress these last years. Such methods are however sensitive to algorithmic bias, i.e. to an under- or an over-representation of positive predictions or to higher prediction errors i…
In critical decision-making scenarios, optimizing accuracy can lead to a biased classifier, hence past work recommends enforcing group-based fairness metrics in addition to maximizing accuracy. However, doing so exposes the classifier to another kind of bias called infra-marginality. This refers to individual-level bia…
This primer tackles biases in machine learning for image analysis, proposing solutions.
problem Causal and statistical biases in machine learning methods for image analysis.
method Introduction of causal and statistical structures that induce failure, highlighting two problems: no fair lunch and subgroup separability.
result Current fair representation learning methods fail to solve these problems, suggesting new paths forward.
Propensity score matching improves fairness in machine learning models.
problem Bias in training data affects fairness metrics in machine learning models.
method Propensity score matching to evaluate and mitigate bias in test data.
result FairMatch significantly reduces bias in test data without sacrificing predictive performance.
Study removes bias from chest X-ray embeddings using orthogonalization.
problem Reduces bias in chest X-ray embeddings due to protected features.
method Orthogonalization technique to remove protected feature effects.
result Orthogonalization removes bias and makes predictions of protected attributes infeasible.
The paper addresses bias in survival analysis due to informative censoring.
problem Bias in treatment effect estimates due to informative censoring in survival analysis.
method Assumption-lean framework using partial identification to derive bounds on CATE.
result Proposes a meta-learner, SurvB-learner, to estimate bounds on CATE.
Enhanced Survival Treesstat.ME
Enhanced survival trees improve computational efficiency and inference.
problem Censored failure time data and variable selection bias.
method Improved splitting procedure, intersected validation, fused regularization, and bootstrap-based bias correction.
result Valid confidence intervals for median survival times.
This work addresses fairness in ML models by training and evaluating attribute classifiers under uncertain and incomplete data.
problem Challenges in fairness metrics due to uncertain and incomplete data.
method Developed a theoretical and empirical analysis to understand and improve bias estimation in the data-scarce regime.
result The test accuracy of the attribute classifier is not always correlated with its effectiveness in bias estimation.
New framework tackles fairness in link prediction beyond demographic parity.
problem Systemic biases in link prediction can exacerbate societal inequalities.
method Formalizes limitations of existing fairness evaluations and proposes a new framework.
result Proposes a lightweight post-processing method combined with decoupled link predictors.
This study quantifies uncertainty in comparing treatments using RCTs with before-and-after measures.
problem Uncertainty in comparing treatments using RCTs with before-and-after measures.
method New statistical modeling principle called ETZ enables counterfactual uncertainty quantification (CUQ) in RCTs with Before-and-After Repeated Measures.
result CUQ typically has lower variability than factual uncertainty quantification and can be achieved in RCTs.
Removing Disparate Impact of Differentially Private Stochastic Gradient Descent on Model Accuracycs.LG
New method reduces privacy impact on model accuracy for underrepresented groups.
problem Privacy mechanisms disproportionately affect underrepresented groups in machine learning models.
method Proposes DPSGD-F, a modified DPSGD that adjusts group contributions based on clipping bias.
result DPSGD-F removes disparate impact of differential privacy on model accuracy for protected groups.
Paper proposes robust method to detect risk heterogeneity across ethnic groups.
problem Detecting risk heterogeneity across ethnic groups in ICU studies.
method Proposes a robust framework using Neyman orthogonality for inference.
result Demonstrates improved inferential stability and reduced bias compared to standard methods.
FairGP uses graph partitioning to make Graph Transformers fair and scalable.
problem Fairness issues in Graph Transformers, especially against sensitive features.
method Graph partitioning to minimize the influence of higher-order nodes and optimize attention mechanisms.
result FairGP improves fairness in Graph Transformers while reducing computational complexity.
Study examines biases in clinical word embeddings, revealing performance gaps across groups.
problem Biases in clinical word embeddings leading to performance differences across groups.
method Pretrained BERT models on MIMIC-III, fill-in-the-blank method, fairness evaluation on clinical tasks.
result Classifiers trained from BERT representations exhibit statistically significant differences in performance across groups.
New method estimates treatment effects across different populations.
problem Estimating treatment effects across populations with changing distributions.
method SBRL-HAP framework combining balancing and independence regularizers with hierarchical attention.
result Significant improvement in HTE estimation across out-of-distribution populations.
Machine learning systems have received much attention recently for their ability to achieve expert-level performance on clinical tasks, particularly in medical imaging. Here, we examine the extent to which state-of-the-art deep learning classifiers trained to yield diagnostic labels from X-ray images are biased with re…
CondMTL improves toxicity detection by learning group-specific representations.
problem Algorithmic bias in toxic language detection across demographic groups.
method Conditional Multi-Task Learning (CondMTL) for demographic-specific tasks.
result CondMTL improves predictive recall for minority demographic groups.
Causal forests use honesty to reduce overfitting, but it can also reduce accuracy, especially with large datasets.
problem Causal forests' honesty can reduce accuracy of individual treatment effects.
method Using honest estimation to divide data into two samples, one for subgroup definition and another for effect estimation.
result Honest estimation can reduce accuracy by requiring 27% more data to match performance of non-honest models.