Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,657 papers · 148 categories

Trend · papers per month

99198297396 · May 202619922001200920172026
48 results for conditional demographic disparity

New methods target conditional demographic parity using optimal transport distances.

problem Auditing and enforcing conditional demographic parity (CDP) in models with complex conditioning variables.
method Developed novel measures of conditional demographic disparity (CDD) based on optimal transport distances and regularization-based approaches.
result Validated methods airbit{} and airlp{} effectively target CDP in real-world datasets with continuous model outputs.

The paper studies and mitigates accuracy disparity in regression models.

problem Accuracy disparity between different demographic subgroups in high-stakes domains.
method Error decomposition theorem and distribution alignment algorithm.
result The proposed algorithm effectively mitigates accuracy disparity while maintaining predictive power.

The paper shows how demographic data can lead to biased predictions, proposing 'Affirmative Information' as a solution.

problem Bias in predictions due to demographic data.
method Characterization of error types and conditions leading to disparate impact.
result Demographic variables in data can lead to biased predictions, with higher average outcomes receiving higher false positive rates.

Paper explores fair classification with bounded disparity using finite datasets.

problem Ensuring fairness in binary classification with protected groups.
method Minimax optimal approach with fairness constraints and demographic disparity control.
result Proposes FairBayes-DDP+ method that achieves minimax lower bound on fairness-aware excess risk.

Study federates measurement of demographic disparities from quantile sketches.

problem Misalignment of fairness goals with siloed data collection and privacy regulations.
method Federated auditing of demographic parity through score distributions, using Wasserstein--Frechet variance and quantile summaries.
result Proposes a one-shot, communication-efficient protocol to estimate global disparity and its decomposition.

We propose a novel algorithm for learning fair representations that can simultaneously mitigate two notions of disparity among different demographic subgroups in the classification setting. Two key components underpinning the design of our algorithm are balanced error rate and conditional alignment of representations. …

2019-10-16abs ↗pdf ↗

We mathematically compare four competing definitions of group-level nondiscrimination: demographic parity, equalized odds, predictive parity, and calibration. Using the theoretical framework of Friedler et al., we study the properties of each definition under various worldviews, which are assumptions about how, if at a…

2018-08-26abs ↗pdf ↗

CondMTL improves toxicity detection by learning group-specific representations.

problem Algorithmic bias in toxic language detection across demographic groups.
method Conditional Multi-Task Learning (CondMTL) for demographic-specific tasks.
result CondMTL improves predictive recall for minority demographic groups.

FairWASP optimizes training data to reduce disparities across subgroups.

problem Reducing disparities in model outputs across different subgroups in machine learning.
method A novel pre-processing approach that minimizes Wasserstein distance to the original dataset while satisfying demographic parity.
result Integer weights are optimal, allowing FairWASP to be understood as duplicating or eliminating samples.

New framework tackles fairness in link prediction beyond demographic parity.

problem Systemic biases in link prediction can exacerbate societal inequalities.
method Formalizes limitations of existing fairness evaluations and proposes a new framework.
result Proposes a lightweight post-processing method combined with decoupled link predictors.

The paper explores fair regression and classification under demographic parity constraints.

problem Ensuring fairness in regression and classification models under demographic parity constraints.
method Characterizes the optimal fair regression function using a barycenter problem with optimal transport costs and studies the connection between fair classification and regression.
result The optimal fair regression function is derived from the solution to a barycenter problem with optimal transport costs, and the optimal fair cost-sensitive classifiers can be derived by applying thresholds to this function.

Develops methods for fair classification under linear disparity constraints.

problem Disparate impacts of machine learning algorithms on protected groups.
method Bayes-optimal fair classification methods via pre-, in-, and post-processing.
result Explicit forms of Bayes-optimal fair classifiers under linear disparity measures.

The paper introduces return parity for fairness in MDPs, addressing delayed and adverse effects.

problem Fairness in MDPs for dynamic domains with delayed and adverse effects.
method Proposes return parity, decomposes return disparity, and develops algorithms for state visitation distributional alignment.
result The proposed algorithms can successfully close the disparity gap while maintaining policy performance.

In recent years, there have been significant efforts on mitigating unethical demographic biases in machine learning methods. However, very little is done for kernel methods. In this paper, we propose a new fair kernel regression method via fair feature embedding (FKR-F2^2E) in kernel space. Motivated by prior works on…

2019-07-04abs ↗pdf ↗

A non-trivial predictor satisfies demographic parity and equalizes group risks in regression.

problem Achieving fairness in regression models while maintaining equal risks across groups.
method Provided an explicit example of a non-constant predictor satisfying Demographic Parity and Equal Group-Wise Risks.
result First explicit construction of a non-constant predictor satisfying both fairness notions.

Fairness in algorithmic decision-making processes is attracting increasing concern. When an algorithm is applied to human-related decision-making an estimator solely optimizing its predictive power can learn biases on the existing data, which motivates us the notion of fairness in machine learning. while several differ…

2018-06-13abs ↗pdf ↗

This paper studies fairness and privacy in federated learning, proposing algorithms to balance both.

problem Joint impact of differential privacy and fairness in federated classification.
method Proposes FDP-Fair and CDP-Fair algorithms for demographic disparity constrained classification under federated differential privacy.
result Established theoretical guarantees on privacy, fairness, and excess risk control.

Machine learning models (e.g., speech recognizers) are usually trained to minimize average loss, which results in representation disparity---minority groups (e.g., non-native speakers) contribute less to the training objective and thus tend to suffer higher loss. Worse, as model accuracy affects user retention, a minor…

2018-06-20abs ↗pdf ↗

Bayesian method improves multivariate periodontal outcome modeling.

problem Modeling periodontal outcomes is challenging and requires consideration of demographic differences.
method Jointly models multivariate outcomes using an online Bayesian transfer learning framework.
result Significant improvement over univariate RECaST method demonstrated.

New framework reduces strategic manipulation cost for minority groups in fair classification.

problem Strategic manipulation disparities in fair classification.
method Constrained optimization framework that constructs classifiers to reduce strategic manipulation cost for minority groups.
result Empirically, the approach reduces strategic manipulation cost for minority groups over multiple real-world datasets.

This paper tackles fair Bayes-optimal classifiers under predictive parity, proving their limitations and proposing a new algorithm.

problem Ensuring fair Bayes-optimal classifiers under predictive parity, especially when group performance levels vary widely.
method Proving the limitations of fair Bayes-optimal classifiers under predictive parity and proposing a new adaptive thresholding algorithm, FairBayes-DPP.
result Fair Bayes-optimal classifiers under predictive parity may not hold if group performance levels vary widely, leading to within-group unfairness.

EL framework certifies and flags bias in ML models without distributional assumptions.

problem Systematic performance disparities across sensitive subpopulations in ML models.
method Empirical likelihood-based approach for non-parametric fairness auditing.
result EL framework outperforms bootstrap methods in certification and subpopulation discovery.

Machine Learning techniques have become pervasive across a range of different applications, and are now widely used in areas as disparate as recidivism prediction, consumer credit-risk analysis and insurance pricing. The prevalence of machine learning techniques has raised concerns about the potential for learned algor…

2019-05-16abs ↗pdf ↗

Semi-supervised learning benefits the rich more than the poor, affecting fairness.

problem Disparate impact of semi-supervised learning on different sub-populations.
method Theoretical and empirical analysis of a broad family of SSL algorithms using pseudo-labels.
result Semi-supervised learning benefits the rich more than the poor, potentially violating fairness.

New method detects bias in AI models that generate data.

problem Detecting bias in AI models that generate data.
method Formalized causal fairness in generative AI, derived new decomposition results, established identification conditions, and introduced efficient estimators.
result Demonstrated the value of new methodology in analyzing bias in large language models.

Medical imaging models may encode demographic attributes without violating fairness, depending on the approach.

problem Discrimination in medical imaging models due to encoding demographic attributes.
method Examined marginal and class-conditional representation invariance, traditional fairness notions, and counterfactual fairness.
result Demographically invariant models may not necessarily be fair, and encoding demographic attributes can be advantageous.

A membership inference attack (MIA) against a machine-learning model enables an attacker to determine whether a given data record was part of the model's training data or not. In this paper, we provide an in-depth study of the phenomenon of disparate vulnerability against MIAs: unequal success rate of MIAs against diff…

2019-06-02abs ↗pdf ↗

Paper develops a model to assess capital requirement for demographic risk using stochastic methods.

problem Quantifying capital requirement for demographic risk in life insurance contracts.
method Stochastic model extending local GAAP to Solvency II framework, proving market consistency.
result Model highlights main drivers of capital requirement evaluation, comparing to GAAP.

In this work, we investigate whether state-of-the-art object detection systems have equitable predictive performance on pedestrians with different skin tones. This work is motivated by many recent examples of ML and vision systems displaying higher error rates for certain demographic groups than others. We annotate an …

2019-02-21abs ↗pdf ↗

FAIRIF improves fairness in deep learning models without changing the model architecture.

problem Improving fairness in deep learning models trained on sensitive data.
method Two-stage training algorithm that minimizes loss over a reweighted data set, balancing model performance across demographic groups.
result FAIRIF reduces disparity among different groups in classification settings, improving fairness-utility trade-offs.

Selective regression allows abstention to improve fairness criteria.

problem Selective regression can exacerbate disparities between subgroups.
method Proposes new fairness criteria and two approaches to mitigate performance disparity.
result Proposed fairness criteria ensures performance improvement for every subgroup with reduced coverage.

Study identifies key health behaviors linked to adolescent suicide attempts.

problem Understanding health behaviors associated with increased risk of adolescent suicide attempts.
method Cross-sectional data analysis using machine learning algorithms and logistic regression.
result Non-parametric Bayesian tree ensemble model outperforms other models, achieving 80.0% accuracy in goodness-of-fit and 78.2% in predictive accuracy.

Recent advances in Representation Learning and Adversarial Training seem to succeed in removing unwanted features from the learned representation. We show that demographic information of authors is encoded in -- and can be recovered from -- the intermediate representations learned by text-based neural classifiers. The …

2018-08-20abs ↗pdf ↗

CCI combines Bayesian and gradient boosting to create fair, reliable credit risk scores.

problem Tackles high-stakes lending decisions with changing data distributions and fairness constraints.
method Combines Bayesian neural risk scorer and fairness-constrained gradient boosting with shift-aware fusion.
result CCI achieves best trade-off between discrimination, calibration, stability, and fairness.

Manifold matching works to identify embeddings of multiple disparate data spaces into the same low-dimensional space, where joint inference can be pursued. It is an enabling methodology for fusion and inference from multiple and massive disparate data sources. In this paper we focus on a method called Canonical Correla…

2012-09-17abs ↗pdf ↗