Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

169,181 papers · 148 categories

Trend · papers per month

120241361481 · Jun 202019922001200920182026
48 results for disparity estimation

Study shows unequal success of membership inference attacks across different groups.

problem Unequal success of membership inference attacks across different groups.
method Established conditions for preventing MIAs and derived connections to fairness and differential privacy.
result Estimating disparate vulnerability to MIAs can lead to overestimation; suitable attacks and statistical framework provided.

Study shows label errors impact model disparity metrics, proposing mitigation methods.

problem Impact of label errors on model disparity metrics.
method Empirical study, characterizing label error effects; proposing estimation and relabeling methods.
result Label errors significantly affect model disparity metrics, particularly for minority groups.

Study decomposes racial healthcare disparities via shifts in mediator distributions.

problem Racial disparities in healthcare expenditures and their underlying drivers.
method Framework decomposing disparities into mediator distribution shifts and residual components, using MEPS data.
result Substantial disparities persist even when mediators are equalized, suggesting unmeasured or structural factors.

Paper explores fair classification with bounded disparity using finite datasets.

problem Ensuring fairness in binary classification with protected groups.
method Minimax optimal approach with fairness constraints and demographic disparity control.
result Proposes FairBayes-DDP+ method that achieves minimax lower bound on fairness-aware excess risk.

The paper addresses fairness in machine learning by adjusting input distributions.

problem Reducing disparate impact in machine learning models over different groups.
method The approach involves learning a counterfactual distribution to adjust input variables for disadvantaged groups.
result The method can reduce disparate impact without training a new model.

The paper examines fairness issues in decision-making systems when protected class labels are unobserved.

problem Fairness assessment challenges when protected class labels are unavailable.
method Decomposes biases in estimating outcome disparity via threshold-based imputation and proposes a weighted estimator.
result Threshold-based imputation generally overestimates disparities, while the weighted estimator has a simpler negative bias.

New method evaluates multiple social disparities using machine learning.

problem Reduction of educational disparities across multiple dimensions.
method Triply-Robust Machine Learning Approach for Causal Decomposition Analysis.
result Simultaneous interventions across multiple domains reduce disparities.

Study reveals unique gender disparities in Bangladeshi TV advertisements and talk shows.

problem Gender disparity and skin color distribution in Bangladeshi TV content.
method Computer Vision, machine learning, head pose, gender detection, skin color estimation.
result Lighter skin tones are less prevalent than darker in Bangladeshi TV, contrary to popular perception.

Study federates measurement of demographic disparities from quantile sketches.

problem Misalignment of fairness goals with siloed data collection and privacy regulations.
method Federated auditing of demographic parity through score distributions, using Wasserstein--Frechet variance and quantile summaries.
result Proposes a one-shot, communication-efficient protocol to estimate global disparity and its decomposition.

New research shows transparent treatment disparity is better for achieving impact parity.

problem Achieving impact parity in ML models when group membership is correlated with other features.
method Theoretical analysis and experimental testing of disparate learning processes (DLPs).
result DLPs can lead to unintended treatment disparity and within-class discrimination, undermining impact parity.

In this paper we examine inefficiencies and information disparity in the Japanese stock market. By carefully analysing information publicly available on the internet, an `outsider' to conventional statistical arbitrage strategies--which are based on market microstructure, company releases, or analyst reports--can never…

2010-03-03abs ↗pdf ↗

The paper studies and mitigates accuracy disparity in regression models.

problem Accuracy disparity between different demographic subgroups in high-stakes domains.
method Error decomposition theorem and distribution alignment algorithm.
result The proposed algorithm effectively mitigates accuracy disparity while maintaining predictive power.

Develops methods for fair classification under linear disparity constraints.

problem Disparate impacts of machine learning algorithms on protected groups.
method Bayes-optimal fair classification methods via pre-, in-, and post-processing.
result Explicit forms of Bayes-optimal fair classifiers under linear disparity measures.

There is growing interest in applying machine learning methods to Electronic Medical Records (EMR). Across different institutions, however, EMR quality can vary widely. This work investigated the impact of this disparity on the performance of three advanced machine learning algorithms: logistic regression, multilayer p…

2017-03-23abs ↗pdf ↗

Study finds racial bias in pulse oximeter readings has minimal impact on ICU ventilation rates.

problem Racial disparities in pulse oximeter readings affect clinical decisions in ICU settings.
method Causal inference using path-specific effects and doubly robust estimator.
result Minimal impact of racial discrepancies on invasive ventilation rates, but more pronounced on ventilation duration.

Study shows explanation disparities in machine learning models are influenced by data and model properties.

problem Disparities in post-hoc machine learning explanation methods across race and gender.
method Simulations and experiments on a real-world dataset to assess challenges to explanation disparities.
result Increased covariate shift, concept shift, and omission of covariates increase explanation disparities, especially for neural network models.

The paper provides CI for test unfairness of group-fairness-aware classifiers trained with online SGD.

problem Ensuring fairness in machine learning models trained with stochastic gradient descent.
method Developed an online multiplier bootstrap method to estimate CI for test unfairness of DI and DM-aware linear classifiers.
result Asymptotic Central Limit Theorem holds for CI estimation of DI and DM-aware models.

Proposes a method to quantify and decompose disparity in ML models, separating exempt and non-exempt components.

problem Quantifying disparity in ML models, especially when certain features are exempted due to their critical importance.
method Information-theoretic decomposition into exempt and non-exempt components, satisfying desirable properties.
result Proposes a measure of non-exempt disparity that satisfies all desirable properties, and shows impossibility results for observational measures.

Combines multi-task and semi-supervised learning for disparate label spaces.

problem Sequence classification tasks with multiple, unrelated label sets.
method Joint embedding space and transfer functions between label embeddings.
result Outperforms strong baselines in topic-based sentiment analysis.

The paper analyzes and corrects disparate impact in machine learning models using information theory.

problem Systematic discrimination in machine learning models based on sensitive attributes.
method Information-theoretic framework to quantify and correct disparate impact.
result Closed-form expressions for efficient correction of input distributions to achieve statistically indistinguishable output distributions.

The paper examines how adversarial robustness affects accuracy disparity across different classes.

problem Understanding the impact of adversarial robustness on accuracy disparity across different classes.
method Linear classifiers under a Gaussian mixture model, decomposing the impact into inherent and imbalance effects.
result Adversarial robustness consistently degrades standard accuracy in balanced classes, but the class imbalance ratio plays a different role in accuracy disparity.

A new CVaR test reduces group performance disparity detection complexity.

problem Detecting performance disparities across multiple sensitive groups in ML models.
method Conditional Value-at-Risk (CVaR) testing to reduce sample complexity.
result Sample complexity reduced exponentially to be at most the square root of the number of groups.

Study highlights fairness issues in travel behavior prediction models.

problem Ethical challenges in travel behavior analysis using machine learning.
method Operationalized computational fairness by equality of opportunity; compared DNN and DCM; introduced absolute correlation regularization.
result Both DNN and DCM predict disparities across social groups, with DNN outperforming DCM in prediction disparities.

The paper compares different fairness definitions under various worldviews.

problem Avoiding disparity amplification under different worldviews.
method Mathematical comparison of four fairness definitions using a theoretical framework.
result Different worldviews require different fairness definitions to avoid disparity amplification.

Conformal prediction sets can lead to unfair outcomes.

problem Disparate impact in decision-making with conformal prediction sets.
method Experiments with human participants to demonstrate disparate impact and propose equalizing set sizes across groups.
result Providing prediction sets that satisfy Equalized Coverage increases disparate impact compared to marginal coverage.

Paper tackles fairness in algorithms by predicting protected class from auxiliary data.

problem Protected class membership is often unobserved in data, leading to unfair algorithmic decisions.
method Use auxiliary datasets to predict protected class from proxy variables and provide characterizations of possible disparities.
result Common disparity measures are generally unidentifiable with auxiliary data, highlighting the need for robust assessments.

Develops methods to measure and reduce fairness in datasets with limited protected attribute labels.

problem Measuring and reducing fairness in datasets with limited protected attribute labels.
method Proposes methods to estimate fairness metrics and train models to limit fairness violations using probabilistic protected attribute labels.
result Our methods provide tighter bounds on true disparity and effectively reduce fairness violations with lesser fairness-accuracy trade-offs.

The paper analyzes how deep neural networks handle noisy labels and finds disparate impacts.

problem Disparate impacts of noisy labels on instances with different representation frequencies.
method Quantifying harms, analyzing solutions, and comparing their impacts on different frequency instances.
result Existing solutions lead to disparate treatments, benefiting higher-frequency instances more.

DCEM algorithm reduces bias in machine learning models trained on selective labels.

problem Bias in machine learning models trained on selective labels.
method Disparate Censorship Expectation-Maximization (DCEM) algorithm.
result DCEM improves bias mitigation without sacrificing discriminative performance.

The paper introduces return parity for fairness in MDPs, addressing delayed and adverse effects.

problem Fairness in MDPs for dynamic domains with delayed and adverse effects.
method Proposes return parity, decomposes return disparity, and develops algorithms for state visitation distributional alignment.
result The proposed algorithms can successfully close the disparity gap while maintaining policy performance.

New method reduces privacy impact on model accuracy for underrepresented groups.

problem Privacy mechanisms disproportionately affect underrepresented groups in machine learning models.
method Proposes DPSGD-F, a modified DPSGD that adjusts group contributions based on clipping bias.
result DPSGD-F removes disparate impact of differential privacy on model accuracy for protected groups.

Deep chest X-ray classifiers show bias in predicting diagnoses.

problem Bias in deep learning classifiers predicting diagnoses from chest X-rays.
method Trained convolutional neural networks on multiple public datasets to predict 14 diagnostic labels.
result True positive rates vary significantly among different protected attributes, indicating bias.

What does it mean for an algorithm to be biased? In U.S. law, unintentional bias is encoded via disparate impact, which occurs when a selection process has widely different outcomes for different groups, even as it appears to be neutral. This legal determination hinges on a definition of a protected class (ethnicity, g…

2014-12-11abs ↗pdf ↗

Learning based methods have shown very promising results for the task of depth estimation in single images. However, most existing approaches treat depth prediction as a supervised regression problem and as a result, require vast quantities of corresponding ground truth depth data for training. Just recording quality d…

2016-09-13abs ↗pdf ↗

New method to quantify feature contributions to disparity without access to decision-making model.

problem Quantifying feature contributions to disparity when decision-making model is not accessible.
method Use information theory to measure redundant statistical dependency between protected attribute and feature.
result Quantify feature contributions to disparity using information theory.

A new method for ILO with transition model disparity using an intermediary policy.

problem Learning tasks from expert observations with different transition dynamics.
method Training an intermediary policy to match the state transitions of the expert dataset.
result Our method outperforms existing ILO approaches with transition model mismatch.

Secure methods learn fair models without revealing sensitive attributes.

problem Training fair machine learning models without exposing sensitive data.
method Secure multi-party computation to encrypt sensitive attributes.
result Outcome-based fair models can be learned, checked, or verified without revealing sensitive attributes.