Controversies around race and machine learning have sparked debate among computer scientists over how to design machine learning systems that guarantee fairness. These debates rarely engage with how racial identity is embedded in our social experience, making for sociological and psychological complexity. This complexi…
Study shows how algorithmic prediction affects US housing market, reducing racial wealth disparities.
problem Impact of algorithmic prediction on housing market and racial wealth disparities.
method Natural experiment using digitization of housing records to study entry, allocation, and prices.
result Digitization leads to increased sale prices for minority-owned homes, reducing racial wealth disparities.
The paper examines how machine learning tools in justice settings can unfairly affect different racial groups.
problem Machine learning tools in justice settings can unfairly affect different racial groups.
method Exploring different ideas of racial equity and their computational trade-offs.
result Computation alone is unlikely to solve the unfairness in machine learning tools for justice settings.
Study decomposes racial healthcare disparities via shifts in mediator distributions.
problem Racial disparities in healthcare expenditures and their underlying drivers.
method Framework decomposing disparities into mediator distribution shifts and residual components, using MEPS data.
result Substantial disparities persist even when mediators are equalized, suggesting unmeasured or structural factors.
To answer questions about racial inequality and fairness, we often need a way to infer race and ethnicity from names. One way to infer race and ethnicity from names is by relying on the Census Bureau's list of popular last names. The list, however, suffers from at least three limitations: 1. it only contains last names…
ProPublica's analysis of recidivism predictions produced by Correctional Offender Management Profiling for Alternative Sanctions (COMPAS) software tool for the task, has shown that the predictions were racially biased against African American defendants. We analyze the COMPAS data using a causal reformulation of the un…
The study uses transfer learning to compare surgical outcomes across racial/ethnic subgroups.
problem Difficulty in comparing surgical outcomes due to racial/ethnic and geographic differences.
method Causal inference framework and transfer learning to incorporate data from multiple populations.
result Racial and ethnic differences in surgical outcomes are found, with non-Hispanic Black patients experiencing wide variability.
Societal bias towards certain communities is a big problem that affects a lot of machine learning systems. This work aims at addressing the racial bias present in many modern gender recognition systems. We learn race invariant representations of human faces with an adversarially trained autoencoder model. We show that …
Study finds racial bias in pulse oximeter readings has minimal impact on ICU ventilation rates.
problem Racial disparities in pulse oximeter readings affect clinical decisions in ICU settings.
method Causal inference using path-specific effects and doubly robust estimator.
result Minimal impact of racial discrepancies on invasive ventilation rates, but more pronounced on ventilation duration.
Over the years, several studies have demonstrated that there exist significant disparities in health indicators in the United States population across various groups. Healthcare expense is used as a proxy for health in algorithms that drive healthcare systems and this exacerbates the existing bias. In this work, we foc…
Prior work finds a diversity paradox: diversity breeds innovation, and yet, underrepresented groups that diversify organizations have less successful careers within them. Does the diversity paradox hold for scientists as well? We study this by utilizing a near-population of ~1.2 million US doctoral recipients from 1977…
The Infant Mortality Rate (IMR) is the number of infants per 1000 that do not survive until their first birthday. It is an important metric providing information about infant health but it also measures the society's general health status. Despite the high level of prosperity in the U.S.A., the country's IMR is higher …
Develops a method to quantify racial bias in law enforcement systems.
problem Quantify racial bias in law enforcement systems considering criminality and multi-stage interactions.
method Multi-stage causal framework incorporating criminality.
result Identifies three canonical scenarios of racial bias in law enforcement.
Recidivism prediction scores are used across the USA to determine sentencing and supervision for hundreds of thousands of inmates. One such generator of recidivism prediction scores is Northpointe's Correctional Offender Management Profiling for Alternative Sanctions (COMPAS) score, used in states like California and F…
Improved surname geocoding and name supplements enhance race imputation accuracy.
problem Census data problems affecting race imputation accuracy.
method Fully Bayesian Improved Surname Geocoding (fBISG) and name supplements.
result Significant improvement in race imputation accuracy across all racial groups.
The paper shows how to audit fairness in decisions with hidden risk factors.
problem Estimating fairness in decisions influenced by hidden, unobservable risk factors.
method Derives unbiased estimates of risk using historical data and audits existing decision-making systems.
result One can compute meaningful bounds on treatment rates for high-risk individuals, even with hidden confounders.
Predictive modeling is increasingly being employed to assist human decision-makers. One purported advantage of replacing human judgment with computer models in high stakes settings-- such as sentencing, hiring, policing, college admissions, and parole decisions-- is the perceived "neutrality" of computers. It is argued…
We consider training machine learning models that are fair in the sense that their performance is invariant under certain sensitive perturbations to the inputs. For example, the performance of a resume screening system should be invariant under changes to the gender and/or ethnicity of the applicant. We formalize this …
Develops causal framework for fair survival analysis in healthcare.
problem Fairness in survival analysis for high-stakes domains like healthcare.
method Causal framework using graphical models, conditional survival function, and Causal Reduction Theorem.
result Decomposes disparities in survival into direct, indirect, and spurious pathways.
Develops tools to audit ML models for bias and unfairness.
problem Auditing ML models for individual bias and unfairness.
method Formalizes the task as an optimization problem and develops inferential tools for the optimal value.
result Demonstrates the utility of tools in revealing biases in COMPAS recidivism prediction instrument.
New method evaluates multiple social disparities using machine learning.
problem Reduction of educational disparities across multiple dimensions.
method Triply-Robust Machine Learning Approach for Causal Decomposition Analysis.
result Simultaneous interventions across multiple domains reduce disparities.
Study reveals AI skin cancer classifiers underperform for darker skin phototypes, advocating for fairness auditing.
problem AI bias in dermatology, particularly for darker skin phototypes.
method Predictive Representativity (PR) framework, evaluating classifiers on HAM10000 and BOSQUE Test sets.
result Substantial performance disparities by skin phototype, highlighting AI bias.
The persistence of racial inequality in the U.S. labor market against a general backdrop of formal equality of opportunity is a troubling phenomenon that has significant ramifications on the design of hiring policies. In this paper, we show that current group disparate outcomes may be immovable even when hiring decisio…
Method debiases alternative data for fair credit underwriting.
problem Bias in alternative data affecting credit underwriting fairness.
method Causal inference applied to machine learning models.
result Improves model accuracy across racial groups without discrimination.
The study tests and optimizes fairness in credit scoring models.
problem Discrimination in credit scoring models based on protected attributes.
method Formal testing and variable identification to optimize fairness and performance.
result Guidance on monitoring and improving algorithmic fairness in credit scoring.
Two simple methods learn fair metrics from data to improve fairness in ML tasks.
problem Lack of widely accepted fair metrics for many ML tasks hinders individual fairness adoption.
method Presented two simple ways to learn fair metrics from various data types.
result Fair training with learned metrics improves fairness on three ML tasks.
New method for analyzing compositional data, addressing biases in summary statistics.
problem Inadequate effect measures for compositional data, especially in high-dimensionality and sparsity.
method Perturbation-based effect measures, average perturbation effects.
result Proposed estimators efficiently estimate average perturbation effects, outperforming existing techniques.
The paper tackles individual fairness in ML models, developing statistical methods to detect bias.
problem Detecting and measuring violations of individual fairness in machine learning models.
method Formalizing the problem as adversarial attack, developing inference tools for the adversarial cost function.
result Statistical methods to assess and test hypotheses of model fairness with non-coverage error rate control.
A machine learning model may exhibit discrimination when used to make decisions involving people. One potential cause for such outcomes is that the model uses a statistical proxy for a protected demographic attribute. In this paper we formulate a definition of proxy use for the setting of linear regression and present …
SLUG method detects bias and out-of-distribution content in generative models.
problem Generative models can underrepresent certain groups and fail on out-of-distribution data.
method SLUG: A new uncertainty quantification method for VAEs combining Laplace approximations and stochastic trace estimators.
result SLUG's UQ score correlates with bias and out-of-distribution content.
Introduces privilege scores to measure and interpret protected attribute-related privilege in machine learning models.
problem Lack of explicit formulation of non-neutrality in fairness-aware machine learning methods.
method Privilege scores (PS) and privilege score contributions (PSCs) to measure and interpret protected attribute-related privilege.
result Demonstrates the broad applicability of PS and PSCs in gender and racial privilege in mortgage and college admissions applications.
Complex statistical machine learning models are increasingly being used or considered for use in high-stakes decision-making pipelines in domains such as financial services, health care, criminal justice and human services. These models are often investigated as possible improvements over more classical tools such as r…
New model tackles real-world distribution mismatches in machine learning.
problem Real-world applications often have training and test distributions that differ.
method Developed a learning model based on information theory using importance sampling.
result The model performs better under large distribution deviations.
Causal thinking improves healthcare decisions from EHRs.
problem Shortcuts in data lead to biased healthcare decisions.
method Step-by-step framework for valid decision making from EHRs.
result Valid decision making requires careful analysis of EHR data.
The isoperimetric inequality and related inequalities are explored.
problem Proving the isoperimetric inequality and related inequalities.
method Discussing classical and recent proofs.
result Various proofs of the isoperimetric inequality and Sobolev inequality.
New proof of Willmore inequality using geometric divergence inequality.
problem Proving the Willmore inequality for bounded domains.
method Using a parametric geometric inequality derived from a divergence form geometric differential inequality.
result New proofs of quantitative Willmore-type and weighted Minkowski inequalities.
Lorentz-Finsler geometry reveals new and old inequalities.
problem Finding new inequalities using Lorentz-Finsler geometry.
method Applying reverse Cauchy-Schwarz and reverse triangle inequalities in Lorentz-Finsler geometry.
result Proved new and refined inequalities, including refinements of Aczél's inequality.
The paper derives new inequalities on manifolds and applies them to convex hypersurfaces.
problem Deriving new inequalities on manifolds and convex hypersurfaces.
method Using Fourier theory and geometric implications of Poincare-type inequalities.
result Sharp Minkowski-type inequalities, including stability and Alexandrov-Fenchel inequalities.
The paper proves inequalities on Finsler manifolds under Ricci curvature bounds.
problem Proving (p,q)-Sobolev and Nash inequalities on Finsler metric measure manifolds. method Global p-Poincaré inequality, (p,q)-Sobolev inequality, Nash inequality derivation. result Established global optimal (p,q)-Sobolev inequality with a sharp constant. New inequality on sphere generalizes circle inequality.
problem Generalizing circle inequality to sphere.
method Develops a new inequality on the sphere that incorporates mass center deviation.
result Improves Aubin's inequality and Onofri's inequality.
Paper proves anisotropic Minkowski inequality and related inequalities.
problem Proving anisotropic Minkowski inequality and related inequalities.
method Utilizes a nonlinear potential theoretic approach.
result Sharp anisotropic Minkowski inequality and related inequalities proved.
Explains geometric inequalities for minimal hypersurfaces.
problem Geometric inequalities for minimal hypersurfaces.
method Expository discussion of known inequalities.
result Discussion of classical inequalities for minimal hypersurfaces.
The paper finds new inequalities for convex polygons.
problem Finding precise inequalities for convex polygons.
method Analytic isoperimetric inequalities based on Schur convex functions, followed by Bonnesen-style and inverse Bonnesen-style inequalities.
result Sharp discrete isoperimetric inequalities for planar convex polygons.
The study improves Bochner inequality on Finsler manifolds to derive important inequalities.
problem Improving Bochner inequality on Finsler manifolds to derive new inequalities.
method Using improved Bochner inequality and its integrated form, the study derives a sharp Poincaré-Lichnerowicz inequality, a new proof for logarithmic Sobolev inequality, and an estimate of geodesic ball volumes.
result Derivation of new inequalities and estimates on Finsler manifolds.
The paper proves various inequalities on gradient shrinking Ricci solitons.
problem Understanding geometric inequalities on gradient shrinking Ricci solitons.
method Proving multiple inequalities equivalent on complete gradient shrinking Ricci solitons.
result Various inequalities (Sobolev, logarithmic Sobolev, Schrödinger, etc.) are equivalent on gradient shrinking Ricci solitons.
Sharp inequality found on three-balls for fourth order Sobolev traces.
problem Fourth order Sobolev trace inequality on three-balls.
method Established through equivalence to a third order Sobolev inequality on two-spheres.
result Sharp fourth order Sobolev trace inequality on three-balls.
Sharp inequalities for star bodies in 2D space.
problem Understanding star bodies in 2D space.
method Sharp inequalities for star bodies in R2. result New inequalities and proofs for star bodies.
The paper develops inequalities for log-concave functions and related surface areas.
problem Understanding log-concave functions and their inequalities.
method Establishing new inequalities through f-divergences and functional affine surface areas.
result New inequalities on functional affine surface area and bounds for Kullback-Leibler divergence.