Recidivism prediction instruments (RPI's) provide decision makers with an assessment of the likelihood that a criminal defendant will reoffend at a future point in time. While such instruments are gaining increasing popularity across the country, their use is attracting tremendous controversy. Much of the controversy c…
On-device research index
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
169,051 papers · 148 categories
Trend · papers per month
48 results for “Recidivism”
New fair-by-design model reduces bias in recidivism prediction.
problem Discriminatory bias in recidivism prediction models.
method Prototype-based, locally learned, data distribution extraction.
result Reduces bias and provides interpretable rules.
Recidivism prediction scores are used across the USA to determine sentencing and supervision for hundreds of thousands of inmates. One such generator of recidivism prediction scores is Northpointe's Correctional Offender Management Profiling for Alternative Sanctions (COMPAS) score, used in states like California and F…
Recidivism prediction instruments provide decision makers with an assessment of the likelihood that a criminal defendant will reoffend at a future point in time. While such instruments are gaining increasing popularity across the country, their use is attracting tremendous controversy. Much of the controversy concerns …
In Pursuit of Interpretable, Fair and Accurate Machine Learning for Criminal Recidivism Predictionstat.ML
Interpretable ML models predict recidivism as well as non-interpretable methods and are more fair.
problem Improving recidivism prediction models for fairness and interpretability.
method Trained interpretable ML models on two recidivism datasets, compared to existing methods, and analyzed fairness.
result Interpretable ML models can predict recidivism as well as non-interpretable methods and are more fair.
COMPAS recidivism predictions show racial bias against African Americans, study finds.
problem Racial bias in recidivism prediction algorithms.
method Causal analysis using FACT, a fairness measure grounded in causal inference.
result COMPAS shows racial bias against African American defendants, robust to unmeasured confounding.
Domestic violence (DV) is a global social and public health issue that is highly gendered. Being able to accurately predict DV recidivism, i.e., re-offending of a previously convicted offender, can speed up and improve risk assessment procedures for police and front-line agencies, better protect victims of DV, and pote…
Paper presents mdfa to identify victims of discrimination in black box classifiers.
problem Identifying victims of discrimination in black box classifiers.
method Reduces discrimination measurement to matching distributions and sensitive attribute coincidence prediction.
result Identifies African-American individuals at high risk of violent recidivism.
When might human input help (or not) when assessing risk in fairness domains? Dressel and Farid (2018) asked Mechanical Turk workers to evaluate a subset of defendants in the ProPublica COMPAS data for risk of recidivism, and concluded that COMPAS predictions were no more accurate or fair than predictions made by human…
We investigate a long-debated question, which is how to create predictive models of recidivism that are sufficiently accurate, transparent, and interpretable to use for decision-making. This question is complicated as these models are used to support different decisions, from sentencing, to determining release on proba…
Proposes a robust method for counterfactual classification.
problem Decision-making under hypothetical scenarios.
method Doubly-robust nonparametric estimator for counterfactual classification.
result Robust against nuisance model misspecification, can attain fast rates.
Paper defines predictive multiplicity and measures its severity in classification problems.
problem Challenges in machine learning due to competing models with conflicting predictions.
method Formal measures and integer programming tools for linear classification problems.
result Real-world datasets may admit competing models with wildly conflicting predictions.
We present new methods to estimate causal effects retrospectively from micro data with the assistance of a machine learning ensemble. This approach overcomes two important limitations in conventional methods like regression modeling or matching: (i) ambiguity about the pertinent retrospective counterfactuals and (ii) p…
Machine learning improves risk assessment for gender-based violence victims.
problem Accurately predicting recidivism risk in gender-based crime victims.
method Applied machine learning techniques to create models predicting recidivism risk.
result Proposed ML method outperforms classical statistical methods.
Develops a new criterion for subgroup fairness in algorithmic decision support.
problem Identifying fair recommendations in algorithms despite group-level differences.
method IJDI criterion and IJDI-Scan approach to detect and mitigate disparities.
result Identifies significant disparities in recommendations across subpopulations.
Bayesian model tackles intersectional fairness in AI.
problem Statistical challenges in measuring fairness for multi-dimensional protected attributes.
method Bayesian probabilistic modeling approach for reliable, data-efficient estimation of fairness.
result Bayesian methods improve fairness measurement in intersectional contexts.
A new method assesses algorithmic fairness using game theory.
problem Evaluating algorithmic fairness without proprietary data.
method Cohort Shapley value, a game-theoretic approach.
result Identifies individual impact of protected attributes.
Framework for assessing fairness across similar predictive models.
problem Fairness in predictive models across different groups.
method Develops a framework for characterizing fairness over the set of good models under selective labels.
result Framework can replace or audit models for better fairness properties.
Paper operationalizes individual fairness using side-information and a unified representation.
problem Difficulty in eliciting a human specification of a similarity metric for individual fairness.
method Proposes a Pairwise Fair Representation (PFR) model that learns from fairness graph and side-information.
result Unified PFR model effectively operationalizes individual fairness without human specification.
Algorithm ensures fairness in online classification with partial feedback.
problem Fairness in online classification with partial feedback.
method Oracle efficient algorithm that satisfies fairness constraints.
result Upper and lower bounds on the cost of fairness constraints.
The paper assesses fairness in risk score models, focusing on epistemic value.
problem Fairness of risk score models in communicating uncertainty.
method Identified key fairness desiderata, developed metrics for quantitative assessment, and applied methodology in two case studies.
result Introduced a novel calibration error metric for meaningful comparisons between groups of different sizes.
Local discovery method uncovers direct unfairness in complex systems.
problem Identifying causal pathways of unfairness in complex domains.
method Local discovery for direct discrimination (LD3) method.
result LD3 returns a valid adjustment set (VAS) for assessing unfairness.
Develops a fair relational model learning algorithm.
problem Fairness in machine learning models for relational data.
method Fair-A3SL, a fairness-aware structure learning algorithm for relational structures.
result Demonstrates effectiveness in learning fair, interpretable, and expressive structures.
Paper introduces xAUC metric to assess fairness of risk scores in bipartite ranking tasks.
problem Disparate impact of risk scores in non-binary, downstream uses.
method Investigates fairness in bipartite ranking tasks, introduces xAUC metric.
result xAUC metric reveals disparities not seen in binary classification performance.
New method to understand incentives from complex models.
problem Understanding how complex models incentivize actions.
method Formulated as a Markov Decision Process (MDP) and solved using MDP tools.
result Identifies optimal actions to maximize model output.
Develops tools to audit ML models for bias and unfairness.
problem Auditing ML models for individual bias and unfairness.
method Formalizes the task as an optimization problem and develops inferential tools for the optimal value.
result Demonstrates the utility of tools in revealing biases in COMPAS recidivism prediction instrument.
Study shows how machine learning can improve human performance in deception detection.
problem Improving human performance in critical tasks involving ethical and legal concerns.
method Investigated how machine learning models and their predictions can assist humans in deception detection tasks.
result Explanations and predicted labels from machine learning models can improve human performance in deception detection.
We propose definitions of fairness in machine learning and artificial intelligence systems that are informed by the framework of intersectionality, a critical lens arising from the Humanities literature which analyzes how interlocking systems of power and oppression affect individuals along overlapping dimensions inclu…
Non-discrimination is a recognized objective in algorithmic decision making. In this paper, we introduce a novel probabilistic formulation of data pre-processing for reducing discrimination. We propose a convex optimization for learning a data transformation with three goals: controlling discrimination, limiting distor…
AdaFair boosts fairness in ML models by balancing accuracy and class imbalance.
problem Discrimination in ML models based on sensitive attributes.
method AdaBoost with cumulative fairness and class imbalance optimization.
result Achieves parity in true positive and true negative rates for both protected and non-protected groups.
Proposes a method to ensure low losses across all subpopulations in large datasets.
problem Standard practice of minimizing average loss fails to guarantee low losses across all subpopulations in heterogeneous datasets.
method Convex procedure that controls worst-case performance over all subpopulations of a given size with finite-sample convergence guarantees.
result Empirically, the worst-case procedure learns models that do well against unseen subpopulations.
New risk control method for non-monotonic losses in complex parameters.
problem Controlling risk for non-monotonic losses with multidimensional parameters.
method Stability-based guarantees for generic algorithms applied to non-monotonic losses.
result Guarantees depend on algorithm stability, with looser guarantees for unstable algorithms.
We explore the problem of learning under selective labels in the context of algorithm-assisted decision making. Selective labels is a pervasive selection bias problem that arises when historical decision making blinds us to the true outcome for certain instances. Examples of this are common in many applications, rangin…
We present a novel subset scan method to detect if a probabilistic binary classifier has statistically significant bias -- over or under predicting the risk -- for some subgroup, and identify the characteristics of this subgroup. This form of model checking and goodness-of-fit test provides a way to interpretably detec…
Paper proposes fair ML predictors to avoid discrimination.
problem Discrimination in ML predictors from historical data.
method Proposes two algorithms to adjust ML predictors for fairness.
result Proves fair EO and AA predictors are optimal in performance.
LIME explanations can be uncertain, even for accurate models.
problem Uncertainty in LIME explanations undermines trust in machine learning models.
method Demonstrated two sources of uncertainty in LIME: sampling randomness and varying interpretation quality.
result Uncertainty in LIME explanations is present even in high-performing models.
In the context of machine learning, disparate impact refers to a form of systematic discrimination whereby the output distribution of a model depends on the value of a sensitive attribute (e.g., race or gender). In this paper, we propose an information-theoretic framework to analyze the disparate impact of a binary cla…
Framework for eliciting fairness constraints from stakeholders.
problem Complex, nuanced fairness requirements not captured by simple definitions.
method Algorithm for learning accurate models subject to elicited fairness constraints.
result Provably convergent and oracle efficient algorithm with generalization bounds.
The paper tackles fairness in classification by learning fair latent representations.
problem Fairness issues in classification algorithms used in societally critical domains.
method Develops a minimax adversarial framework to learn fair latent representations.
result The framework provides theoretical guarantees for statistical parity and individual fairness.
Fairness measures fail in predictive settings that intentionally shift outcomes.
problem Fairness measures fail in performative prediction settings.
method Formalized concept shift and counterfactual outcomes.
result Predictors that are fair during training become unfair during deployment.
Less Discriminatory Alternative and Interpretable XGBoost Framework for Binary Classificationstat.ML
LDA-XGB1 balances fairness and accuracy in lending models.
problem Fair lending practices and model interpretability in binary classification.
method Biobjective optimization using binning and information value, leveraging XGBoost.
result Achieves effective balance between accuracy, fairness, and interpretability.
Complex statistical machine learning models are increasingly being used or considered for use in high-stakes decision-making pipelines in domains such as financial services, health care, criminal justice and human services. These models are often investigated as possible improvements over more classical tools such as r…
NeuRules learns interpretable rule lists from data without pre-discretization.
problem Interpretable rule lists for high-stakes decisions in machine learning.
method Neuro-symbolic continuous optimization with temperature annealing.
result NeuRules outperforms existing methods in learning interpretable rule lists.
The paper introduces fair regression methods to predict real-valued outcomes while ensuring fairness.
problem Predicting real-valued outcomes while ensuring fairness with respect to protected attributes.
method Proposes schemes for fair regression under statistical parity and bounded group loss, applicable to various losses.
result The schemes provide theoretical guarantees on the optimality and fairness of the obtained solutions.
FairVis helps discover biases in machine learning models.
problem Discovering biases in machine learning models is challenging due to multiple definitions of fairness and numerous subgroups.
method Integrates a novel subgroup discovery technique with a mixed-initiative visual analytics system.
result Demonstrates how FairVis helps discover biases in real datasets.
Neural Additive Models combine neural nets with interpretable models for high stakes tasks.
problem Inability to understand how neural networks make decisions.
method Combines neural nets with generalized additive models to create Neural Additive Models (NAMs).
result NAMs are more accurate than intelligible models and as accurate as state-of-the-art generalized additive models.
EL framework certifies and flags bias in ML models without distributional assumptions.
problem Systematic performance disparities across sensitive subpopulations in ML models.
method Empirical likelihood-based approach for non-parametric fairness auditing.
result EL framework outperforms bootstrap methods in certification and subpopulation discovery.
As algorithms are increasingly used to make important decisions that affect human lives, ranging from social benefit assignment to predicting risk of criminal recidivism, concerns have been raised about the fairness of algorithmic decision making. Most prior works on algorithmic fairness normatively prescribe how fair …