Improves AUC for disadvantaged groups by adding features.
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
Trend · papers per month
Women belonging to the socially disadvantaged caste-groups in India have historically been engaged in labour-intensive, blue-collar work. We study whether there has been any change in the ability to predict a woman's work-status and work-type based on her caste by interpreting machine learning models using feature attr…
Algorithms are increasingly used to aid, or in some cases supplant, human decision-making, particularly for decisions that hinge on predictions. As a result, two additional features in addition to prediction quality have generated interest: (i) to facilitate human interaction and understanding with these algorithms, we…
Algorithmic fairness is a field of study that addresses the systematic disadvantage of marginalized groups in machine learning systems.
Bayesian model identifies health disparities in disease progression.
Multiple fairness constraints have been proposed in the literature, motivated by a range of concerns about how demographic groups might be treated unfairly by machine learning classifiers. In this work we consider a different motivation; learning from biased training data. We posit several ways in which training data m…
Paper defines and solves a problem in representation learning to ensure fairness with high confidence.
New research shows fairness in machine learning can sometimes make disadvantaged groups worse off.
When consequential decisions are informed by algorithmic input, individuals may feel compelled to alter their behavior in order to gain a system's approval. Models of agent responsiveness, termed "strategic manipulation," analyze the interaction between a learner and agents in a world where all agents are equally able …
PyCFRL helps ensure fair reinforcement learning policies from offline data.
Proposes active sampling for improving fairness in machine learning.
The purpose of this thesis is to use the language of orbifold groupoids to describe the geometry and topology of orbifolds, highlighting advantages and disadvantages of this language as they arise.
Proposes group whitening to enhance deep learning models' performance.
When the performance of a machine learning model varies over groups defined by sensitive attributes (e.g., gender or ethnicity), the performance disparity can be expressed in terms of the probability distributions of the input and output variables over each group. In this paper, we exploit this fact to reduce the dispa…
Consequential decision-making typically incentivizes individuals to behave strategically, tailoring their behavior to the specifics of the decision rule. A long line of work has therefore sought to counteract strategic behavior by designing more conservative decision boundaries in an effort to increase robustness to th…
The paper tackles fair sharing of exploration costs across groups in online learning.
In critical decision-making scenarios, optimizing accuracy can lead to a biased classifier, hence past work recommends enforcing group-based fairness metrics in addition to maximizing accuracy. However, doing so exposes the classifier to another kind of bias called infra-marginality. This refers to individual-level bia…
Group averaging boosts model accuracy without training cost.
Datasets often contain biases which unfairly disadvantage certain groups, and classifiers trained on such datasets can inherit these biases. In this paper, we provide a mathematical formulation of how this bias can arise. We do so by assuming the existence of underlying, unknown, and unbiased labels which are overwritt…
The rise in machine learning-assisted decision-making has led to concerns about the fairness of the decisions and techniques to mitigate problems of discrimination. If a negative decision is made about an individual (denying a loan, rejecting an application for housing, and so on) justice dictates that we be able to as…
Automated data-driven decision making systems are increasingly being used to assist, or even replace humans in many settings. These systems function by learning from historical decisions, often taken by humans. In order to maximize the utility of these systems (or, classifiers), their training involves minimizing the e…
Recent studies on fairness in automated decision making systems have both investigated the potential future impact of these decisions on the population at large, and emphasized that imposing ''typical'' fairness constraints such as demographic parity or equality of opportunity does not guarantee a benefit to disadvanta…
Most approaches in algorithmic fairness constrain machine learning methods so the resulting predictions satisfy one of several intuitive notions of fairness. While this may help private companies comply with non-discrimination laws or avoid negative publicity, we believe it is often too little, too late. By the time th…
Proposes learning regularization strength directly from data.
The persistence of racial inequality in the U.S. labor market against a general backdrop of formal equality of opportunity is a troubling phenomenon that has significant ramifications on the design of hiring policies. In this paper, we show that current group disparate outcomes may be immovable even when hiring decisio…
This paper will serve as an introduction to the body of work on robust subspace recovery. Robust subspace recovery involves finding an underlying low-dimensional subspace in a dataset that is possibly corrupted with outliers. While this problem is easy to state, it has been difficult to develop optimal algorithms due t…
New method detects and mitigates historical bias in data.
The importance of counterparty credit risk to the derivative contracts was demonstrated consistently throughout the financial crisis of 2008. Accurate valuation of Credit value adjustment (CVA) is essential to reflect the economic values of these risks. In the present article, we reviewed several different approaches f…
New algorithm for bandits with delayed action effects, reducing regret.
We map the recently proposed notions of algorithmic fairness to economic models of Equality of opportunity (EOP)---an extensively studied ideal of fairness in political philosophy. We formally show that through our conceptual mapping, many existing definition of algorithmic fairness, such as predictive value parity and…
Proposes a new model for joint probability distributions in computer vision.
This paper introduces a new process for portfolio rebalancing that is more equitable than existing methods.
The paper explores fairness metrics in automated decision-making and their limitations.
The study assesses ML model robustness under worst-case subpopulations.
Now that machine learning algorithms lie at the center of many resource allocation pipelines, computer scientists have been unwittingly cast as partial social planners. Given this state of affairs, important questions follow. What is the relationship between fairness as defined by computer scientists and notions of soc…
FairPOT balances fairness and AUC performance by selectively transforming risk scores.
The paper proposes a method to improve fairness in machine learning models without refitting.
We investigate the difference between using an penalty versus an constraint in generalized eigenvalue problems, such as principal component analysis and discriminant analysis. Our main finding is that an penalty may fail to provide very sparse solutions; a severe disadvantage for variable sel…
Bayesian-TPNN improves ANOVA-TPNN for detecting higher-order components.
We present five methods to the problem of network anomaly detection. These methods cover most of the common techniques in the anomaly detection field, including Statistical Hypothesis Tests (SHT), Support Vector Machines (SVM) and clustering analysis. We evaluate all methods in a simulated network that consists of nomi…
The paper classifies various higher moments portfolio optimization methods.
Controversies around race and machine learning have sparked debate among computer scientists over how to design machine learning systems that guarantee fairness. These debates rarely engage with how racial identity is embedded in our social experience, making for sociological and psychological complexity. This complexi…
Multi-label classification studies the task where each example belongs to multiple labels simultaneously. As a representative method, Ranking Support Vector Machine (Rank-SVM) aims to minimize the Ranking Loss and can also mitigate the negative influence of the class-imbalance issue. However, due to its stacking-style …
Paper explains learning property of logistic and softmax losses for balanced and imbalanced class data.
A new framework for clustering with uncertainty quantification.
Matrix factorization is one of the best approaches for collaborative filtering, because of its high accuracy in presenting users and items latent factors. The main disadvantages of matrix factorization are its complexity, and being very hard to be parallelized, specially with very large matrices. In this paper, we intr…
The paper addresses fairness in dynamic pricing for strategic buyers.
In this work we study convex relaxations of quadratic optimisation problems over permutation matrices. While existing semidefinite programming approaches can achieve remarkably tight relaxations, they have the strong disadvantage that they lift the original -dimensional variable to an -d…