Measuring dependence between two random variables is very important, and critical in many applied areas such as variable selection, brain network analysis. However, we do not know what kind of functional relationship is between two covariates, which requires the dependence measure to be equitable. That is, it gives sim…
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
Trend · papers per month
A measure of dependence is said to be equitable if it gives similar scores to equally noisy relationships of different types. Equitability is important in data exploration when the goal is to identify a relatively small set of strongest associations within a dataset as opposed to finding as many non-zero associations a…
In exploratory data analysis, we are often interested in identifying promising pairwise associations for further analysis while filtering out weaker, less interesting ones. This can be accomplished by computing a measure of dependence on all variable pairs and examining the highest-scoring pairs, provided the measure o…
For analysis of a high-dimensional dataset, a common approach is to test a null hypothesis of statistical independence on all variable pairs using a non-parametric measure of dependence. However, because this approach attempts to identify any non-trivial relationship no matter how weak, it often identifies too many rel…
Reshef et al. recently proposed a new statistical measure, the "maximal information coefficient" (MIC), for quantifying arbitrary dependencies between pairs of stochastic quantities. MIC is based on mutual information, a fundamental quantity in information theory that is widely understood to serve this need. MIC, howev…
The maximal information coefficient (MIC) is a tool for finding the strongest pairwise relationships in a data set with many variables (Reshef et al., 2011). MIC is useful because it gives similar scores to equally noisy relationships of different types. This property, called {\em equitability}, is important for analyz…
Given a high-dimensional data set we often wish to find the strongest relationships within it. A common strategy is to evaluate a measure of dependence on every variable pair and retain the highest-scoring pairs for follow-up. This strategy works well if the statistic used is equitable [Reshef et al. 2015a], i.e., if, …
Extends Optimal Transport to multiple agents, aiming for equitable and optimal distribution.
PoPCoin aims to create a more equitable cryptocurrency.
As data becomes the fuel driving technological and economic growth, a fundamental challenge is how to quantify the value of data in algorithmic predictions and decisions. For example, in healthcare and consumer markets, it has been suggested that individuals should be compensated for the data that they generate, but it…
Envy is a rather complex and irrational emotion. In general, it is very difficult to obtain a measure of this feeling, but in an economical context envy becomes an observable which can be measured. When various individuals compare their possessions, envy arises due to the inequality of their different allocations of co…
In this article we explore some finer properties of equi-areal mirrors and introduce techniques for developing new mirror surfaces that simultaneously minimize angular and areal distortion.
Paper introduces threshold invariant fairness to ensure equitable predictions across different groups.
There is growing interest in the design of pension annuities that insure against idiosyncratic longevity risk while pooling and sharing systematic risk. This is partially motivated by the desire to reduce capital and reserve requirements while retaining the value of mortality credits; see for example Piggott, Valdez an…
Proposes a new fairness definition based on equity for machine learning classification.
Fair k-means algorithm ensures equitable costs for different groups.
Model shows how discount rates affect intergenerational equity in climate mitigation.
Study optimal and equitable encouragement policies for treatment adherence.
Method reduces model bias in water temperature prediction using physics-guided GNNs.
This paper introduces a new process for portfolio rebalancing that is more equitable than existing methods.
DFL framework improves action and outcome fairness in policy learning.
We show, using Wise's equitable sets criterion, that every tubular free by cyclic group acts freely on a CAT(0) cube complex. We also show that these groups have a finite index subgroup satisfying the strongest Tits alternative, which means that every subgroup either surjects a non abelian free group or is torsion free…
New approach to algorithmic fairness for human-AI collaboration considers compliance with human decisions.
Distributed learning across a coalition of organizations allows the members of the coalition to train and share a model without sharing the data used to optimize this model. In this paper, we propose new secure architectures that guarantee preservation of data privacy, trustworthy sequence of iterative learning and equ…
New fairness criterion for risk-sensitive decisions in regulated industries.
Algorithms are increasingly used to aid, or in some cases supplant, human decision-making, particularly for decisions that hinge on predictions. As a result, two additional features in addition to prediction quality have generated interest: (i) to facilitate human interaction and understanding with these algorithms, we…
Study aims to measure and mitigate biases in motor insurance pricing.
Credit scores misclassify borrowers, especially minorities, leading to inequitable access.
DQ4FairIM uses RL to maximize influence while ensuring fairness across all groups.
In this paper, a class of statistics named ART (the alternant recursive topology statistics) is proposed to measure the properties of correlation between two variables. A wide range of bi-variable correlations both linear and nonlinear can be evaluated by ART efficiently and equitably even if nothing is known about the…
Study examines equity in post-Snow Uri recovery, finds disparities.
Actuaries tackle loss of earning capacity in Denmark, balancing public benefits and private insurance.
Examines fairness in ML for health, highlighting its importance and challenges.
Proposes a method to enforce fairness in machine learning models without sensitive data.
The paper introduces a new algorithm for fair decision-making in outcome control tasks.
In this work, we investigate whether state-of-the-art object detection systems have equitable predictive performance on pedestrians with different skin tones. This work is motivated by many recent examples of ML and vision systems displaying higher error rates for certain demographic groups than others. We annotate an …
An important factor to guarantee a fair use of data-driven recommendation systems is that we should be able to communicate their uncertainty to decision makers. This can be accomplished by constructing prediction intervals, which provide an intuitive measure of the limits of predictive performance. To support equitable…
This paper introduces a nonparametric copula-based index for detecting the strength and monotonicity structure of linear and nonlinear statistical dependence between pairs of random variables or stochastic signals. Our index, termed Copula Index for Detecting Dependence and Monotonicity (CIM), satisfies several desirab…
We study the problem of learning fair prediction models for unseen test sets distributed differently from the train set. Stability against changes in data distribution is an important mandate for responsible deployment of models. The domain adaptation literature addresses this concern, albeit with the notion of stabili…
We study the effect of altruism in two simple asset exchange models: the yard sale model (winner gets a random fraction of the poorer player's wealth) and the theft and fraud model (winner gets a random fraction of the loser's wealth). We also introduce in these models the concept of bargaining efficiency, which makes …
EuLearn creates diverse 3D topological datasets for machine learning.
Optimizes machine learning models while controlling risks.
AdaptHetero uses MLI to tailor EHR models for subgroup-specific predictions.
Paper proposes decentralized annuities for better retirement security.
Framework for fair predictive models using resampled sensitive attributes.
This paper tackles post-trade allocation inefficiencies and presents a uniform return allocation method.
A novel multi-objective optimization framework improves insurance pricing fairness.
Paper detects bias in AI medical models using CART.