This paper examines AI and ML bias and fairness issues.
problem Bias and unfairness in AI and ML algorithms.
method Overview of bias and fairness issues, types and sources of data bias, algorithmic unfairness, fairness metrics, and de-biasing techniques.
result Discussion of the limitations of fairness metrics and de-biasing techniques.
This thesis tackles bias in AI decision-making in banking.
problem Bias in AI-driven banking decisions.
method Understanding, mitigating, and accounting for bias in AI systems.
result Establishment of Responsible AI practices for fair decision-making.
AI-generated variables bias regression estimates; methods correct for invalid inference.
problem Bias in regression estimates due to AI-generated variables.
method Two methods: bias correction and joint estimation.
result Valid inference restored through proposed methods.
Paper detects bias in AI medical models using CART.
problem Ensuring fairness in AI medical decision support systems.
method Uses Classification and Regression Trees (CART) algorithm to identify bias.
result Validated the CART approach in both synthetic and real-world data.
AI bias arises from human-defined goals, not algorithmic flaws.
problem AI bias due to human-defined goals in LLMs.
method Purpose-conditioned cognition and revealing downstream use of LLM outputs.
result AI bias can be reduced by purpose-aware prompting but not fully by regularization.
Unified framework for intersectionally fair AI models using MIO.
problem Bias in AI models for high-risk domains.
method Mixed-Integer Optimization (MIO) for fairness and interpretability.
result Improved performance in detecting and mitigating bias at intersections.
Unified view of improving tree model interpretability and debiasing feature importance.
problem Improving interpretability and debiasing feature importance in tree-based models.
method Demonstrates a common thread among bias correction methods and local explanations for trees.
result Points out a bias in explainable AI for trees algorithms due to inbag data inclusion.
Paper bridges AI/ML and causal modeling to reduce bias.
problem Difficulty in combining methods from different assumptions.
method Integrates system dynamics and structural equation modeling.
result Unified mathematical framework for AI/ML and causal modeling.
Artificial Intelligence (AI) is an important driving force for the development and transformation of the financial industry. However, with the fast-evolving AI technology and application, unintentional bias, insufficient model validation, immature contingency plan and other underestimated threats may expose the company…
Theoretical study shows AI models can recover from contaminated training data.
problem Data contamination in AI training can degrade model performance.
method Theoretical analysis and experiments on various data types.
result Models converge to true distribution under mild conditions, with rate dependent on real data fraction.
Improves AI-prior reliability for Bayesian inference.
problem Error propagation from predictive models into posterior inference.
method Rectified AI-informed prior elicitation framework.
result Significant reduction in bias and improvement in predictive performance.
PBC improves AI and dynamical subseasonal forecasts by reducing biases.
problem Subseasonal forecast accuracy drops due to model biases and compounding errors.
method Probabilistic bias correction (PBC) using machine learning to correct historical forecasts.
result PBC doubles AI Forecasting System's subseasonal skill and improves dynamical model skill.
AlphaX uses AI to outperform Brazilian stock market benchmarks.
problem AI strategies often overperform in backtests but underperform in real markets due to lookahead bias.
method Controlled simulations to mitigate lookahead bias, using Value Investing principles.
result AlphaX strategy outperforms major benchmarks and technical indicators.
Fairness in LLMs is impossible due to inherent technical challenges.
problem Ensuring fairness in large language models (LLMs) with rigorous definitions.
method Analysis of various technical fairness frameworks.
result No feasible technical fairness frameworks for LLMs due to large amounts of unstructured data and many potential combinations.
Examines AI regulation in finance, highlighting risks and gaps in current laws.
problem Rapid AI adoption in finance introduces risks and compliance challenges.
method Reviews current legislation, industry guidelines, and real-world use cases.
result Need for adaptive, technology-neutral policies to balance innovation and consumer protection.
New method detects bias in AI models that generate data.
problem Detecting bias in AI models that generate data.
method Formalized causal fairness in generative AI, derived new decomposition results, established identification conditions, and introduced efficient estimators.
result Demonstrated the value of new methodology in analyzing bias in large language models.
Develops methods to correct bias in AI feedback for more accurate alignment.
problem Systematic bias in AI feedback compared to human labels.
method Two debiased alignment methods: DDPO and DIPO.
result Methods improve alignment efficiency and performance close to human-labeled data.
This paper reviews and introduces measures for data representativity in AI systems.
problem Ensuring appropriate inference from data in AI systems.
method Defined and evaluated three measurable concepts of representativity.
result Contrasts between coverage and distribution representativity are crucial for AI system building.
Study reveals AI skin cancer classifiers underperform for darker skin phototypes, advocating for fairness auditing.
problem AI bias in dermatology, particularly for darker skin phototypes.
method Predictive Representativity (PR) framework, evaluating classifiers on HAM10000 and BOSQUE Test sets.
result Substantial performance disparities by skin phototype, highlighting AI bias.
New tools for assessing and correcting bias in AI algorithms.
problem Fairness and bias in AI algorithms, especially when ground truth data is unavailable.
method Three tools: controlled fairness, retraining algorithms, and parameter adjustment algorithms.
result Effective in reducing bias and improving fairness in AI models.
FinAI-BERT classifies AI disclosures in financial reports with high accuracy.
problem Systematic detection of AI-related disclosures in financial reports.
method Fine-tuned transformer-based model on a curated dataset.
result Achieved near-perfect classification performance (99.37% accuracy).
Extends post-prediction inference method for more accurate AI/ML data analysis.
problem Naively using AI/ML predictions as true observations leads to biased results.
method Extends Wang et al. method to relax assumptions and incorporate a scaling factor.
result Yields unbiased point estimates and proper coverage in simulations.
Many modern Artificial Intelligence (AI) systems make use of data embeddings, particularly in the domain of Natural Language Processing (NLP). These embeddings are learnt from data that has been gathered "from the wild" and have been found to contain unwanted biases. In this paper we make three contributions towards me…
A new metric MSD detects bias in datasets efficiently.
problem Detecting bias in AI systems and datasets.
method Introduced Maximum Subgroup Discrepancy (MSD) metric and a practical algorithm based on MIO.
result MSD provides a linear sample complexity for practical applications, distinguishing biases effectively.
Study data biases to predict algorithmic discrimination, developing a Data Bias Profile.
problem Data biases contribute to algorithmic discrimination, but their impact is understudied.
method Analyzed three common data biases across various datasets and models, developing a Data Bias Profile.
result Combination of proxies and label bias can lead to more significant discrimination than underrepresentation alone.
Study analyzes bias interactions in multimodal models using simulation-based methods.
problem Analyzing dynamic bias interactions in multimodal models to ensure fairness and equity.
method Simulation-based heuristic approach to compute bias scores for text-only, image-only, and multimodal embeddings.
result Multimodal bias interactions can be amplification, mitigation, or neutral, with text bias often dominant.
The paper explores fairness in AI algorithms across various sectors.
problem Algorithmic fairness in AI decision-making is crucial but often overlooked.
method Overview of fairness concepts, mechanisms, and datasets.
result Comprehensive comparison of fairness-enhancing mechanisms.
Generative AI reduces herd behavior in trading, but can also lead to optimal herding.
problem Impact of generative AI on financial stability and herd behavior.
method Laboratory experiments with large language models replicating human trading behavior.
result AI agents make more rational decisions than humans, reducing herd behavior but also potentially leading to optimal herding.
CausalGame benchmarks LLM agents' causal thinking in games.
problem Evaluating causal thinking in AI Scientists with LLMs.
method Interactive games with 14 scenarios incorporating selection bias, measurement error, and hidden confounders.
result None of the 30 LLM agents demonstrated reliable causal thinking, with the best model achieving only 68.0% survival.
FR-Train improves fair and robust AI training by detecting and reducing poisoned data.
problem Training AI models that are fair and robust in the presence of data bias and poisoning.
method Mutual information-based adversarial training with an additional discriminator.
result FR-Train maintains fairness and accuracy even in the presence of poisoned data.
Generative Augmented Inference improves AI-generated data for causal inference.
problem Challenges in using AI-generated annotations for reliable causal inference.
method Generative Augmented Inference (GAI) treats AI outputs as informative features for learning true labels, flexibly modeling the relationship using nonparametric methods.
result GAI significantly reduces estimation error and improves confidence interval quality compared to human-only and PPI-based methods.
This paper explores good practices for AI explainability in finance.
problem Complex financial models lack transparency and interpretability.
method Exploring good practices for deploying explainability in AI-based financial systems.
result Developing effective XAI tools for the financial industry.
Experiment shows cognitive biases impact human-AI collaboration, highlighting the need for diverse evaluator samples.
problem Cognitive biases affect human-AI collaboration, leading to suboptimal outcomes.
method Randomized experiment with 2,784 participants, manipulating AI suggestion quality, task burden, and financial incentives.
result Individual attitudes toward AI are the strongest predictor of performance, influencing accuracy and overcorrection.
The paper studies how to use AI-generated labels in econometrics to avoid bias.
problem Small misclassification errors in AI-generated labels can lead to large biases in econometric estimators.
method The paper proposes a coupled-label bootstrap method to correct bias and deliver valid inference.
result The coupled-label bootstrap method is valid without the strong independence condition between true and imputed labels.
5D AI model detects bad loans without biased features, improving consumer protection.
problem Detecting bad loans without biased features and improving consumer protection.
method Machine learning, BiMOPT features, European Banking Authority principles, AI principles, historical and validation datasets.
result 5D correctly detected 1,461 bad loans out of 1,613 (Sensitivity = 0.91, Prevalence = 0.0253, Positive Predictive Value = 0.19).
New models avoid lookahead bias by training on past data only.
problem Lookahead bias in language models.
method Chronologically consistent training on data before a knowledge-cutoff date.
result Elimination of lookahead bias in predictions.
Geometric framework explains and controls implicit bias in machine learning.
problem Understanding and controlling the selection of solutions in overparameterized models.
method Developed a theoretical and constructive framework based on geometric corrections induced by gradient noise and continuous symmetries of the loss.
result Computed the induced bias across various architectures and enabled inverse design to shape the bias.
Optimized AIS scheme reduces bias and MSE for general proposals.
problem Performing Monte Carlo integration with general proposals.
method Global optimization of χ²-divergence using stochastic gradient Langevin dynamics.
result Explicit theoretical guarantees for uniform-in-time MSE reduction.
Framework audits synthetic datasets for trustworthiness across various use cases.
problem Assessing the trustworthiness of synthetic datasets and models.
method Holistic auditing framework focusing on bias, fidelity, utility, robustness, and privacy.
result Introduces a trustworthiness index and model selection process for controllable trade-offs.
New algorithms improve sampling from Bayesian deep learning models.
problem Sampling from the posterior of deep neural networks is inefficient.
method Adaptive SGMCMC algorithms with biased drift.
result Proposed algorithms significantly outperform existing methods.
This research develops a new framework to measure AI investment returns considering both gains and risks.
problem Traditional ROI calculations fail to account for AI's dual impact on risk reduction and new exposures.
method Integrates ISO 42001 and regulatory exposure into a comprehensive financial framework using risk quantification methods.
result Accurate AI investment evaluation requires modeling both productivity gains and risk exposures.
Infrastructure monitors AI/ML radiology models across multiple sites.
problem Monitoring and improving AI/ML radiology models across multiple sites.
method Interactive radiology reporting, centralized cloud system, post-marketing surveillance.
result Efficient monitoring and iterative development of AI/ML models without radiologist burden.
Proposes a new trust framework for AI models to maximize utility.
problem Concerns over bias and discrimination in predictive models.
method Introduces a novel trust framework inspired by philosophy, focusing on maximizing Bayes utility.
result Properly-ranked models are inherently U-trustworthy. We discovered secular trend bias in a drug effectiveness study for a recently approved drug. We compared treatment outcomes between patients who received the newly approved drug and patients exposed to the standard treatment. All patients diagnosed after the new drug's approval date were considered. We built a machine …
FreB protocol uses AI to infer hidden parameters with valid confidence regions.
problem Generating biased or overconfident conclusions from AI-generated posterior distributions.
method Frequentist-Bayes (FreB) protocol reshapes AI-generated posterior distributions into valid confidence regions.
result FreB provides valid confidence regions that consistently include true parameters with expected probability.
AIS corrects rollout-training mismatch in quantized RL, improving speed and stability.
problem Rollout-training mismatch in quantized RL causes bias and training collapse.
method Adaptive Importance Sampling (AIS) adjusts gradient correction per batch.
result AIS matches BF16 baseline on most tasks while improving speed.
A number of applications (e.g., AI bot tournaments, sports, peer grading, crowdsourcing) use pairwise comparison data and the Bradley-Terry-Luce (BTL) model to evaluate a given collection of items (e.g., bots, teams, students, search results). Past work has shown that under the BTL model, the widely-used maximum-likeli…
Neural networks with learned biases can approximate any function.
problem Whether neural networks with only learned biases can approximate any continuous function.
method Theoretical and numerical analysis of random weights and learned biases in neural networks.
result Feedforward and recurrent neural networks with random weights can approximate any continuous function and dynamical systems.