Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,695 papers · 148 categories

Trend · papers per month

285583110 · Jun 202019922001200920172026
48 results for systematic biases

Machine learning models predict brain age with systematic bias, corrected in this study.

problem Systematic bias in machine learning regression models for brain age prediction.
method General constrained optimization approach to correct bias.
result Our method effectively eliminates the bias from brain age predictions.

LLM evaluation suffers from systematic biases and lacks reliable positive judgments.

problem LLM evaluation suffers from systematic biases and lacks reliable positive judgments.
method Formulate LLM evaluation as a positive-unlabelled learning problem and propose a geometric auditing framework based on Partial Optimal Transport.
result Improved alignment with human preferences, increased robustness to presentation biases, and interpretable confidence estimates.

Chinchilla Approach 2 biases neural scaling law estimates, leading to unnecessary compute costs.

problem Systematic biases in Chinchilla Approach 2's parabolic fits of neural scaling laws.
method Analyzes three sources of error: IsoFLOP sampling grid width, uncentered sampling, and loss surface asymmetry.
result Chinchilla Approach 3 largely eliminates these biases, offering a more convenient or scalable alternative.

Study shows statistical biases can mislead transformer models, impairing their generalization.

problem Statistical biases in transformers affect their ability to generalize.
method Evaluated transformer models on synthetic algorithmic tasks with varying statistical biases.
result Statistical biases lead to overestimation of transformer models' generalization capabilities.

The paper introduces Relative Bias to quantify LLM bias systematically.

problem Quantifying bias in LLMs is challenging due to ambiguity and rapid model emergence.
method Relative Bias framework using Embedding Transformation and LLM-as-a-Judge methodologies.
result The two scoring methods show strong alignment, providing a systematic approach.

Paper develops an AI-driven framework for systematic investing.

problem Manual prompts limit model adaptability and data snooping biases.
method Closed-loop system with self-evolving AI, out-of-sample validation, and economic rationale.
result Long-short portfolios on factor signals outperform with Sharpe ratio 3.11 and return 59.53%.

Systematic review of ML models for detecting social media deception.

problem Detecting fake news, spam, and fake accounts on social media.
method 36 studies evaluated using PROBAST tool, identifying biases and limitations.
result Over-reliance on accuracy in imbalanced data settings is a flaw.

Paper proposes synthetic data generator to study and mitigate bias in machine learning.

problem Bias in machine learning data can lead to unfair outcomes.
method Developed a synthetic data generator to introduce and analyze various types of bias.
result Demonstrated how synthetic data can be used to study and mitigate bias in machine learning models.

The paper analyzes and mitigates biases in scalable Gaussian Process methods.

problem Modeling biases in scalable Gaussian Process methods.
method Randomized truncation estimators to eliminate bias in exchange for increased variance.
result Randomized truncation estimators meaningfully outperform biased counterparts with minimal additional computation.

This study simulates biases in classifiers to assess fairness.

problem Mitigating biases in predictive models to ensure fairness.
method Agent-based model (ABM) to generate synthetic datasets with controlled biases, applied to offline and online learning approaches.
result Demonstrates how biases in data affect classifier outcomes and how mitigations impact feature usage.

Recommender systems are used in variety of domains affecting people's lives. This has raised concerns about possible biases and discrimination that such systems might exacerbate. There are two primary kinds of biases inherent in recommender systems: observation bias and bias stemming from imbalanced data. Observation b…

2018-09-13abs ↗pdf ↗

The paper addresses biased preferences in candidate selection, proposing a fair and utility-maximizing algorithm.

problem Selecting candidates for institutions with biased preferences and limited capacities.
method An algorithm that considers group fairness and true utility, proving near-optimal results under distributional assumptions.
result The proposed algorithm achieves near-optimal group fairness and near-maximal true utility, even in biased settings.

This research explores inductive biases for deep learning to improve AI's higher-level cognition.

problem Current AI struggles with flexible out-of-distribution and systematic generalization.
method Examines and proposes new inductive biases for deep learning.
result Identifies specific inductive biases for higher-level sequential processing.

The estimation of advantage is crucial for a number of reinforcement learning algorithms, as it directly influences the choices of future paths. In this work, we propose a family of estimates based on the order statistics over the path ensemble, which allows one to flexibly drive the learning process, towards or agains…

2019-09-15abs ↗pdf ↗

The study aims to prevent unfair content presentation in recommender systems.

problem Over- and under-presentation of content leads to biased user preference estimates.
method Two models are considered: one that ignores systematic and limited exposure, and another that conditions on limited exposure.
result Ignoring systematic presentations overestimates promoted options and underestimates censored alternatives.

In order to communicate, humans flatten a complex representation of ideas and their attributes into a single word or a sentence. We investigate the impact of representation learning in artificial agents by developing graph referential games. We empirically show that agents parametrized by graph neural networks develop …

2020-02-04abs ↗pdf ↗

SPADE-S improves time series forecasting accuracy for low-magnitude and sparse data.

problem Challenges in forecasting time series with strong heterogeneity in magnitude and sparsity.
method SPADE-S is a robust forecasting architecture that reduces biases and improves overall prediction accuracy.
result SPADE-S outperforms existing state-of-the-art approaches across diverse use cases, improving forecast accuracy by up to 15%.

This paper corrects climate model biases using a factor model approach.

problem Systematic biases in GCM outputs due to unobserved confounders.
method Factor model approach to learn latent confounders from historical data and apply them to enhance bias correction.
result Significant improvements in the accuracy of precipitation outputs.

The paper corrects biases in estimating intrinsic dimension and differential entropy.

problem Systematic bias in estimating intrinsic dimension and differential entropy.
method A bias-corrected estimator for both measures is proposed, highlighting shared steps and useful consequences.
result Simultaneous estimation of differential entropy and intrinsic dimension provides complementary perspectives on underlying manifolds.

Study data biases to predict algorithmic discrimination, developing a Data Bias Profile.

problem Data biases contribute to algorithmic discrimination, but their impact is understudied.
method Analyzed three common data biases across various datasets and models, developing a Data Bias Profile.
result Combination of proxies and label bias can lead to more significant discrimination than underrepresentation alone.

Algorithm reduces audit costs by identifying best service configurations from biased textual evidence.

problem Designing service systems from textual evidence requires accurate selection despite biased automated scoring.
method Developed PP-LUCB algorithm combining LLM scores and selective audits to minimize costs.
result Correctly identified the best model in 40/40 trials with 90% cost reduction.

Machine learning algorithms are optimized to model statistical properties of the training data. If the input data reflects stereotypes and biases of the broader society, then the output of the learning algorithm also captures these stereotypes. In this paper, we initiate the study of gender stereotypes in {\em word emb…

2016-06-20abs ↗pdf ↗

PAC-MCTS addresses biased search in LLM-guided planning by dynamically pruning.

problem Systematic biases in LLMs lead to inefficient and unsafe search in deep planning tasks.
method Formulates node expansion as BAI under bounded bias, derives sample complexity bounds, and proposes PAC-MCTS for dynamic confidence bounds.
result PAC-MCTS improves robustness and efficiency by up to 78% fewer API evaluations and 3x higher sample efficiency.

LLMs struggle to generate random numbers from statistical distributions, leading to biased results in applications.

problem LLMs' inability to generate random numbers accurately from specified distributions.
method Dual-protocol design: Batch Generation and Independent Requests, benchmarking 11 models across 15 distributions.
result Sampling fidelity degrades with distributional complexity and horizon, leading to systematic biases in downstream applications.

Gemini uses inexpensive measurements to correct biases in expensive property evaluations.

problem Accurate estimation of materials properties using expensive measurements is hindered in scientific discovery campaigns.
method Gemini is a data-driven model that corrects systematic biases between property evaluation methods using inexpensive measurements.
result Gemini reduces the number of expensive evaluations needed for Bayesian optimization in materials discovery.

New proof links initial class bias to DNN trainability, challenging traditional understanding.

problem Understanding the initial class bias in DNNs and its impact on trainability.
method Theoretical proof linking initial class bias to mean field theories of DNNs.
result Efficient learning is connected to a network's prejudice towards a specific class, contradicting traditional understanding.

Systematic discriminatory biases present in our society influence the way data is collected and stored, the way variables are defined, and the way scientific findings are put into practice as policy. Automated decision procedures and learning algorithms applied to such data may serve to perpetuate existing injustice or…

2018-09-06abs ↗pdf ↗

The paper proposes a method to improve fairness in machine learning models without refitting.

problem Mitigating biases in machine learning models that disadvantage certain groups.
method Infinitesimal jackknife-based approach to drop selected training data points.
result The intervention improves fairness without significantly reducing predictive performance.

Machine learning models for COVID-19 detection and prognosis from chest images are flawed and unreliable.

problem Developing reliable machine learning models for COVID-19 diagnosis and prognosis from chest images.
method Systematic review of machine learning models published in 2020.
result None of the models identified are of clinical use due to methodological flaws and biases.

Study measures gender bias in machine translation using multiple reference points.

problem Measuring and identifying gender bias in machine translation.
method Used an optimal non-biased translator, reference points from occupational statistics and survey.
result Found bias against both genders, but more against women, and found occupations have a greater effect than adjectives.

The paper explores fundamental limits of learning non-hallucinating generative models.

problem Hallucinations in generative models producing invalid outputs.
method Developed a theoretical framework to analyze learnability from a learning-theoretic perspective, incorporating inductive biases.
result Non-hallucinating learning is statistically impossible without additional inductive biases.