Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,694 papers · 148 categories

Trend · papers per month

3367100133 · Jun 202019922001200920172026
48 results for Bias Management

DeepFair improves fairness in recommender systems without sacrificing accuracy.

problem Lack of bias management in recommender systems leads to unfair recommendations for minority groups.
method Deep Learning based Collaborative Filtering algorithm that balances fairness and accuracy.
result It is possible to make fair recommendations without losing significant accuracy.

This report reviews the Edinburgh tram project's risk management. Projects frequently overrun their cost and timelines and fall short on intended benefits. Cost, schedule, and benefit risk of projects need to be carefully considered to avoid this. The report describes and evaluates risk assessment and management for th…

2018-04-02abs ↗pdf ↗

A major source of risk in project management is inaccurate forecasts of project costs, demand, and other impacts. The paper presents a promising new approach to mitigating such risk, based on theories of decision making under uncertainty which won the 2002 Nobel prize in economics. First, the paper documents inaccuracy…

2013-02-14abs ↗pdf ↗

Machine learning algorithms can misrepresent training data, study finds.

problem Misrepresentation of training data in machine learning algorithms.
method Demonstrated through underestimation of training data due to irreducible error, regularization, and class imbalance.
result Careful management of synthetic counterfactuals can mitigate underestimation bias.

This paper evaluates debiasing methods on word embeddings to reduce religious bias.

problem Social biases persist in word embeddings, potentially amplifying them in AI applications.
method Investigates and evaluates three multiclass debiasing techniques on three word embeddings.
result ConceptorDebiasing is the most effective method, reducing religious bias by 82-96%.

ProPublica's analysis of recidivism predictions produced by Correctional Offender Management Profiling for Alternative Sanctions (COMPAS) software tool for the task, has shown that the predictions were racially biased against African American defendants. We analyze the COMPAS data using a causal reformulation of the un…

2019-11-24abs ↗pdf ↗

Research shows eco-innovation boosts earnings management, especially in constrained firms.

problem The impact of eco-innovation on earnings management in firms with financial constraints.
method Multi-method approach including entropy balancing, PSM, and Heckman Test correction.
result Eco-innovation positively correlates with earnings management, especially in firms facing financial constraints.

PBC improves AI and dynamical subseasonal forecasts by reducing biases.

problem Subseasonal forecast accuracy drops due to model biases and compounding errors.
method Probabilistic bias correction (PBC) using machine learning to correct historical forecasts.
result PBC doubles AI Forecasting System's subseasonal skill and improves dynamical model skill.

Bayesian imputation optimizes bias-variance trade-off in time-series data.

problem Look-ahead bias in imputation of missing time-series data.
method Bayesian consensus posterior that fuses multiple posteriors to optimize bias and variance trade-off.
result Benefit of imputation for portfolio allocation with missing returns demonstrated.

Estimates causal effect of managed care plans on NYC Medicaid spending.

problem Generalizing causal estimates to a target population not well-represented by randomized studies.
method Conditional cross-design synthesis estimators combining randomized and observational data.
result Estimates causal effect of managed care plans on health care spending.

Performance of investment managers are evaluated in comparison with benchmarks, such as financial indices. Due to the operational constraint that most professional databases do not track the change of constitution of benchmark portfolios, standard tests of performance suffer from the "look-ahead benchmark bias," when t…

2008-10-10abs ↗pdf ↗

New method corrects bias in estimating entropic risk for better decision-making.

problem Underestimation of entropic risk when data are limited.
method Parametric bootstrap procedure to overestimate entropic risk.
result Corrected method provides better risk estimates, leading to improved decision-making.

Managing a portfolio to a risk model can tilt the portfolio toward weaknesses of the model. As a result, the optimized portfolio acquires downside exposure to uncertainty in the model itself, what we call "second order risk." We propose a risk measure that accounts for this bias. Studies of real portfolios, in asset-by…

2009-08-17abs ↗pdf ↗

AMA-LSTM improves stock volatility prediction using adversarial training.

problem Predicting stock volatility from financial audio data is challenging due to stochasticity and bias.
method Adversarial training to generate perturbations that simulate stochasticity and bias.
result AMA-LSTM outperforms state-of-the-art methods in predicting stock volatility.

We reformulate the Cont-Bouchaud model of financial markets in terms of classical "super-spins" where the spin value is a measure of the number of individual traders represented by a portfolio manager of an investment agency. We then extend this simplified model by switching on interactions among the super-spins to mod…

1998-10-14abs ↗pdf ↗

GNCL algorithm controls diversity in deep ensembles.

problem Managing bias and variance in deep ensembles.
method Generalized bias-variance decomposition for arbitrary loss functions, leading to GNCL algorithm.
result Explicit control over ensemble diversity and smooth interpolation between independent and joint training.

This work analyzes how preconditioning affects generalization in machine learning models.

problem The impact of preconditioning on the generalization of machine learning models.
method An asymptotic bias-variance decomposition of the generalization error for ridgeless regression under various preconditioners.
result The optimal preconditioner depends on label noise, model specification, and signal alignment, with NGD potentially better under certain conditions.

Monte Carlo simulations of diffusion processes often introduce bias in the final result, due to time discretization. Using an auxiliary Poisson process, it is possible to run simulations which are unbiased. In this article, we propose such a Monte Carlo scheme which converges to the exact value. We manage to keep the s…

2016-05-06abs ↗pdf ↗

We present a reactive beta model that includes the leverage effect to allow hedge fund managers to target a near-zero beta for market neutral strategies. For this purpose, we derive a metric of correlation with leverage effect to identify the relation between the market beta and volatility changes. An empirical test ba…

2019-11-03abs ↗pdf ↗

A new property fixes look-ahead bias in backtesting and trading pipelines.

problem Fixing look-ahead bias in backtesting and trading pipelines.
method Developed a pipeline calculus separating availability from reference time, and a type-and-effect system for the value-independent fragment.
result The check scales linearly and catches all leaks, including those missed by differential and tiling detectors.

Quantum kernels offer potential speed-ups but require encoding problem-specific knowledge.

problem Generalization difficulty in high-dimensional feature spaces.
method Analysis of spectral properties of quantum kernels and their RKHS.
result Quantum advantage is expected if RKHS is low-dimensional and contains hard-to-compute functions.

This paper introduces a new method for sampling copulas using GANs and space-filling designs.

problem Lack of feasible inference and sampling methods for copulas in high-dimensional situations.
method Generative adversarial networks (GANs) and space-filling designs.
result Significantly enhances sampling accuracy and computational efficiency compared to existing methods.

CLQT benchmarks LLM portfolio managers by evaluating their decision-making process, not just returns.

problem Most benchmarks rank LLMs by returns, ignoring their decision-making process and potential for look-ahead leakage.
method CLQT reframes evaluation as diagnosis, using a closed-loop, cost-aware, strategy-consistent environment with a five-stage cycle.
result CLQT provides a durable map of agent competencies and limitations, separating outcome from process.

Many economic applications including optimal pricing and inventory management requires prediction of demand based on sales data and estimation of sales reaction to a price change. There is a wide range of econometric approaches which are used to correct a bias in estimates of demand parameters on censored sales data. T…

2018-10-22abs ↗pdf ↗

This paper explores good practices for AI explainability in finance.

problem Complex financial models lack transparency and interpretability.
method Exploring good practices for deploying explainability in AI-based financial systems.
result Developing effective XAI tools for the financial industry.

New method estimates policy performance under unobserved confounding.

problem Estimating policy performance when decisions depend on unobserved variables.
method Developed worst-case bounds for robust OPE under unobserved confounding.
result Efficient procedure for computing worst-case bounds, proving statistical consistency.

Adaptive spectral RL method enhances RL performance and interpretability.

problem Balancing interpretability and performance in reinforcement learning.
method Spectral based linear RL approach with adaptive regularization.
result Near-optimal bounds for parameter estimation and generalization error.