Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,742 papers · 148 categories

Trend · papers per month

3467101134 · Jun 202019922001200920172026
48 results for publication bias

Study shows how missing data from certain groups can unfairly bias risk models.

problem Data missingness without indicators of missingness can unfairly bias risk models.
method Developed an analytically tractable model of differential feature under-reporting and proposed new methods to mitigate bias.
result Under-reporting typically leads to increasing disparities in risk models.

TMLE improves unbiased estimation in public health studies.

problem Improving unbiased estimation in observational studies.
method Targeted Maximum Likelihood Estimation (TMLE) integrates machine learning and statistical theory.
result TMLE has been adopted by researchers worldwide, especially outside the US.

Bias is known to be an impediment to fair decisions in many domains such as human resources, the public sector, health care etc. Recently, hope has been expressed that the use of machine learning methods for taking such decisions would diminish or even resolve the problem. At the same time, machine learning experts war…

2019-09-02abs ↗pdf ↗

AMA-LSTM improves stock volatility prediction using adversarial training.

problem Predicting stock volatility from financial audio data is challenging due to stochasticity and bias.
method Adversarial training to generate perturbations that simulate stochasticity and bias.
result AMA-LSTM outperforms state-of-the-art methods in predicting stock volatility.

Cost-benefit analysis often assumes accurate estimates, but this study finds significant inaccuracies.

problem Inaccurate cost and benefit estimates in public investments.
method Largest dataset of public investments, statistical analysis of cost overruns and benefit shortfalls.
result Significant inaccuracies in cost and benefit estimates of public investments.

The primary goal of this study is doing a meta-analysis research on two groups of published studies. First, the ones that focus on the evaluation of the United States Department of Agriculture (USDA) forecasts and second, the ones that evaluate the market reactions to the USDA forecasts. We investigate four questions. …

2018-01-19abs ↗pdf ↗

Study analyzes bias interactions in multimodal models using simulation-based methods.

problem Analyzing dynamic bias interactions in multimodal models to ensure fairness and equity.
method Simulation-based heuristic approach to compute bias scores for text-only, image-only, and multimodal embeddings.
result Multimodal bias interactions can be amplification, mitigation, or neutral, with text bias often dominant.

LLMs show biases in investment analysis, leading to unreliable recommendations.

problem LLMs face conflicts between pre-trained knowledge and real-time market data, leading to biases in investment analysis.
method Experimental framework to investigate emergent behaviors in LLMs, analyzing sector, size, and momentum biases.
result Distinct, model-specific biases observed, including a tendency to prefer technology stocks, large-cap stocks, and contrarian strategies.

Collectivistic countries influence Bitcoin returns more than individualistic ones during the pandemic.

problem The impact of public attention to COVID-19 on Bitcoin returns.
method Rolling and recursive-evolving algorithms to account for timing and estimation bias.
result Collectivistic countries have stronger causal impacts on Bitcoin returns.

We study the informational efficiency of a market with a single traded asset. The price initially differs from the fundamental value, about which the agents have noisy private information (which is, on average, correct). A fraction of traders revise their price expectations in each period. The price at which the asset …

2010-09-26abs ↗pdf ↗

XEM improves multivariate time series classification with explainable models.

problem Multivariate time series classification challenges.
method Hybrid ensemble method combining explicit boosting-bagging and implicit divide-and-conquer.
result XEM outperforms state-of-the-art MTS classifiers on public datasets.

STAS selects optimal spatio-temporal scales for bias correction in precipitation forecasts.

problem Limited prior data and fixed ST scale in existing BCoPs lead to biases in numerical weather predictions.
method End-to-end deep-learning BCoP model STAS with SFM/TFM to automatically adjust spatial and temporal scales.
result STAS outperforms 8 published BCoP methods on threat scores (TS).

Bayesian consensus improves accuracy of forecasts from miscalibrated sources.

problem Aggregating predictions from miscalibrated and noisy sources.
method Bayesian approach to adjust for bias and noise, using hierarchical models.
result Bayesian consensus estimator is unbiased and more efficient than alternatives.

Investigates offline RL in factorisable action spaces, overcoming overestimation bias.

problem Overestimation bias in value estimates for unseen state-action pairs.
method Value-decomposition approach in DecQN, adapted for factorised discrete action spaces.
result Demonstrates the effectiveness of factorised approach in offline RL.

This paper examines risks and uncertainties of changing data sources in machine learning for official statistics.

problem Risks and uncertainties associated with changing data sources in machine learning for official statistics.
method An overview of risks, causes, and repercussions of changing data sources, with a checklist of measures.
result Maintaining integrity, reliability, consistency, and relevance in official statistics.

Deep chest X-ray classifiers show bias in predicting diagnoses.

problem Bias in deep learning classifiers predicting diagnoses from chest X-rays.
method Trained convolutional neural networks on multiple public datasets to predict 14 diagnostic labels.
result True positive rates vary significantly among different protected attributes, indicating bias.

A2A metric evaluates bias correction methods, reducing ATE estimation errors.

problem Selection biases in non-randomized studies of medical treatments.
method Propensity score matching (PSM) with novel metric A2A.
result Reduces ATE estimation errors by up to 90% across synthetic and real-world datasets.

In medical domain, data features often contain missing values. This can create serious bias in the predictive modeling. Typical standard data mining methods often produce poor performance measures. In this paper, we propose a new method to simultaneously classify large datasets and reduce the effects of missing values.…

2015-03-21abs ↗pdf ↗

L2M learns to match distributions for domain adaptation without relying on hand-crafted priors.

problem Difficult to directly match cross-domain distributions; existing methods fail to uncover underlying relationships.
method Learning to Match (L2M) framework that learns distribution matching loss using a meta-network in a data-driven way.
result L2M outperforms state-of-the-art methods on public datasets and transfers from pneumonia to COVID-19 images.

Reference class forecasting is a method to remove optimism bias and strategic misrepresentation in infrastructure projects and programmes. In 2012 the Hong Kong government's Development Bureau commissioned a feasibility study on reference class forecasting in Hong Kong - a first for the Asia-Pacific region. This study …

2017-10-03abs ↗pdf ↗

The paper explores how machine learning personalization aligns with humanistic views of the person.

problem Aligning machine learning personalization with humanistic views of the person.
method Explicating the concept of personalization and contrasting it with humanistic views of the person.
result Proposes dimensions for evaluating the degree of personalization of ML personalized scores.

We consider learning problems where the training set consists of two types of examples: private and public. The goal is to design a learning algorithm that satisfies differential privacy only with respect to the private examples. This setting interpolates between private learning (where all examples are private) and cl…

2019-10-25abs ↗pdf ↗

Study public-data assisted private stochastic optimization with labeled or unlabeled public data.

problem Limits and capability of public-data assisted differentially private (PA-DP) algorithms in stochastic convex optimization.
method Lower bounds for PA-DP mean estimation and novel methods for leveraging public data in private supervised learning.
result Achieved dimension independent rate for GLM with unlabeled public data, showing optimality.

Public pretraining improves private model training even in extreme distribution shift scenarios.

problem Improving private model training accuracy in settings with large distribution shift.
method Empirical evaluation and theoretical explanation of public representations improving private training accuracy.
result Public representations can improve private training accuracy by up to 67% over private training from scratch in settings with large distribution shift.

Algorithm selects public datasets for private machine learning.

problem Choosing the most suitable public dataset for private machine learning.
method Measures gradient subspace distance between public and private datasets.
result Excess risk scales with the subspace distance between gradients.

Private distribution learning with public data, leveraging sample compression schemes.

problem Private distribution learning with public and private samples under differential privacy constraints.
method Connection to sample compression schemes and list learning.
result At least d public samples are necessary for private learnability of Gaussians in R^d.

Study uses AI to predict changes in international public finances based on US markets.

problem Understanding correlations between US and international public finances.
method Artificial intelligence and neural networks to model and predict changes.
result Neural network model achieved MSE of 2.79, indicating significant correlation and impact of US market volatility on international markets.