Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,694 papers · 148 categories

Trend · papers per month

57114171228 · May 202619922001200920172026
48 results for systematic bias correction

Machine learning models predict brain age with systematic bias, corrected in this study.

problem Systematic bias in machine learning regression models for brain age prediction.
method General constrained optimization approach to correct bias.
result Our method effectively eliminates the bias from brain age predictions.

A neural framework corrects bias in estimating individual treatment effects.

problem Estimating individual treatment effects from observational data.
method An anchored neural architecture and precision-corrected intersection-bound inference.
result Corrected bias and maintained nominal coverage in high-dimensional settings.

This paper corrects climate model biases using a factor model approach.

problem Systematic biases in GCM outputs due to unobserved confounders.
method Factor model approach to learn latent confounders from historical data and apply them to enhance bias correction.
result Significant improvements in the accuracy of precipitation outputs.

LatentNN corrects neural network attenuation bias in astronomical data.

problem Neural networks underestimate extreme values due to measurement errors.
method Jointly optimizes network parameters and latent input values.
result LatentNN reduces attenuation bias across various signal-to-noise ratios.

The paper corrects biases in estimating intrinsic dimension and differential entropy.

problem Systematic bias in estimating intrinsic dimension and differential entropy.
method A bias-corrected estimator for both measures is proposed, highlighting shared steps and useful consequences.
result Simultaneous estimation of differential entropy and intrinsic dimension provides complementary perspectives on underlying manifolds.

New methods correct bias in LLM-as-a-Judge evaluations, but reliability depends on judge quality and model calibration.

problem Systematic bias in LLM-as-a-Judge evaluations using naive estimators.
method Analytical results, simulations, and real-data case study to diagnose reliability of corrected estimates.
result Corrected estimates, especially shared-calibration comparisons, can be unreliable under certain conditions.

New method corrects seasonal Arctic sea ice predictions with probabilistic models.

problem Systematic biases and errors in climate model forecasts of Arctic sea ice.
method Conditional Variational Autoencoder model to map observation distribution given biased model predictions.
result Probabilistic adjusted forecasts are better calibrated and have smaller errors.

Bayesian hybrid models fuse physics-based insights with machine learning constructs to correct for systematic bias. In this paper, we compare Bayesian hybrid models against physics-based glass-box and Gaussian process black-box surrogate models. We consider ballistic firing as an illustrative case study for a Bayesian …

2019-12-12abs ↗pdf ↗

Generative model improves wind field downscaling from coarse climate models.

problem Limited spatial resolution and biases in GCMs for wind energy studies.
method SerpentFlow for domain alignment and conditional fine-scale learning.
result Improved spatial coherence, inter-variable consistency, robustness under climate change.

New method corrects selection bias in complex models.

problem Selection bias in statistical studies leading to systematic distortions.
method Amortized Bayesian inference with neural posterior estimation.
result Recover well-calibrated posterior distributions across diverse selection mechanisms.

Gemini uses inexpensive measurements to correct biases in expensive property evaluations.

problem Accurate estimation of materials properties using expensive measurements is hindered in scientific discovery campaigns.
method Gemini is a data-driven model that corrects systematic biases between property evaluation methods using inexpensive measurements.
result Gemini reduces the number of expensive evaluations needed for Bayesian optimization in materials discovery.

Estimates causal effects with selection bias and confounding using regression.

problem Estimating causal effects in presence of selection bias and confounding.
method Two-step regression estimator (TSR) that corrects for selection bias and accounts for confounding.
result TSR estimator reduces variance and is validated in simulations.

DoubleGen addresses bias in generative modeling of counterfactuals.

problem Bias in generative models for counterfactual outcomes.
method Doubly robust framework that modifies generative modeling training objectives to mitigate confounding and misspecification biases.
result Successfully addresses confounding bias even if only one auxiliary model is correct.

Unified theory and debiasing framework for random oblique projections in high dimensions.

problem Systematic statistical bias in random oblique projections induced by sampling.
method Unified non-asymptotic theory and debiasing framework.
result Sharp bias--variance characterizations and improved approximation accuracy.

PBC improves AI and dynamical subseasonal forecasts by reducing biases.

problem Subseasonal forecast accuracy drops due to model biases and compounding errors.
method Probabilistic bias correction (PBC) using machine learning to correct historical forecasts.
result PBC doubles AI Forecasting System's subseasonal skill and improves dynamical model skill.

Depth uncertainty networks don't improve with bias correction, contrary to expectations.

problem Improving performance in active learning with overparameterised models like NNs.
method Depth uncertainty networks, compared to underparameterised models, show no improvement in performance with bias correction.
result Depth uncertainty networks do not improve with bias correction, unlike underparameterised models.

This paper examines the use of a residual bootstrap for bias correction in machine learning regression methods. Accounting for bias is an important obstacle in recent efforts to develop statistical inference for machine learning methods. We demonstrate empirically that the proposed bootstrap bias correction can lead to…

2015-06-01abs ↗pdf ↗

The study examines methods to correct measurement error in nutritional epidemiology studies.

problem Measurement error in nutritional studies leads to biased and underconfident estimates.
method The article reviews various bias-correction models for exposure variables in nutritional epidemiology.
result Bias-correction methods are essential for accurate inference in nutritional studies.

BC-ACI corrects time series forecast bias, improving prediction intervals.

problem Persistent bias in time series forecasts leads to overly conservative prediction intervals.
method Augments ACI with an EWM estimate of forecast bias to correct nonconformity scores and re-center intervals.
result Reduces Winkler interval scores by 13-17% under distribution shifts, improving calibration.

Study proposes a new method to estimate bias-correction term for ATE estimation.

problem Estimating the bias-correction term for ATE estimation.
method Directly estimating the bias-correction term by minimizing Bregman divergence.
result Automatic covariate balancing property achieved through specific model choices.

The paper introduces Relative Bias to quantify LLM bias systematically.

problem Quantifying bias in LLMs is challenging due to ambiguity and rapid model emergence.
method Relative Bias framework using Embedding Transformation and LLM-as-a-Judge methodologies.
result The two scoring methods show strong alignment, providing a systematic approach.

One-step Bellman alignment improves online RL by reducing task mismatch.

problem Online RL struggles with task similarity defined by rewards or transitions.
method One-step Bellman alignment and re-weighted targeting (RWT) to correct task mismatch.
result Regret bounds show task shift complexity, not target MDP, affects performance.

CNN improves medium-range temperature forecasts with limited resources.

problem Limited computational resources for high-resolution temperature forecasts.
method CNN post-processing with ensemble NWP models for bias correction and spatial downscaling.
result High-resolution (5-km) surface temperature forecasts with lead times up to 5.5 days.

A new method corrects bias in high-dimensional ridge regression.

problem Inherent bias in ridge regression limits statistical efficiency and scalability.
method Iterative bias correction strategy for p<np < n and Ridge-Screening method for p>np > n.
result Valid inferences and asymptotic properties established for de-biased ridge estimators.

Develops a GMM method to estimate roughness in stochastic volatility models.

problem Estimating roughness in stochastic volatility models with fractional Brownian motion.
method GMM approach for log-normal models with integrated variance and noisy realized variance.
result Consistent and asymptotically normal parameter estimator with bias correction.

BRPC online Bayesian calibration handles gradual and abrupt system changes.

problem Aligning model outputs with field observations in evolving systems.
method Bayesian Recursive Projected Calibration (BRPC) for streaming data under simulator mismatch and nonstationarity.
result Improves calibration accuracy under gradual changes and robustness under abrupt regime shifts.

We use tools from geometric statistics to analyze the usual estimation procedure of a template shape. This applies to shapes from landmarks, curves, surfaces, images etc. We demonstrate the asymptotic bias of the template shape estimation using the stratified geometry of the shape space. We give a Taylor expansion of t…

2016-09-06abs ↗pdf ↗

Modeling wildfire aerosols using satellite data to predict solar radiation reduction.

problem Accurately estimate and predict AOD propagation from wildfires using multi-source satellite data.
method Physics-informed statistical modeling integrating multi-source satellite data with an advection-diffusion equation.
result The proposed approach accurately predicts AOD propagation and demonstrates model interpretability.

Unsupervised recalibration (URC) is a general way to improve the accuracy of an already trained probabilistic classification or regression model upon encountering new data while deployed in the field. URC does not require any ground truth associated with the new field data. URC merely observes the model's predictions a…

2019-08-24abs ↗pdf ↗

We present a predictor-corrector framework, called PicCoLO, that can transform a first-order model-free reinforcement or imitation learning algorithm into a new hybrid method that leverages predictive models to accelerate policy learning. The new "PicCoLOed" algorithm optimizes a policy by recursively repeating two ste…

2018-10-15abs ↗pdf ↗

LLM evaluation suffers from systematic biases and lacks reliable positive judgments.

problem LLM evaluation suffers from systematic biases and lacks reliable positive judgments.
method Formulate LLM evaluation as a positive-unlabelled learning problem and propose a geometric auditing framework based on Partial Optimal Transport.
result Improved alignment with human preferences, increased robustness to presentation biases, and interpretable confidence estimates.