Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,695 papers · 148 categories

Trend · papers per month

4181122162 · May 202619922001200920172026
48 results for bias decomposition

Generalizes bias-variance decomposition for Bregman divergences.

problem No specific problem stated; generalization of bias-variance for Bregman divergences.
method Provided a generalization of the bias-variance decomposition for Bregman divergences.
result A clear, standalone derivation of the bias-variance decomposition for Bregman divergences.

This work introduces a bias-variance decomposition for proper scores, improving uncertainty estimation in predictive models.

problem Reliable uncertainty estimation for predictions in safety-critical applications, especially under domain drift.
method Developed a general bias-variance decomposition for proper scores, introducing the Bregman Information as the variance term.
result The decomposition provides novel formulations for different predictive tasks, including classification and model ensembles.

Bias - variance decomposition of the expected error defined for regression and classification problems is an important tool to study and compare different algorithms, to find the best areas for their application. Here the decomposition is introduced for the survival analysis problem. In our experiments, we study bias -…

2011-09-24abs ↗pdf ↗

Depth uncertainty networks don't improve with bias correction, contrary to expectations.

problem Improving performance in active learning with overparameterised models like NNs.
method Depth uncertainty networks, compared to underparameterised models, show no improvement in performance with bias correction.
result Depth uncertainty networks do not improve with bias correction, unlike underparameterised models.

Deep learning models can have low bias and variance, contrary to classical theory.

problem Understanding the performance of deep learning models at high complexity.
method Developed a fine-grained bias-variance decomposition for random feature kernel regression, analyzing the effects of sampling, initialization, and labels.
result The variance terms exhibit non-monotonic behavior and can diverge at the interpolation boundary, even in the absence of label noise.

Core-Halo solves large-scale fixed-point problems by decentralizing updates.

problem Large-scale fixed-point equations with block dependencies.
method Core-Halo decomposition separates write ownership from read-only context, aligning with block-dependence structure.
result Core-Halo achieves near-centralized performance while retaining parallelism.

Adversarial training leads to large generalization gap, decomposed into bias and variance.

problem Understanding the large generalization gap in adversarially trained models.
method Bias-Variance decomposition of test risk as a function of adversarial perturbation radius.
result Bias increases monotonically with adversarial perturbation radius and is dominant in test risk.

Machine learning can improve 2SLS first stage predictions, but nonlinear methods often introduce bias.

problem Improving the first stage of 2SLS using machine learning.
method Decomposed bias into three components, investigated through simulation.
result Nonlinear machine learning methods can introduce substantial bias in second-stage estimates.

GNCL algorithm controls diversity in deep ensembles.

problem Managing bias and variance in deep ensembles.
method Generalized bias-variance decomposition for arbitrary loss functions, leading to GNCL algorithm.
result Explicit control over ensemble diversity and smooth interpolation between independent and joint training.

New framework assesses value of labeled vs unlabeled data in latent variable models.

problem Determining the optimal use of labeled and unlabeled data in latent variable models.
method Developed a bias-variance decomposition of the generalization error for method-of-moments latent variable estimation, and introduced a correction for misspecification.
result Labeled data is more valuable than unlabeled data when models are misspecified, but this value can be reduced with correction.

The study improves theoretical understanding of using multiple synthetic datasets for better model accuracy.

problem Lack of theoretical understanding of using multiple synthetic datasets for supervised learning.
method Derive bias-variance decompositions for multiple synthetic datasets settings.
result A simple rule of thumb to select the appropriate number of synthetic datasets.

The paper analyzes how re-weighting helps in reducing variance in high-dimensional kernel methods under covariate shifts.

problem The challenge of high-dimensional kernel methods under covariate shifts and the role of re-weighting.
method Derives asymptotic expansion of high-dimensional kernels under covariate shifts, analyzes bias-variance decomposition, and characterizes the regularized kernel.
result Re-weighting helps in decreasing variance and can be seen as a data-dependent regularization.

New framework explains neural network bias in solving differential equations.

problem Understanding and controlling the bias in PINNs for differential equations.
method Deriving an integro-differential equation from PINNs and GPR equivalence.
result PINN predictions are influenced by a kernel term reflecting architecture choices.

The paper introduces a new framework to assess generative model uncertainty.

problem Lack of a theoretical framework for assessing generative models' generalization and uncertainty.
method Bias-variance-covariance decomposition for kernel scores, with unbiased and consistent estimators.
result Kernel-based variance and entropy for uncertainty estimation are more predictive than existing methods.

Paper introduces new importance metrics for machine learning models, linking them to CATE.

problem Interpreting black-box models' importance metrics due to data dependence and non-parametric nature.
method Introduces MVIM and CVIM, proposing permutation-based estimation and bias-variance decomposition.
result MVIM and CVIM have a quadratic relationship with CATE, addressing bias in correlated predictors.

New method decomposes Markov chain rewards into persistent and transient components.

problem Ambiguity in classical evaluation methods for Markov chains with reducible and periodic states.
method Minimal exact quotient by the real peripheral invariant subspace, decomposing rewards into persistent and transient components.
result Exact comparison with classical methods shows that the new decomposition reallocates the same information, making persistent modes explicit.

Unified theory and debiasing framework for random oblique projections in high dimensions.

problem Systematic statistical bias in random oblique projections induced by sampling.
method Unified non-asymptotic theory and debiasing framework.
result Sharp bias--variance characterizations and improved approximation accuracy.

Paper analyzes LSA algorithm bias and error bounds with RR extrapolation.

problem Analyzing bias and high-order error bounds of LSA with Markovian noise.
method Polyak-Ruppert averaging, linearization, Richardson-Romberg extrapolation.
result RR extrapolation effectively cancels the leading bias term.

Ensembles improve classifier performance by reducing bias, not variance.

problem Improving classifier performance through ensemble methods.
method Extended bias-variance decomposition for classification tasks, introducing dual reparameterization.
result Ensembling reduces bias in classifiers, contrary to the traditional view.

New findings show neural networks can be fooled by adversarial data, but a simple bias fix works.

problem Neural networks can be misled by adversarial data, rendering existing generalization bounds ineffective.
method Extensive theoretical investigation of a specific dataset using infinitely-wide models, focusing on the Neural Tangent Kernel (NTK).
result A sensible choice of output bias completely mitigates the adversarial phenomenon, revealing phase transitions in accuracy.

The bias-variance tradeoff tells us that as model complexity increases, bias falls and variances increases, leading to a U-shaped test error curve. However, recent empirical results with over-parameterized neural networks are marked by a striking absence of the classic U-shaped test error curve: test error keeps decrea…

2018-10-19abs ↗pdf ↗

Estimates CATEs for structured treatments using a new decomposition method.

problem Estimating conditional average treatment effects for complex data types.
method Generalized Robinson decomposition, isolating causal estimand, arbitrary model plugging, quasi-oracle convergence guarantee.
result Demonstrates superior performance in CATE estimation compared to prior work.

In this paper we consider the use of the space vs. time Kronecker product decomposition in the estimation of covariance matrices for spatio-temporal data. This decomposition imposes lower dimensional structure on the estimated covariance matrix, thus reducing the number of samples required for estimation. To allow a sm…

2013-07-27abs ↗pdf ↗

Investigates offline RL in factorisable action spaces, overcoming overestimation bias.

problem Overestimation bias in value estimates for unseen state-action pairs.
method Value-decomposition approach in DecQN, adapted for factorised discrete action spaces.
result Demonstrates the effectiveness of factorised approach in offline RL.

A new decomposition explains over-parameterized models' counterintuitive behaviors.

problem Understanding predictive error in over-parameterized models.
method Introducing the Generalized Aliasing Decomposition (GAD) to explain predictive performance.
result The GAD decomposes predictive error into three parts: model insufficiency, data insufficiency, and generalized aliasing.

Improves group fairness in tensor completion by augmenting tensors with balanced entities.

problem Preventing discrimination in tensor decomposition based on social grounds.
method STAFF (Sparse Tensor Augmentation For Fairness) which augments tensors with balanced entities to mitigate imbalance and bias.
result Consistently shows the best trade-off between completion error and group fairness, reducing errors by 36% and 59% respectively.

New unbiased variance estimator for random forests using Hoeffding decomposition.

problem Uncertainty quantification in random forests with large kernel sizes and small sample sizes.
method Proposes a new Hoeffding decomposition view for variance estimation, establishing unbiased estimators and ratio consistency.
result Establishes the ratio consistency of the proposed variance estimator, justifying confidence interval coverage rates.

A hybrid loss framework improves time series forecasting by balancing global and component errors.

problem Current time series methods may prioritize less significant sub-series, leading to forecasting bias.
method Proposes a hybrid loss framework combining global and component losses, dynamically adjusting weights.
result Improves time series forecasting performance by 0.5-2% on average.

Polynomial time algorithm learns depth-2 neural networks with ReLU activations.

problem Learning depth-2 neural networks with non-zero bias terms and general ReLU activations.
method Robust tensor decomposition of Hermite expansions.
result Polynomial time and sample efficient learning of depth-2 networks with ReLU activations.

Q(ΔΔ)-Learning improves Q-Learning by separating action-value functions into different time scales.

problem Q-Learning struggles with bias-variance trade-off, especially in long-term rewards.
method Introduces Q(ΔΔ)-Learning, extending TD(ΔΔ) to decompose Q(ΔΔ)-function into distinct discount factors.
result Q(ΔΔ)-Learning achieves better stability and scalability, especially for long-term tasks.

The paper decomposes unsupervised learning's generalization error into model, data, and variance components.

problem Understanding the components of unsupervised learning's generalization error.
method Information-geometric decomposition of the Kullback-Leibler generalization error.
result The optimal rank in εε-PCA is the noise floor, balancing model-error gain and data-bias cost.

The paper explains why estimating a history-dependent policy can reduce MSE in reinforcement learning.

problem Understanding why history-dependent policies can improve MSE in off-policy evaluation.
method The paper derives a bias-variance decomposition of MSE for various OPE estimators, showing how history-dependent policies can decrease variance and increase bias.
result History-dependent policies can decrease the variance of importance sampling estimators, leading to lower MSE.

Study shows training duration affects model merging quality, suggesting joint selection of duration and method.

problem Impact of expert training duration on model merging quality for large language models (LLMs).
method Systematically fine-tuned experts on five domains across three model sizes, evaluated five merging methods at each duration.
result Training duration and merging method should be chosen jointly, not independently.

Frequency bias affects neural network training on non-uniform data.

problem Understanding how frequency bias impacts neural networks trained on non-uniformly distributed data.
method Used the Neural Tangent Kernel (NTK) model to explore the effect of variable density on training dynamics.
result Convergence time for learning a pure harmonic function depends on the local density at a point.

Decomposes bias in linear models under demographic parity constraints.

problem Understanding and quantifying bias in linear models under fairness constraints.
method Post-processing framework to decompose bias into direct and indirect components.
result Analytical characterization of how demographic parity reshapes model coefficients.

VDA improves disentanglement of latent representations in complex signals.

problem Learning disentangled and interpretable representations in nonstationary, high-dimensional time-evolving signals.
method Variational decomposition autoencoding (VDA) framework, incorporating signal decomposition, contrastive self-supervised task, and variational prior approximation.
result DecVAEs surpass state-of-the-art VAE-based methods in disentanglement quality and generalization.

The paper analyzes high-dimensional kernel regression, showing different risk curves based on data and regularization.

problem Characterizing generalization properties of high-dimensional kernel ridge regression.
method Bias-variance decomposition of the expected excess risk, considering different regularization schemes and data eigen-profiles.
result The risk curve of kernel regression can be double-descent-like, bell-shaped, or monotonic, depending on n, d, and regularization level.