Jointly correct bias fields and reconstruct undersampled MRI images.
problem Recovering fully sampled MRI images from undersampled data while accounting for bias field differences.
method An unsupervised learning-based reconstruction algorithm combined with a N4-based bias field estimation method in a joint optimization scheme.
result The proposed method improves reconstruction quality, both visually and in terms of RMSE.
Geometric framework analyzes bias in variational inference for posterior functionals.
problem Analyzing the bias of posterior functionals under variational approximations.
method Developed a geometric framework to evaluate the bias of posterior functionals using the variational tangent space.
result The leading-order bias of a posterior functional is determined by its component orthogonal to the variational tangent space.
Statistical field theory aids in understanding deep learning complexities.
problem Complexity and lack of theoretical understanding in deep learning.
method Statistical field theory as a theoretical framework.
result Field theory provides insights into generalization, bias, and feature learning.
Generative model improves wind field downscaling from coarse climate models.
problem Limited spatial resolution and biases in GCMs for wind energy studies.
method SerpentFlow for domain alignment and conditional fine-scale learning.
result Improved spatial coherence, inter-variable consistency, robustness under climate change.
New proof links initial class bias to DNN trainability, challenging traditional understanding.
problem Understanding the initial class bias in DNNs and its impact on trainability.
method Theoretical proof linking initial class bias to mean field theories of DNNs.
result Efficient learning is connected to a network's prejudice towards a specific class, contradicting traditional understanding.
Study on investment strategy for agents with periodic preferences and discounting.
problem Investment decisions by agents with periodic S-shaped preferences and present bias.
method Infinite-horizon, continuous-time portfolio selection problem with quasi-hyperbolic discounting.
result Time-consistent planning strategy can be formulated as an equilibrium to a static mean field game.
New method preserves GCM spatial dependencies for better climate projections.
problem Systemic biases in GCM output and loss of spatial/temporal dependencies.
method SPECD approach using Vecchia approximation and semi-parametric quantile regression.
result SPECD preserves key marginal and joint distribution properties of precipitation and temperature.
The study examines methods to correct measurement error in nutritional epidemiology studies.
problem Measurement error in nutritional studies leads to biased and underconfident estimates.
method The article reviews various bias-correction models for exposure variables in nutritional epidemiology.
result Bias-correction methods are essential for accurate inference in nutritional studies.
Paper addresses selection bias in online advertising auctions.
problem Selection bias affects auction truthfulness and advertiser profits.
method Theoretical analysis combined with multi-task learning.
result Selection bias can be significantly reduced using multi-task learning.
Model predicts EMF of Ni-Mn-Ga MSMA, improved with GRNN.
problem Predicting the electromotive force (EMF) of Ni-Mn-Ga MSMA under various conditions.
method Developed a new constitutive model for Ni-Mn-Ga single crystals, incorporating magnetic easy axis offset. Used GRNN to enhance model predictions.
result GRNN improves model predictions of EMF, capturing more experimental features.
Counterfactual reasoning is an important paradigm applicable in many fields, such as healthcare, economics, and education. In this work, we propose a novel method to address the issue of \textit{selection bias}. We learn two groups of latent random variables, where one group corresponds to variables that only cause sel…
TCFimt forecasts causal effects of multiple interventions from individual data.
problem Estimating causal effects of temporal multi-interventions from individual data.
method TCFimt uses adversarial tasks in seq2seq framework to alleviate bias and contrastive learning to decouple effects.
result TCFimt outperforms state-of-the-art methods in predicting future outcomes and choosing optimal treatments.
New method learns time-varying home field advantage in football.
problem Discovering causal factors behind home field advantage in sports.
method DYNAMO: a novel causal discovery method for non-stationary processes.
result Time-varying home field advantages influenced by referee bias.
This paper analyzes the bias of inexact MCMC methods in high dimensions.
problem Understanding the bias of inexact MCMC methods in high-dimensional spaces.
method Establishing bounds on Wasserstein distances between inexact MCMC methods and target distributions.
result The asymptotic bias of ULA and uHMC depends on key quantities related to the target distribution or the stationary probability measure of the scheme.
Study on neural networks' performance under different normalizations as N grows.
problem Characterizing neural networks' performance under various normalizations.
method Developed an asymptotic expansion to analyze statistical output of shallow neural networks.
result No bias-variance trade-off exists to leading order in N, and variance decreases as normalization approaches mean field.
Study on convergence of Langevin dynamics for zero-sum games in probability distributions.
problem Analyzing convergence of Langevin dynamics for zero-sum games in probability distributions.
method Proved exponential and biased convergence guarantees for mean-field and finite-particle min-max Langevin dynamics.
result Explicit iteration complexity for finite-particle algorithms to approximate equilibrium distributions.
New active learning method uses combinatorial coverage to improve data transfer and reduce bias.
problem Inability to transfer sampled data to new models and sampling bias issues.
method Data-centric active learning methods utilizing combinatorial coverage.
result Sampling data with coverage leads to better data transfer and competitive sampling bias.
Study uses neural fields to improve geophysical inversions by reducing artifacts.
problem Improving geophysical inversions by reducing artifacts and improving model recovery.
method Employing neural fields for test-time learning in geophysical inversions.
result Test-time learning with neural fields eliminates unwanted artifacts in recovered models.
Study Q-learning with constant stepsize, proving convergence and bias, and applying extrapolation.
problem Understanding and optimizing Q-learning with constant stepsize.
method Connecting Q-learning to a Markov chain, proving distributional convergence and bias, applying Richardson-Romberg extrapolation.
result Explicit expression for the linear coefficient of the asymptotic bias and improvement of RR extrapolation method.
This thesis tackles bias in AI decision-making in banking.
problem Bias in AI-driven banking decisions.
method Understanding, mitigating, and accounting for bias in AI systems.
result Establishment of Responsible AI practices for fair decision-making.
Graph neural networks improve combinatorial optimization by leveraging inductive bias.
problem Combinatorial optimization problems often arise from related data distributions.
method Using graph neural networks to enhance or solve combinatorial tasks.
result Graph neural networks effectively encode combinatorial and relational input.
The Nadaraya-Watson kernel estimator is among the most popular nonparameteric regression technique thanks to its simplicity. Its asymptotic bias has been studied by Rosenblatt in 1969 and has been reported in a number of related literature. However, Rosenblatt's analysis is only valid for infinitesimal bandwidth. In co…
Study explores bias-variance in adversarial machine learning.
problem Understanding adversarial machine learning's impact on bias and variance.
method Investigates bias-variance trade-offs in deep neural networks using MSE and cross-entropy.
result Derives bias-variance trade-offs for classification and regression.
Bias and heterogeneity in peer assessment can lead to the issue of unfair scoring in the educational field. To deal with this problem, we propose a reference ranking method for an online peer assessment system using HodgeRank. Such a scheme provides instructors with an objective scoring reference based on mathematics.
Proposes tests to control confounding bias in predictive models.
problem Lack of non-parametric tests for confounding bias in predictive modeling.
method Partial and full confounder tests for probing null hypotheses of unconfounded and fully confounded models.
result Reveals previously unreported or hard-to-correct confounders in machine learning models.
Recidivism prediction instruments provide decision makers with an assessment of the likelihood that a criminal defendant will reoffend at a future point in time. While such instruments are gaining increasing popularity across the country, their use is attracting tremendous controversy. Much of the controversy concerns …
Study shows how large neural networks avoid overfitting through decoupling of feature learning and complexity growth.
problem Understanding inductive bias and generalization in large neural networks.
method Dynamical mean field theory applied to large two-layer networks.
result Training dynamics of large networks exhibit a separation of timescales, decoupling feature learning and overfitting.
fairadapt uses causal inference to mitigate algorithmic bias in data pre-processing.
problem Mitigating algorithmic bias in machine learning predictions.
method Causal graphical model and observed data to address counterfactual questions.
result The method can help eliminate discrimination and justify fair decisions.
New method corrects bias in CVaR estimation for extreme risks.
problem Limited data above VaR leads to poor CVaR estimation.
method Bias-corrected peaks-over-threshold (POT) estimation using GPD.
result Asymptotically unbiased CVaR estimator with lower threshold.
New method mitigates bias without sensitive data using causal graph and variational autoencoder.
problem Lack of fairness strategies when sensitive attributes are not collected.
method SRCVAE framework based on causal graph for inferring a proxy sensitive attribute.
result Significant improvements in fairness metrics over existing methods.
Confirmation bias leads to biased estimates in noisy data analysis.
problem Confirmation bias affects scientific conclusions in noisy data environments.
method Investigation of confirmation bias in Gaussian mixture models using K-means and EM algorithms.
result Estimates from algorithms are biased and resemble initial hypotheses, not the noise.
Study reveals limitations of fair representation learning methods and cautions against their use in performance-sensitive tasks.
problem Limitations of fair representation learning methods in performance-sensitive tasks.
method Using causal reasoning, the study defines and formalizes different sources of dataset bias and examines the performance of fair representation learning under distribution shifts.
result Fundamental limitations on fair representation learning when evaluation data is drawn from the same distribution as training data.
Proposes a neural network model to improve predictions in biased datasets.
problem Reduces bias in predictions from datasets with selection bias.
method Integrates meta information about bias direction and quantity into a neural network model.
result Improves prediction accuracy in electoral polls with biased training data.
Unsupervised recalibration (URC) is a general way to improve the accuracy of an already trained probabilistic classification or regression model upon encountering new data while deployed in the field. URC does not require any ground truth associated with the new field data. URC merely observes the model's predictions a…
This work uncovers how model and data biases interact to cause unfairness in fraud detection.
problem Unfairness in fraud detection algorithms due to model and data biases.
method Taxonomy of data bias, hypotheses on fairness-accuracy trade-offs, real-world fraud use case study.
result Data bias affects fairness in expected value and variance, and simple pre-processing can balance group-wise error rates.
Feature selection, identifying a subset of variables that are relevant for predicting a response, is an important and challenging component of many methods in statistics and machine learning. Feature selection is especially difficult and computationally intensive when the number of variables approaches or exceeds the n…
Peer effects, in which the behavior of an individual is affected by the behavior of their peers, are posited by multiple theories in the social sciences. Other processes can also produce behaviors that are correlated in networks and groups, thereby generating debate about the credibility of observational (i.e. nonexper…
We develop a general variational inference method that preserves dependency among the latent variables. Our method uses copulas to augment the families of distributions used in mean-field and structured approximations. Copulas model the dependency that is not captured by the original variational distribution, and thus …
Breakthroughs in machine learning are rapidly changing science and society, yet our fundamental understanding of this technology has lagged far behind. Indeed, one of the central tenets of the field, the bias-variance trade-off, appears to be at odds with the observed behavior of methods used in the modern machine lear…
Balance corrects biased survey data for more accurate insights.
problem Bias in survey data leads to inaccurate insights and underperforming models.
method Three steps: bias understanding, weight adjustment, and evaluation.
result Corrected data leads to more accurate ML model training and insights.
Paper analyzes adaptive Lasso for high-dimensional diffusion processes, improving support recovery and bias.
problem Support recovery for high-dimensional diffusion processes under sparsity constraints.
method Adaptive Lasso estimator for d-dimensional ergodic diffusion process, focusing on linear models.
result Adaptive Lasso achieves support recovery and asymptotic normality for drift parameter under certain conditions.
Meta-learners improve causal effect estimation in small samples.
problem Estimating causal effects using machine learning methods.
method Sample-splitting and cross-fitting to reduce overfitting bias.
result Meta-learners' performance depends on sample size and estimation procedure.
Resetting from checkpoints improves DNN training with noisy labels.
problem Latent gradient bias induced by noisy labels causes overfitting.
method Stochastic resetting applied to SGD to mitigate latent gradient bias.
result Resetting significantly improves DNN generalization performance.
BRPC online Bayesian calibration handles gradual and abrupt system changes.
problem Aligning model outputs with field observations in evolving systems.
method Bayesian Recursive Projected Calibration (BRPC) for streaming data under simulator mismatch and nonstationarity.
result Improves calibration accuracy under gradual changes and robustness under abrupt regime shifts.
Estimates treatment effects in bipartite systems with partial eligibility and interference.
problem Randomized experiments in bipartite systems with partial treatment eligibility and interference.
method Formalizes eligibility-constrained bipartite experiments, defines PTTE and STTE, identifies conditions, develops ensemble estimators, introduces projection.
result Proposed estimators recover PTTE and STTE with low bias and variance, corrects interference bias in field experiments.
The paper introduces a new σ-LSTM cell for volatility forecasting using stylized facts.
problem Lack of explainability and stylized knowledge in neural network volatility modeling.
method Introduces a new σ-LSTM cell with a stochastic processing layer, designed to incorporate stylized facts about volatility. result Shows good out-of-sample forecasting performance with the σ-LSTM cell. A2A metric evaluates bias correction methods, reducing ATE estimation errors.
problem Selection biases in non-randomized studies of medical treatments.
method Propensity score matching (PSM) with novel metric A2A.
result Reduces ATE estimation errors by up to 90% across synthetic and real-world datasets.
It is often observed that the probabilistic predictions given by a machine learning model can disagree with averaged actual outcomes on specific subsets of data, which is also known as the issue of miscalibration. It is responsible for the unreliability of practical machine learning systems. For example, in online adve…