Double Q-learning has the same mean-squared error as Q-learning under certain conditions.
problem Comparing the mean-squared error of Double Q-learning and Q-learning.
method Theoretical analysis based on Lyapunov equations for both tabular and linear function approximation settings.
result The asymptotic mean-squared error of Double Q-learning is exactly equal to that of Q-learning under specific conditions.
The paper provides mean-square error bounds for stochastic approximation algorithms.
problem Error bounds for recursive equations with Markovian disturbances.
method Analysis of mean-square error for stochastic approximation algorithms.
result Mean-square error achieves the optimal rate of O(1/n) under certain conditions. Optimizes threshold selection for variance estimation in financial models.
problem Estimating integrated variance in financial models with jumps.
method Optimizes threshold selection using mean and conditional mean square error criteria.
result Proposes a novel method to approximate the optimal threshold.
This letter presents an improved version of diffusion least mean ppower (LMP) algorithm for distributed estimation. Instead of sum of mean square errors, a weighted sum of mean square error is defined as the cost function for global and local cost functions of a network of sensors. The weight coefficients are updated b…
Paper analyzes convergence of two time-scale stochastic approximation using martingale approach.
problem Analyzing convergence of two time-scale stochastic approximation algorithms.
method Uses martingale approach to establish convergence conditions and rates.
result Establishes different rates of convergence for fast and slow subsystems.
This paper presents a stochastic behavior analysis of a kernel-based stochastic restricted-gradient descent method. The restricted gradient gives a steepest ascent direction within the so-called dictionary subspace. The analysis provides the transient and steady state performance in the mean squared error criterion. It…
Paper optimizes diffusion models for denoising tasks with theoretical guarantees.
problem Lack of theoretical understanding of MSE optimality in diffusion models.
method Inspired by MSE-optimal CME, proposes a novel denoising strategy for diffusion models.
result Demonstrates polynomial-time convergence to the CME under mild conditions.
Efficiently estimates private least squares with linear error growth.
problem Private estimation of ordinary least squares with bounded residuals and leverage.
method Scaled noise added to a stable nonprivate estimator of the regression vector.
result Near-optimal accuracy guarantee with linear error growth in dimension.
A fast method for LOOCV in k-NN regression reduces computation time.
problem Efficient computation of LOOCV for k-NN regression.
method Identical LOOCV estimate to (k+1)-NN MSE on training data.
result LOOCV computation can be done with (k+1)-NN regression once.
Asymptotic error distribution for approximation of a stochastic integral with respect to continuous semimartingale by Riemann sum with general stochastic partition is studied. Effective discretization schemes of which asymptotic conditional mean-squared error attains a lower bound are constructed. Two applications are …
Improved estimator for least squares using random projections achieves smaller error.
problem Improving the accuracy of least squares solutions for large-scale problems.
method James-Stein estimator applied to Gaussian sketching of least squares problems.
result Upper and lower bounds match when SNR is small and data matrix is well-conditioned.
Risk-aware MMSE improves stability in volatile scenarios.
problem In MMSE estimators, volatility of error is unconstrained, leading to significant performance differences.
method Introduces risk-aware MMSE by constraining expected predictive variance.
result Risk-aware MMSE provides better performance, especially in skewed, heavy-tailed distributions.
Unified framework for estimating random forest prediction errors.
problem Estimating prediction errors for random forests.
method Novel estimator of conditional prediction error distribution function.
result Proposed estimators enable competitive prediction intervals.
This study calculates the maximum error of a famous estimation method.
problem Estimating rare items not seen in a sample.
method Characterizes the maximal mean-squared error of the Good-Turing estimator.
result Characterizes the maximal mean-squared error of the Good-Turing estimator.
New method finds best arm minimizing mean-squared error in correlated bandits.
problem Finding an arm that best captures information about other arms.
method Formulated correlated bandit problem, derived MSE estimator, proposed algorithm.
result Proposed algorithm identifies best arm with error probability bounds.
This paper describes a recursive estimation procedure for multivariate binary densities (probability distributions of vectors of Bernoulli random variables) using orthogonal expansions. For d covariates, there are 2d basis coefficients to estimate, which renders conventional approaches computationally prohibitive …
Paper solves outlier robust mean estimation near breakdown point.
problem Estimating mean in presence of adversarial outliers.
method Sum-of-Squares approach to optimize error rate efficiently.
result Achieves optimal error rate for all ε ∈ [0, 1/2).
We derive a mapping between MSE and CCC, revealing counterintuitive insights.
problem Missing mapping between mean square error and concordance correlation coefficient.
method Derive mathematical formula connecting MSE and CCC, analyze graphical implications.
result Formula uncovers counterintuitive insights and precise range for CCC given MSE.
New method optimizes tail dependence coefficient estimation.
problem Estimating tail dependence in nonparametric data.
method Optimal threshold selection combining mean squared error and copula estimation.
result Improved accuracy in tail dependence coefficient estimation.
Constrained adaptive filtering algorithms inculding constrained least mean square (CLMS), constrained affine projection (CAP) and constrained recursive least squares (CRLS) have been extensively studied in many applications. Most existing constrained adaptive filtering algorithms are developed under mean square error (…
Paper bounds prediction error for misspecified Gaussian process models.
problem Guaranteeing model confidence for nonparametric Gaussian process regression.
method Derives an upper bound for mean square prediction error using pseudo-concave optimization.
result Upper bound for mean square prediction error of misspecified models.
Mack's estimator improves chain ladder prediction for large exposure insurance models.
problem Uncertainty quantification in compound Poisson loss models.
method Large exposure asymptotics applied to Mack's estimator.
result Chain ladder prediction uncertainty can be quantified without model assumptions.
The most important aspect of any classifier is its error rate, because this quantifies its predictive capacity. Thus, the accuracy of error estimation is critical. Error estimation is problematic in small-sample classifier design because the error must be estimated using the same data from which the classifier has been…
Develops a new method for estimating models with conditional moment restrictions.
problem Estimating models with conditional moment restrictions, especially non-parametric instrumental variable regression.
method Introduces a min-max criterion function to solve a zero-sum game between modeler and adversary, analyzing estimation rates for various hypothesis spaces.
result Shows that with regularization and rich test function spaces, estimation rates scale with the critical radius of hypothesis and test function spaces.
Improved Least-Squares Monte Carlo with finite-difference ansatz.
problem Improving accuracy and stability in option pricing.
method Constructing an ansatz using finite-difference solution for conditional expected continuation payoffs.
result Reduces mean squared error and final pricing error.
Cryptocurrency prices predicted using LSTM, SVM, and polynomial regression.
problem Uncertainty in crypto coin values.
method Long Short Term Memory, Support Vector Machine, Polynomial Regression models.
result Support Vector Machine with linear kernel had the smallest mean square error.
This paper establishes lower bounds for SGD's error, matching upper bounds.
problem Proving lower error bounds for SGD optimization algorithm.
method Analysis of mean square error for SGD with specific learning rates.
result Essentially matching lower and upper bounds for SGD's mean square error.
Optimal Biweight kernel and computationally efficient Epanechnikov kernel for modal linear regression.
problem Finding the best kernel for modal linear regression.
method Refined analysis of asymptotic statistical behavior and IRLS algorithm convergence.
result Biweight kernel minimizes asymptotic mean squared error, Epanechnikov kernel guarantees IRLS convergence.
The paper examines conditions for linearity in a conditional mean estimator under vector Poisson noise.
problem Conditions for linearity of the conditional mean estimator in vector Poisson noise.
method Analyzes prior distributions and their impact on the conditional mean estimator's linearity.
result The only prior distribution that induces linearity is a product gamma distribution, and non-zero dark current parameter prevents linearity.
In recent years, kernel density estimation has been exploited by computer scientists to model machine learning problems. The kernel density estimation based approaches are of interest due to the low time complexity of either O(n) or O(n*log(n)) for constructing a classifier, where n is the number of sampling instances.…
Proposes variational autoencoder for efficient MMSE estimation.
problem Efficient parameterized MMSE estimation for noisy observations.
method Variational autoencoder models data distribution, approximates MMSE.
result Proposed estimator performs well compared to state-of-the-art.
Improved multi-task averaging reduces mean squared error in high-dimensional data.
problem Joint estimation of multiple distributions using independent data sets.
method Exploits similarities between tasks by shrinking naive estimators towards local averages.
result The method provides a significant reduction in mean squared error, especially in high-dimensional spaces.
Improved speech enhancement using diffusion models with MSE loss.
problem Efficient incorporation of noisy speech in generative speech enhancement.
method Augmented diffusion-based generative model with a MSE loss for enhanced speech.
result Proposed method improves speech enhancement performance compared to original diffusion model.
Study improves least squares estimation for heavy-tailed errors.
problem Improving least squares estimation under heteroscedastic and heavy-tailed errors.
method Analyzes the rate of convergence of least squares estimator under bounded conditional variance and finitely many moments of errors.
result Upper bounds on rates of convergence of LSE for heavy-tailed errors are found.
Unified analysis of TD learning using MJLS theory for linear function approximators.
problem Characterizing the exact behaviors of TD learning algorithms with linear function approximators.
method Exploiting connections to Markov jump linear systems (MJLS) theory to analyze TD learning algorithms.
result Closed-form expressions for mean and covariance matrix of TD estimation error at any time step.
Study on LMMSE estimation with model mismatch, quantifying MSE trade-offs.
problem Model mismatch in LMMSE estimation with undermodeling.
method Analyzing the average MSE of LMMSE estimation with random regressors.
result Performance improvement depends on sufficient samples and model complexity.
Estimates multiple linear systems on a graph with smoothness constraints.
problem Joint estimation of multiple linear systems under graph smoothness constraints.
method Proposes estimators for joint estimation of system matrices with error bounds.
result MSE converges to zero as m increases, typically polynomially fast w.r.t m. Estimating mean from one-bit samples of symmetric log-concave distributions.
problem Estimating the mean of a symmetric log-concave distribution with limited one-bit measurements.
method Analyzes mean squared error in three settings: centralized, adaptive, and distributed, with and without quantization.
result One round of adaptivity is sufficient to achieve optimal mean-square error in the adaptive setting.
Paper introduces statistical learning for point processes.
problem Statistical learning for point processes in general spaces.
method Combines bivariate innovations and point process cross-validation.
result Statistical learning approach outperforms state of the art.
Exponential testing error reduction with stochastic gradient methods under low-noise conditions.
problem Binary classification with positive definite kernels and square loss.
method Stochastic gradient methods under low-noise conditions.
result Testing error converges exponentially fast, while testing loss converges slowly.
ALO-CV approximates leave-one-out error in proportional regime.
problem Estimating generalization error in high-dimensional settings.
method Developed new analysis for ALO-CV, showed consistency under strong convexity.
result ALO-CV approximates leave-one-out error up to negligible error.
The paper compares machine learning models for forecasting residential gas demand, highlighting the impact of temperature forecasts.
problem Forecasting residential gas demand for optimal energy planning.
method Implemented and compared five models: Ridge Regression, GP, k-Nearest Neighbour, ANN, and Torus Model.
result ANN is the best model in terms of RMSE, while GP is the best in terms of MAE.
The conditional-mean barrier helps diagnose deterministic surrogates missing uncertainty.
problem Uncertainty in deterministic surrogates for complex systems.
method Developed diagnostics to locate the conditional-mean barrier and prove its necessity for distributional objectives.
result Crossing the barrier requires a loss that scores distributions, not point predictions.
ABae efficiently computes subset means with expensive predicates using stratified sampling.
problem Computing subset means with expensive predicates efficiently.
method Stratified sampling and proxy models.
result Mean squared error of O(N−1) when N is split evenly between stages. QR-learner estimates individual treatment effects using external data.
problem Limited power to detect individual treatment effects in randomized trials.
method Model-agnostic learner that estimates conditional average treatment effects (CATE) using external data.
result QR-learner reduces mean squared error and can recover true CATE.
We analyze two communication-efficient algorithms for distributed statistical optimization on large-scale data sets. The first algorithm is a standard averaging method that distributes the N data samples evenly to $\nummac$ machines, performs separate minimization on each subset, and then averages the estimates. We p…
Cross-validation pitfalls in change-point regression are addressed with new approaches.
problem Cross-validation's prediction error-based criterion may lead to under- or over-estimation of change-points.
method Proposes two approaches: absolute error loss and modified holdout sets.
result Consistent estimation of the number of change-points under certain conditions.
Robust diffusion adaptive estimation algorithms based on the maximum correntropy criterion (MCC), including adaptation to combination MCC and combination to adaptation MCC, are developed to deal with the distributed estimation over network in impulsive (long-tailed) noise environments. The cost functions used in distri…