Optimizes a small set of centroid points to approximate bootstrap distribution.
problem Computational inefficiency of standard bootstrap methods in large-scale machine learning.
method Explicitly optimizes a small set of high quality centroid points to approximate the ideal bootstrap distribution.
result Accurately estimates uncertainty with a small number of bootstrap centroids, outperforming i.i.d. sampling.
Efficiently bootstraps massive distributed data without over-resampling.
problem Statistical inference for massive distributed data.
method Distributed Bootstrap applied to gradients from worker machines.
result Proves optimal statistical efficiency with minimal communication.
Delta method vs Bootstrap for deep learning classification shows strong linear relationship and faster computation.
problem Validating the Delta method for deep learning classification.
method Comparison of Delta method and Bootstrap on LeNet-based neural networks using MNIST and CIFAR-10 datasets.
result The Delta method provides a five times faster computation with strong linear predictive uncertainty relationship.
Paper explores using bootstrap methods to improve SGD's stability and robustness.
problem Improving the stability and robustness of SGD.
method Investigates empirical bootstrap approaches for SGD from algorithmic stability and statistical robustness perspectives.
result Demonstrates construction of purely distribution-free confidence intervals using bootstrap SGD.
Validates network bootstraps for uncertainty quantification in network visualisation.
problem Quantifying uncertainty in network embeddings when only a single observation is available.
method Statistical indistinguishable embeddings using k-nearest neighbour smoothing, validated by an exchangeable network test.
result Proposes a principled, distribution-free network bootstrap that passes the exchangeable network test.
In this paper we address the problem of performing statistical inference for large scale data sets i.e., Big Data. The volume and dimensionality of the data may be so high that it cannot be processed or stored in a single computing node. We propose a scalable, statistically robust and computationally efficient bootstra…
A new online bootstrap method for time series data.
problem Applying traditional bootstrap methods to time series data with dependencies.
method An autoregressive sequence of resampling weights to account for data dependencies.
result The method provides reliable uncertainty quantification in real-time applications.
We consider the performance of the bootstrap in high-dimensions for the setting of linear regression, where p<n but p/n is not close to zero. We consider ordinary least-squares as well as robust regression methods and adopt a minimalist performance requirement: can the bootstrap give us good confidence intervals fo…
Data augmented bootstrap unifies various confidence interval construction methods.
problem Constructing confidence intervals from data transformations.
method Data augmented bootstrap (DAB) framework.
result Establishes theoretical coverage results for DAB methods.
Three bootstrap tests compare categorical time series generating processes.
problem Testing equality of generating processes in categorical time series.
method Proposes three tests using dissimilarity measures and bootstrap methods.
result Advantages and disadvantages of each bootstrap method discussed.
Structural equation models and Bayesian networks have been widely used to study causal relationships between continuous variables. Recently, a non-Gaussian method called LiNGAM was proposed to discover such causal models and has been extended in various directions. An important problem with LiNGAM is that the results a…
Paper improves bootstrapping for off-policy reinforcement learning inference.
problem Improving bootstrapping for off-policy reinforcement learning inference.
method Proposes a bootstrapping FQE method for off-policy statistical inference and a subsampling procedure to improve runtime.
result Asymptotically efficient and distributionally consistent bootstrapping FQE method for off-policy inference.
Bootstrap method for Markov chains in reinforcement learning.
problem Distributional consistency in finite controlled Markov chains with unknown control policies.
method Model-based bootstrap with novel LLN and CLT for visitation counts and transition increments.
result Asymptotically valid confidence intervals for value and Q-functions in offline RL. New DP bootstrap method for statistical inference with improved privacy and accuracy.
problem Lack of general techniques for conducting statistical inference under differential privacy.
method DP bootstrap procedure to infer sampling distribution and construct confidence intervals.
result DP bootstrap estimates provide consistent point estimates and asymptotically valid standard CIs.
The bootstrap provides a simple and powerful means of assessing the quality of estimators. However, in settings involving large datasets---which are increasingly prevalent---the computation of bootstrap-based quantities can be prohibitively demanding computationally. While variants such as subsampling and the m out o…
A new method reduces bootstrap simulation cost and improves accuracy.
problem Efficiently simulating input uncertainty with large sample sizes.
method Orthogonal Bootstrap: Decomposes into Infinitesimal Jackknife and orthogonal parts.
result Significantly reduces computational cost and maintains accuracy.
AR-Sieve Bootstrap improves Random Forest time series prediction accuracy.
problem Inaccurate time series prediction due to inadequate resampling methods.
method Combines Random Forest with AR-Sieve Bootstrap for better resampling.
result AR-Sieve Bootstrap leads to more accurate predictions compared to other methods.
The paper improves the empirical bootstrap method for non-normal estimators.
problem Theoretical properties of empirical bootstrap for non-asymptotically normal estimators.
method Establishing limiting distribution, deriving consistency conditions, proposing alternative methods.
result The empirical bootstrap method can be asymptotically consistent under stability conditions.
New bootstraps improve speed and accuracy for graph count functionals.
problem Efficiently counting subgraphs in large graphs.
method Developed two types of multiplier bootstraps: a fast, approximate linear one and a quadratic one for denser graphs.
result Both bootstraps provide valid inference and higher-order accuracy under different graph sparsity conditions.
A wild bootstrap method for nonparametric hypothesis tests based on kernel distribution embeddings is proposed. This bootstrap method is used to construct provably consistent tests that apply to random processes, for which the naive permutation-based bootstrap fails. It applies to a large group of kernel tests based on…
Proposes a private empirical bootstrap for Gaussian Differential Privacy.
problem Quantifying uncertainty in massive data under Differential Privacy.
method Gaussian Differential Private Bootstrap by Subsampling.
result Consistent and efficient private inference method.
Paper presents methods to create stock price confidence intervals using LSTM models.
problem Creating accurate confidence intervals for LSTM-estimated stock prices.
method Three bootstrap methods for dependent data, optimal block length selection, and benchmark comparison.
result Illustrated through stock price data, different bootstrap strategies provide varying confidence intervals.
We introduce a bootstrap procedure for high-frequency statistics of Brownian semistationary processes. More specifically, we focus on a hypothesis test on the roughness of sample paths of Brownian semistationary processes, which uses an estimator based on a ratio of realized power variations. Our new resampling method,…
Gaussian and bootstrap methods improve ATE estimator accuracy.
problem Improving the accuracy of Average Treatment Effect (ATE) estimators.
method Gaussian approximation and bootstrap procedures.
result Precise bounds on ATE estimator accuracy quantifying key parameters.
Recently, multilayer bootstrap network (MBN) has demonstrated promising performance in unsupervised dimensionality reduction. It can learn compact representations in standard data sets, i.e. MNIST and RCV1. However, as a bootstrap method, the prediction complexity of MBN is high. In this paper, we propose an unsupervis…
A novel deep bootstrap framework for nonparametric regression using conditional diffusion models.
problem Nonparametric regression with efficient sampling and accurate estimation.
method Conditional diffusion model for learning conditional distributions, integrating sampling and regression into a unified generative framework.
result Established optimal convergence rates in the Wasserstein distance and convergence guarantees for the bootstrap procedure.
The paper analyzes bootstrap ensemble classifiers in high-dimensional settings.
problem Performance of bootstrap ensemble classifiers in high-dimensional data.
method Random Matrix Theory applied to LSSVM ensemble.
result Strategies to optimize performance of LSSVM ensemble.
In distributed, or privacy-preserving learning, we are often given a set of probabilistic models estimated from different local repositories, and asked to combine them into a single model that gives efficient statistical estimation. A simple method is to linearly average the parameters of the local models, which, howev…
Neural Bootstrapper reduces bootstrapping cost for deep neural networks.
problem Computational burden in bootstrapping deep neural networks.
method Neural Bootstrapper learns to generate bootstrapped neural networks through single model training.
result Neural Bootstrapper outperforms bagging methods with lower computational cost.
Off-policy reinforcement learning aims to leverage experience collected from prior policies for sample-efficient learning. However, in practice, commonly used off-policy approximate dynamic programming methods based on Q-learning and actor-critic methods are highly sensitive to the data distribution, and can make only …
A new estimator combines bootstrapping and rollout methods in RL.
problem Combining strengths of bootstrapping and rollout methods in RL.
method Subgraph Bellman operators and fixed point solving.
result Upper bound on error approaches optimal TD variance with additional term.
Develops statistical confidence sets for multidimensional scaling.
problem Statistical uncertainty in multidimensional scaling of noisy data.
method Formal statistical framework, distributional convergence results, uniform confidence sets, bootstrap procedures.
result Construction of reliable confidence sets for latent configurations in multidimensional scaling.
In this paper we revisit the weighted likelihood bootstrap, a method that generates samples from an approximate Bayesian posterior of a parametric model. We show that the same method can be derived, without approximation, under a Bayesian nonparametric model with the parameter of interest defined as minimising an expec…
Improved RL for TBGs by pruning irrelevant tokens and bootstrapping.
problem RL methods fail to generalize in TBGs with small data.
method CREST for irrelevant token removal, bootstrapped Q-learning.
result Improved generalization in unseen TextWorld games.
It is shown that bootstrap approximations of support vector machines (SVMs) based on a general convex and smooth loss function and on a general kernel are consistent. This result is useful to approximate the unknown finite sample distribution of SVMs by the bootstrap approach.
Cheap methods improve uncertainty in SGD solutions.
problem Uncertainty quantification in SGD solutions.
method Two resampling-based methods: parallel resampling with replacement and online resampling.
result Significantly reduced computation effort in constructing confidence intervals.
A new bootstrapping method reduces key sizes and runtime in FHE.
problem Large plaintext evaluation in FHE increases bootstrapping complexity.
method New polynomial vector representation and monic monomial permutation matrices.
result Polynomial factor improvement in key size and constant factor in runtime.
A distributed bootstrap method for high-dimensional data reduces communication rounds efficiently.
problem Simultaneous inference on massive, high-dimensional data stored across many machines.
method Distributed bootstrap based on de-biased lasso with efficient cross-validation tuning.
result Theoretical lower bound on communication rounds τmin for statistical accuracy and efficiency. Equity-Directed Bootstrapping improves model performance across groups in imbalanced datasets.
problem Improving model performance across different groups in imbalanced datasets.
method Equity-Directed Bootstrapping to balance training data with respect to both labels and group identity.
result The equity-directed bootstrap brings test set sensitivities and specificities closer to satisfying the equal odds criterion.
PPBoot simplifies prediction-powered inference.
problem Prediction-powered inference problems.
method Bootstrap-based method for arbitrary estimation problems.
result PPBoot often performs nearly identically to PPI(++).
Private statistical inference methods improve confidence interval lengths.
problem Constructing private confidence intervals with differential privacy.
method Proposed two private variants of non-parametric bootstrap.
result Achieve similar coverage accuracy to non-private methods with shorter intervals.
Bootstrapping regularizes singular correlation matrices, reducing the need for complex regularization.
problem Singular correlation matrices in large datasets.
method Averaging bootstrapped correlation matrices to ensure positive-definiteness.
result The averaged correlation matrix is almost surely positive-definite with a sufficient number of bootstraps.
A novel bootstrap method improves concept drift detection in predictive models.
problem Detecting changes in predictive relationships (concept drift) in data-driven applications.
method Developed a nested bootstrap procedure to calibrate control limits using the entire initial sample.
result The method yields more accurate baseline models and faster CL setup times.
Study uses online bootstrap for RL inference, showing effectiveness.
problem Statistical inference for RL parameters in online settings.
method Online bootstrap method applied to TD and GTD algorithms in RL.
result Method is distributionally consistent for policy evaluation inference.
This study presents two new algorithms for solving linear stochastic bandit problems. The proposed methods use an approach from non-parametric statistics called bootstrapping to create confidence bounds. This is achieved without making any assumptions about the distribution of noise in the underlying system. We present…
Normal-bundle bootstrap generates new data preserving geometric structure.
problem Probabilistic models often exhibit salient geometric structure.
method NBB method decomposes probability measure into manifold and normal spaces, estimates manifold as density ridge, and generates new data by bootstrapping projection vectors.
result NBB generates new data that preserves the geometric structure of a given data set.
This paper examines the use of a residual bootstrap for bias correction in machine learning regression methods. Accounting for bias is an important obstacle in recent efforts to develop statistical inference for machine learning methods. We demonstrate empirically that the proposed bootstrap bias correction can lead to…
A new clustering method using Bayesian techniques improves robustness and interpretability.
problem Improving clustering techniques for better robustness and interpretability.
method The paper proposes a novel Bayesian clustering method using the proper Bayesian bootstrap, which combines k-means clustering and ensemble clustering.
result The method provides clear indication on the optimal number of clusters and a better representation of the clustered data.