This work proves convergence of adaptive resampling for random Fourier features.
problem Sampling Fourier frequencies well for high-dimensional data.
method Data adaptive resampling of Fourier frequencies, asymptotically optimal.
result Proves convergence of adaptive resampling method for regression and classification problems.
This paper tackles noisy multi-objective optimization with adaptive resampling using bootstrapping.
problem Challenges in optimizing noisy multi-objective problems, especially trade-offs between exploration and exploitation.
method Adaptive resampling with bootstrapping to estimate probability of dominance and improve precision.
result Demonstrates the efficiency of the resampling approach in NSGA-II algorithm under multiple noise variations.
ART adapts class-wise resampling to improve imbalanced classification performance.
problem Class imbalance in classification tasks limits model performance.
method ART uses adaptive resampling based on class-wise performance metrics.
result ART consistently outperforms other methods on diverse benchmarks.
The estimation of normalizing constants is a fundamental step in probabilistic model comparison. Sequential Monte Carlo methods may be used for this task and have the advantage of being inherently parallelizable. However, the standard choice of using a fixed number of particles at each iteration is suboptimal because s…
Many machine learning models have important structural tuning parameters that cannot be directly estimated from the data. The common tactic for setting these parameters is to use resampling methods, such as cross--validation or the bootstrap, to evaluate a candidate set of values and choose the best based on some pre--…
Spatial econometric research typically relies on the assumption that the spatial dependence structure is known in advance and is represented by a deterministic spatial weights matrix. Contrary to classical approaches, we investigate the estimation of sparse spatial dependence structures for regular lattice data. In par…
Particle Markov chain Monte Carlo techniques rank among current state-of-the-art methods for probabilistic program inference. A drawback of these techniques is that they rely on importance resampling, which results in degenerate particle trajectories and a low effective sample size for variables sampled early in a prog…
Differentiable resampling improves particle filter performance.
problem Non-differentiability of traditional resampling in particle filters.
method Introduced a neural network resampler (particle transformer) trained with a likelihood-based loss function.
result Learned resampling outperforms traditional methods on synthetic and real-world tasks.
tsbootstrap handles time series uncertainty without assuming independence.
problem Time series data violate IID assumptions, leading to undercoverage in traditional methods.
method Provides various resampling and bootstrap methods, including classical and adaptive conformal calibration.
result Dependence-aware methods reduce coverage deficits, with sieve resampling performing best.
A new differentiable resampling method for Monte Carlo simulations.
problem Improving the efficiency and differentiability of resampling in Monte Carlo simulations.
method Proposes a diffusion model surrogate for resampling, proving consistency and outperforming existing methods.
result The proposed method outperforms state-of-the-art differentiable resampling methods on various benchmarks.
A new test method improves goodness-of-fit tests for copulas.
problem Developing robust tests for copula goodness-of-fit.
method Binary Expansion Approximation of UniformiTY (BEAUTY) and Binary Expansion Adaptive Symmetry Test (BEAST).
result The BEAST method improves empirical power against various alternatives.
Investors in Target Date Funds are automatically switched from high risk to low risk assets as their retirements approach. Such funds have become very popular, but our analysis brings into question the rationale for them. Based on both a model with parameters fitted to historical returns and on bootstrap resampling, we…
Paper proposes a new method for estimating mixture proportions without irreducibility assumption.
problem Estimating mixture proportions when component distributions are not irreducible.
method Developed a resampling-based meta-algorithm that adapts existing MPE algorithms to non-irreducible settings.
result Empirical results show improved estimation performance compared to baseline methods and regrouping-based algorithms.
The modern scale of data has brought new challenges to Bayesian inference. In particular, conventional MCMC algorithms are computationally very expensive for large data sets. A promising approach to solve this problem is embarrassingly parallel MCMC (EP-MCMC), which first partitions the data into multiple subsets and r…
In many real-world binary classification tasks (e.g. detection of certain objects from images), an available dataset is imbalanced, i.e., it has much less representatives of a one class (a minor class), than of another. Generally, accurate prediction of the minor class is crucial but it's hard to achieve since there is…
A new method uses denoising diffusion models to improve seismic data interpolation.
problem Improving the accuracy of seismic data interpolation to enhance imaging and interpretation.
method The approach combines denoising diffusion probabilistic models with coherence-corrected resampling strategies.
result The proposed method achieves superior performance and generalization to various missing patterns and noise levels.
fastml guards against data leakage in automated machine learning.
problem Data leakage during preprocessing before resampling inflates apparent performance.
method fastml uses guarded resampling to re-estimate preprocessing inside each resample.
result Guarded resampling reduces apparent performance compared to global preprocessing.
New law predicts first extinction in resampling processes.
problem Intractable extinction times in resampling processes.
method Modeling multinomial updates as independent square-root diffusions.
result Closed-form law for first-extinction time with linear cost.
Identifying dependency in multivariate data is a common inference task that arises in numerous applications. However, existing nonparametric independence tests typically require computation that scales at least quadratically with the sample size, making it difficult to apply them to massive data. Moreover, resampling i…
Class imbalance problem is commonly faced while developing machine learning models for real-life issues. Due to this problem, the fitted model tends to be biased towards the majority class data, which leads to lower precision, recall, AUC, F1, G-mean score. Several researches have been done to tackle this problem, most…
Generates diverse images by resampling specific parts while maintaining global consistency.
problem Creating diverse images while maintaining global consistency in certain parts.
method Developed a new network architecture, training procedure, and resampling algorithm.
result Achieved low distortion block-resampling with spatially stochastic networks.
This paper surveys various data balancing methods for imbalanced datasets.
problem Imbalanced datasets bias predictions and degrade classifier performance.
method Extensive review of oversampling, undersampling, adaptive, generative, combination, and ensemble methods.
result No single method universally outperforms others; selection depends on dataset characteristics.
0-1 knapsack is of fundamental importance in computer science, business, operations research, etc. In this paper, we present a deep learning technique-based method to solve large-scale 0-1 knapsack problems where the number of products (items) is large and/or the values of products are not necessarily predetermined but…
DAIS improves AIS by resampling, avoiding gradient issues.
problem Low effective sample size in DAIS.
method DAIS with resampling step to improve efficiency.
result Resampling step avoids gradient variance issues.
Study shows resampling can drastically alter PCA results.
problem Stability and sensitivity of PCA under data resampling.
method Analyzed resampling sensitivity of high-dimensional PCA.
result PCA's principal components become asymptotically orthogonal when resampling is significant.
Study compares resampling methods for rare event prediction in longitudinal studies.
problem Predicting rare events in longitudinal follow-up studies.
method Comparison of resampling methods to improve standard regression models.
result Effect of sampling rate on model predictive performance.
A novel variational inference based resampling framework is proposed to evaluate the robustness and generalization capability of deep learning models with respect to distribution shift. We use Auto Encoding Variational Bayes to find a latent representation of the data, on which a Variational Gaussian Mixture Model is a…
Toy model study shows resampling/reweighting can improve feature learning in imbalanced classification.
problem Improving feature learning in imbalanced classification problems.
method High-dimensional toy model with replica method, class-wise resampling/reweighting, and simplified model.
result No resampling/reweighting can sometimes give best feature learning performance.
LOBSTUR-GNN adapts bootstrapping for unsupervised GNNs, improving node representation learning.
problem Hyperparameter tuning and lack of established methodologies for unsupervised GNNs.
method Adapts bootstrapping techniques for local graph dependencies and uses CCA for embedding consistency.
result 65.9% improvement in classification accuracy compared to uninformed hyperparameter selection.
Adaptive sampling method improves efficiency in complex target distributions.
problem Efficiency of importance sampling in complex target distributions, especially multimodal distributions in high-dimensional spaces.
method Proposes an adaptive scheme combining global sampling with delayed weighting to promote efficient exploration of target distributions.
result The proposed algorithm is geometrically convergent under mild assumptions and demonstrates improved efficiency in various numerical experiments.
This paper investigates bias in resampled backtests for financial portfolios, finding it often negligible.
problem Bias in resampled backtests for financial portfolio evaluation.
method Investigation of bias in rolling-window mean-variance portfolios using resampling techniques.
result The bias in Sharpe Ratio estimates from IID resampling is often a fraction of estimation noise, making it tolerable.
Resampling outperforms reweighting for correcting biased data in machine learning models.
problem Correcting sampling bias in machine learning models trained on biased data sets.
method Compared resampling and reweighting techniques, focusing on their performance with stochastic gradient algorithms.
result Resampling outperforms reweighting when combined with stochastic gradient algorithms.
Improved particle filters for estimating model parameters using differentiable resampling.
problem Inability to differentiate sampling and resampling steps in particle filters.
method Extended reparameterisation trick to include stochastic input, enabling differentiation. Used p-MCMC and NUTS for parameter estimation.
result NUTS improves mixing of Markov chain and produces more accurate results in less time.
Bayesian neural networks improve reliability in multimedia forensics.
problem Challenges with out-of-distribution data in multimedia authentication.
method Proposes Bayesian neural networks (BNN) for forensic tasks.
result BNNs provide distributions for better reliability and out-of-distribution detection.
An approximate method for conducting resampling in Lasso, the ℓ1 penalized linear regression, in a semi-analytic manner is developed, whereby the average over the resampled datasets is directly computed without repeated numerical sampling, thus enabling an inference free of the statistical fluctuations due to sam…
Package {mlr3spatiotempcv} simplifies spatiotemporal resampling methods in R.
problem Assessing and tuning spatial and spatiotemporal machine learning models.
method Integrates various spatiotemporal resampling methods into the {mlr3} framework.
result Provides a consistent interface for spatiotemporal resampling methods.
Online class imbalance learning constitutes a new problem and an emerging research topic that focusses on the challenges of online learning under class imbalance and concept drift. Class imbalance deals with data streams that have very skewed distributions while concept drift deals with changes in the class imbalance s…
This paper addresses GE estimation in non-standard settings using various resampling methods.
problem Biased GE estimates in non-standard settings like clustered data and concept drift.
method Tailored resampling methods for clustered, spatial, unequal sampling, concept drift, and hierarchically structured outcomes.
result Standard resampling methods often yield biased GE estimates in non-standard settings.
A common issue for classification in scientific research and industry is the existence of imbalanced classes. When sample sizes of different classes are imbalanced in training data, naively implementing a classification method often leads to unsatisfactory prediction results on test data. Multiple resampling techniques…
Inference-Time Scaling can be extended to domains prone to systematic failure using intrinsic statistics.
problem Scaling inference time in domains prone to systematic failure
method Intrinsic Selection (iS), Intrinsic Particle Filtering (iPF), and Particle Distillation (dPF)
result Intrinsic Selection improves engineering design selection by 20% and pass@1 by 6.1 points on average.
A new particle filter avoids resampling to improve state estimation in high dimensions.
problem Particle deprivation in high-dimensional state spaces.
method A resampling-free particle filter designed to mitigate particle deprivation.
result The filter offers a near-accurate representation of the posterior distribution in high-dimensional contexts.
Flora uses random projections to achieve high-rank updates with low memory usage.
problem Excessive memory usage in large neural networks during training.
method Flora approximates LoRA using random projections to enable high-rank updates with sublinear space complexity.
result Flora achieves high-rank updates with significantly reduced memory usage compared to LoRA.
Paper uses K-NN resampling to simulate and evaluate LOB markets.
problem Simulating and evaluating limit order book (LOB) markets.
method Applies K-nearest neighbor (K-NN) resampling to LOB simulation and evaluation. result Demonstrates the effectiveness and efficiency of K-NN resampling in LOB simulation and evaluation. It is known that evolution strategies in continuous domains might not converge in the presence of noise. It is also known that, under mild assumptions, and using an increasing number of resamplings, one can mitigate the effect of additive noise and recover convergence. We show new sufficient conditions for the converge…
Importance sampling (IS) is a common reweighting strategy for off-policy prediction in reinforcement learning. While it is consistent and unbiased, it can result in high variance updates to the weights for the value function. In this work, we explore a resampling strategy as an alternative to reweighting. We propose Im…
New STH distance finds patterns in event timeseries without resampling.
problem Lack of efficient analysis methods for event and state timeseries.
method Define STE-ts, propose STH, leveraging both time and state duration.
result Improved precision and computation time compared to resampled metrics.
Cheap methods improve uncertainty in SGD solutions.
problem Uncertainty quantification in SGD solutions.
method Two resampling-based methods: parallel resampling with replacement and online resampling.
result Significantly reduced computation effort in constructing confidence intervals.
A new online bootstrap method for time series data.
problem Applying traditional bootstrap methods to time series data with dependencies.
method An autoregressive sequence of resampling weights to account for data dependencies.
result The method provides reliable uncertainty quantification in real-time applications.