Adaptive sampling method improves efficiency in complex target distributions.
problem Efficiency of importance sampling in complex target distributions, especially multimodal distributions in high-dimensional spaces.
method Proposes an adaptive scheme combining global sampling with delayed weighting to promote efficient exploration of target distributions.
result The proposed algorithm is geometrically convergent under mild assumptions and demonstrates improved efficiency in various numerical experiments.
Algorithm samples from Bingham distribution efficiently.
problem Sampling from the Bingham distribution on a sphere.
method Rejection sampling with polynomial approximation.
result Exact samples from Bingham distribution in polynomial time.
The paper tests properties of multiple distributions with limited samples.
problem Testing properties of multiple distributions with few samples.
method Designing testers for uniformity, identity, and closeness testing under specific conditions.
result Sample optimal testers for uniformity, identity, and closeness testing are provided.
The study examines property testing and estimation under non-identically distributed samples, finding necessary and sufficient sample complexities.
problem Property testing and estimation under non-identically distributed samples.
method Analysis of distributional property testing and estimation in settings with heterogeneous entities.
result Necessary and sufficient sample complexities for property testing and estimation under non-identically distributed samples.
New methods learn sampling distributions for particle filters without supervision.
problem Designing accurate sampling distributions for nonlinear dynamical systems.
method Proposed four unsupervised learning methods for multivariate Gaussian and nonparametric distributions.
result Learned sampling distributions outperform designed ones in accuracy.
Improved privacy-preserving methods for estimating multiple samples from distributions.
problem Estimating multiple samples from distributions while maintaining privacy.
method Developed new multi-sampling techniques for differentially private data estimation.
result Achieved significant reduction in sample complexity for multi-sampling from finite domains and Gaussian distributions.
Adapts GAN-based robustness training to live traffic data.
problem Improving classifier robustness to out-of-distribution samples in real-world traffic.
method Adaptive regularization technique based on maximum predictive probability score.
result Significantly improved detection of out-of-distribution samples without degrading in-distribution performance.
Optimizes sampling in continuous domains by adjusting search distribution.
problem Improving sampling efficiency in continuous domains.
method Analyzes and refines the search distribution based on population size and dimension.
result Explicit values for reshaping the search distribution are provided.
The study reveals the efficiency of sampling from tilted distributions.
problem Sampling from a tilted distribution of an unknown underlying distribution.
method Self-normalized importance sampling to characterize accuracy.
result Polynomial vs super-polynomial sample complexity for bounded vs unbounded distributions.
A new classifier method detects out-of-distribution samples by minimizing KL divergence.
problem Detecting out-of-distribution samples in neural networks.
method Training a confident-classifier by minimizing KL divergence and maximizing entropy, or adding a reject class.
result The confident-classifier still yields high confidence for OOD samples far from the in-distribution.
New private identity testers for high-dimensional distributions with improved sample complexity.
problem Testing goodness-of-fit for high-dimensional product distributions under differential privacy.
method Developed novel differentially private testers for multivariate product distributions, including Gaussians and binary product distributions.
result Achieved sample complexity matching the minimax sample complexity of O(d1/2/α2) in many parameter regimes. DiGS improves sampling from multi-modal distributions.
problem Inadequate mixing in MCMC methods for multi-modal distributions.
method Integrates diffusion models and Gibbs sampling to create an auxiliary noisy distribution.
result DiGS exhibits better mixing for multi-modal distributions than state-of-the-art methods.
New algorithm clusters multiple samples from hidden distributions.
problem Traditional clustering algorithms cannot handle multiple samples from non-Gaussian distributions.
method Proposes a general framework for multiple sample clustering, generating various algorithms.
result Sufficient statistics improve clustering accuracy and stability.
The paper addresses distribution mismatch in latent space operations of generative models.
problem Distribution mismatch in latent space operations of generative models.
method Distribution matching transport maps to preserve the prior distribution.
result Proposed operations give higher quality samples compared to original operations.
Paper settles sample complexity for learning from multiple distributions.
problem Learning from multiple data distributions with a hypothesis class of bounded VC dimension.
method Introduced an algorithm with sample complexity of O((d+k)ε^-2)·(k/ε)^o(1).
result Algorithm matches lower bound up to sub-polynomial factor.
New method relaxes TV distance for two-sample testing without distributional assumptions.
problem Challenges in certifying equality or providing tight bounds on TV distance for two distributions.
method Examined blurred total variation distance, a relaxation of TV distance.
result Provided theoretical guarantees for upper and lower bounds on blurred TV distance.
Correcting bias in least squares regression with volume-rescaled sampling.
problem Bias in linear least squares solutions without distributional assumptions.
method Volume-rescaled sampling to correct bias in i.i.d. samples.
result Combined sample becomes unbiased with rescaled volume additional sample.
REGS samples from unnormalized distributions using gradient flow and neural networks.
problem Sampling from unnormalized distributions with high accuracy and efficiency.
method REGS is a particle method that iteratively transforms samples from a reference distribution to match an unnormalized target distribution using Wasserstein gradient flow and neural networks.
result REGS outperforms state-of-the-art methods in sampling from challenging multimodal distributions and real datasets.
WOOD detects out-of-distribution samples using Wasserstein distance.
problem Detecting samples from different distributions in neural networks.
method WOOD defines a Wasserstein-distance-based score to evaluate dissimilarity and solves an optimization problem.
result WOOD consistently outperforms other OOD detection methods.
New MCMC method samples from lattice distributions efficiently.
problem Sampling from probability distributions on lattice structures.
method Metropolis-Hastings algorithm with a pull-back measure.
result The method is uniformly ergodic under certain conditions.
PRS improves rejection sampling by learning better proposals.
problem High rejection rate in traditional rejection sampling.
method PRS uses a kernel estimator to learn better sampling proposals.
result PRS guarantees a low number of accepted samples.
Paper proposes neural network for arbitrary noise modeling.
problem Training deep learning algorithms with unknown noise distributions.
method Fully connected neural network to map uniform distribution to any known probability density function, minimizing Jensen-Shannon divergence.
result Model converges to desired noise distribution, providing an efficient alternative to existing sampling methods.
New sampling and identity-testing methods for mixtures of distributions that don't satisfy approximate tensorization of entropy.
problem Sampling and identity-testing for mixtures of distributions that don't satisfy approximate tensorization of entropy.
method Fast mixing of Glauber dynamics and efficient identity-testers in the coordinate-conditional sampling access model.
result Efficient identity-testers for mixtures of ATE distributions in the coordinate-conditional sampling access model.
We provide rigorous guarantees on learning with the weighted trace-norm under arbitrary sampling distributions. We show that the standard weighted trace-norm might fail when the sampling distribution is not a product distribution (i.e. when row and column indexes are not selected independently), present a corrected var…
A new method samples from multi-modal distributions without hyperparameter tuning.
problem Sampling from multi-modal distributions is challenging and requires tuning hyperparameters.
method Learned Reference-based Diffusion Sampler (LRDS) that learns a reference model on high-density regions and uses it to train a diffusion-based sampler.
result LRDS best exploits prior knowledge on multi-modal distributions compared to competing algorithms.
Researchers develop a method to generate diffusion-based samples from a tilted distribution.
problem Generating samples from a distribution that has been tilted by a parameter.
method Developed a plug-in estimator and proved Wasserstein bounds and TV-accuracy under certain conditions.
result The method is minimax-optimal and can be applied in various domains like finance and climate modeling.
New algorithms reduce rejection sampling complexity for shape-constrained distributions.
problem Generating exact samples from shape-constrained distributions efficiently.
method Sublinear query complexity algorithms for rejection sampling.
result Sublinear complexity algorithms for sampling from shape-constrained distributions.
Sampling is an important tool for estimating large, complex sums and integrals over high dimensional spaces. For instance, important sampling has been used as an alternative to exact methods for inference in belief networks. Ideally, we want to have a sampling distribution that provides optimal-variance estimators. In …
New research shows some distributions hard to sample via diffusions.
problem Some distributions hard to sample via diffusions.
method Learning drifts of diffusions to approximate target distributions.
result Superpolynomially close drifts can yield very far approximations.
Improved sampling from Gaussian distributions with privacy constraints.
problem Sampling from unbounded Gaussian distributions with differential privacy.
method First $\widetilde{\mathcal{O}}\left(d
ight)$-sample algorithm for unbounded Gaussians under $\left(\varepsilon, δ
ight)$-differential privacy.
result A quadratic improvement over previous results, settling an open question.
New method tests mixtures of distributions with fewer samples than previously thought.
problem Testing if a distribution is a mixture of known distributions.
method Noise model where the noisy distribution is a mixture of the original and known noise.
result Sample complexity is the same as for non-mixture cases.
Generates confident out-of-distribution samples to improve classifier robustness.
problem Overconfidence in deep learning models on out-of-distribution inputs.
method Uses a GAN to generate out-of-distribution samples that the classifier is confident on, maximizing entropy.
result Shows effectiveness on handwritten characters and natural images datasets.
Langevin Dynamics fails to sample from mixture distributions efficiently.
problem Analyzing Langevin Dynamics for sampling from mixture distributions.
method Theoretical analysis of Langevin Dynamics and proposing Chained-Langevin Dynamics.
result Langevin Dynamics fails to sample from mixture distributions efficiently.
Study examines kurtosis in heavy-tailed symmetric stable distributions.
problem Understanding kurtosis in heavy-tailed symmetric stable distributions.
method Empirical study focusing on symmetric stable distributions, investigating sample kurtosis behavior with sample size and tail index.
result Expected value of excess kurtosis divided by sample size is finite for any tail index, and sample estimate increases linearly with sample size and tail index.
We consider the problem of approximating the set of eigenvalues of the covariance matrix of a multivariate distribution (equivalently, the problem of approximating the "population spectrum"), given access to samples drawn from the distribution. The eigenvalues of the covariance of a distribution contain basic informati…
Paper characterizes sampling distributions of optimal portfolio weights and characteristics.
problem Characterizing sampling distributions of optimal portfolio weights and characteristics.
method Derives exact sampling distribution by stochastic representation.
result High-dimensional asymptotic distribution of optimal portfolio weights is multivariate normal.
Efficiently estimate Boolean product distribution parameters from truncated samples.
problem Estimating parameters of Boolean product distributions from truncated samples.
method Introducing fatness of truncation set, using membership queries, and adapting Stochastic Gradient Descent.
result Efficiently learn Boolean product distributions from truncated samples with small sample complexity.
New method improves Bayesian cross-validation.
problem Finding good proposal distributions for importance sampling.
method Implicitly adaptive importance sampling that iteratively matches moments.
result Better than many existing parametric adaptive importance sampling methods.
This article reviews and explains HMC-based methods for sampling constrained continuous distributions.
problem Sampling from continuous distributions with constraints.
method HMC and related methods for constrained sampling.
result HMC and related methods are more efficient for constrained sampling.
Paper proposes a new method to detect out-of-distribution samples.
problem Detecting out-of-distribution samples for neural network classifiers.
method Generates effective OOD samples using a manifold learning network and trains an additional classifier.
result Proposed method consistently performs better than existing classifiers on MNIST and Fashion-MNIST datasets.
We obtain a tight distribution-specific characterization of the sample complexity of large-margin classification with L_2 regularization: We introduce the γ-adapted-dimension, which is a simple function of the spectrum of a distribution's covariance matrix, and show distribution-specific upper and lower bounds on the s…
An infinite parallel tempering bouncy particle sampler improves sampling efficiency for multimodal distributions.
problem Sampling from complex posterior distributions with high accuracy and efficiency.
method Introduced an infinite parallel tempering bouncy particle sampler (BPS-PT) to accelerate convergence.
result Demonstrated improved sampling efficiency for multimodal distributions through numerical simulations.
Develops asymptotic analysis for RandNLA sampling estimators in least-squares problems.
problem Lack of distributional information for RandNLA estimators in statistical inference.
method Asymptotic analysis of sampling estimators for least-squares problems in two settings.
result Sampling estimators are asymptotically normally distributed under mild conditions.
EntProp increases entropy of clean samples to generate out-of-distribution data for better DNN performance.
problem Improving deep neural networks' accuracy and robustness to out-of-distribution data.
method High entropy propagation using data augmentation and free adversarial training.
result EntProp achieves higher standard accuracy and robustness with lower training cost.
FAB combines flows with AIS to approximate complex distributions.
problem Challenges in flow-based methods, especially on complex targets.
method Combines flows with AIS, using α-divergence for training.
result FAB produces accurate approximations to complex distributions.
Private distribution learning with public data, leveraging sample compression schemes.
problem Private distribution learning with public and private samples under differential privacy constraints.
method Connection to sample compression schemes and list learning.
result At least d public samples are necessary for private learnability of Gaussians in R^d.
Paper proposes a distributed sampling method for Bayesian inference.
problem Privacy and communication constraints in spatially distributed datasets.
method Alternating Direction Method of Multipliers for distributed sampling.
result Algorithm converges to target distribution in Wasserstein distance.
A new method for conditional sampling using paired Wasserstein Autoencoders.
problem Conditional sampling from complex data distributions.
method Derive a novel loss function for Wasserstein Autoencoders to enable sampling from OT-type couplings.
result Learned cost-optimal transport maps and conditional sampling from an OT-type coupling.