Bayesian Attention Networks compress data by focusing on key training samples.
problem Lossless data compression for efficiency.
method Bayesian Attention Networks with attention factors and latent space.
result Efficient prediction using a few correlated training samples.
Adjoint sampler targets infinite-dimensional function spaces for efficient sampling.
problem Limited theory and algorithms for sampling infinite-dimensional function spaces.
method Adjoint Sampler for infinite-dimensional function spaces based on stochastic maximum principle.
result FAS achieves superior performance in synthetic and real systems.
Article proves conditions for sample mean existence in DTW spaces.
problem Proving existence of sample mean in DTW spaces.
method Presented sufficient conditions for the existence of a sample mean.
result Justifies prior work and sets stage for exact mean algorithms.
New RL method reduces sample complexity for large policy spaces.
problem Large-scale RL with unknown optimal policies and state/action spaces.
method Introduces eluder dimension for policy space, proving near-optimal sample complexity.
result Near-optimal sample complexity upper bound that depends linearly on eluder dimension.
Optimizes biomolecular simulations by ranking adaptive sampling policies.
problem Efficiently sampling biomolecular systems to capture complex dynamical behaviors.
method Metric-driven ranking of adaptive sampling policies to identify the optimal policy for each round.
result Different adaptive sampling policies lead to faster convergence and improved sampling performance.
Solves open problems in graph spaces for sample mean, proposing a new algorithm.
problem Properties of sample mean in graph spaces are unclear or non-existent.
method Proposes conditions and a MMM-Algorithm to resolve six open problems.
result MMM-Algorithm best approximates graph sample mean.
The paper addresses distribution mismatch in latent space operations of generative models.
problem Distribution mismatch in latent space operations of generative models.
method Distribution matching transport maps to preserve the prior distribution.
result Proposed operations give higher quality samples compared to original operations.
Neural network accuracy improves with denser training samples.
problem Improving neural network accuracy on unseen test samples.
method Bounding empirical training error smoothed across activation regions and using it to discard high-risk test samples.
result Discarding high-risk test samples based on error bounds improves prediction accuracy by up to 20%.
New method optimizes MRI sampling patterns for faster scans.
problem Accelerate MRI scans without sacrificing image quality.
method Joint learning of adaptive sampling patterns and model-based recovery.
result Improved MR image quality compared to other methods.
Active sampling improves design space exploration for analog circuits.
problem Efficiently exploring the space of design features in analog circuits with many parameters.
method Combining drastic dimension reduction with sensitivity analysis and Bayesian surrogate modeling for active sampling.
result The proposed active sampling flow outperforms traditional Monte-Carlo sampling.
Flow Annealing Posterior Sampling unifies stochastic-process regression and PDE inverse problems.
problem Function-space posterior sampling for stochastic processes and inverse problems.
method Flow Annealing Posterior Sampling (FAPS) using pretrained function-space flow-matching priors.
result Coherent posterior samples with accurate uncertainty quantification.
FIS-GAN uses importance sampling in GANs to speed up training.
problem Efficiency in GAN training by focusing on hard-to-generate examples.
method Adapting importance sampling into GANs using normalizing flows.
result Significant acceleration in GAN optimization with improved fidelity.
Novel q-space abnormalities detected without labels.
problem Detecting unseen abnormalities in MRI scans.
method Training VAEs on normal data to identify abnormal samples in latent and output spaces.
result Many methods outperform existing q-space novelty detection techniques.
New method recovers matrix column space with active sampling for better results.
problem Recovering column space of partially observed matrices with limited data.
method Alternating minimization with active sampling strategy.
result Active sampling improves convergence to true column space with higher probability.
Improves sample quality of generative models using energy-based methods.
problem Low sample quality in generative models.
method Constructs an energy function on latent space, trains an energy-based model, and generates improved samples.
result Significant improvement in sample quality with minimal computational overhead.
Estimates barycenter in geodesic spaces with finite sample bounds.
problem Estimating the barycenter of a distribution in geodesic spaces.
method Finite sample error bounds, Hoeffding- and Bernstein-type concentration inequalities, efficient algorithms.
result Statistical guarantees for efficient barycenter computation.
Efficiently samples posterior distributions using Langevin dynamics.
problem Challenges in generating diverse posterior samples in high-dimensional spaces.
method Simulates Langevin dynamics in the noise space of a pre-trained generative model.
result Noise-space Langevin dynamics approximates the posterior without restarting the full sampling chain.
O3 optimizes samples from generative models without extra training.
problem Optimizing specific criteria within rich data distributions.
method Surrogate latent spaces for efficient black-box optimisation.
result Surrogate-space optimisation finds higher-scoring samples.
Extended elliptical slice sampling for infinite-dimensional spaces, proving reversibility.
problem Proving reversibility of elliptical slice sampling in infinite-dimensional spaces.
method Extended elliptical slice sampling to infinite-dimensional separable Hilbert spaces, providing an alternative proof of reversibility.
result The approach yields a positive semi-definite Markov operator, proving reversibility.
Discrete diffusion samplers improve sampling from unnormalised densities.
problem Sampling from discrete unnormalised densities efficiently.
method Introduce off-policy training techniques and data-to-energy Schrödinger bridge training for discrete diffusion samplers.
result Improved performance on synthetic and new benchmarks.
The paper extends Thompson Sampling to infinite action spaces using information theory.
problem Addressing the limitation of finite action spaces in Thompson Sampling.
method Information-theoretic analysis, extending rate-distortion theory to infinite action spaces.
result Derives a near-optimal regret bound for bandits with infinite and continuous action spaces.
Paper connects sampling and labeling biases in large-output spaces.
problem Efficient training in large-output spaces with label imbalance.
method Unified approach to address sampling and labeling biases.
result Different negative sampling schemes trade-off performance on dominant and rare labels.
Paper proposes a neural network for learning better importance sampling.
problem Improving variance reduction in Monte Carlo rendering.
method Uses a neural network to learn desired densities in the primary sample space of a rendering algorithm.
result Effective variance reduction demonstrated in practical scenarios.
The paper improves Stein importance sampling for Markov chain samples.
problem Improving the accuracy of sampling from complex distributions.
method Reproducing Stein kernels approach for post-hoc correction.
result Consistent estimators for target distributions using geometrically ergodic Markov chains.
Adaptive sampling method optimizes DNN compression for resource-constrained platforms.
problem Efficiently compressing DNNs for resource-constrained platforms with high accuracy.
method Adaptive sampling using genetic algorithm-inspired operations to optimize hyperparameters.
result Adaptive sampling outperforms rule-based and reinforcement learning methods in compression rate and accuracy.
This paper tackles sampling issues in latent space EBMs by introducing diffusion-based amortization.
problem Degenerate MCMC sampling quality hinders latent space EBM learning and generation quality.
method Introduces diffusion-based amortization for long-run MCMC sampling.
result The learned amortization of MCMC is a valid long-run MCMC sampler.
This work improves sampling efficiency on complex spaces using determinantal processes.
problem Efficient sampling from large-scale datasets with general spaces.
method Determinantal point processes on general spaces and diffusion geometry.
result Improved sampling rates for determinantal processes on Riemannian manifolds and networks.
Paper proposes a structured approach to improve active learning performance.
problem Improving active learning performance in non-linear feature spaces.
method Approximates version space to a structured hypersphere, divides AL sampling into outer and inner volumes, and uses sequential optimization to globally optimize the kernel space.
result Proves guarantees for AL performance in version space and proposes a new algorithm called Volume-based AL (VAL).
Several approximate policy iteration schemes without value functions, which focus on policy representation using classifiers and address policy learning as a supervised learning problem, have been proposed recently. Finding good policies with such methods requires not only an appropriate classifier, but also reliable e…
This work uses sampling theory to analyze smoothness and error bounds of finite neural networks.
problem Analyzing the function space of finite neural networks and providing error bounds.
method Applying sampling theory to finite neural networks with non-expansive activation functions, considering both deterministic and random sampling.
result Novel error bounds for univariate neural networks under band-limited input assumption, highlighting the advantage of deterministic uniform sampling.
P-Net predicts patient outcomes using sample networks.
problem Predicting patient outcomes based on sample data.
method P-Net constructs a network of patients, ranking and classifying them based on phenotype.
result P-Net performs similarly to classical methods in predicting patient outcomes.
New method speeds up Gibbs sampling for large graphs.
problem Efficiently sampling from large graphical models.
method Poisson-minibatching Gibbs sampling.
result Theoretical convergence rate guarantees for Poisson-minibatching Gibbs.
Paper proposes a method to improve MCMC sampling for energy-based models.
problem MCMC sampling of energy-based models is often not mixing in high-dimensional data.
method Proposes using a flow-based model as a backbone to correct the energy-based model, enabling mixing in latent space.
result MCMC sampling of the corrected EBM in the latent space mixes well and traverses modes in the data space.
We extend diffusion models to function spaces and introduce a new method for sampling from posterior distributions.
problem Sampling from posterior distributions in infinite-dimensional function spaces using diffusion models.
method Infinite-dimensional extension of Doob's h-transform, Supervised Guidance Training for efficient sampling. result We prove that diffusion models can be conditioned to sample from posterior distributions and introduce a simulation-free score matching objective.
Novelty search in low-dimensional space improves sample efficiency in exploration tasks.
problem Efficient exploration in complex environments with sparse rewards.
method Combines model-based and model-free objectives to learn a low-dimensional representation. Uses intrinsic novelty rewards based on nearest neighbor distances in this space.
result Our approach achieves more sample-efficient exploration compared to strong baselines on various tasks.
A new method speeds up sampling in diffusion models.
problem Slow sample generation in diffusion models.
method Proposed Splitting Integrators for fast stochastic sampling.
result Achieved FID score of 2.36 in 100 NFE, significantly faster than baselines.
This paper introduces a new method for sampling copulas using GANs and space-filling designs.
problem Lack of feasible inference and sampling methods for copulas in high-dimensional situations.
method Generative adversarial networks (GANs) and space-filling designs.
result Significantly enhances sampling accuracy and computational efficiency compared to existing methods.
Study on how sampling works for complex data functions.
problem Analyzing convergence of sampling algorithms for RKHS functions.
method Minimalistic assumptions on kernel and data, error estimates in RKHS norm, uniform convergence on compact domains.
result New convergence rates for Lipschitz and Hölder continuous kernels.
EDLP samples flat modes in discrete spaces using entropy.
problem Sampling flat modes in discrete spaces is challenging.
method EDLP uses a continuous auxiliary variable and local entropy to guide sampling.
result EDLP consistently outperforms traditional methods in various tasks.
Generative Latent Implicit Conditional Optimization (GLICO) learns from small samples.
problem Learning from small labeled datasets.
method Generative Latent Implicit Conditional Optimization (GLICO) learns a latent space and generator from small labeled data.
result GLICO synthesizes new samples for every class using as few as 10 examples per class.
Study of classification in asymmetric quasi-metric spaces.
problem Classification in asymmetric quasi-metric spaces.
method Sample compression and nearest neighbor algorithm.
result Algorithm has favorable statistical properties.
ESMM models CVR over entire space, overcoming sample selection bias and data sparsity.
problem Sample selection bias and data sparsity in CVR modeling.
method Entire Space Multi-task Model (ESMM) using sequential pattern of user actions.
result ESMM significantly outperforms competitive methods on Taobao dataset.
New RL method reduces sample complexity for large state-action spaces.
problem Handling large state-action spaces in RL with general Q-functions.
method Nonparametric Q-learning using kernel ridge regression.
result Sample complexity is order optimal with respect to ε and kernel complexity.
We consider the related tasks of matrix completion and matrix approximation from missing data and propose adaptive sampling procedures for both problems. We show that adaptive sampling allows one to eliminate standard incoherence assumptions on the matrix row space that are necessary for passive sampling procedures. Fo…
Improved bounds for function approximation in nonlinear sets.
problem Achieving high probability error with limited samples in nonlinear function approximation.
method Restricting model class to a neighbourhood of the best approximation and estimating sample complexity using tangent and normal spaces' complexities and curvature.
result Improved worst-case bounds for sample complexity in more general sets like tensor networks and neural networks.
Enhances labels from unlabeled data using sample correlations.
problem Lack of label distributions in real-world applications.
method Proposes LESC and gLESC methods to enhance label distributions.
result Improves performance of label enhancement through sample correlations.
Shielded LMC samples from non-convex spaces with repulsive drift.
problem Sampling from non-convex spaces with convex holes.
method Combining adaptive temperature and repulsive drift.
result Advantages over unconstrained sampling in constrained spaces.
This paper optimizes sampling for least-squares approximation.
problem Optimizing sampling for least-squares approximation in arbitrary linear spaces.
method Introducing the Christoffel function to construct near-optimal random sampling strategies.
result The number of samples scales log-linearly in the dimension of the approximation space.