Study proper sampling for X-ray transforms on simple surfaces.
problem Proper discretizing and sampling issues related to geodesic X-ray transforms on simple surfaces.
method Provide minimal sampling rates for faithful reconstruction, quantify sampling quality, and predict artifacts.
result Minimal sampling rates and artifact prediction for geodesic X-ray transforms on simple surfaces.
Paper resolves open problems on sample complexity in binary hypothesis testing.
problem Open problems in distributed simple binary hypothesis testing under information constraints.
method One-shot lower bound on Bayes error, streamlined sample complexity formula, reverse data-processing inequality.
result Optimally tight sample complexity bounds for communication-constrained simple binary hypothesis testing.
A simple algorithm for Gaussian mean testing with optimal sample complexity.
problem Distinguishing between standard Gaussian and other Gaussian distributions with unknown mean and covariance.
method An extremely simple algorithm with a one-page analysis.
result Optimal sample complexity of Θ(√d/ε^2) with sample linear time.
A streamlined DRL algorithm improves sample efficiency without entropy maximization.
problem Improving sample efficiency in off-policy DRL algorithms.
method Output normalization and non-uniform sampling.
result Proposed algorithm matches SAC's performance without entropy maximization and improves sample efficiency.
SPCA improves PCA by learning from simple to complex samples.
problem Noise and outliers in complex data.
method Self-paced Principal Component Analysis (SPCA) that integrates samples from simple to more complex.
result SPCA improves state-of-the-art results on popular datasets.
Generative models map simple samples to complex target samples.
problem Improving Monte-Carlo sampling techniques.
method Variational learning of dynamical maps between base and target measures.
result Improved sampling efficiency through feedback loops.
SURF simplifies distribution estimation with simple, robust, and fast algorithms.
problem Efficient and accurate distribution estimation in statistics and machine learning.
method Piecewise polynomial approximation using empirical probability interpolation and divide-and-conquer merging.
result Surpassing state-of-the-art algorithms in efficiency and accuracy, SURF estimates distributions robustly and quickly.
Study hypothesis testing under quantized samples with communication constraints, achieving near-optimal sample complexity.
problem Optimizing hypothesis testing with quantized samples and communication constraints.
method Developed a polynomial-time algorithm achieving near-optimal sample complexity under communication constraints.
result Achieved near-optimal sample complexity under communication constraints, with a logarithmic factor increase over unconstrained setting.
This paper reviews various sampling methods from statistics and machine learning.
problem Addressing sampling methods in statistics and machine learning.
method Explains and reviews simple random sampling, bootstrapping, stratified sampling, cluster sampling, multistage sampling, network sampling, snowball sampling, and sampling from cumulative distribution function.
result Summarizes characteristics, pros, and cons of different sampling methods.
A simple method improves batch active learning without high compute.
problem Efficient batch active learning in machine learning.
method Adapting standard single-point acquisition strategies to batch.
result Simple strategy performs as well as advanced batch methods.
A new MLSS model approximates high-order Markov chains efficiently.
problem Efficiently approximating high-order Markov chains.
method Decaying mixture over past states, simple sampling algorithm.
result Approximates high-order Markov chains with fixed time and memory costs.
Diffusion models learn simple statistics before complex ones, revealing a sample complexity exponent.
problem Understanding the learning dynamics of diffusion models.
method Empirical observations and theoretical analysis of diffusion models and denoisers.
result Diffusion models learn simple statistics (pair-wise correlations) at linear sample complexity, while higher-order statistics (e.g., fourth cumulant) require cubic sample complexity.
A theorem for debiasing machine learning with finite sample guarantees.
problem Calculating confidence intervals for machine learning functionals.
method Debiased machine learning based on bias correction and sample splitting.
result Nonasymptotic debiased machine learning theorem with finite sample guarantees.
Optimistic NPG improves policy optimization in online RL with efficient sample complexity.
problem Limited theoretical understanding of policy optimization, especially in online RL.
method Combines natural policy gradient with optimistic policy evaluation.
result Achieves optimal dimension dependence sample complexity for learning near-optimal policies.
A simple modification improves GAN performance by discarding bad samples.
problem Improving GAN performance with minimal computational cost.
method Top-k update procedure: zero out gradient contributions from least realistic elements.
result Significant improvement in FID score for conditional generation on CIFAR-10.
Paper proposes a diagnostic tool for evaluating model performance out-of-sample.
problem Evaluating model performance on unseen data.
method Uses a finite calibration dataset to assess future losses.
result Provides guarantees under weak assumptions and quantifies distribution shifts.
This work proposes sample complexity bounds for Q-learning with random exploration.
problem Understanding the sample efficiency of simple exploration strategies in reinforcement learning.
method Problem-specific sample complexity bounds for Q-learning with random walk exploration.
result Proposes bounds that relate to empirical performance in benchmark domains.
Improved predictive posterior density estimation through optimized importance sampling.
problem Low signal-to-noise ratio in posterior predictive densities.
method Optimized importance sampling using a test-time variational proxy.
result Significantly improved estimates of predictive posterior densities.
Simple private estimators for mean and covariance outperform existing methods.
problem Private estimation of mean and covariance at small sample sizes.
method Differentially private estimators for multivariate sub-Gaussian data.
result Asymptotic error rates match theoretical bounds and outperform previous methods.
Optimal private tests for simple hypotheses are characterized.
problem Private testing of simple hypotheses under differential privacy constraints.
method Characterization of sample complexity and optimal tests using log-likelihood ratio tests.
result Optimal sample complexity achieved by a specific randomized and clamped variant of the log-likelihood ratio test.
A new method interpolates between sampling and variational inference using stochastic mixtures.
problem Combining the strengths of sampling and variational inference methods.
method Develops a framework using stochastic mixtures of simple component distributions to interpolate between sampling and variational inference.
result Improves on both sampling and variational inference methods by reducing bias and variance.
Improved forecasting for irregularly-sampled time series using kernel flows.
problem Forecasting dynamical systems from irregularly-sampled time series data.
method Directly approximating the vector field using time differences in data-adapted kernels.
result Significant improvement in forecasting accuracy compared to classical methods.
The model is aimed to discriminate the 'good' and the 'bad' companies in Russian corporate sector based on their financial statements data based on Russian Accounting Standards. The data sample consists of 126 Russian public companies- issuers of Ruble bonds which represent about 36% of total number of corporate bonds …
Random sampling has become a critical tool in solving massive matrix problems. For linear regression, a small, manageable set of data rows can be randomly selected to approximate a tall, skinny data matrix, improving processing time significantly. For theoretical performance guarantees, each row must be sampled with pr…
Simple algorithm samples graph nodes efficiently.
problem Sampling representative nodes from large graphs efficiently.
method Minimum inner product greedy selection rule, column-selective sampling.
result Achieves sampling proportional to cluster size, error decays with inter-cluster connectivity.
Thompson sampling has emerged as an effective heuristic for a broad range of online decision problems. In its basic form, the algorithm requires computing and sampling from a posterior distribution over models, which is tractable only for simple special cases. This paper develops ensemble sampling, which aims to approx…
Aims to optimize goal sampling in deep reinforcement learning.
problem The sampling of goals affects deep reinforcement learning performance.
method Curriculum goal masking method to focus on medium difficulty goals.
result Focusing on medium difficulty goals leads to better learning performance.
Study optimizes best-arm identification with minimax and Bayes strategies.
problem Efficiently identifying the best arm in fixed-budget scenarios.
method Adaptive procedure with two stages: pilot phase and minimax game.
result Single strategy is asymptotically minimax and Bayes optimal.
Paper proposes a method to break symmetries in Bayesian matrix factorization.
problem Symmetries in posterior distribution reduce MCMC sampling efficiency.
method Modification to Gaussian prior mean and covariance to break symmetries.
result Breaking symmetries leads to lower autocorrelation and reconstruction errors.
A new SGD variant chooses the sample with lowest loss to make the model more robust to outliers.
problem Outliers can skew the parameters of machine learning models trained via SGD.
method Choose a set of k samples, then select the one with the smallest current loss for update.
result The new method makes SGD more robust for ML problems that are sums of convex losses.
The paper proposes a method to discount backtest PnLs due to in-sample overfitting.
problem In-sample overfitting in backtest-based investment strategies.
method A simple framework to model and quantify in-sample PnL overfitting.
result Computes the appropriate discount factor for PnLs of in-sample investment strategies.
A new algorithm approximates logistic regression probabilities efficiently.
problem Efficiently approximating probabilities in logistic regression for large datasets.
method Randomized sampling-based algorithm with leverage scores.
result Accurate approximations to estimated probabilities with smaller sample sizes.
We introduce a simple method for nearly simultaneous computation of all moments needed for quasi maximum likelihood estimation of parameters in discretely observed stochastic differential equations commonly seen in finance. The method proposed in this papers is not restricted to any particular dynamics of the different…
GANs improve event generation in physics experiments.
problem Improving statistical precision in event generation.
method Used generative adversarial networks (GANs) to generate events.
result GANs amplify the statistical precision of the training sample.
DPP-BBO diversifies batched Bayesian optimization using DPPs.
problem Efficiently proposing diverse and informative batches in batched Bayesian optimization.
method Introducing DPP-Batch Bayesian Optimization (DPP-BBO) with DPP-Thompson Sampling (DPP-TS).
result Novel Bayesian simple regret bounds for DPP-TS show improved performance over classical methods.
This article studies the achievable guarantees on the error rates of certain learning algorithms, with particular focus on refining logarithmic factors. Many of the results are based on a general technique for obtaining bounds on the error rates of sample-consistent classifiers with monotonic error regions, in the real…
Proposes a new semi-supervised learning method to reduce distribution mismatch.
problem Empirical distribution mismatch between labeled and unlabeled data in semi-supervised learning.
method Adversarial training and interpolation strategy to align labeled and unlabeled data distributions.
result Demonstrates improved performance on benchmark datasets SVHN and CIFAR10.
Study binary hypothesis testing with privacy and communication constraints.
problem Binary hypothesis testing under local differential privacy and communication constraints.
method Qualifies results as minimax or instance optimal, develops instance-optimal algorithms.
result Achieves minimum possible sample complexity under both privacy and communication constraints.
P3O merges on-policy and off-policy updates without extra hyper-parameters.
problem Combining on-policy and off-policy RL algorithms to reduce sample complexity.
method Interleaves off-policy updates with on-policy updates using effective sample size.
result P3O reduces sample complexity of state-of-the-art algorithms.
Develops a new sampling method for gauge theories.
problem Sampling from SU(N) gauge theories. method Gauge-equivariant flows for SU(N) variables. result Constructs a class of flows respecting matrix conjugation symmetry.
New characterization limits sampling with inexact scores.
problem Limiting sampling with inexact scores for unbiased results.
method Characterized types of inexact score oracle access.
result Weaker error assumptions rule out tractability of unbiased sampling.
A simple method treats heteroscedastic variance variatively, improving model calibration and sample quality.
problem Brittle optimization impacts model likelihoods for mean and variance estimation.
method Proposes a variational approach to heteroscedastic variance, improving predictive mean and variance calibration.
result The proposed method significantly improves parameter calibration and sample quality for regression and VAEs.
A simple regularization technique speeds up training of Neural ODEs.
problem Training Neural ODEs is computationally expensive.
method Randomly sampling the end time of the ODE during training.
result Significantly decreases training time and improves performance.
Importance sampling is widely used in machine learning and statistics, but its power is limited by the restriction of using simple proposals for which the importance weights can be tractably calculated. We address this problem by studying black-box importance sampling methods that calculate importance weights for sampl…
WSD uses a deterministic model to accelerate diffusion-based sampling.
problem Slow refinement process in diffusion models.
method Warm-start model that predicts an informed prior conditioned on input context.
result Significantly reduces the number of diffusion steps required for realistic samples.
Combines BC and GAIL for efficient imitation learning.
problem Efficient imitation learning without reward signals.
method Integrates Behavior Cloning and Generative Adversarial Imitation Learning.
result Combination leads to stable and sample-efficient learning.
We propose a general semi-supervised inference framework focused on the estimation of the population mean. As usual in semi-supervised settings, there exists an unlabeled sample of covariate vectors and a labeled sample consisting of covariate vectors along with real-valued responses ("labels"). Otherwise, the formulat…
New method identifies wrongly predicted samples for active learning.
problem Identifying important samples for machine learning models.
method A sample selection criterion based on model prediction and its effect on generalization error.
result State-of-the-art results and better rates at identifying wrongly predicted samples.