Proposes a new framework for open set recognition using conditional probabilistic generative models.
problem Unknown samples can mislead traditional deep neural networks during testing.
method Conditional Probabilistic Generative Models (CPGM) that combine generative models with discriminative information.
result Significantly outperforms baselines on multiple benchmark datasets.
Optimistic Thompson Sampling reduces regret in unknown multi-player games.
problem Navigating uncertainty in unknown multi-player games with strategic decision-making.
method Introduces Thompson Sampling algorithms that exploit opponents' actions and reward structures.
result Achieves over tenfold improvements in experimental budgets with logarithmic regret bound.
RTSCV detects unknown unknowns to improve model performance.
problem Model deficiency due to incomplete training data.
method Random Test Sampling and Cross-Validation (RTSCV) framework.
result Reduces performance gap by up to 41%.
Develops robust MDPs for unknown disturbances with performance guarantees.
problem Unknown disturbance distribution in MDPs.
method Empirical distribution, sublevel set of distance function, weak convergence, concentration inequality.
result Robust optimal value function converges to true optimal value function with increasing sample sizes.
CGDL improves open set recognition by learning conditional Gaussian distributions.
problem Handling unknown samples in real-world recognition tasks.
method Conditional Gaussian Distribution Learning (CGDL) with probabilistic ladder architecture.
result CGDL significantly outperforms baseline methods on standard image datasets.
An evolutionary algorithm separates mixed DNA profiles in forensic genetics.
problem Deconvolving mixed DNA profiles from crime samples.
method Multiple population evolutionary algorithm (MEA) with guided mutation.
result The MEA successfully deconvoluted DNA profiles from crime samples.
Thompson sampling used for linear bandits with normal-gamma priors.
problem Optimizing decisions in uncertain environments with linear dependencies and unknown parameters.
method Bayesian Thompson sampling with multivariate normal-gamma priors.
result Derivation of a Bayesian regret bound for the approach.
OpenViewer tackles multi-view learning challenges with interpretability and generalization.
problem Lack of interpretability and insufficient generalization in multi-view learning models.
method OpenViewer introduces a Pseudo-Unknown Sample Generation Mechanism, Expression-Enhanced Deep Unfolding Network, and Perception-Augmented Open-Set Training Regime.
result OpenViewer effectively addresses openness challenges and enhances recognition performance for both known and unknown samples.
Paper tackles unknown variances in best-arm identification.
problem Identifying the best arm with unknown variances in Gaussian distributions.
method Two approaches: empirical variance plugging or adapting transportation costs.
result The impact of unknown variances is small on sample complexity.
We study the problem of estimating the parameters of a Gaussian distribution when samples are only shown if they fall in some (unknown) subset S⊆Rd. This core problem in truncated statistics has long history going back to Galton, Lee, Pearson and Fisher. Recent work by Daskalakis et al. (FOCS'18), provide…
RLFA estimates misstated monetary fraction with weighted sampling without replacement.
problem Estimating misstated monetary fraction with given accuracy and confidence.
method Developed new confidence sequences for weighted average of unknown values using randomized weighted sampling and side information.
result Adaptive methods improve accuracy of estimates based on side information's predictive power.
Bayesian method synthesizes barrier certificates for unknown systems with latent states.
problem Certifying safety in systems with unknown dynamics and latent states.
method Bayesian inference with Metropolis-Hastings sampler and sum-of-squares program.
result Probabilistic validity of barrier certificates for unknown systems.
New method splits unknown covariance Gaussians into independent parts.
problem Splitting multivariate Gaussian data with unknown covariance.
method Developed a general algorithm for decomposing unknown covariance Gaussians.
result Demonstrated decomposition for single multivariate Gaussian with unknown covariance.
Generative adversarial networks sample unknown high-dimensional conditional distributions.
problem Sampling from unknown high-dimensional conditional distributions with limited data.
method Generative adversarial networks (GAN) for both sampling and distribution inference.
result GAN effectively samples target conditional distribution with minimal impact on sample quality.
Paper tackles open set domain adaptation by detecting unknown classes.
problem Adapting to target domains with unknown classes when label spaces partially overlap.
method Instance-level reweighting strategy combined with Extreme Value Theory for unknown class detection.
result Proposed method outperforms state-of-the-art models on conventional datasets.
GP-MRO discovers robust mixed strategies for unknown objectives.
problem Optimizing unknown objectives against worst-case uncertain parameters.
method Sequential learning from noisy point evaluations, combining online learning and Gaussian processes.
result GP-MRO finds robust mixed strategies that significantly improve performance over deterministic strategies.
We develop asymptotically optimal policies for the multi armed bandit (MAB), problem, under a cost constraint. This model is applicable in situations where each sample (or activation) from a population (bandit) incurs a known bandit dependent cost. Successive samples from each population are iid random variables with u…
Kernel smoothing on unknown manifolds with bounds and asymptotic normality.
problem Data on unknown manifolds without boundaries.
method Finite sample bounds and asymptotic normality for kernel smoothing and its derivatives.
result Established finite sample bounds and asymptotic normality for kernel smoothing.
Study approximates unknown function levels with queries.
problem Approximating unknown function levels through sequential queries.
method Introduce Bisect and Approximate algorithms to reduce to local function approximation.
result Rate-optimal sample complexity guarantees for H{ö}lder functions.
New algorithms estimate parameters of Gaussian and non-Gaussian distributions from truncated samples.
problem Estimating distributional parameters from truncated samples.
method Polynomial time algorithms for exponential families and simple sets.
result Efficient algorithms for estimating parameters of various distributions from truncated samples.
Generative model improves sample quality on ImageNet32.
problem Improving sample quality in generative models.
method Iterative Gaussian posterior inference, treating generated sample as unknown variable.
result Improves sample quality on ImageNet32 over BFNs and VDMs.
MetaTS learns to explore better by meta-learning prior from bandit instances.
problem Efficient exploration in bandit problems.
method MetaThompson Sampling (MetaTS) that meta-learns the prior from bandit instances.
result MetaTS quickly adapts to unknown prior and achieves better exploration.
Consider the problem of sampling sequentially from a finite number of N≥2 populations, specified by random variables Xki, i=1,…,N, and k=1,2,…; where Xki denotes the outcome from population i the kth time it is sampled. It is assumed that for each fixed i, $\{ X^i_k \}_{k …
New algorithm clusters Gaussian mixtures with unknown covariance efficiently.
problem Clustering data from a mixture of Gaussians with unknown covariance.
method Developed an efficient spectral algorithm based on a Max-Cut integer program.
result Achieves optimal misclassification rate with quadratic sample size.
Often, when dealing with real-world recognition problems, we do not need, and often cannot have, knowledge of the entire set of possible classes that might appear during operational testing. In such cases, we need to think of robust classification methods able to deal with the "unknown" and properly reject samples belo…
Study optimizes sampling to avoid extreme tail risks in unknown heavy-tailed distributions.
problem Identify optimal alternative with minimal extreme tail risk from unknown heavy-tailed distributions.
method Data-driven sequential sampling policies to maximize likelihood of selecting the optimal alternative.
result Proposed methods outperform existing approaches in identifying the optimal alternative.
Paper introduces method to estimate animal motion on unknown submanifolds using Koopman operator.
problem Estimating animal motion on unknown submanifolds in high-dimensional space.
method Data-dependent approximation of Koopman operator in RKHS over ambient space.
result Strong rates of convergence derived for estimates in terms of fill distance.
Over the past decades, researchers and ML practitioners have come up with better and better ways to build, understand and improve the quality of ML models, but mostly under the key assumption that the training data is distributed identically to the testing data. In many real-world applications, however, some potential …
In this paper, we consider matrix completion from non-uniformly sampled entries including fully observed and partially observed columns. Specifically, we assume that a small number of columns are randomly selected and fully observed, and each remaining column is partially observed with uniform sampling. To recover the …
New Thompson Sampling for partially observed context bandits reduces regret logarithmically with time.
problem Improving Thompson Sampling for partially observed context bandits.
method Proposed a Thompson Sampling algorithm for partially observable contextual multi-armed bandits with theoretical performance guarantees.
result Regret scales logarithmically with time and the number of arms, and linearly with the dimension.
New algorithms learn graphons in GMFGs without knowing them.
problem Learning graphons in Graphon Mean-Field Games with unknown graphons.
method Proximal Policy Optimization for GMFG (GMFG-PPO) and kernel embedding methods for estimating graphons.
result The proposed algorithms reduce exploitability when learning unknown graphons.
We exhibit an efficient procedure for testing, based on a single long state sequence, whether an unknown Markov chain is identical to or ε-far from a given reference chain. We obtain nearly matching (up to logarithmic factors) upper and lower sample complexity bounds for our notion of distance, which is bas…
This work extends Ledoit-Wolf shrinkage to unknown mean covariance estimation.
problem Large dimensional covariance matrix estimation with unknown mean under Kolmogorov asymptotics.
method Extending Ledoit-Wolf linear shrinkage to translation-invariant estimators, proving their convergence properties.
result A new estimator outperforms other standard estimators empirically.
ASE safely explores unknown MDPs with unknown dynamics, improving sample efficiency.
problem Balancing exploration and safety in unknown MDPs with stochastic dynamics.
method Exploits analogies between state-action pairs to safely learn near-optimal policies.
result Empirically improves sample efficiency compared to existing methods.
This work learns exploration policies for unknown distributions using samples and policy gradients.
problem Learning exploration policies for unknown distributions in Bayesian bandits.
method Meta-learning approach parameterizing policies in a differentiable way and optimizing them with policy gradients.
result Effective gradient estimators and variance reduction techniques are derived.
We address the problem of maximizing an unknown submodular function that can only be accessed via noisy evaluations. Our work is motivated by the task of summarizing content, e.g., image collections, by leveraging users' feedback in form of clicks or ratings. For summarization tasks with the goal of maximizing coverage…
We study the quantification of uncertainty of Convolutional Neural Networks (CNNs) based on gradient metrics. Unlike the classical softmax entropy, such metrics gather information from all layers of the CNN. We show for the EMNIST digits data set that for several such metrics we achieve the same meta classification acc…
New method predicts sets under unknown covariate shift with high confidence.
problem Adapting to unknown covariate shift in prediction sets.
method PredSet-1Step, a flexible distribution-free method.
result Achieves asymptotic probably approximately correct coverage.
We study the problem of learning an unknown mixture of k rankings over n elements, given access to noisy samples drawn from the unknown mixture. We consider a range of different noise models, including natural variants of the "heat kernel" noise framework and the Mallows model. For each of these noise models we giv…
Markowitz' celebrated optimal portfolio theory generally fails to deliver out-of-sample diversification. In this note, we propose a new portfolio construction strategy based on symmetry arguments only, leading to "Eigenrisk Parity" portfolios that achieve equal realized risk on all the principal components of the covar…
The problem of estimating an unknown discrete distribution from its samples is a fundamental tenet of statistical learning. Over the past decade, it attracted significant research effort and has been solved for a variety of divergence measures. Surprisingly, an equally important problem, estimating an unknown Markov ch…
For many important problems the quantity of interest is an unknown function of the parameters, which is a random vector with known statistics. Since the dependence of the output on this random vector is unknown, the challenge is to identify its statistics, using the minimum number of function evaluations. This problem …
Transferring knowledge across a sequence of reinforcement-learning tasks is challenging, and has a number of important applications. Though there is encouraging empirical evidence that transfer can improve performance in subsequent reinforcement-learning tasks, there has been very little theoretical analysis. In this p…
Sharp inequalities for matrix means with unknown variance.
problem Estimating matrix means with unknown variance.
method Empirical Bernstein inequalities for symmetric random matrices.
result Adapts to unknown variance with tight deviation bounds.
Algorithm estimates common mean from Gaussian variables with unknown variances.
problem Estimating common mean from Gaussian variables with different unknown variances.
method Intuitive and efficient algorithm using Subset-of-Signals model as benchmark.
result Improved estimation error by polynomial factors compared to previous work.
Consider a noisy linear observation model with an unknown permutation, based on observing y=Π∗Ax∗+w, where x∗∈Rd is an unknown vector, Π∗ is an unknown n×n permutation matrix, and w∈Rn is additive Gaussian noise. We analyze the problem of permutation recovery in a …
This paper addresses the problem of identifying a lower dimensional space where observed data can be sparsely represented. This under-complete dictionary learning task can be formulated as a blind separation problem of sparse sources linearly mixed with an unknown orthogonal mixing matrix. This issue is formulated in a…
New adaptive test for NPIV models controls size and has superior power.
problem Testing inequality and equality restrictions in nonparametric IV models.
method Adaptive hypothesis test based on modified leave-one-out sample quadratic distance.
result Adaptive test attains the adaptive minimax rate of testing in L2.