New bounds found for minimum tests needed in group testing.
problem Determining the minimum number of tests to detect defective items.
method Analyzing non-adaptive randomized algorithms for various group testing models.
result Tight bounds for the minimum number of tests and their limits.
Optimizes group testing for COVID-19 to reduce test numbers.
problem Minimizing tests for accurate infection detection.
method Bayesian approach with genetic algorithms and sub-modularity.
result Greedy-adaptive method provides theoretical guarantees.
New method infers viral load from pooled tests.
problem Inefficient viral load inference in pooled testing.
method Message passing algorithm with PCR noise function.
result Accurate viral load inference possible.
Optimal testing algorithm for matrix rank with improved query complexity.
problem Testing if a matrix has rank at most d or requires changing ε-fraction of entries to achieve rank at most d.
method Non-adaptive query algorithm selecting a pattern of entries in rows and columns.
result Improves query complexity to O(d^2/ε) from O(d^2/ε^2), bypassing lower bound.
Study learns random hypergraphs with queries, improving on previous results.
problem Learn random hypergraphs with non-adaptive queries.
method Equivalence to group testing, using Erdős-Rényi model for graphs.
result Generalization to random k-uniform hypergraphs. Improves target data performance of adaptive classifiers.
problem Adaptive classifiers perform poorly on target data due to distribution shift.
method Constructs robust discriminant analysis estimators.
result Robust discriminant analysis outperforms non-adaptive classifiers on target data.
Adaptive sampling results in dramatic improvements in the recovery of sparse signals in white Gaussian noise. A sequential adaptive sampling-and-refinement procedure called Distilled Sensing (DS) is proposed and analyzed. DS is a form of multi-stage experimental design and testing. Because of the adaptive nature of the…
This paper proposes a simple adaptive sensing and group testing algorithm for sparse signal recovery. The algorithm, termed Compressive Adaptive Sense and Search (CASS), is shown to be near-optimal in that it succeeds at the lowest possible signal-to-noise-ratio (SNR) levels, improving on previous work in adaptive comp…
New algorithm solves stochastic optimization problems with unknown gradients.
problem Solving nonlinear optimization problems with stochastic objectives and deterministic constraints.
method Adaptive SQP with differentiable exact augmented Lagrangian and stochastic line search.
result Global convergence established for both non-adaptive and adaptive SQP methods.
We consider the problem of group testing with sum observations and noiseless answers, in which we aim to locate multiple objects by querying the number of objects in each of a sequence of chosen sets. We study a probabilistic setting with entropy loss, in which we assume a joint Bayesian prior density on the locations …
The study analyzes group testing algorithms for identifying defective items with high confidence.
problem Identifying defective items from a population using group testing with high confidence.
method Formulated as a function learning problem using the PAC framework, analyzed three algorithms: column matching, combinatorial basis pursuit, and definite defectives.
result Derived bounds on the number of tests needed for approximate set identification, comparing with existing bounds and simulating performance.
New study shows non-adaptive trials can be outperformed by adaptive designs in treatment selection.
problem Determining the best allocation of resources in clinical trials.
method Analysis of batched arm elimination designs and comparison with completely randomized trials.
result Simple adaptive designs universally and strictly dominate non-adaptive completely randomized trials for at least three treatment arms.
Sublinear algorithms detect cliques in graphs with high probability.
problem Detecting a planted clique in random graphs efficiently.
method Non-adaptive low-degree polynomial queries of adjacency matrix entries.
result Sublinear time detection is possible for a specific range of clique sizes.
New protocols show 1-bit mean estimation can be order-optimal without interaction.
problem Can 1-bit mean estimation be optimal without interaction?
method Adaptive and non-adaptive threshold and interval queries, with one adaptive transition.
result Arbitrary non-adaptive quantizers can match the adaptive rate, suggesting interaction is not necessary.
Study shows rates for Laplacian-eigenmap methods in nonparametric regression.
problem Minimizing error in nonparametric regression using Laplacian-eigenmap.
method Adaptive and non-adaptive minimax rates using Sobolev space constraints.
result Extends minimax rates to various weighted Laplacian matrices.
This paper studies the sample complexity of searching over multiple populations. We consider a large number of populations, each corresponding to either distribution P0 or P1. The goal of the search problem studied here is to find one population corresponding to distribution P1 with as few samples as possible. The main…
Reward-poisoning attacks can force RL agents to learn bad policies, and we categorize and quantify their feasibility.
problem Reward-poisoning attacks can manipulate RL agents to learn undesirable policies.
method Categorize attacks by infinity-norm constraint, provide thresholds for feasibility, and develop adaptive attack strategies.
result Adaptive reward-poisoning attacks can achieve the nefarious policy in polynomial steps, while non-adaptive attacks require exponential steps.
New adaptive test for NPIV models controls size and has superior power.
problem Testing inequality and equality restrictions in nonparametric IV models.
method Adaptive hypothesis test based on modified leave-one-out sample quadratic distance.
result Adaptive test attains the adaptive minimax rate of testing in L2. Efficiently test and learn causal Bayesian networks with interventions and samples.
problem Testing and learning causal Bayesian networks with interventions and samples.
method Interventions and samples to distinguish causal Bayesian networks, with algorithms for testing and learning.
result Efficient algorithms for testing and learning causal Bayesian networks, with subadditivity inequality for squared Hellinger distance.
New algorithm reduces interventional strategy complexity for causal graph discovery.
problem Designing efficient interventional strategies for causal graph discovery.
method Developed an r-adaptive algorithm for causal graph discovery that minimizes the number of interventions.
result Achieved an approximation of O(min{r, log n} * n^{1/min{r, log n}}) for the verification number.
Adaptive algorithm for online evaluation of targeted audiences in advertising.
problem Determining the right match between advertising creatives and target audiences.
method Contextual bandit approach to address audience overlap and learn optimal display policies.
result The proposed method is more efficient than traditional split-testing methods.
New algorithms learn MNL weights efficiently for any slate size.
problem Efficiently learn weights for MNL models given query access.
method Two algorithms: adaptive and non-adaptive, with specific query complexities.
result Optimal query complexities for both adaptive and non-adaptive cases.
We study the problem of sampling k-bandlimited signals on graphs. We propose two sampling strategies that consist in selecting a small subset of nodes at random. The first strategy is non-adaptive, i.e., independent of the graph structure, and its performance depends on a parameter called the graph coherence. On the co…
Recent breakthrough results in compressive sensing (CS) have established that many high dimensional signals can be accurately recovered from a relatively small number of non-adaptive linear observations, provided that the signals possess a sparse representation in some basis. Subsequent efforts have shown that the perf…
Bayesian filtering unifies adaptive and non-adaptive neural network optimization methods.
problem Optimizing neural networks using standard methods like Adam and RMSprop.
method Formulated as Bayesian filtering, accounting for temporal dynamics of all parameters.
result Recover Adam and AdamW optimizers with competitive generalization performance.
Active inference uses machine learning to prioritize data labeling for more efficient statistical inference.
problem Efficiently collecting data points for statistical inference with limited labels.
method A machine learning-assisted approach that identifies uncertain data points for labeling.
result Achieves the same level of accuracy with fewer samples, resulting in smaller confidence intervals and more powerful p-values.
Adaptive networks improve model robustness through conditional normalization.
problem Limited robustness of adversarial-trained networks due to network capacity and training samples.
method Proposes a conditional normalization module to adapt networks during adversarial training.
result Adaptive networks outperform both clean validation accuracy and robustness compared to non-adaptive counterparts.
Proposes natural analyst models for more optimistic data analysis bounds.
problem Pessimistic generalization guarantees in adaptive data analysis.
method Modeling analyst knowledge as evolving dynamical system, defining recency and anchoring biases.
result Smooth interpolation between non-adaptive and adaptive bounds, capturing standard optimization methods.
Adaptive methods produce less robust models to adversarial examples.
problem Robustness of machine learning models to adversarial examples.
method Comparison of adaptive and non-adaptive optimization methods in linear regression.
result Non-adaptive methods consistently produce more robust models.
Algorithm estimates principal eigenvector with adaptive sensing, improving over non-adaptive methods.
problem Estimating principal eigenvector with limited scalar measurements.
method Compressed variant of Oja's algorithm using two adaptive measurements per sample.
result Convergence rate of O(λ1λ2d2/(Δ2t)) after t iterations, matching information-theoretic lower bound. Optimal experiment design reduces unknown structure in fixed experiments.
problem Learning causal structure from limited experiments.
method Characterizes optimal learning strategy, designs experiments efficiently.
result Proposed algorithm is ρ-approximation for bounded degree graphs.
New findings on complexity limits in fixed budget bandit identification.
problem Determining the best possible error rate for fixed budget bandit identification.
method Analyzing the best non-adaptive sampling procedures and showing the existence of complexities.
result No fixed complexity for certain bandit identification tasks.
New defense method inspired by encryption improves visual classification accuracy.
problem Conventional defenses reduce accuracy and are defeated by obfuscated gradients.
method Block-wise pixel shuffling with secret key for training and test images.
result Achieves high accuracy (91.55%) on clean images and (89.66%) on adversarial examples.
New method for group testing robust to errors in group membership specifications.
problem Errors in specifying group memberships during group testing.
method Debiased Robust Lasso Test Method (DRLT) based on Lasso debiasing.
result Extends LASSO bias mitigation to handle group membership specification errors.
This study explains how different training methods affect the minimizer of neural networks.
problem How training methods influence the minimizer of neural networks.
method Explains how initialization size, adaptive optimization (AdaGrad), and stochastic mini-batch training affect the minimizer.
result Different training methods lead to different minimizers, even in overparameterized networks.
We study the problem of finding the most mutually correlated arms among many arms. We show that adaptive arms sampling strategies can have significant advantages over the non-adaptive uniform sampling strategy. Our proposed algorithms rely on a novel correlation estimator. The use of this accurate estimator allows us t…
Develops a robust classifier for domain adaptation without relying on restrictive assumptions.
problem Robustness of domain-adaptive classifiers in general domain adaptation settings.
method Formulates a conservative parameter estimator that guarantees lower risk for all possible target labelings.
result Classical least-squares and discriminant analysis cases perform on par with state-of-the-art classifiers in sample selection bias settings and outperform them in general domain adaptation settings.
AdaGrad-Norm achieves optimal convergence rates for non-convex objectives without tuning.
problem Optimal convergence rates for non-convex, smooth objectives with adaptive step sizes.
method Adaptive SGD (AdaGrad-Norm) with self-tuning step sizes, analyzing under unbounded gradients and affine variance scaling.
result AdaGrad-Norm achieves order optimal convergence rate of $\mathcal{O}\left(\frac{\mathrm{poly}\log(T)}{\sqrt{T}}
ight)$ under optimal assumptions.
Paper optimizes clustering with bandit feedback, reducing errors.
problem Online clustering with bandit feedback, minimizing errors.
method Instance-dependent information-theoretic lower bound, BOC algorithm with adaptive stopping rule.
result BOC algorithm matches lower bound asymptotically and significantly outperforms non-adaptive baseline.
Improved generalization with iterate averaging and adaptive algorithms.
problem Enhancing model generalization performance in high-dimensional settings.
method Gaussian process perturbation model, combine IA with large learning rates and regularisation, less frequent averaging, adaptive gradient methods.
result Iterate averaging with adaptive algorithms significantly outperforms SGD on various datasets.
Sampling from distributions to find the one with the largest mean arises in a broad range of applications, and it can be mathematically modeled as a multi-armed bandit problem in which each distribution is associated with an arm. This paper studies the sample complexity of identifying the best arm (largest mean) in a m…
New algorithms improve online prediction from experts with privacy constraints.
problem Online prediction from experts under privacy constraints.
method Proposed and analyzed new algorithms for approximate and pure differential privacy.
result Achieved improved regret bounds for various adversaries.
Solves risk-aware optimal switching problems in discrete time.
problem Non-Markovian optimal switching problems with risk awareness and general filtration.
method Solves reflected backward stochastic difference equations.
result Existence and uniqueness of solutions for the problems.
Paper tackles adaptive deletion of data points from trained models.
problem Adaptive deletion of data points from trained models.
method Reduction from adaptive to non-adaptive deletion guarantees using differential privacy and max information.
result Strong provable deletion guarantees for adaptive deletion sequences.
Algorithms learn and test variable partitions in various groups and error metrics.
problem Learning and testing variable partitions in different groups and error metrics.
method Algorithms for agnostically learning and testing k-partitionability over various groups and error metrics. result Learning algorithms for k-partitionability with polynomial time complexity and testing with adaptive queries. Adaptive market-making strategy improves profit by adjusting to order flow.
problem Optimizing market-making profits in a dynamic market environment.
method Closed-form solutions for optimal bid-ask spreads, modeling demand randomness, and adapting to market order behavior.
result Adaptive strategies outperform fixed and non-adaptive strategies.
Adaptive methods optimize machine learning training faster.
problem Non-adaptive stochastic optimization requires tuning for each application.
method Develop adaptive stochastic optimization methods.
result Adaptive methods offer computational savings for large-scale systems.
We break dimension dependence in sparse distribution estimation with communication constraints.
problem Estimating sparse distributions with limited communication.
method Novel localization schemes and tree-based estimation.
result Achieve dimension-free convergence rate independent of dimension d.