arXiv research

We optimize rank-based metrics using blackbox differentiation.

Method uses neural networks to solve combinatorial problems.

Optimizes neural networks with blackbox solvers using Time-cost Regularization.

CoNES optimizes blackbox functions using convex optimization and information geometry.

New method improves blackbox attack transferability by perturbing feature hierarchy.

We present a new algorithm ASEBO for optimizing high-dimensional blackbox functions. ASEBO adapts to the geometry of the function and learns optimal sets of sensing directions, which are used to probe it, on-the-fly. It addresses the exploration-exploitation trade-off of blackbox optimization with expensive blackbox qu…

Private learning of Gaussian Mixture Models without boundedness assumptions.

End-to-end trainable graph matching using improved combinatorial solvers.

Proposes a query-efficient blackbox attack method.

Novel method for scalable neural network-based blackbox optimization.

The paper explores methods to explain decisions of deep learning models by faithfully reproducing their training data views.

EGORSE optimizes high-dimensional problems using random and supervised embeddings.

Open-source Vizier optimizes complex systems for Google and beyond.

PyXAB is a Python library for X-armed bandits and online optimization.

ControlSHAP stabilizes Shapley value approximations using control variates.

InterpretML is an open-source Python package which exposes machine learning interpretability algorithms to practitioners and researchers. InterpretML exposes two types of interpretability - glassbox models, which are machine learning models designed for interpretability (ex: linear models, rule lists, generalized addit…

Improved stability and generalization for blackbox learned optimizers.

New auditors assess $f$-DP privacy with adaptive sampling, avoiding large sample sizes.

No free lunch theorems show all algorithms perform equally under uniform distribution.

Interest in derivative-free optimization (DFO) and "evolutionary strategies" (ES) has recently surged in the Reinforcement Learning (RL) community, with growing evidence that they can match state of the art methods for policy optimization problems in Robotics. However, it is well known that DFO methods suffer from proh…

Despite advances in scalable models, the inference tools used for Gaussian processes (GPs) have yet to fully capitalize on developments in computing hardware. We present an efficient and general approach to GP inference based on Blackbox Matrix-Matrix multiplication (BBMM). BBMM inference uses a modified batched versio…

Adversarial perturbations fool deepfake detectors with high accuracy.

We tackle the blackbox issue of deep neural networks in the settings of reinforcement learning (RL) where neural agents learn towards maximizing reward gains in an uncontrollable way. Such learning approach is risky when the interacting environment includes an expanse of state space because it is then almost impossible…

CALLISTO generates tests and assesses ML data quality using prediction entropy.

IETNet identifies important channels for MVTS classification.

Counterfactual post-hoc interpretability approaches have been proven to be useful tools to generate explanations for the predictions of a trained blackbox classifier. However, the assumptions they make about the data and the classifier make them unreliable in many contexts. In this paper, we discuss three desirable pro…

Unified framework for realizable and agnostic learning.

Imputation-Powered Inference improves subpopulation efficiency in missing data settings.

New method tests tree models without causing computational pressure.

SureMap estimates model performance across subpopulations efficiently.

Distributional reinforcement learning (distributional RL) has seen empirical success in complex Markov Decision Processes (MDPs) in the setting of nonlinear function approximation. However, there are many different ways in which one can leverage the distributional approach to reinforcement learning. In this paper, we p…

Recent developments have established the vulnerability of deep reinforcement learning to policy manipulation attacks via intentionally perturbed inputs, known as adversarial examples. In this work, we propose a technique for mitigation of such attacks based on addition of noise to the parameter space of deep reinforcem…

New method tracks shifts in infinite-armed bandits without prior knowledge.

As convolutional neural networks (CNNs) enable state-of-the-art computer vision applications, their high energy consumption has emerged as a key impediment to their deployment on embedded and mobile devices. Towards efficient image classification under hardware constraints, prior work has proposed adaptive CNNs, i.e., …

The ability to interpret machine learning models has become increasingly important now that machine learning is used to inform consequential decisions. We propose an approach called model extraction for interpreting complex, blackbox models. Our approach approximates the complex model using a much more interpretable mo…

Evolution Strategies (ES) are a powerful class of blackbox optimization techniques that recently became a competitive alternative to state-of-the-art policy gradient (PG) algorithms for reinforcement learning (RL). We propose a new method for improving accuracy of the ES algorithms, that as opposed to recent approaches…

We propose a new class of structured methods for Monte Carlo (MC) sampling, called DPPMC, designed for high-dimensional nonisotropic distributions where samples are correlated to reduce the variance of the estimator via determinantal point processes. We successfully apply DPPMCs to problems involving nonisotropic distr…

We present an information-theoretic framework for sequential adaptive compressed sensing, Info-Greedy Sensing, where measurements are chosen to maximize the extracted information conditioned on the previous measurements. We show that the widely used bisection approach is Info-Greedy for a family of $k$-sparse signals b…

GPEX interprets deep neural networks without strict assumptions.

The rapid digital transformation without security considerations has resulted in the rise of global-scale cyberattacks. The first line of defense against these attacks are Network Intrusion Detection Systems (NIDS). Once deployed, however, these systems work as blackboxes with a high rate of false positives with no mea…

Joint state and parameter estimation is a core problem for dynamic Bayesian networks. Although modern probabilistic inference toolkits make it relatively easy to specify large and practically relevant probabilistic models, the silver bullet---an efficient and general online inference algorithm for such problems---remai…

New adversarial attack method based on deep feature distributions.

Bayesian optimization (BO) aims to minimize a given blackbox function using a model that is updated whenever new evidence about the function becomes available. Here, we address the problem of BO under partially right-censored response data, where in some evaluations we only obtain a lower bound on the function value. T…

BO method improved by density-ratio estimation for better efficiency and scalability.

We study the problem of inverse reinforcement learning (IRL) with the added twist that the learner is assisted by a helpful teacher. More formally, we tackle the following algorithmic question: How could a teacher provide an informative sequence of demonstrations to an IRL learner to speed up the learning process? We p…

Solving for adversarial examples with projected gradient descent has been demonstrated to be highly effective in fooling the neural network based classifiers. However, in the black-box setting, the attacker is limited only to the query access to the network and solving for a successful adversarial example becomes much …

AutoAIViz visualizes AutoAI's model generation process, improving user trust.

Automates design of lightweight neural networks for image classification.