arXiv research

The study proves sampling-based GNNs can approximate training on full graphs with small subgraphs.

Improves generalization with few samples using a new regularization method.

Neural Architecture Search (NAS) has shown great potentials in finding better neural network designs. Sample-based NAS is the most reliable approach which aims at exploring the search space and evaluating the most promising architectures. However, it is computationally very costly. As a remedy, the one-shot approach ha…

Differentiable learning via SGD and GD can simulate various learning problems, depending on precision and minibatch size.

Bayesian model-based reinforcement learning is a formally elegant approach to learning optimal behaviour under model uncertainty, trading off exploration and exploitation in an ideal way. Unfortunately, finding the resulting Bayes-optimal policies is notoriously taxing, since the search space becomes enormous. In this …

New method for Bayesian neural networks reduces inference difficulty.

A scalable method for Bayesian inference in large linear models.

Motion planning for robots of high degrees-of-freedom (DOFs) is an important problem in robotics with sampling-based methods in configuration space C as one popular solution. Recently, machine learning methods have been introduced into sampling-based motion planning methods, which train a classifier to distinguish coll…

This paper presents sampling-based speech parameter generation using moment-matching networks for Deep Neural Network (DNN)-based speech synthesis. Although people never produce exactly the same speech even if we try to express the same linguistic and para-linguistic information, typical statistical speech synthesis pr…

Posterior sampling-based EI achieves sublinear regret bounds for expensive function optimization.

Domain adaptation has become a prominent problem setting in machine learning and related fields. This review asks the question: how can a classifier learn from a source domain and generalize to a target domain? We present a categorization of approaches, divided into, what we refer to as, sample-based, feature-based and…

PS4POMDPs algorithm simplifies online learning for episodic POMDPs with unknown models.

To meet the standard of differential privacy, noise is usually added into the original data, which inevitably deteriorates the predicting performance of subsequent learning algorithms. In this paper, motivated by the success of improving predicting performance by ensemble learning, we propose to enhance privacy-preserv…

New method learns graph structure and uncertainty from data.

Given a data matrix $X \in R^{n\times d}$ and a response vector $y \in R^{n}$, suppose $n>d$, it costs $O(n d^2)$ time and $O(n d)$ space to solve the least squares regression (LSR) problem. When $n$ and $d$ are both large, exactly solving the LSR problem is very expensive. When $n \gg d$, one feasible approach to spee…

Deep unfolding accelerates MCMC-based COP solvers.

Distributional reinforcement learning (DRL) is a recent reinforcement learning framework whose success has been supported by various empirical studies. It relies on the key idea of replacing the expected return with the return distribution, which captures the intrinsic randomness of the long term rewards. Most of the e…

DGFS improves sampling from complex densities by optimizing partial trajectories.

Improves generative models for cost-sensitive decisions.

Graph Convolutional Networks (GCNs) are powerful models for learning representations of attributed graphs. To scale GCNs to large graphs, state-of-the-art methods use various layer sampling techniques to alleviate the "neighbor explosion" problem during minibatch training. We propose GraphSAINT, a graph sampling based …

Purpose: Machine learning is broadly used for clinical data analysis. Before training a model, a machine learning algorithm must be selected. Also, the values of one or more model parameters termed hyper-parameters must be set. Selecting algorithms and hyper-parameter values requires advanced machine learning knowledge…

Quantum algorithm improves portfolio construction accuracy.

Efficiently certifies global robustness of large neural networks with probabilistic guarantees.

Paper proposes robust methods for estimating optimal treatment rules with censored survival data.

Paper proposes first unlearning algorithm for MCMC models.

Bounded rationality investigates utility-optimizing decision-makers with limited information-processing power. In particular, information theoretic bounded rationality models formalize resource constraints abstractly in terms of relative Shannon information, namely the Kullback-Leibler Divergence between the agents' pr…

Neural solver computes Wasserstein geodesics and velocity fields efficiently.

We study primal-dual type stochastic optimization algorithms with non-uniform sampling. Our main theoretical contribution in this paper is to present a convergence analysis of Stochastic Primal Dual Coordinate (SPDC) Method with arbitrary sampling. Based on this theoretical framework, we propose Optimality Violation-ba…

We present an embedding of stochastic optimal control problems, of the so called path integral form, into reproducing kernel Hilbert spaces. Using consistent, sample based estimates of the embedding leads to a model free, non-parametric approach for calculation of an approximate solution to the control problem. This fo…

Evaluating generative adversarial networks (GANs) is inherently challenging. In this paper, we revisit several representative sample-based evaluation metrics for GANs, and address the problem of how to evaluate the evaluation metrics. We start with a few necessary conditions for metrics to produce meaningful scores, su…

HH-VAEM improves imputation and acquisition of missing data using hierarchical models and Hamiltonian Monte Carlo.

This work compares and evaluates various sampling methods for neural language models.

New algorithm learns principal subspace from random samples.

Improved Thompson Sampling algorithms for bandits with tighter regret bounds.

A new method improves SVI for high-dimensional, poorly-conditioned distributions.

MPPN network improves long-term time series forecasting accuracy.

We study the problem of finding the optimal dosage in early stage clinical trials through the multi-armed bandit lens. We advocate the use of the Thompson Sampling principle, a flexible algorithm that can accommodate different types of monotonicity assumptions on the toxicity and efficacy of the doses. For the simplest…

New method for efficient marginalization of discrete latent variables in neural networks.

The paper connects machine learning interpretability with learning theory.

Learning in restricted Boltzmann machine is typically hard due to the computation of gradients of log-likelihood function. To describe the network state statistics of the restricted Boltzmann machine, we develop an advanced mean field theory based on the Bethe approximation. Our theory provides an efficient message pas…

Distributional approaches to value-based reinforcement learning model the entire distribution of returns, rather than just their expected values, and have recently been shown to yield state-of-the-art empirical performance. This was demonstrated by the recently proposed C51 algorithm, based on categorical distributiona…

Low-rank matrix approximations are often used to help scale standard machine learning algorithms to large-scale problems. Recently, matrix coherence has been used to characterize the ability to extract global information from a subset of matrix entries in the context of these low-rank approximations and other sampling-…

MIRA scores assess conditional distribution accuracy using joint samples.

Thompson Sampling tackles USS, a sequential selection problem without feedback.

DPOT uses deep learning to compute optimal transport efficiently.

Efficient clustering for large datasets using a sampling-based approach.

Method quantifies sensitivity of reliability analysis to uncertainty sources.

Efficient algorithm finds fast Transformer models.