arXiv research

Memory-efficient learning for large-scale imaging systems.

This work aims to create a large-scale model for critical care time series data.

Proposes MamBO for efficient high-dimensional large-scale optimization.

Introduces resemblance structure for large scale geometry.

Efficient knockoffs for large-scale feature selection.

Paper proposes PPMM for fast estimation of large-scale OTM.

DistPre predicts traffic speeds efficiently for large networks.

We propose a practical and scalable Gaussian process model for large-scale nonlinear probabilistic regression. Our mixture-of-experts model is conceptually simple and hierarchically recombines computations for an overall approximation of a full Gaussian process. Closed-form and distributed computations allow for effici…

Adaptive regularization prevents overfitting in large-scale sparse feature models.

A new TwinGP framework for efficient large-scale GP modeling.

Randomized spectral co-clustering speeds up large-scale directed networks.

This paper analyzes convergence of large-scale Transformers with weight decay.

Real time large scale streaming data pose major challenges to forecasting, in particular defying the presence of human experts to perform the corresponding analysis. We present here a class of models and methods used to develop an automated, scalable and versatile system for large scale forecasting oriented towards saf…

In order to scale standard Gaussian process (GP) regression to large-scale datasets, aggregation models employ factorized training process and then combine predictions from distributed experts. The state-of-the-art aggregation models, however, either provide inconsistent predictions or require time-consuming aggregatio…

MixKD improves large-scale language model compression and generalization.

BayesDLL offers a PyTorch library for Bayesian deep learning with large models.

New method adds interactions to interpretable models for large-scale data.

Method analyzes large-scale network data to detect communication pattern shifts.

Online method learns sparse models efficiently in large scale settings.

New method estimates bidirectional causal effects in large-scale systems.

We study the concept of coarse disjointness and large scale $n$-to-$1$ functions. As a byproduct, we obtain an Ostrand-type characterization of asymptotic dimension for coarse structures. It is shown that properties like finite asymptotic dimension, coarse finitism, large scale weak paracompactness, ect. are all invari…

Large scale online kernel learning aims to build an efficient and scalable kernel-based predictive model incrementally from a sequence of potentially infinite data points. A current key approach focuses on ways to produce an approximate finite-dimensional feature map, assuming that the kernel used has a feature map wit…

Deep neural networks provide meaningful uncertainty estimates for large-scale simulations.

Recently, pre-trained language representation flourishes as the mainstay of the natural language understanding community, e.g., BERT. These pre-trained language representations can create state-of-the-art results on a wide range of downstream tasks. Along with continuous significant performance improvement, the size an…

New algorithms estimate Jacobian matrices for large-scale machine learning.

The motivation for this paper is to apply Bayesian structure learning using Model Averaging in large-scale networks. Currently, Bayesian model averaging algorithm is applicable to networks with only tens of variables, restrained by its super-exponential complexity. We present a novel framework, called LSBN(Large-Scale …

FaStR improves scalability for time-aware RS with varying coefficients.

For large scale on-line inference problems the update strategy is critical for performance. We derive an adaptive scan Gibbs sampler that optimizes the update frequency by selecting an optimum mini-batch size. We demonstrate performance of our adaptive batch-size Gibbs sampler by comparing it against the collapsed Gibb…

Efficiently solves large-scale robust portfolio optimization problems.

FibeRed reduces complex data dimensions while preserving topology.

In this paper, we apply a mini-batch based negative sampling method to efficiently train a latent factor autoencoder model on large scale and sparse data for implicit feedback collaborative filtering. We compare our work against a state-of-the-art baseline model on different experimental datasets and show that this met…

CTR prediction in real-world business is a difficult machine learning problem with large scale nonlinear sparse data. In this paper, we introduce an industrial strength solution with model named Large Scale Piece-wise Linear Model (LS-PLM). We formulate the learning problem with $L_1$ and $L_{2,1}$ regularizers, leadin…

Large-scale Hierarchical Classification (HC) involves datasets consisting of thousands of classes and millions of training instances with high-dimensional features posing several big data challenges. Feature selection that aims to select the subset of discriminant features is an effective strategy to deal with large-sc…

We present Distributed Equivalent Substitution (DES) training, a novel distributed training framework for large-scale recommender systems with dynamic sparse features. DES introduces fully synchronous training to large-scale recommendation system for the first time by reducing communication, thus making the training of…

This paper surveys large-scale machine learning methods for efficient data analysis.

New method infers causal factors from large-scale data without full graph reconstruction.

Transformers learn to predict chess moves with surprising accuracy and strength.

Augments graph node features to improve GNN performance.

Natural image statistics exhibit hierarchical dependencies across multiple scales. Representing such prior knowledge in non-factorial latent tree models can boost performance of image denoising, inpainting, deconvolution or reconstruction substantially, beyond standard factorial "sparse" methodology. We derive a large …

Large-scale Gaussian process inference has long faced practical challenges due to time and space complexity that is superlinear in dataset size. While sparse variational Gaussian process models are capable of learning from large-scale data, standard strategies for sparsifying the model can prevent the approximation of …

Efficiently trains deep Gaussian processes on large datasets.

A plethora of multi-view subspace clustering (MVSC) methods have been proposed over the past few years. Researchers manage to boost clustering accuracy from different points of view. However, many state-of-the-art MVSC algorithms, typically have a quadratic or even cubic complexity, are inefficient and inherently diffi…

We consider the problem of personalization of online services from the viewpoint of ad targeting, where we seek to find the best ad categories to be shown to each user, resulting in improved user experience and increased advertisers' revenue. We propose to address this problem as a task of ranking the ad categories dep…

New method uses tensor decompositions to overcome the curse of dimensionality for large-scale learning.

Paper presents an efficient algorithm for learning minimax risk classifiers with large-scale data.

Let M be a compact manifold. We show the identity component $\mathrm{Homeo}_0(M)$ of the group of self-homeomorphisms of M has a well-defined quasi-isometry type, and study its large scale geometry. Through examples, we relate this large scale geometry to both the topology of M and the dynamics of group actions on M. T…

We propose a nonparametric approach to link prediction in large-scale dynamic networks. Our model uses graph-based features of pairs of nodes as well as those of their local neighborhoods to predict whether those nodes will be linked at each time step. The model allows for different types of evolution in different part…

Drawing a sample from a discrete distribution is one of the building components for Monte Carlo methods. Like other sampling algorithms, discrete sampling suffers from the high computational burden in large-scale inference problems. We study the problem of sampling a discrete random variable with a high degree of depen…