arXiv research

Bayesian optimization for long-term outcomes using fast and slow experiments.

FAST optimizes additive segmentation for faster, more interpretable models.

T-Rex selector selects variables fast and controls FDR in high-dimensional data.

In this paper we describe a new algorithm called Fast Adaptive Sequencing Technique (FAST) for maximizing a monotone submodular function under a cardinality constraint $k$ whose approximation ratio is arbitrarily close to $1-1/e$, is $O(\log(n) \log^2(\log k))$ adaptive, and uses a total of $O(n \log\log(k))$ queries. …

This paper proposes an incremental solution to Fast Subclass Discriminant Analysis (fastSDA). We present an exact and an approximate linear solution, along with an approximate kernelized variant. Extensive experiments on eight image datasets with different incremental batch sizes show the superiority of the proposed ap…

Paper explores fast adversarial training to improve robustness with less computation.

A fast method for LOOCV in k-NN regression reduces computation time.

CLASSIX is a fast and explainable clustering method that sorts data and merges groups.

Paper presents a fast algorithm for pricing Bermudan swaptions under the two-factor Hull-White model.

A fast method for Lasso and Logistic Lasso problems.

Purpose: To investigate the feasibility of myelin water content quantification using fast dual-echo steady-state (DESS) scans and machine learning with kernels. Methods: We optimized combinations of steady-state (SS) scans for precisely estimating the fast-relaxing signal fraction ff of a two-compartment signal model, …

Enhash detects concept drift in data streams quickly and efficiently.

Symmetric nonnegative matrix factorization (NMF), a special but important class of the general NMF, is demonstrated to be useful for data analysis and in particular for various clustering tasks. Unfortunately, designing fast algorithms for Symmetric NMF is not as easy as for the nonsymmetric counterpart, the latter adm…

A fast method learns plasma collision kernels from simulations, improving kinetic models.

FSNet improves online time series forecasting by balancing fast adaptation and old knowledge.

In this paper we propose a fast online Kernel SVM algorithm under tight budget constraints. We propose to split the input space using LVQ and train a Kernel SVM in each cluster. To allow for online training, we propose to limit the size of the support vector set of each cluster using different strategies. We show in th…

How to train a machine learning model while keeping the data private and secure? We present CodedPrivateML, a fast and scalable approach to this critical problem. CodedPrivateML keeps both the data and the model information-theoretically private, while allowing efficient parallelization of training across distributed w…

A fast algorithm for counting Markov equivalent DAGs and designing experiments.

Efficient CF approach using fast adaptive PCA for recommender systems.

The implementation of conventional sparse principal component analysis (SPCA) on high-dimensional data sets has become a time consuming work. In this paper, a series of subspace projections are constructed efficiently by using Household QR factorization. With the aid of these subspace projections, a fast deflation meth…

User and item features of side information are crucial for accurate recommendation. However, the large number of feature dimensions, e.g., usually larger than 10^7, results in expensive storage and computational cost. This prohibits fast recommendation especially on mobile applications where the computational resource …

In this work, we revisit fast dimension reduction approaches, as with random projections and random sampling. Our goal is to summarize the data to decrease computational costs and memory footprint of subsequent analysis. Such dimension reduction can be very efficient when the signals of interest have a strong structure…

A fast algorithm selects best subsets in high-dimensional models.

Meta-learning bounds derived using PAC-Bayes theory for improved generalization.

This work learns effective dynamics from short-term data of stochastic systems.

Develops a privacy-preserving algorithm for sparse robust regression.

This work develops scalable model selection methods with fast update and selection.

This paper speeds up Gaussian process regression for autocorrelated data.

Fastest video anomaly detection via teacher-student distillation.

Ensemble method for fast portfolio valuation and risk management.

Canonical Correlation Analysis (CCA) is a widely used statistical tool with both well established theory and favorable performance for a wide range of machine learning problems. However, computing CCA for huge datasets can be very slow since it involves implementing QR decomposition or singular value decomposition of h…

A new imputation method MissARF uses adversarial random forests for fast and accurate missing value imputation.

Graph Neural Networks (GNNs) have become a topic of intense research recently due to their powerful capability in high-dimensional classification and regression tasks for graph-structured data. However, as GNNs typically define the graph convolution by the orthonormal basis for the graph Laplacian, they suffer from hig…

We present a logarithmic-scale efficient convolutional neural network architecture for edge devices, named WaveletNet. Our model is based on the well-known depthwise convolution, and on two new layers, which we introduce in this work: a wavelet convolution and a depthwise fast wavelet transform. By breaking the symmetr…

FAWMF adapts weights for implicit feedback recommendation efficiently.

Regression is an important task in machine learning and data mining. It has several applications in various domains, including finance, biomedical, and computer vision. Recently, network Lasso, which estimates local models by making clusters using the network information, was proposed and its superior performance was d…

Quantized Variational Inference improves ELBO optimization with fast convergence.

Many real world problems can now be effectively solved using supervised machine learning. A major roadblock is often the lack of an adequate quantity of labeled data for training. A possible solution is to assign the task of labeling data to a crowd, and then infer the true label using aggregation methods. A well-known…

Fast and accurate methods for low-rank learning problems.

Efficient index structures for fast approximate nearest neighbor queries are required in many applications such as recommendation systems. In high-dimensional spaces, many conventional methods suffer from excessive usage of memory and slow response times. We propose a method where multiple random projection trees are c…

Paper speeds up Gaussian process inference using Matérn kernels.

When applied to training deep neural networks, stochastic gradient descent (SGD) often incurs steady progression phases, interrupted by catastrophic episodes in which loss and gradient norm explode. A possible mitigation of such events is to slow down the learning process. This paper presents a novel approach to contro…

Paper presents a fast, private MH algorithm for large-scale Bayesian inference.

We provide a fast approximation to eNTKs for neural networks.

This work presents a fast and non-convex algorithm for robust subspace recovery. The data sets considered include inliers drawn around a low-dimensional subspace of a higher dimensional ambient space, and a possibly large portion of outliers that do not lie nearby this subspace. The proposed algorithm, which we refer t…

We consider the problem of learning the inhomogeneous intensity of a counting process, under a sparse segmentation assumption. We introduce a weighted total-variation penalization, using data-driven weights that correctly scale the penalization along the observation interval. We prove that this leads to a sharp tuning …

Fast algorithm recovers principal eigenvector from noisy matrices.

Improved graph-based multiclass classification for multilayer data.