arXiv research

Unified bounds for random subset generalization error and improved SGD Langevin dynamics.

New DKPP family controls positive and negative dependence in random subsets.

This paper improves volatility forecasting using dynamic subset selection in genetic programming.

A system of nested dichotomies is a method of decomposing a multi-class problem into a collection of binary problems. Such a system recursively splits the set of classes into two subsets, and trains a binary classifier to distinguish between each subset. Even though ensembles of nested dichotomies with random structure…

New proof shows random neural networks contain sparse subnetworks.

Paper reinterprets ARP algorithm and improves its analysis and speed.

Given a Gaussian Markov random field, we consider the problem of selecting a subset of variables to observe which minimizes the total expected squared prediction error of the unobserved variables. We first show that finding an exact solution is NP-hard even for a restricted class of Gaussian Markov random fields, calle…

Algorithm identifies best item from subsets with random utility model feedback.

The modern scale of data has brought new challenges to Bayesian inference. In particular, conventional MCMC algorithms are computationally very expensive for large data sets. A promising approach to solve this problem is embarrassingly parallel MCMC (EP-MCMC), which first partitions the data into multiple subsets and r…

Random small feature subsets outperform FS in diverse datasets.

We say that a subset $S\subseteq F_N$ is \emph{spectrally rigid} if whenever $T_1, T_2\in cv_N$ are points of the (unprojectivized) Outer space such that $||g||_{T_1}=||g||_{T_2}$ for every $g\in S$ then $T_1=T_2$ in $\cvn$. It is well-known that $F_N$ itself is spectrally rigid; it also follows from the result of Smil…

We study the performance of data-driven, a priori and random approaches to label space partitioning for multi-label classification with a Gaussian Naive Bayes classifier. Experiments were performed on 12 benchmark data sets and evaluated on 5 established measures of classification quality: micro and macro averaged F1 s…

Expected centre of mass for random embeddings is constant.

Ensemble methods have been shown to be an effective tool for solving multi-label classification tasks. In the RAndom k-labELsets (RAKEL) algorithm, each member of the ensemble is associated with a small randomly-selected subset of k labels. Then, a single label classifier is trained according to each combination of ele…

Determinantal consensus clustering improves clustering robustness.

In this paper we propose strategies for estimating performance of a classifier when labels cannot be obtained for the whole test set. The number of test instances which can be labeled is very small compared to the whole test data size. The goal then is to obtain a precise estimate of classifier performance using as lit…

Hierarchical randomized smoothing improves model robustness for complex data.

In today world of enormous amounts of data, it is very important to extract useful knowledge from it. This can be accomplished by feature subset selection. Feature subset selection is a method of selecting a minimum number of features with the help of which our machine can learn and predict which class a particular dat…

LESS combines local predictors for subsets to learn from heterogeneous input-output pairs.

Designs efficient algorithms to maximize the expectation of Gaussian random variables.

We define the beta diffusion tree, a random tree structure with a set of leaves that defines a collection of overlapping subsets of objects, known as a feature allocation. A generative process for the tree structure is defined in terms of particles (representing the objects) diffusing in some continuous space, analogou…

Study tests financial market efficiency using random number generator tests.

DiPriMe forests use private medians to create balanced tree splits for privacy-protected data.

Paper generalizes bipolar theorems for non-negative random variables.

We present a consensus Monte Carlo algorithm that scales existing Bayesian nonparametric models for clustering and feature allocation to big data. The algorithm is valid for any prior on random subsets such as partitions and latent feature allocation, under essentially any sampling model. Motivated by three case studie…

We introduce and study the space of \emph{subset currents} on the free group $F_N$. A subset current on $F_N$ is a positive $F_N$-invariant locally finite Borel measure on the space $\mathfrak C_N$ of all closed subsets of $\partial F_N$ consisting of at least two points. While ordinary geodesic currents generalize con…

New method selects sparse predictors in large LMMs.

A system of nested dichotomies is a method of decomposing a multi-class problem into a collection of binary problems. Such a system recursively applies binary splits to divide the set of classes into two subsets, and trains a binary classifier for each split. Many methods have been proposed to perform this split, each …

Proposes a few-shot learning method for feature selection without labeled data.

Microarray cancer gene expression data comprise of very high dimensions. Reducing the dimensions helps in improving the overall analysis and classification performance. We propose two hybrid techniques, Biogeography - based Optimization - Random Forests (BBO - RF) and BBO - SVM (Support Vector Machines) with gene ranki…

We study the problem of sampling a bandlimited graph signal in the presence of noise, where the objective is to select a node subset of prescribed cardinality that minimizes the signal reconstruction mean squared error (MSE). To that end, we formulate the task at hand as the minimization of MSE subject to binary constr…

Dimensionality reduction is a first step of many machine learning pipelines. Two popular approaches are principal component analysis, which projects onto a small number of well chosen but non-interpretable directions, and feature selection, which selects a small number of the original features. Feature selection can be…

Let $S=Γ\backslash \mathbb{H}$ be a hyperbolic surface of finite topological type, such that the Fuchsian group $Γ\le \operatorname{PSL}_2(\mathbb{R})$ is non-elementary, and consider any generating set $\mathfrak S$ of $Γ$. When sampling by an $n$-step random walk in $π_1(S) \cong Γ$ with each step given by an element…

Markov random field (MRF) learning is intractable, and its approximation algorithms are computationally expensive. We target a small subset of MRF that is used frequently in computer vision. We characterize this subset with three concepts: Lattice, Homogeneity, and Inertia; and design a non-markov model as an alternati…

We propose using five data-driven community detection approaches from social networks to partition the label space for the task of multi-label classification as an alternative to random partitioning into equal subsets as performed by RAkELd: modularity-maximizing fastgreedy and leading eigenvector, infomap, walktrap an…

We introduce extensions of stability selection, a method to stabilise variable selection methods introduced by Meinshausen and Bühlmann (J R Stat Soc 72:417-473, 2010). We propose to apply a base selection method repeatedly to random observation subsamples and covariate subsets under scrutiny, and to select covariates …

BWS selects best window subsets for efficient data pruning.

We analyze the trade-off between model complexity and accuracy for random forests by breaking the trees up into individual classification rules and selecting a subset of them. We show experimentally that already a few rules are sufficient to achieve an acceptable accuracy close to that of the original model. Moreover, …

P-SE explains model decisions with minimal feature subsets and fast estimators.

The completeness problem of the bond market model with the random factors determined by a Wiener process and Poisson random measure is studied. Hedging portfolios use bonds with maturities in a countable, dense subset of a finite time interval. It is shown that under natural assumptions the market is not complete unles…

We construct an infinitely exchangeable process on the set $\cate$ of subsets of the power set of the natural numbers $\mathbb{N}$ via a Poisson point process with mean measure $Λ$ on the power set of $\mathbb{N}$. Each $E\in\cate$ has a least monotone cover in $\catf$, the collection of monotone subsets of $\cate$, an…

This paper studies the Best-of-K Bandit game: At each time the player chooses a subset S among all N-choose-K possible options and observes reward max(X(i) : i in S) where X is a random vector drawn from a joint distribution. The objective is to identify the subset that achieves the highest expected reward with high pr…

Bayesian coresets improved with random sampling and quasi-Newton optimization.

The paper introduces a framework to select efficient datasets for preserving model rankings.

This study examines how randomness affects machine learning model performance.

The paper analyzes bootstrap ensemble classifiers in high-dimensional settings.

Study efficient algorithms for identifying minimum interventional sets to learn causal relationships.

Simplifies RF predictions by focusing on a subset of nearest neighbors.