arXiv research

This paper improves bandwidth selectors for SPBNs to enhance their performance.

We explore the performance of several automatic bandwidth selectors, originally designed for density gradient estimation, as data-based procedures for nonparametric, modal clustering. The key tool to obtain a clustering from density gradient estimators is the mean shift algorithm, which allows to obtain a partition not…

Estimates time-series drifts from i.i.d. data using a direct Nadaraya-Watson plug-in method.

Important information concerning a multivariate data set, such as clusters and modal regions, is contained in the derivatives of the probability density function. Despite this importance, nonparametric estimation of higher order derivatives of the density functions have received only relatively scant attention. Kernel …

Two adaptive kernel selection methods improve the accuracy of Kernelized Diffusion Maps.

A fast method estimates stability of ensemble feature selectors.

An action selector associates, in a suitable way, to each compactly supported Hamiltonian on a symplectic manifold an action value of the Hamiltonian. Action selectors are known to exist for a broad class of symplectic manifolds. We show how the existence of an action selector leads to sharp energy capacity inequalitie…

Deciding what and when to observe is critical when making observations is costly. In a medical setting where observations can be made sequentially, making these observations (or not) should be an active choice. We refer to this as the active sensing problem. In this paper, we propose a novel deep learning framework, wh…

In this paper, we study a simple iterative method for finding the Dantzig selector, which was designed for linear regression problems. The method consists of two main stages. The first stage is to approximate the Dantzig selector through a fixed-point formulation of solutions to the Dantzig selector problem. The second…

Defines spectral selectors on lens spaces for contactomorphisms.

The study proves properties of spectral selectors for contact manifolds and applies them to contact big fibers and geodesics.

T-Rex selector selects variables fast and controls FDR in high-dimensional data.

Study non-squeezing phenomena in contact geometry using specific capacities.

Meta-algorithm selection aims to choose the best algorithm selector for a given problem instance.

CKA with Gaussian RBF kernels converges linearly as bandwidth increases.

Changing kernel bandwidth during training improves kernel regression performance.

In many applications one may acquire a composition of several signals that may be corrupted by noise, and it is a challenging problem to reliably separate the components from one another without sacrificing significant details. Adding to the challenge, in a compressive sensing framework, one is given only an undersampl…

A new method for faster bandwidth selection in Gaussian kernel ridge regression.

ESAC improves reinforcement learning by lookahead and intuition.

We consider a class of linear-programming based estimators in reconstructing a sparse signal from linear measurements. Specific formulations of the reconstruction problem considered here include Dantzig selector, basis pursuit (for the case in which the measurements contain no errors), and the fused Dantzig selector (f…

We provide a way to infer about existence of topological circularity in high-dimensional data sets in $\mathbb{R}^d$ from its projection in $\mathbb{R}^2$ obtained through a fast manifold learning map as a function of the high-dimensional dataset $\mathbb{X}$ and a particular choice of a positive real $σ$ known as band…

The paper bounds bandwidth and focal radius for manifolds with positive isotropic curvature.

Support vector data description (SVDD) is a popular technique for detecting anomalies. The SVDD classifier partitions the whole space into an inlier region, which consists of the region near the training data, and an outlier region, which consists of points away from the training data. The computation of the SVDD class…

Proposes GRAB-MDM for robust multiview data fusion.

Consistency of the kernel density estimator requires that the kernel bandwidth tends to zero as the sample size grows. In this paper we investigate the question of whether consistency is possible when the bandwidth is fixed, if we consider a more general class of weighted KDEs. To answer this question in the affirmativ…

Study bandwidth-limited training and inference of language models.

Algorithm selects variables and bandwidths for geographically weighted regression.

New method selects optimal bandwidth for price return density estimation, impacting efficient market hypothesis evaluation.

We propose a novel high-dimensional linear regression estimator: the Discrete Dantzig Selector, which minimizes the number of nonzero regression coefficients subject to a budget on the maximal absolute correlation between the features and residuals. Motivated by the significant advances in integer optimization over the…

Existing relation classification methods that rely on distant supervision assume that a bag of sentences mentioning an entity pair are all describing a relation for the entity pair. Such methods, performing classification at the bag level, cannot identify the mapping between a relation and a sentence, and largely suffe…

Ensemble learning that can be used to combine the predictions from multiple learners has been widely applied in pattern recognition, and has been reported to be more robust and accurate than the individual learners. This ensemble logic has recently also been more applied in feature selection. There are basically two st…

An accurate and fast estimation of the available bandwidth in a network with varying cross-traffic is a challenging task. The accepted probing tools, based on the fluid-flow model of a bottleneck link with first-in, first-out multiplexing, estimate the available bandwidth by measuring packet dispersions. The estimation…

Support vector data description (SVDD) is a popular anomaly detection technique. The SVDD classifier partitions the whole data space into an inlier region, which consists of the region near the training data, and an outlier region, which consists of points away from the training data. The computation of the SVDD classi…

An algorithm reduces breast cancer detection data complexity using effect sizes.

Prototype selection improved using topological data analysis.

New method aggregates GDS analyses of randomly selected interaction models to identify important factors in screening experiments.

We consider recommendation systems that need to operate under wireless bandwidth constraints, measured as number of broadcast transmissions, and demonstrate a (tight for some instances) tradeoff between regret and bandwidth for two scenarios: the case of multi-armed bandit with context, and the case where there is a la…

This paper proposes a new method for automatically selecting the optimal kernel bandwidth in density estimation.

Study shows that ridgeless Gaussian kernel regression overfits even with varying bandwidth or dimensionality.

IEN speeds up T-Rex+GVS for fast, efficient GWAS.

New method learns to encode predictions within interpretations, improving evaluation.

New approach to adaptively select bandwidths in nonparametric regression.

Study provides bounds for estimating intrinsic dimension using Gaussian kernels.

New method tightens federated probe-logit distillation rates under varying bandwidths.

We propose a flexible nonparametric regression method for ultrahigh-dimensional data. As a first step, we propose a fast screening method based on the favored smoothing bandwidth of the marginal local constant regression. Then, an iterative procedure is developed to recover both the important covariates and the regress…

The Dantzig selector has received popularity for many applications such as compressed sensing and sparse modeling, thanks to its computational efficiency as a linear programming problem and its nice sampling properties. Existing results show that it can recover sparse signals mimicking the accuracy of the ideal procedu…

Dantzig Selector (DS) is widely used in compressed sensing and sparse learning for feature selection and sparse signal recovery. Since the DS formulation is essentially a linear programming optimization, many existing linear programming solvers can be simply applied for scaling up. The DS formulation can be explained a…

Local Gaussian correlation struggles in tails but a new method improves it.