Paper addresses bias in kernel density estimation under minimal assumptions.
problem Kernel density estimation bias under minimal assumptions.
method Demonstrates the need for a balance between kernel decay and bandwidth eigenvalues, and rigorously derives bias bounds.
result Explicit constants and rigorous derivation of bias bounds under minimal assumptions.
Two adaptive kernel selection methods improve the accuracy of Kernelized Diffusion Maps.
problem Selecting an appropriate kernel for Kernelized Diffusion Maps.
method Two complementary approaches: variational outer loop and unsupervised cross-validation.
result Both methods improve the quality and stability of the recovered eigenfunctions.
Gaussian process regression generally does not scale to beyond a few thousands data points without applying some sort of kernel approximation method. Most approximations focus on the high eigenvalue part of the spectrum of the kernel matrix, K, which leads to bad performance when the length scale of the kernel is sma…
CKA with Gaussian RBF kernels converges linearly as bandwidth increases.
problem Understanding the behavior of CKA with large bandwidth Gaussian kernels.
method Analyzing the convergence of CKA based on Gaussian RBF kernels in the large-bandwidth limit.
result CKA based on Gaussian RBF kernels converges linearly as bandwidth increases.
Changing kernel bandwidth during training improves kernel regression performance.
problem Improving kernel regression performance with varying model complexity.
method Investigated changing the bandwidth of a translational-invariant kernel during training for kernel regression using gradient descent.
result Kernel regression exhibits double descent behavior with decreasing model complexity (bandwidth).
A new method for faster bandwidth selection in Gaussian kernel ridge regression.
problem Efficiently selecting the bandwidth in Gaussian kernel ridge regression.
method Formulated an approximate Jacobian expression for bandwidth selection, proposing a closed-form heuristic.
result Our method is as accurate as cross-validation and marginal likelihood maximization but up to six orders of magnitude faster.
New method uses reinforcement learning to accurately estimate available network bandwidth.
problem Accurate and fast estimation of available bandwidth in networks with varying cross-traffic.
method Employed reinforcement learning, specifically the ε-greedy algorithm in a multi-armed bandit approach. result Proposed method identifies available bandwidth with high precision and converges under various challenging conditions.
We provide a way to infer about existence of topological circularity in high-dimensional data sets in Rd from its projection in R2 obtained through a fast manifold learning map as a function of the high-dimensional dataset X and a particular choice of a positive real σ known as band…
The paper proves spectral convergence rates for graph Laplacian to manifold Laplace-Beltrami operator.
problem Spectral convergence of graph Laplacian to manifold Laplace-Beltrami operator.
method Analysis of Dirichlet form convergence and construction of approximate eigenfunctions via manifold heat kernel.
result Proves spectral convergence rates for Gaussian kernelized graph Laplacian.
The paper bounds bandwidth and focal radius for manifolds with positive isotropic curvature.
problem Bounding bandwidth and focal radius for manifolds with positive isotropic curvature.
method Using spectral properties of a twisted de Rham-Hodge operator.
result Upper bounds on bandwidth and focal radius are derived for hypersurfaces in PIC manifolds.
Support vector data description (SVDD) is a popular technique for detecting anomalies. The SVDD classifier partitions the whole space into an inlier region, which consists of the region near the training data, and an outlier region, which consists of points away from the training data. The computation of the SVDD class…
Study on sensor fusion algorithms under high dimensional noise.
problem Behavior of sensor fusion algorithms under high dimensional noise.
method Analysis of NCCA and AD algorithms using Gaussian kernel.
result Robustness of NCCA and AD to high dimensional noise depends on SNR and bandwidth selection.
Proposes GRAB-MDM for robust multiview data fusion.
problem Limited theoretical guarantees for multiview fusion methods in noisy high-dimensional data.
method Generalized Robust Adaptive-Bandwidth Multiview Diffusion Maps (GRAB-MDM) with adaptive bandwidth selection.
result Adaptive bandwidths lead to robust recovery of shared intrinsic structure in noisy multiview data.
Consistency of the kernel density estimator requires that the kernel bandwidth tends to zero as the sample size grows. In this paper we investigate the question of whether consistency is possible when the bandwidth is fixed, if we consider a more general class of weighted KDEs. To answer this question in the affirmativ…
Study bandwidth-limited training and inference of language models.
problem Training and inference of language models on scattered data with limited bandwidth.
method Analyzed two protocols: Federated Probe-Logit Distillation (FPLD) for training and Federated Conformal RAG (FC-RAG) for inference.
result Explicit high-probability KL-consistency rate and distribution-free marginal-coverage bound for Federated Conformal RAG.
Algorithm selects variables and bandwidths for geographically weighted regression.
problem Estimating variable subsets and bandwidths for geographically weighted regression.
method Mathematical programming-based approach integrating variable selection and bandwidth estimation.
result Proposed algorithm provides stable spatially varying patterns with competitive explanatory power.
New method selects optimal bandwidth for price return density estimation, impacting efficient market hypothesis evaluation.
problem Estimating the complexity of price return distributions using kernel density estimation.
method Proposes a new complexity measure to select optimal bandwidth, avoiding overfitting and underfitting.
result Optimal bandwidth selection leads to clearer evaluation of the efficient market hypothesis.
Support vector data description (SVDD) is a popular anomaly detection technique. The SVDD classifier partitions the whole data space into an inlier region, which consists of the region near the training data, and an outlier region, which consists of points away from the training data. The computation of the SVDD classi…
This paper improves bandwidth selectors for SPBNs to enhance their performance.
problem Suboptimal density estimation and reduced predictive performance in SPBNs due to normal rule bandwidth selection.
method Theoretical framework for state-of-the-art bandwidth selectors (cross-validation and plug-in methods) are established and evaluated.
result Cross-validation selectors outperform the normal rule, especially in high sample size scenarios.
We consider recommendation systems that need to operate under wireless bandwidth constraints, measured as number of broadcast transmissions, and demonstrate a (tight for some instances) tradeoff between regret and bandwidth for two scenarios: the case of multi-armed bandit with context, and the case where there is a la…
This paper proposes a new method for automatically selecting the optimal kernel bandwidth in density estimation.
problem The challenge of selecting the optimal kernel bandwidth in unsupervised density estimation.
method The approach uses a topology-based loss function for automated bandwidth selection.
result Demonstrates the potential of the topology-based approach across different dimensions.
Study shows that ridgeless Gaussian kernel regression overfits even with varying bandwidth or dimensionality.
problem Analyzing overfitting in Gaussian kernel ridgeless regression with varying bandwidth or dimensionality.
method Examined the behavior of minimum norm interpolating solutions for fixed and increasing dimensions under varying bandwidth and sample size.
result Ridgeless solutions are never consistent and can be worse than null predictor with large enough noise, even with varying bandwidth or dimensionality.
New approach to adaptively select bandwidths in nonparametric regression.
problem Adaptive bandwidth selection in nonparametric regression.
method Inspired by ℓ2-norms of interval projections, introduces a new bandwidth selection procedure. result Obtains non-asymptotic risk bounds for local polynomial regression methods that adapt to local Hölder exponent.
New method tightens federated probe-logit distillation rates under varying bandwidths.
problem Estimating conditional distributions in federated learning with heterogeneous bandwidth constraints.
method Developed a new federated probe-logit distillation (FPLD) method with optimal allocation for varying bandwidths.
result Achieved matching lower and upper bounds for the minimax rate under heterogeneous bandwidths.
Study provides bounds for estimating intrinsic dimension using Gaussian kernels.
problem Estimating intrinsic dimension from data.
method Finite-sample concentration and anti-concentration bounds for Gaussian kernel sums.
result Explicit dependence on sample size, bandwidth, and geometric parameters.
We propose a flexible nonparametric regression method for ultrahigh-dimensional data. As a first step, we propose a fast screening method based on the favored smoothing bandwidth of the marginal local constant regression. Then, an iterative procedure is developed to recover both the important covariates and the regress…
Local Gaussian correlation struggles in tails but a new method improves it.
problem Local Gaussian correlation's limitations in tail dependence.
method A new adaptive bandwidth method for LGC, optimizing for local effective sample size.
result Adaptive bandwidths outperform global ones in moderate dependence, but not in strong or weak dependence.
Support Vector Data Description (SVDD) provides a useful approach to construct a description of multivariate data for single-class classification and outlier detection with various practical applications. Gaussian kernel used in SVDD formulation allows flexible data description defined by observations designated as sup…
We explore the performance of several automatic bandwidth selectors, originally designed for density gradient estimation, as data-based procedures for nonparametric, modal clustering. The key tool to obtain a clustering from density gradient estimators is the mean shift algorithm, which allows to obtain a partition not…
Study neural communication systems with bandwidth-limited channels.
problem Reliable message transmission despite noisy channels.
method Jointly model compression and error correction with neural networks; introduce prior for missing information; use auxiliary latent variables.
result Joint neural communication systems outperform separate models under expected information loss.
Extends FC-RAG to anytime-valid sequential coverage for language model swarms.
problem Maintain distribution-free coverage for a swarm of weak language models over time.
method Introduces Anytime-FC-RAG, a sequential extension with a summable calibration-deviation budget.
result Achieves time-uniform alarm validity and safety under predictable adaptive control.
A streaming algorithm estimates quadratic covariation from financial data efficiently.
problem Estimating quadratic covariation from ultra-high-frequency financial data with limited memory.
method Formulated multi-scale, realized kernel, pre-averaging, and modulated realized covariance estimators with fixed bandwidth.
result Fixed bandwidth estimators require higher bandwidth for positive semidefiniteness.
PCA-Triage optimizes sensor data sampling for IoT networks.
problem Excessive sensor data in IoT networks exceeds available bandwidth.
method PCA-Triage uses streaming incremental PCA loadings to adaptively triage sensor data.
result PCA-Triage achieves high inference performance with minimal bandwidth usage.
The study optimizes Gaussian process approximations for finite-rank models.
problem Posterior behavior of finite-rank approximations differs from parent GP priors.
method Locally supported basis expansions with dependent Gaussian coefficients.
result Finite-rank expansions inherit the same posterior contraction rate as parent GP priors.
Paper proves MS convergence for radially symmetric kernels with large bandwidths.
problem Proving convergence of mean shift algorithm with radially symmetric kernels.
method Analyzes convergence of mean shift algorithm with radially symmetric, positive definite kernels.
result Guaranteed convergence for sufficiently large bandwidth in any dimension.
New algorithm reduces communication bandwidth for large-scale deep learning training.
problem Efficiently compressing gradients for ring all-reduce in large-scale clusters.
method Importance weighted pruning based on gradient and parameter size.
result Achieved significant gradient compression ratios (64X and 58.8X) on AlexNet and ResNet50.
A-FADMM improves FL scalability and privacy via wireless channel perturbations and interference.
problem Challenges in model training due to wireless channel randomness and interference.
method Formulated a novel constrained optimization problem and proposed A-FADMM framework.
result Proves convergence and privacy guarantees for A-FADMM under time-varying channels.
Paper uses deep learning to optimize resource allocation in ultra-reliable communications.
problem Optimizing resource allocation for ultra-reliable and low-latency communications.
method Unsupervised deep learning for joint power and bandwidth allocation.
result Deep learning finds an approximated optimal solution with QoS constraints.
Estimates bandwidth for CMC initial data sets.
problem Estimating bandwidth for constant mean curvature (CMC) initial data sets.
method Three independent proofs: stability of null expansion, spacetime harmonic function perturbation, Dirac operator.
result Generalized Gromov's band width estimate to CMC initial data sets.
Estimators of information theoretic measures such as entropy and mutual information are a basic workhorse for many downstream applications in modern data science. State of the art approaches have been either geometric (nearest neighbor (NN) based) or kernel based (with a globally chosen bandwidth). In this paper, we co…
Support Vector Data Description (SVDD) is a machine-learning technique used for single class classification and outlier detection. SVDD formulation with kernel function provides a flexible boundary around data. The value of kernel function parameters affects the nature of the data boundary. For example, it is observed …
We address the problem of setting the kernel bandwidth used by Manifold Learning algorithms to construct the graph Laplacian. Exploiting the connection between manifold geometry, represented by the Riemannian metric, and the Laplace-Beltrami operator, we set the bandwidth by optimizing the Laplacian's ability to preser…
The study optimizes bandwidth for nonparametric modal clustering.
problem Optimizing bandwidth for nonparametric modal clustering.
method Asymptotic analysis of density-based partitions and bandwidth selection.
result Asymptotic approximation of a metric for partition distance.
ERNet reduces CNN bandwidth needs for imaging tasks.
problem High DRAM bandwidth requirements for CNNs in imaging.
method ERNet uses block-based inference and temporary layer expansion.
result ERNet outperforms state-of-the-art models in image denoising and super-resolution.
Investigates how neural network capacity impacts the learning of compositional languages.
problem The importance of communicative bandwidth in emergent language learning.
method Exploration of how neural network capacity affects the learning of compositional languages.
result There is a specific range of model capacity and channel bandwidth that induces compositional structure.
Large-scale distributed training requires significant communication bandwidth for gradient exchange that limits the scalability of multi-node training, and requires expensive high-bandwidth network infrastructure. The situation gets even worse with distributed training on mobile devices (federated learning), which suff…
In kernel methods, the median heuristic has been widely used as a way of setting the bandwidth of RBF kernels. While its empirical performances make it a safe choice under many circumstances, there is little theoretical understanding of why this is the case. Our aim in this paper is to advance our understanding of the …
The problem of adaptive noisy clustering is investigated. Given a set of noisy observations Zi=Xi+εi, i=1,...,n, the goal is to design clusters associated with the law of Xi's, with unknown density f with respect to the Lebesgue measure. Since we observe a corrupted sample, a direct approach as the popular …