Modified Epanechnikov Mean Shift converges to cluster centroids.
problem Lack of theoretical support for convergence of Epanechnikov Mean Shift due to non-smooth kernel density functions.
method Proposed a simple remedy to fix convergence issues, ensuring termination at a local maximum of the estimated density.
result Modified Epanechnikov Mean Shift guarantees convergence to a cluster centroid within a finite number of iterations.
Study guarantees convergence of mean shift mode estimation.
problem Ensuring reliable mode estimation in KDE using mean shift.
method Utilizes Łojasiewicz inequality to prove convergence rate.
result Extends convergence guarantees to biweight kernel.
Optimal Biweight kernel and computationally efficient Epanechnikov kernel for modal linear regression.
problem Finding the best kernel for modal linear regression.
method Refined analysis of asymptotic statistical behavior and IRLS algorithm convergence.
result Biweight kernel minimizes asymptotic mean squared error, Epanechnikov kernel guarantees IRLS convergence.
EnEMF uses Epanechnikov kernel for high-dimensional filtering, improving accuracy and robustness.
problem Suboptimal Gaussian mixture kernel density estimates in high-dimensional settings.
method Ensemble Epanechnikov mixture filter (EnEMF) using optimal Epanechnikov kernel.
result EnEMF reduces error per particle on high-dimensional systems like Lorenz '96.
Paper bridges VAEs and KDEs for more flexible posterior estimation.
problem Limitations of Gaussian latent space in VAEs and challenges in KL-divergence estimation.
method Approximate posterior with KDEs and derive upper bound of KL-divergence in ELBO.
result Epanechnikov kernel minimizes KL-divergence upper bound asymptotically.
A new model predicts crop yields with high accuracy and uncertainty.
problem Uncertainty in crop yield forecasting due to weather extremes.
method Quantile random forest and Epanechnikov kernel function.
result The model captures crop yields with high coverage probability and provides feature importance.
A method to remove mean-shift noise from PCA using knockoffs.
problem High sensitivity of PCA to mean-shift contamination in high-dimensional data.
method Introducing knockoff mean-shift perturbation to separate and remove mean-shift components from PCA.
result The mean-shift spikes are spectrally separable from stable eigenvalues, allowing for robust PCA.
The mean-shift algorithm is a popular algorithm in computer vision and image processing. It can also be cast as a minimum gamma-divergence estimation. In this paper we focus on the "blurring" mean shift algorithm, which is one version of the mean-shift process that successively blurs the dataset. The analysis of the bl…
In this paper, we study how the mean shift algorithm can be used to denoise a dataset. We introduce a new framework to analyze the mean shift algorithm as a denoising approach by viewing the algorithm as an operator on a distribution function. We investigate how the mean shift algorithm changes the distribution and sho…
A feature-weighted mean shift algorithm improves clustering in high-dimensional data.
problem Clustering high-dimensional data with traditional mean shift algorithms.
method Feature-weighted mean shift algorithm.
result The algorithm outperforms conventional mean shift and preserves computational simplicity.
The paper explores rigidity of hypersurfaces with constant shifted curvature functions in hyperbolic space.
problem Rigidity of hypersurfaces with constant shifted curvature functions in hyperbolic space.
method Characterizations and rigidity investigations for hypersurfaces with constant weighted shifted mean curvatures or ratios.
result Rigidity results for hypersurfaces with constant linear combinations of weighted shifted mean curvatures and radially symmetric shifted mean curvatures.
Interpolates mean shift and spectral clustering on graphs.
problem Data clustering algorithms.
method Fokker-Planck equations on data graphs.
result New theoretical insights on diffusion maps and mean shift dynamics.
A new Mean Shift variant converges after a finite number of iterations for specific kernel shapes.
problem Improving Mean Shift algorithm convergence for specific kernel shapes.
method Developed a novel Mean Shift variant with a triangular kernel profile.
result The new Mean Shift variant converges after a finite number of iterations.
A natural way to characterize the cluster structure of a dataset is by finding regions containing a high density of data. This can be done in a nonparametric way with a kernel density estimate, whose modes and hence clusters can be found using mean-shift algorithms. We describe the theory and practice behind clustering…
Framework detects shape shifts in functional profiles using Fréchet mean and shape invariant model.
problem Detecting shape shifts in functional profiles.
method Combining Fréchet mean and shape invariant model for interpretable parameterization of profile deviations.
result Potential shifts in shape deformation process distinguished by significant shifts in amplitude and/or phase.
Efficiently estimates mean in contaminated Gaussian data with near-optimal sample complexity.
problem Robust mean estimation in the presence of mean-shift contamination.
method First computationally efficient algorithm with near-optimal sample complexity and polynomial-time running.
result Approximates the target mean to any desired accuracy with constant fraction of outliers tolerated.
Develops an MS-inspired algorithm for regression mode finding and space partitioning.
problem Finding local modes of regression functions and partitioning input space.
method Mean-shift-inspired algorithm for iterative gradient ascent.
result Proves convergence and rates of convergence for estimated local modes.
New methods for Bayesian inference using mean shift particle systems.
problem Approximating expectations with unnormalized densities in Bayesian inference.
method Mean shift interacting particle systems that minimize maximum mean discrepancy (MMD).
result Mean shift interacting particle systems converge quickly and capture complex distributions.
We introduce the functional mean-shift algorithm, an iterative algorithm for estimating the local modes of a surrogate density from functional data. We show that the algorithm can be used for cluster analysis of functional data. We propose a test based on the bootstrap for the significance of the estimated local modes …
Mean shift clustering finds the modes of the data probability density by identifying the zero points of the density gradient. Since it does not require to fix the number of clusters in advance, the mean shift has been a popular clustering algorithm in various application fields. A typical implementation of the mean shi…
The paper studies kernel smoothing and mean shift for directional data, deriving convergence rates and mode estimation.
problem Statistical and computational problems of kernel smoothing for directional data.
method Generalization of mean shift to directional data, derivation of convergence rates, and investigation of mode estimation.
result Statistical convergence rates of directional KDE and its derivatives, ascending property of directional mean shift, and mode estimation.
Paper shows DMS as an EM algorithm with improved convergence.
problem Improving the convergence of DMS algorithm.
method Shows DMS as a generalized EM algorithm and provides new proofs.
result Demonstrates global convergence and linear convergence of DMS.
HypeGBMS clusters data in hyperbolic space, overcoming Euclidean limitations.
problem Clustering in hierarchical or tree-like datasets in curved spaces.
method Hyperbolic Gaussian Blurring Mean Shift with Möbius-weighted means.
result HypeGBMS effectively captures latent hierarchies in non-Euclidean data.
Proposes bipolar activation functions to shift layer mean activations towards zero.
problem Training deep neural networks with high layer mean activations.
method Extends ReLU-family activation functions to shift mean activations towards zero.
result Improves language modeling and classification tasks with competitive results.
New algorithm improves clustering and quantization using MMD.
problem Approximating probability distributions with weighted mixtures of Dirac measures.
method Gradient flow, mean shift, and MMD-optimal quantization.
result MSIP algorithm is more robust than state-of-the-art methods.
The purpose of sufficient dimension reduction (SDR) is to find the low-dimensional subspace of input features that is sufficient for predicting output values. In this paper, we propose a novel distribution-free SDR method called sufficient component analysis (SCA), which is computationally more efficient than existing …
We explore the performance of several automatic bandwidth selectors, originally designed for density gradient estimation, as data-based procedures for nonparametric, modal clustering. The key tool to obtain a clustering from density gradient estimators is the mean shift algorithm, which allows to obtain a partition not…
Paper proposes MMD-Sense-Analysis for detecting word sense shifts.
problem Detecting and interpreting shifts in word meanings over time.
method Leverages Maximum Mean Discrepancy (MMD) to identify and explain word sense changes.
result Demonstrates effectiveness of MMD-Sense-Analysis through empirical results.
Method calibrates simulators under covariate shift using kernel techniques.
problem Dealing with covariate shift in simulator inputs.
method Bayesian inference with kernel mean embedding and importance-weighted reproducing kernel.
result The method effectively calibrates simulators and demonstrates sensitivity analysis.
Efficiently clusters large datasets with approximate nearest neighbors.
problem Efficiently clustering large datasets with high computational cost.
method Approximates density gradient ascent and nearest neighbors using LSH for scalable clustering.
result Improves clustering accuracy and scalability for large datasets.
Anchor-TS uses median anchoring to improve online decision-making from offline data with distribution shift.
problem Improving online decision-making from offline data with distribution shift.
method Sample-Mean Anchored Thompson Sampling (Anchor-TS) with median anchoring.
result Anchor-TS safely leverages offline data to accelerate online learning and reduces regret.
The paper tackles matching a desired mean in causal systems through shift interventions.
problem Matching a desired mean in causal systems.
method Defining Markov equivalence classes, proposing active learning strategies, deriving lower bounds.
result Proposed active learning strategies require fewer interventions than previous approaches, especially for certain graph classes.
Proves new inequality for hyperbolic space hypersurfaces.
problem Finding inequalities for hypersurfaces in hyperbolic space.
method Proves a Heintze-Karcher type inequality for shifted mean convex hypersurfaces.
result Proves Alexandrov type theorem and uniqueness result for hypersurfaces.
New method for clustering binary data using nearest neighbor median shift.
problem Clustering binary data effectively.
method BinNNMS based on nearest neighbor median shift.
result BinNNMS accurately discovers cluster locations in binary data.
Estimates modes and ridges in mixed Euclidean and directional spaces.
problem Estimating local modes and density ridges in product spaces combining Euclidean and directional metrics.
method Extends mean shift algorithm to product spaces, addressing challenges in generalization.
result Established convergence of the proposed methods and demonstrated effectiveness on real-world datasets.
Bayesian approach labels segment parameters for improved change detection.
problem Improving Bayesian change point detection by leveraging segment parameter patterns.
method Proposes a Bayesian mean-shift change point detection algorithm with a Dirichlet process prior for segment class labels.
result Enhanced performance in synthetic and real-world data.
In real supervised learning scenarios, it is not uncommon that the training and test sample follow different probability distributions, thus rendering the necessity to correct the sampling bias. Focusing on a particular covariate shift problem, we derive high probability confidence bounds for the kernel mean matching (…
LCW reduces activation shift in neural networks, improving training efficiency and generalization.
problem Activation shift in neural networks leading to non-zero mean preactivation values.
method Linearly constrained weights (LCW) to reduce activation shift in fully connected and convolutional layers.
result LCW resolves the vanishing gradient problem and improves generalization of neural networks.
Many clustering algorithms exist that estimate a cluster centroid, such as K-means, K-medoids or mean-shift, but no algorithm seems to exist that clusters data by returning exactly K meaningful modes. We propose a natural definition of a K-modes objective function by combining the notions of density and cluster assignm…
Paper proves linear convergence of SCMS algorithm for directional data.
problem Identifying density ridges in directional data.
method Generalized SCMS algorithm to directional data, derived from SCGA with adaptive step size.
result Linear convergence of the proposed directional SCMS algorithm.
The paper develops methods to accurately locate change points in high-dimensional mean shift models.
problem Locating change points in high-dimensional mean shift models.
method Locally refitted least squares estimator, component-wise and simultaneous rates of estimation.
result Asymptotic validity of component-wise and simultaneous confidence intervals for change point parameters.
In addition to finding meaningful clusters, centroid-based clustering algorithms such as K-means or mean-shift should ideally find centroids that are valid patterns in the input space, representative of data in their cluster. This is challenging with data having a nonconvex or manifold structure, as with images or text…
The paper addresses missing data imputation issues by correcting for distribution shift.
problem Missing data imputation and the resulting distribution shift between observed and full data.
method Formulates imputation as a risk minimization problem and proposes a novel algorithm to correct for distribution shift.
result The proposed algorithm consistently improves imputation accuracy, reducing RMSE and Wasserstein distance by 3% and 7%, respectively.
Two new algorithms recover ridge lines from point clouds with convergence guarantees.
problem Extracting filamentary structure from point clouds.
method Proposes two novel algorithms with convergence guarantees.
result The algorithms can asymptotically recover the full ridge set.
Unified view of clustering algorithms presented.
problem Presenting a unified view of clustering algorithms.
method Identifying relationships between five clustering algorithms.
result A novel interpretation of DBSCAN as a climbing procedure.
A new method using mean shift clustering speeds up Bayesian evidence calculation.
problem Difficulty in Nested Sampling algorithm convergence and systematic errors.
method Mean shift cluster recognition method integrated into NestedFit.
result Significant reduction in computation time and uncertainty of Bayesian evidence.
TSFMs embed non-stationary time series data, revealing specific types of changes.
problem Understanding non-stationarity in TSFMs' embedding spaces.
method Examined mean shifts, variance changes, linear trends, and persistence in TSFMs.
result Different TSFMs exhibit distinct failure modes in detecting non-stationarity.
Proposes a new method to adapt to covariate shifts in supervised learning.
problem Covariate shift in training and testing samples with different marginal distributions.
method Minimax risk classification (MRC) approach that weights both training and testing samples.
result Significantly enhanced classification performance in synthetic and empirical experiments.