Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,657 papers · 148 categories

Trend · papers per month

163327490653 · Jun 202019922001200920172026
48 results for clustering efficiency

Efficient clustering for large datasets using a sampling-based approach.

problem Clustering high-dimensional data with a large number of clusters efficiently.
method A simple and efficient clustering method that evaluates distances of data points with a subset of cluster centers.
result Optimal solutions of the approximation are the same as in the exact solution, but more efficient at extracting clusters.

This paper proposes a spectral clustering algorithm for hyperbolic spaces, improving efficiency over Euclidean methods.

problem Inefficient clustering in Euclidean spaces for complex data structures.
method Developed a spectral clustering algorithm using hyperbolic similarity matrices.
result The algorithm converges at least as fast as Euclidean spectral clustering and performs better on complex datasets.

KCoreMotif clusters large networks efficiently by exploiting k-core decomposition and motifs.

problem Efficiently clustering large networks for trust evaluation.
method Exploits k-core decomposition and motifs to perform motif-based spectral clustering on k-core subgraphs.
result The proposed algorithm is accurate and efficient for large networks.

Unified framework for efficient Frank-Wolfe optimization of Dominant Set Clustering.

problem Optimizing Dominant Set Clustering with various Frank-Wolfe algorithms.
method Unified framework for pairwise, standard, and away-steps Frank-Wolfe algorithms, with explicit convergence rates.
result Explicit convergence rates for Frank-Wolfe methods in Dominant Set Clustering.

We propose a deep amortized clustering (DAC), a neural architecture which learns to cluster datasets efficiently using a few forward passes. DAC implicitly learns what makes a cluster, how to group data points into clusters, and how to count the number of clusters in datasets. DAC is meta-learned using labelled dataset…

2019-09-30abs ↗pdf ↗

This paper represents a preliminary (pre-reviewing) version of a sublinear variational algorithm for isotropic Gaussian mixture models (GMMs). Further developments of the algorithm for GMMs with diagonal covariance matrices (instead of isotropic clusters) and their corresponding benchmarking results have been published…

2018-10-01abs ↗pdf ↗

New algorithm for clustering with faulty oracle achieves optimal queries and efficiency.

problem Clustering with a faulty oracle, especially for multiple clusters.
method Built on stochastic block model, provides nearly-optimal query complexity.
result Time-efficient algorithm with nearly-optimal query complexity for all constant k and any δ.

We survey agglomerative hierarchical clustering algorithms and discuss efficient implementations that are available in R and other software environments. We look at hierarchical self-organizing maps, and mixture models. We review grid-based clustering, focusing on hierarchical density-based approaches. Finally we descr…

2011-04-30abs ↗pdf ↗

Active learning optimizes correlation clustering by querying the most informative pairwise comparisons.

problem Efficiently clustering data with limited pairwise similarity information.
method Developed principled active learning approach using information-theoretic acquisition functions.
result Significantly outperforms existing baselines in clustering accuracy and query efficiency.

This paper focuses on scalability and robustness of spectral clustering for extremely large-scale datasets with limited resources. Two novel algorithms are proposed, namely, ultra-scalable spectral clustering (U-SPEC) and ultra-scalable ensemble clustering (U-SENC). In U-SPEC, a hybrid representative selection strategy…

2019-03-04abs ↗pdf ↗

The paper extends fairness to hierarchical clustering, finding efficient algorithms with minimal loss.

problem Ensuring fairness in hierarchical clustering where data is recursively partitioned.
method Extending fairness to hierarchical clustering, developing simple, efficient algorithms for various objectives.
result Simple, efficient algorithms for fair hierarchical clustering with only a negligible loss in objective.

A new algorithm COVA-FC improves subgroup-fair clustering efficiency.

problem Challenges in making cluster assignments independent of sensitive attributes in subgroups.
method Defining a subgroup-fairness gap, deriving a covariance-based surrogate, and introducing a continuous relaxation for efficient optimization.
result COVA-FC achieves competitive cost-fairness trade-offs and improves computational efficiency.

This paper improves spectral clustering for large datasets using the Nystrom method.

problem Spectral clustering's scalability issues with large datasets.
method A principled spectral clustering algorithm exploiting Nystrom approximation's spectral properties.
result Improved spectral clustering efficiency and accuracy compared to existing methods.

A new algorithm for efficient clustered federated learning.

problem Federated learning with clustered users having different learning tasks.
method Iterative Federated Clustering Algorithm (IFCA) that alternates cluster estimation and model parameter optimization.
result IFCA converges with good initialization and guarantees optimal statistical error rate.

Measuring similarity between two objects is the core operation in existing clustering algorithms in grouping similar objects into clusters. This paper introduces a new similarity measure called point-set kernel which computes the similarity between an object and a set of objects. The proposed clustering procedure utili…

2020-02-14abs ↗pdf ↗

Spectral clustering improves accuracy and efficiency for clustering discrete distributions.

problem Inaccurate clustering of discrete distributions using traditional methods.
method Spectral clustering combined with distribution affinity measures (MMD, Wasserstein distance) and linear optimal transport.
result Spectral clustering outperforms traditional methods in accuracy and efficiency.

Co-Clustering, the problem of simultaneously identifying clusters across multiple aspects of a data set, is a natural generalization of clustering to higher-order structured data. Recent convex formulations of bi-clustering and tensor co-clustering, which shrink estimated centroids together using a convex fusion penalt…

2019-01-18abs ↗pdf ↗

Efficiently clusters data sequences with varying distributions.

problem Sequentially grouping data sequences with fixed error probability.
method Proposes Efficient Bandit Clustering (EBC) algorithm for asymptotic optimality and computational efficiency.
result EBC and EBC-H achieve better performance and computational efficiency compared to existing methods.

In this short communication we introduce the quick clustering algorithm (QUIST), an efficient hierarchical clustering algorithm based on sorting. QUIST is a poly-logarithmic divisive clustering algorithm that does not assume the number of clusters, and/or the cluster size to be known ahead of time. It is also insensiti…

2016-06-01abs ↗pdf ↗

Subspace clustering aims to cluster unlabeled data that lies in a union of low-dimensional linear subspaces. Deep subspace clustering approaches based on auto-encoders have become very popular to solve subspace clustering problems. However, the training of current deep methods converges slowly, which is much less effic…

2019-10-12abs ↗pdf ↗

A new, efficient kk-modes algorithm improves clustering of categorical data.

problem Clustering categorical data using existing methods like kk-means is inefficient.
method Developed a novel kk-modes algorithm called OTQT, which improves on existing methods.
result OTQT finds more accurate clusters per iteration and is faster overall.

Efficient algorithm for clustering and classification using MBO scheme.

problem Data clustering and classification tasks.
method Introduces constraints on cluster size leading to a linear integer problem, proving it's induced by a novel order statistic. Develops exact and efficient algorithms based on variational viewpoint connecting to volume-preserving mean curvature flow.
result Estimates computational complexity better than state-of-the-art, proving rigorous analysis.

Clustering is an essential data mining tool that aims to discover inherent cluster structure in data. As such, the study of clusterability, which evaluates whether data possesses such structure, is an integral part of cluster analysis. Yet, despite their central role in the theory and application of clustering, current…

2016-02-22abs ↗pdf ↗

New clustering algorithm for mixed data improves applicability and efficiency.

problem Clustering large, mixed data with improved accuracy and efficiency.
method Developed a new clustering algorithm using peak-finding technique, reducing computational complexity.
result Algorithm detects outliers, clusters of lower density, and determines correct number of clusters.

RKD improves clustering in semi-supervised learning with limited labels.

problem Improving clustering accuracy in semi-supervised learning with few labeled examples.
method RKD as spectral clustering on a teacher model's graph, with clustering error quantification.
result RKD provably leads to low clustering error in semi-supervised classification problems.

Unsupervised clustering of curves according to their shapes is an important problem with broad scientific applications. The existing model-based clustering techniques either rely on simple probability models (e.g., Gaussian) that are not generally valid for shape analysis or assume the number of clusters. We develop an…

2015-04-01abs ↗pdf ↗

Introduces robust convex clustering with Median of Means for better data clustering.

problem Challenges in convex clustering with high-dimensional data and noise/outliers.
method Integrates convex clustering with Median of Means estimator for robustness and efficiency.
result Enhanced clustering performance on large-scale datasets compared to existing methods.

Efficient algorithms find solutions in a rare well-connected cluster at low constraint densities.

problem Finding solutions in the symmetric binary perceptron at low density.
method Formal proof of existence of a subdominant connected cluster and application of an efficient multiscale majority algorithm.
result An efficient algorithm can find solutions in a subdominant connected cluster with high probability.

Dynamic tensor data are becoming prevalent in numerous applications. Existing tensor clustering methods either fail to account for the dynamic nature of the data, or are inapplicable to a general-order tensor. Also there is often a gap between statistical guarantee and computational efficiency for existing tensor clust…

2017-08-24abs ↗pdf ↗

Hierarchical clustering is a widely used approach for clustering datasets at multiple levels of granularity. Despite its popularity, existing algorithms such as hierarchical agglomerative clustering (HAC) are limited to the offline setting, and thus require the entire dataset to be available. This prohibits their use o…

2019-09-20abs ↗pdf ↗

Study efficient inference for network quantile causal effects with partial interference.

problem Estimating network causal effects on outcome quantiles with partial interference.
method Developed a nonparametric efficiency theory and a nonparametrically efficient estimator using a three-way cross-fitting procedure.
result Proposed estimator is consistent, asymptotically normal, and allows flexible estimation of nuisance functions.