Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,657 papers · 148 categories

Trend · papers per month

295887116 · Jun 202019922001200920172026
48 results for Instance-Adaptive Clustering

New algorithm IAC recovers hidden communities in labeled SBM with optimal performance.

problem Recovering hidden communities in Labeled Stochastic Block Model with varying cluster sizes.
method IAC (Instance-Adaptive Clustering) algorithm, consisting of spectral clustering and iterative likelihood-based improvements.
result IAC achieves optimal performance matching instance-specific lower bounds in expectation and with high probability.

Calibrated PRMs improve inference efficiency for LLMs by dynamically adjusting compute budgets.

problem Poor calibration of PRMs leads to overestimation of success probabilities in partial reasoning steps.
method Quantile regression for calibration, instance-adaptive scaling (IAS) framework.
result Calibrated PRMs reduce inference costs while maintaining accuracy, especially on confident problems.

This work provides uncertainty intervals for semantic latent variables in disentangled latent spaces.

problem Challenges in providing meaningful uncertainty quantification for semantic information in disentangled latent spaces.
method Uses quantile regression to output heuristic uncertainty intervals, calibrates these intervals to contain true latent values, and propagates them through the generator.
result Reliably communicates semantically meaningful, principled, and instance-adaptive uncertainty in image super-resolution and image completion.

A method predicts posterior PCs for faster uncertainty quantification in imaging.

problem Uncertainty visualization in image restoration models is limited by per-pixel variances.
method Neural Posterior Principal Components (NPPC) method for predicting PCs in a single forward pass.
result Orders of magnitude faster uncertainty quantification compared to posterior samplers.

AM-PPI uses multiple predictors to reduce label cost in healthcare AI.

problem Reduces label cost in post-deployment monitoring of healthcare AI.
method Combines model predictions with a small labeled sample, routing each instance to a cost-appropriate subset of predictors.
result Produces narrower confidence intervals than single-predictor methods.

Model financial network dynamics to avoid systemic risk.

problem Avoid systemic risk in financial networks.
method Model financial network as random liability graph, agents adapt strategies based on learning, analyze using ODE.
result Emerging strategies converge to evolutionary stable strategies (all risky or all less risky agents).

The paper proposes a method to improve random forest classification accuracy by weighting trees based on their decision path reliability.

problem Random forests' uniform voting fails to correct errors in regions where incorrect tree representations outnumber correct ones.
method The paper introduces using the structural pattern of each tree's decision path as an instance-adaptive reliability signal to identify and weight more reliable trees.
result Using the proposed method yields a statistically significant accuracy improvement over RF on 36 binary classification benchmarks.

Mode clustering is a nonparametric method for clustering that defines clusters using the basins of attraction of a density estimator's modes. We provide several enhancements to mode clustering: (i) a soft variant of cluster assignment, (ii) a measure of connectivity between clusters, (iii) a technique for choosing the …

2014-06-06abs ↗pdf ↗

Clustering is an essential data mining tool that aims to discover inherent cluster structure in data. For most applications, applying clustering is only appropriate when cluster structure is present. As such, the study of clusterability, which evaluates whether data possesses such structure, is an integral part of clus…

2018-08-24abs ↗pdf ↗

Clustering ensemble, or consensus clustering, has emerged as a powerful tool for improving both the robustness and the stability of results from individual clustering methods. Weighted clustering ensemble arises naturally from clustering ensemble. One of the arguments for weighted clustering ensemble is that elements (…

2019-10-06abs ↗pdf ↗

In many practical applications of clustering, the objects to be clustered evolve over time, and a clustering result is desired at each time step. In such applications, evolutionary clustering typically outperforms traditional static clustering by producing clustering results that reflect long-term trends while being ro…

2011-04-11abs ↗pdf ↗

Study examines how cluster number affects short-text clustering, introducing a stability metric.

problem Challenges in finding meaningful clusters in short-text data.
method Introduces a stability metric to determine cluster robustness and visualizes cluster subdivisions.
result Choosing a cluster number involves balancing informativeness and complexity, not seeking a single 'optimal' solution.

The paper improves on existing algorithms for minimizing different types of regret in online learning.

problem Minimizing external, internal, and swap regret in online learning with multiple experts.
method Develops a single algorithm using φ-regret minimization and Haar-wavelet-inspired matrix features to achieve optimal bounds in various scenarios.
result Achieves optimal bounds for external, internal, and swap regrets in different expert scenarios.

Convex clustering, a convex relaxation of k-means clustering and hierarchical clustering, has drawn recent attentions since it nicely addresses the instability issue of traditional nonconvex clustering methods. Although its computational and statistical properties have been recently studied, the performance of convex c…

2016-01-18abs ↗pdf ↗

Clustering is a central approach for unsupervised learning. After clustering is applied, the most fundamental analysis is to quantitatively compare clusterings. Such comparisons are crucial for the evaluation of clustering methods as well as other tasks such as consensus clustering. It is often argued that, in order to…

2017-01-23abs ↗pdf ↗

Clustering is one of the most universal approaches for understanding complex data. A pivotal aspect of clustering analysis is quantitatively comparing clusterings; clustering comparison is the basis for many tasks such as clustering evaluation, consensus clustering, and tracking the temporal evolution of clusters. In p…

2017-06-19abs ↗pdf ↗

A new distributed clustering framework using distributional kernel.

problem Clustering in distributed networks with arbitrary shapes, sizes, and densities.
method Distributed Clustering based on Distributional Kernel (KDC) using similarity of distributions.
result KDC guarantees equivalent clustering outcomes to centralized methods, reduces runtime, and discovers arbitrary clusters.

Skeleton clustering detects clusters in high-dimensional data without needing prototypes.

problem Detecting clusters in high-dimensional data with irregular shapes.
method Skeleton clustering combines prototype methods, density-based clustering, and hierarchical clustering using surrogate density measures.
result Skeleton clustering reliably detects clusters in multivariate and high-dimensional data.

Determining the number of clusters present in a dataset is an important problem in cluster analysis. Conventional clustering techniques generally assume this parameter to be provided up front. %user supplied. %Recently, robustness of any given clustering algorithm is analyzed to measure cluster stability/instability wh…

2019-11-20abs ↗pdf ↗

Exact cluster recovery with same-cluster queries for arbitrary ellipsoidal clusters.

problem Recovering clusters from same-cluster queries in arbitrary ellipsoidal clusters.
method Relaxing spherical kk-means assumption to arbitrary ellipsoidal clusters, designing an algorithm with logarithmic query complexity.
result Exact recovery of clusters using O(k3lnklnn)O(k^3 \ln k \ln n) queries and ildeO(kn+k3) ilde{O}(kn + k^3) time.

Paper proposes a new co-clustering method for overlapping clusters and outliers.

problem Real-world datasets often contain overlaps and outliers in co-clusters.
method Formulated Non-Exhaustive, Overlapping Co-Clustering problem and developed NEO-CC algorithm.
result NEO-CC algorithm effectively captures underlying co-clustering structure of real-world data.

The paper introduces group-representative clustering to ensure fair representation of different groups in clusters.

problem Ensuring fair representation of different groups in clusters.
method Developed a new clustering approach called group-representative clustering, which parallels fairness notions in classification.
result Presented approximation algorithms for group representative kk-median clustering and evaluated on real-world data.

Paper proposes a new clustering model that preserves cluster recovery with fewer dimensions.

problem Clustering high-dimensional data with limited embedding dimensions.
method Randomly projected convex clustering model with improved embedding dimension.
result Cluster recovery can be preserved with fewer dimensions, independent of data points.

Recently, deep clustering, which is able to perform feature learning that favors clustering tasks via deep neural networks, has achieved remarkable performance in image clustering applications. However, the existing deep clustering algorithms generally need the number of clusters in advance, which is usually unknown in…

2018-12-11abs ↗pdf ↗

With inspiration from Random Forests (RF) in the context of classification, a new clustering ensemble method---Cluster Forests (CF) is proposed. Geometrically, CF randomly probes a high-dimensional data cloud to obtain "good local clusterings" and then aggregates via spectral clustering to obtain cluster assignments fo…

2011-04-14abs ↗pdf ↗

We are often interested in clustering objects that evolve over time and identifying solutions to the clustering problem for every time step. Evolutionary clustering provides insight into cluster evolution and temporal changes in cluster memberships while enabling performance superior to that achieved by independently c…

2019-12-27abs ↗pdf ↗

A clustering may be considered as fair on pre-specified sensitive attributes if the proportions of sensitive attribute groups in each cluster reflect that in the dataset. In this paper, we consider the task of fair clustering for scenarios involving multiple multi-valued or numeric sensitive attributes. We propose a fa…

2019-10-11abs ↗pdf ↗

Here, we propose a clustering technique for general clustering problems including those that have non-convex clusters. For a given desired number of clusters KK, we use three stages to find a clustering. The first stage uses a hybrid clustering technique to produce a series of clusterings of various sizes (randomly se…

2015-03-04abs ↗pdf ↗