Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,657 papers · 148 categories

Trend · papers per month

153305458610 · Jun 202019922001200920172026
48 results for invariant information clustering

Deep generative models trained with large amounts of unlabelled data have proven to be powerful within the domain of unsupervised learning. Many real life data sets contain a small amount of labelled data points, that are typically disregarded when training generative models. We propose the Cluster-aware Generative Mod…

2017-04-03abs ↗pdf ↗

New knot invariants derived using quantum cluster algebras.

problem Deriving new knot invariants from quantum cluster algebras.
method Interpreting RR-matrix of Uq(sl2)U_q(\mathfrak{sl}_2) as cluster transformation, introducing auxiliary parameter εε.
result Derives perturbed-Alexander invariants with higher-order terms in εε.

Active learning optimizes correlation clustering by querying the most informative pairwise comparisons.

problem Efficiently clustering data with limited pairwise similarity information.
method Developed principled active learning approach using information-theoretic acquisition functions.
result Significantly outperforms existing baselines in clustering accuracy and query efficiency.

We propose a novel method for clustering data which is grounded in information-theoretic principles and requires no parametric assumptions. Previous attempts to use information theory to define clusters in an assumption-free way are based on maximizing mutual information between data and cluster labels. We demonstrate …

2013-10-15abs ↗pdf ↗

The information bottleneck (IB) approach to clustering takes a joint distribution P ⁣(X,Y)P\!\left(X,Y\right) and maps the data XX to cluster labels TT which retain maximal information about YY (Tishby et al., 1999). This objective results in an algorithm that clusters data points based upon the similarity of their condit…

2017-12-27abs ↗pdf ↗

Our work improves VAE latent space clustering by enforcing invariant and equivariant learning.

problem Current VAEs fail to learn invariant and equivariant clusters in latent space.
method We use a mixture model pdf like Gaussian mixtures to enforce deep, group-invariant learning and separate semantic and equivariant variables.
result Our model effectively learns to disentangle invariant and equivariant representations, improving learning rate and image recognition.

DHOG improves unsupervised clustering accuracy on image benchmarks.

problem Local optima in mutual information maximisation lead to suboptimal representations.
method Deep hierarchical object grouping (DHOG) computes multiple discrete representations in a hierarchical order.
result DHOG achieves new state-of-the-art results on three main benchmarks.

PatchGT uses non-trainable graph patches to improve graph representation learning.

problem Learning high-level information in graph tasks with direct Transformer models.
method PatchGT segments graphs into non-trainable patches, uses GNN for patch-level learning, and Transformer for graph-level learning.
result PatchGT achieves higher expressiveness and competitive performance on benchmark datasets.

Model selection in clustering requires (i) to specify a suitable clustering principle and (ii) to control the model order complexity by choosing an appropriate number of clusters depending on the noise level in the data. We advocate an information theoretic perspective where the uncertainty in the measurements quantize…

2010-06-02abs ↗pdf ↗

Proposes a method for multi-view clustering that integrates consistent and complementary graph regularizers.

problem Multi-view clustering where views have both consistent and complementary information.
method Consistent and complementary graph-regularized multi-view subspace clustering (GRMSC).
result The proposed method outperforms state-of-the-art methods on benchmark datasets.

Study examines the training process of an unsupervised learning model for detecting gravitational-wave transient noise.

problem Transient noise in gravitational-wave detector data causes instability and signal overlap.
method Unsupervised deep learning with variational autoencoder and invariant information clustering applied to the Gravity Spy dataset.
result Training process of the unsupervised learning architecture is examined and reported.

Paper introduces NICc for fast cluster-based validation of prediction models.

problem Validation of prediction models on clustered data.
method Derived NICc to approximate leave-one-cluster-out deviance for standard regression models.
result NICc provides more accurate model size and variable selection, especially with strong clustering.

Semi-supervised clustering aims to introduce prior knowledge in the decision process of a clustering algorithm. In this paper, we propose a novel semi-supervised clustering algorithm based on the information-maximization principle. The proposed method is an extension of a previous unsupervised information-maximization …

2013-04-30abs ↗pdf ↗

This paper introduces GEMINI, a new metric for unsupervised neural network training that avoids the need for regularizations.

problem The mutual information (MI) as a clustering objective does not lead to satisfactory clusters.
method The authors generalised the mutual information by changing its core distance, introducing the Generalised Mutual Information (GEMINI).
result Some GEMINIs do not require regularizations when training and can automatically select the number of clusters.

This paper focuses on obtaining clustering information about a distribution from its i.i.d. samples. We develop theoretical results to understand and use clustering information contained in the eigenvectors of data adjacency matrices based on a radial kernel function with a sufficiently fast tail decay. In particular, …

2008-07-23abs ↗pdf ↗

Graph InfoClust learns node representations by capturing cluster-level information, improving graph mining tasks.

problem Leveraging cluster-level node information for unsupervised graph representation learning.
method Graph InfoClust (GIC) uses a differentiable K-means method to compute clusters and jointly optimizes mutual information between nodes of the same cluster.
result GIC outperforms state-of-the-art methods in various downstream tasks with a 0.9% to 6.1% gain.

This paper introduces GEMINI, a new mutual information metric for unsupervised neural network training.

problem The mutual information (MI) as a clustering objective does not lead to satisfactory clusters.
method The authors generalised MI by changing its core distance, introducing GEMINIs that do not require regularizations and can automatically select the number of clusters.
result GEMINIs can automatically select the number of clusters without requiring a priori knowledge of the number of clusters.

In this paper we consider the problem of group invariant subspace clustering where the data is assumed to come from a union of group-invariant subspaces of a vector space, i.e. subspaces which are invariant with respect to action of a given group. Algebraically, such group-invariant subspaces are also referred to as su…

2015-10-15abs ↗pdf ↗

Multi-view clustering is an important yet challenging task due to the difficulty of integrating the information from multiple representations. Most existing multi-view clustering methods explore the heterogeneous information in the space where the data points lie. Such common practice may cause significant information …

2019-09-13abs ↗pdf ↗

New approach improves domain adaptation by enforcing cluster assumption in target domain.

problem Lack of robustness in target classifier due to violation of cluster assumption.
method Enforces cluster assumption in target domain (Target Consistency) paired with Class-Level InVariance.
result Significant improvement in image classification and segmentation benchmarks.

DGC clusters data with side-information for better prediction.

problem Improving clustering strategies through better prediction performance.
method Deep Goal-Oriented Clustering (DGC) framework that clusters data using supervision and unsupervised modeling.
result Achieves prediction accuracies comparable to state-of-the-art, while learning congruent clustering strategies.

Unified framework for comparing clusterings from information-theoretic and pair-counting perspectives.

problem Divergent evaluations of unsupervised models due to different clustering similarity measures.
method Developed an analytical framework that unifies pair-counting and information-theoretic clustering similarity measures.
result Unified framework clarifies when and why the two regimes diverge and provides a principled basis for selecting and interpreting clustering similarity measures.

GOLFS selects features for clustering by combining global and local information.

problem Feature selection for high-dimensional clustering without labels.
method Combines global and local information via manifold learning and regularized self-representation.
result Improves feature selection and clustering accuracy.

Unsupervised domain adaptation seeks to learn an invariant and discriminative representation for an unlabeled target domain by leveraging the information of a labeled source dataset. We propose to improve the discriminative ability of the target domain representation by simultaneously learning tightly clustered target …

2019-05-30abs ↗pdf ↗

Study finds price-based clustering outperforms AI and human methods in stock market analysis.

problem Investigates if AI can improve stock clustering compared to traditional methods.
method Compares price-based, human-informed, and AI-driven clustering methods using synthetic factor models.
result Price-based clustering reduces RMSE by 15.9% relative to GICS and 14.7% relative to LLM embeddings.

DIVI clusters noisy high-dimensional data with stable feature gating.

problem Challenging clustering in high-dimensional noisy data.
method Data-informed variational clustering framework combining global feature gating and adaptive structure growth.
result DIVI performs competitively under severe feature noise and remains computationally feasible.

In this study, a novel feature coding method that exploits invariance for transformations represented by a finite group of orthogonal matrices is proposed. We prove that the group-invariant feature vector contains sufficient discriminative information when learning a linear classifier using convex loss minimization. Ba…

2019-06-05abs ↗pdf ↗

Multi-view clustering has received much attention recently. Most of the existing multi-view clustering methods only focus on one-sided clustering. As the co-occurring data elements involve the counts of sample-feature co-occurrences, it is more efficient to conduct two-sided clustering along the samples and features si…

2019-05-25abs ↗pdf ↗

We introduce a simple permutation equivariant layer for deep learning with set structure.This type of layer, obtained by parameter-sharing, has a simple implementation and linear-time complexity in the size of each set. We use deep permutation-invariant networks to perform point-could classification and MNIST-digit sum…

2016-11-14abs ↗pdf ↗