arXiv research

Tangles improve clustering in various datasets.

Dendrograms used in data analysis are ultrametric spaces, hence objects of nonarchimedean geometry. It is known that there exist $p$-adic representation of dendrograms. Completed by a point at infinity, they can be viewed as subtrees of the Bruhat-Tits tree associated to the $p$-adic projective line. The implications a…

New method uses dendrograms for better mixture model selection and clustering.

A conceptual framework for cluster analysis from the viewpoint of p-adic geometry is introduced by describing the space of all dendrograms for n datapoints and relating it to the moduli space of p-adic Riemannian spheres with punctures using a method recently applied by Murtagh (2004b). This method embeds a dendrogram …

Hierarchical graph clustering is a common technique to reveal the multi-scale structure of complex networks. We propose a novel metric for assessing the quality of a hierarchical clustering. This metric reflects the ability to reconstruct the graph from the dendrogram, which encodes the hierarchy. The optimal represent…

We derive a statistical model for estimation of a dendrogram from single linkage hierarchical clustering (SLHC) that takes account of uncertainty through noise or corruption in the measurements of separation of data. Our focus is on just the estimation of the hierarchy of partitions afforded by the dendrogram, rather t…

Hierarchical clustering uses OWA operators to generalize linkage methods and avoid dendrogram inversions.

We propose unsupervised representation learning and feature extraction from dendrograms. The commonly used Minimax distance measures correspond to building a dendrogram with single linkage criterion, with defining specific forms of a level function and a distance function over that. Therefore, we extend this method to …

This work introduces novel methods to identify and compare cycles across topological objects.

Previously, we proposed a physically-inspired method to construct data points into an effective in-tree (IT) structure, in which the underlying cluster structure in the dataset is well revealed. Although there are some edges in the IT structure requiring to be removed, such undesired edges are generally distinguishable…

Method preserves order in hierarchical clustering of ordered data.

Unified framework for SGMoE resolves estimation and selection issues.

Proposes a revenue function to evaluate dendrograms from comparisons.

This work improved clustering methods by analyzing various datasets and dendrograms.

We address the problem of computing a single linkage dendrogram. A possible approach is to: (i) Form an edge weighted graph $G$ over the data, with edge weights reflecting dissimilarities. (ii) Calculate the MST $T$ of $G$. (iii) Break the longest edge of $T$ thereby splitting it into subtrees $T_L$, $T_R$. (iv) Apply …

funLOCI identifies clusters in functional data.

Bagging and boosting are proved to be the best methods of building multiple classifiers in classification combination problems. In the area of "flat clustering" problems, it is also recognized that multi-clustering methods based on boosting provide clusterings of an improved quality. In this paper, we introduce a novel…

This paper characterizes hierarchical clustering methods that abide by two previously introduced axioms -- thus, denominated admissible methods -- and proposes tractable algorithms for their implementation. We leverage the fact that, for asymmetric networks, every admissible method must be contained between reciprocal …

Paper proposes a novel method to accurately determine the number of experts in Gaussian-gated Gaussian MoE models.

In the age of globalization, it is natural that the stock market of each country is not independent form the other markets. In this case, collective behavior could be emerged form their dependency together. This article studies the collective behavior of a set of forty influential markets in the world economy with the …

Here, we propose a clustering technique for general clustering problems including those that have non-convex clusters. For a given desired number of clusters $K$, we use three stages to find a clustering. The first stage uses a hybrid clustering technique to produce a series of clusterings of various sizes (randomly se…

A clustering algorithm based on the Hausdorff distance is introduced and compared to the single and complete linkage. The three clustering procedures are applied to a toy example and to the time series of financial data. The dendrograms are scrutinized and their features confronted. The Hausdorff linkage relies of firm…

cuSLINK clusters data faster on GPUs, saving space and time.

Employers actively look for talents having not only specific hard skills but also various soft skills. To analyze the soft skill demands on the job market, it is important to be able to detect soft skill phrases from job advertisements automatically. However, a naive matching of soft skill phrases can lead to false pos…

Soft labeling impacts OOD detection in neural networks.

Developed a new thresholding method that connects soft and hard thresholding.

Soft cells fill space without gaps, derived from minimal surfaces and deformed using edge bending.

This paper proposes a new dimensionality reduction algorithm named branching embedding (BE). It converts a dendrogram to a two-dimensional scatter plot, and visualizes the inherent structures of the original high-dimensional data. Since the conversion part is not computationally demanding, the BE algorithm would be ben…

ASBART accelerates Soft BART for faster Bayesian regression.

Maximum entropy deep reinforcement learning (RL) methods have been demonstrated on a range of challenging continuous tasks. However, existing methods either suffer from severe instability when training on large off-policy data or cannot scale to tasks with very high state and action dimensionality such as 3D humanoid l…

New method improves stability of soft FQI for offline RL.

Proposes HypCSE for enhanced hierarchical clustering.

Generalizes soft noncommutative schemes to flag varieties.

Paper proposes a new loss function for conditional models using soft targets.

Introduces Soft-SVM for binary classification bridging logistic and SVM.

Deep model learns from labeled and unlabeled data for industrial soft sensing.

New method constructs Floer homologies without hard analysis.

This paper introduces TNTK to study infinite soft tree ensembles.

Improves deep neural networks using soft labels through alternating minimization.

Hierarchical clustering is a class of algorithms that seeks to build a hierarchy of clusters. It has been the dominant approach to constructing embedded classification schemes since it outputs dendrograms, which capture the hierarchical relationship among members at all levels of granularity, simultaneously. Being gree…

The paper develops a multi-unit soft sensing model for virtual flow meters that improves few-shot learning.

In this article supervised learning problems are solved using soft rule ensembles. We first review the importance sampling learning ensembles (ISLE) approach that is useful for generating hard rules. The soft rules are then obtained with logistic regression from the corresponding hard rules. In order to deal with the p…

Recently, deep learning becomes the main focus of machine learning research and has greatly impacted many important fields. However, deep learning is criticized for lack of interpretability. As a successful unsupervised model in deep learning, the autoencoder embraces a wide spectrum of applications, yet it suffers fro…

Proposes a new method for deep ensembles that improves accuracy and calibration.

Bayesian neural networks update beliefs with soft evidence, improving accuracy and calibration.

A method for selecting pseudo-labeled data in semi-supervised learning using generalized Bayes and soft revision.

Framework uses machine learning to distinguish major COVID-19 variants.

MSLG generates soft labels to improve DNN performance on noisy datasets.