A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
Unsupervised method learns hierarchical graph representations without labels.
This paper improves disentanglement in VAEs by progressively learning hierarchical representations.
We learn hierarchical slate representations for collaborative filtering.
The joint optimization of representation learning and clustering in the embedding space has experienced a breakthrough in recent years. In spite of the advance, clustering with representation learning has been limited to flat-level categories, which often involves cohesive clustering with a focus on instance relations.…
Method learns hierarchical representations of samples and features simultaneously.
Bayesian algorithm improves word representations using semantic taxonomy.
Proposes a graph pooling method leveraging node proximity for hierarchical graph representation learning.
Proposes a hierarchical clustering method for positive and negative dissimilarities.
HCL learns shared and modality-specific latent representations for multimodal data.
We propose to learn a hierarchical prior in the context of variational autoencoders to avoid the over-regularisation resulting from a standard normal prior distribution. To incentivise an informative latent representation of the data, we formulate the learning problem as a constrained optimisation problem by extending …
Boxhead dataset tests autoencoder disentanglement in hierarchical data.
Representation learning has become an invaluable approach for learning from symbolic data such as text and graphs. However, while complex symbolic datasets often exhibit a latent hierarchical structure, state-of-the-art methods typically learn embeddings in Euclidean vector spaces, which do not account for this propert…
We propose a new method for learning word representations using hierarchical regularization in sparse coding inspired by the linguistic study of word meanings. We show an efficient learning algorithm based on stochastic proximal methods that is significantly faster than previous approaches, making it possible to perfor…
The paper uses deep learning to detect financial market regimes from correlation matrices.
Deep networks, composed of multiple layers of hierarchical distributed representations, tend to learn low-level features in initial layers and transition to high-level features towards final layers. Paradigms such as transfer learning, multi-task learning, and continual learning leverage this notion of generic hierarch…
The recently developed variational autoencoders (VAEs) have proved to be an effective confluence of the rich representational power of neural networks with Bayesian methods. However, most work on VAEs use a rather simple prior over the latent variables such as standard normal distribution, thereby restricting its appli…
Transformer models perform slower than convolutional networks in learning hierarchical language structures.
MHVAE learns cross-modality inference inspired by human cognition.
Deep networks learn hierarchical data by invariant representations.
MxPool learns graph features from diverse graphs using a hierarchical structure.
New measure shows how LSTM models compose hierarchical representations.
Hyperbolic space outperforms Euclidean in learning hierarchical data.
Recent work in learning ontologies (hierarchical and partially-ordered structures) has leveraged the intrinsic geometry of spaces of learned representations to make predictions that automatically obey complex structural constraints. We explore two extensions of one such model, the order-embedding model for hierarchical…
An important problem in multi-label classification is to capture label patterns or underlying structures that have an impact on such patterns. This paper addresses one such problem, namely how to exploit hierarchical structures over labels. We present a novel method to learn vector representations of a label space give…
Sharp theory of neural network scaling laws for hierarchical targets.
INVERT connects neural representations to human-understandable concepts.
We consider a set of probabilistic functions of some input variables as a representation of the inputs. We present bounds on how informative a representation is about input data. We extend these bounds to hierarchical representations so that we can quantify the contribution of each layer towards capturing the informati…
UNTIE learns representations of coupled categorical data.
Network embedding is a method to learn low-dimensional representation vectors for nodes in complex networks. In real networks, nodes may have multiple tags but existing methods ignore the abundant semantic and hierarchical information of tags. This information is useful to many network applications and usually very sta…
HiGraphDTI learns drug and target representations from molecular graphs to predict DTIs.
Deep learning explained through spectral filtering of hierarchical features.
We present a novel method that can learn a graph representation from multivariate data. In our representation, each node represents a cluster of data points and each edge represents the subset-superset relationship between clusters, which can be mutually overlapped. The key to our method is to use formal concept analys…
Representation learning is an essential problem in a wide range of applications and it is important for performing downstream tasks successfully. In this paper, we propose a new model that learns coupled representations of domains, intents, and slots by taking advantage of their hierarchical dependency in a Spoken Lang…
Neural networks benefit from intermediate representations, reducing sample complexity.
PointGMM learns hGMMs from point clouds for 3D shape representation.
By representing words with probability densities rather than point vectors, probabilistic word embeddings can capture rich and interpretable semantic information and uncertainty. The uncertainty information can be particularly meaningful in capturing entailment relationships -- whereby general words such as "entity" co…
DS2CF-Net learns hierarchical representations with deep coupled factorization and enriched prior.
In this work, we take a representation learning perspective on hierarchical reinforcement learning, where the problem of learning lower layers in a hierarchy is transformed into the problem of learning trajectory-level generative models. We show that we can learn continuous latent representations of trajectories, which…
Graph Neural Networks (GNNs), which generalize deep neural networks to graph-structured data, have drawn considerable attention and achieved state-of-the-art performance in numerous graph related tasks. However, existing GNN models mainly focus on designing graph convolution operations. The graph pooling (or downsampli…
Proposes EM-HRNN model for better hierarchical language representation.
DHRL learns interpretable features from visual data.
The paper extends fairness to hierarchical clustering, finding efficient algorithms with minimal loss.
Agent learns diverse hierarchical structures in unknown environments.
With the rapid increase of compound databases available in medicinal and material science, there is a growing need for learning representations of molecules in a semi-supervised manner. In this paper, we propose an unsupervised hierarchical feature extraction algorithm for molecules (or more generally, graph-structured…
Hierarchical graph clustering is a common technique to reveal the multi-scale structure of complex networks. We propose a novel metric for assessing the quality of a hierarchical clustering. This metric reflects the ability to reconstruct the graph from the dendrogram, which encodes the hierarchy. The optimal represent…
CNNs, RNNs, GCNs, and CapsNets have shown significant insights in representation learning and are widely used in various text mining tasks such as large-scale multi-label text classification. However, most existing deep models for multi-label text classification consider either the non-consecutive and long-distance sem…
Extends linear representation hypothesis to categorical and hierarchical concepts in LLMs.
SRHM explains deep learning's hierarchy and insensitivity to transformations.