The paper provides concentration bounds for embeddings of generative models.
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
Trend · papers per month
The paper establishes concentration bounds for embeddings of generative models.
Generative LLE modifies LLE to generate stochastic embeddings.
This work analyzes PPR-based node embeddings and their topological information.
Generalizes embedding complex Grassmannians into quadrics.
Defines coupled embeddability for maps on products of spaces, generating examples and nonexamples.
Paper studies embedding conditions for homogeneous quandles.
In this paper new general modewise Johnson-Lindenstrauss (JL) subspace embeddings are proposed that are both considerably faster to generate and easier to store than traditional JL embeddings when working with extremely large vectors and/or tensors. Corresponding embedding results are then proven for two different type…
Author2Vec generates user embeddings from social media data.
Maps can be embedded in higher dimensions if they lift to embeddings in product spaces.
For leveled spatial graphs, we find a surface embedding that allows cellular embedding.
New method neutralizes gender bias in word embeddings without losing semantic information.
A graph embedding is a representation of graph vertices in a low-dimensional space, which approximately preserves properties such as distances between nodes. Vertex sequence-based embedding procedures use features extracted from linear sequences of nodes to create embeddings using a neural network. In this paper, we pr…
Network embedding has proved extremely useful in a variety of network analysis tasks such as node classification, link prediction, and network visualization. Almost all the existing network embedding methods learn to map the node IDs to their corresponding node embeddings. This design principle, however, hinders the ex…
In this paper we study the embedding of Riemannian manifolds in low codimension. The well-known result of Nash and Kuiper says that any short embedding in codimension one can be uniformly approximated by isometric embeddings. This statement clearly cannot be true for embeddings in general, due to the classi…
New proof shows no Hölder embeddings into Heisenberg group.
Recently, click-through rate (CTR) prediction models have evolved from shallow methods to deep neural networks. Most deep CTR models follow an Embedding\&MLP paradigm, that is, first mapping discrete id features, e.g. user visited items, into low dimensional vectors with an embedding module, then learn a multi-layer pe…
This paper tightens the generalization error bound for graph embedding in non-Euclidean spaces.
The performance of many network learning applications crucially hinges on the success of network embedding algorithms, which aim to encode rich network information into low-dimensional vertex-based vector representations. This paper considers a novel variational formulation of network embeddings, with special focus on …
Models use embeddings and attention for better claim severity prediction.
In this paper, we show that, under arbitrary bounded Willmore energy assumption, embedded Willmore spheres (or more generally, embedded Willmore spheres under area constraint) with small diameter in a given -dimensional Riemannian manifold necessarily concentrate at a critical point of the scalar curvature …
DiSeNE generates interpretable node embeddings without supervision.
Audio features have been proven useful for increasing the performance of automated topic segmentation systems. This study explores the novel task of using audio embeddings for automated, topically coherent segmentation of radio shows. We created three different audio embedding generators using multi-class classificatio…
CR embeddings in complex spaces for specific Lie groups.
New method detects and analyzes correlation in multiple network data.
We give a solution to the equivalence and the embedding problems for smooth CR-submanifolds of complex spaces (and, more generally, for abstract CR-manifolds) in terms of complete differential systems in jet bundles satisfied by all CR-equivalences or CR-embeddings respectively (local and global). For the equivalence p…
Deep metric learning is often used to learn an embedding function that captures the semantic differences within a dataset. A key factor in many problem domains is how this embedding generalizes to new classes of data. In observing many triplet selection strategies for Metric Learning, we find that the best performance …
Unified framework for word embedding models using noise examples.
In this paper, by using analytical methods we obtain a generalization of the famous Kodaira embedding theorem.
PGEL learns embeddings to diversify protein motifs while maintaining biological function.
This paper improves topic modeling by embedding words and topics together.
We introduce -regular maps, which generalize two previously studied classes of maps: affinely -regular maps and totally skew embeddings. We exhibit some explicit examples and obtain bounds on the least dimension of a Euclidean space into which a manifold can be embedded by a -regular map. The problem c…
Extends graph encoder embedding to weighted graphs and matrices.
Conventional text classification models make a bag-of-words assumption reducing text into word occurrence counts per document. Recent algorithms such as word2vec are capable of learning semantic meaning and similarity between words in an entirely unsupervised manner using a contextual window and doing so much faster th…
Network representation learning in low dimensional vector space has attracted considerable attention in both academic and industrial domains. Most real-world networks are dynamic with addition/deletion of nodes and edges. The existing graph embedding methods are designed for static networks and they cannot capture evol…
We introduce a new multi-dimensional nonlinear embedding -- Piecewise Flat Embedding (PFE) -- for image segmentation. Based on the theory of sparse signal recovery, piecewise flat embedding with diverse channels attempts to recover a piecewise constant image representation with sparse region boundaries and sparse clust…
Generalized Tanaka prolongation ensures convergence of formal embeddings of complex manifolds.
We introduce a notion of fibred coarse embedding into Hilbert space for metric spaces, which is a generalization of Gromov's notion of coarse embedding into Hilbert space. It turns out that a large class of expander graphs admit such an embedding. We show that the maximal coarse Baum-Connes conjecture holds for metric …
This work optimizes induced correlation in joint graph embeddings.
Click-through rate (CTR) prediction has been one of the most central problems in computational advertising. Lately, embedding techniques that produce low-dimensional representations of ad IDs drastically improve CTR prediction accuracies. However, such learning techniques are data demanding and work poorly on new ads w…
BERT embeddings improve sequence quality metrics.
With the great success of graph embedding model on both academic and industry area, the robustness of graph embedding against adversarial attack inevitably becomes a central problem in graph learning domain. Regardless of the fruitful progress, most of the current works perform the attack in a white-box fashion: they n…
The paper proves isometric embeddings for smooth manifolds.
Isometric embeddings of Teichmüller spaces are derived from branched coverings.
Unsupervised text embedding has shown great power in a wide range of NLP tasks. While text embeddings are typically learned in the Euclidean space, directional similarity is often more effective in tasks such as word similarity and document clustering, which creates a gap between the training stage and usage stage of t…
Arnlind, Hoppe and Huisken showed how to express the Gauss and mean curvature of a surface embedded in a Riemannian manifold in terms of Poisson brackets of the embedding coordinates. We generalize these expressions to the pseudo-Riemannian setting and derive explicit formulas for the case of surfaces embedded in $\R^m…
Word embedding models have become a fundamental component in a wide range of Natural Language Processing (NLP) applications. However, embeddings trained on human-generated corpora have been demonstrated to inherit strong gender stereotypes that reflect social constructs. To address this concern, in this paper, we propo…
New families of embeddings in 4-manifolds, topologically trivial but smoothly non-trivial.