New faster, space-saving methods for subspace embeddings in tensors.
problem Efficiently embedding large tensors with fewer random bits.
method Modewise Johnson-Lindenstrauss embeddings for rank-r tensors. result Improved space complexity for tensor subspaces with fewer random bits.
In this paper, we propose a Tensor Train Neighborhood Preserving Embedding (TTNPE) to embed multi-dimensional tensor data into low dimensional tensor subspace. Novel approaches to solve the optimization problem in TTNPE are proposed. For this embedding, we evaluate novel trade-off gain among classification, computation…
Most popular word embedding techniques involve implicit or explicit factorization of a word co-occurrence based matrix into low rank factors. In this paper, we aim to generalize this trend by using numerical methods to factor higher-order word co-occurrence based arrays, or \textit{tensors}. We present four word embedd…
A new method combines multiple node embeddings using tensor decomposition.
problem Generating accurate node embeddings for complex networks.
method TenSemble2Vec: combines multiple embeddings via tensor decomposition.
result Improves node embeddings by leveraging complementary information from different methods.
The study analyzes XRP transaction networks to understand market dynamics.
problem Understanding market dynamics of XRP through transaction data.
method Weekly weighted directed networks are embedded into a vector space using network embedding techniques. A correlation tensor is calculated and analyzed using singular value decomposition.
result The correlation tensor provides insights into the system's behavior and dependence on model parameters.
DEMOTE uses neural diffusion-reaction processes to capture temporal dynamics in sparse tensor data.
problem Sparse and temporally associated tensor data with limited structural knowledge.
method Develops a neural diffusion-reaction process to estimate dynamic embeddings for tensor modes.
result Captures both commonalities and personalities in evolving tensor entries.
This work improves tensor decomposition methods, especially for large datasets.
problem Lack of efficient methods for estimating Tucker decompositions.
method Applies Johnson-Lindenstrauss type guarantees to Tucker decompositions with random embeddings.
result Effective dimension reduction with minimal error for large tensors.
New invariant metrics preserved under deformed Markov embeddings.
problem Preserving invariance in probability measure spaces under deformed embeddings.
method Deforming Markov embeddings while maintaining sufficiency, proving existence and uniqueness of invariant families.
result Existence and uniqueness of invariant families of tensor fields under deformed embeddings.
New tensors capture intrinsic embedding data of conformal hypersurfaces.
problem Classifying hypersurface invariants in conformal manifolds.
method Constructing curvatures and conformal fundamental forms.
result Finite family of tensors captures extrinsic embedding data.
Explores tensor products in hyperdimensional computing.
problem Understanding tensor products in hyperdimensional computing.
method Generalized results from graph embeddings to vector symbolic architectures and hyperdimensional computing.
result Tensor product is the most general and expressive representation with errorless unbinding and detection.
Word embedding is a powerful tool in natural language processing. In this paper we consider the problem of word embedding composition \--- given vector representations of two words, compute a vector for the entire phrase. We give a generative model that can capture specific syntactic relations between words. Under our …
Tensoring p-weak differentiable structures preserves their properties.
problem Tensorization of p-weak differentiable structures. method Proving the product of p-weak charts is a p-weak chart, and showing isometric embeddings. result Tensorization of p-weak differentiable structures is possible under certain conditions. We construct an algebra of nonlinear generalized tensor fields on manifolds in the sense of J.-F. Colombeau, i.e., containing distributional tensor fields as a linear subspace and smooth tensor fields as a faithful subalgebra. The use of a background connection on the manifold allows for a simplified construction based…
We present a family of novel methods for embedding knowledge graphs into real-valued tensors. These tensor-based embeddings capture the ordered relations that are typical in the knowledge graphs represented by semantic web languages like RDF. Unlike many previous models, our methods can easily use prior background know…
Extends nonlinear theory of distributional geometry.
problem Developing a theory for nonsmooth differential geometry.
method Extending Colombeau theory to tensor fields, introducing Lie derivative and covariant derivative, defining generalised metric.
result Preserves Einstein equations and curvature of cones in nonsmooth geometry.
Develops tensor calculus for submanifolds of arbitrary codimension.
problem Tensor calculus on evolving submanifolds with arbitrary codimension.
method Extrinsic, parametrization-free tensor calculus.
result Derives new conservation laws and tensorial energy expressions.
We use the Nash embedding theorem to construct generators for the space of algebraic covariant derivative curvature tensors.
The study evaluates memory and capacity of graph embedding methods.
problem Assessing the memory and capacity of graph embedding methods.
method Not specified in the abstract provided.
result Not specified in the abstract provided.
Research explores the space-like embeddings in pseudo-hyperbolic space, finding geometric frames and actions.
problem Flat maximal space-like embeddings in pseudo-hyperbolic space.
method Description of Codazzi tensors, introduction of pseudo-Kähler metrics, Hamiltonian actions, moment maps, and geometric frames.
result Existence of two Hamiltonian actions with moment maps and geometric global Darboux frame.
Proposes BHT-ARIMA for forecasting multiple short time series.
problem Forecasting multiple short time series with mutual correlations.
method Block Hankel tensors, Tucker decomposition, generalized tensor ARIMA.
result Improves forecasting accuracy and reduces computational cost.
Knowledge graphs contain knowledge about the world and provide a structured representation of this knowledge. Current knowledge graphs contain only a small subset of what is true in the world. Link prediction approaches aim at predicting new links for a knowledge graph given the existing links among the entities. Tenso…
MEI model improves knowledge graph completion by efficiently modeling interactions between embeddings.
problem Efficiently modeling interactions between knowledge graph embeddings to predict missing links.
method MEI divides embeddings into partitions and uses Tucker and block term formats to model interactions efficiently.
result Achieves state-of-the-art performance on link prediction tasks.
TACE unifies scalar and tensorial modeling in Cartesian space for accurate, stable, and efficient atomistic predictions.
problem Complexity and challenges in equivariant atomistic machine learning models.
method Tensor Atomic Cluster Expansion (TACE) in Cartesian space, decomposing local environments into irreducible Cartesian tensors (ICT).
result Universal invariant and equivariant embeddings, enabling explicit control at inference.
A new method reduces the complexity of tensor products from cubic to quadratic, improving both speed and accuracy.
problem Efficiently computing high-dimensional tensor products for polynomial kernels.
method Complex-to-Real (CtR) modification of sketches using complex random projections.
result Achieves state-of-the-art performance in accuracy and speed.
A new method for embedding sparse high-order interactions.
problem Learning embeddings from sparse high-order interaction events.
method Hybridizing sparse hypergraph and matrix Gaussian processes.
result Strong asymptotic bounds on sparsity ratio.
Proposes a novel tensor-based approach for multi-level link prediction.
problem Inferring potential links from observed networks.
method Tensor-based joint network embedding capturing pairwise and hyperlinks.
result Improves hyperlink and pairwise link prediction accuracy.
Meta-graph is currently the most powerful tool for similarity search on heterogeneous information networks,where a meta-graph is a composition of meta-paths that captures the complex structural information. However, current relevance computing based on meta-graph only considers the complex structural information, but i…
Introduces tensor product for quiver representations and applies to stable bundles and character varieties.
problem Stability and classification of quiver bundles and their subvarieties.
method Definition of tensor product for quiver representations and application to stability and character varieties.
result Tensor products of polystable quiver bundles are polystable and provide insights into character varieties.
The popular Alternating Least Squares (ALS) algorithm for tensor decomposition is efficient and easy to implement, but often converges to poor local optima---particularly when the weights of the factors are non-uniform. We propose a modification of the ALS approach that is as efficient as standard ALS, but provably rec…
Tensorized Rademacher projections outperform Gaussian projections in reducing tensor dimensions.
problem Reducing the dimension of high-dimensional tensors for machine learning.
method Tensorized Rademacher random projections using Tensor Train decomposition.
result Tensorized Rademacher projections can replace Gaussian projections in tensor compression.
TM-GCN learns dynamic graph embeddings using tensor algebra.
problem Handling dynamic graphs in graph neural networks.
method Tensor M-product for dynamic graph convolution.
result TM-GCN outperforms existing methods on edge classification and link prediction.
In this paper, we exhibit the tradeoffs between the (training) sample, computation and storage complexity for the problem of supervised classification using signal subspace estimation. Our main tool is the use of tensor subspaces, i.e. subspaces with a Kronecker structure, for embedding the data into lower dimensions. …
Network analysis of human brain connectivity is critically important for understanding brain function and disease states. Embedding a brain network as a whole graph instance into a meaningful low-dimensional representation can be used to investigate disease mechanisms and inform therapeutic interventions. Moreover, by …
Given an integral symplectic manifold, we construct a family of "coherent state" maps into complex projective space. The maps are built from sections of the tensor powers of a hermitian line bundle whose curvature is a multiple of the symplectic form. We show that this family is an almost-complex version of the Kodiara…
Holomorphic tensors on algebraic cones are invariant under certain group actions.
problem Holomorphic tensors on products of algebraic cones
method Using algebraic structures and embeddings
result Holomorphic tensors are invariant under group actions
Paper proves conditions for 3D submanifolds to embed in 4D space.
problem Conditions for 3D Riemannian submanifolds to embed in R4. method Used symbolic method from classical invariant theory.
result Two known intrinsic conditions are sufficient for embedding.
Paper explores duality in DPPs using embedding structure analysis.
problem Understanding the geometric structure of determinantal point processes.
method Analyzes the exponential family embedding of DPPs and uses the e-embedding curvature tensor.
result Discovers the duality between marginal and L-ensemble kernels.
Proposes a new graph representation method using tensor products.
problem Dynamic graph representation and theoretical properties.
method Bind-and-sum approach in hyperdimensional computing (HDC), tensor product as binding operation.
result Memory vs. size analysis of graph representation size scaling.
The paper proves local isometric embeddings for singular metrics near a point.
problem Existence of local isometric embeddings for singular Riemannian metrics.
method Ramified local isometric embeddings using Leray's ramified Cauchy-Kovalevskaya Theorem.
result Existence of local analytic isometric embeddings into Euclidean space.
MARS automatically selects tensor decomposition ranks, improving performance in neural network tasks.
problem Determining optimal decomposition ranks in tensor decompositions.
method MARS uses binary masks to learn optimal tensor structure during training via relaxed MAP estimation.
result MARS achieves better results than previous methods in various tasks.
Many features of dimensional reduction schemes are determined by the breaking of higher dimensional general covariance associated with the selection of a particular subset of coordinates. By investigating residual covariance we introduce lower dimensional tensors --generalizing to one side Kaluza-Klein gauge fields and…
Paper learns meaningful state and action representations from MDP trajectories.
problem Learning good state and action representations from MDP trajectories.
method Tensor decomposition, kernelization, importance sampling, low-Tucker-rank approximation.
result The learned state/action abstractions provide accurate approximations to latent block structures.
Defines constraint tensor for null hypersurfaces, providing explicit geometry.
problem Defining constraint tensor for null hypersurfaces with any topology.
method Explicit definition in extrinsic geometry, covariant for any topology.
result Simple form of constraint tensor on transverse submanifolds.
We consider a compact CR manifold with a transversal CR locally free circle action endowed with a rigid positive CR line bundle. We prove that a certain weighted Fourier-Szegő kernel of the CR sections in the high tensor powers admits a full asymptotic expansion. As a consequence, we establish an equivariant Kodaira em…
Geometric calculus introduced on pseudo-Riemannian manifolds without embedding.
problem Developing calculus on pseudo-Riemannian manifolds without embedding.
method Direct axiomatic approach to geometric calculus, paralleling general relativity.
result Full theory of differential calculus for vector, multivector, and tensor fields developed.
We suggest a new, alternative algebraic method for computation of geometrical quantities by means of the embedding of local loops into Lie groups.
The paper defines and studies the geometric mean for tensors and its associated Riemannian geometry.
problem Defining and studying the geometric mean for tensors.
method Generalized geometric mean for tensors using T-product, verified properties, and investigated Riemannian manifold.
result Geometric mean of T-positive definite tensors is a unique solution of algebraic Riccati tensor equations and a midpoint of geodesics.
New tensors help determine if metrics are related to Poincaré-Einstein ones.
problem Determining when metrics on conformally compact manifolds are related to Poincaré-Einstein metrics.
method Developed new tensors and used conformal tractor calculus to analyze metrics.
result The vanishing of these new tensors is a necessary and sufficient condition for a metric to be related to a Poincaré-Einstein metric.