A tensor model for meta-learning adapts to task-specific features.
problem Learning shared representations for diverse tasks without task-specific observable information.
method Modeling meta-parameters as an order-3 tensor, estimating through tensor regression and method of moments.
result Tensor-based approach improves meta-learning performance with fewer samples.
Explores tensor products in hyperdimensional computing.
problem Understanding tensor products in hyperdimensional computing.
method Generalized results from graph embeddings to vector symbolic architectures and hyperdimensional computing.
result Tensor product is the most general and expressive representation with errorless unbinding and detection.
Paper develops a method for causal representation learning from irregular tensors.
problem Complex patterns in high-dimensional, irregular tensor data.
method Novel causal formulation and CaRTeD framework integrating temporal causal representation learning with irregular tensor decomposition.
result Framework provides theoretical guarantees and outperforms state-of-the-art techniques.
Paper learns meaningful state and action representations from MDP trajectories.
problem Learning good state and action representations from MDP trajectories.
method Tensor decomposition, kernelization, importance sampling, low-Tucker-rank approximation.
result The learned state/action abstractions provide accurate approximations to latent block structures.
Paper develops a method to robustly cluster tensors with outliers.
problem Clustering tensors contaminated by outliers or sample-specific corruptions.
method Transformed Tensor Low-Rank Representation (OR-TLRR) method.
result Provably recovers row space of clean data and detects outliers.
The report analyzes Legendre decomposition for tensor data.
problem Finding effective lower dimensional representations of tensors.
method Theoretical analysis of dual parameters and dually flat manifold properties, followed by experimental verification and clustering.
result Parameters on submanifold cannot be directly used as low-rank representations.
Introduces tensor product for quiver representations and applies to stable bundles and character varieties.
problem Stability and classification of quiver bundles and their subvarieties.
method Definition of tensor product for quiver representations and application to stability and character varieties.
result Tensor products of polystable quiver bundles are polystable and provide insights into character varieties.
T-Basis represents neural network tensors with fewer parameters.
problem Efficiently representing neural network tensors with fewer parameters.
method T-Basis uses Tensor Rings to represent tensors in a neural network, parameterizing them with a small number of coefficients.
result T-Basis achieves high compression rates with minimal performance loss.
There has been an increased interest in multimodal language processing including multimodal dialog, question answering, sentiment analysis, and speech recognition. However, naturally occurring multimodal data is often imperfect as a result of imperfect modalities, missing entries or noise corruption. To address these c…
Proposes a new graph representation method using tensor products.
problem Dynamic graph representation and theoretical properties.
method Bind-and-sum approach in hyperdimensional computing (HDC), tensor product as binding operation.
result Memory vs. size analysis of graph representation size scaling.
The paper explores tensor decompositions in deep learning models.
problem Compressing parameter space and creating richer representations.
method Tensor decompositions applied to deep learning models.
result Tensor methods can yield richer adaptive representations of complex data.
The increasing use of multiple sensors, which produce a large amount of multi-dimensional data, requires efficient representation and classification methods. In this paper, we present a new method for multi-dimensional data classification that relies on two premises: 1) multi-dimensional data are usually represented by…
The paper describes a fine representation of the Ricci tensor and Hessian on RCD spaces.
problem Understanding the structure of the Ricci tensor and Hessians on RCD spaces.
method Polar decomposition of the Ricci tensor and Hessians, providing regularity results.
result The Ricci tensor and Hessians on RCD spaces can be represented by a polar decomposition, revealing their regularity.
We derive the quantum Teichmüller space, previously constructed by Kashaev and by Fock and Chekhov, from tensor products of a single canonical representation of the modular double of the quantum plane. We show that the quantum dilogarithm function appears naturally in the decomposition of the tensor square, the quantum…
We provide an explicit algorithm to calculate invariant tensors for the adjoint representation of the simple Lie algebra sl(n), as well as arbitrary representation in terms of roots. We also obtain explicit formulae for the adjoint representations of the orthogonal and symplectic Lie algebras so(n) and sp(n).
Tensor neural network improves human pose classification from 3D skeleton data.
problem Efficiently processing spatiotemporal data for human pose classification.
method Proposes a tensor-based neural network with three components: spatiotemporal feature construction, tensor fusion, and tensor-based neural network processing.
result Achieves state-of-the-art performance in human pose classification.
In the low-rank matrix completion (LRMC) problem, the low-rank assumption means that the columns (or rows) of the matrix to be completed are points on a low-dimensional linear algebraic variety. This paper extends this thinking to cases where the columns are points on a low-dimensional nonlinear algebraic variety, a pr…
Introduces TT-NF for more compact neural field representations.
problem Finding more compact and easy-to-fit neural field representations.
method Tensor Train parameterization trained with backpropagation.
result Low-rank compression improves downstream task quality metrics.
New method estimates tensors from noisy data with missing entries.
problem Tensor estimation from noisy observations with missing entries.
method Sign series representation for tensor completion, addressing low- and high-rank signals.
result Excess risk bounds, estimation error rates, and sample complexities established.
The main goal of this paper is to study the geometric structures associated with the representation of tensors in subspace based formats. To do this we use a property of the so-called minimal subspaces which allows us to describe the tensor representation by means of a rooted tree. By using the tree structure and the d…
Proposes a new nonlocal curvature tensor concept.
problem Various nonlocal curvature concepts in literature.
method Generalizes classical curvature tensor representation and uses fractional differential operator analogies.
result Introduces a new nonlocal curvature tensor.
Tensor networks improve integration accuracy for high-dimensional problems.
problem Integration of high-dimensional functions with exponential convergence.
method Regression-free tensor network representations for integration.
result Exponential convergence achieved for non-analytic integrands.
New proof shows holomorphic sectional curvature fully determines curvature tensor.
problem Determining the curvature tensor from holomorphic sectional curvature.
method Representation-theoretic means to calculate L2-norm of holomorphic sectional curvature. result Holomorphic sectional curvature fully determines the curvature tensor.
Study invariant operations on Fedosov manifolds.
problem None explicitly stated in the abstract.
method Analysis of tensor-valued operations on Fedosov manifolds.
result Spaces of homogeneous natural tensors are finite dimensional linear representations of the symplectic group.
We present in this paper the algebra of fused permutations and its deformation the fused Hecke algebra. The first one is defined on a set of combinatorial objects that we call fused permutations, and its deformation is defined on a set of topological objects that we call fused braids. We use these algebras to prove a S…
Seq2Tens uses tensors to efficiently represent sequences, improving performance on time series and video tasks.
problem Challenges in analyzing sequential data due to complex dependencies and non-commutativity.
method Uses tensor algebra to capture dependencies and low-rank tensor projections to manage computational complexity.
result State-of-the-art performance on multivariate time series classification and video generation benchmarks.
Multimodal research is an emerging field of artificial intelligence, and one of the main research problems in this field is multimodal fusion. The fusion of multimodal data is the process of integrating multiple unimodal representations into one compact multimodal representation. Previous research in this field has exp…
New CSC model extracts EEG signals with low noise sensitivity.
problem Analyzing noisy EEG signals during anesthesia.
method Kruskal CSC model using Kruskal decomposition for low-rank tensor activations.
result TC-FISTA efficiently extracts robust, sparse, and interpretable EEG encodings.
We present a novel neural network algorithm, the Tensor Switching (TS) network, which generalizes the Rectified Linear Unit (ReLU) nonlinearity to tensor-valued hidden units. The TS network copies its entire input vector to different locations in an expanded representation, with the location determined by its hidden un…
We use an isomorphism between the space of valence two Killing tensors on an n-dimensional constant sectional curvature manifold and the irreducible GL(n+1)-representation space of algebraic curvature tensors in order to translate the Nijenhuis integrability conditions for a Killing tensor into purely algebraic integra…
A new method computes Greeks for multi-asset options using tensor trains and Fourier transforms.
problem Efficient computation of Greeks for multi-asset options with high accuracy and low sample complexity.
method Tensor train (TT) representations of Fourier-based pricing functions, combined with numerical differentiation or analytical approaches.
result Significant speed-ups of up to 105imes over Monte Carlo simulations while maintaining comparable accuracy. DTCCA learns nonlinear transformations of multi-view data for high-order correlation.
problem Learning complex nonlinear transformations of multiple data views.
method Maximizes high-order canonical correlation by jointly learning transformations of each view using a reformulated tensor decomposition.
result DTCCA efficiently handles high-dimensional and large number of views, overcoming scalability issues.
Tensor Regression tackles high-dimensional data analysis.
problem Challenges in traditional data representation methods for high-dimensional data.
method Systematic study and analysis of tensor-based regression models.
result Provides solutions for specific regression tasks with multiway data.
Verma Howe duality connects tensor products of Verma modules to LKB representations.
problem Understanding the relationship between tensor products of Verma modules and LKB representations.
method Established a quantized version of Verma Howe duality and used it to prove the simplicity of LKB representations.
result LKB representations arise from the quantized Verma Howe duality and are shown to be simple modules.
Tensor networks are efficient representations of high-dimensional tensors which have been very successful for physics and mathematics applications. We demonstrate how algorithms for optimizing such networks can be adapted to supervised learning tasks by using matrix product states (tensor trains) to parameterize models…
In this paper we study the variational problem associated to support vector regression in Banach function spaces. Using the Fenchel-Rockafellar duality theory, we give explicit formulation of the dual problem as well as of the related optimality conditions. Moreover, we provide a new computational framework for solving…
TRNN combines tensor geometry with neural network nonlinearity for HD data.
problem Modeling high-dimensional data with preserved tensor geometry and nonlinear interactions.
method Introduces TRNN that integrates tensor geometry and neural network nonlinearity.
result TRNN preserves tensor geometry while offering nonlinearity.
In this paper we give an example of a linear group such that its tensor square is not linear. Also, we formulate some sufficient conditions for the linearity of non-abelian tensor products G⊗H and tensor squares G⊗G. Using these results we prove that tensor squares of some groups with one relation a…
Nowadays, with the availability of massive amount of trade data collected, the dynamics of the financial markets pose both a challenge and an opportunity for high frequency traders. In order to take advantage of the rapid, subtle movement of assets in High Frequency Trading (HFT), an automatic algorithm to analyze and …
tvGP-VAE models tensor-valued latent variables with Gaussian processes for better data structure representation.
problem Agnostic latent variables in VAEs ignore data structure correlations.
method Proposes tensor-variate Gaussian process prior for variational autoencoder.
result Explicitly modeling correlation structures improves model performance in reconstruction.
Machine learning accelerates Lie algebra computations.
problem Computing tensor products and branching rules of Lie algebras.
method Machine learning for Lie algebra computations.
result Achieves significant speed-ups in Lie algebra computations.
This paper generalizes graph representation for diverse data types.
problem Representing and querying hybrid data types in a unified way.
method Introducing a directed Tensor-Typed Multi-Graph with embeddings.
result Unified representation for visual, linguistic, and auditory data.
In this work, we develop Gaussian process regression (GPR) models of hyperelastic material behavior. First, we consider the direct approach of modeling the components of the Cauchy stress tensor as a function of the components of the Finger stretch tensor in a Gaussian process. We then consider an improvement on this a…
SG-NTF completes HDI tensors with spectral mapping and spatio-temporal gating.
problem High-dimensional and incomplete tensor completion.
method Spectra-Guided Neural Tucker Factorization (SG-NTF) with Spatio-Temporal Co-Gating (STCG).
result Maintains competitive completion accuracy with parameter efficiency.
The space of differential operators acting on skewsymmetric tensor fields or on smooth forms of a smooth manifold are representations of its Lie algebra of vector fields. We compute the first cohomology spaces of these representations and show how they are related to the cohomology with coefficients in ther space of sm…
Recent years have seen rapid advances in the data-driven analysis of dynamical systems based on Koopman operator theory and related approaches. On the other hand, low-rank tensor product approximations -- in particular the tensor train (TT) format -- have become a valuable tool for the solution of large-scale problems …
Money analyzed as a multidimensional tensor for better economic policy.
problem Economic complexity and policy responsiveness.
method Tensor analysis of money dynamics.
result Enhanced economic policy design and resilience.
A new method for decomposing non-negative tensors using energy-based modeling.
problem Challenges in traditional tensor decomposition methods, especially global optimization and rank selection.
method Energy-based modeling of tensors, considering interactions between modes for global optimization.
result Demonstrates effectiveness in tensor completion and approximation, revealing a relationship between many-body and low-rank approximations.