arXiv research

Proposes MLDP for modeling multilinear data.

Extends RRR to capture nonlinear interactions in multi-response regression.

New model generates unseen attribute combinations from limited data.

New method forecasts multilinear data using tensor autoregression.

Geometrically, tensors of fixed rank form a minimal submanifold.

Causal deep learning tackles causal inference using tensor factor analysis.

Unified multilinear model for causal factor disentanglement.

New algorithm solves $\ell_0$-norm constrained multilinear logistic regression for tensor data.

Tucker decomposition is the cornerstone of modern machine learning on tensorial data analysis, which have attracted considerable attention for multiway feature extraction, compressive sensing, and tensor completion. The most challenging problem is related to determination of model complexity (i.e., multilinear rank), e…

In this paper we present a new model and an algorithm for unsupervised clustering of 2-D data such as images. We assume that the data comes from a union of multilinear subspaces (UOMS) model, which is a specific structured case of the much studied union of subspaces (UOS) model. For segmentation under this model, we de…

Wide neural networks become linear, but adding bottlenecks makes them bilinear or multilinear.

GMT improves interpretability of XGNNs by approximating SubMT.

The main results of our paper deal with the lifting problem for multilinear differential operators between complexes of horizontal de Rham forms on the infinite jet bundle. We answer the question when does an n-multilinear differential operator from the space of (N,0)-forms (where N is the dimension of the base) to the…

We prove near-tight concentration of measure for polynomial functions of the Ising model under high temperature. For any degree $d$, we show that a degree-$d$ polynomial of a $n$-spin Ising model exhibits exponential tails that scale as $\exp(-r^{2/d})$ at radius $r=\tildeΩ_d(n^{d/2})$. Our concentration radius is opti…

Study uses random matrix theory to improve tensor approximation accuracy.

Principal component analysis (PCA) is an unsupervised method for learning low-dimensional features with orthogonal projections. Multilinear PCA methods extend PCA to deal with multidimensional data (tensors) directly via tensor-to-tensor projection or tensor-to-vector projection (TVP). However, under the TVP setting, i…

Matrix factorizations and their extensions to tensor factorizations and decompositions have become prominent techniques for linear and multilinear blind source separation (BSS), especially multiway Independent Component Analysis (ICA), NonnegativeMatrix and Tensor Factorization (NMF/NTF), Smooth Component Analysis (Smo…

Proposes FMPCA for federated tensor data dimensionality reduction.

Given a multifunction from $X$ to the $k-$fold symmetric product $Sym_k(X)$, we use the Dold-Thom Theorem to establish a homological selection Theorem. This is used to establish existence of Nash equilibria. Cost functions in problems concerning the existence of Nash Equilibria are traditionally multilinear in the mixe…

Derives a primal-dual MLSVD formulation for multilinear data.

Dimensionality reduction is a main step in the learning process which plays an essential role in many applications. The most popular methods in this field like SVD, PCA, and LDA, only can be applied to data with vector format. This means that for higher order data like matrices or more generally tensors, data should be…

MCCA extracts shared structure from multiple tensor datasets.

Efficiently optimizes boolean functions using multilinear polynomials and exponential weight updates.

We study algebraic varieties of ReLU networks to understand their representable functions.

The aim of this work is to lay the foundations of differential geometry and Lie theory over the general class of topological base fields and -rings for which a differential calculus has been developed in recent work (collaboration with H. Gloeckner and K.-H. Neeb), without any restriction on the dimension or on the cha…

Paper introduces a new multilinear functional for spectral triples and computes its properties.

Nowadays, with the availability of massive amount of trade data collected, the dynamics of the financial markets pose both a challenge and an opportunity for high frequency traders. In order to take advantage of the rapid, subtle movement of assets in High Frequency Trading (HFT), an automatic algorithm to analyze and …

Extends De Leeuw theorems to noncommutative groups and multipliers.

A linear Lie rack structure on a finite dimensional vector space $V$ is a Lie rack operation $(x,y)\mapsto x\rhd y$ pointed at the origin and such that for any $x$, the left translation $\mathrm{L}_x:y\mapsto \mathrm{L}_x(y)= x\rhd y$ is linear. A linear Lie rack operation $\rhd$ is called analytic if for any $x,y\in V…

Four algorithms improve sparse tensor BR1Approx with theoretical guarantees.

We give an algorithm for completing an order-$m$ symmetric low-rank tensor from its multilinear entries in time roughly proportional to the number of tensor entries. We apply our tensor completion algorithm to the problem of learning mixtures of product distributions over the hypercube, obtaining new algorithmic result…

The goal of tensor completion is to fill in missing entries of a partially known tensor (possibly including some noise) under a low-rank constraint. This may be formulated as a least-squares problem. The set of tensors of a given multilinear rank is known to admit a Riemannian manifold structure, thus methods of Rieman…

Algorithm identifies sources in product distributions with improved complexity.

We are interested in approximation of a multivariate function $f(x_1,\dots,x_d)$ by linear combinations of products $u^1(x_1)\cdots u^d(x_d)$ of univariate functions $u^i(x_i)$, $i=1,\dots,d$. In the case $d=2$ it is a classical problem of bilinear approximation. In the case of approximation in the $L_2$ space the bili…

We study conformal deformation problems on manifolds with boundary which include prescribing $σ_k\equiv0$ in the interior. In particular, we prove a Dirichlet principle when the induced metric on the boundary is fixed and an Obata-type theorem on the upper hemisphere. We introduce some conformally covariant multilinear…

Optimal tensor PCA for estimating factors and loadings in high-dimensional panel data.

We introduce the problem of learning mixtures of $k$ subcubes over $\{0,1\}^n$, which contains many classic learning theory problems as a special case (and is itself a special case of others). We give a surprising $n^{O(\log k)}$-time learning algorithm based on higher-order multilinear moments. It is not possible to l…

We propose a new framework for the analysis of low-rank tensors which lies at the intersection of spectral graph theory and signal processing. As a first step, we present a new graph based low-rank decomposition which approximates the classical low-rank SVD for matrices and multi-linear SVD for tensors. Then, building …

NCPF model improves traffic data imputation with neural and tensor methods.

Nonnegative Tucker decomposition (NTD) is a powerful tool for the extraction of nonnegative parts-based and physically meaningful latent components from high-dimensional tensor data while preserving the natural multilinear structure of data. However, as the data tensor often has multiple modes and is large-scale, exist…

SPIDER uses deep neural networks for streaming tensor factorization.

Rank-R FNN handles high-dimensional data efficiently.

New sampling method estimates Shapley values more accurately.

In this paper, we provide an accessible introduction to the theory of locally convex supermanifolds in the categorical approach. In this setting, a supermanifold is a functor $\mathcal{M}\colon\mathbf{Gr}\to\mathbf{Man}$ from the category of Grassmann algebras to the category of locally convex manifolds that has certai…

The increasing use of multiple sensors, which produce a large amount of multi-dimensional data, requires efficient representation and classification methods. In this paper, we present a new method for multi-dimensional data classification that relies on two premises: 1) multi-dimensional data are usually represented by…

New robust MPCA method handles casewise and cellwise outliers in tensor data.

Derives smooth homogeneous structures for low-rank tensors.

We propose a novel multilinear dynamical system (MLDS) in a transform domain, named $\mathcal{L}$-MLDS, to model tensor time series. With transformations applied to a tensor data, the latent multidimensional correlations among the frontal slices are built, and thus resulting in the computational independence in the tra…