arXiv research

Efficiently optimizes boolean functions using multilinear polynomials and exponential weight updates.

We study algebraic varieties of ReLU networks to understand their representable functions.

We give an algorithm for completing an order-$m$ symmetric low-rank tensor from its multilinear entries in time roughly proportional to the number of tensor entries. We apply our tensor completion algorithm to the problem of learning mixtures of product distributions over the hypercube, obtaining new algorithmic result…

We use computer algebra to demonstrate the existence of a multilinear polynomial identity of degree 8 satisfied by the bilinear operation in every Lie-Yamaguti algebra. This identity is a consequence of the defining identities for Lie-Yamaguti algebras, but is not a consequence of anticommutativity. We give an explicit…

We prove near-tight concentration of measure for polynomial functions of the Ising model under high temperature. For any degree $d$, we show that a degree-$d$ polynomial of a $n$-spin Ising model exhibits exponential tails that scale as $\exp(-r^{2/d})$ at radius $r=\tildeΩ_d(n^{d/2})$. Our concentration radius is opti…

Proposes MLDP for modeling multilinear data.

New method forecasts multilinear data using tensor autoregression.

Geometrically, tensors of fixed rank form a minimal submanifold.

Unified multilinear model for causal factor disentanglement.

New algorithm solves $\ell_0$-norm constrained multilinear logistic regression for tensor data.

Tucker decomposition is the cornerstone of modern machine learning on tensorial data analysis, which have attracted considerable attention for multiway feature extraction, compressive sensing, and tensor completion. The most challenging problem is related to determination of model complexity (i.e., multilinear rank), e…

In this paper we present a new model and an algorithm for unsupervised clustering of 2-D data such as images. We assume that the data comes from a union of multilinear subspaces (UOMS) model, which is a specific structured case of the much studied union of subspaces (UOS) model. For segmentation under this model, we de…

Wide neural networks become linear, but adding bottlenecks makes them bilinear or multilinear.

GMT improves interpretability of XGNNs by approximating SubMT.

The main results of our paper deal with the lifting problem for multilinear differential operators between complexes of horizontal de Rham forms on the infinite jet bundle. We answer the question when does an n-multilinear differential operator from the space of (N,0)-forms (where N is the dimension of the base) to the…

Study uses random matrix theory to improve tensor approximation accuracy.

Principal component analysis (PCA) is an unsupervised method for learning low-dimensional features with orthogonal projections. Multilinear PCA methods extend PCA to deal with multidimensional data (tensors) directly via tensor-to-tensor projection or tensor-to-vector projection (TVP). However, under the TVP setting, i…

We introduce the problem of learning mixtures of $k$ subcubes over $\{0,1\}^n$, which contains many classic learning theory problems as a special case (and is itself a special case of others). We give a surprising $n^{O(\log k)}$-time learning algorithm based on higher-order multilinear moments. It is not possible to l…

Matrix factorizations and their extensions to tensor factorizations and decompositions have become prominent techniques for linear and multilinear blind source separation (BSS), especially multiway Independent Component Analysis (ICA), NonnegativeMatrix and Tensor Factorization (NMF/NTF), Smooth Component Analysis (Smo…

Proposes FMPCA for federated tensor data dimensionality reduction.

Given a multifunction from $X$ to the $k-$fold symmetric product $Sym_k(X)$, we use the Dold-Thom Theorem to establish a homological selection Theorem. This is used to establish existence of Nash equilibria. Cost functions in problems concerning the existence of Nash Equilibria are traditionally multilinear in the mixe…

Tensor networks and RNNs are equivalent, improving wave function encoding.

Derives a primal-dual MLSVD formulation for multilinear data.

New model generates unseen attribute combinations from limited data.

Dimensionality reduction is a main step in the learning process which plays an essential role in many applications. The most popular methods in this field like SVD, PCA, and LDA, only can be applied to data with vector format. This means that for higher order data like matrices or more generally tensors, data should be…

Constructs finite element spaces for $(p,q)$-forms, excluding one subspace.

It is shown that a (curved) projective structure on a smooth manifold determines on the Poisson algebra of smooth, fiberwise-polynomial functions on the cotangent bundle a one-parameter family of graded star products. For a particular value of the parameter (corresponding to half-densities) the star product is symmetri…

MCCA extracts shared structure from multiple tensor datasets.

The aim of this work is to lay the foundations of differential geometry and Lie theory over the general class of topological base fields and -rings for which a differential calculus has been developed in recent work (collaboration with H. Gloeckner and K.-H. Neeb), without any restriction on the dimension or on the cha…

Paper introduces a new multilinear functional for spectral triples and computes its properties.

In this paper, we investigate the sample size requirement for exact recovery of a high order tensor of low rank from a subset of its entries. We show that a gradient descent algorithm with initial value obtained from a spectral method can, in particular, reconstruct a ${d\times d\times d}$ tensor of multilinear ranks $…

Causal deep learning tackles causal inference using tensor factor analysis.

Nowadays, with the availability of massive amount of trade data collected, the dynamics of the financial markets pose both a challenge and an opportunity for high frequency traders. In order to take advantage of the rapid, subtle movement of assets in High Frequency Trading (HFT), an automatic algorithm to analyze and …

Extends De Leeuw theorems to noncommutative groups and multipliers.

Extends algorithms for computing $Φ$-equilibria to higher polynomial dimensions.

A linear Lie rack structure on a finite dimensional vector space $V$ is a Lie rack operation $(x,y)\mapsto x\rhd y$ pointed at the origin and such that for any $x$, the left translation $\mathrm{L}_x:y\mapsto \mathrm{L}_x(y)= x\rhd y$ is linear. A linear Lie rack operation $\rhd$ is called analytic if for any $x,y\in V…

Four algorithms improve sparse tensor BR1Approx with theoretical guarantees.

The goal of tensor completion is to fill in missing entries of a partially known tensor (possibly including some noise) under a low-rank constraint. This may be formulated as a least-squares problem. The set of tensors of a given multilinear rank is known to admit a Riemannian manifold structure, thus methods of Rieman…

Algorithm identifies sources in product distributions with improved complexity.

We are interested in approximation of a multivariate function $f(x_1,\dots,x_d)$ by linear combinations of products $u^1(x_1)\cdots u^d(x_d)$ of univariate functions $u^i(x_i)$, $i=1,\dots,d$. In the case $d=2$ it is a classical problem of bilinear approximation. In the case of approximation in the $L_2$ space the bili…

Extends RRR to capture nonlinear interactions in multi-response regression.

We study conformal deformation problems on manifolds with boundary which include prescribing $σ_k\equiv0$ in the interior. In particular, we prove a Dirichlet principle when the induced metric on the boundary is fixed and an Obata-type theorem on the upper hemisphere. We introduce some conformally covariant multilinear…

Optimal tensor PCA for estimating factors and loadings in high-dimensional panel data.

We propose a new framework for the analysis of low-rank tensors which lies at the intersection of spectral graph theory and signal processing. As a first step, we present a new graph based low-rank decomposition which approximates the classical low-rank SVD for matrices and multi-linear SVD for tensors. Then, building …

Nonnegative Tucker decomposition (NTD) is a powerful tool for the extraction of nonnegative parts-based and physically meaningful latent components from high-dimensional tensor data while preserving the natural multilinear structure of data. However, as the data tensor often has multiple modes and is large-scale, exist…

The central discovery of $2d$ conformal theory was holomorphic factorization, which expressed correlation functions through bilinear combinations of conformal blocks, which are easily cut and joined without a need to sum over the entire huge Hilbert space of states. Somewhat similar, when a link diagram is glued from t…

Rank-R FNN handles high-dimensional data efficiently.

New sampling method estimates Shapley values more accurately.