New insights into identifying mixtures of product distributions using Hadamard extensions.
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
Trend · papers per month
The tensor-tensor product (t-product) [M. E. Kilmer and C. D. Martin, 2011] is a natural generalization of matrix multiplication. Based on t-product, many operations on matrix can be extended to tensor cases, including tensor SVD, tensor spectral norm, tensor nuclear norm [C. Lu, et al., 2018] and many others. The line…
Study on Gaussian ensemble of matrix products with mixed moments computed.
The paper analyzes stability of random matrix products with Markovian noise.
Revisits neural collaborative filtering vs. matrix factorization, showing dot product superiority.
Paper proposes algorithms for BMF using integer programming.
Data often comes in the form of an array or matrix. Matrix factorization techniques attempt to recover missing or corrupted entries by assuming that the matrix can be written as the product of two low-rank matrices. In other words, matrix factorization approximates the entries of the matrix by a simple, fixed function-…
Curious structure of special orthogonal, unitary, and symplectic groups as products of Grassmannians discovered.
Graphical notation simplifies tensor operations and decompositions.
New algorithm reduces cold-start costs in multi-armed bandits for many products.
We propose a statistical model for natural language that begins by considering language as a monoid, then representing it in complex matrices with a compatible translation invariant probability measure. We interpret the probability measure as arising via the Born rule from a translation invariant matrix product state.
Defines cross product for m vectors in n-dimensional spaces.
Given a real matrix A with n columns, the problem is to approximate the Gram product AA^T by c << n weighted outer products of columns of A. Necessary and sufficient conditions for the exact computation of AA^T (in exact arithmetic) from c >= rank(A) columns depend on the right singular vector matrix of A. For a Monte-…
A new matrix concentration inequality for random products of matrices.
We want to construct a homological link invariant whose Euler characteristic is MOY polynomial as Khovanov and Rozansky constructed a categorification of HOMFLY polynomial. The present paper gives the first step to construct a categorification of MOY polynomial. For the essential colored planar diagrams with additional…
AMP algorithm for matrix tensor product model provides recovery conditions.
Few attempts have been proposed in order to describe the statistical features and historical evolution of the export bipartite matrix countries/products. An important standpoint is the introduction of a products network, namely a hierarchical forest of products that models the formation and the evolution of commodities…
We present two formulas for Chern classes of the tensor product of two vector bundles. In the first formula we consider a matrix containing Chern classes of the first bundle and we take a polynomial of this matrix with Chern classes of the second bundle as coefficients. The determinant of this expression equals the Che…
Scalable Gaussian processes with latent Kronecker structure for large datasets.
Paper finds formulas for mutual information and MMSE in matrix tensor product problems.
We consider the problem of matrix approximation and denoising induced by the Kronecker product decomposition. Specifically, we propose to approximate a given matrix by the sum of a few Kronecker products of matrices, which we refer to as the Kronecker product approximation (KoPA). Because the Kronecker product is an ex…
At the core of any inference procedure in deep neural networks are dot product operations, which are the component that require the highest computational resources. A common approach to reduce the cost of inference is to reduce its memory complexity by lowering the entropy of the weight matrices of the neural network, …
A popular trick for computing a pairwise co-occurrence matrix is the product of an incidence matrix and its transpose. We present an analog for higher order tuple co-occurrences using the face-splitting product, or alternately known as the transpose Khatri-Rao product. These higher order co-occurrences encode the commo…
Theoretical studies have proven that the Hilbert space has remarkable performance in many fields of applications. Frames in tensor product of Hilbert spaces were introduced to generalize the inner product to high-order tensors. However, these techniques require tensor decomposition which could lead to the loss of infor…
Paper proposes a new approach to optimal transport for vector and matrix densities.
NG+ method improves deep learning efficiency and accuracy.
New method estimates large matrices' spectra from small sub-matrices.
A Kronecker product model is the set of visible marginal probability distributions of an exponential family whose sufficient statistics matrix factorizes as a Kronecker product of two matrices, one for the visible variables and one for the hidden variables. We estimate the dimension of these models by the maximum rank …
Sketch Tomography improves quantum state estimation accuracy.
Matrix Product States (MPS), also known as Tensor Train (TT) decomposition in mathematics, has been proposed originally for describing an (especially one-dimensional) quantum system, and recently has found applications in various applications such as compressing high-dimensional data, supervised kernel linear classifie…
A matrix completion problem is to recover the missing entries in a partially observed matrix. Most of the existing matrix completion methods assume a low rank structure of the underlying complete matrix. In this paper, we introduce an alternative and more general form of the underlying complete matrix, which assumes a …
Subspace clustering is a useful technique for many computer vision applications in which the intrinsic dimension of high-dimensional data is often smaller than the ambient dimension. Spectral clustering, as one of the main approaches to subspace clustering, often takes on a sparse representation or a low-rank represent…
A new method uses Gram matrix for efficient multivariate functional principal components.
A new algorithm speeds up matrix multiplication without actual multiplication.
The study explores how Matrix Product States can represent boolean and continuous functions.
The easy access to large data sets has allowed for leveraging methodology in network physics and complexity science to disentangle patterns and processes directly from the data, leading to key insights in the behavior of systems. Here we use to country specific food production data to study binary and weighted topologi…
The paper defines the OU matrix for braid diagrams and finds determinant relationships.
The graph Laplacian is a standard tool in data science, machine learning, and image processing. The corresponding matrix inherits the complex structure of the underlying network and is in certain applications densely populated. This makes computations, in particular matrix-vector products, with the graph Laplacian a ha…
Deep ReLU networks can approximate matrix-vector products with error bounds.
Study uses Google matrix analysis to show how COVID-19 changed international trade flows.
Study on Neural Tangent Kernel of Matrix Product States and their convergence.
New methods estimate covariance for matrix data without assuming fixed size or specific distributions.
Kronecker Products (KP) have been used to compress IoT RNN Applications by 15-38x compression factors, achieving better results than traditional compression methods. However when KP is applied to large Natural Language Processing tasks, it leads to significant accuracy loss (approx 26%). This paper proposes a way to re…
Discovering the underlying low dimensional structure of high dimensional data has attracted a significant amount of researches recently and has shown to have a wide range of applications. As an effective dimension reduction tool, singular value decomposition is often used to analyze high dimensional matrices, which are…
This paper introduces matrix product state (MPS) decomposition as a new and systematic method to compress multidimensional data represented by higher-order tensors. It solves two major bottlenecks in tensor compression: computation and compression quality. Regardless of tensor order, MPS compresses tensors to matrices …
Matrix factorization methods are extensively employed to understand complex data. In this paper, we introduce the cross-product penalized component analysis (XCAN), a sparse matrix factorization based on the optimization of a loss function that allows a trade-off between variance maximization and structural preservatio…
Generalizes randomized SVD for better matrix approximations using Gaussian vectors.
Using the United Nations COMTRADE database \cite{comtrade} we construct the Google matrix of multiproduct world trade between the UN countries and analyze the properties of trade flows on this network for years 1962 - 2010. This construction, based on Markov chains, treats all countries on equal democratic grounds …