We propose a statistical model for natural language that begins by considering language as a monoid, then representing it in complex matrices with a compatible translation invariant probability measure. We interpret the probability measure as arising via the Born rule from a translation invariant matrix product state.
On-device research index
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
168,657 papers · 148 categories
Trend · papers per month
48 results for “Matrix Product State”
Sketch Tomography improves quantum state estimation accuracy.
problem Efficiently estimating quantum states, especially MPS states.
method Hybridizes classical shadow protocol with tensor train ansatz.
result Proven convergence with quadratic sample complexity.
The paper analyzes stability of random matrix products with Markovian noise.
problem Analyzing stability of random matrix products with Markovian noise.
method Using a super-Lyapunov drift condition and controlled growth of matrix-valued functions, the paper provides an exponential stability result for the p-th moment of random matrix product.
result Finite-time p-th moment bounds for linear stochastic approximation and TD learning algorithms.
AMP algorithm for matrix tensor product model provides recovery conditions.
problem Generalization of standard spiked matrix models with multiple pairwise observations.
method Approximate message passing with optimal weighing and combining of estimates.
result Asymptotically exact performance description and necessary/sufficient recovery conditions.
Shortcut Matrix Product States and its applicationscond-mat.stat-mech
Matrix Product States (MPS), also known as Tensor Train (TT) decomposition in mathematics, has been proposed originally for describing an (especially one-dimensional) quantum system, and recently has found applications in various applications such as compressing high-dimensional data, supervised kernel linear classifie…
The study explores how Matrix Product States can represent boolean and continuous functions.
problem Representing arbitrary boolean and continuous functions using Matrix Product States.
method Developed a construction method for MPS to represent boolean gates and proved density in continuous function space.
result MPS can accurately represent arbitrary boolean functions and continuous functions densely.
Study on Neural Tangent Kernel of Matrix Product States and their convergence.
problem Understanding the convergence of Neural Tangent Kernel of Matrix Product States.
method Analyzing the Neural Tangent Kernel of Matrix Product States and proving its convergence in the infinite bond dimensional limit.
result The Neural Tangent Kernel of Matrix Product States converges to a constant matrix during training.
This paper introduces matrix product state (MPS) decomposition as a new and systematic method to compress multidimensional data represented by higher-order tensors. It solves two major bottlenecks in tensor compression: computation and compression quality. Regardless of tensor order, MPS compresses tensors to matrices …
Tensor networks and RNNs are equivalent, improving wave function encoding.
problem Efficiently encoding quantum states in neural networks.
method Generalized RNN architecture for tensor networks, supporting polynomial time wave function evaluation.
result Tensorial RNNs can encode quantum states with lower bond dimensions and higher accuracy.
Paper proposes algorithms for BMF using integer programming.
problem Approximating binary input matrix as product of two smaller binary factors.
method Alternating optimization strategy using integer programming to solve subproblems and combine solutions.
result Proposed algorithms outperform state of the art on medium-scale problems.
Revisits neural collaborative filtering vs. matrix factorization, showing dot product superiority.
problem Comparing neural collaborative filtering to matrix factorization in recommendation systems.
method Revisited experiments using MLPs as similarity functions, comparing dot product to MLP outputs.
result Simple dot product outperforms MLP-based learned similarities in practical settings.
We present two simple ways of reducing the number of parameters and accelerating the training of large Long Short-Term Memory (LSTM) networks: the first one is "matrix factorization by design" of LSTM matrix into the product of two smaller matrices, and the second one is partitioning of LSTM matrix, its inputs and stat…
MPSTime uses matrix-product states for efficient time-series ML.
problem Learning complex correlations in time-series data.
method Developed an MPS-based algorithm for joint probability distribution learning.
result MPSTime efficiently learns time-series probability distributions.
Tensor networks for unsupervised machine learningcond-mat.stat-mech
Tensor networks improve unsupervised learning performance.
problem Improving unsupervised machine learning models.
method Autoregressive Matrix Product States (AMPS) combining quantum and machine learning.
result AMPS significantly outperforms existing tensor network models and neural networks.
Scalable Gaussian processes with latent Kronecker structure for large datasets.
problem Limited scalability of Gaussian processes for large datasets.
method Leveraging latent Kronecker structure, projecting kernel matrix onto latent Kronecker product, using iterative linear system solvers and pathwise conditioning.
result Outperforms state-of-the-art sparse and variational GPs on real-world datasets with up to five million examples.
Unsupervised Generative Modeling Using Matrix Product Statescond-mat.stat-mech
Generative modeling, which learns joint probability distribution from data and generates samples according to it, is an important task in machine learning and artificial intelligence. Inspired by probabilistic interpretation of quantum physics, we propose a generative model using matrix product states, which is a tenso…
NG+ method improves deep learning efficiency and accuracy.
problem Efficiency and accuracy in deep learning models.
method Proposes NG+ method using matrix-product natural gradient approach.
result Established global convergence and provided regret bound.
New method for inferring Markov chains from large state spaces, applied to epidemic models.
problem Challenging to compute matrix exponentials and derivatives for large state spaces.
method Differentiated uniformization method for continuous-time Markov chains.
result Estimation of infection and recovery rates during the first wave of COVID-19 in Austria.
At the core of any inference procedure in deep neural networks are dot product operations, which are the component that require the highest computational resources. A common approach to reduce the cost of inference is to reduce its memory complexity by lowering the entropy of the weight matrices of the neural network, …
A new MPS model for both classification and generation.
problem Efficiently representing and manipulating complex, high-dimensional data.
method Inspired by Matrix Product States (MPS) used in quantum computing, applies them in a classical machine learning setting.
result Dual functionality in a supervised learning framework enhances traditional training and generates more realistic samples.
Subspace clustering is a useful technique for many computer vision applications in which the intrinsic dimension of high-dimensional data is often smaller than the ambient dimension. Spectral clustering, as one of the main approaches to subspace clustering, often takes on a sparse representation or a low-rank represent…
Tensor Network for Anomaly Detection in the Latent Space of Proton Collision Events at the LHChep-ph
Tensor networks improve anomaly detection at LHC for new physics.
problem Identifying new phenomena in proton collision events at LHC.
method Tensor network-based anomaly detection using Matrix Product State with an isometric feature map.
result Tensor networks outperform established quantum methods in identifying new phenomena.
Quantum computing for option pricing using MPS states.
problem Efficiently generating time series for path-dependent options on quantum computers.
method Proposes a Matrix Product State (MPS) model for time series generation and trains it for the Heston model.
result Demonstrates the MPS model's capability to generate paths in the Heston model for path-dependent option pricing.
New methods improve Fisher Matrix approximations for neural networks at low cost.
problem High cost of solving Fisher Information Matrix (FIM) in neural networks.
method Direct minimization via Kronecker product singular value decomposition.
result Improved approximations to FIM provide more accurate and faster optimization.
The aim of this paper is to present a dual-term structure model of interest rate derivatives in order to solve the two hardest problems in financial modeling: the exact volatility calibration of the entire swaption matrix, and the calculation of bucket vegas for structured products. The model takes a series of long-ter…
New insights into identifying mixtures of product distributions using Hadamard extensions.
problem Identifying mixtures of product distributions on binary variables.
method Analysis of Hadamard extensions of matrix products.
result Conditions for full column rank of Hadamard extensions.
The tensor-tensor product (t-product) [M. E. Kilmer and C. D. Martin, 2011] is a natural generalization of matrix multiplication. Based on t-product, many operations on matrix can be extended to tensor cases, including tensor SVD, tensor spectral norm, tensor nuclear norm [C. Lu, et al., 2018] and many others. The line…
The paper develops algorithms for Boolean matrix factorization using IP and heuristics.
problem Approximating binary input matrices as products of smaller binary factors.
method Alternating optimization with integer programming and greedy/local-search heuristics.
result Proposed methods improve scalability and performance compared to existing techniques.
Efficiently predicts long-time dynamics of quantum spin models using MLP regression.
problem Challenges in calculating long-time expectation values for quantum spin models.
method Utilized a multi-layer perceptron (MLP) model for regression on matrix product states (MPS) expectation values.
result Significantly reduced computational cost for generating long-time dynamics while maintaining high accuracy.
Study on Gaussian ensemble of matrix products with mixed moments computed.
problem Understanding the statistical properties of matrix products of Gaussian matrices.
method Analysis of a multi-Wishart ensemble and enumeration of non-crossing pairings.
result Mixed moments of the product matrix are computed and found to be weighted by Fuss-Catalan numbers at large .
No free lunch theorem formalized for tensor network models.
problem Understanding limitations of tensor network machine learning models.
method Formalized rigorous no-free-lunch theorem for specific tensor network models.
result Revealed intrinsic limitations of tensor network-based learning models.
Inspired by the possibility that generative models based on quantum circuits can provide a useful inductive bias for sequence modeling tasks, we propose an efficient training algorithm for a subset of classically simulable quantum circuit models. The gradient-free algorithm, presented as a sequence of exactly solvable …
We consider stochastic partial differential equations appearing as Markovian lifts of matrix valued (affine) Volterra type processes from the point of view of the generalized Feller property (see e.g., \cite{doetei:10}). We introduce in particular Volterra Wishart processes with fractional kernels and values in the con…
A new tensor network method for image classification reduces computation cost.
problem Efficiently classifying images in high-dimensional spaces.
method Proposes a multi-layered tensor network (MLTN) that performs one MPS operation per layer, reducing computation cost.
result Reduces computation cost without degrading performance.
Recent work shows that inference for Gaussian processes can be performed efficiently using iterative methods that rely only on matrix-vector multiplications (MVMs). Structured Kernel Interpolation (SKI) exploits these techniques by deriving approximate kernels with very fast MVMs. Unfortunately, such strategies suffer …
Data often comes in the form of an array or matrix. Matrix factorization techniques attempt to recover missing or corrupted entries by assuming that the matrix can be written as the product of two low-rank matrices. In other words, matrix factorization approximates the entries of the matrix by a simple, fixed function-…
Curious structure of special orthogonal, unitary, and symplectic groups as products of Grassmannians discovered.
problem Understanding the structure of special orthogonal, unitary, and symplectic groups.
method Expressing these groups as products of Grassmannians realized as involution matrices.
result Special orthogonal, special unitary, and symplectic groups can be expressed as products of their corresponding Grassmannians.
Graphical notation simplifies tensor operations and decompositions.
problem Complex tensor operations are difficult to understand and represent.
method Introduces graphical notation to represent tensor operations.
result Simplified representation of tensor operations and decompositions.
Ordinal data is omnipresent in almost all multiuser-generated feedback - questionnaires, preferences etc. This paper investigates modelling of ordinal data with Gaussian restricted Boltzmann machines (RBMs). In particular, we present the model architecture, learning and inference procedures for both vector-variate and …
New algorithm reduces cold-start costs in multi-armed bandits for many products.
problem High burn-in costs in multi-armed bandits for new products.
method Two-phase bandit algorithm using subsampling and low-rank matrix estimation.
result Reduces burn-in costs and expedites experiment in large product sets.
Efficient method estimates intrinsic dimension for big data.
problem Estimating intrinsic dimension for large datasets is costly and complex.
method Proposes a matrix-vector product-based approach for efficient intrinsic dimension estimation.
result Demonstrates superior performance compared to state-of-the-art methods.
New method compresses LSTM networks using MPS tensor trains.
problem Challenges in maintaining performance of compressed RNNs.
method Use of MPS tensor trains for LSTM network compression.
result MPS tensor trains outperform MPOs in storage and inference time.
Defines cross product for m vectors in n-dimensional spaces.
problem No universal definition for cross product in high-dimensional spaces.
method Defines cross product for m vectors in n-dimensional spaces with any metric matrices.
result Cross product length represents m-dimensional volume, components represent volume directions.
Given a real matrix A with n columns, the problem is to approximate the Gram product AA^T by c << n weighted outer products of columns of A. Necessary and sufficient conditions for the exact computation of AA^T (in exact arithmetic) from c >= rank(A) columns depend on the right singular vector matrix of A. For a Monte-…
A new matrix concentration inequality for random products of matrices.
problem Understanding the behavior of random matrix products under bounded independent positive semidefinite matrices.
method Developed a non-asymptotic concentration inequality for the product of matrices.
result The inequality provides a bound on the deviation of the matrix product from its expected value.
New model uses PEPS for image classification, outperforming tree-like networks.
problem Efficiently modeling and classifying 2D data like images.
method Feature map followed by PEPS contraction with trainable parameters.
result Significantly superior to tree-like networks on MNIST and Fashion-MNIST.
We want to construct a homological link invariant whose Euler characteristic is MOY polynomial as Khovanov and Rozansky constructed a categorification of HOMFLY polynomial. The present paper gives the first step to construct a categorification of MOY polynomial. For the essential colored planar diagrams with additional…
Few attempts have been proposed in order to describe the statistical features and historical evolution of the export bipartite matrix countries/products. An important standpoint is the introduction of a products network, namely a hierarchical forest of products that models the formation and the evolution of commodities…