Paper proposes a new method for density estimation using tree tensor-network states.
problem Density estimation for complex graphical models with loops.
method Determines tree topology with Chow-Liu algorithm and uses sketching techniques to define tensor-network components.
result Sample complexity guarantees and empirical validation provided.
Tree tensor networks balance model complexity and empirical risk for high-dimensional function approximation.
problem Selecting optimal tree structure and ranks for high-dimensional function approximation.
method Proposes a complexity-based model selection method for tree tensor networks in empirical risk minimization.
result Demonstrates near-minimax adaptive performance across various smoothness classes.
New model uses PEPS for image classification, outperforming tree-like networks.
problem Efficiently modeling and classifying 2D data like images.
method Feature map followed by PEPS contraction with trainable parameters.
result Significantly superior to tree-like networks on MNIST and Fashion-MNIST.
Matrix product states (MPS), a tensor network designed for one-dimensional quantum systems, has been recently proposed for generative modeling of natural data (such as images) in terms of `Born machine'. However, the exponential decay of correlation in MPS restricts its representation power heavily for modeling complex…
Improved machine learning with reduced tensor rank constraints and dropout.
problem Efficiently approximating large tensors in machine learning.
method Tree tensor networks with CP rank constraints and tensor dropout.
result Low-rank TTN classifier achieves 90.3% accuracy in Fashion-MNIST.
TensorNetwork is an open source library for implementing tensor network algorithms in TensorFlow. We describe a tree tensor network (TTN) algorithm for approximating the ground state of either a periodic quantum spin chain (1D) or a lattice model on a thin torus (2D), and implement the algorithm using TensorNetwork. We…
Tensor networks improve exotic option pricing efficiency.
problem Challenges in pricing exotic financial derivatives using standard methods.
method Combining binomial pricing with tensor network techniques (Matrix Product States).
result Linear scaling with parameters and reduced computational complexity.
Tensor networks improve b-jet classification in high-energy physics.
problem Classifying jets from b-quarks in proton-proton collisions.
method Quantum-inspired machine learning using tensor networks.
result Optimized classification of b-jets with improved precision and speed.
It is known that describing or calculating the conditional probabilities of multiple events is exponentially expensive. In this work, Bayesian tensor network (BTN) is proposed to efficiently capture the conditional probabilities of multiple sets of events with polynomial complexity. BTN is a directed acyclic graphical …
New algorithm speeds up knot polynomial calculations.
problem Computing Reshetikhin--Turaev knot polynomials efficiently.
method Fixed-parameter tractable computation via tensor networks.
result Knot polynomial computations are fixed-parameter tractable.
Extends geometrical description of tensor manifolds in tree-based formats.
problem Geometrical description of tensor manifolds in tree-based formats.
method Provided a new geometrical description of manifolds of tensors in tree-based format.
result Geometrical description compatible with Tucker format.
We propose a new statistical model suitable for machine learning of systems with long distance correlations such as natural languages. The model is based on directed acyclic graph decorated by multi-linear tensor maps in the vertices and vector spaces in the edges, called tensor network. Such tensor networks have been …
New framework constructs holographic tensor networks using hyperbolic buildings.
problem Building holographic tensor networks for non-integer dimensions and fractal spaces.
method Introducing a unifying framework based on hyperbolic buildings and dualities.
result Constructs a family of bulk regions satisfying complementary recovery and Ryu-Takayanagi formula.
We consider the problem of the estimation of a high-dimensional probability distribution from i.i.d. samples of the distribution using model classes of functions in tree-based tensor formats, a particular case of tensor networks associated with a dimension partition tree. The distribution is assumed to admit a density …
Inspired by coarse-graining approaches used in physics, we show how similar algorithms can be adapted for data. The resulting algorithms are based on layered tree tensor networks and scale linearly with both the dimension of the input and the training set size. Computing most of the layers with an unsupervised algorith…
Tensor networks improve integration accuracy for high-dimensional problems.
problem Integration of high-dimensional functions with exponential convergence.
method Regression-free tensor network representations for integration.
result Exponential convergence achieved for non-analytic integrands.
Hybrid tensor networks improve machine learning by combining quantum and classical methods.
problem Limitations of regular tensor networks in machine learning.
method Quantum-classical hybrid tensor networks (HTN) combining tensor networks and classical neural networks.
result HTN overcomes limitations of regular tensor networks and enables deep learning training.
In this article we show the duality between tensor networks and undirected graphical models with discrete variables. We study tensor networks on hypergraphs, which we call tensor hypernetworks. We show that the tensor hypernetwork on a hypergraph exactly corresponds to the graphical model given by the dual hypergraph. …
A novel Laplace-approximated Bayesian Tensor Network Kernel Machine (LA-TNKM) provides principled uncertainty estimates.
problem How to provide principled uncertainty estimates for tensor network kernel machines.
method Employing a linearized Laplace approximation for Bayesian inference.
result Consistently matches or surpasses Gaussian Processes and BNNs across diverse UCI regression benchmarks.
Tensor networks have found a wide use in a variety of applications in physics and computer science, recently leading to both theoretical insights as well as practical algorithms in machine learning. In this work we explore the connection between tensor networks and probabilistic graphical models, and show that it motiv…
Tensor networks improve medical image classification performance.
problem Improving medical image classification accuracy.
method Extending tensor networks to medical image analysis, focusing on 2D images.
result Tensor networks achieve comparable performance to deep learning methods with fewer hyperparameters and resources.
The resemblance between the methods used in quantum-many body physics and in machine learning has drawn considerable attention. In particular, tensor networks (TNs) and deep learning architectures bear striking similarities to the extent that TNs can be used for machine learning. Previous results used one-dimensional T…
RBM and DBM are represented as 2D tensor networks, revealing their expressive power and efficiency.
problem Understanding and optimizing RBM and DBM models.
method Representing RBM and DBM as 2D tensor networks and developing an efficient tensor network contraction algorithm.
result The proposed algorithm for computing partition functions is more accurate than state-of-the-art methods.
Tensor networks improve anomaly detection efficiency.
problem Anomaly detection in high-dimensional data.
method Tensor networks for learning a linear transformation over high-dimensional space, penalizing global tendency to normality.
result Tensor networks outperform deep and classical algorithms on various datasets.
Tensor networks improve anomaly detection at LHC for new physics.
problem Identifying new phenomena in proton collision events at LHC.
method Tensor network-based anomaly detection using Matrix Product State with an isometric feature map.
result Tensor networks outperform established quantum methods in identifying new phenomena.
Improves tensor networks for classifying medical images.
problem Classifying 2D and 3D medical images efficiently.
method Develops LoTeNet, a tensor network that treats small image regions as orderless and aggregates local representations hierarchically.
result LoTeNet achieves comparable or superior performance to other methods with less computational resources.
This paper shows how infinitely wide Tensor Networks converge to Gaussian Processes.
problem Understanding the relationship between Tensor Networks and Gaussian Processes.
method Analyzing the infinite-width limit of Tensor Networks and comparing them to Gaussian Processes.
result Infinitely wide Tensor Networks converge to Gaussian Processes, proving their equivalence.
Tensor networks improve image classification but require more expressive states.
problem Understanding why tensor networks work in image classification.
method Investigated entanglement properties of tensor network models for supervised image classification.
result Tensor networks can learn states that are robustly entangled, suggesting long-range entanglement is not essential.
Quantum-inspired tensor network speeds up financial risk assessment.
problem Efficiently pricing multi-asset derivatives in finance.
method Tensor network algorithms for multi-asset options pricing.
result Tensor network approach yields several orders of magnitude speedup.
No free lunch theorem formalized for tensor network models.
problem Understanding limitations of tensor network machine learning models.
method Formalized rigorous no-free-lunch theorem for specific tensor network models.
result Revealed intrinsic limitations of tensor network-based learning models.
Tensor networks reveal limitations for efficient text description but suggest potential for images.
problem Efficiently describing large text and image data sets using tensor networks.
method Investigation of mutual information scaling, introduction of mutual information estimators, and use of autoregressive and convolutional neural networks.
result Text data cannot be efficiently described by 1D tensor networks, while images may be better described by 2D tensor networks.
Bayesian Tensor Network combines prior and data likelihood for efficient prediction and parameter estimation.
problem Overfitting and poor performance in Tensor Network models.
method Introduce prior distribution, use Laplace approximation for posterior predictive distribution, and propose stable initialization for parameter estimation.
result Reduces overfitting and improves performance of Tensor Network models.
New method combines Monte Carlo and tensor networks for solving complex equations.
problem Solving high-dimensional partial differential equations efficiently.
method Uses Monte Carlo simulations and tensor train sketching for updates and re-estimations.
result Demonstrates versatility and efficacy in solving specific equations.
Tensor networks improve unsupervised learning performance.
problem Improving unsupervised machine learning models.
method Autoregressive Matrix Product States (AMPS) combining quantum and machine learning.
result AMPS significantly outperforms existing tensor network models and neural networks.
Adaptive algorithm learns tensor network structures from data.
problem Identifying optimal tensor network structure from data.
method Greedy approach starting from rank one tensor, small rank increments.
result Adaptive algorithm identifies efficient tensor network structures.
Develops a tensor network framework to reduce RNN complexity for high-dimensional sequence modeling.
problem Exponential parameter growth in RNNs for large multidimensional data.
method Embeds a multi-linear graph filter in a tensor network architecture to approximate RNN hidden states.
result Demonstrates superior performance and reduced complexity compared to traditional RNNs.
We propose a restricted class of tensor network state, built from number-state preserving tensors, for supervised learning tasks. This class of tensor network is argued to be a natural choice for classifiers as (i) they map classical data to classical data, and thus preserve the interpretability of data under tensor tr…
Quantum neural network and tensor network models outperform classical models in Japanese stock market predictions.
problem Improving stock return predictions using quantum and quantum-inspired machine learning.
method Evaluation of quantum neural network and tensor network models against classical models like linear and neural networks.
result Tensor network model outperforms classical models in Japanese stock market, including linear and neural network models.
We introduce tensor network contraction algorithms for the evaluation of the Jones polynomial of arbitrary knots. The value of the Jones polynomial of a knot maps to the partition function of a q-state Potts model defined as a planar graph with weighted edges that corresponds to the knot. For any integer q, we cast…
A new tensor completion method using tensor networks with Tucker wrapper.
problem Low-rank tensor completion in various applications.
method Solving LRTC as a system of nonlinear equations using a two-level alternative least squares method.
result The method converges to the exact solution at a linear rate with high probability.
RWTNs improve NTN performance in SRL tasks.
problem Improving NTN performance in SRL tasks.
method Randomly weighted, untrained tensors in NTN encoder network.
result RWTNs outperform LTNs in SII tasks.
Unified tensor network formalism for combining neural and symbolic AI.
problem Combining neural and symbolic AI approaches remains a challenge.
method Introduces a tensor network formalism capturing sparsity principles.
result Unified treatment identifies tensor network contractions as a fundamental inference class.
DCTN uses tensor networks for image classification, achieving state-of-the-art results.
problem Improving image classification accuracy with deep neural networks.
method Developed a novel deep convolutional tensor network (DCTN) based on Entangled plaquette states (EPS).
result DCTN achieves state-of-the-art results on MNIST and FashionMNIST but overfits on CIFAR10.
Tensor networks are efficient representations of high-dimensional tensors which have been very successful for physics and mathematics applications. We demonstrate how algorithms for optimizing such networks can be adapted to supervised learning tasks by using matrix product states (tensor trains) to parameterize models…
A new tensor network method for image classification reduces computation cost.
problem Efficiently classifying images in high-dimensional spaces.
method Proposes a multi-layered tensor network (MLTN) that performs one MPS operation per layer, reducing computation cost.
result Reduces computation cost without degrading performance.
New tensor network models learn continuous data effectively.
problem Tensor network models' limitations in handling continuous data.
method Developed a new family of tensor network generative models for continuous data.
result Models can approximate any reasonably smooth probability density function with arbitrary precision.
New method approximates high-dimensional probability densities efficiently.
problem Approximating high-dimensional probability densities accurately and efficiently.
method Hierarchical tensor-network approach using randomized SVD and linear equations.
result The method effectively approximates high-dimensional densities with linear complexity.
We present an algorithm for supervised learning using tensor networks, employing a step of preprocessing the data by coarse-graining through a sequence of wavelet transformations. We represent these transformations as a set of tensor network layers identical to those in a multi-scale entanglement renormalization ansatz…