Bayesian tensor train method recovers streaming data with high accuracy.
problem Recovering high-order, incomplete, and noisy streaming data.
method Bayesian tensor train decomposition using streaming variational Bayes method.
result The proposed SPTT algorithm excels in recovering streaming data compared to state-of-the-art methods.
Tensor train (TT) decomposition provides a space-efficient representation for higher-order tensors. Despite its advantage, we face two crucial limitations when we apply the TT decomposition to machine learning problems: the lack of statistical theory and of scalable algorithms. In this paper, we address the limitations…
Tensorized random projections reduce high-dimensional tensor size efficiently.
problem Efficiently reducing the dimension of very high-dimensional tensors.
method Proposes two tensorized random projection maps using TT and CP decompositions.
result TT format offers superior performance in terms of required random projection size.
Study geodesic X-ray transforms on hyperbolic surfaces, proposing new reconstruction methods.
problem Inverting geodesic X-ray transforms for symmetric tensor fields on asymptotically hyperbolic surfaces.
method Developed a decomposition theorem for m-tensor fields, used Guillemin-Kazhdan operators and 0-calculus, and provided explicit reconstruction methods.
result Explicit reconstruction methods for even tensor fields from their X-ray transform or normal operator.
Tensorized Rademacher projections outperform Gaussian projections in reducing tensor dimensions.
problem Reducing the dimension of high-dimensional tensors for machine learning.
method Tensorized Rademacher random projections using Tensor Train decomposition.
result Tensorized Rademacher projections can replace Gaussian projections in tensor compression.
Characterizes kernel of linearization for minimal surfaces problem
problem Characterizing kernel of linearization for minimal surfaces problem
method Show kernel consists of potential fields and TT fields
result In whole-space Euclidean decomposition, kernel consists of potential fields and TT fields
Tensor networks constrain kernel machines to Gaussian processes.
problem Speeding up kernel machines with reduced model complexity.
method Proving CPD and TT-constrained models recover Gaussian processes with i.i.d. priors.
result TT-constrained models exhibit more Gaussian process behavior than CPD for the same parameters.
In this paper, we analyze the fundamental conditions for low-rank tensor completion given the separation or tensor-train (TT) rank, i.e., ranks of unfoldings. We exploit the algebraic structure of the TT decomposition to obtain the deterministic necessary and sufficient conditions on the locations of the samples to ens…
Tensor completion estimates missing components by exploiting the low-rank structure of multi-way data. The recently proposed methods based on tensor train (TT) and tensor ring (TR) show better performance in image recovery than classical ones. Compared with TT and TR, the projected entangled pair state (PEPS), which is…
New LSH methods for tensor data improve efficiency and space usage.
problem Efficiency and space usage issues in LSH for tensor data.
method Proposes new LSH methods using CP and TT decompositions for Euclidean and cosine similarity.
result Space-efficient and scalable LSH for tensor data.
We introduce a new parameterization method for deep learning layers using spectral tensor train decomposition.
problem Efficiency and stability in deep learning models with weight matrix compression.
method Spectral Tensor Train Parameterization (STTP) of weight matrices.
result Improved compression and training stability in neural networks.
Develops a new tensor classification method for high-dimensional data.
problem Efficient learning algorithms exploiting tensorial structure in high-dimensional multi-way arrays.
method Tensor Train Multi-way Multi-level Kernel (TT-MMK) combining Canonical Polyadic decomposition, Dual Structure-preserving Support Vector Machine, and Tensor Train approximation.
result The TT-MMK method provides higher prediction accuracy and is more reliable computationally compared to other techniques.
TensorGuide improves LoRA efficiency and expressivity through joint tensor-train optimization.
problem Limited expressivity and generalization of standard LoRA.
method TensorGuide uses a unified tensor-train structure with controlled Gaussian noise to generate correlated low-rank matrices.
result TensorGuide achieves superior accuracy and scalability with fewer parameters compared to standard LoRA and TT-LoRA.
Adaptive algorithm learns tensor network structures from data.
problem Identifying optimal tensor network structure from data.
method Greedy approach starting from rank one tensor, small rank increments.
result Adaptive algorithm identifies efficient tensor network structures.
Unified algorithm for tensor decomposition supports multiple loss functions and models.
problem Efficient tensor decomposition for various models and loss functions.
method Hierarchical combination of ADMM and MM for optimization.
result Wide-range applications can be solved by the proposed algorithm.
The main construction of this paper contains a serious error, and I am withdrawing it. I owe Andrew Stacey and Ralph Cohen thanks for seeing the problem; in particular, Stacey has shown that the projections constructed in §3.1 will fail in general to have constant rank, so the family TV of vector spaces defined…
Tensor network decomposition, originated from quantum physics to model entangled many-particle quantum systems, turns out to be a promising mathematical technique to efficiently represent and process big data in parsimonious manner. In this study, we show that tensor networks can systematically partition structured dat…
Classifies Toda-type tt*-structures and their fixed points.
problem Classifying Toda-type tt*-structures and their fixed points.
method Fixed point description and reduction of anti-symmetry conditions.
result Reduces possibilities of anti-symmetry condition to two cases.
Recurrent Neural Networks (RNNs) are powerful sequence modeling tools. However, when dealing with high dimensional inputs, the training of RNNs becomes computational expensive due to the large number of model parameters. This hinders RNNs from solving many important computer vision tasks, such as Action Recognition in …
A new method uses CPD to efficiently model feature interactions in non-sequential data.
problem Efficiently modeling feature interactions in non-sequential data with high computational and memory costs.
method Implicitly represent model parameters as a tensor, factorize into a compact Tensor Train (TT) format, and use Canonical Polyadic (CP) Decomposition for invariance to feature ordering.
result The proposed CP-based predictor outperforms other TN-based predictors on sparse data and matches neural network performance on dense non-sequential tasks.
Using nonlinear pde techniques, we construct a new family of globally smooth tt* structures. This includes tt* structures associated to the (orbifold) quantum cohomology of a finite number of complex projective spaces and weighted projective spaces. The existence of such "magical solutions" of the tt* equations, namely…
The paper proves an isomorphism between tt∗ structures of Landau-Ginzburg and Calabi-Yau models.
problem Establishing an isomorphism between tt∗ structures of different geometries. method Using Landau-Ginzburg models and Calabi-Yau hypersurfaces, proving the isomorphism via the big residue map.
result An isomorphism between tt∗ structures of Landau-Ginzburg and Calabi-Yau models is proven. Relates quantum cohomology to tt*-Toda equations for minuscule flag manifolds.
problem Quantum cohomology of minuscule flag manifolds.
method Combining Lie-theoretic treatments of tt*-Toda equations and quantum cohomology.
result Relates quantum cohomology to tt*-Toda equations for minuscule flag manifolds.
Recent studies have introduced end-to-end TTS, which integrates the production of context and acoustic features in statistical parametric speech synthesis. As a result, a single neural network replaced laborious feature engineering with automated feature learning. However, little is known about what types of context in…
Paper compresses RNNs using HT decomposition for better performance.
problem Large model sizes of RNNs in sequence analysis.
method Hierarchical Tucker (HT) tensor decomposition for model compression.
result HT-LSTM achieves better compression and accuracy than state-of-the-art methods.
Analyzes tt*-structures from ADE-type Stokes data.
problem Classifying tt*-structures over C∗. method Isomonodromic deformations with upper unitriangular real Stokes matrices.
result Establishes a direct analytic realization of the ADE classification. Polynomial growth elements found in all subgroups of Out(F_n).
problem Understanding polynomial growth in subgroups of Out(F_n).
method Analyzing conjugacy classes and elements of Out(F_n).
result Polynomial growth elements exist in all subgroups of Out(F_n).
Explains quantum cohomology of Grassmannians using tt* equations.
problem Relates quantum cohomology of complex Grassmannians to projective space.
method Uses tt* equations and Lie-theoretic connections.
result Illustrates relations between tt* equations and quantum cohomology.
Proves existence and uniqueness of solutions for A_n tt*-Toda equations.
problem Existence and uniqueness of solutions for A_n tt*-Toda equations.
method Proof of existence and uniqueness for any n, new treatment of asymptotic data.
result Existence and uniqueness of global solutions for any n.
We study transverse-tracefree (TT)-tensors on conformally flat 3-manifolds (M,g). The Cotton-York tensor linearized at g maps every symmetric tracefree tensor into one which is TT. The question as to whether this is the general solution to the TT-condition is viewed as a cohomological problem within an elliptic com…
Solves constant pre-factor problem for tt*-Toda equations using asymptotic data and symplectic structures.
problem Constant pre-factor problem for the tt*-Toda equations.
method Explicit evaluation using asymptotic data and introduction of symplectic structures.
result Preservation of symplectic structures by Riemann-Hilbert correspondence for wider class of solutions.
BOFFIN TTS optimizes hyper-parameters for new speaker adaptation.
problem Fine-tuning a pre-trained TTS model for a new speaker with limited data.
method Bayesian optimization to efficiently find optimal hyper-parameters.
result Average 30% improvement in speaker similarity over standard techniques.
Study of symplectic groupoids from tt*-Toda equations.
problem Geometry of meromorphic connections with irregular singularities.
method Holomorphic symplectic groupoid structure over Steinberg cross section.
result Proves the space of tt*-Toda connections is a symplectic Lie groupoid.
Solutions of tt*-equation from SU(2)_k fusion algebra.
problem Describe solutions to the tt*-equation from a specific algebra.
method Use DPW method and representations of SU(2).
result Construct solutions corresponding to A_k minimal model.
We propose RandUCB, a bandit strategy that builds on theoretically derived confidence intervals similar to upper confidence bound (UCB) algorithms, but akin to Thompson sampling (TS), it uses randomization to trade off exploration and exploitation. In the K-armed bandit setting, we show that there are infinitel…
New surfaces with conjugate points have global blow-down maps in their TT spaces.
problem Constructing global blow-down maps for surfaces with conjugate points.
method Explicit construction of a family of non-trapping Riemannian surfaces with global blow-down maps.
result Global blow-down maps exist for some non-simple surfaces with conjugate points.
Proposes Textual Echo Cancellation to improve speech recognition.
problem Improving speech recognition performance and user experience for smart devices.
method A novel sequence-to-sequence model with multi-source attention that processes both the microphone mixture signal and source text of TTS playback.
result Demonstrates enhanced speech recognition performance and reduced latency.
Investigates neural TTS systems for Japanese and English.
problem Improving neural TTS systems for high-quality speech synthesis.
method Comparative study of neural sequence-to-sequence TTS vs. DNN pipeline TTS, varying model architecture, parameter size, and language.
result A neural sequence-to-sequence TTS system requires sufficient model parameters and a powerful encoder for high-quality speech synthesis.
End-to-end text-to-speech (TTS) synthesis is a method that directly converts input text to output acoustic features using a single network. A recent advance of end-to-end TTS is due to a key technique called attention mechanisms, and all successful methods proposed so far have been based on soft attention mechanisms. H…
We present a fully convolutional wav-to-wav network for converting between speakers' voices, without relying on text. Our network is based on an encoder-decoder architecture, where the encoder is pre-trained for the task of Automatic Speech Recognition, and a multi-speaker waveform decoder is trained to reconstruct the…
We describe all smooth solutions of the two-function tt*-Toda equations (a version of the tt* equations, or equations for harmonic maps into SL(n,R)/SO(n)) in terms of (i) asymptotic data, (ii) holomorphic data, and (iii) monodromy data. This allows us to find all solutions with integral Stokes data. These include solu…
In "Isomonodromy aspects of the tt* equations of Cecotti and Vafa I. Stokes data" (arxiv:1209.2045) we described all smooth solutions of the two-function tt*-Toda equations in terms of asymptotic data, holomorphic data, and monodromy data. In this supplementary article we focus on the holomorphic data and its interpret…
A new TTS method uses diffusion and VAE for better speech synthesis.
problem Improving text-to-speech synthesis for better speech quality and robustness.
method Combines diffusion probabilistic model and variational autoencoder for latent variable conversion.
result The method is robust to poor orthography and alignment errors.
End-to-end Sanskrit TTS developed with limited data, achieving good quality.
problem Developing natural-sounding speech for Sanskrit with scarce data.
method Fine-tuning Tacotron2 model with WaveGlow and transfer learning.
result Achieved an overall MOS of 3.38 from 37 evaluators.
In this note we prove an existence result for the Einstein conformal constraint equations for metrics with vanishing Yamabe invariant assuming that the TT-tensor is small in L2.
We give an overview on the tt*-geometry defined for isolated hypersurface singularities and tame functions via Brieskorn lattices. We discuss nilpotent orbits in this context, as well as classifying spaces of Brieskorn lattices and (limits of) period maps.
Tensor network surrogate for efficient option pricing in large portfolios.
problem Large-scale portfolio revaluation problems in market risk management.
method Tensor-train (TT) approximation for high-dimensional price surfaces, direct inference using Laplacian kernel and TT representations.
result Tensor surrogate achieves lower test error and faster evaluation times compared to standard GPR.
Proposes a new kernel technique for tensor data in SVM.
problem Handling tensorial data in machine learning.
method Kernelized support tensor train machine for image classification.
result Tensorizes the standard SVM on its input structure and kernel mapping scheme.