A new algorithm speeds up CP decomposition for large tensors.
problem Efficiently processing large-scale tensors in real-time.
method Randomized online CP decomposition (ROCP) algorithm.
result ROCP reduces computing time and memory usage significantly.
New method models matrix time series using tensor CP-decomposition.
problem Modeling matrix time series with reduced complexity.
method One-pass estimation via generalized eigenanalysis and refined projection.
result Component coefficient vectors estimated consistently with certain rates.
Constructs a simplicial cell decomposition of complex projective space for n ≥ 2.
problem Finding a simplicial cell decomposition for complex projective space.
method Starting with a standard crystallisation of the 2-sphere, constructing a simplicial subdivision, and quotienting by the Sym(n) action.
result Explicit construction of a simplicial cell decomposition of complex projective space for n ≥ 2.
Revisits CP tensor decomposition for noisy, non-orthogonal data.
problem Statistical optimality and convergence of ALS in noisy, non-orthogonal, higher-rank settings.
method Statistical analysis and TASD method for initialization.
result ALS with TASD achieves optimal error in rank-one setting within one or two iterations.
New algorithms improve tensor CP decomposition under mild conditions.
problem Improving tensor CP decomposition with theoretical guarantees under mild incoherence conditions.
method Composite PCA and Concurrent Orthogonalization algorithms.
result Theoretical guarantees and practical superiority over existing methods.
The problem of Knowledge Base Completion can be framed as a 3rd-order binary tensor completion problem. In this light, the Canonical Tensor Decomposition (CP) (Hitchcock, 1927) seems like a natural solution; however, current implementations of CP on standard Knowledge Base Completion benchmarks are lagging behind their…
Develops SymGCP for tensor decompositions with general symmetry.
problem Handling symmetry in tensor decompositions for better model accuracy.
method Introduces SymGCP, a generalized CP decomposition that accounts for any subset of tensor modes' symmetry.
result SymGCP enables efficient and scalable tensor decomposition with improved model robustness and accuracy.
We give new rational blowdown constructions of exotic CP^2#n(-CP^2) (5\leq n\leq 9) without using elliptic fibrations. We also show that our 4-manifolds admit handle decompositions without 1- and 3-handles, for 7\leq n\leq 9. A strategy for rational blowdown constructions of exotic CP^2#n(-CP^2) (1\leq n\leq 4) is also…
Unified algorithm for tensor decomposition supports multiple loss functions and models.
problem Efficient tensor decomposition for various models and loss functions.
method Hierarchical combination of ADMM and MM for optimization.
result Wide-range applications can be solved by the proposed algorithm.
TGCCA analyzes higher-order tensors using orthogonal rank-R CP decomposition.
problem Handling higher-order structures in multi-block data analysis.
method Tensor Generalized Canonical Correlation Analysis (TGCCA) with orthogonal rank-R CP decomposition.
result TGCCA outperforms state-of-the-art methods on simulated and real data.
New complex structure on hyperbolic disc within hyperkaehler space.
problem Complex structure on hyperbolic disc within hyperkaehler space.
method Mostow decomposition and complex adjoint orbit analysis.
result Complex structure on hyperbolic disc differs from natural embedding.
Two methods preserve tensor structure for reduced dimensionality in tensor regression.
problem Reducing dimensionality of tensor predictors for improved interpretation and accuracy.
method Developed two tensor dimension reduction methods using Tucker and CP decompositions.
result Substantial improvement in accuracy over existing methods in simulations and applications.
Methods based on vector embeddings of knowledge graphs have been actively pursued as a promising approach to knowledge graph completion.However, embedding models generate storage-inefficient representations, particularly when the number of entities and relations, and the dimensionality of the real-valued embedding vect…
Classifies 4-manifolds with genus one horizontal handlebody decomposition.
problem Classifying 4-manifolds with specific properties.
method Classification using Euler characteristic and handlebody decomposition.
result Found a large family of rational homology balls that embed into CP2. Efficient tensor decomposition for count data models achieves near-optimal multiway analysis.
problem Efficient tensor decomposition for count data models.
method Rank-constrained maximum-likelihood estimator for tensor decomposition.
result Achieves multiway analysis with variance matching Cramér-Rao Lower Bound up to constants and logarithmic factors.
We consider the problem of online subspace tracking of a partially observed high-dimensional data stream corrupted by noise, where we assume that the data lie in a low-dimensional linear subspace. This problem is cast as an online low-rank tensor completion problem. We propose a novel online tensor subspace tracking al…
Smooth 4-manifolds have simple horizontal decompositions.
problem Classifying smooth, closed, orientable 4-manifolds.
method Horizontal handlebody decomposition.
result Simplest horizontal decompositions classify closed 4-manifolds.
Tensor decompositions are powerful tools for large data analytics as they jointly model multiple aspects of data into one framework and enable the discovery of the latent structures and higher-order correlations within the data. One of the most widely studied and used decompositions, especially in data mining and machi…
New 4-manifolds found without 1- and 3-handles.
problem Finding 4-manifolds without specific handles.
method Perfect Morse functions and handle decompositions.
result Infinitely many 4-manifolds homeomorphic but not diffeomorphic to standard manifolds.
Tensorized random projections reduce high-dimensional tensor size efficiently.
problem Efficiently reducing the dimension of very high-dimensional tensors.
method Proposes two tensorized random projection maps using TT and CP decompositions.
result TT format offers superior performance in terms of required random projection size.
This work improves tensor decomposition methods, especially for large datasets.
problem Lack of efficient methods for estimating Tucker decompositions.
method Applies Johnson-Lindenstrauss type guarantees to Tucker decompositions with random embeddings.
result Effective dimension reduction with minimal error for large tensors.
CP-factorization for high-dimensional tensor time series and double projection iterations
problem Identifying and estimating factor loadings in CP decomposition for high-dimensional tensor time series
method One-pass estimation procedure using standard eigen-analysis for matrix constructed based on serial dependence
result Asymptotic properties established under general settings, adapt to sparsity, accommodates weak factors
Tensor CANDECOMP/PARAFAC (CP) decomposition has wide applications in statistical learning of latent variable models and in data mining. In this paper, we propose fast and randomized tensor CP decomposition algorithms based on sketching. We build on the idea of count sketches, but introduce many novel ideas which are un…
In this paper, we study a polynomial decomposition model that arises in problems of system identification, signal processing and machine learning. We show that this decomposition is a special case of the X-rank decomposition --- a powerful novel concept in algebraic geometry that generalizes the tensor CP decomposition…
We construct instanton Floer homology for lens spaces L(p,q). As an application, we prove that $X = \CP^2 # \CP^2$ does not admit a decomposition X=X1∪X2. Here X1 and X2 are oriented, simply connected, non-spin 4-manifolds with b+=1 and with boundary L(p,2), and p is a prime number of the f…
Quantization on even-dimensional compact manifolds using cell decomposition.
problem Quantization of compact even-dimensional manifolds.
method Cell decomposition and embedding in CP^d, inducing local Poisson structure and star product.
result Achieved Berezin-type quantization on compact even-dimensional manifolds.
New LSH methods for tensor data improve efficiency and space usage.
problem Efficiency and space usage issues in LSH for tensor data.
method Proposes new LSH methods using CP and TT decompositions for Euclidean and cosine similarity.
result Space-efficient and scalable LSH for tensor data.
Robust tensor CP decomposition involves decomposing a tensor into low rank and sparse components. We propose a novel non-convex iterative algorithm with guaranteed recovery. It alternates between low-rank CP decomposition through gradient ascent (a variant of the tensor power method), and hard thresholding of the resid…
High-dimensional tensors or multi-way data are becoming prevalent in areas such as biomedical imaging, chemometrics, networking and bibliometrics. Traditional approaches to finding lower dimensional representations of tensor data include flattening the data and applying matrix factorizations such as principal component…
We propose an extension of the canonical polyadic (CP) tensor model where one of the latent factors is allowed to vary through data slices in a constrained way. The components of the latent factors, which we want to retrieve from data, can vary from one slice to another up to a diffeomorphism. We suppose that the diffe…
The paper embeds 4-manifolds into CP^2 x CP^1 using Lefschetz fibrations.
problem Embedding 4-manifolds into CP^2 x CP^1.
method Proving Lefschetz fibration embeddings of 4-manifolds into CP^2 x CP^1.
result Every closed, connected, orientable 4-manifold admits a smooth Lefschetz fibration embedding into CP^2 x CP^1.
In this paper, we first prove that any closed simply connected 4-manifold that admits a decomposition into two disk bundles of rank greater than 1 is diffeomorphic to one of the standard elliptic 4-manifolds: S4, CP2, S2×S2, or CP2#±CP2. As an…
New method solves elliptic equations on manifolds without grids.
problem Solving elliptic equations on complex manifolds.
method Numerical domain decomposition method avoiding global grids.
result Method validated on specific 4D manifolds.
New ADMM method for PARAFAC2 tensor decomposition with flexible regularization.
problem Challenges in applying regularisation to the evolving mode of PARAFAC2.
method Alternating Direction Method of Multipliers (AO-ADMM) for PARAFAC2 tensor fitting.
result The proposed ADMM-based approach accurately recovers underlying components from simulated data.
Matrix factorizations and their extensions to tensor factorizations and decompositions have become prominent techniques for linear and multilinear blind source separation (BSS), especially multiway Independent Component Analysis (ICA), NonnegativeMatrix and Tensor Factorization (NMF/NTF), Smooth Component Analysis (Smo…
Tensor decomposition methods are widely used for model compression and fast inference in convolutional neural networks (CNNs). Although many decompositions are conceivable, only CP decomposition and a few others have been applied in practice, and no extensive comparisons have been made between available methods. Previo…
4-manifolds can be broken down into pairs-of-pants and K3 surfaces.
problem Decomposing 4-manifolds diffeomorphic to complex hypersurfaces.
method Pair-of-pants and K3 surfaces decomposition.
result 4-manifolds diffeomorphic to complex hypersurfaces can be decomposed into a specific number of pair-of-pants and K3 surfaces.
Let S be a surface with genus g and n boundary components and let d(S) = 3g-3+n denote the number of curves in any pants decomposition of S. We employ metric properties of the graph of pants decompositions CP(S) prove that the Weil-Petersson metric on Teichmuller space Teich(S) is Gromov-hyperbolic if and only if d(S) …
New method compresses deep learning layers using tensor decomposition.
problem Reduction of computation cost and interpretability for tensor data.
method CP-decomposition to compress convolutional layers in deep learning.
result Reduces model complexity and maintains prediction performance.
NeCPD improves online tensor decomposition using SGD with Hessian analysis and NAG.
problem Efficiently decompose multi-way tensors in online data processing.
method NeCPD solver based on SGD with Hessian analysis and NAG.
result NeCPD provides more accurate results than existing methods.
New algorithm for online tensor factorization with provable guarantees.
problem Factorizing structured tensors with unknown factors and non-convex optimization.
method Online CP/PARAFAC decomposition via dictionary learning with incoherence and sparsity constraints.
result Exact recovery of tensor factors at a linear rate under mild conditions.
Paper tackles tensor decomposition for unaligned observations using RKHS and novel loss functions.
problem Tackles tensor decomposition for unaligned observations.
method Uses functions in RKHS to represent mode with unaligned observations, introduces versatile loss function, proposes optimization algorithm and stochastic gradient method.
result Demonstrates improved tensor decomposition efficiency and effectiveness with synthetic and real data.
Recovery of low-rank matrices from a small number of linear measurements is now well-known to be possible under various model assumptions on the measurements. Such results demonstrate robustness and are backed with provable theoretical guarantees. However, extensions to tensor recovery have only recently began to be st…
New algorithm learns interpretable CP-basis from streaming tensor data under Markovian constraints.
problem Learning interpretable CP-basis from streaming tensor data under Markovian constraints.
method Online Tensor Factorization (OTF) with CANDECOMP/PARAFAC (CP) decomposition, proving convergence to stationary points.
result Algorithm converges almost surely to stationary points of the objective function under Markovian data generation.
NeSGD efficiently updates tensor-based features for online model learning in multi-way data.
problem Incremental updates of tensor-based features and model coefficients for evolving data distributions.
method Online NeSGD for CP decomposition of tensor data.
result Proposed NeSGD method significantly improves classification accuracy and adapts to changing data distributions.
Using tropical geometry, Mikhalkin has proved that every smooth complex hypersurface in CPn+1 decomposes into pairs of pants: a pair of pants is a real compact 2n-manifold with cornered boundary obtained by removing an open regular neighborhood of n+2 generic hyperplanes from CPn. As is we…
A new method uses CPD to efficiently model feature interactions in non-sequential data.
problem Efficiently modeling feature interactions in non-sequential data with high computational and memory costs.
method Implicitly represent model parameters as a tensor, factorize into a compact Tensor Train (TT) format, and use Canonical Polyadic (CP) Decomposition for invariance to feature ordering.
result The proposed CP-based predictor outperforms other TN-based predictors on sparse data and matches neural network performance on dense non-sequential tasks.
A new framework improves tensor completion accuracy by considering numerical priors.
problem Tensor completion accuracy loss due to ignoring numerical priors.
method Generalized CP Decomposition Tensor Completion (GCDTC) framework incorporating numerical priors.
result GCDTC framework outperforms state-of-the-arts in non-negative tensor completion.