The paper tackles tensor factorization and completion from noisy data.
problem Sparse nonnegative tensor factorization and completion from partial and noisy observations.
method Minimizes the sum of maximum likelihood estimation and tensor ℓ0 norm with nonnegativity constraints. result Error bounds and minimax lower bounds are established for the proposed model.
Paper compares optimization methods for sparse NCP decomposition of tensors.
problem Efficiently extract meaningful nonnegative and sparse components from tensors.
method Sparse NCP decomposition with l1-norm regularization and block coordinate descent.
result Comparison of optimization methods for tensor decomposition effectiveness and speed.
Proposes a method to recover sparse tensors with covariate info.
problem Sparse tensor with high missing entries and many zeros.
method Covariate-assisted Sparse Tensor Completion (COSTCO) using latent components.
result 23% accuracy improvement over baseline in advertisement dataset.
Paper proposes a method for estimating sparse and low-rank tensors from sketchings.
problem Estimating sparse and low-rank tensors from limited data.
method Two-stage non-convex implementation using sparse tensor decomposition and thresholded gradient descent.
result Exact and stable recovery of tensors in noisy and noiseless cases with high probability.
Proposes a model to relate a tensor feature to a univariate outcome using sparse and low-rank components.
problem Relating a univariate outcome to a feature tensor with sparse and low-rank components.
method Divide-and-conquer strategy, stagewise estimation procedure for unit-rank tensor regression.
result The stagewise solution paths converge to those of regularized regression as step size goes to zero.
Sparse tensor additive regression models tensor covariates for scalar responses.
problem Modeling scalar responses from tensor covariates with sparse and low-rank structures.
method Proposes a non-convex optimization problem and an efficient penalized alternating minimization algorithm.
result Establishes an error bound for the estimator and demonstrates the model's efficacy in simulations and online advertising.
Four algorithms improve sparse tensor BR1Approx with theoretical guarantees.
problem Sparse tensor best rank-1 approximation.
method Four approximation algorithms exploiting multilinearity and sparsity.
result Theoretical worst-case approximation lower bounds for all algorithms.
New algorithms recover sparse tensor principal components efficiently.
problem Recovering sparse tensor principal components from noisy data.
method Family of algorithms interpolating between polynomial-time and exhaustive search, tailored for sparse and highly sparse regimes.
result Our algorithms recover sparse vectors for signal-to-noise ratios beyond previous limits, with time complexity ildeO(np+t). Unified model for tensor completion using low-rank and sparse Tucker decomposition.
problem Estimating missing data from incomplete tensor measurements.
method Unified low-rank and sparse enhanced Tucker decomposition model with ADMM.
result Our model achieves higher recovery accuracy on various real-world data sets.
Robust tensor CP decomposition involves decomposing a tensor into low rank and sparse components. We propose a novel non-convex iterative algorithm with guaranteed recovery. It alternates between low-rank CP decomposition through gradient ascent (a variant of the tensor power method), and hard thresholding of the resid…
New method improves tensor completion by selectively preserving important elements.
problem Recovering corrupted high-dimensional tensor data with missing entries and noise.
method Tensor weighted correlated total variation (TWCTV) regularizer with ADMM algorithm.
result Superior performance in image completion, denoising, and background subtraction tasks.
Tensor decomposition improves robot control by modeling inverse dynamics.
problem Accurate modeling of inverse dynamics for robot control.
method Tensor decomposition of sparse tensors to approximate non-linear functions.
result Superior performance compared to state-of-the-art methods.
CPOPT-Net predicts sparse client actions in banking using tensor decomposition and neural networks.
problem Predicting sparse client activities in the banking environment with evolving regulations.
method Combines CP tensor decomposition and neural networks for time series predictions.
result CPOPT-Net achieves accurate predictions of clients' financial activities.
Robust tensor ring completion improves tensor recovery accuracy and efficiency.
problem Tensor completion sensitivity to sparse components.
method Robust Tensor Ring Completion (RTRC) with weighted nuclear norms and l1 regularization.
result Exact recovery guarantees and superior performance in various tasks.
Paper tackles tensor completion from sparse corrupted data using convex optimization.
problem Estimating multidimensional arrays from a subset of corrupted entries.
method Solves a convex program that minimizes a weighted combination of tubal nuclear norm and ℓ1-norm. result Exact recovery of incoherent tensors with overwhelming probability.
Paper proposes tensor sparse PCA for improved face recognition accuracy.
problem Face recognition accuracy improvement using novel methods.
method Combines tensor sparse PCA with nearest-neighbor and kernel ridge regression methods.
result Tensor sparse PCA method yields better accuracy than PCA method alone.
Paper proposes a new method for exact recovery in robust tensor principal component analysis.
problem Exact recovery of low-rank and sparse components in tensors.
method Proposes a new method based on tensor-tensor product and t-SVD to solve a convex optimization problem.
result Exact recovery achieved in a deterministic fashion without randomness assumptions.
Algorithm estimates tensors from sparse observations with robust error bounds.
problem Estimating tensors from sparse noisy observations.
method Similarity-based collaborative filtering algorithm for tensor estimation.
result Achieves sample complexity nearly matching conjectured lower bound.
Sparse sampling method for tensor factorization and completion of high rank tensors.
problem Completion of high rank tensors with missing data in recommendation systems.
method Sparse measurements and message-passing algorithms in a high-dimensional limit.
result Theoretical insights and performance analysis of tensor factorization in dense limit.
New model encodes multivariate signals more efficiently with sparsity and low-rank constraints.
problem Efficiently encoding multivariate signals with sparsity and low-rank constraints.
method Multivariate convolutional sparse coding with tensor algebra, CP decomposition, and alternating optimization.
result Proves model closely related to Kruskal tensor regression problem with theoretical guarantees.
Proposes a nonparametric tensor factorization for sparse data.
problem Handling sparse tensor data with structural and interpretability benefits.
method Hierarchical Gamma processes and Poisson random measures for tensor-valued process, Dirichlet processes for sampling entry indices, Gaussian processes for values.
result Demonstrates superior performance on benchmark datasets.
Paper tackles sparse, unstructured data tensors by optimizing adaptive aggregation granularity.
problem Sparse, unstructured data tensors are hard to analyze.
method Introduces IceBreaker, a greedy algorithm that optimizes adaptive tensor aggregation.
result IceBreaker constructs tensors with high structure quality from various datasets.
Proposes a method for tensor completion with sparse factors and missing data.
problem Recovering nonnegative data from noisy observations with missing values.
method Sparse nonnegative Tucker decomposition with ℓ0 norm for sparsity, maximum likelihood estimation, and error bounds. result The method outperforms existing tensor-based or matrix-based methods in nonnegative tensor data completion.
This work learns sparse tensor representations using mixtures of separable dictionaries.
problem Learning sparse representations of tensor data with structured models.
method Proposes and explores learning a mixture of separable dictionaries with sufficient conditions for local identifiability.
result Developed computational algorithms for batch and online learning.
Efficiently decomposes large tensors using stochastic gradients.
problem Efficiently decomposing large tensors for multiway data analysis.
method Stochastic gradients computed via MTTKRP kernel for efficient computation.
result Advantages and scalability demonstrated for large-scale problems.
STAT-SVD method reduces high-dimensional data sparsity, achieving optimal estimation.
problem Sparse tensor singular value decomposition for high-dimensional data.
method STAT-SVD method with double projection & thresholding scheme.
result STAT-SVD provides sharp thresholding criterion and minimax rate-optimal estimation.
We propose a novel sparse tensor decomposition method, namely Tensor Truncated Power (TTP) method, that incorporates variable selection into the estimation of decomposition components. The sparsity is achieved via an efficient truncation step embedded in the tensor power iteration. Our method applies to a broad family …
The paper proposes a method to estimate tensor regression parameters using low-rank and sparse Tucker decompositions.
problem Estimating tensor regression parameters from limited data.
method Low-rank and sparse Tucker decompositions, non-convex optimization, projected gradient descent.
result The method can linearly converge to an appropriate solution under certain conditions.
TensorNetwork simplifies tensor network algorithms for physics and machine learning.
problem Sparse data structures for quantum physics and machine learning.
method Open-source library for tensor network algorithms.
result Demonstrates applications in physics and machine learning.
Efficient NTF algorithm for large sparse tensors.
problem Sparse multi-dimensional data and limitations of existing NTF algorithms.
method Saturating Coordinate Descent with element selection based on Lipschitz continuity.
result Proposes a scalable NTF algorithm for large tensors.
Motivated by applications in neuroimaging analysis, we propose a new regression model, Sparse TensOr REsponse regression (STORE), with a tensor response and a vector predictor. STORE embeds two key sparse structures: element-wise sparsity and low-rankness. It can handle both a non-symmetric and a symmetric tensor respo…
This work solves TRPCA under linear transforms, recovering low-rank and sparse components.
problem Exact recovery of tensor low-rank and sparse components from their sum.
method Convex optimization with weighted tensor nuclear norm and ℓ1-norm.
result The convex program exactly recovers the components under certain incoherence conditions.
DEMOTE uses neural diffusion-reaction processes to capture temporal dynamics in sparse tensor data.
problem Sparse and temporally associated tensor data with limited structural knowledge.
method Develops a neural diffusion-reaction process to estimate dynamic embeddings for tensor modes.
result Captures both commonalities and personalities in evolving tensor entries.
In this paper we study the problem of noisy tensor completion for tensors that admit a canonical polyadic or CANDECOMP/PARAFAC (CP) decomposition with one of the factors being sparse. We present general theoretical error bounds for an estimate obtained by using a complexity-regularized maximum likelihood principle and …
Improves group fairness in tensor completion by augmenting tensors with balanced entities.
problem Preventing discrimination in tensor decomposition based on social grounds.
method STAFF (Sparse Tensor Augmentation For Fairness) which augments tensors with balanced entities to mitigate imbalance and bias.
result Consistently shows the best trade-off between completion error and group fairness, reducing errors by 36% and 59% respectively.
Sparse symmetric tensor regression reduces brain connectivity complexity.
problem Complex brain connectivity analysis in neuroimaging.
method Sparse symmetric tensor regression model for functional connectivity.
result Superior performance in Alzheimer's disease detection.
ALℓ0CORE tensor decomposition reduces computational cost for sparse count data.
problem Efficiently decompose sparse count data matrices.
method Probabilistic Tucker decomposition with ℓ0-norm constraint. result ALℓ0CORE achieves similar results to full Tucker decomposition at a fraction of the cost. Paper solves TRPCA problem for tensor data with new tensor nuclear norm.
problem Exact recovery of tensor low-rank and sparse components.
method Introduces tensor-tensor product and new tensor nuclear norm to solve TRPCA.
result The new tensor nuclear norm guarantees exact recovery of tensor data.
A new method for embedding sparse high-order interactions.
problem Learning embeddings from sparse high-order interaction events.
method Hybridizing sparse hypergraph and matrix Gaussian processes.
result Strong asymptotic bounds on sparsity ratio.
New method clusters multiway data from noisy tensors.
problem Identifying multiway block structure from noisy tensors.
method Tensor block model, unified least-square estimation, sparse regularization.
result Achieves partition consistency and outperforms previous methods.
New CSC model extracts EEG signals with low noise sensitivity.
problem Analyzing noisy EEG signals during anesthesia.
method Kruskal CSC model using Kruskal decomposition for low-rank tensor activations.
result TC-FISTA efficiently extracts robust, sparse, and interpretable EEG encodings.
FasTR efficiently solves sparse and unit-rank tensor regression problems.
problem Sparse and unit-rank tensor regression problems in tensor data analysis.
method FasTR decomposes tensor coefficients into component vectors and estimates each with ℓ1 regularized regression, solving in parallel. result FasTR computes better solutions faster than baseline models.
Dictionary learning is the problem of estimating the collection of atomic elements that provide a sparse representation of measured/collected signals or data. This paper finds fundamental limits on the sample complexity of estimating dictionaries for tensor data by proving a lower bound on the minimax risk. This lower …
GrateTile optimizes CNN feature map storage for efficient data access.
problem Efficient storage and access of sparse CNN feature maps.
method Divides feature maps into uneven-sized subtensors, compresses and stores them in a compressed yet accessible format.
result Average 55% DRAM bandwidth reduction with minimal indexing overhead.
Proposes a new tensor completion method using dual framework and Riemannian optimization.
problem Low-rank tensor completion with sparse or non-sparse tensor combinations.
method Dual framework, latent trace norm, Riemannian optimization, trust region algorithm.
result Shows the optimal solution lies on a Cartesian product of Riemannian manifolds.
Efficient tensor kernel method reduces memory usage and computational cost for sparse regression.
problem Memory and computational limitations in tensor kernel methods for sparse regression.
method Proposes a new tensor data layout and Nystrom subsampling approach to reduce memory and computational requirements.
result Improvements lead to more efficient tensor kernel methods for sparse regression.
A simple self-supervised model for tensor RPCA using deep unfolding.
problem Tensor robust principal component analysis (RPCA) challenges in practical applications.
method Deep unfolding with only four hyperparameters.
result Competitive or superior performance compared to supervised methods, even in data-starved scenarios.
Sparse Tucker decomposition with graph regularization improves time series forecasting accuracy.
problem High-dimensional time series forecasting with over-parameterization issue.
method Sparse Tucker decomposition and graph regularization for tensor-based model.
result Non-asymptotic error bound and superior performance in numerical experiments.