Study tensor completion for tensors with sparse CP factors under noisy conditions.
problem Noisy tensor completion for tensors with a sparse CP factor.
method Complexity-regularized maximum likelihood principle and ADMM-type algorithm.
result General theoretical error bounds and validation via experiments.
High-dimensional tensors or multi-way data are becoming prevalent in areas such as biomedical imaging, chemometrics, networking and bibliometrics. Traditional approaches to finding lower dimensional representations of tensor data include flattening the data and applying matrix factorizations such as principal component…
New algorithm for online tensor factorization with provable guarantees.
problem Factorizing structured tensors with unknown factors and non-convex optimization.
method Online CP/PARAFAC decomposition via dictionary learning with incoherence and sparsity constraints.
result Exact recovery of tensor factors at a linear rate under mild conditions.
New result on tensor recovery without strong assumptions.
problem Recoverability of randomly compressed tensors with low CP rank.
method Deriving restricted isometry property (R.I.P.) via set covering techniques.
result The tensor is recoverable if the number of measurements is proportional to the model parameters.
NCPF model improves traffic data imputation with neural and tensor methods.
problem Pervasive missing data in traffic analysis due to sensor failures and gaps.
method Neural Canonical Polyadic Factorization (NCPF) integrating CP decomposition and deep learning.
result NCPF outperforms state-of-the-art baselines in urban traffic datasets.
A new method for predicting with confidence for complex models.
problem Lack of reliable confidence in high-stake decision-making models.
method Developed a full-CP for sparse high-order interaction model using homotopy mining.
result SHIM achieves comparable accuracy to complex models and superior statistical power.
CANDECOMP/PARAFAC (CP) tensor factorization of incomplete data is a powerful technique for tensor completion through explicitly capturing the multilinear latent factors. The existing CP algorithms require the tensor rank to be manually specified, however, the determination of tensor rank remains a challenging problem e…
Matrix factorizations and their extensions to tensor factorizations and decompositions have become prominent techniques for linear and multilinear blind source separation (BSS), especially multiway Independent Component Analysis (ICA), NonnegativeMatrix and Tensor Factorization (NMF/NTF), Smooth Component Analysis (Smo…
Study improves confidence measures in medical imaging pipelines by addressing bias.
problem Bias in metric-based imaging pipelines compromises the efficiency of prediction intervals.
method Formalized symmetric and asymmetric CP formulations, analyzed bias effects, and validated empirically.
result Symmetric intervals are inflated by bias, while asymmetric intervals remain unaffected.
CP-factorization for high-dimensional tensor time series and double projection iterations
problem Identifying and estimating factor loadings in CP decomposition for high-dimensional tensor time series
method One-pass estimation procedure using standard eigen-analysis for matrix constructed based on serial dependence
result Asymptotic properties established under general settings, adapt to sparsity, accommodates weak factors
CPOPT-Net predicts sparse client actions in banking using tensor decomposition and neural networks.
problem Predicting sparse client activities in the banking environment with evolving regulations.
method Combines CP tensor decomposition and neural networks for time series predictions.
result CPOPT-Net achieves accurate predictions of clients' financial activities.
New characterization of symplectic surfaces in CP^2 via bridge trisections.
problem Characterize symplectic surfaces in CP^2.
method Bridge trisections and quasipositive factorizations.
result Minimal genus symplectic surfaces are isotopic to surfaces in transverse bridge position.
A new tensor model merges curve registration and tensor decomposition.
problem Retrieving latent factors and diffeomorphisms from data slices.
method Introduced a registered CP tensor model with a diffeomorphism constraint.
result Simulation results show registered CP outperforms other models.
New algorithm learns interpretable CP-basis from streaming tensor data under Markovian constraints.
problem Learning interpretable CP-basis from streaming tensor data under Markovian constraints.
method Online Tensor Factorization (OTF) with CANDECOMP/PARAFAC (CP) decomposition, proving convergence to stationary points.
result Algorithm converges almost surely to stationary points of the objective function under Markovian data generation.
Interest in multioutput kernel methods is increasing, whether under the guise of multitask learning, multisensor networks or structured output data. From the Gaussian process perspective a multioutput Mercer kernel is a covariance function over correlated output functions. One way of constructing such kernels is based …
We explicitly construct genus-2 Lefschetz fibrations whose total spaces are minimal symplectic 4-manifolds homeomorphic to complex rational surfaces CP^2 # p (-CP^2) for p=7, 8, 9, and to 3 CP^2 #q (-CP^2) for q =12,...,19. Complementarily, we prove that there are no minimal genus-2 Lefschetz fibrations whose total spa…
Proposes a model to relate a tensor feature to a univariate outcome using sparse and low-rank components.
problem Relating a univariate outcome to a feature tensor with sparse and low-rank components.
method Divide-and-conquer strategy, stagewise estimation procedure for unit-rank tensor regression.
result The stagewise solution paths converge to those of regularized regression as step size goes to zero.
Robust tensor CP decomposition involves decomposing a tensor into low rank and sparse components. We propose a novel non-convex iterative algorithm with guaranteed recovery. It alternates between low-rank CP decomposition through gradient ascent (a variant of the tensor power method), and hard thresholding of the resid…
New algorithms improve tensor CP decomposition under mild conditions.
problem Improving tensor CP decomposition with theoretical guarantees under mild incoherence conditions.
method Composite PCA and Concurrent Orthogonalization algorithms.
result Theoretical guarantees and practical superiority over existing methods.
We refine toxicity bounds for dynamic liquidation incentives in CP-AMM systems.
problem Ensuring stability in dynamic liquidation incentives in automated market makers.
method Derived state-dependent toxicity bounds for dynamic liquidation incentives, reconciling them with CP-AMM price dynamics.
result State-dependent bounds and liquidity-depth-only condition for dynamic liquidation incentives.
SimplE enhances tensor factorization for better link prediction in knowledge graphs.
problem Link prediction in knowledge graphs to discover new relationships.
method Proposes SimplE, a simple enhancement of CP decomposition to learn entity embeddings dependently.
result SimplE outperforms state-of-the-art tensor factorization techniques in link prediction.
Bayesian hierarchical tensor factorization model for international trade flows
problem Sparse semi-continuous tensor data modeling
method Bayesian hierarchical tensor factorization with Poisson and Gamma models
result Identifies multiway dependence in trade flows
New exotic 4-manifolds with zero signature found.
problem Finding exotic 4-manifolds with specific properties.
method Special small Lefschetz fibrations built via positive factorizations in the mapping class group.
result Smallest known exotic closed simply connected 4-manifolds with signature zero.
New method for hyperparameter tuning in sparse matrix factorization.
problem Hyperparameter tuning in sparse matrix factorization.
method Numerical method based on evaluating the zero point of normalization factor in sparse matrix prior.
result Our method outperforms existing algorithms in ground-truth sparse matrix reconstruction.
Sparse APCA identifies sparse factors in financial returns over time.
problem Analyzing co-movements of high-dimensional panel data over time.
method Sparse asymptotic PCA with truncated power method for sparse factors and sequential deflation for multi-factor cases.
result Identification of nine risk factors influencing the S&P 500 stock market.
Proposes FARM model combining latent factor and sparse regression.
problem Testing adequacy of latent factor and sparse regression models.
method Factor Augmented sparse linear Regression Model (FARM) with FabTest and ANOVA type tests.
result Model robustness and effectiveness validated through experiments.
Efficient tensor decomposition for count data models achieves near-optimal multiway analysis.
problem Efficient tensor decomposition for count data models.
method Rank-constrained maximum-likelihood estimator for tensor decomposition.
result Achieves multiway analysis with variance matching Cramér-Rao Lower Bound up to constants and logarithmic factors.
Sparse symmetric tensor regression reduces brain connectivity complexity.
problem Complex brain connectivity analysis in neuroimaging.
method Sparse symmetric tensor regression model for functional connectivity.
result Superior performance in Alzheimer's disease detection.
SupCP factorizes multiway data with covariates for biomedical research.
problem Handling multiway data with covariates in biomedical research.
method Probabilistic PARAFAC/CANDECOMP factorization with latent variables informed by covariates.
result SupCP improves accuracy and interpretability of latent structures.
Global optimization algorithm finds sparse mixed membership matrix factorization's global optimum.
problem Sparse mixed membership matrix factorization problems with local optima.
method Derives a global optimization algorithm for sparse mixed membership matrix factorization.
result Guaranteed ε-global optimum across random initializations and multiple modes. New method improves dynamic topic modeling for large-scale data.
problem Lack of temporal information in dynamic topic modeling.
method Nonnegative CP tensor decomposition (NNCPD) for data tensor.
result Significantly improved results compared to NMF-based methods.
We classify genus 2 Lefschetz fibrations on certain 4-manifolds.
problem Classify genus 2 Lefschetz fibrations on specific 4-manifolds.
method Positive factorization of type (10,10) and observations of restrictions.
result Positive factorizations describe genus 2 Lefschetz fibrations on various 4-manifolds.
Bayesian GNNs with temperature improve prediction efficiency in CP.
problem Efficiency of prediction sets in CP for GNNs.
method Introducing a temperature parameter into Bayesian GNNs within the CP framework.
result More efficient prediction sets achieved with the temperature parameter.
SCTD extracts interpretable spatio-temporal modes from high-dimensional data.
problem Analyzing complex, multivariate data with temporal dependencies.
method Shape Constrained Tensor Decomposition using sparse representations.
result More interpretable spatio-temporal modes extracted.
We classify SIC-POVMs of rank one in CP^2, or equivalently sets of nine equally-spaced points in CP^2, without the assumption of group covariance. If two points are fixed, the remaining seven must lie on a pinched torus that a standard moment mapping projects to a circle in R^3. We use this approach to prove that any S…
Deep weight factorization improves neural network training through smooth optimization of sparse penalties.
problem Challenges in applying sparse regularization in neural networks due to non-differentiability of penalties.
method Introduces deep weight factorization, decomposing weights into multiple factors for smooth optimization of L1-penalized networks. result Deep weight factorization outperforms shallow factorization and pruning methods consistently across various architectures and datasets.
We prove that a certain class of ALE spaces always has a Kahler conformal compactification, and moreover provide explicit formulas for the conformal factor and the Kahler potential of said compactification. We then apply this to give a new and simple construction of the canonical Bochner-Kähler metric on certain weight…
Sparse VAE learns latent factors from high-dimensional data.
problem Unsupervised representation learning on high-dimensional data.
method Sparse VAE model that learns latent factors summarizing data associations.
result Sparse VAE can recover true model parameters with infinite data.
Bayesian model infers factor dimensionality and sparse loading matrix adaptively.
problem Inference of high-dimensional sparse factor model with varying sparsity and factor dimensions.
method Adaptive Bayesian sparse factor model with posterior concentration.
result Posterior distribution asymptotically concentrates on true factor dimensionality and sparsity.
Sparse GFA identifies disease factors in FTD subgroups.
problem Heterogeneity in neurological disorders hinders understanding and treatment.
method Sparse Group Factor Analysis (GFA) with regularised horseshoe priors.
result Identified latent disease factors differentially expressed in FTD subgroups.
We investigate the problem of factorizing a matrix into several sparse matrices and propose an algorithm for this under randomness and sparsity assumptions. This problem can be viewed as a simplification of the deep learning problem where finding a factorization corresponds to finding edges in different layers and valu…
Tensor factorization arises in many machine learning applications, such knowledge base modeling and parameter estimation in latent variable models. However, numerical methods for tensor factorization have not reached the level of maturity of matrix factorization methods. In this paper, we propose a new method for CP te…
A new method uses CPD to efficiently model feature interactions in non-sequential data.
problem Efficiently modeling feature interactions in non-sequential data with high computational and memory costs.
method Implicitly represent model parameters as a tensor, factorize into a compact Tensor Train (TT) format, and use Canonical Polyadic (CP) Decomposition for invariance to feature ordering.
result The proposed CP-based predictor outperforms other TN-based predictors on sparse data and matches neural network performance on dense non-sequential tasks.
A new NMF variant tackles underdetermined problems with sparse and separable assumptions.
problem Underdetermined blind source separation, especially multispectral image unmixing.
method Sparse Separable Nonnegative Matrix Factorization (SSNMF) combining separability and sparsity assumptions. Algorithm based on SNPA and sparse nonnegative least squares.
result In noiseless settings, the algorithm recovers true underlying sources.
EFS uses LLMs to optimize sparse portfolios by evolving alpha factors.
problem Sparse portfolio optimization in dynamic market regimes.
method Evolutionary feedback loop with LLM-generated alpha factors.
result Significantly outperforms baselines in diverse datasets.
A new method for analyzing multi-source, multi-way data reduces dimensionality and reveals shared and individual structures.
problem Analyzing multi-source, multi-way data from different high-throughput technologies.
method Multiple Linked Tensor Factorization (MULTIFAC) extending CP decomposition with L2 penalties and EM algorithm for incomplete data.
result MULTIFAC approximates underlying signal, identifies shared and unshared structures, and imputes missing data.
New nonconvex regularizers improve low-rank matrix recovery efficiency and accuracy.
problem Efficiently recover low-rank matrices from incomplete data.
method Factor group-sparse regularization, related to Schatten-p norms.
result Improved generalization error bounds for Schatten-p norms as p decreases.
We present an algorithm, AROFAC2, which detects the (CP-)rank of a degree 3 tensor and calculates its factorization into rank-one components. We provide generative conditions for the algorithm to work and demonstrate on both synthetic and real world data that AROFAC2 is a potentially outperforming alternative to the go…