Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,695 papers · 148 categories

Trend · papers per month

3671107142 · Jun 202019922001200920172026
48 results for tensor-based embedding

A substantial progress in development of new and efficient tensor factorization techniques has led to an extensive research of their applicability in recommender systems field. Tensor-based recommender models push the boundaries of traditional collaborative filtering techniques by taking into account a multifaceted nat…

2016-03-19abs ↗pdf ↗

NeSGD efficiently updates tensor-based features for online model learning in multi-way data.

problem Incremental updates of tensor-based features and model coefficients for evolving data distributions.
method Online NeSGD for CP decomposition of tensor data.
result Proposed NeSGD method significantly improves classification accuracy and adapts to changing data distributions.

Most popular word embedding techniques involve implicit or explicit factorization of a word co-occurrence based matrix into low rank factors. In this paper, we aim to generalize this trend by using numerical methods to factor higher-order word co-occurrence based arrays, or \textit{tensors}. We present four word embedd…

2017-04-10abs ↗pdf ↗

This work introduces a tensor-based method to perform supervised classification on spatiotemporal data processed in an echo state network. Typically when performing supervised classification tasks on data processed in an echo state network, the entire collection of hidden layer node states from the training dataset is …

2017-08-23abs ↗pdf ↗

The interest in machine learning with tensor networks has been growing rapidly in recent years. We show that tensor-based methods developed for learning the governing equations of dynamical systems from data can, in the same way, be used for supervised learning problems and propose two novel approaches for image classi…

2019-10-04abs ↗pdf ↗

The data in many disciplines such as social networks, web analysis, etc. is link-based, and the link structure can be exploited for many different data mining tasks. In this paper, we consider the problem of temporal link prediction: Given link data for times 1 through T, can we predict the links at time T+1? If our da…

2010-05-21abs ↗pdf ↗

Paper introduces an unsupervised tensor-based anomaly detection method for spatiotemporal data.

problem Challenges in detecting anomalies in spatiotemporal data, especially in urban traffic monitoring and medical imaging.
method Formulates anomaly detection as a regularized robust low-rank + sparse tensor decomposition, incorporating spatiotemporal smoothness and local dependencies.
result Demonstrates improved anomaly detection performance on both synthetic and real data.

Paper proposes tensor-based method for semiconductor manufacturing process control.

problem Challenges of traditional process control methods in high-dimensional image-based overlay errors.
method Builds a high-dimensional process model, proposes tensor-on-vector regression algorithms, designs EWMA controller for tensor data.
result The method reduces overlay errors using limited control recipes and is superior especially when disturbances are not stable.

In this paper we propose a tensor-based nonlinear model for high-order data classification. The advantages of the proposed scheme are that (i) it significantly reduces the number of weight parameters, and hence of required training samples, and (ii) it retains the spatial structure of the input samples. The proposed mo…

2018-02-15abs ↗pdf ↗

In many real-world applications, data are often unlabeled and comprised of different representations/views which often provide information complementary to each other. Although several multi-view clustering methods have been proposed, most of them routinely assume one weight for one view of features, and thus inter-vie…

2018-10-18abs ↗pdf ↗

Existing imitation learning approaches often require that the complete demonstration data, including sequences of actions and states, are available. In this paper, we consider a more realistic and difficult scenario where a reinforcement learning agent only has access to the state sequences of an expert, while the expe…

2019-03-11abs ↗pdf ↗

Tensor neural network improves human pose classification from 3D skeleton data.

problem Efficiently processing spatiotemporal data for human pose classification.
method Proposes a tensor-based neural network with three components: spatiotemporal feature construction, tensor fusion, and tensor-based neural network processing.
result Achieves state-of-the-art performance in human pose classification.

A new tensor-based layer reduces neural network dimensions without losing important features.

problem Reducing dimensionality in tensor-structured feature data for deep neural networks.
method TensorProjection layer that projects input tensors into output tensors with reduced dimensions through mode-wise projections.
result The TensorProjection layer outperforms traditional downsampling methods in tasks like medical image classification and segmentation.

Study quantifies performance gap between tensor and matrix-based approaches in nested matrix-tensor model.

problem Estimating a planted signal in a nested matrix-tensor model.
method Comparing tensor-based and matrix-based approaches for best rank-one approximation of tensor data.
result Derives precise algorithmic threshold for the unfolding approach and shows BBP-type transition behavior.

Paper compares expressive power of GNNs, proving approximation guarantees for practical architectures.

problem Understanding the expressive power of Graph Neural Networks (GNNs).
method Theoretical framework comparing invariant and equivariant GNNs, proving approximation guarantees for practical architectures.
result Folklore Graph Neural Networks (FGNN) are the most expressive architectures for a given tensor order.

The paper introduces a tensor-based approach to improve neural models' aggregation of structural context.

problem Sub-optimal use of simple aggregation functions in neural models for structured data.
method Tensor-based formulation and Tucker tensor decomposition to control parameter space size.
result Effective regulation of trade-off between expressivity, computational complexity, and generalisation.

E2^2M optimizes tensor density estimation by relaxing αα-divergence to KL-divergence.

problem Analytical challenges in traditional αα-divergence optimization for tensor-based density estimation.
method E2^2M algorithm: relaxes optimization to KL-divergence, then applies tensor many-body approximation.
result Flexible modeling of various low-rank structures and their mixtures.

Sparse Tucker decomposition with graph regularization improves time series forecasting accuracy.

problem High-dimensional time series forecasting with over-parameterization issue.
method Sparse Tucker decomposition and graph regularization for tensor-based model.
result Non-asymptotic error bound and superior performance in numerical experiments.

The tensor-tensor product (t-product) [M. E. Kilmer and C. D. Martin, 2011] is a natural generalization of matrix multiplication. Based on t-product, many operations on matrix can be extended to tensor cases, including tensor SVD, tensor spectral norm, tensor nuclear norm [C. Lu, et al., 2018] and many others. The line…

2018-06-17abs ↗pdf ↗

Paper optimizes clustering for multi-layer networks and discrete mixtures.

problem Optimizing clustering in multi-layer networks and discrete mixtures.
method Two-stage method: tensor-based initialization and likelihood-based refinement.
result Achieves minimax optimal error rate for multi-layer networks and discrete mixtures.

Graph representations have increasingly grown in popularity during the last years. Existing representation learning approaches explicitly encode network structure. Despite their good performance in downstream processes (e.g., node classification, link prediction), there is still room for improvement in different aspect…

2018-05-03abs ↗pdf ↗

HiJoD detects misinformation using multiple aspects and outperforms state-of-the-art methods.

problem Detecting misinformation with limited labeled data.
method Hierarchical Joint Decomposition framework combining content, context, and domain features.
result HiJoD achieves F1-scores of 74% and 81% on Twitter and Politifact datasets respectively, and is faster than similar approaches.

Machine learning models accurately predict molecular magnetic anisotropy tensors.

problem Accurately modeling molecular magnetic anisotropy tensors.
method Gaussian-moment neural-network approach for machine learning.
result Achieved accuracy of 0.3--0.4 cm1^{-1} for magnetic anisotropy tensor predictions.

In this work, we consider Corporate Governance (CG) ties among companies from a multiple network perspective. Such a structure naturally arises from the close interrelation between the Shareholding Network (SH) and the Board of Directors network (BD). In order to capture the simultaneous effects of both networks on CG,…

2014-01-17abs ↗pdf ↗

Paper proposes a new tensor imputation method for spatiotemporal traffic data with missing patterns.

problem Imputation of corrupted or incomplete traffic data.
method Truncated tensor Schatten p-norm (TSpN) for spatiotemporal traffic data imputation.
result The proposed method outperforms other state-of-the-art tensor-based imputation models in various missing cases.

Latent variable models with hidden binary units appear in various applications. Learning such models, in particular in the presence of noise, is a challenging computational problem. In this paper we propose a novel spectral approach to this problem, based on the eigenvectors of both the second order moment matrix and t…

2018-02-27abs ↗pdf ↗

TRNN combines tensor geometry with neural network nonlinearity for HD data.

problem Modeling high-dimensional data with preserved tensor geometry and nonlinear interactions.
method Introduces TRNN that integrates tensor geometry and neural network nonlinearity.
result TRNN preserves tensor geometry while offering nonlinearity.