Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,657 papers · 148 categories

Trend · papers per month

2685358031,070 · Jun 202019922001200920172026
48 results for Deep Factorization Machines

Proposes FEFM and DeepFEFM for CTR prediction, outperforming state-of-the-art models.

problem Click-through rate prediction in online applications.
method Field-Embedded Factorization Machine (FEFM) and its deep counterpart DeepFEFM, combining feature embeddings and deep neural networks.
result FEFM and DeepFEFM outperform existing models in CTR prediction tasks.

NeuralFactors uses deep learning to improve factor analysis in equity modeling.

problem Enhancing classical factor models for better risk forecasting and portfolio construction.
method Introduces a novel machine-learning approach (NeuralFactors) that outputs factor exposures and returns, trained using variational autoencoders.
result NeuralFactors outperforms prior approaches in log-likelihood performance and computational efficiency.

This paper introduces our solution to the 2018 Duolingo Shared Task on Second Language Acquisition Modeling (SLAM). We used deep factorization machines, a wide and deep learning model of pairwise relationships between users, items, skills, and other entities considered. Our solution (AUC 0.815) hopefully managed to bea…

2018-05-01abs ↗pdf ↗

Latent factor models have been used widely in collaborative filtering based recommender systems. In recent years, deep learning has been successful in solving a wide variety of machine learning problems. Motivated by the success of deep learning, we propose a deeper version of latent factor model. Experiments on benchm…

2019-12-10abs ↗pdf ↗

Study proposes a new method for deep portfolio optimization using residual factors.

problem Non-stationary financial market makes traditional machine learning methods ineffective.
method Predict distribution of residual factors using a novel neural network architecture with financial inductive biases.
result Demonstrated improved performance on U.S. and Japanese stock market data.

Deep weight factorization improves neural network training through smooth optimization of sparse penalties.

problem Challenges in applying sparse regularization in neural networks due to non-differentiability of penalties.
method Introduces deep weight factorization, decomposing weights into multiple factors for smooth optimization of L1L_1-penalized networks.
result Deep weight factorization outperforms shallow factorization and pruning methods consistently across various architectures and datasets.

We propose to represent a return model and risk model in a unified manner with deep learning, which is a representative model that can express a nonlinear relationship. Although deep learning performs quite well, it has significant disadvantages such as a lack of transparency and limitations to the interpretability of …

2018-10-01abs ↗pdf ↗

An efficient way to learn deep density models that have many layers of latent variables is to learn one layer at a time using a model that has only one layer of latent variables. After learning each layer, samples from the posterior distributions for that layer are used as training data for learning the next layer. Thi…

2012-06-18abs ↗pdf ↗

Matrix completion is one of the key problems in signal processing and machine learning. In recent years, deep-learning-based models have achieved state-of-the-art results in matrix completion. Nevertheless, they suffer from two drawbacks: (i) they can not be extended easily to rows or columns unseen during training; an…

2018-12-04abs ↗pdf ↗

The paper explores indeterminacy in latent factor projections and its implications for data representation.

problem Indeterminacy in latent factor projections and its implications for data representation.
method Analyzes the fundamental problem of indeterminacy in latent factor projections and discusses its implications for data representation.
result Latent factor determinacy across all facets is achieved when the feature-dimension grows to infinity.

The study compares different models for predicting factor premiums and finds neural networks perform better but have unstable weights.

problem Predicting and timing the CMA factor premium using machine learning models.
method Compared regression models (OLS, Ridge, Random Forest, Neural Network) and tested factor timing strategies.
result Neural networks outperform linear models in explaining factor premium variance, but weights are unstable.

This paper investigates the impact of normalization on deep neural networks for click-through rate prediction.

problem The effect of normalization on deep neural network models for CTR estimation.
method Systematic study of various normalization approaches applied to feature embedding and MLP part of DNN models.
result Correct normalization significantly enhances model performance, as demonstrated by extensive experiments on real-world datasets.

RVRAE combines deep learning and dynamic factor models for better stock returns prediction.

problem Improving stock returns prediction in volatile markets.
method Combines dynamic factor modeling with variational recurrent autoencoder (VRAE). Uses prior-posterior learning for optimal factor model.
result RVRAE outperforms traditional methods in predicting stock returns and estimating variances.

DeCom predicts post-COVID RSV timing and intensity with NPI consideration.

problem Predicting RSV timing and intensity post-COVID with NPI impact.
method Deep coupled tensor factorization machine (DeCom) leveraging tensor factorization and residual modeling.
result DeCom achieves up to 46% lower RMSE and 49% lower MAE compared to baselines.

Survey on concept factorization methods for better feature learning.

problem Understanding the quality of learned features in representation learning.
method Categorizing and summarizing recent advances in concept factorization methods.
result Provides insights into theoretical basis and current developments in concept factorization.

This research predicts cryptocurrency price volatility using deep learning models.

problem Predicting the volatility of cryptocurrency prices to mitigate investment risk.
method Used CNN, LSTM, BiLSTM, and GRU models to predict the risk factor of 20 cryptocurrency parameters.
result Developed a new model with RMSE of 0.0089, significantly outperforming existing models.

Develops a deep multi-factor model for factor investing with clear financial insights.

problem Lack of interpretability and unclear financial insights in non-linear factor models.
method Industry and market neutralization modules, graph attention modules, factor-attention module.
result Demonstrates effectiveness in factor investing with real-world stock market data.

Deep tensor factorization benefits from implicit regularization with polynomial growth.

problem Tensor factorization's implicit regularization effect in deep networks is not well understood.
method Investigated the implicit regularization in deep tensor factorization, showing polynomial growth.
result Implicit regularization in deep tensor factorization grows polynomially with depth, improving estimation accuracy and convergence.

Neural networks outperform single-hour models in day-ahead electricity price forecasting.

problem Improving accuracy in day-ahead electricity price forecasting.
method Compared two neural network structures: one-hour models and daily auction models.
result Daily auction models outperform one-hour models in forecasting accuracy.

DPLS improves asset pricing by capturing non-linear risk factor structures.

problem Estimating asset pricing models with non-linear risk factor structures.
method Deep Partial Least Squares (DPLS) for dynamic and flexible factor modeling.
result DPLS models outperform linear models in asset pricing, capturing non-linear risk factor interactions.

Machine learning factors outperform traditional portfolio optimization methods.

problem Comparing machine learning and traditional portfolio optimization methods.
method Examined machine learning and factor-based portfolio optimization using autoencoder neural networks and dimensionality reduction techniques.
result Minimum-variance portfolios using latent factors derived from autoencoders and sparse methods outperform simpler benchmarks in risk minimization.

The paper studies the loss landscape of regularized deep matrix factorization, revealing unique and sharp minimizers.

problem Understanding the loss landscape and minimizers of regularized deep matrix factorization problems.
method Theoretical analysis of 2\ell^2-regularized deep matrix factorization/deep linear network training problems with squared-error loss.
result The unique end-to-end minimizer exists for all target matrices except for a set of Lebesgue measure zero.

DF2M uses deep neural networks within a factor model for high-dimensional functional time series forecasting.

problem Forecasting high-dimensional functional time series with explainability and accuracy.
method Bayesian nonparametric model based on Indian Buffet Process and multi-task Gaussian Process, incorporating a deep kernel function.
result DF2M provides better explainability and superior predictive accuracy compared to conventional deep learning models.

Scaling ResNets requires careful consideration of the layer depth and output scaling factors.

problem Avoiding vanishing or exploding gradients in deep ResNets as depth increases.
method Probabilistic analysis and continuous-time limit interpretation of ResNets.
result The optimal scaling factor is αL=1Lα_L = \frac{1}{\sqrt{L}} for standard i.i.d. initializations.

Efficiently compress overparameterized deep models by focusing on low-dimensional learning dynamics.

problem Overparameterized models increase computational and memory costs.
method Study of learning dynamics reveals updates occur within a low-dimensional subspace, leading to a compression algorithm.
result Compressed deep linear networks converge faster and yield smaller recovery errors.

Proposes an end-to-end deep learning framework for active investing.

problem Constructing an active investment portfolio via deep learning.
method End-to-end deep learning framework covering factor selection, combination, stock selection, and portfolio construction.
result Demonstrates effectiveness of E2E deep learning framework in active investing.

DS2CF-Net learns hierarchical representations with deep coupled factorization and enriched prior.

problem Learning deep hierarchical representations from data.
method Dual-constrained Deep Semi-Supervised Coupled Factorization Network (DS2CF-Net) with enriched prior.
result DS2CF-Net achieves state-of-the-art performance in representation learning and clustering.

Efficiently learns deep factor graphs using Gaussian belief propagation.

problem Learning in deep factor graphs with efficient inference.
method Treats all relevant quantities as random variables, uses belief propagation for inference.
result Efficiently solves training and prediction problems in deep factor graphs with belief propagation.