Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

169,051 papers · 148 categories

Trend · papers per month

6.3%12.5%18.8%25.0% · Oct 199319922001200920182026
48 results for Hidden Factors

FactorGCL uses hypergraph learning to predict stock returns by mining hidden factors.

problem Mining effective factors in data-driven models is challenging due to low signal-to-noise ratio in market data.
method FactorGCL employs a hypergraph structure and temporal residual contrastive learning to extract hidden factors.
result FactorGCL outperforms existing methods and mines effective hidden factors for predicting stock returns.

This paper addresses the issue of model selection for hidden Markov models (HMMs). We generalize factorized asymptotic Bayesian inference (FAB), which has been recently developed for model selection on independent hidden variables (i.e., mixture models), for time-dependent hidden variables. As with FAB in mixture model…

2012-06-18abs ↗pdf ↗

DISTANA improves weather prediction by inferring hidden factors from temperature data.

problem Inferring hidden factors in spatiotemporal processes without supervision.
method Enhanced DISTANA architecture for spatiotemporal data, active tuning for latent state inference.
result DISTANA achieves more accurate predictions than other methods, inferring hidden factors from temperature data.

To infer a multilayer representation of high-dimensional count vectors, we propose the Poisson gamma belief network (PGBN) that factorizes each of its layers into the product of a connection weight matrix and the nonnegative real hidden units of the next layer. The PGBN's hidden layers are jointly trained with an upwar…

2015-11-06abs ↗pdf ↗

To infer multilayer deep representations of high-dimensional discrete and nonnegative real vectors, we propose an augmentable gamma belief network (GBN) that factorizes each of its hidden layers into the product of a sparse connection weight matrix and the nonnegative real hidden units of the next layer. The GBN's hidd…

2015-12-09abs ↗pdf ↗

We investigate the problem of factorizing a matrix into several sparse matrices and propose an algorithm for this under randomness and sparsity assumptions. This problem can be viewed as a simplification of the deep learning problem where finding a factorization corresponds to finding edges in different layers and valu…

2013-11-13abs ↗pdf ↗

Estimates crypto risk premia using hidden factors and finds significant integration with traditional markets.

problem Estimating risk premia in cryptocurrency returns.
method Giglio-Xiu (2021) three-pass approach, controlling for latent factors and non-tradable state variables.
result Latent factors significantly impact crypto returns, highlighting the importance of controlling for unobserved risks.

Proposes MV-Co-VH for multi-view clustering using visible and hidden views.

problem Lack of efficient algorithms for fully utilizing multi-view data.
method Projects multiple views to a common hidden space using NMF, then applies collaborative learning.
result Competitive clustering performance on UCI and real-world datasets.

The paper uses PCA and HMM to forecast stock returns outperforming buy-and-hold.

problem Predicting stock returns accurately.
method Applied PCA to covariance matrix of S&P 500 stocks, used HMM on principal components, and forecasted stock returns.
result The model outperforms buy-and-hold strategy in terms of annualized Sharpe ratio.

Tensor-networks enhance probabilistic modeling in physics and machine learning.

problem Understanding the expressive power of different tensor-network factorizations.
method Rigorous analysis of various tensor-network factorizations of discrete multivariate probability distributions.
result There are unbounded separations between the resource requirements of some tensor-network factorizations.

DeepUnHide uses deep learning to reveal hidden demographic features in recommender systems.

problem Extracting hidden demographic features from recommender systems factors.
method Gradient-based localization in deep learning for feature extraction.
result DeepUnHide outperforms state-of-the-art feature selection methods.

Hidden Markov Models analyze mobile health data to identify APNS states.

problem Subjective self-report measures of APNS lead to errors and biases.
method Exploratory hidden Markov factor models and Stabilized Expectation-Maximization algorithm.
result Identified homogeneous APNS states and dynamic transitions.

New method estimates treatment effects in time series data with hidden confounders.

problem Estimating treatment effects from longitudinal observational data with hidden confounders.
method Time Series Deconfounder using recurrent neural networks and factor models.
result Effective in deconfounding treatment responses over time in both simulated and real data.

Tensor factorization uncovers hidden patterns in student behavior data.

problem Discovering low-dimensional structure in high-dimensional behavioral data.
method Non-negative tensor factorization applied to wearable sensor data.
result Tensor factorization reveals clusters of students with different behaviors.

A neural network method determines the latent dimensionality of NMF.

problem Determining the correct number of hidden features (latent dimensionality) in NMF.
method Combining NMFk with an MLP classifier trained on a dataset of matrices with known latent features.
result The MLP classifier in conjunction with NMFk achieves a greater than 95% success rate in determining the correct number of latent features.

Debias recommender systems by accounting for hidden confounders using network information.

problem Debiased recommender systems to reduce bias caused by hidden confounders.
method Leverage network information to disentangle user conformity and item popularity, modeling exposure and ratings while controlling hidden confounders.
result The proposed method effectively debiases recommender systems, improving recommendation accuracy.

Study uses MLP models to predict large-cap US stocks, finding 2-3 hidden layers more flexible.

problem Predicting asset prices for large-cap US stocks.
method Applied MLP models with dynamic structure to factor models, focusing on firm characteristics.
result MLP models with 2-3 hidden layers more flexible in modeling factors, better for downside risk control.

We solve a high-dimensional model where nonlinear autoencoders detect hidden structure missed by PCA.

problem Hidden structure in high-dimensional data not detected by PCA.
method Tractable spiked model with two latent factors, one visible and one uncorrelated.
result Nonlinear autoencoders can extract hidden structure missed by PCA, even if reconstruction loss is higher.

A new VAR model with low-rank constraint for high-dimensional correlated series.

problem Predicting high-dimensional correlated series with hidden factors.
method Vector auto-regressive (VAR) model with low-rank transition matrix.
result Our method shows excellent performances on various simulated datasets and competitive/predictive in real macro-economic data.

New algorithms for high-dimensional HMMs reduce complexity by discarding non-local factors.

problem High-dimensional HMMs are computationally expensive to filter and smooth.
method Approximate filtering and smoothing via locality in factor graphs, avoiding exponential cost.
result Error bounds in local total variation norm are dimension-free, improving scalability.

DSCF-Net learns deep features for clustering with robustness and locality preservation.

problem Unsupervised deep representation learning for clustering.
method Integrates robust deep concept factorization, deep self-expressive representation, and adaptive locality preserving feature learning.
result Delivers state-of-the-art performance on public databases.

We are often interested in explaining data through a set of hidden factors or features. When the number of hidden features is unknown, the Indian Buffet Process (IBP) is a nonparametric latent feature model that does not bound the number of active features in dataset. However, the IBP assumes that all latent features a…

2012-05-09abs ↗pdf ↗

C2^2VAE learns disentangled and coupled representations without prior knowledge.

problem Learning disentangled and coupled representations in latent space.
method Introduces C2^2VAE, a self-supervised VAE that factorizes posterior and uses Gaussian copula for dependencies.
result Demonstrates strong effect in enhancing disentangled representation learning.

A new method detects hidden driving forces in systems with multiple observables.

problem Hidden driving forces in systems with multiple observables cannot be detected by scalar statistics.
method Cross-spectral witness for hidden nonequilibrium.
result Two simultaneously observed channels retain an off-diagonal cross-spectral sector inaccessible to scalar reductions.

Individual risk models need to capture possible correlations as failing to do so typically results in an underestimation of extreme quantiles of the aggregate loss. Such dependence modelling is particularly important for managing credit risk, for instance, where joint defaults are a major cause of concern. Often, the d…

2014-12-10abs ↗pdf ↗

Deep neural networks can handle high dimensions without losing accuracy.

problem The curse of dimensionality in nonparametric regression.
method Least squares estimates on fully connected neural networks with ReLU activation functions.
result Similar convergence results to deep learning models with sparsity constraints can be achieved without such constraints.

GLFA improves latent factor analysis by incorporating graph structures for HiDS matrices.

problem Accurate representation learning on high-dimensional and sparse matrices.
method GLFA incorporates a graph to identify hidden high-order interactions and uses a recurrent LFA structure to improve representation learning.
result GLFA outperforms state-of-the-art models in predicting missing data of HiDS matrices.

In many applications of finance, biology and sociology, complex systems involve entities interacting with each other. These processes have the peculiarity of evolving over time and of comprising latent factors, which influence the system without being explicitly measured. In this work we present latent variable time-va…

2018-02-12abs ↗pdf ↗