arXiv research

Deep model learns complex latent codes without assuming factor structure.

This paper uses Factored Latent Analysis (FLA) to learn a factorized, segmental representation for observations of tracked objects over time. Factored Latent Analysis is latent class analysis in which the observation space is subdivided and each aspect of the original space is represented by a separate latent class mod…

Sparse GFA identifies disease factors in FTD subgroups.

Method for factor analysis in short panels without assuming sphericity or Gaussianity.

An ADRC-incorporated SGD algorithm improves latent factor analysis speed and accuracy.

NCFA uses deep learning and causal discovery to analyze complex data.

Proposes D-CDLF for multi-view data decomposition.

Survey of factor analysis, PCA, variational inference, and VAE.

DMSTF models spatio-temporal data with deep Markov priors.

Method evaluates disentanglement in DLVMs, including those not aligned with latent axes.

Dimensionality reduction techniques play an essential role in data analytics, signal processing and machine learning. Dimensionality reduction is usually performed in a preprocessing stage that is separate from subsequent data analysis, such as clustering or classification. Finding reduced-dimension representations tha…

A gamma process dynamic Poisson factor analysis model is proposed to factorize a dynamic count matrix, whose columns are sequentially observed count vectors. The model builds a novel Markov chain that sends the latent gamma random variables at time $(t-1)$ as the shape parameters of those at time $t$, which are linked …

GLFA improves latent factor analysis by incorporating graph structures for HiDS matrices.

Study nonparametric factor analysis with arbitrary noise.

Factor analysis aims to determine latent factors, or traits, which summarize a given data set. Inter-battery factor analysis extends this notion to multiple views of the data. In this paper we show how a nonlinear, nonparametric version of these models can be recovered through the Gaussian process latent variable model…

We propose a combined model, which integrates the latent factor model and the logistic regression model, for the citation network. It is noticed that neither a latent factor model nor a logistic regression model alone is sufficient to capture the structure of the data. The proposed model has a latent (i.e., factor anal…

New method explains high-dimensional sphere data with latent factors.

Neuroscience is experiencing a data revolution in which many hundreds or thousands of neurons are recorded simultaneously. Currently, there is little consensus on how such data should be analyzed. Here we introduce LFADS (Latent Factor Analysis via Dynamical Systems), a method to infer latent dynamics from simultaneous…

Non-negative tensor factorization models enable predictive analysis on count data. Among them, Bayesian Poisson-Gamma models can derive full posterior distributions of latent factors and are less sensitive to sparse count data. However, current inference methods for these Bayesian models adopt restricted update rules f…

Method learns shared and specific factors in multi-study gene expression data.

New principle for disentangling latent factors using sparse regularization.

Proposes a flexible feature allocation model for sparse factor analysis.

We present a semi-supervised learning algorithm for learning discrete factor analysis models with arbitrary structure on the latent variables. Our algorithm assumes that every latent variable has an "anchor", an observed variable with only that latent variable as its parent. Given such anchors, we show that it is possi…

Latent variable models can be used to probabilistically "fill-in" missing data entries. The variational autoencoder architecture (Kingma and Welling, 2014; Rezende et al., 2014) includes a "recognition" or "encoder" network that infers the latent variables given the data variables. However, it is not clear how to handl…

This study analyzes prediction risk for PCR method in latent factor regression models.

In this paper we address the problem of modeling relational data, which appear in many applications such as social network analysis, recommender systems and bioinformatics. Previous studies either consider latent feature based models but disregarding local structure in the network, or focus exclusively on capturing loc…

We propose a family of novel hierarchical Bayesian deep auto-encoder models capable of identifying disentangled factors of variability in data. While many recent attempts at factor disentanglement have focused on sophisticated learning objectives within the VAE framework, their choice of a standard normal as the latent…

FSGD uses latent factors to scale SGD for high-dimensional learning.

MRTL learns interpretable spatial patterns efficiently.

Latent factor models are the canonical statistical tool for exploratory analyses of low-dimensional linear structure for an observation matrix with p features across n samples. We develop a structured Bayesian group factor analysis model that extends the factor model to multiple coupled observation matrices; in the cas…

Enhances interpretability of linear latent spaces through automated clustering and ranking.

A representative model in integrative analysis of two high-dimensional correlated datasets is to decompose each data matrix into a low-rank common matrix generated by latent factors shared across datasets, a low-rank distinctive matrix corresponding to each dataset, and an additive noise matrix. Existing decomposition …

Extract common latent factors from graphs for better representation learning.

DGA and DVGA learn disentangled graph representations to improve graph analysis.

Enhances time-series regression trees with latent factors for robust financial analysis.

The paper reviews identifiability in linear and nonlinear models, from Gaussian to non-Gaussian.

New model extracts shared brain activity patterns from fMRI data.

The paper develops a new model for high-dimensional spatial arbitrage pricing.

New algorithm speeds up fitting GLLVMs to large datasets.

This paper proposes an alternating back-propagation algorithm for learning the generator network model. The model is a non-linear generalization of factor analysis. In this model, the mapping from the continuous latent factors to the observed signal is parametrized by a convolutional neural network. The alternating bac…

Modern biomedical studies often collect multi-view data, that is, multiple types of data measured on the same set of objects. A popular model in high-dimensional multi-view data analysis is to decompose each view's data matrix into a low-rank common-source matrix generated by latent factors common across all data views…

TraLFM models human mobility patterns from traffic trajectories.

In many applications, observed data are influenced by some combination of latent causes. For example, suppose sensors are placed inside a building to record responses such as temperature, humidity, power consumption and noise levels. These random, observed responses are typically affected by many unobserved, latent fac…

We present a Bayesian tensor factorization model for inferring latent group structures from dynamic pairwise interaction patterns. For decades, political scientists have collected and analyzed records of the form "country $i$ took action $a$ toward country $j$ at time $t$"---known as dyadic events---in order to form an…

Improved IFA with Generative Adversarial Networks for high-dimensional latent variables.

Paper proposes C-STM for multimodal neuroimaging data classification.

Factor analysis provides linear factors that describe relationships between individual variables of a data set. We extend this classical formulation into linear factors that describe relationships between groups of variables, where each group represents either a set of related variables or a data set. The model also na…

Proposes MD-LiNA for multi-domain latent factor causal discovery.