Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,878 papers · 148 categories

Trend · papers per month

169339508677 · Jun 202019922001200920172026
48 results for probabilistic factor analysis

This work connects LLE, factor analysis, and probabilistic PCA through a stochastic perspective.

problem Exploring the theoretical connection between LLE, factor analysis, and probabilistic PCA.
method Solving the stochastic linear reconstruction of LLE using expectation maximization.
result LLE, factor analysis, and probabilistic PCA are shown to be connected through a stochastic perspective.

Paper extends quantile factor analysis with probabilistic methods for better economic policy and financial condition prediction.

problem Improving accuracy in economic and financial condition prediction.
method Probabilistic quantile factor analysis with regularization and variational approximations.
result The probabilistic estimator outperforms a recent loss-based estimator in many cases.

We propose a new IRT model that directly factors test items without factor analysis.

problem Existing multidimensional IRT methods require factorization, which is posthoc and linear.
method We use a sparsity-promoting horseshoe prior to factorize items directly within the IRT model.
result Our model performs factorization directly and consistently selects the correct number of factors.

Survey of factor analysis, PCA, variational inference, and VAE.

problem Dimensionality reduction and generative modeling of data.
method Variational inference, factor analysis, probabilistic PCA, and VAE.
result Derivation and explanation of ELBO, EM, and closed-form solutions.

NTFA models participant and stimulus variations in fMRI data.

problem Lack of statistical tools to examine participant differences in neuroimaging studies.
method NTFA, a probabilistic factor analysis model inferring embeddings for participants and stimuli.
result NTFA improves predictive generalization and downstream tasks.

Many data-driven approaches exist to extract neural representations of functional magnetic resonance imaging (fMRI) data, but most of them lack a proper probabilistic formulation. We propose a group level scalable probabilistic sparse factor analysis (psFA) allowing spatially sparse maps, component pruning using automa…

2016-12-14abs ↗pdf ↗

The PARAFAC2 is a multimodal factor analysis model suitable for analyzing multi-way data when one of the modes has incomparable observation units, for example because of differences in signal sampling or batch sizes. A fully probabilistic treatment of the PARAFAC2 is desirable in order to improve robustness to noise an…

2018-06-21abs ↗pdf ↗

HPPCA improves imputation of longitudinal data with missing values.

problem Handling incomplete, high-dimensional longitudinal data with nested sources of variation and temporal dependency.
method Hierarchical probabilistic principal component analysis (HPPCA) with a two-level latent factor model and Gaussian process.
result HPPCA outperforms standard PPCA and multivariate functional PCA in imputation accuracy, even under heavy missingness and model misspecification.

Tensor-networks enhance probabilistic modeling in physics and machine learning.

problem Understanding the expressive power of different tensor-network factorizations.
method Rigorous analysis of various tensor-network factorizations of discrete multivariate probability distributions.
result There are unbounded separations between the resource requirements of some tensor-network factorizations.

Matrix factorization (MF) has become a common approach to collaborative filtering, due to ease of implementation and scalability to large data sets. Two existing drawbacks of the basic model is that it does not incorporate side information on either users or items, and assumes a common variance for all users. We extend…

2014-07-29abs ↗pdf ↗

Hierarchical probabilistic models, such as mixture models, are used for cluster analysis. These models have two types of variables: observable and latent. In cluster analysis, the latent variable is estimated, and it is expected that additional information will improve the accuracy of the estimation of the latent varia…

2016-07-13abs ↗pdf ↗

Proposes a new Gaussian factor for probabilistic inference with degenerate settings.

problem Handling linear dependencies among random variables in Gaussian networks.
method Introduces a parametrised factor that relaxes the positive-definite constraint of the covariance matrix.
result Accurately accommodates degeneracies in probabilistic inference without significant computational overhead.

Scaling ResNets requires careful consideration of the layer depth and output scaling factors.

problem Avoiding vanishing or exploding gradients in deep ResNets as depth increases.
method Probabilistic analysis and continuous-time limit interpretation of ResNets.
result The optimal scaling factor is αL=1Lα_L = \frac{1}{\sqrt{L}} for standard i.i.d. initializations.

This project compares MCMC and VI for Bayesian PMF on MovieLens.

problem Intractable posterior distribution in PMF.
method Employed MCMC and VI for Bayesian inference on MovieLens.
result VI converges faster, MCMC provides more accurate estimates.

Sparse GFA identifies disease factors in FTD subgroups.

problem Heterogeneity in neurological disorders hinders understanding and treatment.
method Sparse Group Factor Analysis (GFA) with regularised horseshoe priors.
result Identified latent disease factors differentially expressed in FTD subgroups.

Distributions over rankings are used to model data in various settings such as preference analysis and political elections. The factorial size of the space of rankings, however, typically forces one to make structural assumptions, such as smoothness, sparsity, or probabilistic independence about these underlying distri…

2012-02-14abs ↗pdf ↗

Hybrid approach improves probabilistic forecasts for electricity trading.

problem Improving probabilistic forecasts for electricity trading markets.
method Combines QRA and factor-based averaging for probabilistic forecasting.
result The hybrid approach outperforms benchmarks in statistical measures and economic value.

A wide class of machine learning algorithms can be reduced to variable elimination on factor graphs. While factor graphs provide a unifying notation for these algorithms, they do not provide a compact way to express repeated structure when compared to plate diagrams for directed graphical models. To exploit efficient t…

2019-02-08abs ↗pdf ↗

Dynamic probabilistic forecasts guide optimal decisions in uncertain processes.

problem Optimal decision making in processes influenced by uncertain random factors.
method Stochastic models for probabilistic forecast evolution, calibrated from ensemble forecasts.
result Optimal decision strategies determined using dynamic probabilistic forecasts.

Probabilistic models analyze data by relying on a set of assumptions. Data that exhibit deviations from these assumptions can undermine inference and prediction quality. Robust models offer protection against mismatch between a model's assumptions and reality. We propose a way to systematically detect and mitigate mism…

2016-06-13abs ↗pdf ↗

A new model BGAR(1) improves temporal NMF for time series data.

problem Temporal NMF models lack a well-defined stationary distribution.
method Introduced a new Gamma Markov chain model BGAR(1) to overcome the limitation of previous models.
result BGAR(1) model has a well-defined stationary distribution.

This paper tackles Bayesian system identification with probabilistic numerical methods.

problem Accurately modeling nonlinear dynamic systems from noisy data.
method Probabilistic Sequential Monte Carlo (SMC) combined with probabilistic numerical integration.
result Efficient identification of latent states and system parameters from noisy measurements.

Bioprocess risk and sensitivity analysis for personalized biotherapeutics.

problem Complexity, variability, and limited data in biomanufacturing.
method Bayesian network, Shapley value sensitivity analysis, game theory.
result Identifies bottlenecks and guides data collection for improved production stability.

Proposes a flexible feature allocation model for sparse factor analysis.

problem Sparse data and rigid assumptions in traditional exploratory tools.
method Adaptive latent feature sharing with control over feature sparsity.
result Derives a novel adaptive Factor analysis (aFA) and aPPCA for flexible dimensionality reduction.

New algorithm for contextual combinatorial bandits with probabilistic arm triggering.

problem Optimizing decisions in dynamic environments with probabilistic arm availability.
method C^2-UCB-T and VAC^2-UCB algorithms with TPM and VM conditions.
result Achieved improved regret bounds for contextual combinatorial bandits.

LPF provides formal guarantees for aggregating multi-evidence in probabilistic tasks.

problem Lack of formal guarantees for multi-evidence reasoning in AI.
method LPF uses variational autoencoders and Sum-Product Networks to aggregate evidence items.
result Proves multiple formal guarantees including calibration preservation and error decay.

Probabilistic techniques are central to data analysis, but different approaches can be difficult to apply, combine, and compare. This paper introduces composable generative population models (CGPMs), a computational abstraction that extends directed graphical models and can be used to describe and compose a broad class…

2016-08-18abs ↗pdf ↗