VarFA efficiently estimates student skill levels with uncertainty for adaptive testing.
problem Efficiently estimating student skill levels with uncertainty for adaptive testing.
method VarFA uses variational inference to extend factor analysis models for educational data.
result VarFA efficiently handles large datasets and produces uncertainty estimates.
This project compares MCMC and VI for Bayesian PMF on MovieLens.
problem Intractable posterior distribution in PMF.
method Employed MCMC and VI for Bayesian inference on MovieLens.
result VI converges faster, MCMC provides more accurate estimates.
Variational inference improves neural network matrix factorization for stochastic blockmodels.
problem Improving predictive performance of neural network matrix factorization for stochastic blockmodels.
method Construct Bayesian neural networks and fit with variational inference.
result Variational inference can achieve equivalent performance to neural networks on Movielens data.
PGMax automates PGM inference on GPUs, improving quality and speed.
problem Efficient inference in complex discrete PGMs.
method Factor graph specification and loopy belief propagation in JAX.
result Higher-quality inference with up to 3x speedups.
Learned factor graphs improve inference from time sequences using neural networks.
problem Inference from time sequences with limited labeled data.
method Combines model-based algorithms and data-driven ML tools for stationary time sequences.
result Learned factor graphs can accurately infer from small training sets.
Bayesian hypergraph inference models disease pathways from EHR data.
problem Modeling rare diseases influenced by shared risk factors.
method Bayesian hypergraph inference framework reframing multi-disease modeling.
result Interpretable disease pathways and well-calibrated uncertainty quantification.
Proposes a new Gaussian factor for probabilistic inference with degenerate settings.
problem Handling linear dependencies among random variables in Gaussian networks.
method Introduces a parametrised factor that relaxes the positive-definite constraint of the covariance matrix.
result Accurately accommodates degeneracies in probabilistic inference without significant computational overhead.
Bayesian model infers factor dimensionality and sparse loading matrix adaptively.
problem Inference of high-dimensional sparse factor model with varying sparsity and factor dimensions.
method Adaptive Bayesian sparse factor model with posterior concentration.
result Posterior distribution asymptotically concentrates on true factor dimensionality and sparsity.
Knockoffs method selects financial factors, controlling false discoveries.
problem Controlling false discoveries in financial factor selection.
method Apply knockoff procedure to build fake factors.
result Shows versatility in fund replication and network inference.
Tensor variable elimination for plated factor graphs enables exact inference in models with repeated structure.
problem Efficient inference in models with repeated structure.
method Generalized variable elimination to tensor variable elimination on plated factor graphs.
result Tractable inference for a class of plated factor graphs.
Survey of factor analysis, PCA, variational inference, and VAE.
problem Dimensionality reduction and generative modeling of data.
method Variational inference, factor analysis, probabilistic PCA, and VAE.
result Derivation and explanation of ELBO, EM, and closed-form solutions.
DISTANA improves weather prediction by inferring hidden factors from temperature data.
problem Inferring hidden factors in spatiotemporal processes without supervision.
method Enhanced DISTANA architecture for spatiotemporal data, active tuning for latent state inference.
result DISTANA achieves more accurate predictions than other methods, inferring hidden factors from temperature data.
Efficient CVI for NGFA improves GFA inference for large-scale data.
problem Inference limitations in GFA models for large-scale data.
method Collapsed variational inference for nonparametric Bayesian GFA.
result CVI algorithm effectively approximates NGFA posterior in collapsed space.
Deep model learns complex latent codes without assuming factor structure.
problem Learning latent codes with complex, non-factorial distributions.
method Deep generative factor analysis with beta process prior and stochastic EM algorithm.
result Preliminary results show model can approximate complex distributions.
We present a Bayesian tensor factorization model for inferring latent group structures from dynamic pairwise interaction patterns. For decades, political scientists have collected and analyzed records of the form "country i took action a toward country j at time t"---known as dyadic events---in order to form an…
SOFARI improves inference on multi-task learning latent factors.
problem Challenges in precise inference on multi-task learning latent factor matrices.
method High-dimensional manifold-based Neyman near-orthogonality inference on Stiefel manifold structure.
result Easy-to-use bias-corrected estimators for latent factor vectors and singular values with asymptotic normal distributions.
New method disentangles latent factors for better treatment effect estimation.
problem Estimating treatment effects from observational data when confounders are not the only variables.
method Variational inference to disentangle latent factors into instrumental, confounding, and risk factors.
result The method improves treatment effect estimation accuracy on various datasets.
New distribution simplifies covariance matrix inference.
problem Efficient inference for covariance matrices in large models.
method Incorporates Inverse G-Wishart distribution for variational message passing.
result Elegant and succinct expression of variational message passing fragments.
New theory for PCA under weak latent factors, improving inference and testing.
problem Statistical inference for PCA with weak latent factors and cross-sectional dependence.
method Comprehensive estimation and inference theory for PCA under nearly minimal factor strength, non-asymptotic.
result Asymptotic normality of PCA-based estimator for N≍T with SNR growth rate. Probabilistic approaches for tensor factorization aim to extract meaningful structure from incomplete data by postulating low rank constraints. Recently, variational Bayesian (VB) inference techniques have successfully been applied to large scale models. This paper presents full Bayesian inference via VB on both single…
Bayesian inference improves neural network pruning efficiency.
problem Reducing computational and memory demands of large neural networks.
method Utilizes Bayesian inference to calculate Bayes factors for iterative pruning.
result Achieves desired levels of sparsity while maintaining competitive accuracy.
Models for recommender systems use latent factors to explain the preferences and behaviors of users with respect to a set of items (e.g., movies, books, academic papers). Typically, the latent factors are assumed to be static and, given these factors, the observed preferences and behaviors of users are assumed to be ge…
Paper proposes Walsh-Hadamard Variational Inference for efficient approximate inference in large models.
problem Over-regularization in variational inference for large models.
method Walsh-Hadamard factorization strategies to reduce parameterization, accelerate computations, and increase posterior expressiveness.
result Efficient approximate inference achieved in over-parameterized models.
We present a Bayesian non-negative tensor factorization model for count-valued tensor data, and develop scalable inference algorithms (both batch and online) for dealing with massive tensors. Our generative model can handle overdispersed counts as well as infer the rank of the decomposition. Moreover, leveraging a repa…
Tree-AMP simplifies inference in complex tree-structured models.
problem Inference in high-dimensional tree-structured models.
method Approximate Message Passing algorithms for various machine learning tasks.
result Theoretical performance predictions and automated entropy estimation.
Beta process is the standard nonparametric Bayesian prior for latent factor model. In this paper, we derive a structured mean-field variational inference algorithm for a beta process non-negative matrix factorization (NMF) model with Poisson likelihood. Unlike the linear Gaussian model, which is well-studied in the non…
Non-negative Matrix Factorization (NMF) is a popular tool for data exploration. Bayesian NMF promises to also characterize uncertainty in the factorization. Unfortunately, current inference approaches such as MCMC mix slowly and tend to get stuck on single modes. We introduce a novel approach using rapidly-exploring ra…
FACTM combines FA with correlated topic modeling for structured data integration.
problem Integrating structured data modalities like text and single cell sequencing.
method Bayesian FACTM model combining FA and correlated topic modeling with variational inference.
result FACTM outperforms other methods in identifying clusters in structured data and integrating them with simple modalities.
NTFA models participant and stimulus variations in fMRI data.
problem Lack of statistical tools to examine participant differences in neuroimaging studies.
method NTFA, a probabilistic factor analysis model inferring embeddings for participants and stimuli.
result NTFA improves predictive generalization and downstream tasks.
Model-based collaborative filtering analyzes user-item interactions to infer latent factors that represent user preferences and item characteristics in order to predict future interactions. Most collaborative filtering algorithms assume that these latent factors are static, although it has been shown that user preferen…
New method for inference on covariates in NMF with random effects.
problem Formal inference for covariate effects in NMF with non-negativity constraints.
method NMF-RE model with random effects, ridge updates, df-based cap, asymptotic linearization, wild bootstrap.
result Valid inference on covariates with non-negativity constraint, avoiding degeneracy.
Optimizes Bayesian priors for matrix factorization without posterior inference.
problem Selecting optimal priors for Bayesian models in machine learning.
method Prior predictive distribution and virtual statistics matching user-provided or observed data statistics.
result Analytically determines hyperparameters for Poisson factorization models.
PRISM identifies simplex vertices from noisy data.
problem Identifying vertices of a simplex from noisy data.
method Probabilistic simplex model with maximum likelihood inference.
result Vertices are identifiable under certain assumptions.
Model for dynamic relational data with regime changes.
problem Handling abrupt changes in dynamic relational data.
method Factorized fusion shrinkage model with global-local shrinkage priors.
result Posterior distribution attains minimax optimal rate up to logarithmic factors.
Automates Bayesian signal processing algorithm design using factor graphs.
problem Designing efficient Bayesian signal processing algorithms.
method Factor graph approach and ForneyLab tool for automated inference.
result ForneyLab outperforms competitors in automated inference for state-space models.
New method for community detection in graphs faster than DCBM inference.
problem Efficiently detecting communities in graphs with heterogeneous node degrees.
method Reformulated constrained nonnegative matrix factorization for DCBM inference.
result Faster community detection (4 minutes for 100k nodes vs. DCBM's 10+ minutes).
DMSTF models spatio-temporal data with deep Markov priors.
problem Analyzing nonlinear multimodal spatio-temporal dynamics.
method Deep Markov spatio-temporal factorization with stochastic variational inference.
result DMSTF outperforms other methods in predictive performance and clustering.
Bayesian model learns optimal number of latent dimensions for Boolean data.
problem Optimal number of latent dimensions in Boolean data models.
method Indian Buffet Process prior over factor matrices for non-parametric Boolean factorisation.
result Posterior inference is efficient and the number of latent dimensions is transparently inferred.
New method for high-dimensional manifold-based inference tackles latent responses.
problem Inference on latent right factor vectors in multi-task learning with large numbers of responses and features.
method SOFARI-R method with two variants: one for strongly orthogonal factors and another for weakly orthogonal factors.
result Bias-corrected estimators for latent right factor vectors with asymptotically normal distributions and justified asymptotic variance estimates.
We speed up marginal inference by ignoring factors that do not significantly contribute to overall accuracy. In order to pick a suitable subset of factors to ignore, we propose three schemes: minimizing the number of model factors under a bound on the KL divergence between pruned and full models; minimizing the KL dive…
Analyzes factors affecting flow VI performance.
problem Consistent performance of flow VI across studies.
method Step-by-step analysis of capacity, objectives, batchsize, estimators, and step-sizes.
result Specific recommendations and a flow VI recipe.
New method handles missing data and multiple data types in time series models.
problem Handling missing data and multiple data modalities in time series models.
method Factorized inference method for Multimodal Deep Markov Models (MDMMs).
result Method performs well even with high levels of missing data and outperforms existing approaches.
Neuroscience is experiencing a data revolution in which many hundreds or thousands of neurons are recorded simultaneously. Currently, there is little consensus on how such data should be analyzed. Here we introduce LFADS (Latent Factor Analysis via Dynamical Systems), a method to infer latent dynamics from simultaneous…
Tackling pattern recognition problems in areas such as computer vision, bioinformatics, speech or text recognition is often done best by taking into account task-specific statistical relations between output variables. In structured prediction, this internal structure is used to predict multiple outputs simultaneously,…
Unified approach to path planning using probabilistic inference on factor graphs.
problem Path planning problems using probabilistic inference.
method Unified framework using probabilistic factor graphs and message composition rules.
result Unified approach includes various algorithms like Sum-product, Max-product, Dynamic programming, and mixed criteria.
Bayesian model identifies outliers and determines tensor rank in streaming data.
problem Outliers and over-fitting in streaming tensor factorization.
method Variational Bayesian Inference for robust tensor rank determination and outlier identification.
result Model accurately identifies sparse outliers and determines tensor rank.
Probabilistic inference in graphical models is the task of computing marginal and conditional densities of interest from a factorized representation of a joint probability distribution. Inference algorithms such as variable elimination and belief propagation take advantage of constraints embedded in this factorization …
A new method uncovers discrete and continuous factors in gene expression data.
problem Jointly identifying discrete and continuous factors of variability without supervision.
method cpl-mixVAE framework using multiple interacting networks.
result The method successfully uncovers discrete and continuous factors in gene expression data.