New AD algorithms speed up learning in integer models.
problem Efficient inference and learning in integer latent variable models.
method Nested automatic differentiation for exact inference and learning.
result Significantly faster and more accurate learning algorithms.
Develops a method to identify causal effects in linear models with latent variables.
problem Identifying causal effects in models with latent variables that are not independent.
method A novel graphical criterion and an integer linear program algorithm.
result Sufficient condition for identifying causal effects by rational formulas in the covariance matrix.
A new method for Bayesian inference using discrete variables.
problem Efficient and exact computations in Bayesian variational inference.
method DIRECT approach exploiting Kronecker matrix algebra for unbiased ELBO gradient estimation.
result Direct models can compute ELBO gradients exactly and use quasi-Newton optimization methods.
Improves BO methods for categorical and integer-valued variables.
problem Handling categorical and integer-valued variables in BO with GPs.
method Proposes a principled approach to encode categorical and integer-valued inputs.
result Significantly improves BO results on problems with categorical or integer-valued variables.
MVRSM optimizes expensive functions with mixed variables, outperforming state-of-the-art methods.
problem Minimizing expensive functions with mixed continuous and integer variables.
method Mixed-Variable ReLU-based Surrogate Modelling (MVRSM) using rectified linear units.
result MVRSM outperforms state-of-the-art methods on synthetic and real-life benchmarks.
Bayesian optimization (BO) methods are useful for optimizing functions that are expensive to evaluate, lack an analytical expression and whose evaluations can be contaminated by noise. These methods rely on a probabilistic model of the objective function, typically a Gaussian process (GP), upon which an acquisition fun…
A new method for discrete data normalizing flows using latent transformations.
problem Challenges in parameterizing bijective transformations for discrete data.
method Predict a distribution over latent transformations to make the marginal likelihood differentiable.
result Discrete-data normalizing flows can be trained using gradient-based learning with unbiased score function estimation.
Paper solves low-rank Boolean matrix approximation using integer programming.
problem Finding low-rank approximations to Boolean matrices.
method Integer programming formulation with polynomial variables and constraints.
result First computationally tractable integer programming approach.
Optimizes intervention design for causal discovery using integer programming.
problem Identifying causal structures from observational data due to confounding variables.
method Uses integer programming to design minimal intervention sets for causal structure identifiability.
result Provides exact and modular solutions adaptable to various experimental settings and constraints.
Investigates latent variable models for useful generative concept representations.
problem Creating latent representations that support various concepts and attributes.
method Latent variable modeling, including latent variable models, latent representations, and latent spaces.
result Hierarchical latent representations and latent space vectors and geometry are effective for generative concept representations.
Researchers identify latent variables and causal structures from nonlinear hierarchical models.
problem Challenging task of identifying latent variables and causal structures from observational data, especially when relationships are nonlinear.
method Investigated nonlinear latent hierarchical causal models, developed identification criterion, and constructed an estimation procedure.
result Identifiability of causal structures and latent variables achieved under mild assumptions.
A neural network finds causal relationships among latent variables.
problem Learning causal structure among latent variables in high-dimensional data.
method Redundant Input Neural Network (RINN) with modified architecture and regularized objective function.
result The RINN method successfully recovers latent causal structure between input and output variables.
In this letter we borrow from the inference techniques developed for unbounded state-cardinality (nonparametric) variants of the HMM and use them to develop a tuning-parameter free, black-box inference procedure for Explicit-state-duration hidden Markov models (EDHMM). EDHMMs are HMMs that have latent states consisting…
Paper introduces DP methods for high-dimensional variable selection.
problem Sparse variable selection in high-dimensional learning.
method Pure differentially private estimators using Integer Programming.
result Achieves state-of-the-art empirical support recovery.
Improved DSSMs for easier interpretable latent variables.
problem Complex and hard-to-interpret latent variables in DSSMs.
method Simplified predictive decoder and shrinkage priors.
result Interpretable latent variables improve forecasting performance.
IDF++ improves integer discrete flows for lossless compression.
problem Theoretical limitations of integer discrete flows for lossless compression.
method Investigated and improved integer discrete flows, addressing gradient bias and architecture modifications.
result Different architecture modifications improve integer discrete flows for lossless compression.
Bit-Swap improves lossless compression for hierarchical latent variable models.
problem Efficient lossless compression for latent variable models with hierarchical structure.
method Generalizes bits-back coding to hierarchical latent variable models with Markov chain structure.
result Achieves superior lossless compression rates for hierarchical latent variable models.
New method identifies latent causal variables from observed data, overcoming indeterminacies.
problem Identifying latent causal variables from observed data, especially when latent variables are weight-variant.
method Introduces a novel identifiability condition for latent causal models, proposing SuaVE method.
result Identifies latent causal variables up to trivial permutation and scaling, demonstrating consistency and efficacy.
Tutorial on combining latent variable models with deep learning.
problem Combining latent variable models with deep learning to model natural language.
method Exploring variational inference to address intractable posterior inference and non-differentiability issues.
result Exploration of variational inference techniques to handle deep latent variable models.
Exact inference possible without observing latent variables in unknown domains.
problem Can exact inference be done without knowing latent variables or their domain?
method Semidefinite programming (SDP) approach based on Karush-Kuhn-Tucker (KKT) conditions and matrix spectrum.
result Exact inference can be achieved without knowing latent variables or their domain.
New method identifies latent relationships in deep models without additional constraints.
problem Latent representations in deep latent variable models are not statistically identifiable.
method Identifies relationships between latent variables (distances, angles, volumes) under mild model conditions.
result Empirically demonstrates more reliable latent distances without additional labeled data.
Generative skip models avoid latent variable collapse in VAEs.
problem Latent variable collapse in VAEs prevents useful representations.
method Include skip connections in generative models to enforce strong links between latent variables and likelihood function.
result Generative skip models maintain similar predictive performance but reduce latent variable collapse and provide more meaningful representations.
New method for fitting graphical models with latent variables using regularized conditional likelihood.
problem Graphical modeling with latent variables and confounding dependencies.
method Regularized conditional likelihood for exponential family graphical models.
result Framework applicable to broader settings without knowing latent variables' distribution.
We propose a probabilistic model to infer supervised latent variables in the Hamming space from observed data. Our model allows simultaneous inference of the number of binary latent variables, and their values. The latent variables preserve neighbourhood structure of the data in a sense that objects in the same semanti…
Method evaluates disentanglement in DLVMs, including those not aligned with latent axes.
problem Evaluate disentanglement in DLVMs, especially those not aligned with latent axes.
method Proposes a statistical method to discover generative factors of a dataset.
result Empirically demonstrates the advantage of the method on two datasets.
New method learns graphical models with latent variables for extreme events.
problem Learning graphical models with latent variables for multivariate extremes.
method Tractable convex program exttt{eglatent} for Hüsler-Reiss models.
result Consistently recovers conditional graph and latent variables.
Unified framework for disentangling latent variables.
problem Unidentifiability of deep latent-variable models.
method Variational autoencoders and nonlinear ICA, with a factorized prior conditioned on an observed variable.
result Identification of true joint distribution over observed and latent variables is possible up to simple transformations.
DSVNP uses global and local latent variables for improved neural process predictions.
problem Limited expressiveness of vanilla neural processes in capturing target-specific local variation.
method Introduces DSVNP combining global and local latent variables for prediction.
result Competitive prediction performance in multi-output regression and uncertainty estimation.
VAEs help in learning latent variables for cryo-EM applications.
problem Learning latent variables for cryo-EM data.
method Used VAEs for latent variable learning, focusing on the encoder's role.
result The encoder of the VAE in cryo-EM applications resembles traditional latent variable representations.
Paper relaxes identifiability conditions for causal models with latent variables.
problem Challenges in identifying causal graphical models with latent variables.
method Proposes a double triangular graphical condition for nonparametric measurement models with binary latent variables.
result Guarantees identifiability of the entire causal graphical model under relaxed conditions.
Bayesian non-parametric model selects latent dimensions automatically.
problem Non-linear, sparse latent variable selection.
method Indian buffet process prior, random Fourier approximation, MCMC sampling.
result Superior performance on synthetic, biological, and text datasets.
Formula for 2-bridge link Alexander polynomials via integer walks.
problem Computing Alexander polynomials of 2-bridge links.
method Extending Hartley's and Minkus' formula to 2-variable polynomials via integer lattice walks.
result A formula corresponding to a walk on the 2D integer lattice.
We study parameter inference in large-scale latent variable models. We first propose an unified treatment of online inference for latent variable models from a non-canonical exponential family, and draw explicit links between several previously proposed frequentist or Bayesian methods. We then propose a novel inference…
Paper proposes a new method to identify causal graphs with latent variables using higher-order cumulants.
problem Estimating causal directed acyclic graphs with latent confounders.
method Uses higher-order cumulants to identify causal structures among observed and latent variables.
result Validates the proposed algorithm through simulations and real-world data.
The paper identifies causal effects in latent variable models using higher-order cumulants.
problem Challenges in identifying causal effects in latent variable models with latent confounders.
method Using higher-order cumulants, the paper addresses two challenging setups: a single proxy variable and underspecified instrumental variables.
result Causal effects are identifiable with a single proxy or instrument.
The causal discovery of Bayesian networks is an active and important research area, and it is based upon searching the space of causal models for those which can best explain a pattern of probabilistic dependencies shown in the data. However, some of those dependencies are generated by causal structures involving varia…
The paper tackles causal disentanglement with linear models and interventions.
problem Identify latent variables in a causal model from observed data.
method Use linear transformations and interventions to uniquely identify latent variables.
result A single intervention on each latent variable is sufficient for identifying the latent causal model.
CIPNN model tackles continuous latent variables, solving intractable posterior problems.
problem Solving intractable posterior calculation for continuous latent variables.
method Derives analytical solution for posterior of continuous latent variables, proposes CIPNN and CIPAE.
result CIPNN model demonstrates great classification capability, solving problems for continuous latent variables.
Paper proposes RCD method to discover causal structure with latent confounders.
problem Causal discovery from data with latent confounders.
method Repetitive causal discovery (RCD) method to infer causal directions between observed variables.
result RCD effectively identifies latent confounders and causal directions between observed variables.
Improves latent variable use in generative models.
problem Poor use of latent variables in variational autoencoders (VAEs).
method Combines data log likelihood with autoencoder reconstruction likelihood.
result Ensures latent variable captures observation information and generates well.
Paper tackles causal effect identification in sub-population with latent variables.
problem Identify causal effects in a sub-population with latent variables.
method Extend relevant graphical definitions and propose an algorithm for the s-ID problem.
result Sound algorithm for s-ID problem with latent variables.
Latent variable models improve RL by facilitating efficient learning and exploration.
problem Improving sample efficiency in reinforcement learning.
method Representation view of latent variable models for state-action value functions, incorporating kernel embeddings and UCB exploration.
result Established sample complexity of the proposed approach in online and offline settings, demonstrated superior performance in benchmarks.
A new method reduces variance in training discrete latent variable models.
problem High variance in stochastic gradient estimators for discrete latent variable models.
method Double control variates for score function estimators using Taylor expansions.
result Our method can have lower variance compared to other estimators.
New method identifies latent variables with causal dependencies from observed data.
problem Identify latent variables with causal relationships from observed data.
method Linear causal disentanglement via higher-order cumulants, with perfect and soft interventions.
result Recovery of parameters via coupled tensor decomposition and polynomial equations.
A method estimates causal parameters using a latent variable recovery.
problem Estimating causal parameters in contexts with multiple causes and unobserved confounding.
method Substitute adjustment via recovery of latent variables.
result Substitute adjustment estimates adjusted regression parameters under certain conditions.
Method interprets GAN latent space via latent variable correlation analysis.
problem Understanding the inner workings of GANs.
method Analyzing correlation between latent variables and semantic contents in generated images.
result A method for controllable semantic content generation in GANs.
Paper detects hierarchical changes in latent variable models from data streams.
problem Detecting changes at three levels: data distribution, latent variables, and number of latent variables.
method Information-theoretic framework using MDL and DNML for change detection.
result Effective in detecting changes with good interpretability.
New algorithm for learning RBMs with sparse latent variables.
problem Learning RBMs with sparse latent variables efficiently.
method Algorithm with time complexity O(n^(2^s+1)) for sparse RBMs.
result Improves learning time for RBMs with sparse latent variables.