This work extends identifiability analysis to sequential latent variable models, focusing on Switching Dynamical Systems.
problem Identifying latent variables in sequential data models.
method Proved identifiability of Markov Switching Models and established conditions for Switching Dynamical Systems.
result Identifiability of latent variables and non-linear mappings in Switching Dynamical Systems up to affine transformations.
New framework identifies strongly identifiable models from flexible generators.
problem Indeterminacies in generative models that prevent unique latent codes.
method Theoretical framework for analyzing latent variable models, excluding certain indeterminacies.
result Strong identifiability possible even with flexible nonlinear generators.
Paper establishes identifiability conditions for a model with two latent vectors and auxiliary data.
problem Identifying conditions for a statistical model with two latent vectors and auxiliary data.
method Proposes a statistical model with two latent vectors and auxiliary data, establishing various identifiability conditions.
result Identifiability conditions reveal a dimensionality relation and link model indeterminacies to maximum link weights.
Researchers show mixtures of ranking models are generally identifiable.
problem Understanding when and how parameters of mixtures of ranking models can be uniquely determined.
method Algebraic geometry framework applied to verify the number of solutions in polynomial systems.
result Popular mixtures of ranking models with two components are generically identifiable.
Paper relaxes identifiability conditions for causal models with latent variables.
problem Challenges in identifying causal graphical models with latent variables.
method Proposes a double triangular graphical condition for nonparametric measurement models with binary latent variables.
result Guarantees identifiability of the entire causal graphical model under relaxed conditions.
Paper simplifies complex causal identifiability problems with exogenous isomorphism.
problem Achieving consistent answers to causal questions in Structural Causal Models.
method Introducing exogenous isomorphism and proposing ∼EI-identifiability. result Unified and generalized theories for practical applications in counterfactual reasoning.
Hypothesis testing in singular models is fundamentally about identifiable vs. non-identifiable parameters.
problem Testing in singular models is inherently problematic due to non-identifiability and degeneracy of Fisher information.
method Formalized the overlap obstruction and showed that hypotheses over non-identifiable parameters are untestable, while those over identifiable parameters reduce to classical testing.
result Hypotheses over non-identifiable parameters are untestable, while those over identifiable parameters reduce to classical testing.
The paper shows that certain learned representations are identifiable in function space.
problem Identifiability of learned representations in deep neural networks.
method Using recent advances in nonlinear ICA, the paper shows that a large family of discriminative models are identifiable in function space, up to a linear indeterminacy.
result Many models for representation learning are identifiable in function space, including text, images, and audio.
New method identifies latent relationships in deep models without additional constraints.
problem Latent representations in deep latent variable models are not statistically identifiable.
method Identifies relationships between latent variables (distances, angles, volumes) under mild model conditions.
result Empirically demonstrates more reliable latent distances without additional labeled data.
Neural networks can learn relationships that traditional models cannot.
problem Identifying factors that differentiate neural networks from traditional models.
method Proving non-identifiability of neural networks compared to smooth parametric models.
result Neural networks can learn nontrivial relationships that traditional models cannot.
We identify causal models with unobserved confounding using bijective generation mechanisms.
problem Identifying causal relationships with unobserved confounders.
method Establish counterfactual identifiability for BGMs and propose a learning method.
result Learned BGMs enable efficient counterfactual estimation.
Proves identifiability of deep latent variable models without auxiliary information.
problem Identify deep generative models without side information.
method Analyzes a broad class of deep latent variable models with universal approximation capabilities.
result Identifiability of generative models without side information u. Efficient algorithm for identifying causal effects in linear models.
problem Determining causal effects from observational data under latent confounding.
method Symbolic computation and efficient algorithm for finding identifying formulas.
result Proves the existence of identifying formulas of a specified degree in quasi-polynomial time.
Concept modulation models unify identifiability and extrapolation in conditional latent variable models.
problem Reliable generalization in conditional latent variable models
method Concept modulation models (CMMs) with structure AoΛoCoX result Lifts identifiability to conditional settings and controls extrapolation through attribute potentials.
The paper reviews identifiability in linear and nonlinear models, from Gaussian to non-Gaussian.
problem Identifiability issues in latent-variable and structural-equation models, especially in nonlinear cases.
method Review of identifiability theory for linear and nonlinear models, including factor analysis and structural equation models.
result Even nonparametric nonlinear models can be estimated with additional assumptions.
Develops identifiability theory for multi-lag regime-switching models.
problem Ensuring interpretability of deep latent variable models with multi-lag dependencies.
method Formulates a general theoretical framework for multi-lag Regime-Switching Models (RSMs), proving identifiability of number of regimes and multi-lag transitions.
result Establishes identifiability conditions for multi-lag regime-switching models, including Markov Switching Models and Switching Dynamical Systems.
Overcomplete latent representations have been very popular for unsupervised feature learning in recent years. In this paper, we specify which overcomplete models can be identified given observable moments of a certain order. We consider probabilistic admixture or topic models in the overcomplete regime, where the numbe…
Study shows not all ML models are uniquely identifiable from data.
problem Identifiability issues in machine learning models.
method Investigated through a case study on gait dynamics using a bipedal-spring mass model.
result Some parameters can be identified, but others remain unidentifiable.
Proposes iVDFM for identifying latent factors in multivariate time series.
problem Identifying latent factors in multivariate time series with structural dynamics.
method Identifiable Variational Dynamic Factor Model (iVDFM) with iVAE-style conditioning.
result Identifiable latent factors up to permutation and component-wise affine transformations.
We improve robust parameter estimation in causal models from observational data.
problem Robustly estimating parameters in linear structural equation models from observational data.
method Extending Sankararaman et al. (2019) to a broader class of models, providing sufficient conditions for robust identifiability.
result For a large set of parameters, robust identifiability holds and existing algorithms achieve robust identifiability.
New bounds on sample size for identifying mixture models with grouped samples.
problem Identifying mixture models with minimal sample size.
method Generalized identifiability bounds for mixture models with grouped samples.
result Identifiability with (2m−1)/(k−1) samples per group, with no improvement possible. New method warns of counterfactual non-identifiability in DSCMs.
problem Counterfactual inference from observational data is non-identifiable even without unobserved confounding.
method Prove counterfactual identifiability for monotonic generation mechanisms, provide impossibility result for general mechanisms, propose method for estimating worst-case errors.
result Non-identifiability of counterfactual inference from observational data, even in absence of unobserved confounding.
Unsupervised learning models can be indistinguishable without identifiability, leading to unreliable representations.
problem Unsupervised learning models may be indistinguishable without identifiability, making it impossible to recover a ground truth generative model.
method Construction based on nonlinear independent component analysis theory to illustrate potential failure cases.
result Counterexamples show that identifiability is crucial for reliable unsupervised representation learning.
Paper identifies tensor ranks via prior predictive matching, solving system of equations.
problem Determining the latent dimensions (ranks) in tensor factorization models.
method Prior predictive moment matching to transform moment matching conditions into a log-linear system of equations.
result Identifies which tensor models have identifiable ranks and derives rank estimators.
Study on identifying AMP chain graph models under known and unknown component decompositions.
problem Identifying AMP chain graph models with known and unknown chain component decompositions.
method Analyzes conditions for identifiability of AMP models and proposes algorithms for structure recovery.
result Conditions for DAG identifiability in AMP models extend equal variance criteria for Bayes nets.
This paper explores unsupervised learning of parsing models along two directions. First, which models are identifiable from infinite data? We use a general technique for numerically checking identifiability based on the rank of a Jacobian matrix, and apply it to several standard constituency and dependency parsing mode…
Variational autoencoders often collapse, showing latent variables are non-identifiable.
problem Posterior collapse in variational autoencoders due to non-identifiable latent variables.
method Proves latent variable non-identifiability causes posterior collapse. Proposes latent-identifiable models using Brenier maps and input convex neural networks.
result Latent-identifiable models resolve posterior collapse and provide meaningful representations.
New framework for disentangling features from noisy data.
problem Disentangling identifiable features from noisy data.
method Structured Nonlinear Independent Component Analysis (SNICA).
result Identifiability holds even in the presence of noise of unknown distribution.
New method identifies latent causal variables from observed data, overcoming indeterminacies.
problem Identifying latent causal variables from observed data, especially when latent variables are weight-variant.
method Introduces a novel identifiability condition for latent causal models, proposing SuaVE method.
result Identifies latent causal variables up to trivial permutation and scaling, demonstrating consistency and efficacy.
Hierarchical Latent Attribute Models (HLAMs) are a family of discrete latent variable models that are attracting increasing attention in educational, psychological, and behavioral sciences. The key ingredients of an HLAM include a binary structural matrix and a directed acyclic graph specifying hierarchical constraints…
Study identifies specialist representations from generalist models without parametric constraints.
problem Identify task-relevant latent representations from generalist models.
method Nonparametric, fully unsupervised approach, proving identifiability of task structure and latent representations.
result Identifiability of task structure and latent representations in a nonparametric setting.
This work addresses missing data imputation for MNAR scenarios with identifiable deep generative models.
problem Missing data with complex missingness mechanisms (MNAR) leading to biased imputation results.
method Systematic analysis and proposal of an identifiable deep generative model.
result Proposed model provides identifiability guarantees under mild assumptions for various MNAR mechanisms.
By taking into account the nonlinear effect of the cause, the inner noise effect, and the measurement distortion effect in the observed variables, the post-nonlinear (PNL) causal model has demonstrated its excellent performance in distinguishing the cause from effect. However, its identifiability has not been properly …
Paper proves identifiability and consistency of hub model for network inference.
problem Identifying network structure from group behavior.
method Hub model and variants, proving identifiability and consistency under mild conditions.
result Identifiability and estimation consistency of hub model and its variants proved.
Paper introduces a new identifiability criterion for DAGs using conditional variances.
problem Challenges in discovering causal relationships from observational data.
method Introduces a novel identifiability criterion for DAGs using conditional variances. Uses weak majorization on Cholesky factor of covariance matrix for learning DAGs.
result Demonstrates effectiveness of the new approach in recovering DAGs through simulations and real data analysis.
New model identifies cell-specific genes for cancer prognosis.
problem No statistical model to integrate multiscale cancer data.
method Bayesian generalized promotion time cure models (GPTCMs).
result Improves cancer prognosis by identifying cell-specific genes.
New findings on identifying latent variables in nonlinear ICA models.
problem Identifying latent variables in nonlinear ICA models is challenging due to spurious solutions.
method Proved that conformal maps are identifiable and provided theoretical results on preventing spurious solutions.
result Conformal maps are identifiable in nonlinear ICA models, preventing spurious solutions.
Identifiability, or recovery of the true latent representations from which the observed data originates, is de facto a fundamental goal of representation learning. Yet, most deep generative models do not address the question of identifiability, and thus fail to deliver on the promise of the recovery of the true latent …
This paper tackles causal representation learning with linear and general transformations.
problem Identify and recover latent causal variables and graphs under unknown transformations.
method Score-based algorithms that use gradients of log-density functions for identifiability and achievability.
result Two stochastic hard interventions per node are sufficient for identifiability of general transformations.
Measurement error in the observed values of the variables can greatly change the output of various causal discovery methods. This problem has received much attention in multiple fields, but it is not clear to what extent the causal model for the measurement-error-free variables can be identified in the presence of meas…
Identifying causal direction in location-scale noise models with hidden variables
problem Causal discovery in location-scale noise models with hidden variables
method ADMGs satisfying a bow-free condition
result First identifiability result for causally insufficient models beyond noise additivity
Study identifies latent variables and models from spacecraft data.
problem Learning reliable models from spacecraft data with complex relationships.
method Inductive bias inspired by controllable canonical forms for sparse, input-dependent latent variables.
result Identifies latent variables up to scaling and determines dynamic models up to transformations for linear and affine systems.
This research improves neural network representation identifiability through task structures.
problem Improving neural network representation identifiability in multi-task settings.
method Analyzing the effects of task distributions and causal structures on latent factors, leading to simpler optimization.
result A straightforward optimization procedure enables better representation recovery in both synthetic and real-world data.
In this work, we consider the identifiability assumption of Gaussian linear structural equation models (SEMs) in which each variable is determined by a linear function of its parents plus normally distributed error. It has been shown that linear Gaussian structural equation models are fully identifiable if all error va…
In this paper, we prove that some Gaussian structural equation models with dependent errors having equal variances are identifiable from their corresponding Gaussian distributions. Specifically, we prove identifiability for the Gaussian structural equation models that can be represented as Andersson-Madigan-Perlman cha…
We solve continuous-time latent SDE identifiability using diffusion shifts.
problem Identifiability of latent SDEs in continuous-time time series.
method Environment-induced shifts in diffusion covariance for additive-noise latent SDEs.
result Two diagonal diffusion regimes with distinct variance ratios identify latent coordinates up to permutation and scaling.
New method uses logical relations to derive bounds and inequality constraints from causal models.
problem Recovering bounds and inequality constraints from unobserved confounding.
method Using rules of probability and restrictions on counterfactuals implied by causal graphical models.
result Powerful method to recover known and novel bounds and constraints.
Transformer-based method improves causal discovery from observational data.
problem Causal discovery from observational data requires explicit assumptions.
method CSIvA transformer architecture trained on synthetic data.
result Transformer-based methods adhere to identifiability theory.