New score-based methods identify causal structures with latent variables.
problem Identifying causal structures involving latent variables.
method Score-based methods with identifiability guarantees.
result Score equivalence and consistency for latent variable causal models.
R package stagedtrees learns staged tree structures from data.
problem Learning the structure of staged trees from data.
method Score-based and clustering-based algorithms implemented.
result Illustrated capabilities using two datasets.
CCHM algorithm learns BN structure with latent variables, improving causal effect measurement.
problem Latent variables cause spurious relationships in BN structure learning.
method Hybrid approach combining constraint-based and score-based learning, incorporating do-calculus.
result CCHM outperforms state-of-the-art in reconstructing true BN structure.
Proposes an approach to ensure acyclic graphs in Bayesian structure learning.
problem Ensuring acyclic graphs in Bayesian structure learning.
method Integration of knowledge from topological orderings to constrain acyclicty.
result Outperforms related Bayesian score-based approaches in experiments.
SBMs learn manifold-like structures by mixing samples with a non-conservative field.
problem How SBMs learn data distributions on low-dimensional manifolds.
method Investigating linear approximations and subspaces of local feature vectors during diffusion.
result SBMs mix samples by a non-conservative field within the manifold, maintaining manifold-like structure.
SAMI learns disentangled representations from data.
problem Learning disentangled representations from data.
method Combines diffusion models and VAEs to learn disentangled representations.
result SAMI learns disentangled representations that are interpretable and useful.
Paper analyzes stability and forgetting in score-based generative models.
problem Understanding the stability and long-time behavior of generative models.
method Quantitative bounds on sampling error using stability and forgetting properties of the Markov chain.
result Provides practical consequences of stability and contraction mechanism in sampling.
We study a family of regularized score-based estimators for learning the structure of a directed acyclic graph (DAG) for a multivariate normal distribution from high-dimensional data with p≫n. Our main results establish support recovery guarantees and deviation bounds for a family of penalized least-squares estima…
Paper develops a consistent algorithm for learning graph structure from continuous-time stochastic differential equations.
problem Learning structure from continuous-time stochastic differential equations.
method Score-based structure learning using Neural Ordinary Differential Equations with adaptive regularization.
result The method consistently recovers directed graphs of local independencies in systems of stochastic differential equations.
Improved generative models learn structured data better.
problem Training score-based generative models for structured data.
method Nonlinear denoising score matching with neural control variates.
result Enhanced learning of multimodal and symmetric data.
FLOP algorithm speeds up causal structure learning for linear models.
problem Efficiently learning causal structures from discrete data.
method FLOP algorithm combines fast parent selection and iterative score updates.
result FLOP finds highly accurate causal structures with near-perfect recovery.
Enhances learning of structured distributions using nonlinear denoising score matching.
problem Learning structured distributions from noisy data.
method Latent Nonlinear Denoising Score Matching (LNDSM) integrating nonlinear dynamics with VAE-based latent score matching.
result LNDSM achieves superior sample quality and variability compared to structure-agnostic methods.
A new method infers causal gene regulatory networks from parallel CRISPR interventions and transcriptomic data.
problem Learning causal gene regulatory networks from observational data is complicated by lack of identifiability and a combinatorial solution space.
method A continuous optimization framework that leverages observational and interventional data to infer a single causal structure, assuming a linear Structural Equation Model (SEM).
result A provably consistent estimator of the true DAG under mild assumptions.
Three classes of algorithms to learn the structure of Bayesian networks from data are common in the literature: constraint-based algorithms, which use conditional independence tests to learn the dependence structure of the data; score-based algorithms, which use goodness-of-fit scores as objective functions to maximise…
Mathematical analysis improves SGMs, resolving memorization issues.
problem Improving performance and avoiding memorization in SGMs.
method Formulated SGMs using Wasserstein proximal operators and mean-field games.
result Improved SGM performance in terms of training samples and time.
We solve structure learning for cyclic linear causal models using observational data.
problem Learning the structure of cyclic linear causal models from observational data.
method Assuming simple graphs, we use a criterion for distributional equivalence and implement a greedy search method.
result We show that simple cyclic models are of expected dimension and justify score-based methods for structure learning.
We introduce SADs to reveal how network architecture shapes score-based generative models.
problem Understanding and predicting the inductive biases of score-based generative models.
method Introducing Score Anisotropy Directions (SADs) to analyze network architecture.
result SADs reliably capture model behavior and correlate with performance.
Proposes a new algorithm for learning continuous-time Bayesian network structures.
problem Lack of constraint-based algorithms for continuous-time Bayesian networks.
method Develops a constraint-based algorithm using statistical tests for conditional independence.
result The proposed algorithm is more accurate with variables having more than two values.
Improved score-based models generate high-quality images up to 256x256.
problem Training score-based models for high-resolution images is unstable and limited.
method Theoretical analysis, exponential moving average of model weights.
result Score-based models can generate high-fidelity images up to 256x256.
A new method learns graph distributions invariant to node ordering.
problem Graphs are hard to model due to node ordering invariance issues.
method Score-based generative modeling with permutation equivariant graph neural network.
result The method achieves better or comparable graph generation results.
Many algorithms for score-based Bayesian network structure learning (BNSL), in particular exact ones, take as input a collection of potentially optimal parent sets for each variable in the data. Constructing such collections naively is computationally intensive since the number of parent sets grows exponentially with t…
Proposes a scalable framework for extracting data manifold geometry.
problem Efficiently mapping and learning data manifold geometry.
method Score-based pullback Riemannian geometry integrating pullback Riemannian geometry and generative models.
result High-quality geodesics and reliable intrinsic dimension estimation.
The paper formalizes how concepts are encoded in text-guided generative models and provides a method to manipulate them.
problem Encoding and manipulating concepts in text-guided generative models.
method Formalizing concepts as subspaces of a representation space, developing algebraic manipulation methods.
result The ability to manipulate concepts in generative models through algebraic operations on the representation.
We solve the paradox of score-based methods by minimizing path variance.
problem Score-based methods are path-dependent, leading to inaccurate and unstable estimators.
method Propose MVP Principle to minimize path variance, derive closed-form expression, and use flexible Kumaraswamy Mixture Model.
result Establishes new state-of-the-art results on challenging benchmarks.
CASPER improves DAG structure learning by integrating graph structure into score function.
problem Discovering suboptimal DAGs and model vulnerabilities in causal discovery.
method CASPER integrates graph structure into the score function as a new measure in the causal space, enhancing DAG structure learning via adaptive attention to DAG-ness.
result CASPER outperforms state-of-the-art methods in terms of accuracy and robustness.
Causal modeling has long been an attractive topic for many researchers and in recent decades there has seen a surge in theoretical development and discovery algorithms. Generally discovery algorithms can be divided into two approaches: constraint-based and score-based. The constraint-based approach is able to detect co…
Adaptive learning of SPDE solutions using score-based diffusion models.
problem Model errors and reduced accuracy in SPDE solutions due to incomplete physical knowledge and environmental variability.
method Score-based diffusion models with recursive Bayesian inference, incorporating simulation data and observational information.
result Accuracy and robustness of the proposed method demonstrated on benchmark SPDEs.
New method for generating images with conditional probability models.
problem Generating images with specific conditions.
method Score-based diffusion models with theoretical analysis and new estimator.
result New estimator for conditional score performs similarly to state-of-the-art.
We give a new consistent scoring function for structure learning of Bayesian networks. In contrast to traditional approaches to score-based structure learning, such as BDeu or MDL, the complexity penalty that we propose is data-dependent and is given by the probability that a conditional independence test correctly sho…
In literature there are several studies on the performance of Bayesian network structure learning algorithms. The focus of these studies is almost always the heuristics the learning algorithms are based on, i.e. the maximisation algorithms (in score-based algorithms) or the techniques for learning the dependencies of e…
Paper proposes a QUBO formulation that reduces binary variables in Bayesian network learning.
problem Reducing the number of binary variables in QUBO formulations for Bayesian network learning.
method Proposes a new QUBO formulation that minimizes binary variables.
result Significantly reduces the number of binary variables required for Bayesian network structure learning.
Paper tackles BNSL with IP, improving quality of solutions.
problem Bayesian Network Structure Learning (BNSL) with IP formulations.
method Inexact column generation using difference-of-submodular optimization.
result Improved solutions quality compared to state-of-the-art approaches.
New algorithm speeds up learning of graphical models.
problem Learning graphical models with sparse structure efficiently.
method Vertex-greedy score-based algorithm for learning DAGs.
result Polynomial runtime for learning DAG models.
New framework for dynamic causal graph modeling and effect estimation.
problem Dynamic changes in causal relationships over time.
method Score-based causal discovery with autoregressive model structure.
result Dynamic causal graph with time-varying causal relations.
Paper adapts DDPM to low-dimensional structures in image distributions.
problem Understanding and adapting to low-dimensional structures in image distributions.
method Developed a novel set of analysis tools to characterize algorithmic dynamics.
result First theoretical demonstration that DDPM can adapt to unknown low-dimensional structures.
Maximum likelihood training improves the performance of score-based diffusion models.
problem Training score-based diffusion models with maximum likelihood.
method Trained by minimizing a weighted combination of score matching losses, with a specific weighting scheme that bounds negative log-likelihood.
result Maximum likelihood training improves the log-likelihood of score-based diffusion models across multiple datasets.
New method for data assimilation using score-based models.
problem Bayesian inverse problem of identifying plausible state trajectories.
method Score-based data assimilation, learning a score-based generative model of state trajectories.
result Effective method for zero-shot observation scenarios.
SSDMs generate quantum states directly, outperforming classical methods.
problem Generating pure-state quantum representations efficiently.
method Score-based generative model on complex projective manifold.
result SSDMs match target pure-state ensembles by orders of magnitude.
A new method improves density ratio estimation with fewer function evaluations.
problem Stable and accurate estimation of density ratios with high variance issues.
method Diffusion Secant Alignment for Score-Based Density Ratio Estimation (ISA-DRE)
result ISA-DRE achieves comparable or superior results with fewer function evaluations.
bnlearn is an R package which includes several algorithms for learning the structure of Bayesian networks with either discrete or continuous variables. Both constraint-based and score-based algorithms are implemented, and can use the functionality provided by the snow package to improve their performance via parallel c…
Graph Neural Network improves causal inference in dynamic systems.
problem Identifying causal relations among multi-variate time series.
method Graph Neural Network approach with score-based method.
result Graph Neural Network significantly outperformed other methods in dynamic Bayesian network inference.
Unified model for prediction and deferral selects top-k entities efficiently.
problem Efficiently selecting top-k entities for deferral in machine learning.
method One-stage Top-k Learning-to-Defer framework with a convex surrogate. result Unified model achieves superior accuracy-cost trade-offs.
Paper introduces new loss functions for multi-class abstention learning.
problem Learning with multi-class classification and the ability to abstain.
method Developed new families of surrogate losses for abstention.
result Proved strong consistency guarantees for new surrogate losses.
DCRL learns causal relationships from mixed-type discrete data.
problem Challenges in learning causal relationships from discrete, mixed-type data.
method Generative framework modeling directed acyclic graph and sparse bipartite graph, flexible measurement models for different types of data.
result Consistent recovery of latent causal structure from observed data distribution.
Analyzes how class imbalance and heterogeneity affect diffusion model learning dynamics.
problem Understanding how class imbalance and heterogeneity impact the learning dynamics of diffusion models.
method Developed a high-dimensional analytical framework to study class-dependent learning in score-based diffusion models.
result Class variance is the primary determinant of learning order, favoring higher-variance classes; centroid geometry plays a secondary role.
Proposes MSS to identify causal structure from heterogeneous environments.
problem Distribution shifts between environments violate i.i.d. data assumption.
method Sparse mechanism shift hypothesis, score-based approach.
result Identifies entire causal structure with high probability.
Neural network learns causal graph structure from data.
problem Inferring causal graph structure from observational and interventional data.
method Supervised training of a neural network on synthetic graphs.
result Learned model generalizes to new graphs, robust to distribution shifts, and outperforms existing methods.
New methods learn DAGs from noisy data, adapting to noise levels.
problem Inferring causal relationships from observational data with noise and confounding.
method Reformulate DAG learning as a continuous optimization problem over adjacency matrices, jointly inferring structure and noise levels.
result Improved robustness to heteroscedasticity and distribution shifts.