Proposes a new algorithm for learning continuous-time Bayesian network structures.
problem Lack of constraint-based algorithms for continuous-time Bayesian networks.
method Develops a constraint-based algorithm using statistical tests for conditional independence.
result The proposed algorithm is more accurate with variables having more than two values.
The paper defines conditions for learning causal graphs from data with unobserved variables.
problem Learning causal graphs from data with unobserved variables.
method Formalizes constraint-based structure learning algorithms under conditions and assumptions.
result Natural family of algorithms output Markov equivalent graphs to the causal graph under faithfulness assumption.
Constraint-based algorithms often perform worse in terms of accuracy but not speed compared to score-based algorithms.
problem Comparing the performance of constraint-based, score-based, and hybrid algorithms in learning Bayesian network structures.
method Comparison of algorithms using simulated and real-world data, focusing on accuracy and speed.
result Constraint-based algorithms are often less accurate than score-based algorithms but not significantly faster.
A new method reduces CI tests for causal structure learning.
problem Exponential CI tests in constraint-based methods.
method Recursive Markov boundary-based approach.
result Significantly reduces CI tests compared to existing methods.
New method combines gradient optimization with constraint-based techniques for causal discovery.
problem Causal discovery from observational data, especially with small sample sizes.
method Differentiable d-separation scores using percolation theory and soft logic for gradient-based optimization of conditional independence constraints. result Empirical evaluations show robust performance in low-sample regimes, surpassing traditional methods.
Bayesian structure learning for high-dimensional data using recursive bootstrap.
problem Bayesian structure learning for domains with hundreds of variables.
method Non-parametric bootstrap, recursive structure learning, combining bootstrap with constraint-based learning.
result The proposed method learns better MAP models and more reliable causal relationships than other state-of-the-art methods.
Method learns Markov networks from continuous data without distributional assumptions.
problem Learning Markov network structures for continuous data without distributional assumptions.
method Combines non-parametric mutual information estimator with constraint-based algorithm for learning graph structure.
result Shows superior structure learning accuracy compared to competing methods on synthetic data with non-linear dependencies.
New algorithm reduces conditional independence tests needed for causal discovery.
problem Efficiently infer causal relations from observational data.
method Established an algorithm with complexity pO(s) tests. result Achieves exponent-optimality up to a logarithmic factor in terms of conditional independence tests.
A new hybrid method learns Bayesian network structures more efficiently.
problem Challenging to learn Bayesian network structures due to vast possibilities and acyclicity constraints.
method Synthesises constraint-based and score/search approaches in a novel hybrid method.
result Offers markedly superior performance in learning and sampling Bayesian network structures.
Bayesian method estimates dynamics from near-optimal trajectories.
problem Estimating dynamics from near-optimal expert trajectories in reinforcement learning.
method Constraint-based Bayesian approach integrating expert near-optimality.
result Significant improvements in decision-making and transfer success.
LP algorithm optimizes neural networks with architectural constraints.
problem Training neural networks with specific architectural constraints.
method Lagrangian optimization and saddle point search in adjoint space.
result LP algorithm is fully parallelizable and feasible for training deep networks.
The study learns causal graphs from time series data using entropy measures.
problem Learning causal graphs from time series data.
method Constraint-based framework, information-theoretic measures, generalized causation entropy, PC and FCI algorithms.
result The methods effectively construct causal graphs from time series data.
New concept of illiquidity linked to credit risk, using Jarrow & Turnbull's analogy.
problem Understanding illiquidity in financial markets, especially with credit risk.
method Introduces a constraint-based notion of illiquidity, using Jarrow & Turnbull's foreign exchange analogy.
result A new mathematical framework for understanding illiquidity in financial markets.
Survey of integrating domain knowledge into DL models.
problem Improving DL model performance with limited data or complex functions.
method Five categories of approaches to inject domain knowledge into DL models.
result Survey identifies five main categories of approaches.
A new algorithm for robust causal discovery in small sample sizes.
problem Limited data leads to weak conditional independence tests in causal discovery.
method Proposes a k-PC algorithm that bounds conditioning set size for robust causal discovery. result The k-PC algorithm enables more robust causal discovery in small sample sizes. Constraint-based (CB) learning is a formalism for learning a causal network with a database D by performing a series of conditional-independence tests to infer structural information. This paper considers a new test of independence that combines ideas from Bayesian learning, Bayesian network inference, and classical hy…
DiCoLa recursively decomposes causal structure learning for latent variables.
problem Learning causal structures in high-dimensional settings with latent variables.
method Recursive decomposition framework for divide-and-conquer causal discovery.
result Theoretical soundness and completeness of DiCoLa framework.
This paper deals with chain graphs under the alternative Andersson-Madigan-Perlman (AMP) interpretation. In particular, we present a constraint based algorithm for learning an AMP chain graph a given probability distribution is faithful to. We also show that the extension of Meek's conjecture to AMP chain graphs does n…
Framework for causal discovery from changing data.
problem Challenges of causal discovery in heterogeneous or nonstationary data.
method Constraint-based CD-NOD framework for causal skeleton and orientation recovery, independent changes detection.
result Efficient estimation of causal mechanism changes and low-dimensional representation of nonstationarity.
bnlearn is an R package which includes several algorithms for learning the structure of Bayesian networks with either discrete or continuous variables. Both constraint-based and score-based algorithms are implemented, and can use the functionality provided by the snow package to improve their performance via parallel c…
Scalable method learns context-specific models for hundreds of variables.
problem Learning context-specific models for large numbers of variables.
method Order-based Markov chain Monte-Carlo search with context-specific sparsity assumption.
result Method scales to hundreds of variables and learns accurate models.
Paper presents new algorithms for causal discovery with latent variables and overlapping datasets.
problem Causal discovery with latent variables and overlapping datasets.
method Introduces tiered FCI and tIOD algorithms for constraint-based causal discovery.
result The tIOD algorithm is more efficient and informative than the IOD algorithm.
We consider constraint-based methods for causal structure learning, such as the PC-, FCI-, RFCI- and CCD- algorithms (Spirtes et al. (2000, 1993), Richardson (1996), Colombo et al. (2012), Claassen et al. (2013)). The first step of all these algorithms consists of the PC-algorithm. This algorithm is known to be order-d…
This work integrates domain knowledge into A*-based causal discovery methods.
problem Efficiently incorporating domain knowledge into A*-based causal discovery methods.
method Integrates various types of domain knowledge into A*-based causal discovery methods, reducing the graph search space and improving computational gains.
result Small amounts of domain knowledge can dramatically speed up A*-based causal discovery and improve its performance and practicality.
We extend common entropy concept and propose algorithms to distinguish causation from correlation.
problem Discovering the simplest latent variable for conditional independence of observed variables.
method Renyi common entropy, iterative algorithm, constraint-based methods modification.
result Improved constraint-based methods for causal inference in small samples.
This paper deals with chain graphs under the Andersson-Madigan-Perlman (AMP) interpretation. In particular, we present a constraint based algorithm for learning an AMP chain graph a given probability distribution is faithful to. Moreover, we show that the extension of Meek's conjecture to AMP chain graphs does not hold…
New method for identifying causal relationships in financial time series data.
problem Identifying causal relationships in nonstationary financial time series data.
method Refined constraint-based causal discovery algorithm (CD-NOTS) for nonstationary time series data.
result CD-NOTS effectively identifies causal connections in financial applications.
CCI algorithm handles cycles, latent variables, and selection bias in causal discovery.
problem Cycles, latent variables, and selection bias in causal processes.
method CCI algorithm using a conditional independence oracle for cyclic, latent, and selection bias cases.
result CCI outperforms existing algorithms in cyclic cases and rivals them in acyclic cases.
New method for estimating local structure around target nodes in DAGs.
problem Challenges in learning causal DAG structures in high-dimensional settings.
method Constraint-based method for estimating local structure around multiple target nodes.
result Consistency results for estimating local neighborhood structure of target nodes.
In literature there are several studies on the performance of Bayesian network structure learning algorithms. The focus of these studies is almost always the heuristics the learning algorithms are based on, i.e. the maximisation algorithms (in score-based algorithms) or the techniques for learning the dependencies of e…
Study improves causal model discovery by relaxing assumptions for latent variables.
problem Discovering causal models with latent variables under weaker assumptions.
method Uses Answer Set Programming to discover semi-Markovian causal models with weakened Faithfulness assumption.
result Weakened Faithfulness assumption preserves power and speeds up discovery for causal models with latent variables.
Cluster-DAGs improve causal discovery with prior knowledge.
problem Finding cause-effect relationships from high-dimensional data.
method Cluster-DAGs as prior knowledge framework, modified constraint-based algorithms Cluster-PC and Cluster-FCI.
result Cluster-PC and Cluster-FCI outperform baselines without prior knowledge.
New method tests causal relationships from data without needing to learn the entire graph.
problem Testing if a causal graph belongs to a specific Markov equivalence class from observational data.
method Established bounds on the number of independence tests required and provided an algorithm that matches these bounds.
result Testing requires exponentially less independence tests compared to learning, especially in graphs with high in-degrees and small clique sizes.
New method identifies causal structure in exchangeable data.
problem Existing causal discovery methods struggle with i.i.d. data.
method Exchangeable data provides richer conditional independence structure.
result Exchangeable data allows for unique causal structure identification.
New score-based methods identify causal structures with latent variables.
problem Identifying causal structures involving latent variables.
method Score-based methods with identifiability guarantees.
result Score equivalence and consistency for latent variable causal models.
Proposes ConstraintMatch for semi-supervised clustering with unconstrained data.
problem Leveraging unconstrained data alongside constraints for clustering models.
method Semi-supervised context with pseudo-constraining and pseudo-labeling mechanisms.
result Demonstrates effectiveness of ConstraintMatch over baselines.
Discovering causal relationships from data is the ultimate goal of many research areas. Constraint based causal exploration algorithms, such as PC, FCI, RFCI, PC-simple, IDA and Joint-IDA have achieved significant progress and have many applications. A common problem with these methods is the high computational complex…
Paper proposes a new framework for semi-supervised learning.
problem Limited annotated data in supervised learning.
method Fuzzy domain constraint-based framework for semi-supervised learning.
result Enhances model quality for semi-supervised learning.
Deep learning methods have recently made notable advances in the tasks of classification and representation learning. These tasks are important for brain imaging and neuroscience discovery, making the methods attractive for porting to a neuroimager's toolbox. Success of these methods is, in part, explained by the flexi…
Optimal algorithms learn Gaussian trees and polytrees from data.
problem Learning undirected Gaussian trees and polytrees from data.
method Two approaches: Chow-Liu algorithm for tree structure and modified PC algorithm for polytree structure.
result Explicit finite-sample guarantees and matching lower bounds for both approaches.
A new algorithm infers causal networks from data using topological thresholds.
problem Inferring causal networks from data.
method Two methods for determining topological thresholds: one to leave no disconnected nodes, the other to find a causal large connected component.
result The novel algorithm is faster and more accurate than the PC algorithm.
New algorithm uncovers causal relations in non-stationary time series.
problem Discovering causal relations from non-stationary time series data.
method Constraint-based, non-parametric algorithm for semi-stationary time series.
result Algorithm PCMCIΩ identifies causal graph with CI tests. The paper tackles hierarchical clustering with structural constraints, providing approximation guarantees and improving upon current techniques.
problem Exploiting prior information in hierarchical clustering for real-world applications.
method Top-down algorithms with provable approximation guarantees, using optimization viewpoint and constraint-based regularization.
result Improved solutions for hierarchical clustering with conflicting prior information.
New method trains neural nets without loss functions.
problem Training neural networks efficiently and without loss functions.
method Optimizer RRR derives steps from projections to local constraints, not gradients.
result Success in phase retrieval and neural networks, with novel partitioning of projections.
Paper tackles estimating individual treatment effects from observational data.
problem Estimating the difference between outcomes with and without treatment from single observation.
method Formulated as inference from hidden variables, uses a model of four causal populations, proposes ECM algorithm.
result ECM algorithm provides better performance compared to baseline methods on synthetic and real-world data.
Learning a Bayesian network structure from data is an NP-hard problem and thus exact algorithms are feasible only for small data sets. Therefore, network structures for larger networks are usually learned with various heuristics. Another approach to scaling up the structure learning is local learning. In local learning…
Fast nonparametric conditional independence testing via two-stage regression
problem Fast nonparametric conditional independence testing
method BLITZ (Broad-to-Local Independence Testing via residualiZation)
result Better null calibration than fast kernel, random-feature, and regression-based competitors
Two ML approaches learn local volatility surfaces from option prices, with GP being arbitrage-free.
problem Interpolating European vanilla option prices to create a local volatility surface.
method Gaussian process regression and neural net with arbitrage penalties.
result GP approach is arbitrage-free and yields best out-of-sample calibration error.