b-LOAD extends local causal discovery with prior knowledge, improving causal effect estimation.
problem Local causal discovery struggles in data-scarce settings due to uncertainty and incomplete neighborhoods.
method b-LOAD incorporates prior knowledge directly into local structure learning, using Meek's rules to refine discovery.
result b-LOAD refines the admissible equivalence class and enlarges identifiable causal queries, improving causal effect estimation.
This work benchmarks neural embeddings for link prediction in evolving knowledge graphs.
problem Evaluating the robustness of neural embeddings in changing knowledge graphs.
method Proposes an open-source evaluation pipeline using relation-centric connectivity measures.
result Demonstrates the importance of simulating embedding accuracy for frequently updated knowledge graphs.
Proposes a method to identify causal relationships using background knowledge.
problem Identifying causal relationships in the presence of background knowledge.
method Learning local structure using all types of causal background knowledge (direct, non-ancestral, ancestral). Criteria for identifying causal relationships based on local structure.
result Effective and efficient method for local structure learning and causal relationship identification.
In order to learn quickly with few samples, meta-learning utilizes prior knowledge learned from previous tasks. However, a critical challenge in meta-learning is task uncertainty and heterogeneity, which can not be handled via globally sharing knowledge among tasks. In this paper, based on gradient-based meta-learning,…
Knowledge graph construction consists of two tasks: extracting information from external resources (knowledge population) and inferring missing information through a statistical analysis on the extracted information (knowledge completion). In many cases, insufficient external resources in the knowledge population hinde…
The study categorizes knowledge graph relations and explains their embedding representations.
problem Understanding how knowledge graph relation representations capture semantic information.
method Categorizing knowledge graph relations into three types and deriving explicit requirements for their representations.
result Empirical properties of relation representations and the performance of methods are justified by the analysis.
Adaptive learning, also known as adaptive teaching, relies on learning path recommendation, which sequentially recommends personalized learning items (e.g., lectures, exercises) to satisfy the unique needs of each learner. Although it is well known that modeling the cognitive structure including knowledge level of lear…
Machine learning refactors knowledge to improve learning efficiency.
problem Inductive program synthesis efficiency through knowledge restructuring.
method Introduces Knorf, a system that refactors knowledge bases using constraint optimization.
result Learning from refactored knowledge improves predictive accuracy fourfold and reduces learning time by half.
PSI-KT improves KT accuracy and interpretability in learning materials.
problem Optimizing learning materials selection and timing for understanding and retention.
method Hierarchical generative approach using Bayesian inference.
result Superior multi-step predictive accuracy and scalable inference.
A new algorithm discovers causal factors between T2DM and bone mineral density.
problem Discovering causal factors between T2DM and bone mineral density from clinical data.
method Prior-Knowledge-driven local Causal structure Learning (PKCL) algorithm.
result PKCL achieves more reliable results without long-standing medical experiments.
Method finds motifs in knowledge graphs, revealing their structure.
problem Identifying meaningful subunits in knowledge graphs.
method Inspired by simple graphs, the approach uses compression techniques to find motifs.
result Motifs found reflect the basic structure of the graph.
The paper proposes a method to transfer knowledge across different settings using causal theory.
problem Learning transfer across similar but different settings.
method Bayesian perspective of causal theory induction, integrating instance-level associative learning and abstract-level structural causal knowledge.
result The proposed model achieved transfer behavior across trials and learning situations, unlike RL algorithms.
Hybrid model learns novel handwritten characters better than neural or symbolic models alone.
problem Generating novel yet structured concepts.
method Neuro-symbolic model combining neural networks and probabilistic programs.
result Hybrid model outperforms alternative models in learning and generalizing novel handwritten characters.
New framework uses background knowledge to speed up causal discovery.
problem Scalable causal discovery for large datasets.
method Utilizes background knowledge during causal discovery process.
result Background knowledge reduces computational requirements and improves structure quality.
ARML learns task relations to improve meta-learning efficiency.
problem Handling task heterogeneity in meta-learning.
method Automatically extracts cross-task relations and constructs a meta-knowledge graph.
result ARML outperforms state-of-the-art baselines in few-shot learning tasks.
Develops a simulation-based method to translate expert knowledge into prior distributions for Bayesian models.
problem Effective incorporation of expert knowledge into prior distributions for diverse model structures.
method Simulation-based stochastic gradient descent to learn hyperparameters of parametric priors from expert knowledge.
result Method is adaptable to various elicitation techniques and independent of model structure.
Proposes a method to derive knowledge graphs from EHR data.
problem Challenges in deriving generalizable knowledge from EHR data.
method Infer conditional dependency structure via a latent graphical block model (LGBM).
result Perfect recovery of block structure demonstrated.
Two methods factor out prior knowledge from low-dimensional embeddings.
problem Visualizing data without considering background knowledge.
method JEDI for tSNE and CONFETTI for any embedding.
result Embeddings reveal meaningful structure hidden by prior knowledge.
TXtract extracts structured knowledge from thousands of product categories.
problem Extracting structured knowledge from diverse product categories in e-commerce.
method TXtract uses a taxonomy-aware model with category conditional self-attention and multi-task learning.
result TXtract outperforms state-of-the-art approaches by up to 10% in F1 and 15% in coverage across all categories.
The paper tackles adaptive targeting in networks with interference effects.
problem Adaptive targeting under network interference in a bandit setting.
method Linear model in a sparse regime, analyzing different levels of knowledge of the interference structure.
result Unified view of how knowledge of the interference structure affects online learning efficiency.
New model of vague knowledge without strict partitions or transitivity.
problem Standard economic models of information fail to capture real-world vague knowledge.
method Relaxing assumptions of transitivity and partition structure to formalize vague knowledge.
result Vague knowledge can distinguish some states but not partition the state space.
Knowledge graphs are a versatile framework to encode richly structured data relationships, but it can be challenging to combine these graphs with unstructured data. Methods for retrofitting pre-trained entity representations to the structure of a knowledge graph typically assume that entities are embedded in a connecte…
The paper explores how to apply causal knowledge across different datasets to improve learning.
problem How to apply causal knowledge across different datasets to improve learning.
method Investigates the structural causal bandit with transportability, fusing priors from source environments to enhance learning in the deployment setting.
result Achieves a sub-linear regret bound with an explicit dependence on informativeness of prior data, potentially outperforming standard bandit approaches.
MoleculeSTM learns from molecule structures and texts for better drug design.
problem Lack of integration between chemical structures and textual knowledge in AI drug discovery.
method Jointly learns chemical structures and texts via contrastive learning, using a large dataset.
result MoleculeSTM achieves state-of-the-art performance in zero-shot tasks like structure-text retrieval and molecule editing.
SANS uses graph structure to find meaningful negatives for entity and relation embeddings.
problem Finding hard negatives for entity and relation embeddings in knowledge graphs.
method Structure Aware Negative Sampling (SANS) that selects negatives from a node's k-hop neighborhood.
result SANS finds semantically meaningful negatives and is competitive with state-of-the-art approaches.
Robust PCA, the problem of PCA in the presence of outliers has been extensively investigated in the last few years. Here we focus on Robust PCA in the outlier model where each column of the data matrix is either an inlier or an outlier. Most of the existing methods for this model assumes either the knowledge of the dim…
Method learns relational features for Gaifman models from knowledge bases.
problem Structure learning for Gaifman models.
method Relational tree distances to learn relational features.
result Empirical evaluation shows superiority over classical rule-learning.
A central problem to understanding intelligence is the concept of generalisation. This allows previously learnt structure to be exploited to solve tasks in novel situations differing in their particularities. We take inspiration from neuroscience, specifically the hippocampal-entorhinal system known to be important for…
New probabilistic approaches offer recourse recommendations even when causal models are imperfect.
problem Limited causal knowledge makes guaranteeing algorithmic recourse impossible.
method Two probabilistic approaches: Bayesian model averaging and average effect computation.
result Probabilistic approaches lead to more reliable recourse recommendations.
Survey of methods to incorporate external knowledge into stock price prediction.
problem Challenges in predicting stock prices due to market volatility and non-linearity.
method Survey of methods for acquiring and incorporating external knowledge into stock price prediction models.
result Systematic synthesis of previous studies on external knowledge types and their application in stock price prediction.
Path queries on a knowledge graph can be used to answer compositional questions such as "What languages are spoken by people living in Lisbon?". However, knowledge graphs often have missing facts (edges) which disrupts path queries. Recent models for knowledge base completion impute missing facts by embedding knowledge…
New algorithm improves causal discovery in biomedical data.
problem Stability and accuracy issues in causal discovery algorithms.
method Exploits temporal structure and tiered background knowledge.
result Increases accuracy in finite samples for causal structure estimation.
Recently, deep models have had considerable success in several tasks, especially with low-level representations. However, effective learning from sparse noisy samples is a major challenge in most deep models, especially in domains with structured representations. Inspired by the proven success of human guided machine l…
New method improves knowledge transfer from large to small networks.
problem Improving knowledge transfer from large to small neural networks.
method Contrastive learning to capture more structural knowledge.
result Contrastive learning outperforms knowledge distillation on various transfer tasks.
Semantic TrueLearn uses semantic graphs to improve educational recommendation systems.
problem Challenges in handling semantic and hierarchical structure in knowledge areas.
method Introduces a novel learner model that exploits semantic relatedness between knowledge components using a Wikipedia link graph.
result Achieves statistically significant improvements in predictive performance for educational engagement.
Enhances generative model accuracy through knowledge transfer.
problem Improving generative model precision across different tasks.
method Introduces a novel framework for transfer learning using shared structures.
result Demonstrates enhanced performance in diffusion and normalizing flows models.
Graph representation learning improves with domain knowledge.
problem Efficiently learning graph representations from scarce labels.
method Multi-task knowledge distillation combining graph metrics.
result Improves prediction performance, especially with limited training data.
The paper shows how causal knowledge improves model robustness.
problem Improving model robustness in the face of unseen domains.
method Utilizes Structural Causal Models (SCM) to guide model selection based on likelihood of the SCM given predictions and input variables.
result Identifies more robust models that generalize better to unseen domains.
Within Reinforcement Learning, there is a growing collection of research which aims to express all of an agent's knowledge of the world through predictions about sensation, behaviour, and time. This work can be seen not only as a collection of architectural proposals, but also as the beginnings of a theory of machine k…
The broad set of deep generative models (DGMs) has achieved remarkable advances. However, it is often difficult to incorporate rich structured domain knowledge with the end-to-end DGMs. Posterior regularization (PR) offers a principled framework to impose structured constraints on probabilistic models, but has limited …
NTS-NOTEARS learns DBNs from time-series data with prior knowledge.
problem Learning dynamic Bayesian networks from time-series data with nonlinear and lagged relationships.
method Uses 1D CNNs to model DBNs, incorporating prior knowledge as constraints.
result Achieves state-of-the-art DAG structure quality compared to parametric and nonparametric methods.
A zoo of deep nets is available these days for almost any given task, and it is increasingly unclear which net to start with when addressing a new task, or which net to use as an initialization for fine-tuning a new model. To address this issue, in this paper, we develop knowledge flow which moves 'knowledge' from mult…
BOIS optimizes complex systems by leveraging structural knowledge.
problem Optimizing complex systems with black-box models and structural knowledge.
method Adaptive linearization of composite functions to exploit structural knowledge.
result BOIS achieves performance gains and accurately captures composite function statistics.
Paper proposes KE-GCN for better graph embedding.
problem Efficiently leveraging complex graphs with heterogeneous entities and relations.
method Combines GCNs and knowledge embedding methods.
result Advantages in knowledge graph alignment and entity classification.
This paper discovers classification models from sequential data without prior knowledge.
problem Lack of prior knowledge in defining kernels for online classification.
method Adapts GP-based time-series structure discovery with SMC to learn new features from sequential data.
result Improves classification accuracy by 10% on real-world data.
DASH simplifies neural networks for gene regulatory dynamics using domain knowledge.
problem Pruning neural networks for gene regulatory dynamics lacks biologically meaningful structure learning.
method DASH uses domain-specific structural information to guide network pruning, leading to sparser, better interpretable models.
result DASH outperforms general pruning methods in gene regulatory network inference, yielding deeper insights.
MuVI models multi-view data with structured sparsity, integrating domain knowledge.
problem Disentangling variation across multiple data views in complex systems.
method Multi-view latent variable model with structured sparsity using a modified horseshoe prior.
result MuVI outperforms state-of-the-art methods in structured sparsity modeling and integrates noisy domain expertise.
Deep generative models (DGMs) have shown promise in image generation. However, most of the existing work learn the model by simply optimizing a divergence between the marginal distributions of the model and the data, and often fail to capture the rich structures and relations in multi-object images. Human knowledge is …