ZSL-KG learns class representations from common sense knowledge graphs.
problem Predicting classes without labeled examples using semantic class representations.
method TrGCN, a novel transformer graph convolutional network, embeds nodes from common sense knowledge graphs in a vector space.
result ZSL-KG improves over existing methods on five out of six zero-shot benchmark datasets.
Bayesian optimization improves performance with common random numbers.
problem Optimizing expensive stochastic functions with common random numbers.
method Proposes a novel Gaussian process model and Knowledge Gradient for Common Random Numbers.
result Significant performance improvements with moderate computational cost.
System helps engineers with concept recognition for SEVA.
problem Recognizing systems engineering concepts for SEVA.
method Token classification task, domain expert labeling, pre-trained model fine-tuning, essential datasets creation, knowledge graph construction.
result System successfully recognizes systems engineering concepts.
Improved GCNNs tackle noisy knowledge graphs for better link prediction.
problem Link prediction on noisy biomedical knowledge graphs.
method Regularized attention mechanism for GCNNs, interpretable visualization methods.
result Improved performance on noisy datasets, automated denoising potential.
New framework tackles adversarial classification problems.
problem Security classification problems with adversaries.
method Adversarial risk analysis approach.
result Illustrated with examples and discussed computational issues.
Neural story generation gains common sense through targeted training.
problem Lack of common sense reasoning in neural-generated stories.
method Multi-task learning with auxiliary datasets for common sense grounding.
result Improved common sense reasoning and state-of-the-art perplexity.
Paper learns a versatile model from diverse networks without annotations.
problem Combining knowledge from different specialized networks without access to their training data.
method Transforms features of diverse networks into a common space and forces a student model to mimic them.
result The student model outperforms individual teacher models on various benchmarks.
A new personality-based recommender system tackles data sparsity without feedback.
problem Data sparsity without common feedback among users.
method Implicitly identifying users' personality type and incorporating it with personal interests and knowledge level.
result The model's effectiveness, especially in data sparsity situations, demonstrated on a real-world dataset.
Recent research in psycholinguistics has provided increasing evidence that humans predict upcoming content. Prediction also affects perception and might be a key to robustness in human language processing. In this paper, we investigate the factors that affect human prediction by building a computational model that can …
Knowledge graph construction consists of two tasks: extracting information from external resources (knowledge population) and inferring missing information through a statistical analysis on the extracted information (knowledge completion). In many cases, insufficient external resources in the knowledge population hinde…
Minimal domain knowledge used for malware detection with neural networks.
problem Malware detection without explicit feature construction.
method Restricting domain knowledge to extract PE header features and using neural networks.
result Neural networks can learn from raw bytes and perform better than explicit feature approaches.
Framework evaluates the impact of prior knowledge in deep learning models.
problem Mitigating data-driven model shortcomings like data dependence and generalization ability.
method Model-agnostic framework inspired by interpretable machine learning, assessing data volume and estimation range effects.
result Complex relationship between data and knowledge, including dependence, synergistic, and substitution effects.
Method finds motifs in knowledge graphs, revealing their structure.
problem Identifying meaningful subunits in knowledge graphs.
method Inspired by simple graphs, the approach uses compression techniques to find motifs.
result Motifs found reflect the basic structure of the graph.
This paper improves speech recognition by distilling knowledge from acoustic models.
problem Improving speech recognition accuracy using ensemble models.
method Proposes multi-teacher distillation strategies for joint CTC-attention end-to-end ASR systems, integrating error rate metric for optimization.
result Reports state-of-the-art error rates on various datasets and languages.
Bayesian neural networks improve knowledge sharing across networks.
problem Improving knowledge sharing between neural networks.
method Application of Bayesian interpretations to neural networks for feature sharing.
result Enhanced feature sharing across networks.
Bayesian method transfers knowledge between brain tumor datasets.
problem Applying deep learning to small medical datasets.
method Generative Bayesian Prior network for knowledge transfer.
result Best results in Dice Similarity Coefficient for BRATS2018.
Bayesian method transfers knowledge between brain tumor datasets for MRI segmentation.
problem Limited applicability of deep learning methods for small medical datasets.
method Generative Bayesian Prior network for knowledge transfer.
result Best results in Dice Similarity Coefficient metric for BRATS2018.
Study shows LLMs can remove half of layers without significant performance drop.
problem Understanding knowledge storage in LLMs' weights.
method Layer pruning and finetuning to identify and remove unnecessary parameters.
result Minimal degradation of performance after removing up to half of layers.
There is a significant literature on methods for incorporating knowledge into multiple testing procedures so as to improve their power and precision. Some common forms of prior knowledge include (a) beliefs about which hypotheses are null, modeled by non-uniform prior weights; (b) differing importances of hypotheses, m…
Induction of common sense knowledge about prototypical sequences of events has recently received much attention. Instead of inducing this knowledge in the form of graphs, as in much of the previous work, in our method, distributed representations of event realizations are computed based on distributed representations o…
Models learn spatial templates from implicit language, predicting spatial arrangements with high accuracy.
problem Predicting spatial arrangements from implicit spatial language.
method Simple neural-based models leveraging annotated images and structured text.
result Models can predict spatial arrangements from implicit spatial language with high accuracy, even for unseen objects.
New method predicts target genres from source genres, unifying music tag systems.
problem Automatic genre inference fails to handle music genre diversity and subjectivity.
method Knowledge-based, statistical, and hybrid translation models.
result Hybrid translation model is most effective for multilabel classification.
The paper provides fast, sample-efficient algorithms for learning common features in multi-task linear regression.
problem Learning transferable features from multiple related tasks.
method Provably fast, sample-efficient algorithms for multi-task linear regression.
result Theoretical guarantees on sample complexity for learning common features.
Proposes a method to identify causal relationships using background knowledge.
problem Identifying causal relationships in the presence of background knowledge.
method Learning local structure using all types of causal background knowledge (direct, non-ancestral, ancestral). Criteria for identifying causal relationships based on local structure.
result Effective and efficient method for local structure learning and causal relationship identification.
New approach combines multi-view learning for improved convergence in knowledge transfer.
problem Improving convergence in knowledge transfer settings like learning with privileged information and distillation.
method Adopting a multi-view approach under reasonable assumptions about hypothesis spaces, encouraging agreement between teacher and student.
result Improved convergence rate achieved with regularized empirical risk minimization.
MetaR learns few-shot link prediction in KGs by transferring relation-specific meta info.
problem Few-shot link prediction in KGs with limited associative triples.
method MetaR framework focusing on transferring relation-specific meta information.
result MetaR achieves state-of-the-art results on few-shot link prediction benchmarks.
HAKE embeds entities in polar coordinates to model semantic hierarchies in knowledge graphs.
problem Lack of modeling semantic hierarchies in knowledge graph embeddings.
method HAKE embeds entities in a polar coordinate system, where the radial coordinate represents hierarchy levels and the angular coordinate distinguishes entities at the same level.
result HAKE significantly outperforms existing methods on link prediction tasks in knowledge graphs.
The incorporation of prior knowledge into learning is essential in achieving good performance based on small noisy samples. Such knowledge is often incorporated through the availability of related data arising from domains and tasks similar to the one of current interest. Ideally one would like to allow both the data f…
A novel fact-checking method using debate dynamics on knowledge graphs.
problem Fact-checking on knowledge graphs with user comprehension and interactive reasoning.
method Reinforcement learning agents debate on paths in the graph to classify facts as true or false.
result Interactive reasoning and user understanding of AI decisions on knowledge graphs.
DKN uses knowledge graphs to improve news recommendation.
problem Limited personalized news recommendations due to lack of external knowledge.
method Integrates knowledge graph representation into news recommendation using a deep knowledge-aware network (DKN).
result DKN achieves substantial gains over state-of-the-art models in click-through rate prediction.
This paper introduces a new reward shaping method for average-reward reinforcement learning.
problem Speeding up convergence to an optimal policy in average-reward reinforcement learning tasks.
method Developed a temporal logic-based approach to automatically generate reward shaping functions.
result The optimal policy can be recovered using the proposed reward shaping framework.
Framework adds human knowledge to AI decisions to improve outcomes.
problem Conflict between AI recommendations and human insights.
method Develops a framework for integrating human knowledge as a guardrail for AI decisions.
result Human knowledge can improve AI decisions, especially in specific pitfalls.
Role-wise data augmentation improves knowledge distillation effectiveness.
problem Existing knowledge distillation methods fail to utilize the full potential of teacher-student data interaction.
method Design and implement data augmentation agents with distinct roles for teacher and student.
result Specially tailored data points enhance the demonstration of teacher's knowledge to the student.
Unified framework for multi-source data analysis improves network structure identification.
problem High dimensionality and heterogeneity in large-scale network data.
method msLBM framework combining multiple data sources for simultaneous grouping and connectivity analysis.
result Statistically optimal rates achieved for consensus knowledge graph learning.
Paper presents a technique using Spearman's Rank Correlation Coefficient for KE in TDs.
problem Extracting common characteristics and grouping similar TDs.
method Spearman's Rank Correlation Coefficient (SRCC) for KE.
result SRCC proves a comprehensive measure for high-quality KE.
A common assumption in financial engineering is that the market price for any derivative coincides with an objectively defined risk-neutral price - a plausible assumption only if traders collectively possess objective knowledge about the price dynamics of the underlying security over short time scales. Here we assume t…
A new method for optimizing black-box problems with constraints.
problem Optimizing black-box systems with multiple performance criteria and constraints.
method Developed a novel constrained Bayesian optimization approach based on the knowledge gradient method.
result A new acquisition function that balances optimality and feasibility.
Combines expert knowledge and data for efficient probability distribution inference.
problem Inferring discrete probability distributions using limited data and expert knowledge.
method A novel estimator that weights expert knowledge and empirical data.
result The proposed estimator is always more efficient than either expert or data alone.
Developed LQ MFG theory with common noise, proving existence and uniqueness.
problem Linear-quadratic mean field games with common noise.
method Coupled forward-backward stochastic evolution equations (FBSEEs) in Hilbert spaces.
result Existence and uniqueness of solutions for small and arbitrary finite time horizons.
Spatial information is not always necessary for spatio-temporal models.
problem The necessity of including spatial information in spatio-temporal models.
method Comparison of spatial agnostic neural networks with state-of-the-art models on ten datasets.
result Spatial information is not always needed in most spatio-temporal models.
Enhances machine learning with background knowledge through feature generation.
problem Machine learning struggles with small datasets.
method Generates features from auxiliary datasets not similar to the original task.
result Significant improvement in various learning tasks.
New method models multi-view noise as Mixture of Gaussians for robust MSL.
problem Robust multi-view subspace learning with complex noise.
method Model multi-view noise as Mixture of Gaussians, regularize across views.
result Method outperforms existing models in robustness and interpretability.
Enhancing spectral embedding for low-dimensional embeddings in rare disease cohorts
problem Representing clinical concepts and patients in electronic health records
method Spectral-based unsupervised learning with flexible knowledge transfer
result Outperforms competing approaches in challenging scenarios
This paper extracts topic-specific subgraphs from Wikidata for easier research.
problem Time-consuming and task-specific tuning in using Wikidata for graph processing.
method Unified framework to extract topic-specific subgraphs from Wikidata.
result Standardized sub-graphs for easier evaluation of graph processing algorithms.
Research examines how Islamic banking principles spread among managers and scholars.
problem Diffusion of Islamic banking principles among managers and scholars.
method Literature review focusing on knowledge diffusion and Islamic banking governance principles.
result Emergence of common Islamic banking governance principles from diverse knowledge streams.
DASH simplifies neural networks for gene regulatory dynamics using domain knowledge.
problem Pruning neural networks for gene regulatory dynamics lacks biologically meaningful structure learning.
method DASH uses domain-specific structural information to guide network pruning, leading to sparser, better interpretable models.
result DASH outperforms general pruning methods in gene regulatory network inference, yielding deeper insights.
MetaNOR learns common nonlocal kernels for efficient metamaterial modeling.
problem Efficiently modeling wave propagation in new metamaterials.
method Meta-learns a common nonlocal kernel from existing tasks and transfers this knowledge to new tasks with minimal data.
result Substantial improvements in sampling efficiency for new metamaterials.
SRL+CS improves deep RL by incorporating common sense, achieving near perfect zero-shot transfer.
problem Lack of transfer learning, abstraction, and interpretability in deep RL.
method Proposes SRL+CS, a novel extension of DSRL that balances generalization and specialization using principles of common sense.
result SRL+CS learns faster and achieves higher accuracy, including near perfect zero-shot transfer in a random environment.