Industry-specific knowledge boosts pioneer firms' survival and growth.
problem How do regions diversify their economies?
method Measuring industry, occupation, and location-specific knowledge from work histories, using Bartik instruments.
result Industry-specific knowledge is crucial for pioneer firms' survival and growth.
New model uses less site-specific data for accurate hydrologic predictions.
problem Accurate rainfall-runoff modeling in data-poor regions.
method Data-driven learned embedding to replace location-specific attributes.
result Achieves state-of-the-art results with significantly less information.
We apply neuromodulation to deep neural networks to improve learning.
problem Static learning parameters in neural networks limit adaptability.
method Evolved neuromodulatory dynamics modify learning parameters over training.
result Evolution found dynamic, location-specific learning strategies.
Elevating houses to flood risk increases uncertainty, leading to higher optimal elevations.
problem Deciding how high to elevate houses to manage riverine flood risks is complex due to uncertainties.
method Used a multi-objective robust decision-making framework to analyze uncertainties.
result Optimal house elevation can be significantly higher than FEMA's recommendation due to deep uncertainties.
Spatially-aware model improves earthquake hazard assessment accuracy.
problem Misrepresentation of seismic effects across diverse landscapes.
method Causal Bayesian network with Gaussian Processes and normalizing flows.
result Achieves up to 35.2% AUC improvement over existing methods.
Study short-term wind power and speed predictions using machine learning.
problem Accurate short-term wind power and speed predictions for energy systems.
method Combining numerical weather prediction models with local observations, using machine learning for variable selection and forecasting.
result Improved wind power and speed predictions for 4-hour ahead using machine learning.
New PG samplers improve inference in coupled state-space models.
problem Bayesian inference from multiple time series with shared parameters.
method Marginalized Particle Gibbs samplers for coupled state-space models.
result Improved parameter inference through shared information.
Unified framework detects shifts in climate boundaries using GP regression and MAD test.
problem Challenges in quantifying and testing for temporal shifts in spatial boundaries from noisy data.
method Combines heteroskedastic GP regression with scaled MAD GET.
result No significant decade-scale changes in arid and semi-arid interfaces, but localized shifts during extreme droughts identified.
The paper uses Bayesian Surprise to identify unexpected structures in indoor environments.
problem Identifying unexpected structures in indoor environments.
method Bayesian Surprise applied to Isovist Analysis of 2D floor plans.
result Surprise regions in indoor environments can be used to focus on important areas in LBS.
MIP framework improves urban flow prediction by adapting to distribution shifts.
problem Distribution shifts in urban flow data make prediction models unreliable.
method Memory-enhanced Invariant Prompt learning with learnable memory bank.
result MIP ensures robust predictions by focusing on invariant features.
Bayesian model improves traffic prediction with uncertainty estimates.
problem Lack of uncertainty estimates in deep-learning traffic models.
method Proposes a Bayesian recurrent neural network with spectral normalization.
result Spectral normalization improves uncertainty estimates and generalizability.
Framework generates realistic crop images for growth modeling.
problem Modeling crop growth over time with precision and detail.
method Two-stage framework: image prediction and growth estimation models.
result Framework accurately predicts crop images with varying conditions.
Transfer learning improves highway traffic forecasting using graph neural networks.
problem Lack of historical data for traffic forecasting on large highway networks.
method Developed a transfer learning approach for DCRNN, a graph neural network for highway forecasting.
result TL-DCRNN can forecast traffic on unseen regions of the highway network with high accuracy.
Local Gaussian correlation struggles in tails but a new method improves it.
problem Local Gaussian correlation's limitations in tail dependence.
method A new adaptive bandwidth method for LGC, optimizing for local effective sample size.
result Adaptive bandwidths outperform global ones in moderate dependence, but not in strong or weak dependence.
Paper extends knowledge tracing algorithms to infer student knowledge and predict posttest performance.
problem Lack of algorithms that directly infer student knowledge and predict posttest performance.
method Extended DKT and DKVMN to infer knowledge, and applied to BKT and PFA for comparison.
result Knowledge estimates from the extended algorithms correlate better with posttest performance than existing methods.
Survey on robust data representation learning from a knowledge flow perspective.
problem Learning robust visual representation from noisy, incomplete or mismatched data.
method Low-rank modeling for robust knowledge recovery, transfer, and fusion.
result Unified formulation for robust knowledge discovery and transfer/fusion.
Proposes using knowledge graphs to improve probabilistic model estimation.
problem Lack of direct utilization of domain knowledge in regularization methods.
method Knowledge-based distant regularization framework using knowledge graph embeddings.
result Improvement in generalization capability of probabilistic models.
A new framework for knowledge graph embedding using sheaves.
problem Learning representations for entities and relations in knowledge graphs.
method Using cellular sheaves to describe knowledge graph embeddings with consistency constraints.
result A generalized framework for reasoning about knowledge graph embedding models.
Paper analyzes consistency between neural networks at different levels.
problem Understanding knowledge consistency between neural networks.
method Generic definition and task-agnostic method to disentangle consistent knowledge.
result Knowledge consistency provides new insights and can improve network performance.
Tensor-based embeddings improve knowledge graph fact prediction.
problem Predicting new facts in knowledge graphs.
method Knowledge-Enriched Tensor Factorization
result 5% to 50% relative improvement over state-of-the-art techniques.
A finance approach values knowledge, emphasizing the importance of noticing new information.
problem The valuation of knowledge to ensure better training and awareness of new information.
method Formulated a methodology using finance principles, providing axioms and models.
result First attempt to numerically value knowledge, emphasizing the importance of noticing new information.
Framework evaluates the impact of prior knowledge in deep learning models.
problem Mitigating data-driven model shortcomings like data dependence and generalization ability.
method Model-agnostic framework inspired by interpretable machine learning, assessing data volume and estimation range effects.
result Complex relationship between data and knowledge, including dependence, synergistic, and substitution effects.
The paper explores the concept of predictive knowledge in reinforcement learning.
problem The relationship between predictions and knowledge in reinforcement learning is underdeveloped.
method The paper discusses the relationship between predictive knowledge learning methods and epistemic notions of justification and truth.
result The paper suggests the need for formalizing predictive knowledge in reinforcement learning.
Knowledge graph construction consists of two tasks: extracting information from external resources (knowledge population) and inferring missing information through a statistical analysis on the extracted information (knowledge completion). In many cases, insufficient external resources in the knowledge population hinde…
This paper enhances language models with knowledge awareness.
problem Understanding how much knowledge pretrained language models grasp.
method Inserting explicit knowledge layers into pretraining without changing transformer architecture.
result Significantly more knowledge packed into transformer parameters.
Survey of methods to incorporate external knowledge into stock price prediction.
problem Challenges in predicting stock prices due to market volatility and non-linearity.
method Survey of methods for acquiring and incorporating external knowledge into stock price prediction models.
result Systematic synthesis of previous studies on external knowledge types and their application in stock price prediction.
New model enables AI to learn autonomously.
problem Enabling AI to acquire domain knowledge.
method Hybrid model combining ontology, knowledge graph, and Logic Neural Network.
result System can enrich and extend its knowledge.
Knowledge flow transfers knowledge from multiple teachers to a student net.
problem Choosing and initializing deep nets for new tasks is unclear and inefficient.
method Develops a method to move 'knowledge' from multiple deep nets (teachers) to a new net (student) without dependency on teachers.
result The student net outperforms fine-tuning and other methods on various tasks.
This paper explores the connection between adversarial and knowledge transferability.
problem Understanding the factors affecting knowledge transferability.
method Theoretical analysis and practical metrics for adversarial transferability.
result Adversarial transferability and knowledge transferability are closely related.
New attacks manipulate knowledge graph embeddings by adding or deleting facts.
problem Lack of robustness of KGE to adversarial attacks.
method Data poisoning attack strategies to manipulate knowledge graph embeddings.
result Demonstrated effectiveness and efficiency of proposed attack strategies.
Machine learning refactors knowledge to improve learning efficiency.
problem Inductive program synthesis efficiency through knowledge restructuring.
method Introduces Knorf, a system that refactors knowledge bases using constraint optimization.
result Learning from refactored knowledge improves predictive accuracy fourfold and reduces learning time by half.
Recent variants improve knowledge distillation performance.
problem Improving the performance of knowledge distillation.
method Introducing additional components or changing the learning process.
result These variants have shown promising results.
We present a baseline approach for cross-modal knowledge fusion. Different basic fusion methods are evaluated on existing embedding approaches to show the potential of joining knowledge about certain concepts across modalities in a fused concept representation.
BioNAS optimizes deep learning models for biomedical research, revealing new knowledge.
problem Building interpretable deep learning models for biomedical research.
method Neural architecture search with knowledge dissimilarity functions for joint optimization of predictive power and biological knowledge.
result BioNAS optimal models reveal novel knowledge in both simulated and real functional genomics data.
A new KD method distills dataset-based knowledge using MHA.
problem Distilling knowledge from large teacher networks to small student networks.
method Graph-based knowledge distillation by multi-head attention network.
result The method improves SN performance by 7.05% on CIFAR100.
This paper improves understanding of knowledge distillation and its effects.
problem Improving model quality with a fixed capacity budget.
method Categorizing teacher's knowledge into three levels and studying their effects on distillation.
result The three hierarchical levels of teacher's knowledge (universe, domain, instance) significantly impact knowledge distillation.
Simple embedding models outperform complex ones in knowledge base completion.
problem Improving the accuracy of knowledge base completion using embedding models.
method Evaluation of embedding models for knowledge base completion using different protocols and a rule-based baseline.
result Current embedding models perform poorly in knowledge base completion compared to a simple rule-based approach.
The paper explains knowledge distillation by analyzing visual concepts in DNNs.
problem Understanding how knowledge distillation affects the learning of visual concepts in deep neural networks.
method The paper proposes three hypotheses and designs mathematical metrics to evaluate feature representations of DNNs.
result The hypotheses were verified through experiments on various DNNs.
In this paper, we consider a supervised learning setting where side knowledge is provided about the labels of unlabeled examples. The side knowledge has the effect of reducing the hypothesis space, leading to tighter generalization bounds, and thus possibly better generalization. We consider several types of side knowl…
Paper extends knowledge gradient for preferential BO, overcoming computational challenges.
problem Extending knowledge gradient to preferential BO with pairwise comparisons.
method Derive exact and analytical knowledge gradient for preferential BO.
result Exact knowledge gradient outperforms existing acquisition functions on benchmark problems.
New model of vague knowledge without strict partitions or transitivity.
problem Standard economic models of information fail to capture real-world vague knowledge.
method Relaxing assumptions of transitivity and partition structure to formalize vague knowledge.
result Vague knowledge can distinguish some states but not partition the state space.
b-LOAD extends local causal discovery with prior knowledge, improving causal effect estimation.
problem Local causal discovery struggles in data-scarce settings due to uncertainty and incomplete neighborhoods.
method b-LOAD incorporates prior knowledge directly into local structure learning, using Meek's rules to refine discovery.
result b-LOAD refines the admissible equivalence class and enlarges identifiable causal queries, improving causal effect estimation.
New method improves knowledge transfer from large to small networks.
problem Improving knowledge transfer from large to small neural networks.
method Contrastive learning to capture more structural knowledge.
result Contrastive learning outperforms knowledge distillation on various transfer tasks.
Proposes clustering as a new evaluation method for clinical knowledge embedding.
problem Traditional Link Prediction evaluation protocol loses information and harms model accuracy.
method Proposes Clustering Evaluation Protocol as an alternative.
result Experimental results show the proposed protocol can potentially replace Link Prediction.
Bayesian neural networks incorporate domain knowledge through variational inference.
problem Specifying priors for Bayesian neural networks that capture domain knowledge is challenging.
method Proposes a framework for integrating domain knowledge into BNN priors through variational inference.
result BNNs with proposed domain knowledge priors outperform those with standard priors, achieving better predictive performance.
This work integrates domain knowledge into A*-based causal discovery methods.
problem Efficiently incorporating domain knowledge into A*-based causal discovery methods.
method Integrates various types of domain knowledge into A*-based causal discovery methods, reducing the graph search space and improving computational gains.
result Small amounts of domain knowledge can dramatically speed up A*-based causal discovery and improve its performance and practicality.
Proposes a new method for predicting missing relations in knowledge graphs.
problem Predicting missing relations between entities in knowledge graphs.
method Relational message passing method considering only edge features without entity IDs.
result PathCon method outperforms state-of-the-art methods significantly.
Enhances data-driven models with physics knowledge for better system dynamics.
problem Improving generalization and interpretability in complex physical system modeling.
method EVGP (Explicit Variational Gaussian Process) model that incorporates domain knowledge into data-driven models.
result The EVGP model outperforms purely data-driven models when using prior domain knowledge.