Low-dimensional embeddings of knowledge graphs and behavior graphs have proved remarkably powerful in varieties of tasks, from predicting unobserved edges between entities to content recommendation. The two types of graphs can contain distinct and complementary information for the same entities/nodes. However, previous…
FLARKO uses LLMs, KGs, and KTO to generate profitable, behaviorally aligned financial recommendations.
problem Financial recommendation systems often fail to account for behavioral and regulatory factors.
method FLARKO integrates LLMs, KGs, and KTO to generate profitable and behaviorally aligned recommendations.
result FLARKO consistently outperforms state-of-the-art recommendation baselines on behavioral alignment and joint profitability.
This survey analyzes knowledge discovery in cryptocurrency transactions.
problem Understanding user behaviors and collective actions in cryptocurrency transactions.
method Data mining techniques and literature review.
result Classified existing research into three aspects and discussed major findings.
RKT model improves knowledge tracing by considering exercise relations and student forget behavior.
problem Traditional KT models fail to consider both exercise relations and student forget behavior.
method RKT model uses relation-aware self-attention to incorporate exercise relations and student forget behavior.
result RKT model outperforms state-of-the-art KT methods on real-world datasets.
Designs a DNN with alternative-specific utility functions for improved choice analysis.
problem Challenges in reconciling domain-specific knowledge with generic DNN.
method Integrates prior behavioral knowledge into DNN architecture with alternative-specific utility functions.
result 2-3% higher prediction accuracy than fully connected DNN over hyperparameter space.
We infer both microscopic and macroscopic behaviors of a three-dimensional chaotic fluid flow using reservoir computing. In our procedure of the inference, we assume no prior knowledge of a physical process of a fluid flow except that its behavior is complex but deterministic. We present two ways of inference of the co…
The goal of imitation learning is for an apprentice to learn how to behave in a stochastic environment by observing a mentor demonstrating the correct behavior. Accurate prior knowledge about the correct behavior can reduce the need for demonstrations from the mentor. We present a novel approach to encoding prior knowl…
New model enables AI to learn autonomously.
problem Enabling AI to acquire domain knowledge.
method Hybrid model combining ontology, knowledge graph, and Logic Neural Network.
result System can enrich and extend its knowledge.
Future robots should follow human social norms in order to be useful and accepted in human society. In this paper, we leverage already existing social knowledge in human societies by capturing it in our framework through the notion of social norms. We show how norms can be used to guide a reinforcement learning agent t…
KT models struggle with student concept drift, but BKT remains the most stable.
problem Impact of student concept drift on KT models.
method Applied four KT models to five academic years of data.
result KT models generally degrade in performance with concept drift, BKT remains stable.
In this work, we propose a method for learning driver models that account for variables that cannot be observed directly. When trained on a synthetic dataset, our models are able to learn encodings for vehicle trajectories that distinguish between four distinct classes of driver behavior. Such encodings are learned wit…
Modeling cascading behavior in complex systems using CTBNs.
problem Understanding which states trigger cascading events in complex systems.
method Continuous-time Bayesian networks (CTBNs) for modeling and identifying likely sentry states.
result Identification of likely sentry states that may lead to cascading behavior.
This paper evaluates knowledge graph completion models under the open-world assumption, revealing unexpected behavior of metrics.
problem Evaluation of knowledge graph completion models often assumes a closed-world assumption, which can lead to misleading results.
method The paper studies KGC evaluation under the open-world assumption, analyzing the behavior of metrics like MRR and Hits@K.
result Metrics like MRR and Hits@K can show significant degradation under the open-world assumption, leading to incorrect model comparisons.
Model predicts human food choices based on demographics.
problem Predicting human food choices from demographic data.
method Non-deterministic model based on NHANES dataset and behavioral studies.
result Generates synthetic data similar to original dataset.
Behavior Transfer improves reinforcement learning by leveraging pre-trained policies.
problem Efficient transfer of knowledge in reinforcement learning.
method Behavior Transfer (BT) that uses pre-trained policies for exploration.
result BT combined with pre-training leads to better solutions than without pre-training.
Making the right decision in traffic is a challenging task that is highly dependent on individual preferences as well as the surrounding environment. Therefore it is hard to model solely based on expert knowledge. In this work we use Deep Reinforcement Learning to learn maneuver decisions based on a compact semantic st…
Method learns evolving policies in healthcare contexts.
problem Understanding non-stationary behavior in evolving decision-making processes.
method Inverse Contextual Bandits (ICB) approach for learning interpretable representations of non-stationary behavior.
result Demonstrated applicability and accuracy of ICB method in liver transplantation policies.
Deep learning analyzes healthcare provider actions and patient outcomes.
problem Understanding provider behavior in non-randomized healthcare settings.
method Deep causal behavioral policy learning (DC-BPL) using transformer architecture.
result Optimal provider policies identified for specific patient types.
Building performance discrepancies between building design and operation are one of the causes that lead many new designs fail to achieve their goals and objectives. One of main factors contributing to the discrepancy is occupant behaviors. Occupants responding to a new design are influenced by several factors. Existin…
Modeling student behaviors and multiple predictions for early intervention.
problem Predicting student outcomes and interactions among multiple tasks.
method Proposes a variant of LSTM and soft-attention mechanism for heterogeneous behaviors, and co-attention mechanism for task interactions.
result Demonstrated effectiveness in predicting student outcomes and interactions.
Recent advances in Bayesian reinforcement learning (BRL) have shown that Bayes-optimality is theoretically achievable by modeling the environment's latent dynamics using Flat-Dirichlet-Multinomial (FDM) prior. In self-interested multi-agent environments, the transition dynamics are mainly controlled by the other agent'…
Study minimax off-policy evaluation in multi-armed bandits with known and unknown behavior policies.
problem Evaluate policies in multi-armed bandits with unknown behavior policies.
method Develop minimax rate-optimal procedures for known and unknown behavior policies, including the Switch estimator and Chebyshev polynomial-based estimator.
result Plug-in estimator achieves optimal competitive ratio up to a logarithmic factor when behavior policy is unknown.
This article reviews machine learning methods for behavioral sciences.
problem Applying machine learning to behavioral science data.
method Overview of classical and recent algorithms for tabular, behavioral, and textual data.
result Practical guidance for using machine learning in behavioral science.
The paper proposes a method to transfer knowledge across different settings using causal theory.
problem Learning transfer across similar but different settings.
method Bayesian perspective of causal theory induction, integrating instance-level associative learning and abstract-level structural causal knowledge.
result The proposed model achieved transfer behavior across trials and learning situations, unlike RL algorithms.
Paper develops a framework for learning interpretable representations of sequential decision behavior.
problem Obtaining a transparent description of existing behavior.
method Inverse decision modeling framework, formalizing both forward and inverse problems.
result Learning interpretable representations of behavior, including suboptimal actions, biased beliefs, and imperfect knowledge.
Study evaluates how much knowledge LLMs have by comparing their prediction accuracy to flexible models.
problem Evaluating the predictive power of LLMs without access to their training data.
method Equivalent sample size measure, comparing LLM's prediction error to flexible models trained on varying amounts of domain-specific data.
result LLMs encode varying amounts of predictive information across different economic variables.
QuantAgent learns trading signals through self-improvement.
problem Building domain-specific knowledge for LLMs in quantitative investment.
method Two-layer loop approach: inner loop refines responses, outer loop tests and learns.
result QuantAgent approximates optimal trading behavior with provable efficiency.
Bayesian neural networks incorporate domain knowledge through variational inference.
problem Specifying priors for Bayesian neural networks that capture domain knowledge is challenging.
method Proposes a framework for integrating domain knowledge into BNN priors through variational inference.
result BNNs with proposed domain knowledge priors outperform those with standard priors, achieving better predictive performance.
While physics conveys knowledge of nature built from an interplay between observations and theory, it has been considered less importantly in deep neural networks. Especially, there are few works leveraging physics behaviors when the knowledge is given less explicitly. In this work, we propose a novel architecture call…
A new approach combines prior knowledge with learning to adapt quickly to new tasks.
problem Adapting quickly to new tasks using prior knowledge.
method Combines behavior prior, robust off-policy learning, and value function representation.
result Achieves competitive adaptation performance compared to meta reinforcement learning baselines.
Improved robot navigation using multi-head attention for natural language instructions.
problem Improving robot navigation in unfamiliar environments.
method Proposes a multi-head attention mechanism blending layer in a neural network model.
result Significant performance gains in translating instructions for unseen environments.
An agent explores indefinitely in an environment with unlimited rewards.
problem Balancing exploration and exploitation in environments with unlimited rewards.
method Simple example of an environment with unbounded rewards and optimal agent behavior.
result An optimal agent always explores to maximize rewards, regardless of accumulated knowledge.
This paper tackles online strategic decision making with asymmetry and knowledge transportability.
problem Strategic decision making with information asymmetry and knowledge transportability challenges.
method Developed a sample-efficient algorithm for online learning under these conditions.
result Proved sample complexity of O(1/ε2) for learning an ε-optimal policy. Study improves vehicle motion prediction by incorporating traffic density.
problem Lack of contextual knowledge in predicting driving behavior.
method Categorize and define external conditions, evaluate motion prediction approach.
result Traffic density significantly improves motion prediction accuracy.
Context-awareness in smart mobile applications is a growing area of study, because of it's intelligence in the applications. In order to build context-aware intelligent applications, mining contextual behavioral rules of individual smartphone users utilizing their phone log data is the key. However, to mine these rules…
Compressed imitation learning uses simplicity priors for efficient expert behavior copying.
problem Efficiently learn expert behaviors with minimal data.
method Utilizes policy simplicity as a prior for sample-efficient imitation learning.
result Significantly higher scores achieved with limited expert demonstrations.
Modeling investor behavior from financial advisor notes using NLP.
problem Identifying behavioral coaching opportunities for financial advisors.
method Topic modeling and supervised classification model.
result Predicting investor needs during adverse market conditions.
Proposes DAPr framework to learn feature importance from prior knowledge.
problem Ensuring meaningful feature attributions in deep models.
method Jointly learns feature importance from prior knowledge and biases models to rely on important features.
result Improves model generalization and provides new interpretation methods.
Modern software systems provide many configuration options which significantly influence their non-functional properties. To understand and predict the effect of configuration options, several sampling and learning strategies have been proposed, albeit often with significant cost to cover the highly dimensional configu…
We propose a framework for ensuring safe behavior of a reinforcement learning agent when the reward function may be difficult to specify. In order to do this, we rely on the existence of demonstrations from expert policies, and we provide a theoretical framework for the agent to optimize in the space of rewards consist…
Role-wise data augmentation improves knowledge distillation effectiveness.
problem Existing knowledge distillation methods fail to utilize the full potential of teacher-student data interaction.
method Design and implement data augmentation agents with distinct roles for teacher and student.
result Specially tailored data points enhance the demonstration of teacher's knowledge to the student.
We provide a rigorous definition of the visual cause of a behavior that is broadly applicable to the visually driven behavior in humans, animals, neurons, robots and other perceiving systems. Our framework generalizes standard accounts of causal learning to settings in which the causal variables need to be constructed …
Large Question-and-Answer (Q&A) platforms support diverse knowledge curation on the Web. While researchers have studied user behavior on the platforms in a variety of contexts, there is relatively little insight into important by-products of user behavior that also encode knowledge. Here, we analyze and model the macro…
A new model captures car-following and lane-changing behaviors in traffic.
problem Modeling stochastic microscopic traffic behaviors.
method Physics regularized Gaussian process (PRGP) approach.
result The proposed model outperforms previous methods in estimation precision.
Shapley values explain financial language models, aligning with domain knowledge.
problem Lack of explainability in financial applications of large language models.
method Shapley value analysis for financial textual data.
result Shapley values provide consistent explanations with financial reasoning.
New method improves uncertainty estimation in Bayesian deep learning models.
problem Underestimation of predictive uncertainty in Neural Linear Models (NLMs).
method Proposes a novel training method to capture useful predictive uncertainties and incorporate domain knowledge.
result Traditional training procedures for NLMs can drastically underestimate uncertainty in data-scarce regions.
StockAgent uses AI to simulate real-world stock trading, analyzing external factors and profitability.
problem Investors need to understand how external factors affect stock trading.
method Developed StockAgent, a multi-agent system driven by large language models.
result Identified how external factors impact trading behavior and profitability.
The roundworm C. elegans exhibits robust escape behavior in response to rapidly rising temperature. The behavior lasts for a few seconds, shows history dependence, involves both sensory and motor systems, and is too complicated to model mechanistically using currently available knowledge. Instead we model the process p…