Robot learns to imitate human interactions through deep learning.
problem Teaching robots to coordinate actions with human partners.
method Deep learning framework for motion embedding, prediction, and trajectory generation.
result Importance of predictive and adaptive components for successful imitation.
Study causal effects on humans in mixed human-AI systems with unobserved unit types.
problem Estimating causal effects on humans in systems with unobserved unit types and interaction networks.
method Assumed human-AI prior, causal message passing (CMP) framework, subpopulation analysis.
result Consistently recover human-specific causal effects using subpopulations with varying expected human composition and treatment exposure.
For robots to coexist with humans in a social world like ours, it is crucial that they possess human-like social interaction skills. Programming a robot to possess such skills is a challenging task. In this paper, we propose a Multimodal Deep Q-Network (MDQN) to enable a robot to learn human-like interaction skills thr…
For a safe, natural and effective human-robot social interaction, it is essential to develop a system that allows a robot to demonstrate the perceivable responsive behaviors to complex human behaviors. We introduce the Multimodal Deep Attention Recurrent Q-Network using which the robot exhibits human-like social intera…
Cluster annotation reduces active learning human interactions.
problem Reducing human interactions in active learning.
method Cluster annotation to label multiple samples at once.
result 82% and 87% less human interactions for CIFAR-10 and EuroSAT datasets.
IAL uses interactive learning to improve model performance with minimal human feedback.
problem Overfitting and high human interaction cost in training neural networks.
method IAL framework with NAP attention generator and reranking algorithm.
result IAL significantly outperforms baselines with less retraining and human interaction.
Alpha-GPT 2.0 integrates human insights into AI-driven investment research.
problem Efficiency and precision in quantitative investment research.
method Iterative Human-AI interaction using large language models.
result Enhanced efficiency and precision in quantitative investment research.
TraderTalk uses LLMs to simulate human trading interactions in financial markets.
problem Simulating realistic human trading interactions in financial markets.
method Hybrid ABM with LLM-generated behaviors for detailed conversations.
result Successfully replicates trade-to-order volume ratios in financial markets.
XGL uses global explanations to guide human supervision in machine learning.
problem Improving model quality through human-machine interaction.
method XGL employs global explanations to guide human selection of informative examples.
result XGL avoids overselling the model's quality and performs comparably to other strategies.
SocialInteractionGAN generates realistic human interactions from low-dimensional data.
problem Generating realistic human interactions from limited data.
method Adversarial architecture with a recurrent encoder-decoder generator and dual-stream discriminator.
result SocialInteractionGAN produces high-quality action sequences of interacting people.
Mathematical framework for cooperative communication explains belief transmission.
problem Lack of understanding why cooperation enables effective belief transmission.
method Connection to optimal transport theory, deriving prior models, statistical interpretations, proofs of robustness and instability.
result Cooperative communication provably enables effective, robust belief transmission.
Deep learning model classifies concurrent human interactions from WiFi data with high accuracy.
problem Classifying concurrent human interactions from WiFi data with high accuracy.
method Attention-BiGRU deep learning model using Multiple Input Multiple Output radio link.
result Maximum benchmark accuracy of 94% for a single subject-pair, 88% for ten subject pairs.
Novel RL algorithms learn from human interaction data without exploration.
problem Efficiently learning from off-policy data in reinforcement learning.
method Developed off-policy batch RL algorithms using KL-control and dropout-based uncertainty.
result Successfully learned multiple reward functions from human interaction data.
Alpha-GPT mines new trading signals with human-AI interaction.
problem Mining new alphas for effective trading signals.
method Human-AI interaction and prompt engineering algorithmic framework.
result Demonstrates Alpha-GPT's effectiveness in generating creative, insightful, and effective alphas.
Interactive machine learning improves deep RL in Minecraft by giving action advice.
problem Training deep RL agents in high-aliasing environments like Minecraft is computationally expensive.
method Conducted experiments with two RL algorithms, Feedback Arbitration, and Newtonian Action Advice, to give action advice to human teachers.
result Action advice from human teachers can improve agent performance in high-aliasing environments.
We present an approach to interactive-predictive neural machine translation that attempts to reduce human effort from three directions: Firstly, instead of requiring humans to select, correct, or delete segments, we employ the idea of learning from human reinforcements in form of judgments on the quality of partial tra…
Study human-machine interaction with private info using offline RL.
problem Confounding bias and distributional mismatch in offline RL for human-guided interaction.
method Developed a novel identification result and OPE method to address confounding bias, and used pessimism to tackle distributional mismatch.
result Policy pair converges to optimal one at satisfactory rate under mild assumptions.
This research integrates human interaction into reinforcement learning to improve sample efficiency and real-time learning.
problem Current reinforcement learning requires thousands of samples to converge, and is prone to catastrophic failures.
method Integrates human interaction modalities (demonstrations, interventions, evaluations) into the reinforcement learning loop.
result Human interaction accelerates learning and improves sample efficiency.
User interfaces provide an interactive window between physical and virtual environments. A new concept in the field of human-computer interaction is a soft user interface; a compliant surface that facilitates touch interaction through deformation. Despite the potential of these interfaces, they currently lack a signal …
Robots learn intentions from multiple cues to reduce uncertainty.
problem Uncertainty in human-robot interaction for vulnerable users.
method Multimodal classifier fusion using Bayesian Independent Opinion Pool.
result Fused classifiers outperform individual modalities in accuracy and uncertainty reduction.
PHASE dataset simulates complex social interactions in physical environments.
problem Lack of datasets for evaluating physically grounded perception of complex social interactions.
method Created PHASE dataset of 2D animations with procedural generation and physics engine.
result SIMPLE model outperforms neural networks in recognizing complex social interactions.
Paper proposes a self-play method to approximate human evaluation of conversational agents.
problem Challenges in evaluating open-domain dialog systems.
method Self-play scenario with sentiment and semantic coherence proxies.
result Self-play metric correlates significantly with human ratings (r>.7, p<.05).
This paper argues for more realistic human models in RL.
problem Current RL models oversimplify human feedback, ignoring personal, contextual, and dynamic aspects.
method Calls for interdisciplinary research on human feedback in RL.
result Realistic human models are needed for robust human-in-the-loop RL systems.
Study on predictable forward processes in trading without frequent evaluations.
problem Trading performance evaluation times not matching trading times.
method Solving a linear functional equation to construct predictable forward processes.
result Predictable forward processes are inherently myopic and optimal strategies do not use future information.
Quriosity analyzes curiosity-driven questions from diverse sources.
problem Understanding and analyzing human curiosity-driven questions.
method Collection of 13.5K questions from various sources, development of an iterative prompt improvement framework.
result 42% of questions are causal, revealing unique linguistic properties.
Study explores how to explain deep neural networks using interactive naming.
problem Explaining deep neural networks' decisions in human-understandable terms.
method Developed an interactive naming interface for human annotators to cluster activation maps into visual concepts.
result Significant agreement among annotators about visual concepts, many activation maps have recognizable concepts.
Paper proposes a modified uncertainty sampling method to speed up preference learning from noisy humans.
problem Learning preferences from humans with limited queries and noisy responses.
method Modified uncertainty sampling using expected output value to speed up preference learning.
result The modified method outperforms the baseline uncertainty sampling in preference learning.
Paper proposes self-supervised method for accurate speaker diarization.
problem Speaker diarization without massive labeling effort.
method Introduces dynamic triplet loss and multinomial loss for audio-video synchronization.
result Best model yields +8% F1-score improvement and diarization error rate reduction.
Programmatic Motion Concepts learn human actions from paired videos.
problem Learning motion concepts from paired video and action sequences.
method Semi-supervised learning architecture for hierarchical motion representation.
result Outperforms established baselines, especially in small data settings.
Model infers temporal connections in dynamic graphs from node interactions.
problem Challenges in reasoning about evolving graphs, especially with human-specified edges.
method Temporal point processes and variational autoencoders with bilinear interactions.
result Model outperforms baselines and infers semantically interpretable connections.
Interactive EMA combines multiple explainability methods to improve model understanding.
problem Isolated explanations of machine learning models lead to misunderstandings and wrong reasoning.
method Interactive EMA (IEMA) combines multiple explainability methods sequentially.
result Interactive EMA increases the performance and confidence of human decision making.
Framework for responsible LLM deployment with human involvement and decentralized technologies.
problem Challenges in deploying LLMs for high-stakes decisions, including data security and accountability.
method Interactive human involvement through multiple iterations, decentralized technologies, and automated auditing.
result Enhanced security and accountability in LLM deployment for financial decisions.
A novel multi-modal active learning approach using RL for engagement estimation.
problem Challenges in labeling multi-modal human data for accurate user state estimation.
method Deep reinforcement learning for optimal data selection and multi-modal data fusion.
result The proposed approach outperforms existing methods in engagement estimation.
Robot learns from human actions to perform complex tasks.
problem Learning complex skills from interaction data with embodiment differences.
method Formulated graphical model, treated action as observed variable, used domain-dependent prior.
result Robotic planning agent can learn tool use from human observations.
A robot assists a human in a bandit task to learn and improve performance.
problem Learning preferences in humans when they are also learning.
method Introduces assistive multi-armed bandit, where a robot helps a human maximize cumulative reward.
result Human performance can be better when effectively communicating observed rewards to the robot, not just by learning optimally.
AI benchmarks evaluate football team performance using generative models.
problem Evaluating human performance in complex interactive tasks is error-prone and unreliable.
method Trained Conditional VRNN Model on player and ball tracking data to imitate and predict team interactions.
result Trained model as a useful benchmark for evaluating team performance in football.
Human advice improves deep learning from sparse samples.
problem Learning from sparse, noisy samples in deep models.
method Knowledge-augmented Column Networks using human advice.
result Significantly improved performance or faster convergence.
For sophisticated reinforcement learning (RL) systems to interact usefully with real-world environments, we need to communicate complex goals to these systems. In this work, we explore goals defined in terms of (non-expert) human preferences between pairs of trajectory segments. We show that this approach can effective…
We present an interactive version of an evidence-driven state-merging (EDSM) algorithm for learning variants of finite state automata. Learning these automata often amounts to recovering or reverse engineering the model generating the data despite noisy, incomplete, or imperfectly sampled data sources rather than optim…
Autonomous vehicles (AVs) are on the road. To safely and efficiently interact with other road participants, AVs have to accurately predict the behavior of surrounding vehicles and plan accordingly. Such prediction should be probabilistic, to address the uncertainties in human behavior. Such prediction should also be in…
SOM-VQ tokenizes discrete models with semantic structure and navigable topology.
problem Lack of semantic structure in vector quantized representations limits interpretable human control.
method Combines vector quantization with Self-Organizing Maps to learn discrete codebooks with explicit topology.
result SOM-VQ produces more learnable token sequences and provides an explicit navigable geometry in code space.
The paper tackles AI advice giving by considering adherence levels and defer options.
problem Inadequate consideration of human adherence to AI recommendations.
method Sequential decision-making model that considers adherence levels and incorporates a defer option.
result Specialized learning algorithms provide better convergence and empirical performance.
Framework enables robots to learn tasks from unlabeled human instructions.
problem Robotic task learning with unlabeled human instructions.
method TICS architecture combining reward function, human feedback, and unlabeled instructions.
result Framework accelerates task-learning and reduces teaching signals.
Computational modeling of human multimodal language is an emerging research area in natural language processing spanning the language, visual and acoustic modalities. Comprehending multimodal language requires modeling not only the interactions within each modality (intra-modal interactions) but more importantly the in…
Reinforcement Learning AI commonly uses reward/penalty signals that are objective and explicit in an environment -- e.g. game score, completion time, etc. -- in order to learn the optimal strategy for task performance. However, Human-AI interaction for such AI agents should include additional reinforcement that is impl…
New method extracts latent variables from process data using autoencoders.
problem Extracting useful information from diverse, noisy, and nonstandard response processes.
method Sequence-to-sequence autoencoder to compress response processes into standard numerical vectors.
result The latent variables extracted from response processes are useful for understanding complex skills.
Robots learn conservatively from human corrections, avoiding unintended changes to their objectives.
problem Robots learn from human corrections but may not align with the intended objectives due to misspecified hypothesis spaces.
method Robots reason in real-time about the relevance of human corrections to their hypothesis space, learning more conservatively.
result Robots can avoid unintended learning from human corrections, improving alignment with intended objectives.
DeepDrummer generates drum loops with human preferences via active learning.
problem Creating drum loops efficiently with user preferences.
method Active learning with a deep neural network classifier.
result System converges to user preferences after few interactions.