Self-feeding chatbots learn from user feedback to improve performance.
problem Lack of training data after deployment of dialogue agents.
method Extracts new training examples from user responses and uses feedback to improve dialogue abilities.
result Self-feeding chatbots significantly improve performance on PersonaChat dataset.
SuTaT creates dialogue summaries for tete-a-tetes without labeled data.
problem Lack of high-quality paired dialogue-summary data.
method Unsupervised model for tete-a-tetes, modeling customer and agent roles separately.
result SuTaT outperforms on automatic and human evaluations.
New method improves dialogue agents focusing on simple utterances.
problem Dialogue agents often focus on simple utterances and suboptimal policies.
method Tempered Policy Gradient (TPG) methods to improve dialogue performance.
result Significant improvements in dialogue performance, especially in producing convincing utterances.
Study combines chit-chat and goal-oriented dialogue in fantasy games.
problem Combining naturalistic chit-chat with goal-oriented tasks in fantasy games.
method Trained a goal-oriented model with reinforcement learning against an imitation-learned chit-chat model using two approaches.
result Both models outperform a baseline and can converse naturally to achieve goals.
Developing a dialogue agent that is capable of making autonomous decisions and communicating by natural language is one of the long-term goals of machine learning research. Traditional approaches either rely on hand-crafting a small state-action set for applying reinforcement learning that is not scalable or constructi…
We present a new algorithm that significantly improves the efficiency of exploration for deep Q-learning agents in dialogue systems. Our agents explore via Thompson sampling, drawing Monte Carlo samples from a Bayes-by-Backprop neural network. Our algorithm learns much faster than common exploration strategies such as …
Study proposes a multi-agent framework to mitigate bias in sentiment analysis.
problem Bias in sentiment analysis models.
method Integrates multiple LLMs, incorporates dialogue sessions, and uses probabilistic prediction.
result KCS+IBC reduces entropy and increases variance, suggesting improved balance between aggregation and diversity.
Improved model-based reinforcement learning for interactive dialogue tasks reduces sample needs and improves performance.
problem Limited data and high sample cost in interactive dialogue systems.
method Model-based actor-critic approach with an environment model and planner.
result 70 times fewer samples required compared to baseline model-free algorithm, with 2x better asymptotic performance.
In spoken dialogue systems, we aim to deploy artificial intelligence to build automated dialogue agents that can converse with humans. A part of this effort is the policy optimisation task, which attempts to find a policy describing how to respond to humans, in the form of a function taking the current state of the dia…
Enhances dialogue model with persona attributes using adversarial learning.
problem Improving dialogue models to better capture speaker identity and topic.
method Adversarial learning framework with a dual discriminator system.
result phredGAN outperforms persona Seq2Seq model in various datasets.
Pretraining method enhances dialogue representation learning across various tasks.
problem Scarce labeled data for specific dialogue tasks.
method Multi-task unsupervised pretraining with natural training objectives.
result Significant improvement in downstream tasks without encoder discrimination.
GOLOMB improves dialogue state tracking for unseen services.
problem Improving dialogue state tracking for multiple services and APIs.
method GOLOMB uses a BERT-based model that queries dialogue history with slot descriptions and values.
result GOLOMB achieves a joint goal accuracy of 53.97% on the SGD dataset.
Modeling long-range context for multi-function utterances in dialogues.
problem Complex dependencies across dialogue turns in long utterances.
method Adapted Convolutional Recurrent Neural Network (CRNN) to model interactions between utterances.
result Significantly outperforms existing work on CDA recognition on a tech forum dataset.
Two large medical dialogue datasets for improving healthcare.
problem Improving healthcare through better dialogue systems.
method Building two large-scale medical dialogue datasets: MedDialog-EN and MedDialog-CN.
result The datasets are the largest medical dialogue datasets to date.
Paper improves emotion expression in AI chatbots.
problem AI chatbots generate responses that lack emotion.
method Developed neural models to express specific emotions in generated responses.
result An encoder-decoder model with multiple attention layers performs best in expressing required emotion.
Study aims to develop a humanoid robot dialogue system.
problem Current dialogue systems lack attention to non-verbal cues.
method Participated in a competition to develop a system with facial expressions and gaze control.
result Developed a humanoid robot dialogue system.
Mild cognitive impairment (MCI) is a prodromal phase in the progression from normal aging to dementia, especially Alzheimers disease. Even though there is mild cognitive decline in MCI patients, they have normal overall cognition and thus is challenging to distinguish from normal aging. Using transcribed data obtained …
DLGNet improves dialogue response generation by leveraging transformer architecture.
problem Lack of relevance, diversity, and coherence in dialogue responses.
method Transformer-based model for dialogue response generation, incorporating long-range structures and random paddings.
result Significant improvements over state-of-the-art models on multiple datasets.
The paper improves dialogue quality estimation using a novel user satisfaction model.
problem Improving dialogue quality estimation in spoken dialogue systems.
method Proposes a novel user satisfaction estimator based on BiLSTMs and reinforcement learning.
result The novel user satisfaction estimator outperforms previous models in terms of user satisfaction and task success.
Reinforcement learning is widely used for dialogue policy optimization where the reward function often consists of more than one component, e.g., the dialogue success and the dialogue length. In this work, we propose a structured method for finding a good balance between these components by searching for the optimal re…
MathChat uses LLM agents to solve challenging math problems through conversational problem-solving.
problem Solving math problems expressed in natural language.
method MathChat is a conversational framework combining an LLM agent and a user proxy agent for collaborative problem-solving.
result MathChat improves tool-using prompting methods by 6% on difficult math problems.
Memory-Augmented Recurrent Networks improve dialogue coherence by expanding conversation history storage.
problem Fixed-size vectors limit dialogue coherence; attention mechanisms are computationally expensive.
method Introduce Neural Turing Machines (NTMs) to provide flexible and permanent storage for dialogue history.
result Improved perplexity performance compared to existing baselines.
Teaching machines to accomplish tasks by conversing naturally with humans is challenging. Currently, developing task-oriented dialogue systems requires creating multiple components and typically this involves either a large amount of handcrafting, or acquiring costly labelled datasets to solve a statistical learning pr…
Reinforcement Learning improves personalized dialogue systems.
problem Personalized dialogue systems that generalize across users.
method Two RL-based approaches: single learner with user context features, and learner per context segmentation.
result RL methods outperform handcrafted systems in financial product recommendation.
We propose a novel dialogue modeling framework, the first-ever nonparametric kernel functions based approach for dialogue modeling, which learns kernelized hashcodes as compressed text representations; unlike traditional deep learning models, it handles well relatively small datasets, while also scaling to large ones. …
Automated dialogue quality evaluation using user satisfaction estimates across multiple domains.
problem Lack of automated and domain-independent dialogue quality evaluation metrics.
method Created a new Response Quality annotation scheme, introduced five domain-independent feature sets, and experimented with six machine learning models.
result Gradient Boosting Regression model achieved best prediction performance, with a 16% relative improvement in binary satisfaction class prediction accuracy.
FastSGT improves accuracy in BERT-based DST for SGD datasets.
problem Dialog State Tracking in goal-oriented dialogue systems.
method BERT-based model with two carry-over procedures and multi-head attention.
result Significantly improved accuracy compared to baseline model.
Dialogue assistants are rapidly becoming an indispensable daily aid. To avoid the significant effort needed to hand-craft the required dialogue flow, the Dialogue Management (DM) module can be cast as a continuous Markov Decision Process (MDP) and trained through Reinforcement Learning (RL). Several RL models have been…
Enhances persona-based conversation model for multi-turn dialogue.
problem Improving persona-based conversation models for multi-turn dialogue.
method Introduced additional input modality into hredGAN to capture external attributes.
result Persona hredGAN (phredGAN) outperforms existing models in multi-turn dialogue corpora. Paper proposes a method to generate task-oriented dialogue queries.
problem Scarcity of training data for task-oriented dialogue systems.
method Conditional variational autoencoder for intent-specific sentence generation and query transfer protocol.
result Our method improves the diversity of generated queries without compromising quality.
This paper collects a large dataset for conversational recommendation research.
problem Creating dialogue systems for conversational recommendation.
method Collects a large dataset (ReDial) and explores neural architectures, mechanisms, and methods for conversational recommendation systems.
result Demonstrates the utility of the collected dataset for systematic probing of model sub-components in conversational recommendation.
In statistical dialogue management, the dialogue manager learns a policy that maps a belief state to an action for the system to perform. Efficient exploration is key to successful policy optimisation. Current deep reinforcement learning methods are very promising but rely on epsilon-greedy exploration, thus subjecting…
During the past decade, several areas of speech and language understanding have witnessed substantial breakthroughs from the use of data-driven models. In the area of dialogue systems, the trend is less obvious, and most practical systems are still built through significant engineering and expert knowledge. Nevertheles…
Improves dialogue state tracking across multiple domains.
problem Incomplete domain ontology limits DST models' adaptability.
method Model DST as Q&A, using evolving knowledge graph.
result 5.80% and 12.21% relative improvement on datasets.
End-to-end dialogue model learns from joint embeddings and user intent.
problem Challenges in reasoning and incorporating state-full knowledge in goal-oriented dialogues.
method Proposes an RNN-based end-to-end encoder-decoder architecture trained with joint embeddings and multi-task learning.
result Improves task-oriented dialogue system performance as shown by BLEU score evaluation.
We propose an adversarial learning approach for generating multi-turn dialogue responses. Our proposed framework, hredGAN, is based on conditional generative adversarial networks (GANs). The GAN's generator is a modified hierarchical recurrent encoder-decoder network (HRED) and the discriminator is a word-level bidirec…
Improves dialogue response model interpretability using attention and regularization.
problem Improving interpretability of dual encoder models for dialogue response suggestions.
method Integrates attention mechanism and novel regularization loss to emphasize important words.
result Improves model accuracy and interpretability compared to existing methods.
New metric estimates user satisfaction for dialogue quality evaluation.
problem Sparse and intrusive explicit user feedback for dialogue quality evaluation.
method Created a new Response Quality annotation scheme and developed a turn-level User Satisfaction metric using five domain-independent feature sets and six machine learning models.
result Gradient boosting regression achieved best correlation of ~0.79 between predicted and annotated user satisfaction labels.
ConvMFiT classifies client utterances in counseling dialogues.
problem Classifying client utterances for better counseling outcomes.
method Fine-tuning a pre-trained conversation model on counselor-client dialogues.
result ConvMFiT outperforms state-of-the-art models in classification.
DGDS uses documents to center conversations, promising broader AI understanding.
problem DS classification by function is insufficient for complex conversations.
method Classify DS based on document grounding, analyzing classification, architecture, datasets, and models.
result DGDS can better represent current DS development trends and future AI understanding.
TCT learns multimodal sequence representations by translating from related sequences.
problem Challenges in learning semantic representations from multimodalities.
method Transformer based Cross-modal Translator (TCT) combined with Multimodal Transformer Network (MTN).
result Proposed method achieves new state-of-the-art performance on video-grounded dialogue.
A new multi-hop FiLM approach improves visual reasoning tasks.
problem Challenging multi-modal tasks like visual question-answering and dialogue.
method Generate FiLM layer parameters in a multi-hop fashion, alternating between attending to language and generating parameters.
result Multi-hop FiLM generation achieves state-of-the-art performance on visual dialogue tasks.
Proposes a new method for conversational agents using deep learning.
problem Building coherent and non-monotonous conversational agents with proper discourse and coverage.
method End-to-end multi-stream deep learning architecture leveraging contextual and syntactic information.
result Significantly improved next sentence prediction task.
Improved RL for knowledge graph reasoning with entity types.
problem Challenges in path-based relational reasoning over knowledge graphs.
method Type-enhanced RL agent using GNN for neighborhood information.
result Outperforms state-of-the-art RL methods and discovers novel paths.
We consider apprenticeship learning, i.e., having an agent learn a task by observing an expert demonstrating the task in a partially observable environment when the model of the environment is uncertain. This setting is useful in applications where the explicit modeling of the environment is difficult, such as a dialog…
New method for explaining dialogue response generation models.
problem Interpreting sequence generation models, especially dialogue response generation.
method Local Explanation of Response Generation (LERG) method.
result LERG improves dialogue response generation explanations compared to existing methods.
Deep learning improves conversational recommender systems.
problem Creating effective goal-oriented dialogue systems through natural language interactions.
method Apply deep learning techniques to conversational recommender systems.
result Deep learning models enhance user preference learning in CRS.
DAG-LSTM improves DA classification in group chats.
problem DA classification in multi-party conversations.
method Directed-Acyclic-Graph LSTM (DAG-LSTM) exploiting turn-taking structure.
result DAG-LSTM outperforms existing methods by 0.8% in accuracy and 1.2% in macro-F1 score.