Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,786 papers · 148 categories

Trend · papers per month

6.3%12.5%18.8%25.0% · Jul 199319922001200920172026
48 results for dialogue state tracking

Improves slot key and value prediction for unseen entities.

problem Dealing with unseen slot keys and values in real-world dialogue systems.
method Leverages external knowledge bases to project slots into an attribute space and generate candidate keys and values.
result Significant improvements in F1 score and accuracy (57.7% and 82.7%, respectively) over a previous approach.

Word vectors are at the core of many natural language processing tasks. Recently, there has been interest in post-processing word vectors to enrich their semantic information. In this paper, we introduce a novel word vector post-processing technique based on matrix conceptors (Jaeger2014), a family of regularized ident…

2018-11-17abs ↗pdf ↗

Developing a dialogue agent that is capable of making autonomous decisions and communicating by natural language is one of the long-term goals of machine learning research. Traditional approaches either rely on hand-crafting a small state-action set for applying reinforcement learning that is not scalable or constructi…

2017-05-29abs ↗pdf ↗

Memory-Augmented Recurrent Networks improve dialogue coherence by expanding conversation history storage.

problem Fixed-size vectors limit dialogue coherence; attention mechanisms are computationally expensive.
method Introduce Neural Turing Machines (NTMs) to provide flexible and permanent storage for dialogue history.
result Improved perplexity performance compared to existing baselines.

End-to-end dialogue model learns from joint embeddings and user intent.

problem Challenges in reasoning and incorporating state-full knowledge in goal-oriented dialogues.
method Proposes an RNN-based end-to-end encoder-decoder architecture trained with joint embeddings and multi-task learning.
result Improves task-oriented dialogue system performance as shown by BLEU score evaluation.

Neural dialogue models, despite their successes, still suffer from lack of relevance, diversity, and in many cases coherence in their generated responses. These issues can attributed to reasons including (1) short-range model architectures that capture limited temporal dependencies, (2) limitations of the maximum likel…

2019-07-26abs ↗pdf ↗

Pretraining method enhances dialogue representation learning across various tasks.

problem Scarce labeled data for specific dialogue tasks.
method Multi-task unsupervised pretraining with natural training objectives.
result Significant improvement in downstream tasks without encoder discrimination.

Modeling long-range context for multi-function utterances in dialogues.

problem Complex dependencies across dialogue turns in long utterances.
method Adapted Convolutional Recurrent Neural Network (CRNN) to model interactions between utterances.
result Significantly outperforms existing work on CDA recognition on a tech forum dataset.

TCT learns multimodal sequence representations by translating from related sequences.

problem Challenges in learning semantic representations from multimodalities.
method Transformer based Cross-modal Translator (TCT) combined with Multimodal Transformer Network (MTN).
result Proposed method achieves new state-of-the-art performance on video-grounded dialogue.

Recent breakthroughs in computer vision and natural language processing have spurred interest in challenging multi-modal tasks such as visual question-answering and visual dialogue. For such tasks, one successful approach is to condition image-based convolutional network computation on language via Feature-wise Linear …

2018-08-03abs ↗pdf ↗

The paper improves dialogue quality estimation using a novel user satisfaction model.

problem Improving dialogue quality estimation in spoken dialogue systems.
method Proposes a novel user satisfaction estimator based on BiLSTMs and reinforcement learning.
result The novel user satisfaction estimator outperforms previous models in terms of user satisfaction and task success.

Language systems have been of great interest to the research community and have recently reached the mass market through various assistant platforms on the web. Reinforcement Learning methods that optimize dialogue policies have seen successes in past years and have recently been extended into methods that personalize …

2019-08-01abs ↗pdf ↗

Many challenges in natural language processing require generating text, including language translation, dialogue generation, and speech recognition. For all of these problems, text generation becomes more difficult as the text becomes longer. Current language models often struggle to keep track of coherence for long pi…

2018-10-20abs ↗pdf ↗

Deep learning improves conversational recommender systems.

problem Creating effective goal-oriented dialogue systems through natural language interactions.
method Apply deep learning techniques to conversational recommender systems.
result Deep learning models enhance user preference learning in CRS.

Teaching machines to accomplish tasks by conversing naturally with humans is challenging. Currently, developing task-oriented dialogue systems requires creating multiple components and typically this involves either a large amount of handcrafting, or acquiring costly labelled datasets to solve a statistical learning pr…

2016-04-15abs ↗pdf ↗

Self-attentional models improve chatbot efficiency and performance.

problem Training efficient task-oriented dialogue generation systems.
method Applied self-attentional models to three datasets for chatbot training.
result Self-attentional models outperform recurrence-based models in efficiency and performance.

The majority of conversations a dialogue agent sees over its lifetime occur after it has already been trained and deployed, leaving a vast store of potential training signal untapped. In this work, we propose the self-feeding chatbot, a dialogue agent with the ability to extract new training examples from the conversat…

2019-01-16abs ↗pdf ↗

Study combines chit-chat and goal-oriented dialogue in fantasy games.

problem Combining naturalistic chit-chat with goal-oriented tasks in fantasy games.
method Trained a goal-oriented model with reinforcement learning against an imitation-learned chit-chat model using two approaches.
result Both models outperform a baseline and can converse naturally to achieve goals.

Automated dialogue quality evaluation using user satisfaction estimates across multiple domains.

problem Lack of automated and domain-independent dialogue quality evaluation metrics.
method Created a new Response Quality annotation scheme, introduced five domain-independent feature sets, and experimented with six machine learning models.
result Gradient Boosting Regression model achieved best prediction performance, with a 16% relative improvement in binary satisfaction class prediction accuracy.

Paper proposes a method to generate task-oriented dialogue queries.

problem Scarcity of training data for task-oriented dialogue systems.
method Conditional variational autoencoder for intent-specific sentence generation and query transfer protocol.
result Our method improves the diversity of generated queries without compromising quality.

There has been growing interest in using neural networks and deep learning techniques to create dialogue systems. Conversational recommendation is an interesting setting for the scientific exploration of dialogue with natural language as the associated discourse involves goal-driven dialogue that often transforms natur…

2018-12-18abs ↗pdf ↗

Learning goal-oriented dialogues by means of deep reinforcement learning has recently become a popular research topic. However, commonly used policy-based dialogue agents often end up focusing on simple utterances and suboptimal policies. To mitigate this problem, we propose a class of novel temperature-based extension…

2018-07-02abs ↗pdf ↗

Improves dialogue response model interpretability using attention and regularization.

problem Improving interpretability of dual encoder models for dialogue response suggestions.
method Integrates attention mechanism and novel regularization loss to emphasize important words.
result Improves model accuracy and interpretability compared to existing methods.

New metric estimates user satisfaction for dialogue quality evaluation.

problem Sparse and intrusive explicit user feedback for dialogue quality evaluation.
method Created a new Response Quality annotation scheme and developed a turn-level User Satisfaction metric using five domain-independent feature sets and six machine learning models.
result Gradient boosting regression achieved best correlation of ~0.79 between predicted and annotated user satisfaction labels.

DGDS uses documents to center conversations, promising broader AI understanding.

problem DS classification by function is insufficient for complex conversations.
method Classify DS based on document grounding, analyzing classification, architecture, datasets, and models.
result DGDS can better represent current DS development trends and future AI understanding.

Improved tracking and prediction of moving objects in visual data streams.

problem Tracking and predicting multiple moving objects in visual data streams.
method Disentangled latent state-space model with amortized variational Bayesian inference.
result Significantly improved long-term prediction and object decomposition in the presence of occlusions.

Online learners track optimal solutions with constant step-size.

problem Tracking optimal solutions in online learning settings.
method Established a link between steady-state performance and tracking performance using analogies with adaptive filters.
result Inferred tracking performance from steady-state expressions directly.

Neural Assistant integrates knowledge reasoning and dialogue generation in a single model.

problem Challenges in task-oriented dialog systems, including multi-turn language understanding and generation, knowledge retrieval and reasoning, and action prediction.
method Develops a single neural network model that jointly predicts text responses and actions from conversation history and external knowledge.
result The model learns to reason on external knowledge with weak supervision, improving factual accuracy and language generation performance.