SeqAttnGAN generates interactive images based on multi-turn text descriptions.
problem Interactive image editing with multi-turn textual commands.
method SeqAttnGAN uses a neural state tracker and GAN framework for sequential image generation and refinement.
result SeqAttnGAN outperforms state-of-the-art models on interactive image editing tasks.
To solve a text-based game, an agent needs to formulate valid text commands for a given context and find the ones that lead to success. Recent attempts at solving text-based games with deep reinforcement learning have focused on the latter, i.e., learning to act optimally when valid actions are known in advance. In thi…
Enhances math problem-solving models with multi-turn preference learning.
problem Improving mathematical problem-solving capabilities of large language models.
method Introduces a multi-turn direct preference learning framework for tool-integrated mathematical reasoning tasks.
result Significant performance improvements in model accuracy on math datasets.
Enhances persona-based conversation model for multi-turn dialogue.
problem Improving persona-based conversation models for multi-turn dialogue.
method Introduced additional input modality into hredGAN to capture external attributes.
result Persona hredGAN (phredGAN) outperforms existing models in multi-turn dialogue corpora. Foundation models struggle with multi-turn exploration but can learn through regular summaries.
problem Foundation models struggle with multi-turn exploration in dynamic environments.
method Implemented a text-based version of the Alchemy environment to test multi-trial learning. Prompting models to summarize their observations at regular intervals enabled them to improve across trials and adapt to changes.
result Foundation models can improve through regular summaries, enabling multi-trial learning and adaptation.
This study compares hierarchical and non-hierarchical models for open-domain multi-turn dialog generation.
problem Which kind of models (hierarchical or non-hierarchical) is better for open-domain multi-turn dialog generation?
method Systematically compared nearly all representative hierarchical and non-hierarchical models over the same experimental settings.
result Nearly all hierarchical models are worse than non-hierarchical models in open-domain multi-turn dialog generation, except for HRAN.
Unified pipeline detects multi-turn deception using geometric signals.
problem Detecting multi-turn deceptive interactions in LLMs.
method Geometric signaturization via genetic prompt optimization.
result Compact geometric model achieves high recall and F1 scores.
ReOPD uses pre-collected teacher trajectories to distill knowledge from multi-turn interactions.
problem The cost of fully online on-policy distillation for multi-turn interactions.
method ReOPD, an off-environment alternative that reuses pre-collected teacher trajectories as replayed prefixes, addressing the prefix trap and distribution shift.
result ReOPD preserves or improves OPD-level accuracy, uses zero tool calls, and is at least 4imes faster per training step. Neural Assistant integrates knowledge reasoning and dialogue generation in a single model.
problem Challenges in task-oriented dialog systems, including multi-turn language understanding and generation, knowledge retrieval and reasoning, and action prediction.
method Develops a single neural network model that jointly predicts text responses and actions from conversation history and external knowledge.
result The model learns to reason on external knowledge with weak supervision, improving factual accuracy and language generation performance.
Meena is a chatbot trained on social media data, achieving human-like conversation quality.
problem Creating a chatbot that can have human-like conversations in an open-domain setting.
method End-to-end training of a 2.6B parameter neural network on social media data, using perplexity and a human evaluation metric (SSA) to assess quality.
result Meena achieves a high human-like conversation quality (79% SSA) when compared to existing chatbots.
Method uses Seq2Seq learning to automatically generate recovery commands for ICT systems.
problem Manual decision-making for recovery commands is time-consuming and error-prone.
method Seq2Seq neural network model trained on past logs and commands.
result The model can estimate accurate recovery commands from new failures.
Paper finds universal speech command perturbations that fool models.
problem Existence of universal adversarial examples in speech command classification.
method Proposed a novel analytical framework for evaluating universal perturbations and a detailed distortion measurement method.
result Universal perturbations can fool speech command classification models across different models.
Enhances dialogue model with persona attributes using adversarial learning.
problem Improving dialogue models to better capture speaker identity and topic.
method Adversarial learning framework with a dual discriminator system.
result phredGAN outperforms persona Seq2Seq model in various datasets.
Study evaluates consistency of LLMs in binary text classification, providing systematic guidance.
problem Lack of reliable methods for evaluating large language model (LLM) binary text classification.
method Adapting psychometric principles, the study determines sample size requirements, develops metrics for invalid responses, and evaluates intra- and inter-rater reliability.
result LLMs demonstrated high intra-rater consistency, achieving perfect agreement on 90-98% of examples, with smaller models outperforming larger counterparts.
Interactive machine comprehension models learn through seeking relevant information.
problem Existing MRC models struggle with real-world applications due to static datasets.
method Reframe MRC datasets as interactive, partially observable environments.
result Interactive models can seek relevant information through sequential decision making.
We propose an adversarial learning approach for generating multi-turn dialogue responses. Our proposed framework, hredGAN, is based on conditional generative adversarial networks (GANs). The GAN's generator is a modified hierarchical recurrent encoder-decoder network (HRED) and the discriminator is a word-level bidirec…
The paper proposes an on-line monitoring framework for continuous real-time safety/security in learning-based control systems (specifically application to a unmanned ground vehicle). We monitor validity of mappings from sensor inputs to actuator commands, controller-focused anomaly detection (CFAM), and from actuator c…
New method converts natural language commands into reward functions for robots.
problem Creating effective reward functions for autonomous machines.
method Language-conditioned reward learning (LC-RL) using inverse reinforcement learning.
result Model learns transferable rewards from natural language commands.
Generative neural nets learn deep policies conditioned on goals.
problem Learning optimal policies for specific goals in reinforcement learning.
method Goal-conditioned neural nets that generate deep neural policies.
result Single learned policy generator can achieve any desired return.
Efficient algorithm for learning from indirect feedback in complex decision-making scenarios.
problem Learning from indirect feedback in realistic scenarios with personalized mechanisms.
method IGW algorithm for policy optimization, extending reward-estimator construction from single-step to multi-step.
result Achieves sublinear regret guarantee for contextual episodic MDPs with personalized feedback.
Learning weights in a spiking neural network with hidden neurons, using local, stable and online rules, to control non-linear body dynamics is an open problem. Here, we employ a supervised scheme, Feedback-based Online Local Learning Of Weights (FOLLOW), to train a network of heterogeneous spiking neurons with hidden l…
PBN combines generative and discriminative capabilities in a neural network.
problem Combining generative and discriminative capabilities in neural networks.
method Convolutional PBN, sharing FF-NN embodiment, combining generative and discriminative qualities.
result PBN shows excellent qualities from either generative or discriminative viewpoint.
A new multi-layer attention mechanism improves speech keyword recognition accuracy.
problem Inaccurate attention weights in LSTM networks for speech keyword recognition.
method Introducing information from layers prior to feature extraction into attention weights calculations.
result The proposed multi-layer attention mechanism leads to more accurate attention weights and improved keyword spotting performance.
DLGNet improves dialogue response generation by leveraging transformer architecture.
problem Lack of relevance, diversity, and coherence in dialogue responses.
method Transformer-based model for dialogue response generation, incorporating long-range structures and random paddings.
result Significant improvements over state-of-the-art models on multiple datasets.
Learning to drive faithfully in highly stochastic urban settings remains an open problem. To that end, we propose a Multi-task Learning from Demonstration (MT-LfD) framework which uses supervised auxiliary task prediction to guide the main task of predicting the driving commands. Our framework involves an end-to-end tr…
Sparse representations improve network robustness and stability.
problem The benefits of sparse representations in artificial networks.
method Analysis of sparse networks with sparse weights and activations, simulations on MNIST and Google Speech Command Dataset.
result Sparse networks show significantly improved robustness and stability compared to dense networks.
A new method for estimating causal effects using synthetic controls.
problem Evaluating causal effects of policy changes in settings with observational data.
method Distributional Synthetic Controls method.
result Allows construction of entire synthetic distributions for the treated unit.
IllinoisSL is a Java library for learning structured prediction models. It supports structured Support Vector Machines and structured Perceptron. The library consists of a core learning module and several applications, which can be executed from command-lines. Documentation is provided to guide users. In Comparison to …
A hierarchical DNN model for end-to-end driving tasks.
problem End-to-end driving tasks with various challenges.
method Hierarchical multi-task DNN architecture with subservient networks for specific tasks.
result Reduction in training data and tailored model complexity for different tasks.
New dataset for UAV gesture recognition in outdoor settings.
problem Lack of public outdoor UAV gesture recognition datasets.
method Recorded 13 gestures in an outdoor setting, created 119 HD video clips, annotated with body joints and gesture classes.
result Baseline gesture recognition performance of 91.9% using P-CNN.
Considering the driving habits which are learned from the naturalistic driving data in the path-tracking system can significantly improve the acceptance of intelligent vehicles. Therefore, the goal of this paper is to generate the prediction results of lateral commands with confidence regions according to the reference…
Paper optimizes KWS models using NAS and quantization for limited resources.
problem Developing efficient keyword spotting models in resource-constrained environments.
method Neural Architecture Search (NAS) for model structure optimization and quantization of weights and activations.
result Achieved high accuracy (95.55%) with minimal parameters and operations using NAS and quantization.
This paper extends adversarial attacks to produce desired class probability distributions.
problem Easily fooling deep learning models with imperceptible perturbations.
method Probabilistic framework to generate desired class probability distributions.
result The ability to closely approximate any probability distribution for classes while maintaining high fooling rates and preventing detection.
GenéLive! generates rhythm game commands with musical structure.
problem Generating accurate rhythm commands in music games.
method Deep generative model that considers musical structures.
result Reduced business cost by half at KLab Inc.
Network analysis reveals changing cryptocurrency market leaders.
problem Understanding evolving cryptocurrency market leaders and their influence.
method Hourly-resolution data and Kendall's Tau correlation for network analysis.
result Pearson's correlation underestimates market dynamics; FTT and FTX were key during the 2021 bull run.
Deep learning has revolutionized the ability to learn "end-to-end" autonomous vehicle control directly from raw sensory data. While there have been recent extensions to handle forms of navigation instruction, these works are unable to capture the full distribution of possible actions that could be taken and to reason a…
System identifies and responds to help queries in personal assistants.
problem Difficulty in remembering command structures for various tasks in personal assistants.
method Proposes a C-BiLSTM based classifier and semantic ANN module to detect and respond to help queries.
result System outperforms other approaches in returning relevant responses for help queries.
SparseChem speeds up ML for small molecules.
problem Training fast and accurate ML models for high-dimensional data.
method Supports millions of features and compounds, trains various models.
result Fast and accurate machine learning models for biochemical applications.
Neuro-symbolic system tackles conversational AI's need for natural, broad-ranging dialogue.
problem Understanding unstated presumptions in conversational AI commands.
method Neuro-symbolic theorem prover for multi-hop reasoning.
result Extracts multi-hop reasoning chains from natural language commands.
StableLM 2 1.6B is a new language model series with detailed evaluations and performance metrics.
problem Improving language models with smaller sizes and better performance.
method Detailed data and training procedure for StableLM 2 1.6B, including zero- and few-shot benchmarks and multilingual evaluations.
result StableLM 2 1.6B is the state-of-the-art open model under 2B parameters.
liquidSVM is a package written in C++ that provides SVM-type solvers for various classification and regression tasks. Because of a fully integrated hyper-parameter selection, very carefully implemented solvers, multi-threading and GPU support, and several built-in data decomposition strategies it provides unprecedented…
Pretrained model improves visual dialog performance.
problem Improving performance in visual dialog tasks.
method Pretrained ViLBERT model on vision-language datasets, fine-tuned on VisDial.
result Best model outperforms prior work by more than 1% on NDCG and MRR.
AI stocks hedge against AI singularity's economic impact.
problem AI singularity's displacement of consumption.
method Developed an asset pricing model with incomplete markets.
result AI stocks command a premium due to market incompleteness.
For later use in subsequent upcoming arxiv.org prepublications, basic foundational material on local, smooth or real analytic, CR-generic submanifolds of complex Euclidean spaces is developed from scratch, with strong emphasis on the interplay between extrinsic and intrinsic aspects, a constructive option that commands…
SchNetPack 2.0 enhances atomistic machine learning with improved neural networks.
problem Improving atomistic machine learning methods and applications.
method Improved data pipeline, equivariant neural networks, PyTorch implementation, PyTorch Lightning, Hydra configuration framework.
result Easy extension and complex training tasks support.
Automated dialogue quality evaluation using user satisfaction estimates across multiple domains.
problem Lack of automated and domain-independent dialogue quality evaluation metrics.
method Created a new Response Quality annotation scheme, introduced five domain-independent feature sets, and experimented with six machine learning models.
result Gradient Boosting Regression model achieved best prediction performance, with a 16% relative improvement in binary satisfaction class prediction accuracy.
With the celebrated success of deep learning, some attempts to develop effective methods for detecting malicious PowerShell programs employ neural nets in a traditional natural language processing setup while others employ convolutional neural nets to detect obfuscated malicious commands at a character level. While the…
Large deep neural networks are powerful, but exhibit undesirable behaviors such as memorization and sensitivity to adversarial examples. In this work, we propose mixup, a simple learning principle to alleviate these issues. In essence, mixup trains a neural network on convex combinations of pairs of examples and their …