This work trains a model to generate all valid commands for text-based games.
problem Generating valid commands for text-based games.
method Training generative models on a dataset of text-based game contexts.
result The best model can generate valid commands unseen at training and achieves high F1 score.
The paper improves safety in autonomous systems using adversarial learning.
problem Ensuring safety in real-time control systems of autonomous vehicles.
method The paper introduces a dual anomaly detection framework (CFAM and SFAM) using generative adversarial networks (GANs) and video prediction.
result Demonstrated effectiveness on both indoor and outdoor autonomous ground vehicles.
Method uses Seq2Seq learning to automatically generate recovery commands for ICT systems.
problem Manual decision-making for recovery commands is time-consuming and error-prone.
method Seq2Seq neural network model trained on past logs and commands.
result The model can estimate accurate recovery commands from new failures.
Learning to drive faithfully in highly stochastic urban settings remains an open problem. To that end, we propose a Multi-task Learning from Demonstration (MT-LfD) framework which uses supervised auxiliary task prediction to guide the main task of predicting the driving commands. Our framework involves an end-to-end tr…
Paper finds universal speech command perturbations that fool models.
problem Existence of universal adversarial examples in speech command classification.
method Proposed a novel analytical framework for evaluating universal perturbations and a detailed distortion measurement method.
result Universal perturbations can fool speech command classification models across different models.
A new multi-layer attention mechanism improves speech keyword recognition accuracy.
problem Inaccurate attention weights in LSTM networks for speech keyword recognition.
method Introducing information from layers prior to feature extraction into attention weights calculations.
result The proposed multi-layer attention mechanism leads to more accurate attention weights and improved keyword spotting performance.
Considering the driving habits which are learned from the naturalistic driving data in the path-tracking system can significantly improve the acceptance of intelligent vehicles. Therefore, the goal of this paper is to generate the prediction results of lateral commands with confidence regions according to the reference…
New method converts natural language commands into reward functions for robots.
problem Creating effective reward functions for autonomous machines.
method Language-conditioned reward learning (LC-RL) using inverse reinforcement learning.
result Model learns transferable rewards from natural language commands.
Generative neural nets learn deep policies conditioned on goals.
problem Learning optimal policies for specific goals in reinforcement learning.
method Goal-conditioned neural nets that generate deep neural policies.
result Single learned policy generator can achieve any desired return.
Learning weights in a spiking neural network with hidden neurons, using local, stable and online rules, to control non-linear body dynamics is an open problem. Here, we employ a supervised scheme, Feedback-based Online Local Learning Of Weights (FOLLOW), to train a network of heterogeneous spiking neurons with hidden l…
While invasively recorded brain activity is known to provide detailed information on motor commands, it is an open question at what level of detail information about positions of body parts can be decoded from non-invasively acquired signals. In this work it is shown that index finger positions can be differentiated fr…
PBN combines generative and discriminative capabilities in a neural network.
problem Combining generative and discriminative capabilities in neural networks.
method Convolutional PBN, sharing FF-NN embodiment, combining generative and discriminative qualities.
result PBN shows excellent qualities from either generative or discriminative viewpoint.
Sparse representations improve network robustness and stability.
problem The benefits of sparse representations in artificial networks.
method Analysis of sparse networks with sparse weights and activations, simulations on MNIST and Google Speech Command Dataset.
result Sparse networks show significantly improved robustness and stability compared to dense networks.
A new method for estimating causal effects using synthetic controls.
problem Evaluating causal effects of policy changes in settings with observational data.
method Distributional Synthetic Controls method.
result Allows construction of entire synthetic distributions for the treated unit.
IllinoisSL is a Java library for learning structured prediction models. It supports structured Support Vector Machines and structured Perceptron. The library consists of a core learning module and several applications, which can be executed from command-lines. Documentation is provided to guide users. In Comparison to …
A hierarchical DNN model for end-to-end driving tasks.
problem End-to-end driving tasks with various challenges.
method Hierarchical multi-task DNN architecture with subservient networks for specific tasks.
result Reduction in training data and tailored model complexity for different tasks.
New dataset for UAV gesture recognition in outdoor settings.
problem Lack of public outdoor UAV gesture recognition datasets.
method Recorded 13 gestures in an outdoor setting, created 119 HD video clips, annotated with body joints and gesture classes.
result Baseline gesture recognition performance of 91.9% using P-CNN.
Paper optimizes KWS models using NAS and quantization for limited resources.
problem Developing efficient keyword spotting models in resource-constrained environments.
method Neural Architecture Search (NAS) for model structure optimization and quantization of weights and activations.
result Achieved high accuracy (95.55%) with minimal parameters and operations using NAS and quantization.
SANAS adapts neural network architecture in real-time for efficient keyword spotting.
problem Efficiently identifying keywords in real-time audio streams with minimal computational cost.
method Stochastic Adaptive Neural Architecture Search (SANAS) that dynamically adjusts network size based on task difficulty.
result SANAS achieves high keyword recognition accuracy with significantly reduced computational cost.
GenéLive! generates rhythm game commands with musical structure.
problem Generating accurate rhythm commands in music games.
method Deep generative model that considers musical structures.
result Reduced business cost by half at KLab Inc.
Network analysis reveals changing cryptocurrency market leaders.
problem Understanding evolving cryptocurrency market leaders and their influence.
method Hourly-resolution data and Kendall's Tau correlation for network analysis.
result Pearson's correlation underestimates market dynamics; FTT and FTX were key during the 2021 bull run.
This two-part work puts forth the idea of engaging power electronics to probe an electric grid to infer non-metered loads. Probing can be accomplished by commanding inverters to perturb their power injections and record the induced voltage response. Once a probing setup is deemed topologically observable by the tests o…
Study evaluates consistency of LLMs in binary text classification, providing systematic guidance.
problem Lack of reliable methods for evaluating large language model (LLM) binary text classification.
method Adapting psychometric principles, the study determines sample size requirements, develops metrics for invalid responses, and evaluates intra- and inter-rater reliability.
result LLMs demonstrated high intra-rater consistency, achieving perfect agreement on 90-98% of examples, with smaller models outperforming larger counterparts.
System identifies and responds to help queries in personal assistants.
problem Difficulty in remembering command structures for various tasks in personal assistants.
method Proposes a C-BiLSTM based classifier and semantic ANN module to detect and respond to help queries.
result System outperforms other approaches in returning relevant responses for help queries.
SparseChem speeds up ML for small molecules.
problem Training fast and accurate ML models for high-dimensional data.
method Supports millions of features and compounds, trains various models.
result Fast and accurate machine learning models for biochemical applications.
Improved AI patent classifier measures U.S. and China's AI patenting.
problem Measuring AI patents with high precision and generalization.
method Fine-tuning PatentSBERTa on manually labeled data from USPTO's AI Patent Dataset.
result Rapid growth in AI patenting in both countries, but different organizational patterns.
Neuro-symbolic system tackles conversational AI's need for natural, broad-ranging dialogue.
problem Understanding unstated presumptions in conversational AI commands.
method Neuro-symbolic theorem prover for multi-hop reasoning.
result Extracts multi-hop reasoning chains from natural language commands.
liquidSVM is a package written in C++ that provides SVM-type solvers for various classification and regression tasks. Because of a fully integrated hyper-parameter selection, very carefully implemented solvers, multi-threading and GPU support, and several built-in data decomposition strategies it provides unprecedented…
End-to-end driving network learns navigation and localization from raw data.
problem Lack of full action distribution and localization in end-to-end autonomous driving.
method Variational network for predicting control commands and deterministic navigation, probabilistic localization using noisy GPS.
result Model can predict full probability distribution over possible actions and navigate routes.
AI stocks hedge against AI singularity's economic impact.
problem AI singularity's displacement of consumption.
method Developed an asset pricing model with incomplete markets.
result AI stocks command a premium due to market incompleteness.
This paper extends adversarial attacks to produce desired class probability distributions.
problem Easily fooling deep learning models with imperceptible perturbations.
method Probabilistic framework to generate desired class probability distributions.
result The ability to closely approximate any probability distribution for classes while maintaining high fooling rates and preventing detection.
Entangled watermarks improve model defense against extraction attacks.
problem Model extraction attacks risk leaking valuable intellectual property.
method Entangled Watermarking Embeddings (EWE) leverages model capacity to overfit to outlier input-output pairs.
result The approach successfully claims model ownership with high confidence and minimal performance loss.
For later use in subsequent upcoming arxiv.org prepublications, basic foundational material on local, smooth or real analytic, CR-generic submanifolds of complex Euclidean spaces is developed from scratch, with strong emphasis on the interplay between extrinsic and intrinsic aspects, a constructive option that commands…
The paper provides theoretical guarantees for behavior cloning using generative models.
problem Behavior cloning of complex expert demonstrations using generative models.
method The paper proposes a theoretical framework invoking low-level controllers to stabilize imitation around expert demonstrations. It shows that with suitable low-level stability guarantees and powerful generative models, pure supervised behavior cloning can match expert trajectories.
result The paper proves that with a suitable low-level stability guarantee and a powerful enough generative model, pure supervised behavior cloning can generate trajectories matching the per-time step distribution of essentially arbitrary expert trajectories in an optimal transport cost.
CosmoVAE uses deep learning to fill in missing parts of the cosmic microwave background map.
problem Missing observations in the CMB map due to thermal dust noise.
method Variational autoencoder (VAE) trained with a new loss function.
result CosmoVAE achieves state-of-the-art performance in CMB map inpainting.
Generative compression technique reduces neural network size and improves performance on microcontrollers.
problem Memory constraints on microcontrollers limit the size of neural networks, especially for 1x1 pointwise (PW) mixers.
method HYPER-TINYPW uses a shared micro-MLP to generate PW kernels from tiny per-layer codes, reducing memory usage.
result HYPER-TINYPW achieves comparable performance to larger models while being significantly smaller (225 kB vs 1.4 MB).
SchNetPack 2.0 enhances atomistic machine learning with improved neural networks.
problem Improving atomistic machine learning methods and applications.
method Improved data pipeline, equivariant neural networks, PyTorch implementation, PyTorch Lightning, Hydra configuration framework.
result Easy extension and complex training tasks support.
Paper uses user engagement signals to automatically label training data for AI assistants.
problem Lack of annotated training data for AI assistants.
method Leverages user engagement signals for unsupervised entity labeling and data augmentation.
result Significant accuracy gains in sequence labeling tasks and user-facing results.
Improved SNNs for speech classification with PyTorch.
problem Training convolutional spiking neural networks efficiently.
method Supervised training using backpropagation through time, surrogate gradient, and novel connections.
result Achieved nearly state-of-the-art accuracy on speech classification task.
Large deep neural networks are powerful, but exhibit undesirable behaviors such as memorization and sensitivity to adversarial examples. In this work, we propose mixup, a simple learning principle to alleviate these issues. In essence, mixup trains a neural network on convex combinations of pairs of examples and their …
SeqAttnGAN generates interactive images based on multi-turn text descriptions.
problem Interactive image editing with multi-turn textual commands.
method SeqAttnGAN uses a neural state tracker and GAN framework for sequential image generation and refinement.
result SeqAttnGAN outperforms state-of-the-art models on interactive image editing tasks.
Simplified plug-in loss approximates EDL for reliable uncertainty estimation.
problem Efficient and reliable uncertainty estimation in real-world sensor-based learning systems.
method Approximate Dirichlet expected objectives with plug-in losses evaluated at the Dirichlet mean.
result Plug-in losses provide comparable predictive accuracy and selective prediction performance to classical EDL, while being simpler to implement.
SOL is an open-source library for scalable online learning algorithms, and is particularly suitable for learning with high-dimensional data. The library provides a family of regular and sparse online learning algorithms for large-scale binary and multi-class classification tasks with high efficiency, scalability, porta…
Braidlab is a Matlab package for analyzing data using braids. It was designed to be fast, so it can be used on relatively large problems. It uses the object-oriented features of Matlab to provide a class for braids on punctured disks and a class for equivalence classes of simple closed loops. The growth of loops under …
We consider the problem of generating automatic code given sample input-output pairs. We train a neural network to map from the current state and the outputs to the program's next statement. The neural network optimizes multiple tasks concurrently: the next operation out of a set of high level commands, the operands of…
Hybrid approach combines ASTs and deep learning for PowerShell malware detection.
problem Detecting malicious PowerShell scripts effectively.
method Combining static program analysis (ASTs) with deep learning.
result Preliminary results show promising classification of PowerShell scripts by family type.
OpenGM is a C++ template library for defining discrete graphical models and performing inference on these models, using a wide range of state-of-the-art algorithms. No restrictions are imposed on the factor graph to allow for higher-order factors and arbitrary neighborhood structures. Large models with repetitive struc…
New dataset for evaluating speech recognition fairness across demographics.
problem Lack of fairness metrics in speech recognition datasets.
method Developed Fair-Speech dataset with diverse demographic information.
result Helps evaluate ASR models for fairness across demographics.