End-to-end speech recognition using EEG without speech input.
problem Speech recognition without direct speech input.
method Implemented attention model and CTC-based ASR systems for EEG signals; fused EEG with noisy speech features.
result Demonstrated end-to-end speech recognition using EEG signals.
End-to-end learning refers to training a possibly complex learning system by applying gradient-based learning to the system as a whole. End-to-end learning system is specifically designed so that all modules are differentiable. In effect, not only a central learning machine, but also all "peripheral" modules like repre…
Simple physical modifications can fool autonomous driving systems.
problem Vulnerability of autonomous driving models to adversarial attacks.
method Demonstrated end-to-end attacks on autonomous driving using simple physical modifications.
result Simple physical modifications can induce activation patterns similar to different scenarios used in training, fooling autonomous driving models.
Learning to drive faithfully in highly stochastic urban settings remains an open problem. To that end, we propose a Multi-task Learning from Demonstration (MT-LfD) framework which uses supervised auxiliary task prediction to guide the main task of predicting the driving commands. Our framework involves an end-to-end tr…
EEG signals enhance speaker verification system robustness.
problem Improving speaker verification in noisy environments.
method Used end-to-end deep learning model with EEG and speech features.
result EEG signals improve speaker verification robustness, especially in noisy conditions.
End-to-end neural network based approaches to audio modelling are generally outperformed by models trained on high-level data representations. In this paper we present preliminary work that shows the feasibility of training the first layers of a deep convolutional neural network (CNN) model to learn the commonly-used l…
End-to-end autonomous driving models get better uncertainty estimates.
problem Uncertainty quantification for end-to-end autonomous driving models.
method Approximate inference for implicit copula neural linear model.
result Densities for steering angle are marginally calibrated.
End-to-end graph-based SSL learns all graph factors dynamically.
problem Learning quality of graph in SSL is crucial but difficult.
method Proposes an end-to-end approach to optimize all graph factors.
result Demonstrates effectiveness on benchmark datasets.
End-to-end policy learning improves statistical arbitrage trading.
problem Traditional mean reversion trading strategies in statistical arbitrage are limited.
method We use Autoencoder architectures and policy learning to develop trading strategies.
result End-to-end training yields superior gross returns.
New algorithm improves causal effect estimation for continuous treatments.
problem Observational causal inference with continuous treatments.
method End-to-end entropy balancing for maximizing causal inference accuracy.
result Our algorithm estimates causal effect more accurately than baseline.
Improved speech recognition using EEG and video.
problem Enhancing continuous speech recognition systems.
method Implemented a CTC-based ASR model using EEG features.
result EEG features improve continuous visual speech recognition.
Proposes an end-to-end deep learning framework for active investing.
problem Constructing an active investment portfolio via deep learning.
method End-to-end deep learning framework covering factor selection, combination, stock selection, and portfolio construction.
result Demonstrates effectiveness of E2E deep learning framework in active investing.
A new method learns representations without end-to-end backpropagation.
problem Learning representations without labeled data and end-to-end backpropagation.
method Gradient-isolated modules trained using InfoNCE bound.
result Top module's representations yield competitive results on downstream tasks.
WEEND uses a neural network to recognize speech and assign speakers to words.
problem End-to-end neural diarization without additional ASR and orchestration.
method Multi-task learning with an auxiliary network for ASR and speaker diarization.
result WEEND outperforms turn-based diarization and can handle 5-minute audio.
Machine reading using differentiable reasoning models has recently shown remarkable progress. In this context, End-to-End trainable Memory Networks, MemN2N, have demonstrated promising performance on simple natural language based reasoning tasks such as factual reasoning and basic deduction. However, other tasks, namel…
End-to-end learning of codes for secure BPSK communication in Gaussian wiretap channel.
problem Secure communication in the presence of an adversary for BPSK modulation.
method Learning finite-length codes using deep neural networks (DNNs) with mutual information estimation.
result Learned codes achieve near-optimal security performance, as demonstrated by numerical results.
End-to-end autonomous driving models are vulnerable to simple physical manipulations of images.
problem Vulnerability of end-to-end autonomous driving models to subtle adversarial manipulations of images.
method Developed novel end-to-end attacks using simple physical manipulations (painting black lines on the road) and used Bayesian Optimization to efficiently search for successful attacks.
result Simple physical manipulations can cause autonomous driving models to follow unintended paths, highlighting the vulnerability of these models.
End-to-end learnable network for safer self-driving with interpretable intermediate representations.
problem Safe motion planning for self-driving vehicles.
method Differentiable semantic occupancy representation for cost calculation in motion planning.
result Significantly outperforms state-of-the-art planners in imitating human behaviors and producing safer trajectories.
Guided Learning improves end-to-end modeling for multi-stage decision-making.
problem Challenges in training unified neural networks for multi-stage decision-making.
method Guided Learning framework with a guide function and utility function.
result Significant improvement in performance over traditional methods.
Streaming ASR with transformer achieves low WER.
problem Real-time ASR with speech recognition.
method Time-restricted self-attention and triggered attention mechanisms.
result 2.8% and 7.2% WER for LibriSpeech test data.
Proposes a new method for decision-aware learning in optimization.
problem Contextual linear optimization with cost prediction errors.
method Reweighing prediction error by decision regret for decision-aware predictor.
result Improves over predict-then-optimize framework for misspecified models.
This paper presents KeypointNet, an end-to-end geometric reasoning framework to learn an optimal set of category-specific 3D keypoints, along with their detectors. Given a single image, KeypointNet extracts 3D keypoints that are optimized for a downstream task. We demonstrate this framework on 3D pose estimation by pro…
We propose a novel end-to-end neural network architecture that, once trained, directly outputs a probabilistic clustering of a batch of input examples in one pass. It estimates a distribution over the number of clusters k, and for each 1≤k≤kmax, a distribution over the individual cluster assignm…
A new type of End-to-End system for text-dependent speaker verification is presented in this paper. Previously, using the phonetically discriminative/speaker discriminative DNNs as feature extractors for speaker verification has shown promising results. The extracted frame-level (DNN bottleneck, posterior or d-vector) …
End-to-end method for robot localization in simulated and real environments.
problem Generating robot actions to maximize pose disambiguation in a reference map.
method Differentiable learning of perception and planning modules, using convolutional neural networks and deep reinforcement learning.
result The system outperforms traditional approaches for perception or planning.
End-to-end portfolio optimization framework bypassing covariance matrix estimation.
problem Optimizing portfolios with large numbers of assets and constraints.
method Deep learning approach that directly optimizes asset distributions without forecasting.
result Framework outperforms classical methods and handles various constraints.
Differentiable clustering method using perturbed spanning forests.
problem Efficient clustering in trainable pipelines with noisy data.
method Stochastic perturbations of minimum-weight spanning forests.
result Method performs well even in challenging settings.
Deep learning improves options trading without market assumptions.
problem Traditional options trading requires market dynamics and pricing models.
method End-to-end deep learning approach that learns from market data.
result Deep learning models outperform existing trading strategies.
Citizen science projects are successful at gathering rich datasets for various applications. However, the data collected by citizen scientists are often biased --- in particular, aligned more with the citizens' preferences than with scientific objectives. We propose the Shift Compensation Network (SCN), an end-to-end l…
Structured Prediction Energy Networks (SPENs) are a simple, yet expressive family of structured prediction models (Belanger and McCallum, 2016). An energy function over candidate structured outputs is given by a deep network, and predictions are formed by gradient-based optimization. This paper presents end-to-end lear…
Proposes Equity2Vec for cross-sectional asset pricing.
problem Sub-optimal performance due to missing cross-sectional effects and heterogeneous data.
method End-to-end deep learning framework with Equity2Vec for graph-based interactions and all alpha sources.
result Outperforms state-of-the-art approaches in real-world stock market datasets.
Differentiable perturbed optimizers enable end-to-end learning of discrete decisions.
problem Discrete decisions in machine learning pipelines break back-propagation.
method Transform optimizers into differentiable operations using stochastically perturbed optimizers.
result Smoothness of derivatives can be tuned via noise amplitude.
End-to-end neural network improves QbE-STD in multilingual speech search.
problem Query by example spoken term detection in zero-resource scenarios.
method Use of multilingual bottleneck features and CNN for pattern matching, integrated into a fully neural network framework.
result CNN-based matching outperforms DTW-based matching using bottleneck features.
PyODDS automates outlier detection for new data sources.
problem Manual outlier detection is inefficient and domain-specific.
method Automated end-to-end system with Apache Spark and database support.
result PyODDS optimizes outlier detection pipelines automatically.
End-to-end image super-resolution using Attention-based DenseNet with residual deconvolution.
problem Challenging task of improving low-resolution images.
method Proposes a novel ADRD model with weighted dense blocks and spatial attention modules.
result Demonstrates promising performance on publicly available datasets.
Proposes neural dynamic mode decomposition for end-to-end modeling of nonlinear dynamics.
problem Understanding and modeling nonlinear dynamical systems.
method Trains neural networks to minimize forecast error based on spectral decomposition in the lifted space.
result Demonstrates effectiveness in eigenvalue estimation and forecast performance.
We present NAVREN-RL, an approach to NAVigate an unmanned aerial vehicle in an indoor Real ENvironment via end-to-end reinforcement learning RL. A suitable reward function is designed keeping in mind the cost and weight constraints for micro drone with minimum number of sensing modalities. Collection of small number of…
End-to-end portfolio system accounts for model risk.
problem Model risk in portfolio selection.
method Distributionally robust optimization with convex duality.
result Explicitly accounts for model risk in portfolio selection.
Hybrid model for online nonlinear prediction using LSTM and soft GBDT.
problem Online nonlinear prediction with manual feature selection and model selection issues.
method End-to-end architecture with LSTM for feature extraction and soft GBDT for regression, jointly optimized.
result Significant performance improvements over conventional methods on real datasets.
Cilia are hairlike structures protruding from nearly every cell in the body. Diseases known as ciliopathies, where cilia function is disrupted, can result in a wide spectrum of disorders. However, most techniques for assessing ciliary motion rely on manual identification and tracking of cilia; this process is laborious…
The idea of end-to-end learning of communications systems through neural network -based autoencoders has the shortcoming that it requires a differentiable channel model. We present in this paper a novel learning algorithm which alleviates this problem. The algorithm iterates between supervised training of the receiver …
Regularization is important for end-to-end speech models, since the models are highly flexible and easy to overfit. Data augmentation and dropout has been important for improving end-to-end models in other domains. However, they are relatively under explored for end-to-end speech models. Therefore, we investigate the e…
Develops Bayesian approach for end-to-end learning in stochastic optimization.
problem Stochastic optimization problems under uncertainty.
method Bayesian interpretation and new end-to-end learning algorithms.
result Improved decision maps for empirical risk minimization and distributionally robust optimization.
End-to-end graph SVM with graph convolutions and RKHS.
problem Graph classification with complex feature spaces.
method End-to-end training of graph convolutions, kernel function, and SVM parameters.
result Outperforms existing deep learning models on graph classification tasks.
Develops deep learning model for detecting anomalies in transportation data.
problem Anomaly detection in temporal data of transportation networks.
method Proposes EVT-LSTM model combining LSTM and EVT, trained with an objective function.
result EVT-LSTM model outperforms other models in anomaly detection.
The idea of end-to-end learning of communication systems through neural network-based autoencoders has the shortcoming that it requires a differentiable channel model. We present in this paper a novel learning algorithm which alleviates this problem. The algorithm enables training of communication systems with an unkno…
End-to-end training of DBMs with improved gradient estimation.
problem Biased gradient estimation in DBMs, especially with high-dimensional states.
method Unbiased contrastive divergence using MH coupling and local mode initialization.
result End-to-end training of DBMs without greedy pretraining, achieving FID score of 10.33 for MNIST.
RawNet synthesizes speech without relying on human-designed features.
problem Speech synthesis models rely heavily on human-designed spectral features.
method End-to-end neural vocoder using auto-encoder structure, learning features and audio recovery directly from raw waveform.
result RawNet achieves better speech quality with a simplified model architecture and faster inference speed.