Expert augmentation improves hybrid model generalization.
problem Limited generalization of hybrid models outside training distribution.
method Introducing expert augmentation to improve hybrid model performance.
result Expert augmentation improves generalization of hybrid models.
In this paper, a new deep reinforcement learning based augmented general sequence tagging system is proposed. The new system contains two parts: a deep neural network (DNN) based sequence tagging model and a deep reinforcement learning (DRL) based augmented tagger. The augmented tagger helps improve system performance …
ARDA automatically augments datasets for machine learning models.
problem Improving machine learning model performance through data augmentation.
method ARDA combines data searching, joining, and feature selection to augment datasets.
result Training models on ARDA's augmented datasets leads to better performance.
Aug-Gen improves music generation by augmenting training data with model-produced examples.
problem Lack of high-quality training data for specific musical styles.
method Dataset augmentation using generated examples during training.
result Aug-Gen improves both training duration and quality of generated music.
Proposes neural delay differential equations for stable system identification with partially observed states.
problem Learning stable models for systems with partial or delayed observations.
method Augments states with history, uses neural delay differential equations, and ensures stability through time delay analysis.
result The approach ensures stability of learned models for partially observed systems.
We study the geometry of fully augmented link complements in S3 by looking at their link diagrams. We extend the method introduced by Thistlethwaite and Tsvietkova to fully augmented links and define a system of algebraic equations in terms of parameters coming from edges and crossings of the link diagrams. Combinin…
We classify the simple sheaves microsupported along the conormal bundle of a knot. We also establish a correspondence between simple sheaves up to local systems and augmentations, explaining the underlying reason why knot contact homology representations detect augmentations.
SpecAugment improves speech recognition with simple feature augmentation.
problem Improving automatic speech recognition accuracy.
method Applying warping, frequency channel masking, and time step masking to feature inputs of neural networks.
result Achieved state-of-the-art performance on LibriSpeech and Switchboard tasks.
SONODEs and ANODEs improve learning of second order dynamics.
problem Learning dynamics governed by second order laws.
method Extended adjoint sensitivity method and theoretical analysis of ANODEs.
result SONODEs and ANODEs can learn higher order dynamics efficiently.
Improved neural PDEs trained on augmented data enhance model accuracy and efficiency.
problem Training neural PDEs on limited data to accurately represent complex systems.
method Space-filling sampling of local states to generate augmented training data.
result Data-augmented neural PDEs outperform traditional emulators in accuracy and stability.
Proposes a new model for better speech segmentation.
problem Improving speech segmentation accuracy.
method Integrates recurrent explicit duration variables into rSLDS and uses Pólya-gamma augmentation for inference.
result Demonstrates improved segmentation on various datasets.
Noise Collector detects sparse signals from noisy data efficiently.
problem Efficiently detecting sparse signals from noisy high-dimensional data.
method Introduces Noise Collector (NC) matrix to solve augmented system Aρ+Cη=b0+e. result The l1-norm minimal solution of the augmented system has zero false discovery rate for any level of noise. Enhanced EEG classification using augmented covariance matrix.
problem Improving motor imagery classification from EEG signals.
method Proposes a new framework based on the augmented covariance matrix derived from an autoregressive model.
result The augmented covariance matrix outperformed state-of-the-art methods.
Mixes higher-order simplicial complexes for data augmentation.
problem Lack of labeled data for complex systems with multiway interactions.
method Proposes mixup mechanisms for simplicial complexes, including linear and nonlinear mixup, and a convex clustering mixup.
result Synthetic simplicial complexes interpolate between existing data based on homomorphism densities.
The paper defines a new coordinate system for anti-de Sitter structures.
problem Understanding the geometry of anti-de Sitter spaces.
method Combining recent work on anti-de Sitter structures with classical theory.
result Introduced a coordinate system resembling Fenchel-Nielsen coordinates.
Symmetry augmentation speeds up learning in robotics tasks.
problem Learning efficiency in robotics tasks with limited data.
method Data augmentation using symmetry in the quadruped domain of DeepMind control suite.
result Agent learns faster with augmented symmetry experiences.
This paper explores the use of adversarial examples in training speech recognition systems to increase robustness of deep neural network acoustic models. During training, the fast gradient sign method is used to generate adversarial examples augmenting the original training data. Different from conventional data augmen…
Deep multitask learning boosts performance by sharing learned structure across related tasks. This paper adapts ideas from deep multitask learning to the setting where only a single task is available. The method is formalized as pseudo-task augmentation, in which models are trained with multiple decoders for each task.…
This work proposes an augmented variant of DebtRank with uncertainty intervals as a method to investigate and assess systemic risk in financial networks, in a context of incomplete data. The algorithm is tested against a default contagion algorithm on three ensembles of networks with increasing density, estimated from …
Herein, we present a system for hyperspectral image segmentation that utilizes multiple class--based denoising autoencoders which are efficiently trained. Moreover, we present a novel hyperspectral data augmentation method for labelled HSI data using linear mixtures of pixels from each class, which helps the system wit…
Improves fairness in machine learning by adding underrepresented group data.
problem Machine learning biases across subgroups due to under-representation or societal biases.
method Data augmentation via pairwise mixup across subgroups to balance subpopulations.
result Achieves fair outcomes with robust if not improved accuracy.
WeSinger improves singing voice synthesis with data augmentation and specialized modules.
problem Improving the accuracy and naturalness of synthesized singing voices.
method Developed a multi-singer Chinese neural singing voice synthesis system with deep bi-directional LSTM, Transformer, LPCNet, and data augmentation.
result WeSinger achieves state-of-the-art performance on the Opencpop corpus.
This paper will explore the use of autoencoders for semantic hashing in the context of Information Retrieval. This paper will summarize how to efficiently train an autoencoder in order to create meaningful and low-dimensional encodings of data. This paper will demonstrate how computing and storing the closest encodings…
End-to-end speech recognition system trained on GPUs and CPUs.
problem Building state-of-the-art speech recognition systems.
method Utilizes CPUs and GPUs for training, data augmentation, and neural network updates. Uses vocal tract length perturbation and acoustic simulator for data augmentation. Employed Horovod allreduce for training.
result Achieved 7.92% WER on proprietary English Bixby open domain test set using a Bidirectional Full Attention (BFA) model.
A novel method uses GPLFMs for joint input-state estimation in linear structural systems.
problem Combined state and input estimation of linear structural systems.
method Gaussian process latent force models (GPLFMs) combined with Kalman filters.
result GPLFMs outperform conventional Kalman filters in state and input estimation.
New method learns dynamics from sparse data using geometric constraints.
problem Learning dynamics from sparse, undersampled data.
method Reformulates inference as a stochastic control problem, using geometry-driven path augmentation.
result Accurately recovers stochastic dynamics from extremely undersampled data.
Benchmark evaluates AI-generated financial QA hallucinations, highlighting system vulnerabilities.
problem Ensuring factual accuracy of AI-generated financial QA outputs.
method Developed a benchmark dataset and evaluated six detection methods under clean and noisy conditions.
result LLM-based judges and embedding methods perform best, but degrade under noisy conditions.
We present our first efforts in building an automatic speech recognition system for Somali, an under-resourced language, using 1.57 hrs of annotated speech for acoustic model training. The system is part of an ongoing effort by the United Nations (UN) to implement keyword spotting systems supporting humanitarian relief…
Patch Gaussian augmentation improves model robustness without sacrificing accuracy.
problem Challenges in building robust models without sacrificing accuracy.
method Adds Gaussian noise to randomly selected patches in images.
result Achieves state-of-the-art performance on benchmarks while improving clean data accuracy.
New method solves constrained optimization problems efficiently.
problem Equality-constrained nonlinear, nonconvex optimization problems.
method Adaptive inexact Newton method with randomized iterative sketching.
result Global almost sure convergence and local linear/superlinear convergence.
This work improves fairness in federated learning by using zero-shot data augmentation.
problem Statistical heterogeneity leads to biased and less uniform accuracy across clients in federated learning.
method Proposes a federated learning system with zero-shot data augmentation to mitigate statistical heterogeneity and improve fairness.
result Empirical results show improved test accuracy and fairness across clients.
AI system helps clinicians assess liver metastases quickly and with explanations.
problem Manual assessment of metastases is time-consuming and subjective.
method Interactive AI system with model interpretability.
result AI-assisted assessment improves efficiency and provides explanations.
Effective training of neural networks requires much data. In the low-data regime, parameters are underdetermined, and learnt networks generalise poorly. Data Augmentation alleviates this by using existing data more effectively. However standard data augmentation produces only limited plausible alternative data. Given t…
SOAD model improves data assimilation for nonlinear systems.
problem Challenges in classical data assimilation with high nonlinearity.
method State-Observation Augmented Diffusion (SOAD) model for data-driven assimilation.
result SOAD model matches true posterior distribution under mild assumptions.
GANs generate new traffic sign images to improve recognition accuracy.
problem Lack of data limits SqueezeNet's performance in traffic sign recognition.
method Applied pix2pix GANs to translate symbolic sign images to real ones for data augmentation.
result Data augmentation with GANs increased classification accuracy for traffic signs.
E-Stitchup augments pre-trained embeddings for better model performance and confidence calibration.
problem Improving classification accuracy and confidence calibration of models using pre-trained embeddings.
method Data augmentation methods inspired by Mixup combined with label softening.
result Significantly increased classification accuracy and reduced training time.
SBA improves neural network generalization by dynamically augmenting data.
problem Lack of direct supervision in data augmentation for generalization.
method Stochastic Batch Augmentation with dynamic soft label regularization.
result SBA improves generalization and speeds up training.
New algorithms tackle data challenges in physics model selection.
problem Lack of labeled data, high dimensionality, and inapplicability of data augmentation techniques to physics data.
method Two algorithms: feature selection and data augmentation combined with classifiers and stacking ensemble.
result Achieved 90% accuracy on nonlinear structural mechanics classification problem.
Memory-Augmented Meta-Optimization improves cold-start recommendation.
problem Cold-start problem in recommender systems for new users or items.
method Memory-Augmented Meta-Optimization approach with personalized and task-specific memories.
result Significant improvement in cold-start recommendation performance on multiple datasets.
Adaptive financial dataflow system improves model robustness in dynamic markets.
problem Static historical data leads to poor performance in dynamic financial markets.
method Drift-aware dataflow system with adaptive control and optimization.
result Enhanced model robustness and improved risk-adjusted returns.
Telephonetic improves robustness of neural language models to ASR errors.
problem Handling ASR errors and semantic noise in neural language models trained on written text.
method Data augmentation framework using character-level and embedding space perturbations.
result Achieves state-of-the-art perplexity of 37.49 on Penn Treebank corpus.
SRNNs learn dynamics of physical systems from data.
problem Learning dynamics of complex, noisy Hamiltonian systems.
method SRNNs model Hamiltonian functions with neural networks, using symplectic integration and optimization.
result SRNNs reliably learn dynamics of complex and noisy Hamiltonian systems.
Given an iterated function system (IFS) of contractive similitudes, the theory of Gromov hyperbolic graph on the IFS has been established recently. In the paper, we introduce a notion of simple augmented tree which is a Gromov hyperbolic graph. By generalizing a combinatorial device of rearrangeable matrix, we show tha…
Deep learning models misclassify malware with added benign features.
problem Detecting malware with deep learning when it's mixed with benign code.
method Trained a deep neural network classifier using benign and malware features. Demonstrated the impact of adding benign features to malware. Used data augmentation to improve classifier robustness.
result Adding benign features to malware significantly increases false negatives.
While recent progress has spawned very powerful machine learning systems, those agents remain extremely specialized and fail to transfer the knowledge they gain to similar yet unseen tasks. In this paper, we study a simple reinforcement learning problem and focus on learning policies that encode the proper invariances …
Categorical distributions are ubiquitous in machine learning, e.g., in classification, language models, and recommendation systems. However, when the number of possible outcomes is very large, using categorical distributions becomes computationally expensive, as the complexity scales linearly with the number of outcome…
RoyalFlush system improves multi-speaker ASR in M2MeT challenge.
problem Improving multi-speaker automatic speech recognition in noisy environments.
method Front-end processing with WPE and beamforming, data augmentation, and fusion of two ASR models.
result 12.22% absolute CER reduction on validation set and 12.11% on test set compared to baseline.
DisARM improves gradient estimation for binary latent variables.
problem Challenges in training models with discrete latent variables.
method Uses antithetic sampling over continuous augmentation.
result DisARM consistently outperforms ARM and baseline methods in log-likelihood and variance.