Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,878 papers · 148 categories

Trend · papers per month

1122 · May 201919922001200920172026
11 results for autoaugment

Data augmentation is an essential technique for improving generalization ability of deep learning models. Recently, AutoAugment has been proposed as an algorithm to automatically search for augmentation policies from a dataset and has significantly enhanced performances on many image recognition tasks. However, its sea…

2019-05-01abs ↗pdf ↗

CutMix training technique improves spatial locality in Vision Transformers.

problem Improving spatial locality in Vision Transformers trained from scratch.
method Comparison of Baseline and Modern training protocols on CIFAR-10, CIFAR-100, and Tiny-ImageNet.
result CutMix training component significantly reduces Mean Attention Distance (MAD) in early layers of Vision Transformers.

ReMixMatch improves semi-supervised learning with new techniques for data efficiency.

problem Improving semi-supervised learning with limited labeled data.
method Distribution alignment and augmentation anchoring with AutoAugment.
result Significantly more data-efficient, requiring less labeled data for similar accuracy.

Data augmentation is an effective technique for improving the accuracy of modern image classifiers. However, current data augmentation implementations are manually designed. In this paper, we describe a simple procedure called AutoAugment to automatically search for improved data augmentation policies. In our implement…

2018-05-24abs ↗pdf ↗

New insights into data augmentation for improving robustness in computer vision.

problem Challenges in achieving robustness to distributional shift in computer vision.
method Investigation of trade-offs between robustness to high and low frequency corruptions using Gaussian data augmentation and adversarial training.
result Improvements in robustness to high frequency corruptions come at the cost of reduced robustness to low frequency corruptions.

Study linear transformations' effects on data augmentation for improved estimation.

problem Improving performance in image and text classification tasks.
method Examined a family of linear transformations in over-parametrized linear regression settings.
result Transformations that preserve labels or mix data can improve estimation.

New research shows flat minima in robust loss landscapes correlate with good adversarial robustness.

problem Adversarial training leads to robust overfitting, poor robust generalization.
method Average- and worst-case metrics to measure flatness in robust loss landscapes.
result Flatness in robust loss landscapes correlates with good adversarial robustness.