Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,694 papers · 148 categories

Trend · papers per month

0.3%0.5%0.8%0.1% · Aug 202219922001200920172026
6 results for CutMix

CutMix enhances feature learning in neural networks, improving test accuracy.

problem Understanding and improving feature learning in neural networks using patch-level augmentation.
method Three distinct methods: vanilla training, Cutout training, and CutMix training were studied.
result CutMix training yields the highest test accuracy and learns all features and noise vectors evenly.

CutMix training technique improves spatial locality in Vision Transformers.

problem Improving spatial locality in Vision Transformers trained from scratch.
method Comparison of Baseline and Modern training protocols on CIFAR-10, CIFAR-100, and Tiny-ImageNet.
result CutMix training component significantly reduces Mean Attention Distance (MAD) in early layers of Vision Transformers.

FMix improves model performance by distorting learned functions without distorting data distribution.

problem Improving model robustness and generalization performance in mixed sample data augmentation.
method Proposes FMix, an MSDA using random binary masks generated from Fourier space.
result FMix outperforms MixUp and CutMix, achieving state-of-the-art results on CIFAR-10.

Unified theory explains how data augmentation improves deep learning models.

problem Understanding why data augmentation improves model generalization.
method Unified theoretical framework explaining two key effects: partial semantic feature removal and feature mixing.
result Data augmentation enhances generalization through partial semantic feature removal and feature mixing.

DeepIFSAC uses attention mechanisms and contrastive learning to impute missing values in tabular data.

problem Missing values in tabular data, especially when high and not random.
method Row and column attention in a contrastive learning framework with CutMix data augmentation.
result Proposed method outperforms state-of-the-art methods for missing rates between 10% and 90% and various missing value types.