Novel anti-grokking phase discovered in neural networks, revealed by HTSR layer quality metric.
problem Understanding and detecting overfitting in neural networks.
method 3-layer MLP, weight decay, HTSR layer quality metric , correlation traps, Kolmogorov–Smirnov tests.
result Anti-grokking phase detected late in training, revealed by and correlation traps.