SRatio enhances simple models using complex models' insights.
problem Improving performance of simple models like decision trees and shallow networks.
method SRatio method reweights a training dataset for simple models using complex models' information and per-sample hardness estimates.
result Outperforms competitors on 16 out of 27 UCI datasets and CIFAR-10 cases, approaching complex model's performance.