SWAG outperforms traditional neural networks on complex tasks.
problem Improving neural network performance on complex, non-linear tasks.
method SWAG uses a polynomial basis of activation functions in each layer.
result SWAG outperforms state-of-the-art neural networks in convergence and performance.