AlgebraNetscs.LG
AlgebraNets use alternative algebras for neural networks, improving performance on image and language tasks.
problem Improving neural network performance on large-scale image and language tasks.
method Considered alternative algebras (C, H, M2(R), M2(C), M3(R), M4(R)) for activations and weights, and studied their performance on ImageNet and enwiki8 datasets.
result Alternative algebras deliver better parameter and computational efficiency compared with real numbers, especially in sparse and auto-regressive inference scenarios.