Full-capacity uRNNs improve performance over restricted-capacity ones.
problem Vanishing and exploding gradient issues in recurrent neural networks.
method Optimized full-capacity unitary recurrence matrices over all unitary matrices.
result Significantly improved performance compared to LSTMs and restricted-capacity uRNNs.