Teacher forcing and batchnorm

Two things you may want to add:

1.  Teacher forcing for RNNs (very common in practice).  With a cheatsheet, you won't be able to cover everything, and this may just be nice to have, but it looks like you have the space for it.
2.  Batchnorm is also a regularizer.