Recurrent Layers

Recurrent layers are a common architecture for text and sequential data.

A recurrent layer shares weights iteratively across time. Todo.

• State Machines

• RNNs

• Backprop Through Time

• Relation between RNNs and Convolutions

• Gated RNNs – GRU, LSTM