Hulu Beijing

Dec 7, 2017 · Artificial Intelligence

How Recurrent Neural Networks Generate Text Representations and Tackle Gradient Problems

This article explains what Recurrent Neural Networks are, how they create text representations, why they suffer from gradient vanishing or explosion, and what architectural improvements such as LSTM, GRU, residual connections and gradient clipping can do to overcome these issues.