Skip to content
Tagged articles

Recurrent Neural Networks

2 articles · Page 1 of 1
Code Archaeology
Code Archaeology
Sep 30, 2025 · Artificial Intelligence

RNNs, LSTM, and Attention: The Building Blocks Behind LLMs

This article explains how recurrent neural networks handle variable-length sequences, why LSTM's gated memory cells solve long-term dependency issues, and how attention mechanisms improve translation by weighting encoder hidden states, laying the groundwork for Transformer-based LLMs.

Attention MechanismGRULSTM
0 likes · 7 min read
RNNs, LSTM, and Attention: The Building Blocks Behind LLMs
Hulu Beijing
Hulu Beijing
Mar 12, 2019 · Artificial Intelligence

How LSTM Networks Achieve Long‑Term Memory: Mechanisms Explained

This article explains how Long Short‑Term Memory (LSTM) networks overcome the long‑term dependency problem of traditional recurrent neural networks by using gated cells that store and retrieve information over extended periods, and highlights their widespread applications in speech recognition, machine translation, image captioning, and beyond.

LSTMLong Short-Term MemoryRecurrent Neural Networks
0 likes · 5 min read
How LSTM Networks Achieve Long‑Term Memory: Mechanisms Explained