Skip to content
Tagged articles

Layer Normalization

3 articles · Page 1 of 1
Code Archaeology
Code Archaeology
Oct 10, 2025 · Artificial Intelligence

Transformer Explained: Self-Attention, Positional Encoding & Encoder-Decoder Code

This article explains the Transformer architecture from "Attention Is All You Need", covering self-attention, multi-head attention, layer normalization, positional encoding, and the encoder-decoder structure with PyTorch code, showing how Transformers enable parallel sequence processing without recurrence.

Attention Is All You NeedEncoder-DecoderLayer Normalization
0 likes · 10 min read
Transformer Explained: Self-Attention, Positional Encoding & Encoder-Decoder Code
Baobao Algorithm Notes
Baobao Algorithm Notes
Nov 13, 2023 · Artificial Intelligence

Mastering LLM Fundamentals: Tokenizers, Layer Norm, and PEFT Explained

This article provides a comprehensive technical guide on large language model fundamentals, covering tokenizer construction methods such as BPE, WordPiece, and SentencePiece, detailed explanations of Layer Normalization variants, Deep Norm concepts with code, and an overview of parameter‑efficient fine‑tuning techniques like LoRA and PEFT.

LLMLayer NormalizationPEFT
0 likes · 36 min read
Mastering LLM Fundamentals: Tokenizers, Layer Norm, and PEFT Explained