IT Services Circle
May 1, 2026 · Artificial Intelligence
GPT’s Father Sends AI Back to 1930: An AI That Writes Python Without Seeing Code
Alec Radford’s team released Talkie, a 13‑billion‑parameter LLM trained exclusively on pre‑1931 texts (2600 billion tokens), which surprisingly can generate correct Python programs via few‑shot learning, demonstrating genuine reasoning rather than mere memorisation, and the article details its experiments, data‑quality challenges, comparative performance, and ambitious scaling roadmap.
Model ScalingOCR data qualityfew‑shot programming
0 likes · 8 min read
