Baobao Algorithm Notes

Jul 13, 2024 · Artificial Intelligence

Which LLM Generates Tokens Fastest? A Real‑World Speed Benchmark Across Major Models

This article presents a practical Python benchmark that measures token‑per‑second generation speed of various large language models—including GPT‑4o, glm‑4‑airx, and moonshot‑v1‑32k—by timing text generation on a Colab environment and summarizing the results in detailed tables and visual charts.