Tag

LLM.c

0 views collected around this technical thread.

IT Services Circle

Jun 7, 2024 · Artificial Intelligence

Reader – One‑Click URL to LLM‑Friendly Input, and llm.c – C/CUDA LLM Training Tool

This article introduces Reader, an open‑source Jina AI tool that converts any web URL into a format optimized for large language models, and llm.c, a minimalist C and CUDA project that demonstrates how to train a GPT‑2‑style LLM from scratch.

C++CUDAJina AI

0 likes · 4 min read

Reader – One‑Click URL to LLM‑Friendly Input, and llm.c – C/CUDA LLM Training Tool

IT Services Circle

May 2, 2024 · Artificial Intelligence

LLM.c: A 1000‑Line C Implementation for Training GPT‑2

Andrej Karpathy’s LLM.c project demonstrates how a compact, pure‑C (and CUDA) codebase of roughly 1000 lines can train a GPT‑2 model, covering data preparation, memory management, layer implementations, compilation, and practical tips for running and testing the model on CPUs and GPUs.

AIC++CUDA

0 likes · 10 min read

LLM.c: A 1000‑Line C Implementation for Training GPT‑2