Infra Learning Club shares study notes, cutting-edge technology, and career discussions.
The article shows how adding Transform functions to client-go and controller-runtime informers trims metadata, cutting apiserver memory usage by up to 60% when watching hundreds of Secrets and ConfigMaps in large Kubernetes clusters.
This article explains the design of Kubernetes 1.32 Device Resource Allocation (DRA), detailing the four new CRDs, the roles of kube‑controller‑manager, kube‑scheduler and kubelet plugins, and the required admission webhook and RPC interfaces for managing device resources.
This guide walks through setting up an Ubuntu 22.04 environment, installing Docker, kind, the NVIDIA Container Toolkit, configuring the NVIDIA runtime as default, building and deploying the Kubernetes DRA driver, and running three demo scenarios that demonstrate GPU sharing across containers and pods in a Kubernetes 1.31 cluster.
This guide shows how to deploy the open‑source Tabby AI coding assistant with the Qwen2.5‑Coder‑1.5B‑Instruct model using Docker, register an admin account, configure the Tabby VS Code extension, and verify real‑time multi‑line code completion, all in a few minutes.
The article explains vLLM’s GPU compute capability requirement, describes the swap_space and cpu_offload_gb parameters, outlines their ideal usage scenarios, and provides step‑by‑step code examples that demonstrate how adjusting these settings enables loading and running a 7B‑parameter model on a 16 GB T4 GPU.
The article surveys the most funded and influential AI startups of 2024, profiling ten large‑scale companies such as OpenAI, Anthropic, and Scale AI, and highlighting six promising newcomers, while detailing their products, CEOs, valuations, recent milestones, and industry impact.
The article explains that a token is the unit processed by large language models, describes three common tokenizer methods—word‑level, character‑level, and sub‑word level—with English and Chinese examples, discusses their advantages and limitations, and shows how OpenAI’s tokenizer varies across model versions.
The article traces the development of GPT series—from the 2017 Transformer breakthrough, through GPT‑1, GPT‑2, and GPT‑3’s 175 billion parameters, to later models like Codex and ChatGPT—highlighting key papers, architectural choices, and the surprising role of OpenAI’s decoder‑only approach.
This guide explains what Hacktoberfest is, why developers should join, the step‑by‑step process to register, find suitable projects, make code, documentation or design contributions, submit pull requests, track progress, and succeed with the new 2024 updates and tips.
The article examines the scheduling performance and tight coupling issues of Kubernetes DRA before version 1.30, explains the original workflow involving PodSchedulingContext and DRA driver, and then details the latest design that introduces ResourceClaimParameters and ResourceSlice to let the scheduler handle complex device constraints internally.
