Infra Learning Club shares study notes, cutting-edge technology, and career discussions.
This article explains Nvidia's Multi‑Instance GPU (MIG) technology, compares it with vGPU, walks through enabling and partitioning MIG on A100 cards using nvidia‑smi commands, and shows how to expose MIG resources in Kubernetes with single and mixed strategies.
This article explains the principles of GPU kernel virtualization by analyzing the cgpu project's source code, detailing kernel interception of device operations, the driver’s file_operations, module initialization and cleanup, procfs interfaces, scheduling logic, and compilation steps on Ubuntu 22.04.
This tutorial walks through the motivation for Nvidia GPU kernel interception, explains Linux kernel module basics and privilege rings, shows how to set up an Ubuntu environment, write and compile a minimal LKM, load and test it, then create a fake GPU character device and mount it into a Docker container for verification.
The article explains how to design and implement a sharded WorkQueue in Kubernetes' controller-runtime, enabling concurrent processing while guaranteeing that resources belonging to the same node are handled sequentially within a single goroutine, using hash-based partitioning and custom queue structures.
This guide walks through preparing a XiaoAI speaker, selecting a free LLM service, creating an API key, installing Docker, running the MiGPT server, and configuring the speaker to query the chosen large language model.
An analysis of 2024 startup‑released open‑source projects shows AI‑focused tools leading popularity, with Python used in 60% of the top 20, a median monthly growth of about 15%, and the United States contributing 65% of the most impactful releases.
This article surveys twenty of the most talked‑about open‑source projects released by early‑2024 startups, spanning AI assistants, developer tools, Python package managers, blockchain platforms, and more, each highlighted with its GitHub URL, star count, and a brief functional description.
The author experiments with GitHub Copilot Workspace to automatically generate a WeChat mini‑program for family library management, documents the prompting process, code generation, bug fixes, UI tweaks, and reflects on the broader impact of AI‑driven development on programmers' future jobs.
This article dissects the GPUMounter project's implementation of dynamic GPU device mounting to a pod, detailing the roles of cgroups (v1 and v2) and Linux namespaces, and provides step‑by‑step command‑line examples and a CLI tool for practical use.
In 2025, large language models will see three key trends—agents becoming pervasive in daily life and industry, the emergence of efficient small models for edge and specialized tasks, and the integration of multimodal capabilities that combine text, images, and audio to enable more natural human‑machine interaction.
