Tagged articles
DataLoader
10 articles · Page 1 of 1
This article walks through diagnosing a severe GPU under‑utilization bug in an 8‑A100 training job, explains why the default Dataset/DataLoader setup stalls, and presents a step‑by‑step redesign using MapDataset or IterableDataset, WebDataset tar shards, tuned DataLoader parameters, worker‑level seeding, GPU‑side prefetching, and distributed sampling to boost GPU utilization from 5‑12% to over 85% while cutting epoch time from 40 h to 9 h.
DataLoaderDistributedSamplerGPU prefetch
0 likes · 22 min read

This article explains the N+1 query problem in a Spring Boot GraphQL service, demonstrates how DataLoader batches and caches requests to reduce database round‑trips, and provides step‑by‑step integration code, including dependency setup, schema definition, entity mapping, batch loader registration, and best‑practice recommendations.
Batch loadingDataLoaderGraphQL
0 likes · 8 min read

This article explains how to integrate the Java‑DataLoader library into a Spring Boot 3.5.0 application, covering dependency setup, entity and repository definitions, service methods, DataLoader configuration, testing, contextual loading, and custom two‑level caching to achieve high‑performance batch data fetching.
Batch loadingCachingDataLoader
0 likes · 12 min read

This article walks through twenty essential PyTorch concepts—from basic Tensor creation and manipulation, through autograd and neural‑network construction, to data loading, GPU acceleration, model saving, and practical training tricks—providing concrete code examples and clear explanations for developers eager to build and deploy AI models.
AutogradDataLoaderGPU
0 likes · 16 min read

This article walks through concrete techniques to accelerate PyTorch training, covering mixed‑precision with torch.cuda.amp, profiling with torch.profiler, DataLoader tuning, torch.compile, distributed strategies like DataParallel and DDP, gradient accumulation, and advanced libraries such as Lightning, Apex, and DeepSpeed, plus model‑level optimizations and monitoring tips.
DataLoaderPyTorchdistributed training
0 likes · 12 min read

The guide walks through fine‑tuning InternLM‑Chat‑7B with XTuner, showing how to build a DataLoader from a HuggingFace Dataset, convert a LoRA .pth checkpoint to HuggingFace format, merge the adapter into the base model, run inference, and adapt the process for custom datasets and 4‑bit quantization experiments.
DataLoaderFineTuningInternLM
0 likes · 27 min read


HomeTechOct 12, 2022 · Backend Development
This article shares a backend team's practical experience of adopting GraphQL with Express and Apollo Server as a BFF layer, covering motivations, implementation steps, schema merging, proxy configuration, HTTP caching strategies, DataLoader optimization, code generation, and integration testing to improve performance and developer efficiency.
Apollo ServerDataLoaderExpress
0 likes · 14 min read

This article explains the internal mechanism of PyTorch's DataLoader when using multiple worker processes, detailing how tensors are serialized, shared via multiprocessing.Queue, and reconstructed in the main process to avoid unnecessary memory copies.
DataLoaderPyTorchSerialization
0 likes · 7 min read

This article explains the GraphQL N+1 performance issue, demonstrates how DataLoader batches and caches database calls to eliminate redundant queries, walks through its core TypeScript implementation—including batch scheduling, cache handling, and load methods—while providing practical examples and integration tips for real‑world GraphQL servers.
CachingDataLoaderGraphQL
0 likes · 28 min read

This article presents practical strategies for building high‑performance PyTorch training pipelines, covering bottleneck identification, efficient data loading, RAM‑based datasets, profiling tools, multi‑GPU training with DataParallel and DistributedDataParallel, custom loss implementation, and hardware‑vs‑software trade‑offs to accelerate deep‑learning workloads.
Custom LossDataLoaderPyTorch
0 likes · 13 min read
