This article explains how using UUIDs as primary keys can degrade insert performance and increase storage requirements, illustrating the impact with a million‑row simulation and offering guidance for better database design in.
This guide explains how LVM snapshots work, how to create them using copy‑on‑write, restore individual files or entire volumes, merge snapshots back into the original LV, and leverage snapshots for testing environments, all without stopping services.
This guide walks you through Linux's built‑in utilities—such as cat, free, vmstat, lsblk, ip, ethtool, top, htop, and Glances—to display and analyze CPU, memory, storage, and network information, helping you monitor system health and plan upgrades.
Since 2023, Ctrip’s Data Platform 2.0 has been redesigned to support multi‑IDC storage, tiered hot/warm/cold data, transparent migration, priority scheduling, mixed online/offline resources, and a smooth upgrade from Spark 2 to Spark 3 with Kyuubi as the query engine, delivering higher performance and scalability.
This guide walks through setting up a CentOS 7 environment, installing Helm, adding the OpenEBS chart repository, deploying the OpenEBS control plane, creating a dedicated PostgreSQL namespace, and configuring persistent storage with a ConfigMap, providing all necessary commands and screenshots.
This article analyzes the architectural upgrades required for ultra‑large AI clusters, covering single‑GPU performance, super‑node scaling, DPU‑based heterogeneous computing, power‑efficiency, high‑throughput storage, and robust high‑speed networking to support trillion‑parameter model training and inference.
The article outlines the challenges of massive AI training data, defines storage performance requirements, and presents Polefs—a cloud‑native distributed cache file system with unified storage, metadata acceleration, and read/write caching designed to improve GPU utilization and reduce data redundancy.
This article investigates why the storage size shown inside iOS apps often differs from the total size displayed in the iPhone Settings, analyzes four main causes—including app bundle size, binary vs decimal units, measurement scope, and cache path handling—and demonstrates how Kuaishou aligned its storage reporting with the system through experiments and code changes.
This article explains the fundamentals of Network File System (NFS), its reliance on RPC for communication, the step‑by‑step workflow of NFS operations, configuration details in /etc/exports, common troubleshooting cases, and practical command‑line examples for Linux administrators.
This article explains the principles, advantages, disadvantages, and best‑practice recommendations for four common RAID configurations—RAID 0, RAID 1, RAID 10, and RAID 5—helping readers choose the appropriate disk‑array solution for performance and reliability needs.
The article compares DRAM and Flash memory characteristics, explains how emerging AI and automotive applications are reshaping storage demand, and highlights China's strategic challenges in catching up with leading DRAM and NAND Flash manufacturers.
The article introduces LightPool, an open‑source, cloud‑native storage‑pool architecture presented at HPCA 2024, which leverages NVMe‑over‑Fabric, Kubernetes CSI integration, and a lightweight user‑space engine to deliver high‑performance, elastic, and highly available storage for large‑scale distributed databases while reducing cost and improving resource utilization.
This comprehensive guide explains what LVM is, its core concepts, installation steps, common commands, how to create and manage physical, volume and logical volumes, extend and shrink volumes, handle snapshots, and migrate volume groups across machines, all illustrated with practical command‑line examples.
The article presents LightPool, a cloud‑native storage‑pooling solution that leverages NVMe‑over‑Fabric, Kubernetes‑based scheduling, and a lightweight user‑space engine to deliver high‑performance, low‑cost, and highly available storage for large‑scale distributed databases while eliminating traditional bottlenecks.
The article introduces LightPool, an open‑source cloud‑native storage‑pool architecture built on NVMe‑over‑Fabric that delivers high performance, low cost, and high availability for large‑scale distributed databases, and explains its design, scheduling, storage engine, and hot‑upgrade/migration capabilities presented at the 30th IEEE HPCA conference.
The article compares hyper‑converged infrastructure with the traditional VMware + FC SAN stack, highlighting four architectural differences and showing how hyper‑convergence improves reliability, concurrency performance, scalability, operational simplicity, and total cost of ownership for modern data‑center workloads.
Huawei's newly announced OceanStor Arctic storage system, based on magneto‑electric disk (MED) technology, claims over 10 PB capacity, sub‑2 kW power use and up to 90% energy savings, potentially reshaping the data‑center storage market by 2025.
A technical deep‑dive shows how a team managing dozens of Kubernetes clusters diagnosed a write‑ahead‑log bottleneck in etcd, measured IOPS and latency with etcdctl and fio, upgraded gp2 volumes to gp3, and discovered diminishing returns beyond 3000 IOPS while explaining the role of fdatasync in storage performance.
This guide explains how to choose Linux I/O schedulers, generate realistic storage workloads with fio, configure various RAID levels using mdadm and LVM, and monitor performance with tools like top, iostat, iotop, blktrace, and atop, providing practical command examples and best‑practice recommendations.
This article provides a comprehensive technical overview of LiteIO, describing its core and CSI components, the complete volume lifecycle within Kubernetes, Disk‑Agent responsibilities, common implementation pitfalls, storage‑pool construction methods, and the design of the node‑disk‑controller, scheduler, and CSI modules.
This article explains why a Huawei OBS CSI plugin loses its s3fs process after a restart, causing "Transport endpoint is not connected" errors, and provides a step‑by‑step solution using client‑go to rebuild the mount and trigger kubelet remount via a liveness probe.
This article analyzes the XFS filesystem implementation in the Linux kernel, covering its on‑disk layout, superblock and allocation‑group structures, inode and free‑space B+ trees, operation sets (iops, fops, aops), file creation, write and read paths, logging, block layer interactions, and useful XFS utilities.
This article introduces the Xinchuang (information technology innovation) industry, outlines its hardware components, and provides concise explanations of CPU concepts, instruction sets, GPU architecture and operation, as well as storage classifications, while also linking to related research reports and promotional resources.
This article explains what MySQL general tablespaces are, outlines their main features and benefits, provides step‑by‑step commands for creating, managing, and assigning tables to them, and shows monitoring queries and practical usage scenarios for improved storage efficiency and performance.
The article examines how different I/O patterns, such as sequential writes, request size interference, and read/write conflicts, affect NVMe SSD performance, explains the underlying mechanisms like write amplification and GC behavior, and proposes software-level optimizations—including large‑block writes, Optane caching, and OpenChannel/Object SSD designs—to improve throughput and latency.
This guide walks you through ten practical steps for diagnosing Kubernetes problems, from POD startup failures and resource limits to network connectivity, storage configuration, container logs, DNS resolution, and final troubleshooting tips, helping you keep your clusters stable and reliable.
This article examines Baidu Search's content storage team's HTAP table storage system, detailing the challenges of supporting massive OLAP workloads on an OLTP‑oriented backend, the architectural split into Neptune and Saturn, storage‑engine optimizations such as row partitioning and dynamic columns, and a SQL‑like KQL framework for compute and scheduling.
This article debunks the common belief that MySQL VARCHAR can store up to 65535 characters, showing how the true limit depends on the chosen character set, NULLability, column count, and row‑format details, and explains how oversized values are stored or require TEXT/BLOB types.
RAID combines multiple physical disks into virtual drives, offering various levels—RAID 0, 1, 1ADM, 5, 6, 10, 10ADM, 1E, 50, and 60—each balancing performance, fault tolerance, and capacity, with detailed processing flows, storage calculations, and best‑practice recommendations for optimal deployment.
VictoriaLogs, a log‑storage system marketed as a cost‑effective, high‑performance alternative, is compared against Elasticsearch/OpenSearch, Grafana Loki, and ClickHouse, highlighting its lower RAM and disk usage, faster queries, simplified setup, and specialized features such as LogSQL, Bloom filters, and custom compression.
The article analyzes how hardware components, software mechanisms, and environmental conditions collectively impact NVMe SSD performance, explaining why real‑world results often differ from vendor specifications and highlighting the roles of NAND type, controller architecture, PCIe bandwidth, garbage collection, temperature, and wear‑leveling.
This article provides a comprehensive overview of RAID technology, explaining disk groups, virtual disks, detailed characteristics of RAID 0, 1, 1ADM, 5, 6, 10, 10ADM, 1E, 50, and 60, and compares their fault tolerance, I/O performance, and storage capacity considerations.
This article explains RAID fault‑tolerance mechanisms, consistency verification, hot‑spare and emergency backup, rebuild processes, virtual‑disk read/write policies, power‑loss protection, disk striping, mirroring, foreign configurations, power‑saving and pass‑through features, providing a comprehensive overview of modern storage system capabilities.
This guide walks you through ten systematic steps—from inspecting pod status and cluster health to verifying network connectivity, storage configuration, DNS resolution, and container logs—to effectively troubleshoot common Kubernetes issues and keep your applications running smoothly.
This article explains the ALUA (Asymmetric Logical Unit Access) multipath model, compares it with other storage path mechanisms, describes its operation in dual‑active environments, outlines key features such as path states and failover, and reviews native ALUA support across major operating systems.
This article explains how the emergence of ultra‑fast SSDs and NVMe reshapes storage architecture, details the NVMe protocol and its extensions over fabrics, compares RDMA‑based transport options such as FC, TCP, and RoCE, and discusses network requirements and performance trade‑offs for modern data‑center deployments.
This article explains how computer storage works, why database indexes dramatically speed up queries, the mechanics of binary search, the differences between clustered and non‑clustered indexes, common pitfalls of over‑indexing, and practical SQL optimization strategies to avoid full table scans and index invalidation.
This article explains the fundamentals of storage, detailing the physical media and safety methods, introduces FC‑SAN technology and its components, outlines its advantages, and compares DAS, NAS, and SAN in terms of connection methods and suitable application scenarios.
This article provides a comprehensive overview of the storage chip market, detailing the different storage media, memory hierarchy, DRAM/ROM technologies, DDR standards, NAND flash classifications, 3D NAND advancements, and the industry’s supply‑chain structure, while highlighting the emerging domestic substitution trend.
This article details the evolution of the open‑source distributed database MatrixOne, describing its early NewSQL/MPP design, the scalability, performance and cost challenges it faced, and the architectural redesign that introduced decoupled compute, transaction, and storage layers with HTAP support using TAE, S3, and Logtail.
The article provides a comprehensive analysis of China’s solid‑state drive (SSD) industry, covering its definition, classification, market size, growth drivers, business models, supply‑chain structure, competitive landscape, user segments, and future technological trends.
The article analyzes the AI compute ecosystem—highlighting GPUs as the core engine, network bandwidth as a bottleneck, and storage memory walls—while also promoting comprehensive server and storage e‑books for deeper technical insight.
This article walks through a real‑world e‑commerce scenario where billions of daily browsing events generate over 100K TPS writes, evaluates storage options on reliability, cost, read/write performance and implementation difficulty, and ultimately recommends Tair after detailed analysis of List, Sorted‑Set and Hash structures, code examples, and concurrency controls.
This guide explains what NFS is, how to create a Kubernetes pod that mounts an NFS share, expose the pod via a NodePort service, and verify the NFS logs using standard Linux commands.
This article explains the fundamentals of NFS (Network File System), its role in Kubernetes volumes, and provides a step‑by‑step tutorial for installing nfs-utils, configuring /etc/exports, setting permissions, starting rpcbind and NFS services, and verifying the setup with commands.
This weekly front‑end roundup from the Goodme team highlights five curated articles covering serverless cold‑start optimization, React component unit testing, CSS white‑space and word‑wrap mastery, debugging Ant Design source code, and a clear comparison of OSS, NAS, and EBS storage solutions.
This article explains the different server storage types—including mechanical HDDs, solid‑state SSDs, various interfaces, RAID arrays, and network‑attached storage—while covering their structures, performance characteristics, Linux device handling, and how to choose the right solution based on cost, capacity, speed, and reliability.
The 2023 online summit held on August 5‑6 showcases a series of technical talks by industry experts on modern big‑data storage architectures such as Paimon, JuiceFS, Databend, and CloudFS, highlighting cloud‑native design, storage‑compute separation, and practical implementation experiences.
This guide explains how to select desktop computer parts—including CPU, GPU, motherboard, memory, storage, power supply, and cooling—by evaluating usage, performance tiers, specifications, brand options, and compatibility, while also noting which components can be safely bought second‑hand.
This article traces the development of message queues from early decoupling solutions like ActiveMQ and RabbitMQ, through high‑throughput designs such as Kafka and RocketMQ, to modern platform‑centric systems like Pulsar, while detailing core concepts, architecture diagrams, storage mechanisms and trade‑offs.
Learn how Kubernetes abstracts persistent storage using PersistentVolumes (PV) and PersistentVolumeClaims (PVC), why HostPath is limited, the role of network storage, and how to implement CSI drivers with practical YAML examples and kubectl commands for creating and managing PVs and PVCs.
This article explains the structure of Linux Ext (2/3/4) filesystems, detailing superblocks, inode tables and data blocks, then describes block groups, the role of superblocks, and outlines the differences between hardware and software RAID as well as the principles and risks of using LVM for flexible storage management.
The forum gathers senior experts from Baidu, Meituan, Ant Group, Xiaomi and Baidu Cloud to share practical experiences and future trends on constructing ultra‑large‑scale file, block, KV and NoSQL storage systems, focusing on low‑cost, high‑performance solutions and architectural challenges.
The article analyzes how large language models like ChatGPT are reshaping the software ecosystem by positioning AI compute—driven by GPUs, high‑speed networking, and advanced storage solutions such as HBM and 3D‑stacked memory—as the foundational engine for future information systems, highlighting current market trends and technical challenges.
This article explains how database indexes work, covering storage fundamentals, the role of indexes in accelerating queries, different index types such as clustered and non‑clustered, common pitfalls, and practical SQL optimization tips to improve read performance while managing write overhead.
This article explains how the Elastic File Client (EFC) and Fluid together provide a cloud‑native, high‑performance storage solution for AI and big‑data workloads on Kubernetes, detailing architecture challenges, core features, performance benchmarks, and a step‑by‑step deployment guide.
This article provides a comprehensive overview of the Xinchuang industry, detailing the fundamental concepts, architectures, and classifications of CPUs, GPUs, and storage devices, and explains how these core hardware components support the goal of achieving self‑controlled, secure information technology in China.
This tutorial walks through the complete process of preparing three CentOS 7 nodes, installing ceph‑deploy, configuring storage and network topology, and sequentially deploying monitors, managers, OSDs, MDS, RGW, enabling the Ceph dashboard, performing verification tests, and finally uninstalling the cluster.
This article provides a comprehensive, step‑by‑step tutorial for installing Ceph on ZTE NewStart CGSL using an offline RPM repository, covering yum repository setup, Ceph package installation, monitor, OSD, and MGR node configuration, and includes all necessary command examples.
This article explains how Meituan’s storage team designed the MStore distributed storage platform to separate storage and compute, addressing scaling, cost, and reliability challenges of monolithic architectures, and details its cloud‑native components, data model, performance optimizations, observability, and the derived EBS block‑storage service.
This tutorial walks you through creating a minimal Linux VM in VirtualBox, adding four virtual disks, formatting and mounting them, and then installing and configuring MinIO in a single‑node multi‑drive setup using systemd, complete with verification commands and screenshots.
This article details Bilibili's thumb‑up system design, covering business capabilities, multi‑layer storage, traffic handling, disaster‑recovery strategies, and future plans to ensure a high‑traffic, reliable like service for videos, posts, comments, and more.
In this expert interview, a chief big‑data architect from NetEase explains the core technology layers, key performance indicators, major challenges and mitigation strategies, the business value, and emerging trends of cloud‑native big data platforms, highlighting scheduling, storage, and mixed‑deployment considerations.
This guide walks you through three Bash scripts that automate creating primary ext4/xfs partitions, building a full‑disk LVM logical volume, and converting a partition into a logical volume, complete with user prompts, filesystem formatting, and fstab updates.
This article explains the concepts, architecture, configuration, and practical use cases of Kubernetes volume snapshots, including how to define snapshot classes, create snapshots, clone PVCs, and perform consistent backups across different storage providers and clusters.
Alibaba Cloud’s cloud‑native data lake analysis solution combines fully managed storage (OSS‑HDFS), a one‑stop lake management platform (Data Lake Formation), and multimodal compute capabilities, delivering high performance, massive scalability, and low cost for big‑data and AI workloads across offline, real‑time, and lake‑house scenarios.
This article explains the fundamentals of RAID, compares common RAID levels, describes hardware RAID components, and provides a step‑by‑step guide for configuring a Linux software RAID 5 array with mdadm, including commands, monitoring, and recovery procedures.
This article explains how database indexes improve query speed by leveraging storage principles, binary search, and B‑tree structures, discusses clustered versus non‑clustered indexes, outlines the trade‑offs of indexing, and provides practical SQL optimization tips to avoid full table scans and index misuse.
The article outlines Xiaomi's data governance journey, focusing on storage‑service cost governance, describing the transition from simple cost‑centered governance to big‑data‑driven asset management, and detailing concrete HDFS and HBase practices that achieved significant resource and cost reductions.
This article explains the evolution of data storage, the fundamentals of computer storage devices, how database indexes function like a book's table of contents, the role of binary search, the benefits and drawbacks of indexes, and practical SQL optimization techniques to enhance query speed.
This article explains the evolution of data storage, the fundamentals of computer storage devices, how database indexes function like a book's table of contents, the role of binary search, the benefits and drawbacks of indexes, clustered versus non‑clustered indexes, and common SQL optimization techniques.
This article reviews the evolution of file storage, outlines the challenges of the cloud era, and details JuiceFS's design philosophy, architecture, key capabilities, and real‑world use cases such as Kubernetes, AI, big‑data analytics, and NAS migration to the cloud.
This article explains how distributed storage, computing, and resource‑management technologies have evolved—from early Google File System research to Hadoop, Spark, and Kubernetes—enabling enterprises to tackle the 4 Vs of big data while reducing cost, improving performance, and supporting real‑time analytics.
This article explains how enterprises can build a unified data storage and compute foundation, covering strategic goals, functional and architectural requirements, and the layered design of business support, storage‑compute, and resource management to enable scalable, secure, and high‑performance data platforms.
This article explains how databases store data on physical devices, how indexes work like a book’s table of contents to accelerate queries, covers storage fundamentals, binary search, clustered vs non‑clustered indexes, and practical SQL optimization tips to avoid full‑table scans and index pitfalls.
The article outlines the evolution of data‑center architectures, identifies capacity, efficiency, and performance challenges of traditional storage‑compute models, and presents the emerging Diskless architecture—leveraging DPU, CXL, RDMA, and high‑throughput networking—to achieve decoupled, pool‑based resources and improve overall data‑center utilization.
This article examines YouTube’s massive backend infrastructure, detailing how the platform stores billions of videos using MySQL, Vitess for horizontal scaling, sharding, replication, disaster management, cloud‑native deployment on Kubernetes, and the supporting storage systems such as GFS and BigTable.
This article explains the fundamentals of Ceph cache tiering, covering cache and buffer concepts, the two cache‑pool modes (write‑back and read‑forward), step‑by‑step deployment, configuration parameters, and proper procedures for creating, tuning, and safely removing cache pools.
The whitepaper outlines the evolution and challenges of modern data center architectures, introduces the Diskless architecture that decouples compute and storage using high‑density storage, DPUs, RDMA and CXL, and details its design principles, key technologies, and industry implementations.
This article provides a comprehensive overview of the Xinchuang industry’s hardware fundamentals, detailing CPU architecture and operation, instruction set classifications, GPU concepts and workflows, storage categories, and the distinction between independent and integrated GPUs, while also noting related promotional resources.
The article examines whether today’s powerful operating systems can assume tasks traditionally handled by database kernels, tracing the evolution from early OS‑dependent databases to modern systems that leverage OS file cache, VMM, and storage optimizations, while also discussing scenarios where direct DB control remains necessary.
This article provides an in‑depth technical overview of the NVMe (Non‑Volatile Memory Express) protocol over PCIe, covering its logical device interface, namespace concepts, queue mechanisms, register layouts, command formats, controller initialization, interrupt handling, and data protection features.
The 2022 Hyperion Research HPC market report shows a $348 billion total market in 2021, with servers leading, HPC Cloud growing 23% to $62 billion, storage and AI‑enabled servers driving the fastest growth, and detailed forecasts for vendors, applications, networking, and operating‑system migration.
This guide walks you through installing Podman on CentOS 8, configuring user namespaces, creating and building a custom UBI‑based image with a Dockerfile, running containers, verifying installed tools, using interactive shells, and mounting host directories for persistent storage.
This article outlines the full spectrum of technologies and tools for building microservice‑based systems, covering management, storage, business support, and DevOps, and provides a structured guide for selecting the most suitable solutions for each architectural concern.
JEDEC’s new UFS File‑Based Optimization (FBO) 1.0 standard defines an interface for host‑device communication to defragment file‑related LBA ranges, but a Xiaomi engineer’s Linux kernel patch implementing it was sharply criticized by kernel veteran Christoph Hellwig as impractical and unrelated to the kernel.
JEDEC’s new UFS File‑Based Optimization (FBO) 1.0 standard aims to improve flash storage performance by defragmenting LBA ranges tied to specific files, but a Xiaomi engineer’s patch proposal to implement it in Linux was sharply rejected by kernel veteran Christoph Hellwig, who called the idea fundamentally flawed.
Since the IEEE 802.3ae standard was approved in 2002, 10‑Gigabit Ethernet has expanded dramatically due to falling port prices, new fiber technologies, rising bandwidth demands, and its ability to support high‑performance data center, storage, and clustering applications, making it a key networking solution today.
The talk outlines how AI training’s growing data and compute demands create storage bottlenecks across four evolutionary stages, identifies four core problems—massive data, data‑flow, resource scheduling, and compute acceleration—and proposes hardware, software (parallel file systems, caching), and cloud‑native orchestration (Fluid, Baidu Canghai) solutions that combine object‑storage lakes with high‑performance acceleration layers to achieve near‑full GPU utilization.
This guide explains what RAID is, its role in server storage, compares common RAID levels (0, 1, 5, 6, 10) in terms of fault tolerance, performance, and capacity, and offers recommendations for selecting the most suitable RAID configuration based on data safety, speed, and cost considerations.
This article explores the fundamentals of data saving for web‑based tools, covering what data is saved, where it is stored (backend vs. frontend), various trigger mechanisms, design principles for reliable saving, and feedback patterns to ensure users never lose their work.
Flink Table Store, an Apache Flink subproject, provides a unified stream‑batch storage layer with SQL‑based table APIs, addressing real‑time and offline data needs, detailing its design goals, usage patterns, architectural layers, implementation choices, and upcoming roadmap.
This article provides a detailed overview of Docker, covering its definition, core components, advantages over virtual machines, common use cases, installation steps, storage configuration, image management commands, network modes, data volumes, private registry setup, backup procedures, and MySQL deployment, all illustrated with practical command examples.
This guide walks through installing NFS on Kubernetes nodes, creating a shared directory, configuring exports, setting up PersistentVolume and PersistentVolumeClaim objects, and deploying a MySQL instance that uses the NFS-backed storage.
The article explains the fundamental differences between row‑based and column‑based storage in databases, compares their write and read performance, presents a practical openGauss experiment showing storage size and insert speed differences, and offers guidance on when to choose each model.
This article explains the core concepts of low‑code platforms, emphasizing visual editing as a mandatory feature, comparing declarative and imperative approaches, detailing front‑end JSON‑to‑React rendering, reviewing five back‑end storage strategies, discussing business‑logic implementation, workflow engines, and predicting the future evolution of low‑code solutions.
This guide explains the SCSI protocol and common disk interfaces, details how to install and use the lsscsi command on various Linux distributions, describes its options and output formats, and provides examples of querying devices, interpreting results, and enabling SCSI logging for debugging.
This article presents a comprehensive framework for selecting a storage solution, covering business and technical metrics, comparing relational databases with various NoSQL types, and offering concrete pros, cons, and scenario‑based recommendations to help engineers make informed data‑store decisions.
The article explains why copying a seemingly 100 GB file with the cp command finishes instantly by analyzing file size versus allocated blocks, sparse file concepts, inode structures, direct and indirect block indexing, and how Linux file systems manage storage space efficiently.
The article explains how the ASTRA high‑performance computing platform, built for translational medicine, integrates a three‑tier storage architecture with Intel's DAOS to overcome data‑intensive challenges, improve AI and big‑data workloads, and achieve top rankings on the IO500 benchmark.
