This article chronicles Tencent's journey from the early development of the TFS distributed storage platform to large‑scale data migrations, flexible bandwidth strategies, and the creation of the cloud‑native YottaStore, illustrating how a small architecture team solved massive storage challenges for billions of users.
This article provides a comprehensive technical overview of Red Hat Ceph, covering its distributed storage architecture, cluster components, storage pool types, authentication, placement algorithms, I/O paths, replication and erasure‑coding strategies, internal management operations, high‑availability mechanisms, client libraries, data striping, and encryption details.
As IoT and 5G drive massive data generation, edge storage emerges as a flexible solution that reduces latency, lowers bandwidth costs, and enhances data security compared to traditional central cloud storage, especially for video surveillance and other high‑throughput scenarios.
Learn how to turn OneDrive into a personal cloud drive without speed limits by deploying the OneManager-php project on Tencent Cloud's Serverless SCF using the Serverless Framework, following a concise three‑step tutorial that includes installation, template setup, and deployment commands.
Alibaba Cloud’s Log Service (SLS) has evolved into a unified observability middle‑platform that handles tens of petabytes daily, offering integrated storage, processing, and AI‑driven analysis for logs, metrics, and traces, while addressing challenges of data ingestion, performance, and scalability across diverse Ops scenarios.
This article explains how to pick the most suitable cloud storage—cloud disk, file service, or object storage—by using four easy-to-remember mnemonics that cover functionality, performance, concurrency, and latency, helping readers avoid complex parameter analysis.
The Tencent Cloud CBS data scheduling system has evolved from a simple snapshot service into a highly concurrent, low‑latency platform that uses COW/ROW mechanisms, multi‑version snapshots, rapid rollback, hot‑data caching, horizontal scaling, fault‑tolerant task switching, cross‑region replication, and seamless disk migration to ensure reliable, fast storage for backups, image creation, and cloud‑disk migration, with future AI‑driven scheduling and ultra‑low‑latency features.
Tencent Cloud Block Storage (CBS) has evolved through three generations—apllo, atlas, and HiSTOR—adopting a client‑direct, distributed architecture, SPDK, RDMA and user‑space TCP to cut latency to sub‑microseconds while delivering exabyte‑scale throughput, high IOPS, and reliable multi‑copy replication for cloud VM workloads.
This article explains why data lake acceleration is essential, outlines the three key architectural decisions for big‑data architects, and details Alibaba Cloud's JindoFS solutions—including basic adaptation, cache acceleration, and deep‑customization modes—to boost performance and reliability of lake storage and compute.
Tencent Cloud’s new CBS 3.0‑based Enhanced and Ultra‑Fast SSD cloud disks cut latency by over 50 % to sub‑100 µs, boost IOPS up to 1.1 million and throughput to 4 GB/s, and achieve these gains through SPDK‑driven virtualization, RDMA‑based data paths, a user‑space ZTCP stack, zero‑copy memory handling and dedicated hardware acceleration, targeting latency‑sensitive and IO‑intensive workloads such as large databases, video processing and AI inference.
Alluxio is an open‑source, memory‑centric data orchestration layer that bridges compute frameworks such as Spark, Presto, and TensorFlow with diverse storage systems, offering high‑speed I/O, unified namespace, multi‑level caching, and easy deployment, while providing extensive documentation, download links, and community resources for rapid adoption.
This article explains the fundamentals of object storage, compares it with block and file storage, outlines its architecture, components, advantages, use cases, and limitations, showing why it has become the dominant storage model in modern cloud environments.
This guide explains the background of object storage services, shows SDK upload examples for Alibaba Cloud, Huawei Cloud, and Qiniu, introduces the Amazon S3 protocol as a universal solution, lists compatible Chinese cloud providers, and demonstrates how to configure and use a Spring Boot OSS starter—including support for self‑hosted MinIO—by setting appropriate parameters and invoking OssTemplate.
Alibaba Cloud Object Storage (OSS) boosts its availability SLA tenfold to 99.995% by employing rigorous 5‑minute error‑rate metrics, redundant local and city‑level architectures, sophisticated distributed systems like Nuwa and Pangu, robust IDC design, QoS, security defenses, and comprehensive management practices.
This article explains why traditional server‑mediated file uploads are inefficient, introduces the server‑side signed direct upload approach for Alibaba Cloud OSS, and provides a step‑by‑step guide—including OSS setup, Maven dependencies, Spring Cloud configuration, policy‑generation controller, gateway routing, CORS settings, and a Vue upload component—complete with code examples.
During Kuaishou's 2020 Spring Festival red‑envelope campaign, Tencent Cloud's Cloud File Storage (CFS) provided a high‑throughput, read‑heavy NFS solution that handled up to 5 GB/s across 1 700 pods, delivering 100% availability, low latency, and massive interaction volumes for billions of users.
This guide explains why you might need a private cloud, compares several open‑source solutions, and provides step‑by‑step instructions—including Docker installation and Nextcloud deployment—so you can quickly set up a multi‑device synchronized cloud storage on a CentOS 7 VPS.
This guide walks you through purchasing a VPS, installing DNF, Apache, PHP, and MariaDB on CentOS 8, configuring SELinux, deploying Nextcloud from source, setting permissions, and completing the web‑based setup, enabling a fully functional self‑hosted cloud storage service.
This guide explains how to set up Qiniu Cloud object storage as an image‑hosting service, configure a CDN domain with CNAME records, bind a custom domain, and use the MPic tool to automatically upload images for use in Markdown editors.
This article describes the challenges of delivering large video lessons and other digital assets to distributed school campuses and explains how the Dandelion release platform uses resumable uploads, cloud OSS, long‑connection messaging, redundancy, and version‑controlled rollout to ensure reliable, low‑latency playback and scalable resource distribution.
This case study details the redesign of the internal 58 Cloud Disk service, covering project background, challenges with legacy tools, the four redesign goals of lightweight, usability, consistency, and branding, and the ongoing lessons learned for enterprise product development.
The guide shows how to enlarge storage on a Tencent Cloud Linux VM by adding and expanding CBS cloud disks using three approaches—direct bare‑device formatting, MBR partitioning for disks under 2 TB, and GPT partitioning for larger disks—detailing step‑by‑step commands, online vs offline resizing, and best‑practice recommendations.
This article details how 360 adopted Cassandra for its cloud drive, describing Cassandra’s decentralized architecture, the reasons for its selection over HBase, large‑scale deployment challenges, performance optimizations, reliability improvements, disk utilization techniques, and the evolution of the system from 2010 to present.
A recent ElasticSearch breach exposed 2.7 billion email addresses, one‑billion plain‑text passwords and hundreds of thousands of birth‑certificate copies, highlighting persistent security gaps in cloud‑based search services despite growing corporate safeguards.
This article examines the rising importance of data security, explains continuous data protection (CDP) concepts, compares traditional backup methods with CDP, outlines implementation models, reviews major vendor solutions, and introduces an elastic, verifiable CDP approach for cloud environments.
Despite recent market turbulence and negative headlines, Hadoop's revenue continues to grow, driven by cloud migration, evolving storage solutions, and increasing adoption of related projects like Spark and Kafka, positioning it as a leading data‑lake technology.
The article explains how Chinese filenames cause encoding errors when uploading to Amazon S3, why S3 forces UTF‑8 for website access, and presents a practical Nginx‑based proxy solution that transparently converts GBK‑encoded URIs to UTF‑8 to ensure reliable file retrieval.
This article provides an in‑depth comparison of Red Hat’s Ceph and GlusterFS open‑source storage solutions, detailing their underlying architectures—including RADOS, CephFS, RBD, and Gluster’s brick‑based design—while discussing performance, scalability, high‑availability, hardware requirements, and suitability for various cloud environments.
The article describes the background, goals, architecture, security, and future plans of Autohome's internally developed enterprise cloud disk, detailing its multi‑layer design, RBAC permission model, file processing, task scheduling, and integration with various corporate systems to improve collaborative work efficiency.
This article explains how using the Storage Performance Development Kit (SPDK) optimizes virtualized I/O paths for cloud disks, covering its architecture, virtio vring basics, hot‑upgrade solutions, online migration techniques, and io_uring enhancements that together achieve up to 1.2 million IOPS with dramatically reduced latency.
The article provides a comprehensive overview of Ceph’s distributed storage architecture, explaining the roles of RADOS, OSD, Monitor, and Metadata Cluster, and detailing the three-step data mapping process from file to object, to placement group, and finally to OSD storage.
The article explains how the TianTi platform integrates DevOps practices, cloud storage, and document version control to streamline the entire software lifecycle from requirements to operation, highlighting its architecture, workflow, and metadata management.
Tencent Cloud’s CynosDB uses a shared‑storage, primary‑multiple‑replica architecture built on the user‑space distributed file system CynosFS, separating compute from elastic block storage, sinking write‑ahead logs for asynchronous replay, and employing MVCC with Raft‑replicated segments to achieve high‑availability, scalable, and cost‑effective MySQL/PostgreSQL‑compatible performance.
The article explains the formation of the Ceph Foundation, outlines Ceph’s widespread adoption, and provides a detailed, step‑by‑step analysis of the Scrub and Deep‑Scrub processes, highlighting their operation, limitations, and ongoing efforts to improve automatic repair.
This article explains how UCloud’s self‑developed IO acceleration technology dramatically narrows the CPU‑disk performance gap by raising 4K random write throughput from 300 IOPS to 45,000 IOPS, detailing its architecture, first‑generation limitations, and the second‑generation enhancements that enable scalable, fault‑tolerant cloud storage.
UCloud’s latest SSD cloud disk redesign dramatically improves performance—raising IOPS by 13‑fold, cutting latency tenfold, and expanding capacity—through a two‑layer IO path, 1 MB metadata shards, multithreaded models, overload protection, online migration, and upcoming RDMA/SPDK‑based ultra‑high‑performance storage solutions.
UCloud’s first Tech Talk detailed a comprehensive redesign of its cloud disk architecture, introduced ServiceMesh‑based gray‑scale deployment for virtual networking, and unveiled a second‑level snapshot system that delivers second‑level continuous backups with rapid restore capabilities, all backed by NVMe and programmable switch innovations.
The talk explains Tencent Cloud Object Storage (COS) fundamentals and its integration with Serverless Cloud Function (SCF), showcasing use cases like image processing, video transcoding, log analysis, CDN refresh, disaster backup, and face‑recognition demos, while outlining trigger limits, best practices, cost benefits, and when traditional servers remain preferable.
This guide shows how to install and configure Baidu's UEditor rich‑text editor in a Laravel 5 project, covering Composer installation, service provider registration, configuration for local or Qiniu cloud storage, and Blade view integration for seamless content editing.
The article reports on UCloud's subsidiary presenting at ArchSummit 2018 in Shenzhen, detailing the evolution to the digital era, challenges of PB‑scale data storage, and their solution using NFS‑Ganesha, Hadapter, and UMStor to achieve efficient big‑data‑on‑cloud performance and a data‑lake model.
The June 2018 Ceph Developer Monthly Report reviews key changes such as the deprecation of ceph‑disk, the upcoming seastar‑based OSD, SMART‑driven disk‑failure prediction, new rbd namespace support, BlueStore memory optimizations, iWARP RDMA support, and several operational enhancements.
This article explores why GitHub, the world’s largest open‑source code host with 85 million repositories and 28 million developers, remains indispensable by examining its strong community, massive code library, simple version control, extensive integrations, and secure cloud storage.
The article details Veritas Velocity’s hybrid‑cloud data replica solution, its architecture, deployment steps, role‑based access, workflow automation with Oracle RMAN, and performance benchmarks that show up to 8.8× faster test‑environment provisioning while halving required manpower.
The article explains how data‑control separation architecture is used across traditional and distributed file systems, high‑performance SAN designs, software‑defined storage solutions, and cloud platforms like OpenStack, highlighting its impact on performance, scalability, and resource contention.
The article examines Maslow's hammer metaphor to highlight how engineers often default to familiar technologies—such as Java, H5, or Ceph—when solving problems, urging a deeper analysis of requirements, diverse skill sets, and appropriate solutions like cloud storage for high‑availability needs.
This article explains blockchain fundamentals, its core features like distributed ledgers and data authentication, and explores practical applications such as crowdfunding, smart contracts, supply‑chain management, decentralized cloud storage, fast secure payments, and IoT device connectivity.
This article explains how the BBR congestion control algorithm, designed for long‑fat networks, overcomes the limitations of traditional TCP to dramatically improve cloud storage download speeds, detailing its principles, implementation steps, and real‑world performance gains.
The article traces Tencent Cloud Storage's evolution from basic data access in the early 2010s, through a data‑processing phase driven by video and image workloads, to the current data‑activation era focused on big‑data analytics and cost‑effective cloud migration, highlighting technical features and real‑world use cases.
This article traces the evolution of Tencent Cloud Block Service (CBS), detailing the transition from the initial CBS1.0 built on three distributed systems, through the streamlined CBS2.0, to the cost‑effective two‑layer CBS3.0 architecture, and discusses the technical challenges, solutions, and operational outcomes.
This article outlines the development of Tencent Cloud Block Service, describing the transition from the monolithic CBS1.0 through the streamlined CBS2.0 to the two‑layer CBS3.0 architecture, and discusses the design choices, operational challenges, performance optimizations, and industry comparison with Ceph.
This article explains how to design and implement dual‑active storage solutions combined with virtualization and application clustering, covering industry requirements, storage vendor options, physical and virtual deployment models, and the role of cloud storage and OpenStack Ironic.
The article proposes an incremental synchronization scheme for Meituan’s Rhino Cloud Disk that shifts rsync‑style signature and delta generation to the client, leverages zsync‑like HTTP range fetching, and discusses challenges such as block fragmentation, low locality in binary files, server‑side merge overhead, and future optimizations like variable‑size chunking and Rabin fingerprint‑based content‑defined chunking.
This article explains how Alibaba Cloud designed a high‑performance local storage solution—leveraging Virtio‑blk, SPDK, and NVMe SSDs—to meet the massive peak pressure, ultra‑low latency, and high IOPS demands of the Alipay red‑packet business, and how the technology is now available in the public cloud.
This guide explains how to deploy a private Docker Registry in Azure China using the open‑source azure‑docker‑registry‑template, covering architecture, required files, TLS configuration, ARM template parameters, and step‑by‑step deployment commands for creating certificates, storage, load balancer, and VM cluster.
This article details the architecture, chunked upload strategy, event handling, Redis caching, database sharding, and performance optimizations of a cloud‑based video surveillance storage system that evolved through versions 2.0, 3.0, and 4.0 to handle high‑concurrency alarm video uploads.
This tutorial explains how to perform remote operations on OpenStack Glance images stored in Ceph—covering preparation, secret configuration, image conversion, resizing, snapshot creation, and in‑place editing with libvirt and guestfish—so you can manage images entirely on the storage backend.
Amid rising data‑storage complexity, twelve innovative startups emerged in 2015‑2016, leveraging flash, disk, and cloud technologies to improve data mobility and management across hierarchical storage tiers, offering solutions ranging from cloud‑native storage networks to SAN arrays and virtualization platforms.
This article explains the concepts of Virtual OS Infrastructure (VOI) and Virtual Desktop Infrastructure (VDI), introduces the Next Generation Desktop (NGD) as a hybrid solution, discusses their limitations, and shows how cloud storage can integrate VOI and VDI to enable flexible, cost‑effective cloud computing deployments.
In a two‑day incident, Tencent Cloud's CBS team diagnosed cell failures, implemented directed reads and a dual‑cell merge strategy, and restored three‑copy data integrity, while uncovering monitoring gaps and tool limitations that inform future storage operations.
The article analyzes how cloud-native, distributed, and software‑defined storage solutions are reshaping the enterprise storage market, compares them with traditional high‑reliability systems, and offers guidance on selecting, integrating, and migrating storage technologies based on business scenarios, cost, and performance considerations.
The article details the evolution, system architecture, backend technologies, high‑availability designs, data handling, upload and playback workflows, and operational monitoring of the Miaopai short‑video service, illustrating how it scales to hundreds of millions of users under heavy load.
This article explains how to set up a fast, stable private Docker Registry by leveraging Azure Storage as the backend, detailing the creation of Azure-hosted Docker machines, configuring the registry containers for both macOS/Linux and Windows, and providing scripts to pull and push images through the Azure-backed storage.
The article reviews Red Hat Ceph Storage 2’s major updates—including multi‑site support, enhanced authentication, S3 compatibility, and performance gains with InfiniFlash—explains its pivotal role in OpenStack deployments, and mentions the 2016 China Open Source Storage Summit.
This article details the architectural design and implementation of a scalable big data platform built on AWS services, highlighting the transition from HDFS to S3 for storage, the use of EMR for elastic compute, and a custom Execution Service integrated with Consul and Airflow for automated cluster management and task scheduling.
Baidu’s LBS Cloud Storage and Retrieval platform offers developers a fully managed, high‑performance solution for massive geospatial data, featuring free large‑scale storage, GeoHash‑based spatial queries, real‑time updates, strong isolation, and a series of architectural optimizations that dramatically improve latency, availability, and scalability.
This guide consolidates Huawei OBS eSDK storage training, explains the service’s core capabilities, lists bucket and object operations, and walks through setting up a C# development environment with step‑by‑step demos for creating buckets, uploading, downloading, and hosting static sites.
This article examines why Windows‑based image servers are often seen as conservative, outlines the limitations of single‑server and clustered designs, and presents modern, scalable architectures using virtual directories, shared storage, FastDFS, and CDN integration for high‑performance web applications.
The article analyzes the staggering traffic, storage needs, and infrastructure of major adult video platforms, revealing that sites like Xvideos and YouPorn handle tens of petabytes of data monthly, requiring bandwidth and hardware comparable to leading streaming services.
This article outlines Meipai’s evolution into a billion‑user short‑video platform, detailing its high‑availability, scalable architecture, service discovery via etcd, data storage challenges, CDN and cloud‑storage redundancy, fault‑tolerance mechanisms, and future directions such as H.265 adoption and P2P‑CDN hybrid delivery.
The interview with XiaoKaXiu CTO explains the end‑to‑end architecture of a video app, covering upload and playback pipelines, strategies for handling traffic spikes, mobile capture optimization, and multi‑region storage design to ensure security and fast access.
Using Apache JMeter, this study objectively benchmarks hot object storage performance (RT and TPS) and pricing across five major cloud vendors—AWS, Azure, Alibaba Cloud, Qiniu, and Huawei—evaluating download/upload speeds for various file sizes and calculating a performance‑to‑price ratio to guide optimal provider selection.
This article presents a systematic performance and cost‑effectiveness comparison of six major cloud object‑storage providers—AWS, Azure, Qiniu, Huawei Cloud, Alibaba Cloud, and Kingsoft Cloud—using JMeter‑driven upload/download tests across various file sizes and analyzing price data to rank their overall value.
This article presents an overview of Ctrip's cloud platform built on OpenStack, details the architecture and components of Ceph storage—including RGW and RBD—describes deployment configurations across multiple data centers, and discusses real-world use cases such as hotel image feature storage and cross‑region continuous delivery.
The article outlines Baidu Cloud's comprehensive quality assurance framework—including testing technologies, specialized safeguards, and a multi‑stage QA evolution—demonstrating how data integrity, performance, and user experience are continuously measured, monitored, and improved for a cloud storage service serving hundreds of millions of users.
The article examines the Ctrip outage by analyzing observed symptoms, evaluating the likelihood of a large‑scale database attack versus node failures, and discussing how backup strategies and private‑cloud storage could affect data recovery in such a severe security incident.
This article details how the high‑traffic mobile platform 糗百 migrated its massive image repository to Qiniu Cloud without service interruption, using the qrsync upload tool combined with Qiniu’s mirror storage to smoothly transfer cold data, handle hot data, and alleviate I/O bottlenecks.
The article summarizes Google’s recent papers that outline an architectural guide for creating elastic, scalable web applications on Google Cloud Platform, describing key components such as regions, zones, load balancers, autoscalers, Cloud SQL, Cloud Storage, and deployment best‑practices.
This guide shows how to turn a cloud‑drive folder into a pseudo‑remote Git repository, enabling seamless code synchronization between office and home without relying on services like GitHub.
From the evolution of single‑machine file systems to today’s distributed, erasure‑coded cloud storage, this article examines why storage has become increasingly complex, the limitations of traditional replication, and how Qiniu’s next‑gen architecture leverages EC, faster repairs, and cost reductions to meet scalability, reliability, and availability demands.
