Spring Boot's multipart parser writes uploads to disk before your controller runs, filling /tmp during concurrent large files; the fix is direct browser-to-object-storage uploads via presigned URLs, plus temp directory isolation, concurrency limits, and content validation.
This comprehensive guide covers MinIO cluster deployment, erasure coding configuration, S3 API compatibility nuances, TLS/load balancing setup, user policies, monitoring, backup strategies, and troubleshooting common production issues like write quorum failures and signature mismatches.
This article demonstrates how Alibaba Cloud's STAROps platform and OSS Agent collaborate to transform ops troubleshooting by correlating cross-domain monitoring data and storage-layer diagnostics, using three real-world scenarios where alerts pointed to the wrong domain while root causes lay in naming conventions, bucket policies, and referer configurations.
OpenAI's Pando Git backend separates read and write paths, stores packs immutably in object storage, and broadcasts only the main branch, reducing median push latency to one-fifth while serving 1 PB of Git data daily and 57 TB/hour with 99% cache hits.
The article explores the critical architectural choice between semantic mapping and materialized object storage for ontology implementation, detailing Tianyi Credit's lessons learned, a hybrid approach with core objects materialized, consistency via incremental updates, and a measurable delivery template.
RustFS evolved from a doubted README-only project into a production-ready, S3-compatible object storage written in Rust, now with 2.7M+ installations, seamless MinIO migration, and free Iceberg-powered S3 Tables that MinIO charges $80k/year for.
RustFS 1.0 GA releases a production-ready, Apache 2.0-licensed S3-compatible object store written in Rust, achieving 2.3× MinIO performance on 4KB objects via SIMD-accelerated erasure coding, io_uring zero-copy I/O, and a GC-free runtime, while adding built-in Iceberg REST Catalog (S3 Tables) for data-lake workloads.
The article shows how to handle 10GB file downloads in Spring Boot by replacing in-memory byte[] loading with streaming via FileSystemResource and leveraging Spring MVC's built-in Range request support for resumable downloads, while covering security, immutability, and object storage offloading.
This article explains how a pre-gateway routes requests to the correct container type, how dual storage tracks (shared filesystem for development, object storage for runtime) prevent file inconsistencies, and why a same-region file proxy handles I/O operations, including design trade-offs and common pitfalls.
RustFS, a Rust-written S3-compatible distributed object storage, hits GA with 32.5K GitHub stars, offering MinIO migration paths including on-demand data migration, versioning, erasure coding, and storage pool scaling, plus a Docker quick-start for production evaluation.
RustFS 1.0 GA launches as a production-ready, Apache 2.0-licensed, S3-compatible object storage written in Rust, offering MinIO migration paths, 2.3x faster 4KB object performance, and a roadmap targeting AI data infrastructure with S3 Tables and vector storage.
Ray History Server solves the loss of observability when ephemeral Ray clusters terminate by archiving logs, events, and dashboard snapshots to object storage, enabling long-term querying, debugging, and unified access to both live and historical clusters via a reconstructed dashboard.
At Apache COC Asia 2026, Didi’s engineers presented three deep‑dive sessions covering the evolution of massive‑scale object storage with Ozone, cost‑effective lakehouse migration using Iceberg and real‑time ingestion, and AI‑friendly enhancements to the open‑source Seata project, detailing architectural choices, performance gains, and open‑source contributions.
The article breaks down five durability tiers for database writes—from in‑memory acknowledgment to cross‑availability‑zone replication—explaining how the point at which success is reported determines latency, fault tolerance, and the hidden coordination work a system must perform.
This article details building an enterprise file service platform using Spring Boot and MinIO, covering cluster architecture, multi-tenant isolation, SDK tuning, multipart upload with resumable frontend direct upload, lifecycle management, security controls, production optimization, and async image processing pipelines.
The article explains that MinIO Community removed its web management console in February 2024, why the change was made, and provides a step‑by‑step guide to set up the Rust‑based RustFS object storage as a functional alternative, including deployment, HTTPS configuration, and a feature comparison.
The article compares open‑source MinIO with commercial object storage services such as Alibaba OSS, Tencent COS, Huawei OBS, and Amazon S3, analyzing architecture, maintenance responsibilities, total cost of ownership, and suitability criteria to help enterprises decide which storage path aligns with their control needs and operational capabilities.
The article explains block, file, and object storage by describing their core characteristics, advantages, disadvantages, typical scenarios, and provides a concise comparison to help readers quickly choose the appropriate storage type for databases, shared files, or massive media assets.
The article analyzes the storage, query performance, high‑availability, and data‑loss challenges of running Prometheus on a 1,000‑node Kubernetes cluster and demonstrates how a Thanos‑based architecture—Sidecar, Query, Store Gateway, Compactor, Receiver, and object‑storage back‑ends—can be designed, tuned, and operated to achieve horizontal scalability, efficient down‑sampling, and reliable fault recovery.
ZestKV is a Redis‑compatible distributed KV store that separates compute from storage, using a log service and object storage to lower hardware costs, guarantee data durability, and enable independent, elastic scaling of compute and storage resources.
This guide walks through the complete deployment of MinIO, an S3‑compatible object storage system, covering single‑node and erasure‑coded multi‑node clusters, hardware planning, TLS setup, bucket policies, lifecycle management, security hardening, monitoring with Prometheus, backup strategies, and detailed troubleshooting procedures, all backed by concrete commands and configuration examples.
This article walks through moving image storage from TiDB Cloud to Qiniu Cloud for a WeChat mini‑program, detailing a Rust + Actix‑Web backend that validates image format, deduplicates via SHA‑256 content‑addressable keys, creates upload tokens, performs idempotent multipart uploads, and builds hour‑aligned private download URLs with referer protection.
This guide explains why traditional block and file storage struggle with massive unstructured data, introduces MinIO as a high‑performance, Go‑based S3‑compatible object storage, and provides step‑by‑step instructions for single‑node and erasure‑coded multi‑node deployments, TLS setup, client usage, policies, monitoring, backup, and troubleshooting.
As data volumes surge, the article compares six mainstream storage technologies—relational databases, data warehouses, NoSQL databases, search storage, object storage, and data lakes—explaining their core principles, ideal use cases, and trade‑offs to help you select the most suitable solution for your workload.
This guide covers MinIO object storage deployment with ready-to-use automation scripts for both standalone and distributed modes, including environment checks, binary download methods, systemd service configuration, and cluster requirements for production use.
The article explains how MinIO's community edition removed its web console via a large PR, outlines the official push toward a commercial product, and provides a step‑by‑step guide to deploying the Rust‑based RustFS as an open‑source alternative with Docker Compose and Nginx HTTPS configuration, concluding with a feature comparison.
This guide walks you through installing the RustFS distributed object storage via Docker, using its visual console, and configuring a SpringBoot project to upload and delete files through the RustFS S3‑compatible API, complete with code snippets and practical screenshots.
With MinIO entering maintenance mode, this article evaluates open‑source S3‑compatible alternatives—Ceph, SeaweedFS, Garage, and RustFS—detailing their strengths, limitations, security concerns, and practical deployment tips, while concluding that none yet offers a perfect drop‑in replacement.
After MinIO entered maintenance mode in December 2025, RustFS—a Rust‑written, Apache‑2.0 licensed, high‑performance distributed object storage—offers memory‑safe design, cross‑platform Docker deployment, S3 compatibility, and seamless integration with the Webman PHP framework, providing a compelling alternative for cloud‑native environments.
Learn how to quickly set up a high‑performance, easy‑to‑deploy object storage solution by combining RustFS with Docker, covering prerequisites, Docker commands, optional Docker‑Compose configuration, Nginx reverse‑proxy setup, security hardening, testing, and production‑grade recommendations for backend developers and ops teams.
MinIO has entered maintenance mode, dropping its web console, stopping Docker image updates, and refusing new features, prompting users to migrate to RustFs—a fully compatible, Apache‑2.0 licensed S3 alternative that offers higher performance and easy Docker and Spring Boot integration.
This step‑by‑step guide explains why Amazon S3 is chosen as a universal protocol, walks through creating a Spring Boot project, defining configuration properties, implementing an OSS template, auto‑configuring beans, packaging the starter, and testing it against services like MinIO, Alibaba OSS, and Tencent COS.
This article examines the design and implementation of a proprietary concurrent Append‑Only distributed object storage system, detailing its unified persistence layer, heavyweight client, hardware optimizations, metadata simplification, flexible redundancy, high availability, and real‑world performance gains across big‑data, AI, and log‑archiving workloads.
MinIO, the high‑performance distributed object storage system with over a billion downloads, stopped providing pre‑built Docker images after its October 2025 CVE‑compliant release, forcing users to build from source and sparking heated community debate over licensing, security, and the sustainability of free open‑source distribution.
This article examines MinIO’s security vulnerability, open‑source license shift, feature reductions, and Docker image distribution changes, offering mitigation steps and alternative solutions for enterprises relying on cloud‑native object storage.
MinIO, once the fastest‑growing open‑source object storage, stopped publishing pre‑built Docker images in October 2025, forcing users to build from source, sparking community backlash, raising security and operational concerns, and prompting discussions about the project's future direction.
This guide walks backend engineers through the fundamentals of object storage, showing how to perform quick OSS uploads, implement multipart uploads for large files, prevent duplicate uploads with MD5 checks, and secure files against malicious content using header validation, content scanning, and bucket isolation.
This article explains the core concepts and architectures of distributed storage, covering file‑based systems like HDFS, object storage such as Ceph, block storage for high‑performance workloads, and key‑value stores like Redis and Cassandra, highlighting their use cases and design principles.
This article walks you through MinIO’s features, deployment requirements, Docker installation, web‑UI access, bucket creation, sharing links, access policies, and using the MinIO client (mc) for common S3‑compatible operations, all with clear command examples and screenshots.
This guide walks you through installing MinIO Client (mc) via Docker, Homebrew, Linux/Windows binaries, or source, and then demonstrates core commands for adding hosts, listing servers, creating and inspecting buckets, uploading and deleting objects, and removing buckets.
This article compares StarRocks' integrated (BE) and separated (CN + object storage) architectures, detailing write flows like Stream Load with MemTable and compaction, read flows with local vs cached data, and scalability trade-offs.
The article explains MinIO's removal of its open‑source console in May 2025, introduces the RustFS distributed object storage as an alternative, and provides step‑by‑step Docker deployment, log inspection, and basic mc commands to verify functionality.
This article provides a step‑by‑step tutorial on configuring Spring Boot to work with MinIO, covering YAML settings, property binding, utility classes for file upload/download, controller and service implementations, key technical points, and best‑practice recommendations for scalable backend file storage.
This article walks through creating a self‑hosted object storage solution by configuring Nginx for static file serving, implementing secure downloads with X‑Accel‑Redirect and signed URLs, and deploying MinIO as an S3‑compatible service, complete with Spring Boot integration and sample code.
This step‑by‑step tutorial shows how to deploy StarRocks and MinIO in a decoupled storage‑compute architecture using Docker Compose and Kubernetes, configure local caching, create storage volumes, load public datasets, and run SQL queries to explore the combined data.
RustFS is an open‑source, Rust‑based distributed object storage system that is fully S3‑compatible, runs on any major OS and CPU architecture, and can be quickly deployed with Docker for cloud‑native environments, with step‑by‑step usage examples in PHP.
This guide explains what JuiceFS is, its cloud‑native architecture separating data and metadata, and provides step‑by‑step instructions—including prerequisites, client installation, formatting, mounting, and verification—to help you deploy the high‑performance distributed file system on object storage and PostgreSQL.
This article explains how Erasure Coding (EC) improves data reliability and dramatically reduces storage overhead in Ozone by leveraging hot‑cold data characteristics, intelligent tiering, dynamic EC ratios, and repair throttling, while also discussing performance trade‑offs and limitations.
The article provides a detailed technical overview of Alibaba Cloud's Object Storage Service (OSS), covering its architecture, features such as massive scalability, lifecycle management, versioning, cross‑region replication, security mechanisms, access methods, and common use cases like static website hosting, big‑data analytics, backup, and multimedia processing.
This guide walks you through deploying a highly available MinIO distributed object storage cluster on Rocky 9, covering prerequisites, environment preparation, user and directory setup, configuration files, systemd service creation, testing, Nginx load balancing, and verification of cluster health.
This article explains the concepts, advantages, and disadvantages of block storage, file storage, and object storage, compares their architectures, and clarifies when each type is appropriate for different applications and workloads.
On March 21 2025, a mis‑deployed credential during R2 Gateway's key rotation caused a 1‑hour‑7‑minute outage that blocked all write operations and about 35% of reads across R2 and several downstream Cloudflare services, prompting a detailed post‑mortem and a set of corrective actions to improve visibility and safety of credential changes.
StrmVol storage volumes replace the FUSE‑based OSS mount with a virtual block device and kernel‑mode file system, dramatically reducing latency for massive small‑file reads in Kubernetes workloads such as AI training datasets, and the article demonstrates setup, configuration, and performance testing using Argo Workflows.
This guide walks you through installing the MinIO Client (mc) via Docker, Homebrew, or direct binary download, then demonstrates core commands for adding cloud hosts, listing servers, creating and managing buckets, uploading files, and cleaning up resources.
This guide explains how to use Alibaba Cloud's Function Compute, OSS, and Vision AI to quickly set up a face‑matching service, covering architecture, deployment steps, and practical usage scenarios such as identity verification, access control, and security monitoring.
This guide explains why MinIO is a high‑performance, S3‑compatible object storage solution and walks you through the prerequisites, Helm‑based installation steps on a Kubernetes cluster, verification procedures, and best‑practice tips for deploying a secure, scalable production‑grade MinIO service.
This article provides a step‑by‑step guide to building a Spring Boot starter that abstracts object storage services (OSS) via the Amazon S3 protocol, covering dependency selection, configuration properties, template interfaces, implementation, auto‑configuration, packaging, and testing for cloud‑native backend applications.
This article explains Ozone's object storage architecture, its evolution of metadata management using distributed KV stores like Apache Cassandra, and the performance optimizations—read/write separation, unlimited scaling, and partitioning—that enable high‑throughput, low‑latency handling of massive datasets.
This guide walks you through setting up a private MinIO object storage server using Docker, explains core concepts like buckets and access keys, and demonstrates how to configure the Webman PHP framework with the MinIO plugin to upload, manage, and preview files via the MinIO console.
This article analyzes the evolution of data‑lake storage acceleration, compares traditional parallel file systems, object‑storage‑based solutions and modern cache‑enabled architectures, and explains how cloud‑native data lakes address scalability, cost, and performance challenges for AI and big‑data workloads.
Baidu’s Data Lake Storage Acceleration 2.0 replaces traditional HDFS with a scalable object‑storage foundation, introducing an adaptive hierarchical namespace, high‑throughput streaming engine, RapidFS caching, and fully compatible BOS‑HDFS APIs, thereby delivering up to 70 % higher throughput, lower costs, and seamless migration for big‑data and AI workloads.
Data lakes have evolved from HDFS to object storage, addressing resource inefficiency, scalability limits, and operational burdens; Baidu’s Data Lake Storage Acceleration 2.0 introduces hierarchical Namespace 2.0, a streaming storage engine, RapidFS caching, and a fully HDFS‑compatible BOS‑HDFS layer to boost performance and support massive AI workloads.
Baidu's latest data lake acceleration 2.0 replaces HDFS with a scalable object‑storage foundation, introduces a hierarchical Namespace 2.0, a high‑throughput streaming engine, RapidFS caching, and a fully HDFS‑compatible BOS‑HDFS layer, delivering up to 70% higher throughput and dramatically lower costs for big data and AI pipelines.
Block, file, and object storage each offer distinct architectures and trade‑offs—block storage provides high performance but limited sharing, file storage enables easy sharing at lower speeds, and object storage combines both advantages with metadata‑driven distribution—this guide explains their principles, benefits, drawbacks, and ideal applications.
Quickwit is a Rust‑based distributed search engine that enables sub‑second queries directly on cloud object storage, and its documentation details the architecture, core concepts, installation, data ingestion, log management, tracing, deployment options, configuration, and operational best practices.
This article provides a step‑by‑step guide to building a Spring Boot starter that abstracts OSS object‑storage services via the Amazon S3 protocol, covering project setup, Maven dependencies, configuration properties, template interfaces, implementation, auto‑configuration, packaging, and testing.
This tutorial walks you through creating Ceph RGW users, configuring Kubernetes secrets, deploying the CSI‑S3 driver, setting up a storage class and persistent volume claim, and verifying the integration, while highlighting experimental status and important tips for production use.
This article provides a comprehensive overview of object storage, covering its origins, historical development, fundamental operations, key advantages over block and file storage, major application scenarios, and predicted future trends in cloud and big‑data environments.
This article provides a comprehensive guide to installing MinIO on CentOS 7, configuring it with Docker, integrating it into a Spring Boot application, and implementing file upload, download, and multipart upload features using MinIO's Java SDK, along with troubleshooting tips and code examples.
This article provides a comprehensive tutorial on MinIO, covering its features, application scenarios, Docker installation on CentOS 7, firewall configuration, Spring Boot integration, chunked upload implementation, and testing, complete with code examples and troubleshooting tips.
This article walks through setting up MinIO, installing it via Docker on CentOS 7, configuring Spring Boot, and implementing chunked, instant‑resume, and resumable uploads for large files, complete with code examples, Docker commands, and troubleshooting tips.
This article provides a detailed tutorial on installing MinIO on CentOS 7 using Docker, configuring it, integrating with Spring Boot for multipart upload, generating presigned URLs, and includes complete Java code examples for utilities and controllers, covering use cases, deployment steps, and troubleshooting tips.
The article introduces oss_pipe, a Rust‑based file migration utility designed for large‑scale object storage transfers, compares it with existing Java and Go tools, highlights Rust’s memory safety and performance advantages, outlines its core features, and presents benchmark results demonstrating multi‑gigabit throughput and efficient resource usage.
This article explains why direct file storage on application servers is not scalable, introduces Alibaba Cloud OSS as an object storage solution, walks through bucket creation, access key management, Node.js upload code, temporary credentials for browser uploads, CDN integration, and security considerations, providing a complete end‑to‑end upload workflow.
This article presents JuiceFS, a cloud‑native distributed file system that bridges the gaps between HDFS and object storage, explaining Data Lake and Lakehouse concepts, comparing storage options, detailing JuiceFS's architecture and performance benefits, and showcasing real‑world user case studies.
This article presents a comprehensive overview of Ozone, a Hadoop‑based distributed object storage system, detailing its architecture, metadata management, scalability enhancements, small‑file handling, erasure coding, lifecycle policies, and future improvements aimed at boosting performance and reliability for large‑scale unstructured data workloads.
This presentation outlines NetEase's NDH big‑data platform, detailing its background, object‑storage upload and rename optimizations, Impala engine adaptations—including file‑handle caching, transparent URI handling, and getFileBlockLocations improvements—and a suite of operational enhancements such as dynamic proxy user configuration and audit‑log extensions.
This article provides a step‑by‑step guide to building a Spring Boot starter that abstracts Amazon S3‑compatible object storage services such as Alibaba Cloud OSS, Tencent COS, Qiniu OSS, and MinIO, covering dependency setup, configuration properties, template interfaces, implementation, auto‑configuration, packaging, and testing.
This article explains CDN fundamentals, its DNS‑based routing and caching mechanisms, how back‑origin works, when CDN accelerates content delivery, the costs involved, and scenarios where using a CDN may not bring performance benefits.
This article explains how to design SLA metrics for object storage services, describes the S3 protocol, proposes availability calculations, outlines monitoring and alerting rules, and provides practical implementation examples using s3cmd, Python boto, and Java SDK to ensure reliable cloud storage operations.
This article presents Kingsoft Cloud's comprehensive practice on big data compute‑storage separation, detailing the challenges of modern data platforms, comparing HDFS with object storage, describing three separation modes, and explaining the architecture, core modules, performance optimizations, and advantages of the KS3‑HDFS solution.
Xiaohongshu built REDck, a cloud‑native, storage‑compute separated real‑time OLAP warehouse on ClickHouse, addressing scaling, cost, and reliability challenges through a unified metadata service, object‑storage optimizations, multi‑level caching, distributed task scheduling, bucketing, and exactly‑once transaction support.
Magnetic tape, once the music‑distribution workhorse, remains essential for enterprise deep‑archive thanks to its low cost, high capacity, and durability, with LTO and IBM 3592 cartridges housed in large libraries, while cloud object‑storage deep‑archive tiers and Tencent’s Berg cold‑data engine provide API‑driven ingestion, retrieval, erasure‑coding, and fault‑tolerant management for truly cold workloads that tolerate hours‑long latency.
To tackle the massive data, high‑throughput and low‑latency demands of large‑model training and inference, the talk proposes a unified data‑lake built on scalable object storage combined with an acceleration layer—either a parallel file system or cloud‑native RapidFS cache—demonstrating multi‑fold training speedups, faster checkpoint uploads, and linear inference scaling.
AI Model StorageAccelerated FilesystemObject Storage
This article examines the storage challenges posed by large AI models, analyzes the full workflow from data ingestion to inference, compares HDFS and object‑storage data lakes, and presents Baidu's cloud‑native storage‑acceleration solutions—including RapidFS and PFS—that dramatically improve training speed, checkpoint handling, and model deployment throughput.
This article explains common storage types—file (NAS), block (EBS), and object (OSS)—detailing their physical foundations, performance metrics, underlying Alibaba Cloud architectures, protocol differences, and ideal application scenarios to help readers select the most suitable storage solution for any workload.
This article examines the performance challenges of cloud‑native data lakes built on flat object storage and explains how a hierarchical‑namespace design improves directory operations, reduces request amplification, and delivers significant speedups for big‑data and AI workloads.
This article examines the evolution of big‑data storage from on‑premise HDFS to cloud‑native object storage, compares their architectures and performance, outlines future lakehouse storage requirements, and demonstrates a practical implementation using the JuiceFS distributed file system.
This guide introduces MinIO as an S3‑compatible object storage service and walks through its installation, Maven dependencies, Spring Boot configuration, Java client setup, REST controller implementation for file upload, preview, download, and deletion, and includes debugging screenshots.
The article explains how Apache Doris 2.0 introduces hot‑cold data tiering to move infrequently accessed data from expensive SSDs to cheaper object storage, dramatically reducing storage costs while maintaining query performance through automatic lifecycle management, storage policies, and cache mechanisms.
This article demonstrates step‑by‑step how to set up a high‑performance MinIO object storage service using Docker, configure it in a Spring Boot application, and integrate file upload functionality with a Vue/Element‑UI front‑end, including code snippets for Docker commands, Java client setup, and UI implementation.
This guide explains object storage fundamentals, the bucket model, Ceph's RADOS Gateway (RGW) architecture, step‑by‑step installation (online and offline), configuration, keyring creation, pool setup, troubleshooting PG limits, user creation, and how to access RGW using AWS CLI tools.
This article explains how to create a reusable Spring Boot starter for enterprise‑level object storage services by leveraging the Amazon S3 protocol, covering OSS fundamentals, dependency setup, configuration properties, template interfaces, implementation, auto‑configuration, packaging, and testing with code examples.
This article walks through using Rust and the AWS SDK to connect to object storage services, perform basic CRUD operations, and handle large file uploads and downloads efficiently with multipart techniques.
This tutorial walks you through creating a minimal Linux VM in VirtualBox, adding four virtual disks, formatting and mounting them, and then installing and configuring MinIO in a single‑node multi‑drive setup using systemd, complete with verification commands and screenshots.
This article explains how to build a ready‑to‑use Spring Boot starter for enterprise OSS object storage, leveraging the Amazon S3 protocol to support major providers such as Alibaba Cloud OSS, Tencent COS, Qiniu OSS, and MinIO, and includes full Maven configuration, Java code, and packaging steps.
COSI (Container Object Storage Interface) is an alpha feature in Kubernetes v1.25 that standardizes object storage provisioning and usage, offering Kubernetes-native bucket management, self‑service capabilities for DevOps, and cross‑cluster and cross‑provider portability through a unified API and driver architecture.
This article details Baidu's Cloud Storage (BOS) architecture, the challenges of its legacy metadata system, and the design of a new generation metadata engine that enables trillion‑object buckets, million‑QPS performance, hierarchical namespaces, and intelligent lifecycle management.