BestHub
Sign in
Tagged articles
160 articles
Page 1 of 2
MaGe Linux Operations
MaGe Linux Operations
Feb 28, 2026 · Cloud Computing

Deploying MinIO: A Complete Guide to Private S3‑Compatible Object Storage

This guide explains why traditional block and file storage struggle with massive unstructured data, introduces MinIO as a high‑performance, Go‑based S3‑compatible object storage, and provides step‑by‑step instructions for single‑node and erasure‑coded multi‑node deployments, TLS setup, client usage, policies, monitoring, backup, and troubleshooting.

BackupKubernetesMinio
0 likes · 35 min read
Deploying MinIO: A Complete Guide to Private S3‑Compatible Object Storage
Java Companion
Java Companion
Jan 13, 2026 · Cloud Native

Why MinIO Community Dropped Its Web UI and How RustFS Can Fill the Gap

The article explains how MinIO's community edition removed its web console via a large PR, outlines the official push toward a commercial product, and provides a step‑by‑step guide to deploying the Rust‑based RustFS as an open‑source alternative with Docker Compose and Nginx HTTPS configuration, concluding with a feature comparison.

Apache 2.0Docker ComposeMinio
0 likes · 7 min read
Why MinIO Community Dropped Its Web UI and How RustFS Can Fill the Gap
macrozheng
macrozheng
Dec 17, 2025 · Backend Development

How to Deploy RustFS with Docker and Integrate It into a SpringBoot Application

This guide walks you through installing the RustFS distributed object storage via Docker, using its visual console, and configuring a SpringBoot project to upload and delete files through the RustFS S3‑compatible API, complete with code snippets and practical screenshots.

AWS S3 CompatibilityRustFSSpringBoot
0 likes · 9 min read
How to Deploy RustFS with Docker and Integrate It into a SpringBoot Application
ITPUB
ITPUB
Dec 14, 2025 · Cloud Native

What Can Replace MinIO? A Deep Dive into Ceph, SeaweedFS, Garage, and RustFS

With MinIO entering maintenance mode, this article evaluates open‑source S3‑compatible alternatives—Ceph, SeaweedFS, Garage, and RustFS—detailing their strengths, limitations, security concerns, and practical deployment tips, while concluding that none yet offers a perfect drop‑in replacement.

CephMinioRustFS
0 likes · 9 min read
What Can Replace MinIO? A Deep Dive into Ceph, SeaweedFS, Garage, and RustFS
Open Source Tech Hub
Open Source Tech Hub
Dec 13, 2025 · Cloud Native

Why RustFS Is Emerging as the Next‑Gen Open‑Source S3‑Compatible Storage

After MinIO entered maintenance mode in December 2025, RustFS—a Rust‑written, Apache‑2.0 licensed, high‑performance distributed object storage—offers memory‑safe design, cross‑platform Docker deployment, S3 compatibility, and seamless integration with the Webman PHP framework, providing a compelling alternative for cloud‑native environments.

DockerRustRustFS
0 likes · 5 min read
Why RustFS Is Emerging as the Next‑Gen Open‑Source S3‑Compatible Storage
Xiao Liu Lab
Xiao Liu Lab
Dec 8, 2025 · Backend Development

Boost Your Storage Performance: Deploy RustFS Object Store with Docker in Minutes

Learn how to quickly set up a high‑performance, easy‑to‑deploy object storage solution by combining RustFS with Docker, covering prerequisites, Docker commands, optional Docker‑Compose configuration, Nginx reverse‑proxy setup, security hardening, testing, and production‑grade recommendations for backend developers and ops teams.

BackendDevOpsDocker
0 likes · 12 min read
Boost Your Storage Performance: Deploy RustFS Object Store with Docker in Minutes
Java Architecture Diary
Java Architecture Diary
Dec 5, 2025 · Cloud Native

Why MinIO Is Going Dark and How RustFs Can Seamlessly Replace It

MinIO has entered maintenance mode, dropping its web console, stopping Docker image updates, and refusing new features, prompting users to migrate to RustFs—a fully compatible, Apache‑2.0 licensed S3 alternative that offers higher performance and easy Docker and Spring Boot integration.

DockerMinioRustFS
0 likes · 8 min read
Why MinIO Is Going Dark and How RustFs Can Seamlessly Replace It
Java Web Project
Java Web Project
Nov 14, 2025 · Backend Development

How to Build a Spring Boot Starter for Multi‑Cloud Object Storage (OSS)

This step‑by‑step guide explains why Amazon S3 is chosen as a universal protocol, walks through creating a Spring Boot project, defining configuration properties, implementing an OSS template, auto‑configuring beans, packaging the starter, and testing it against services like MinIO, Alibaba OSS, and Tencent COS.

Amazon S3OSSSpring Boot
0 likes · 15 min read
How to Build a Spring Boot Starter for Multi‑Cloud Object Storage (OSS)
Instant Consumer Technology Team
Instant Consumer Technology Team
Nov 4, 2025 · Backend Development

How a Concurrent Append‑Only Architecture Doubles Storage Performance

This article examines the design and implementation of a proprietary concurrent Append‑Only distributed object storage system, detailing its unified persistence layer, heavyweight client, hardware optimizations, metadata simplification, flexible redundancy, high availability, and real‑world performance gains across big‑data, AI, and log‑archiving workloads.

append-onlydistributed storagehigh performance
0 likes · 20 min read
How a Concurrent Append‑Only Architecture Doubles Storage Performance
IT Services Circle
IT Services Circle
Nov 3, 2025 · Cloud Native

Why MinIO Dropped Official Docker Images and What It Means for Users

MinIO, the high‑performance distributed object storage system with over a billion downloads, stopped providing pre‑built Docker images after its October 2025 CVE‑compliant release, forcing users to build from source and sparking heated community debate over licensing, security, and the sustainability of free open‑source distribution.

DockerMiniocloud-native
0 likes · 11 min read
Why MinIO Dropped Official Docker Images and What It Means for Users
dbaplus Community
dbaplus Community
Oct 28, 2025 · Cloud Native

Why MinIO Dropped Official Docker Images and What It Means for Users

MinIO, once the fastest‑growing open‑source object storage, stopped publishing pre‑built Docker images in October 2025, forcing users to build from source, sparking community backlash, raising security and operational concerns, and prompting discussions about the project's future direction.

Cloud NativeDockerMinio
0 likes · 10 min read
Why MinIO Dropped Official Docker Images and What It Means for Users
Rare Earth Juejin Tech Community
Rare Earth Juejin Tech Community
Oct 11, 2025 · Backend Development

Mastering Object Storage: From Simple OSS Uploads to Advanced Multipart Strategies

This guide walks backend engineers through the fundamentals of object storage, showing how to perform quick OSS uploads, implement multipart uploads for large files, prevent duplicate uploads with MD5 checks, and secure files against malicious content using header validation, content scanning, and bucket isolation.

Multipart UploadOSSbackend-development
0 likes · 10 min read
Mastering Object Storage: From Simple OSS Uploads to Advanced Multipart Strategies
Raymond Ops
Raymond Ops
Sep 7, 2025 · Operations

Master MinIO Client (mc): Install, Configure, and Manage Buckets Quickly

This guide walks you through installing MinIO Client (mc) via Docker, Homebrew, Linux/Windows binaries, or source, and then demonstrates core commands for adding hosts, listing servers, creating and inspecting buckets, uploading and deleting objects, and removing buckets.

CLIInstallationMc
0 likes · 7 min read
Master MinIO Client (mc): Install, Configure, and Manage Buckets Quickly
Linux Ops Smart Journey
Linux Ops Smart Journey
Aug 21, 2025 · Cloud Native

Why MinIO Dropped Its Console and How RustFS Can Fill the Gap

The article explains MinIO's removal of its open‑source console in May 2025, introduces the RustFS distributed object storage as an alternative, and provides step‑by‑step Docker deployment, log inspection, and basic mc commands to verify functionality.

RustFSS3 Compatibilityobject storage
0 likes · 7 min read
Why MinIO Dropped Its Console and How RustFS Can Fill the Gap
Lin is Dream
Lin is Dream
Aug 8, 2025 · Backend Development

How to Build a Low‑Cost Private Object Storage Service with Nginx and MinIO

This article walks through creating a self‑hosted object storage solution by configuring Nginx for static file serving, implementing secure downloads with X‑Accel‑Redirect and signed URLs, and deploying MinIO as an S3‑compatible service, complete with Spring Boot integration and sample code.

MinioNginxSpring Boot
0 likes · 17 min read
How to Build a Low‑Cost Private Object Storage Service with Nginx and MinIO
StarRocks
StarRocks
Jul 16, 2025 · Cloud Native

Build a Decoupled Storage‑Compute Data Platform with StarRocks and MinIO

This step‑by‑step tutorial shows how to deploy StarRocks and MinIO in a decoupled storage‑compute architecture using Docker Compose and Kubernetes, configure local caching, create storage volumes, load public datasets, and run SQL queries to explore the combined data.

Data LakehouseDecoupled StorageDocker Compose
0 likes · 14 min read
Build a Decoupled Storage‑Compute Data Platform with StarRocks and MinIO
Linux Ops Smart Journey
Linux Ops Smart Journey
Jun 19, 2025 · Cloud Native

How to Deploy JuiceFS: A Cloud‑Native Distributed File System Tutorial

This guide explains what JuiceFS is, its cloud‑native architecture separating data and metadata, and provides step‑by‑step instructions—including prerequisites, client installation, formatting, mounting, and verification—to help you deploy the high‑performance distributed file system on object storage and PostgreSQL.

Distributed File SystemJuiceFScloud-native
0 likes · 7 min read
How to Deploy JuiceFS: A Cloud‑Native Distributed File System Tutorial
360 Zhihui Cloud Developer
360 Zhihui Cloud Developer
Jun 6, 2025 · Fundamentals

How Erasure Coding Cuts Storage Costs in Ozone: A Deep Dive

This article explains how Erasure Coding (EC) improves data reliability and dramatically reduces storage overhead in Ozone by leveraging hot‑cold data characteristics, intelligent tiering, dynamic EC ratios, and repair throttling, while also discussing performance trade‑offs and limitations.

Data ReliabilityOzoneStorage Optimization
0 likes · 9 min read
How Erasure Coding Cuts Storage Costs in Ozone: A Deep Dive
MaGe Linux Operations
MaGe Linux Operations
Jun 2, 2025 · Operations

How to Deploy a High‑Availability MinIO Distributed Cluster on Rocky 9

This guide walks you through deploying a highly available MinIO distributed object storage cluster on Rocky 9, covering prerequisites, environment preparation, user and directory setup, configuration files, systemd service creation, testing, Nginx load balancing, and verification of cluster health.

Miniodistributed storagehigh availability
0 likes · 20 min read
How to Deploy a High‑Availability MinIO Distributed Cluster on Rocky 9
ITPUB
ITPUB
Apr 30, 2025 · Operations

Why a Credential‑Rotation Mistake Took Down Cloudflare R2 and Its Dependent Services

On March 21 2025, a mis‑deployed credential during R2 Gateway's key rotation caused a 1‑hour‑7‑minute outage that blocked all write operations and about 35% of reads across R2 and several downstream Cloudflare services, prompting a detailed post‑mortem and a set of corrective actions to improve visibility and safety of credential changes.

Operationscloud computingcredential management
0 likes · 15 min read
Why a Credential‑Rotation Mistake Took Down Cloudflare R2 and Its Dependent Services
Alibaba Cloud Infrastructure
Alibaba Cloud Infrastructure
Apr 28, 2025 · Cloud Native

Improving OSS Small‑File Access Performance with StrmVol Storage Volumes in Kubernetes

StrmVol storage volumes replace the FUSE‑based OSS mount with a virtual block device and kernel‑mode file system, dramatically reducing latency for massive small‑file reads in Kubernetes workloads such as AI training datasets, and the article demonstrates setup, configuration, and performance testing using Argo Workflows.

Argo WorkflowsCSIKubernetes
0 likes · 13 min read
Improving OSS Small‑File Access Performance with StrmVol Storage Volumes in Kubernetes
Alibaba Cloud Developer
Alibaba Cloud Developer
Dec 31, 2024 · Artificial Intelligence

How to Deploy Cloud-Based Face Recognition with Alibaba AI Services

This guide explains how to use Alibaba Cloud's Function Compute, OSS, and Vision AI to quickly set up a face‑matching service, covering architecture, deployment steps, and practical usage scenarios such as identity verification, access control, and security monitoring.

Alibaba CloudCloud AIdeployment tutorial
0 likes · 6 min read
How to Deploy Cloud-Based Face Recognition with Alibaba AI Services
Linux Ops Smart Journey
Linux Ops Smart Journey
Dec 18, 2024 · Cloud Native

How to Deploy MinIO Object Storage on Kubernetes for Production

This guide explains why MinIO is a high‑performance, S3‑compatible object storage solution and walks you through the prerequisites, Helm‑based installation steps on a Kubernetes cluster, verification procedures, and best‑practice tips for deploying a secure, scalable production‑grade MinIO service.

Kuberneteshelmobject storage
0 likes · 8 min read
How to Deploy MinIO Object Storage on Kubernetes for Production
Code Ape Tech Column
Code Ape Tech Column
Dec 2, 2024 · Backend Development

Creating an Enterprise‑Grade OSS Object Storage Spring Boot Starter Based on Amazon S3

This article provides a step‑by‑step guide to building a Spring Boot starter that abstracts object storage services (OSS) via the Amazon S3 protocol, covering dependency selection, configuration properties, template interfaces, implementation, auto‑configuration, packaging, and testing for cloud‑native backend applications.

Amazon S3BackendOSS
0 likes · 15 min read
Creating an Enterprise‑Grade OSS Object Storage Spring Boot Starter Based on Amazon S3
360 Zhihui Cloud Developer
360 Zhihui Cloud Developer
Nov 29, 2024 · Big Data

How Ozone Scales Metadata for Massive Big Data Storage

This article explains Ozone's object storage architecture, its evolution of metadata management using distributed KV stores like Apache Cassandra, and the performance optimizations—read/write separation, unlimited scaling, and partitioning—that enable high‑throughput, low‑latency handling of massive datasets.

Apache CassandraBig DataDistributed KV
0 likes · 9 min read
How Ozone Scales Metadata for Massive Big Data Storage
Baidu Geek Talk
Baidu Geek Talk
Nov 13, 2024 · Industry Insights

Why Cloud‑Native Data Lakes Are the New Standard for Storage Acceleration

This article analyzes the evolution of data‑lake storage acceleration, compares traditional parallel file systems, object‑storage‑based solutions and modern cache‑enabled architectures, and explains how cloud‑native data lakes address scalability, cost, and performance challenges for AI and big‑data workloads.

AIBig DataCloud Native
0 likes · 24 min read
Why Cloud‑Native Data Lakes Are the New Standard for Storage Acceleration
Baidu Tech Salon
Baidu Tech Salon
Nov 5, 2024 · Big Data

Accelerating Data Lake Storage for Big Data and AI: Baidu's Solutions

Baidu’s Data Lake Storage Acceleration 2.0 replaces traditional HDFS with a scalable object‑storage foundation, introducing an adaptive hierarchical namespace, high‑throughput streaming engine, RapidFS caching, and fully compatible BOS‑HDFS APIs, thereby delivering up to 70 % higher throughput, lower costs, and seamless migration for big‑data and AI workloads.

AIBOS-HDFSBig Data
0 likes · 11 min read
Accelerating Data Lake Storage for Big Data and AI: Baidu's Solutions
Baidu Geek Talk
Baidu Geek Talk
Nov 4, 2024 · Big Data

Why Object Storage Is Replacing HDFS for Modern Data Lakes: Baidu’s 2.0 Acceleration

Data lakes have evolved from HDFS to object storage, addressing resource inefficiency, scalability limits, and operational burdens; Baidu’s Data Lake Storage Acceleration 2.0 introduces hierarchical Namespace 2.0, a streaming storage engine, RapidFS caching, and a fully HDFS‑compatible BOS‑HDFS layer to boost performance and support massive AI workloads.

AIBaiduBig Data
0 likes · 12 min read
Why Object Storage Is Replacing HDFS for Modern Data Lakes: Baidu’s 2.0 Acceleration
Baidu Intelligent Cloud Tech Hub
Baidu Intelligent Cloud Tech Hub
Oct 21, 2024 · Big Data

How Baidu’s Data Lake Acceleration 2.0 Supercharges Big Data and AI Workloads

Baidu's latest data lake acceleration 2.0 replaces HDFS with a scalable object‑storage foundation, introduces a hierarchical Namespace 2.0, a high‑throughput streaming engine, RapidFS caching, and a fully HDFS‑compatible BOS‑HDFS layer, delivering up to 70% higher throughput and dramatically lower costs for big data and AI pipelines.

AICloud Nativeobject storage
0 likes · 12 min read
How Baidu’s Data Lake Acceleration 2.0 Supercharges Big Data and AI Workloads
MaGe Linux Operations
MaGe Linux Operations
Oct 5, 2024 · Fundamentals

Understanding Block, File, and Object Storage: Pros, Cons, and Use Cases

Block, file, and object storage each offer distinct architectures and trade‑offs—block storage provides high performance but limited sharing, file storage enables easy sharing at lower speeds, and object storage combines both advantages with metadata‑driven distribution—this guide explains their principles, benefits, drawbacks, and ideal applications.

NASSANblock storage
0 likes · 9 min read
Understanding Block, File, and Object Storage: Pros, Cons, and Use Cases
Top Architect
Top Architect
Sep 8, 2024 · Backend Development

Building an OSS Spring Boot Starter Using Amazon S3

This article provides a step‑by‑step guide to creating a Spring Boot starter for enterprise‑grade object storage services, explaining OSS concepts, Amazon S3 basics, project setup, Maven dependencies, configuration classes, template interfaces, implementation details, auto‑configuration, packaging, and testing.

Amazon S3OSSSpring Boot
0 likes · 21 min read
Building an OSS Spring Boot Starter Using Amazon S3
Java Architect Essentials
Java Architect Essentials
Jul 23, 2024 · Cloud Native

Guide to Installing and Using MinIO with Spring Boot and Docker

This article provides a comprehensive guide to installing MinIO on CentOS 7, configuring it with Docker, integrating it into a Spring Boot application, and implementing file upload, download, and multipart upload features using MinIO's Java SDK, along with troubleshooting tips and code examples.

DockerMinioSpring Boot
0 likes · 23 min read
Guide to Installing and Using MinIO with Spring Boot and Docker
Code Ape Tech Column
Code Ape Tech Column
Jul 8, 2024 · Backend Development

Guide to Installing and Using MinIO with Spring Boot for Object Storage

This article provides a comprehensive tutorial on MinIO, covering its features, application scenarios, Docker installation on CentOS 7, firewall configuration, Spring Boot integration, chunked upload implementation, and testing, complete with code examples and troubleshooting tips.

Spring Bootchunked uploadobject storage
0 likes · 21 min read
Guide to Installing and Using MinIO with Spring Boot for Object Storage
Top Architect
Top Architect
Jun 27, 2024 · Cloud Computing

Comprehensive Guide to Installing and Using MinIO with Spring Boot and Docker

This article provides a detailed tutorial on installing MinIO on CentOS 7 using Docker, configuring it, integrating with Spring Boot for multipart upload, generating presigned URLs, and includes complete Java code examples for utilities and controllers, covering use cases, deployment steps, and troubleshooting tips.

DockerMinioSpringBoot
0 likes · 24 min read
Comprehensive Guide to Installing and Using MinIO with Spring Boot and Docker
JD Cloud Developers
JD Cloud Developers
May 13, 2024 · Operations

Why Rust Powers oss_pipe: A High‑Performance Cloud File Migration Tool

The article introduces oss_pipe, a Rust‑based file migration utility designed for large‑scale object storage transfers, compares it with existing Java and Go tools, highlights Rust’s memory safety and performance advantages, outlines its core features, and presents benchmark results demonstrating multi‑gigabit throughput and efficient resource usage.

File MigrationRustcloud operations
0 likes · 6 min read
Why Rust Powers oss_pipe: A High‑Performance Cloud File Migration Tool
IT Services Circle
IT Services Circle
Jan 27, 2024 · Cloud Computing

Using Alibaba Cloud OSS for File Uploads: Setup, Code Samples, and Best Practices

This article explains why direct file storage on application servers is not scalable, introduces Alibaba Cloud OSS as an object storage solution, walks through bucket creation, access key management, Node.js upload code, temporary credentials for browser uploads, CDN integration, and security considerations, providing a complete end‑to‑end upload workflow.

Alibaba CloudCDNNode.js
0 likes · 10 min read
Using Alibaba Cloud OSS for File Uploads: Setup, Code Samples, and Best Practices
DataFunTalk
DataFunTalk
Jan 27, 2024 · Big Data

JuiceFS: A Cloud‑Native Distributed File System for Data Lake and Lakehouse

This article presents JuiceFS, a cloud‑native distributed file system that bridges the gaps between HDFS and object storage, explaining Data Lake and Lakehouse concepts, comparing storage options, detailing JuiceFS's architecture and performance benefits, and showcasing real‑world user case studies.

Big DataDistributed File SystemJuiceFS
0 likes · 23 min read
JuiceFS: A Cloud‑Native Distributed File System for Data Lake and Lakehouse
360 Smart Cloud
360 Smart Cloud
Jan 15, 2024 · Big Data

Design and Optimization of the Ozone Distributed Object Storage System

This article presents a comprehensive overview of Ozone, a Hadoop‑based distributed object storage system, detailing its architecture, metadata management, scalability enhancements, small‑file handling, erasure coding, lifecycle policies, and future improvements aimed at boosting performance and reliability for large‑scale unstructured data workloads.

Big DataDistributed SystemsHadoop
0 likes · 15 min read
Design and Optimization of the Ozone Distributed Object Storage System
DataFunTalk
DataFunTalk
Jan 14, 2024 · Big Data

Optimizing Object Storage and Impala Engine in NetEase NDH: Performance Enhancements and Feature Additions

This presentation outlines NetEase's NDH big‑data platform, detailing its background, object‑storage upload and rename optimizations, Impala engine adaptations—including file‑handle caching, transparent URI handling, and getFileBlockLocations improvements—and a suite of operational enhancements such as dynamic proxy user configuration and audit‑log extensions.

AlluxioBig DataImpala
0 likes · 14 min read
Optimizing Object Storage and Impala Engine in NetEase NDH: Performance Enhancements and Feature Additions
Code Ape Tech Column
Code Ape Tech Column
Jan 4, 2024 · Backend Development

Creating an Enterprise-Grade OSS Object Storage Spring Boot Starter

This article provides a step‑by‑step guide to building a Spring Boot starter that abstracts Amazon S3‑compatible object storage services such as Alibaba Cloud OSS, Tencent COS, Qiniu OSS, and MinIO, covering dependency setup, configuration properties, template interfaces, implementation, auto‑configuration, packaging, and testing.

Amazon S3BackendOSS
0 likes · 15 min read
Creating an Enterprise-Grade OSS Object Storage Spring Boot Starter
DevOps
DevOps
Oct 26, 2023 · Operations

Design and Implementation of SLA for Object Storage Services

This article explains how to design SLA metrics for object storage services, describes the S3 protocol, proposes availability calculations, outlines monitoring and alerting rules, and provides practical implementation examples using s3cmd, Python boto, and Java SDK to ensure reliable cloud storage operations.

SLAmonitoringobject storage
0 likes · 16 min read
Design and Implementation of SLA for Object Storage Services
DataFunSummit
DataFunSummit
Sep 16, 2023 · Big Data

Kingsoft Cloud's Big Data Compute‑Storage Separation Practices and KS3‑HDFS Solution

This article presents Kingsoft Cloud's comprehensive practice on big data compute‑storage separation, detailing the challenges of modern data platforms, comparing HDFS with object storage, describing three separation modes, and explaining the architecture, core modules, performance optimizations, and advantages of the KS3‑HDFS solution.

Compute-Storage SeparationKS3-HDFScloud computing
0 likes · 21 min read
Kingsoft Cloud's Big Data Compute‑Storage Separation Practices and KS3‑HDFS Solution
ITPUB
ITPUB
Sep 11, 2023 · Cloud Native

How REDck Transforms ClickHouse into a Scalable Cloud‑Native Real‑Time Data Warehouse

Xiaohongshu built REDck, a cloud‑native, storage‑compute separated real‑time OLAP warehouse on ClickHouse, addressing scaling, cost, and reliability challenges through a unified metadata service, object‑storage optimizations, multi‑level caching, distributed task scheduling, bucketing, and exactly‑once transaction support.

Distributed TransactionsReal-time OLAPcaching
0 likes · 21 min read
How REDck Transforms ClickHouse into a Scalable Cloud‑Native Real‑Time Data Warehouse
Tencent Cloud Developer
Tencent Cloud Developer
Aug 31, 2023 · Cloud Computing

Tape Storage Technology: Enterprise Deep Archive and the Berg Cold‑Data Engine

Magnetic tape, once the music‑distribution workhorse, remains essential for enterprise deep‑archive thanks to its low cost, high capacity, and durability, with LTO and IBM 3592 cartridges housed in large libraries, while cloud object‑storage deep‑archive tiers and Tencent’s Berg cold‑data engine provide API‑driven ingestion, retrieval, erasure‑coding, and fault‑tolerant management for truly cold workloads that tolerate hours‑long latency.

Berg enginecloud storagecold data
0 likes · 27 min read
Tape Storage Technology: Enterprise Deep Archive and the Berg Cold‑Data Engine
Baidu Geek Talk
Baidu Geek Talk
Aug 7, 2023 · Artificial Intelligence

Storage Acceleration Solutions for Large AI Model Workflows

To tackle the massive data, high‑throughput and low‑latency demands of large‑model training and inference, the talk proposes a unified data‑lake built on scalable object storage combined with an acceleration layer—either a parallel file system or cloud‑native RapidFS cache—demonstrating multi‑fold training speedups, faster checkpoint uploads, and linear inference scaling.

AI Model StorageAccelerated FilesystemData Lake
0 likes · 18 min read
Storage Acceleration Solutions for Large AI Model Workflows
Baidu Intelligent Cloud Tech Hub
Baidu Intelligent Cloud Tech Hub
Jul 10, 2023 · Artificial Intelligence

How Object Storage Accelerates Large AI Model Training and Inference

This article examines the storage challenges posed by large AI models, analyzes the full workflow from data ingestion to inference, compares HDFS and object‑storage data lakes, and presents Baidu's cloud‑native storage‑acceleration solutions—including RapidFS and PFS—that dramatically improve training speed, checkpoint handling, and model deployment throughput.

AICloud Nativelarge models
0 likes · 19 min read
How Object Storage Accelerates Large AI Model Training and Inference
Alibaba Cloud Developer
Alibaba Cloud Developer
Jul 10, 2023 · Cloud Computing

Choosing the Right Cloud Storage: NAS, Block, and Object Explained

This article explains common storage types—file (NAS), block (EBS), and object (OSS)—detailing their physical foundations, performance metrics, underlying Alibaba Cloud architectures, protocol differences, and ideal application scenarios to help readers select the most suitable storage solution for any workload.

Alibaba CloudNASProtocols
0 likes · 15 min read
Choosing the Right Cloud Storage: NAS, Block, and Object Explained
DataFunTalk
DataFunTalk
Jun 20, 2023 · Databases

Hot and Cold Data Tiering in Apache Doris 2.0: Architecture, Configuration, and Performance Evaluation

This article explains the hot‑cold data tiering technique in Apache Doris 2.0, covering its motivation, storage‑layer design, configuration steps (resource, storage policy, table/partition settings), cost‑saving calculations, query performance impact, cold‑data compaction, and cache mechanisms, with practical code examples.

Apache DorisCold Data TieringStorage Policy
0 likes · 18 min read
Hot and Cold Data Tiering in Apache Doris 2.0: Architecture, Configuration, and Performance Evaluation
Selected Java Interview Questions
Selected Java Interview Questions
Jun 12, 2023 · Backend Development

Integrating MinIO Object Storage with Spring Boot: Configuration, Code Samples, and API Endpoints

This guide introduces MinIO as an S3‑compatible object storage service and walks through its installation, Maven dependencies, Spring Boot configuration, Java client setup, REST controller implementation for file upload, preview, download, and deletion, and includes debugging screenshots.

MinioSpring Bootbackend-development
0 likes · 5 min read
Integrating MinIO Object Storage with Spring Boot: Configuration, Code Samples, and API Endpoints
ITPUB
ITPUB
Jun 10, 2023 · Databases

How Apache Doris 2.0 Cuts Storage Costs with Hot‑Cold Data Tiering

The article explains how Apache Doris 2.0 introduces hot‑cold data tiering to move infrequently accessed data from expensive SSDs to cheaper object storage, dramatically reducing storage costs while maintaining query performance through automatic lifecycle management, storage policies, and cache mechanisms.

Apache DorisCost reductionhot‑cold tiering
0 likes · 19 min read
How Apache Doris 2.0 Cuts Storage Costs with Hot‑Cold Data Tiering
Java Architect Essentials
Java Architect Essentials
Jun 8, 2023 · Backend Development

How to Build a MinIO Object Storage Service with Docker, Spring Boot, and Vue

This article demonstrates step‑by‑step how to set up a high‑performance MinIO object storage service using Docker, configure it in a Spring Boot application, and integrate file upload functionality with a Vue/Element‑UI front‑end, including code snippets for Docker commands, Java client setup, and UI implementation.

DockerMinioSpring Boot
0 likes · 12 min read
How to Build a MinIO Object Storage Service with Docker, Spring Boot, and Vue
Java Architect Essentials
Java Architect Essentials
May 28, 2023 · Backend Development

Building an Enterprise OSS Object Storage Spring Boot Starter Based on Amazon S3

This article explains how to create a reusable Spring Boot starter for enterprise‑level object storage services by leveraging the Amazon S3 protocol, covering OSS fundamentals, dependency setup, configuration properties, template interfaces, implementation, auto‑configuration, packaging, and testing with code examples.

Amazon S3BackendOSS
0 likes · 15 min read
Building an Enterprise OSS Object Storage Spring Boot Starter Based on Amazon S3
MaGe Linux Operations
MaGe Linux Operations
Mar 16, 2023 · Cloud Native

Understanding COSI: Kubernetes’ Standard for Object Storage Management

COSI (Container Object Storage Interface) is an alpha feature in Kubernetes v1.25 that standardizes object storage provisioning and usage, offering Kubernetes-native bucket management, self‑service capabilities for DevOps, and cross‑cluster and cross‑provider portability through a unified API and driver architecture.

COSICloud NativeDevOps
0 likes · 8 min read
Understanding COSI: Kubernetes’ Standard for Object Storage Management
IT Services Circle
IT Services Circle
Jan 4, 2023 · Cloud Computing

Understanding CDN: How Content Delivery Networks Work and When to Use Them

This article explains the fundamentals of Content Delivery Networks (CDN), how they cache object‑storage files, the DNS resolution process with CNAME records, origin‑pull behavior on cache misses, performance trade‑offs, and guidelines for when CDN integration is beneficial or unnecessary.

CDNCacheContent Delivery Network
0 likes · 14 min read
Understanding CDN: How Content Delivery Networks Work and When to Use Them
ITPUB
ITPUB
Dec 25, 2022 · Cloud Native

How to Build a Scalable Distributed File System with MinIO

This guide explains the fundamentals of distributed file systems, compares them with traditional storage, introduces MinIO’s architecture and features, and provides step‑by‑step instructions for deploying a multi‑node MinIO cluster with Nginx load balancing on Linux.

DeploymentLinuxMinio
0 likes · 16 min read
How to Build a Scalable Distributed File System with MinIO
Architects Research Society
Architects Research Society
Dec 5, 2022 · Fundamentals

Differences Between File, Block, and Object Storage and Why Object Storage Suits the Data Explosion

As global data volumes surge toward 163 zettabytes by 2025, traditional file and block storage struggle to scale, making object storage—offering unique IDs, metadata binding, and effortless scalability—the preferred solution for handling massive, mostly unstructured data in modern cloud environments.

Data GrowthStorage Fundamentalsblock storage
0 likes · 9 min read
Differences Between File, Block, and Object Storage and Why Object Storage Suits the Data Explosion
UCloud Tech
UCloud Tech
Nov 21, 2022 · Cloud Computing

How UCloud Revamped US3 Metadata Service for 80% Cost Savings and Faster Performance

UCloud’s US3 object storage metadata service, originally built on a chained MongoDB architecture, faced scalability, performance, and cost challenges, prompting a redesign that introduces a high‑compatibility DB‑Gateway, a distributed KV store (UKV) with custom RocksDB, delivering faster reads, zero list‑service latency, 80% cost reduction, and simpler operations.

Distributed KVcloud architecturemetadata service
0 likes · 8 min read
How UCloud Revamped US3 Metadata Service for 80% Cost Savings and Faster Performance
Selected Java Interview Questions
Selected Java Interview Questions
Nov 16, 2022 · Backend Development

MinIO Overview, Installation, and Spring Boot Integration Guide

This article introduces MinIO as a high‑performance, cloud‑native object storage solution, explains its key features and use cases, provides step‑by‑step Docker installation commands, and demonstrates how to integrate MinIO with Spring Boot through Maven dependencies, configuration, utility classes, service, and controller code.

DockerMinioSDK
0 likes · 19 min read
MinIO Overview, Installation, and Spring Boot Integration Guide
Python Crawling & Data Mining
Python Crawling & Data Mining
Oct 30, 2022 · Big Data

Why Ozone Is the Next‑Generation Distributed Object Store for Big Data

This article explains how Ozone, the Hadoop community’s new distributed object‑storage system, overcomes HDFS’s small‑file limitations with a hierarchical Volume‑Bucket‑Object model, detailing its architecture, components, data flow for creating and reading objects, and the benefits of its scalable, fault‑tolerant design.

Big DataHadoopOzone
0 likes · 12 min read
Why Ozone Is the Next‑Generation Distributed Object Store for Big Data
Architects' Tech Alliance
Architects' Tech Alliance
Oct 5, 2022 · Cloud Native

Ceph Distributed Storage System: Architecture, CRUSH Algorithm, and Storage Backend Evolution

This article introduces Ceph's distributed storage architecture, explains the CRUSH data placement algorithm, compares FileStore and BlueStore backends, and discusses performance optimizations and emerging storage technologies for cloud‑native environments, including considerations of scalability, fault tolerance, and hardware integration.

BlueStoreCRUSHCeph
0 likes · 12 min read
Ceph Distributed Storage System: Architecture, CRUSH Algorithm, and Storage Backend Evolution
Tongcheng Travel Technology Center
Tongcheng Travel Technology Center
Sep 2, 2022 · Cloud Computing

Design and Implementation of a Scalable, High‑Availability Object Storage Service (OSS) Based on SeaweedFS

This article describes the design goals, technology selection, architecture, high‑availability mechanisms, performance testing, cost optimization, and seamless migration strategy of a new object storage service built on SeaweedFS to support billions of files with low latency and high reliability.

Cloud NativeS3 CompatibilityScalability
0 likes · 16 min read
Design and Implementation of a Scalable, High‑Availability Object Storage Service (OSS) Based on SeaweedFS
macrozheng
macrozheng
Aug 31, 2022 · Backend Development

How to Install MinIO and Integrate It with Spring Boot for File Uploads

This guide introduces MinIO, an open‑source, S3‑compatible object storage written in Go, outlines its key features and deployment via Docker, and demonstrates step‑by‑step integration with Spring Boot to upload files through the MinIO SDK, including configuration, controller code, and testing.

DockerMinioS3 Compatibility
0 likes · 8 min read
How to Install MinIO and Integrate It with Spring Boot for File Uploads
MaGe Linux Operations
MaGe Linux Operations
Aug 28, 2022 · Cloud Native

Master MinIO: From Client Commands to Scalable Distributed Clusters

This guide walks through MinIO client (mc) usage, bucket management, user and policy administration, and two practical methods for expanding a MinIO distributed cluster—peer‑to‑peer scaling and federation with etcd—providing step‑by‑step commands, scripts, and configuration details for cloud‑native object storage.

Distributed SystemsMiniocluster scaling
0 likes · 31 min read
Master MinIO: From Client Commands to Scalable Distributed Clusters
MaGe Linux Operations
MaGe Linux Operations
Aug 27, 2022 · Cloud Computing

Step‑by‑Step Guide to Deploying MinIO Distributed Object Storage

This article introduces MinIO, a high‑performance, GNU‑AGPL‑licensed object storage compatible with Amazon S3, explains its core concepts such as buckets, drives, sets and erasure coding, and provides a detailed step‑by‑step guide for deploying a distributed MinIO cluster on Linux, including configuration, systemd service setup, Nginx load balancing, and client (mc) usage.

Distributed DeploymentErasure CodeLinux
0 likes · 20 min read
Step‑by‑Step Guide to Deploying MinIO Distributed Object Storage
Infra Learning Club
Infra Learning Club
Jul 29, 2022 · Fundamentals

Understanding File, Block, and Object Storage: Key Differences and Use Cases

The article explains the core concepts, advantages, and limitations of file storage, block storage, and object storage, illustrating how each format organizes data, interacts with operating systems, and fits various application scenarios such as databases, cloud services, and unstructured data handling.

block storagecloud storagedata storage fundamentals
0 likes · 6 min read
Understanding File, Block, and Object Storage: Key Differences and Use Cases
Bilibili Tech
Bilibili Tech
May 20, 2022 · Backend Development

Design and Implementation of Bilibili Object Storage Service (BOSS): Architecture, Topology, Metadata, Erasure Coding, and Scaling

The article chronicles Bilibili’s 13‑day development of BOSS, a custom object storage service, detailing how it replaces MySQL‑based routing and ID generation with replicated etcd or Raft KV stores, models metadata via protobuf, adopts erasure coding and a Bitcask‑style engine, and implements safe delete, replica repair, and horizontal scaling for a resilient large‑scale system.

Distributed Systemserasure codingmetadata design
0 likes · 28 min read
Design and Implementation of Bilibili Object Storage Service (BOSS): Architecture, Topology, Metadata, Erasure Coding, and Scaling
DataFunTalk
DataFunTalk
May 17, 2022 · Big Data

Exploring JuiceFS in Data Lake Storage Architecture

This presentation provides a comprehensive overview of JuiceFS, an open‑source cloud‑native distributed file system, detailing its role in modern data lake and lakehouse architectures, comparing it with HDFS and object storage, and highlighting its performance, integration, and community ecosystem.

Big DataData LakeDistributed File System
0 likes · 19 min read
Exploring JuiceFS in Data Lake Storage Architecture
Bilibili Tech
Bilibili Tech
May 17, 2022 · Cloud Computing

Bilibili Object Storage Service (BOSS) Design: Building a Large-Scale Distributed Storage System in 13 Days

In just 13 days Bilibili transformed a simple MySQL‑based S3 prototype into the BOSS distributed object storage system by separating metadata and data, adding an RPC abstraction layer, implementing two‑level sharding, switching to RocksDB, and deploying a three‑replica, multi‑zone high‑availability architecture.

ReplicationRocksDBS3 protocol
0 likes · 15 min read
Bilibili Object Storage Service (BOSS) Design: Building a Large-Scale Distributed Storage System in 13 Days
IT Architects Alliance
IT Architects Alliance
Mar 28, 2022 · Fundamentals

Evolution and Fundamentals of Storage Systems: From Single-Node to Cloud‑Native

This article outlines the historical development of storage systems—from single-node and centralized architectures to distributed, cloud, and cloud‑native solutions—detailing storage types (block, file, object), data models, system components, and key design principles for modern storage infrastructures.

Data ModelsDistributed Systemsblock storage
0 likes · 7 min read
Evolution and Fundamentals of Storage Systems: From Single-Node to Cloud‑Native
Top Architect
Top Architect
Feb 28, 2022 · Backend Development

Integrating MinIO Object Storage with Spring Boot and Vue: Docker Setup, API, and Frontend Upload

This tutorial explains how to deploy MinIO with Docker on Linux/macOS and Windows, configure a Spring Boot backend with MinIO client libraries, create reusable Java components for signed policies and file uploads, and build a Vue/Element‑UI frontend that demonstrates three upload methods, all with complete code examples.

DockerMinioSpring Boot
0 likes · 12 min read
Integrating MinIO Object Storage with Spring Boot and Vue: Docker Setup, API, and Frontend Upload
ByteFE
ByteFE
Jan 10, 2022 · Frontend Development

Frontend Resource Download via CDN and Object Storage

This article explains how front-end developers can directly download resources from CDN or object storage using HTML5's download attribute and JavaScript workarounds, addressing CORS limitations and providing code examples for implementation.

Blob APICDNCORS
0 likes · 7 min read
Frontend Resource Download via CDN and Object Storage
Kuaishou Big Data
Kuaishou Big Data
Oct 28, 2021 · Big Data

How Kuaishou Cut Object Storage Costs by 50% with LRC Erasure Coding

Kuaishou reduced half of its massive object storage expenses by redesigning its architecture to use HBase indexing, HDFS large‑file storage, MemoryCache, and a cross‑IDC LRC erasure‑coding warm layer that maintains disaster‑recovery while dynamically moving data from hot to warm to cold tiers.

Big DataKuaishouLRC
0 likes · 12 min read
How Kuaishou Cut Object Storage Costs by 50% with LRC Erasure Coding