Tag

object storage

0 views collected around this technical thread.

360 Zhihui Cloud Developer
360 Zhihui Cloud Developer
Jun 6, 2025 · Fundamentals

How Erasure Coding Cuts Storage Costs in Ozone: A Deep Dive

This article explains how Erasure Coding (EC) improves data reliability and dramatically reduces storage overhead in Ozone by leveraging hot‑cold data characteristics, intelligent tiering, dynamic EC ratios, and repair throttling, while also discussing performance trade‑offs and limitations.

Data ReliabilityErasure CodingOzone
0 likes · 9 min read
How Erasure Coding Cuts Storage Costs in Ozone: A Deep Dive
Raymond Ops
Raymond Ops
May 27, 2025 · Fundamentals

Understanding Block, File, and Object Storage: Pros, Cons, and Use Cases

This article explains the concepts, advantages, and disadvantages of block storage, file storage, and object storage, compares their architectures, and clarifies when each type is appropriate for different applications and workloads.

block storagefile storageinfrastructure
0 likes · 10 min read
Understanding Block, File, and Object Storage: Pros, Cons, and Use Cases
Alibaba Cloud Infrastructure
Alibaba Cloud Infrastructure
Apr 28, 2025 · Cloud Native

Improving OSS Small‑File Access Performance with StrmVol Storage Volumes in Kubernetes

StrmVol storage volumes replace the FUSE‑based OSS mount with a virtual block device and kernel‑mode file system, dramatically reducing latency for massive small‑file reads in Kubernetes workloads such as AI training datasets, and the article demonstrates setup, configuration, and performance testing using Argo Workflows.

Argo WorkflowsCSIKubernetes
0 likes · 13 min read
Improving OSS Small‑File Access Performance with StrmVol Storage Volumes in Kubernetes
Linux Ops Smart Journey
Linux Ops Smart Journey
Dec 18, 2024 · Cloud Native

How to Deploy MinIO Object Storage on Kubernetes for Production

This guide explains why MinIO is a high‑performance, S3‑compatible object storage solution and walks you through the prerequisites, Helm‑based installation steps on a Kubernetes cluster, verification procedures, and best‑practice tips for deploying a secure, scalable production‑grade MinIO service.

HelmKubernetesMinIO
0 likes · 8 min read
How to Deploy MinIO Object Storage on Kubernetes for Production
Code Ape Tech Column
Code Ape Tech Column
Dec 2, 2024 · Backend Development

Creating an Enterprise‑Grade OSS Object Storage Spring Boot Starter Based on Amazon S3

This article provides a step‑by‑step guide to building a Spring Boot starter that abstracts object storage services (OSS) via the Amazon S3 protocol, covering dependency selection, configuration properties, template interfaces, implementation, auto‑configuration, packaging, and testing for cloud‑native backend applications.

Amazon S3BackendJava
0 likes · 15 min read
Creating an Enterprise‑Grade OSS Object Storage Spring Boot Starter Based on Amazon S3
360 Zhihui Cloud Developer
360 Zhihui Cloud Developer
Nov 29, 2024 · Big Data

How Ozone Scales Metadata for Massive Big Data Storage

This article explains Ozone's object storage architecture, its evolution of metadata management using distributed KV stores like Apache Cassandra, and the performance optimizations—read/write separation, unlimited scaling, and partitioning—that enable high‑throughput, low‑latency handling of massive datasets.

Apache CassandraBig DataDistributed KV
0 likes · 9 min read
How Ozone Scales Metadata for Massive Big Data Storage
Baidu Tech Salon
Baidu Tech Salon
Nov 5, 2024 · Big Data

Accelerating Data Lake Storage for Big Data and AI: Baidu's Solutions

Baidu’s Data Lake Storage Acceleration 2.0 replaces traditional HDFS with a scalable object‑storage foundation, introducing an adaptive hierarchical namespace, high‑throughput streaming engine, RapidFS caching, and fully compatible BOS‑HDFS APIs, thereby delivering up to 70 % higher throughput, lower costs, and seamless migration for big‑data and AI workloads.

AIBOS-HDFSBig Data
0 likes · 11 min read
Accelerating Data Lake Storage for Big Data and AI: Baidu's Solutions
Top Architect
Top Architect
Sep 8, 2024 · Backend Development

Building an OSS Spring Boot Starter Using Amazon S3

This article provides a step‑by‑step guide to creating a Spring Boot starter for enterprise‑grade object storage services, explaining OSS concepts, Amazon S3 basics, project setup, Maven dependencies, configuration classes, template interfaces, implementation details, auto‑configuration, packaging, and testing.

Amazon S3BackendJava
0 likes · 21 min read
Building an OSS Spring Boot Starter Using Amazon S3
Architect's Guide
Architect's Guide
Aug 28, 2024 · Backend Development

Creating an Enterprise OSS Object Storage Spring Boot Starter Based on Amazon S3

This article provides a step‑by‑step guide to building a Spring Boot starter that abstracts OSS object‑storage services via the Amazon S3 protocol, covering project setup, Maven dependencies, configuration properties, template interfaces, implementation, auto‑configuration, packaging, and testing.

Amazon S3JavaOSS
0 likes · 17 min read
Creating an Enterprise OSS Object Storage Spring Boot Starter Based on Amazon S3
360 Zhihui Cloud Developer
360 Zhihui Cloud Developer
Aug 20, 2024 · Cloud Computing

How to Automate Windows File Backup to Cloud with rclone and FreeFileSync

This guide shows how to set up automatic Windows file backup to ZhiHui Cloud OBS using rclone for mounting and FreeFileSync for synchronization, covering bucket creation, AK/SK setup, tool installation, mounting commands, and real‑time sync configuration.

FreeFileSyncautomationcloud backup
0 likes · 5 min read
How to Automate Windows File Backup to Cloud with rclone and FreeFileSync
Linux Ops Smart Journey
Linux Ops Smart Journey
Aug 18, 2024 · Cloud Native

Step‑by‑Step Guide to Integrate Ceph RGW Object Storage with Kubernetes

This tutorial walks you through creating Ceph RGW users, configuring Kubernetes secrets, deploying the CSI‑S3 driver, setting up a storage class and persistent volume claim, and verifying the integration, while highlighting experimental status and important tips for production use.

CSICephKubernetes
0 likes · 10 min read
Step‑by‑Step Guide to Integrate Ceph RGW Object Storage with Kubernetes
360 Smart Cloud
360 Smart Cloud
Jul 26, 2024 · Cloud Computing

Object Storage: Origins, Evolution, Core Operations, Advantages, Use Cases, and Future Trends

This article provides a comprehensive overview of object storage, covering its origins, historical development, fundamental operations, key advantages over block and file storage, major application scenarios, and predicted future trends in cloud and big‑data environments.

Big Datacloud storagedata management
0 likes · 15 min read
Object Storage: Origins, Evolution, Core Operations, Advantages, Use Cases, and Future Trends
Java Architect Essentials
Java Architect Essentials
Jul 23, 2024 · Cloud Native

Guide to Installing and Using MinIO with Spring Boot and Docker

This article provides a comprehensive guide to installing MinIO on CentOS 7, configuring it with Docker, integrating it into a Spring Boot application, and implementing file upload, download, and multipart upload features using MinIO's Java SDK, along with troubleshooting tips and code examples.

DockerJavaMinIO
0 likes · 23 min read
Guide to Installing and Using MinIO with Spring Boot and Docker
Code Ape Tech Column
Code Ape Tech Column
Jul 8, 2024 · Backend Development

Guide to Installing and Using MinIO with Spring Boot for Object Storage

This article provides a comprehensive tutorial on MinIO, covering its features, application scenarios, Docker installation on CentOS 7, firewall configuration, Spring Boot integration, chunked upload implementation, and testing, complete with code examples and troubleshooting tips.

Chunked UploadDockerMinIO
0 likes · 21 min read
Guide to Installing and Using MinIO with Spring Boot for Object Storage
Top Architect
Top Architect
Jun 27, 2024 · Cloud Computing

Comprehensive Guide to Installing and Using MinIO with Spring Boot and Docker

This article provides a detailed tutorial on installing MinIO on CentOS 7 using Docker, configuring it, integrating with Spring Boot for multipart upload, generating presigned URLs, and includes complete Java code examples for utilities and controllers, covering use cases, deployment steps, and troubleshooting tips.

DockerFile UploadJava
0 likes · 24 min read
Comprehensive Guide to Installing and Using MinIO with Spring Boot and Docker
IT Services Circle
IT Services Circle
Jan 27, 2024 · Cloud Computing

Using Alibaba Cloud OSS for File Uploads: Setup, Code Samples, and Best Practices

This article explains why direct file storage on application servers is not scalable, introduces Alibaba Cloud OSS as an object storage solution, walks through bucket creation, access key management, Node.js upload code, temporary credentials for browser uploads, CDN integration, and security considerations, providing a complete end‑to‑end upload workflow.

Alibaba CloudFile UploadNode.js
0 likes · 10 min read
Using Alibaba Cloud OSS for File Uploads: Setup, Code Samples, and Best Practices
DataFunTalk
DataFunTalk
Jan 27, 2024 · Big Data

JuiceFS: A Cloud‑Native Distributed File System for Data Lake and Lakehouse

This article presents JuiceFS, a cloud‑native distributed file system that bridges the gaps between HDFS and object storage, explaining Data Lake and Lakehouse concepts, comparing storage options, detailing JuiceFS's architecture and performance benefits, and showcasing real‑world user case studies.

Big DataJuiceFSLakehouse
0 likes · 23 min read
JuiceFS: A Cloud‑Native Distributed File System for Data Lake and Lakehouse
360 Smart Cloud
360 Smart Cloud
Jan 15, 2024 · Big Data

Design and Optimization of the Ozone Distributed Object Storage System

This article presents a comprehensive overview of Ozone, a Hadoop‑based distributed object storage system, detailing its architecture, metadata management, scalability enhancements, small‑file handling, erasure coding, lifecycle policies, and future improvements aimed at boosting performance and reliability for large‑scale unstructured data workloads.

Big DataHadoopOptimization
0 likes · 15 min read
Design and Optimization of the Ozone Distributed Object Storage System
DataFunTalk
DataFunTalk
Jan 14, 2024 · Big Data

Optimizing Object Storage and Impala Engine in NetEase NDH: Performance Enhancements and Feature Additions

This presentation outlines NetEase's NDH big‑data platform, detailing its background, object‑storage upload and rename optimizations, Impala engine adaptations—including file‑handle caching, transparent URI handling, and getFileBlockLocations improvements—and a suite of operational enhancements such as dynamic proxy user configuration and audit‑log extensions.

AlluxioBig DataImpala
0 likes · 14 min read
Optimizing Object Storage and Impala Engine in NetEase NDH: Performance Enhancements and Feature Additions
Code Ape Tech Column
Code Ape Tech Column
Jan 4, 2024 · Backend Development

Creating an Enterprise-Grade OSS Object Storage Spring Boot Starter

This article provides a step‑by‑step guide to building a Spring Boot starter that abstracts Amazon S3‑compatible object storage services such as Alibaba Cloud OSS, Tencent COS, Qiniu OSS, and MinIO, covering dependency setup, configuration properties, template interfaces, implementation, auto‑configuration, packaging, and testing.

Amazon S3BackendJava
0 likes · 15 min read
Creating an Enterprise-Grade OSS Object Storage Spring Boot Starter