BestHub
Sign in
Tag

cloud storage

0 views collected around this technical thread.

Architects' Tech Alliance
Architects' Tech Alliance
Jun 3, 2025 · Artificial Intelligence

Comprehensive Analysis of RDMA Technology: Principles, Features, Products, and Applications in HPC, AI, and Cloud Storage

The article provides an in‑depth technical overview of Remote Direct Memory Access (RDMA), covering its zero‑copy, kernel‑bypass, and protocol‑offload features, hardware and software ecosystems, and its impact on high‑performance computing, artificial intelligence, cloud storage, finance, and edge computing.

Artificial IntelligenceHigh Performance ComputingRDMA
0 likes · 10 min read
Comprehensive Analysis of RDMA Technology: Principles, Features, Products, and Applications in HPC, AI, and Cloud Storage
360 Zhihui Cloud Developer
360 Zhihui Cloud Developer
Feb 26, 2025 · Cloud Computing

Master Cross-Cloud Object Storage Sync with Juicesync: Step-by-Step Guide

This article provides a comprehensive, step-by-step tutorial on using the open‑source Juicesync tool to migrate and synchronize object storage data across multiple cloud platforms, covering background, installation, configuration, full and incremental sync, and best‑practice notes.

Juicesynccloud storagecross-cloud
0 likes · 10 min read
Master Cross-Cloud Object Storage Sync with Juicesync: Step-by-Step Guide
Baidu Tech Salon
Baidu Tech Salon
Nov 8, 2024 · Cloud Computing

Design and Evolution of Baidu Canghai Storage Unified Technology Stack

Baidu Canghai Storage’s unified technology stack—comprising a meta‑aware distributed metadata layer, a hybrid single‑node‑distributed namespace, and an online erasure‑coding data layer—delivers AI‑driven, high‑performance, low‑cost, ZB‑scale cloud storage by modularizing metadata, namespace, and data services for object, file, and block workloads.

BaiduDistributed SystemsErasure Coding
0 likes · 16 min read
Design and Evolution of Baidu Canghai Storage Unified Technology Stack
Baidu Geek Talk
Baidu Geek Talk
Nov 6, 2024 · Cloud Computing

Baidu Canghai Storage Unified Technology Base: Architecture and Evolution of Metadata, Namespace, and Data Layers

Baidu’s Canghai Storage unifies metadata, hierarchical namespace, and data layers into a Meta‑Aware, three‑generation architecture that scales to trillions of metadata items and zettabyte‑scale data, using a distributed transactional KV store, single‑machine‑distributed namespace, and online erasure‑coding micro‑services to deliver high performance, low cost, and seamless scalability.

Big DataDistributed SystemsErasure Coding
0 likes · 18 min read
Baidu Canghai Storage Unified Technology Base: Architecture and Evolution of Metadata, Namespace, and Data Layers
Test Development Learning Exchange
Test Development Learning Exchange
Sep 1, 2024 · Fundamentals

Python Utility Scripts for Data Cleaning, Translation, File Sync, Cloud Backup, and More

This article presents a collection of Python utility scripts that demonstrate how to clean CSV data, translate text files, synchronize folders, upload files to S3, count directory contents, classify files by type, perform OCR on images, convert video to audio, extract images from webpages, and generate text summaries using modern libraries.

AIcloud storagedata cleaning
0 likes · 6 min read
Python Utility Scripts for Data Cleaning, Translation, File Sync, Cloud Backup, and More
360 Smart Cloud
360 Smart Cloud
Jul 26, 2024 · Cloud Computing

Object Storage: Origins, Evolution, Core Operations, Advantages, Use Cases, and Future Trends

This article provides a comprehensive overview of object storage, covering its origins, historical development, fundamental operations, key advantages over block and file storage, major application scenarios, and predicted future trends in cloud and big‑data environments.

Big Datacloud storagedata management
0 likes · 15 min read
Object Storage: Origins, Evolution, Core Operations, Advantages, Use Cases, and Future Trends
Rare Earth Juejin Tech Community
Rare Earth Juejin Tech Community
May 23, 2024 · Artificial Intelligence

Building a Multi‑Agent Bookmark Assistant Bot with Coze: From File Upload to AI‑Powered Search

This tutorial walks through creating a Coze bot that uses multi‑agent orchestration, memory variables, triggers, and large‑language‑model integration to upload bookmark files, extract and clean data, classify sites, generate importable HTML bookmarks, and provide AI‑driven search functionality, complete with Python code examples and deployment tips.

AI agentsBookmark ManagementCoze
0 likes · 24 min read
Building a Multi‑Agent Bookmark Assistant Bot with Coze: From File Upload to AI‑Powered Search
Test Development Learning Exchange
Test Development Learning Exchange
Apr 12, 2024 · Operations

Python Data Backup Scripts and Tools Overview

This article introduces various Python-based data backup techniques, covering standard library modules such as shutil, zipfile, and tarfile, as well as database dump tools like pg_dump and mysqldump, and cloud storage options using awscli or boto3, with example code snippets for each method.

DatabaseOperationscloud storage
0 likes · 4 min read
Python Data Backup Scripts and Tools Overview
Mike Chen's Internet Architecture
Mike Chen's Internet Architecture
Mar 6, 2024 · Cloud Computing

Understanding IaaS: Definition, Features, Core Technologies, and Application Scenarios

This article provides a comprehensive overview of IaaS, detailing its definition, core characteristics, underlying technologies such as virtualization and automation, and common use cases, while highlighting benefits like cost reduction, elasticity, high availability, and security in cloud environments.

AutomationCloud ComputingIaaS
0 likes · 8 min read
Understanding IaaS: Definition, Features, Core Technologies, and Application Scenarios
Baidu Geek Talk
Baidu Geek Talk
Jan 29, 2024 · Databases

BTS (Baidu Table Storage): Architecture and Core Technologies

BTS (Baidu Table Storage) is Baidu Intelligent Cloud’s high‑performance, low‑cost semi‑structured NoSQL service that evolved from single‑table to multi‑model (wide tables, time‑series, soon documents), featuring a three‑layer compute‑storage separation architecture, multi‑level caching, hot‑backup HA, and supporting massive IoT, AI, autonomous‑driving and monitoring workloads.

BTSBaidu Table StorageBig Data
0 likes · 21 min read
BTS (Baidu Table Storage): Architecture and Core Technologies
Architects' Tech Alliance
Architects' Tech Alliance
Sep 17, 2023 · Cloud Computing

Trends and Market Outlook of Cloud Storage, Software‑Defined Storage, and Hyper‑Convergence

The article analyzes the rapid growth of the global cloud storage market, explains core technologies such as software‑defined storage, distributed storage and hyper‑convergence, reviews major vendors and market forecasts, and discusses the evolving ecosystem of operating systems and open‑source initiatives driving future infrastructure development.

Distributed Storagecloud storagehyper-convergence
0 likes · 12 min read
Trends and Market Outlook of Cloud Storage, Software‑Defined Storage, and Hyper‑Convergence
DataFunTalk
DataFunTalk
Sep 15, 2023 · Cloud Computing

Design and Architecture of Baidu CFS Large‑Scale Distributed File System and Metadata Service

The talk from DataFun Summit 2023 explains how Baidu's CFS storage builds a trillion‑file‑scale distributed file system by revisiting file system fundamentals, POSIX limitations, historical storage architectures, and introducing a lock‑free metadata service with single‑shard primitives, data‑layout optimizations, and a simplified client‑centric architecture that achieves high scalability and performance.

Big DataCFSPOSIX
0 likes · 31 min read
Design and Architecture of Baidu CFS Large‑Scale Distributed File System and Metadata Service
Tencent Cloud Developer
Tencent Cloud Developer
Aug 31, 2023 · Cloud Computing

Tape Storage Technology: Enterprise Deep Archive and the Berg Cold‑Data Engine

Magnetic tape, once the music‑distribution workhorse, remains essential for enterprise deep‑archive thanks to its low cost, high capacity, and durability, with LTO and IBM 3592 cartridges housed in large libraries, while cloud object‑storage deep‑archive tiers and Tencent’s Berg cold‑data engine provide API‑driven ingestion, retrieval, erasure‑coding, and fault‑tolerant management for truly cold workloads that tolerate hours‑long latency.

Berg engineCold DataTape Storage
0 likes · 27 min read
Tape Storage Technology: Enterprise Deep Archive and the Berg Cold‑Data Engine
Architects' Tech Alliance
Architects' Tech Alliance
Aug 17, 2023 · Fundamentals

GPFS vs. Ceph: Architecture, Components, and Usage Scenarios of Distributed Storage Systems

This article provides a comprehensive overview of GPFS (IBM Spectrum Scale) and Ceph, detailing their architectures, core components, deployment models, use cases, performance considerations, and a comparative analysis with GlusterFS, while also discussing future trends in distributed storage.

CephData ArchitectureDistributed Storage
0 likes · 20 min read
GPFS vs. Ceph: Architecture, Components, and Usage Scenarios of Distributed Storage Systems
Architects' Tech Alliance
Architects' Tech Alliance
Jul 4, 2023 · Cloud Computing

Challenges and Emerging Trends in Cloud and Internet Storage Architecture

The article analyzes the mismatched data‑preservation cycles, performance‑reliability trade‑offs, server‑centred data‑center tax, and the need for new storage‑compute disaggregation, then outlines hardware trends such as Ethernet‑based flash, CXL, DPUs, and proposes a novel storage‑compute separation architecture to improve resource utilization, reliability, and efficiency for cloud and internet workloads.

CXLDPUHardware Trends
0 likes · 12 min read
Challenges and Emerging Trends in Cloud and Internet Storage Architecture
DaTaobao Tech
DaTaobao Tech
Jun 21, 2023 · Databases

Data Space Architecture and Metadata Models

The article outlines a data‑space architecture that employs a wide‑table design with dynamic columns and dedicated metadata tables, a metadata execution engine for business‑logic mapping, upgraded SQL parsing via Druid, MySQL‑proxy protocol handling, and distributed flow control using Redis and Zookeeper to enable scalable, multi‑tenant, low‑code and cloud‑native data management.

Data SpaceDatabase DesignOpen Platform
0 likes · 16 min read
Data Space Architecture and Metadata Models
Architects' Tech Alliance
Architects' Tech Alliance
Jun 18, 2023 · Cloud Computing

Comparison of Three‑Replica and Dual‑RAID Distributed Storage Architectures

The article compares three‑replica and dual‑RAID distributed storage designs, detailing their architectures, bandwidth and latency impacts, failure isolation, “slow‑disk” issues, and overall performance, stability, and reliability advantages of dual‑RAID for modern cloud and hyper‑converged environments.

Distributed StoragePerformanceRAID
0 likes · 7 min read
Comparison of Three‑Replica and Dual‑RAID Distributed Storage Architectures
Bilibili Tech
Bilibili Tech
Jun 16, 2023 · Mobile Development

Optimizing Video Upload Experience for Bilibili Overseas Creators: Product and Technical Improvements

Bilibili’s Q4 2022 initiative overhauled the overseas video upload flow by defining new metrics, adding progress indicators, shrinking chunk size, enabling multi‑threaded and resumable uploads with background support, which boosted submission conversion by up to 10 % and cut failure rates from 4 % to 1 %.

BilibiliMobile SDKcloud storage
0 likes · 13 min read
Optimizing Video Upload Experience for Bilibili Overseas Creators: Product and Technical Improvements
政采云技术
政采云技术
May 31, 2023 · Frontend Development

Frontend Single File Upload to Cloud Service Storage

This article explains the common approaches for uploading a single file from a web front‑end to cloud storage, compares backend‑mediated and direct browser uploads, provides SDK and temporary‑URL examples with code, and discusses encryption, request formats, and best‑practice recommendations.

File UploadJavaScriptSDK
0 likes · 16 min read
Frontend Single File Upload to Cloud Service Storage