Tagged articles
S3
45 articles · Page 1 of 1

java1234Nov 15, 2026 · Backend Development
FlowMQ Kafka separates compute and storage with S3 and RLog backends, delivering 94% cost savings on cloud object storage and eliminating manual rebalancing through segment-level replication and Flexible Quorum, outperforming Kafka and Redpanda in multi-AZ failure recovery.
Flexible QuorumFlowMQKafka
0 likes · 15 min read

FlowMQ Kafka implements the Kafka protocol with compute-storage separation, offering S3 for low-cost cloud storage and RLog for low-latency on-prem deployments, using segment-level replication and Flexible Quorum to enable seamless scaling and fast failure recovery without data rebalancing.
Flexible QuorumFlowMQKafka
0 likes · 13 min read

TiDB’s next‑generation tiered storage separates hot data on local SSDs from cold data on object storage, using multi‑tree LSM, segment caching, and IA Manager to reduce storage costs by up to 50 % while preserving low latency for frequent accesses and providing clear migration and monitoring guidelines.
Cold DataIA ManagerS3
0 likes · 15 min read


Niu LiuJul 15, 2026 · Cloud Computing
The article compares open‑source MinIO with commercial object storage services such as Alibaba OSS, Tencent COS, Huawei OBS, and Amazon S3, analyzing architecture, maintenance responsibilities, total cost of ownership, and suitability criteria to help enterprises decide which storage path aligns with their control needs and operational capabilities.
MinIOObject StorageS3
0 likes · 12 min read

The article details a step‑by‑step exploitation chain against a site using JWT authentication and an upload endpoint, showing how modifying the JWT realm, removing the Bearer keyword, and abusing Amazon S3/CloudFront default settings enabled arbitrary file overwrite and yielded a total $23,000 bounty.
Authorization HeaderCloudFrontFile Overwrite
0 likes · 7 min read

Bun introduces a built-in, zero-dependency image processing library called Bun.Image that supports JPEG, PNG, WebP, and limited HEIC/AVIF formats, offering chainable resizing, filtering, S3 integration, clipboard handling, and placeholder generation, while sparking community debate over runtime bloat versus Sharp’s richer feature set and deployment challenges.
AVIFBunHEIC
0 likes · 10 min read

This guide covers MinIO object storage deployment with ready-to-use automation scripts for both standalone and distributed modes, including environment checks, binary download methods, systemd service configuration, and cluster requirements for production use.
Bash ScriptMinIOObject Storage
0 likes · 38 min read


ITPUBDec 14, 2025 · Cloud Native
With MinIO entering maintenance mode, this article evaluates open‑source S3‑compatible alternatives—Ceph, SeaweedFS, Garage, and RustFS—detailing their strengths, limitations, security concerns, and practical deployment tips, while concluding that none yet offers a perfect drop‑in replacement.
CephMinIOObject Storage
0 likes · 9 min read

After MinIO entered maintenance mode in December 2025, RustFS—a Rust‑written, Apache‑2.0 licensed, high‑performance distributed object storage—offers memory‑safe design, cross‑platform Docker deployment, S3 compatibility, and seamless integration with the Webman PHP framework, providing a compelling alternative for cloud‑native environments.
DockerObject StorageRust
0 likes · 5 min read

This article explains how StarRocks mitigates the hidden risks of massive one‑time data imports in a storage‑compute separated architecture by redesigning the write path to spill to local disk, merge centrally, and write to object storage, resulting in fewer small files, higher write throughput, and more stable query performance.
Data EngineeringS3StarRocks
0 likes · 12 min read

After months of puzzling over a $2,400 monthly S3 bill, we discovered a missing Cache‑Control header caused CloudFront to revalidate every request, and by adding the header we boosted cache hits from 12% to 94%, cutting costs to under $500.
AWSCloudFrontCost Optimization
0 likes · 5 min read

StarRocks 3.5 introduces a cluster‑level snapshot mechanism that automates backup to object storage, supports minute‑level recovery, and integrates with Kubernetes via Helm charts to streamline disaster‑recovery workflows for high‑availability workloads.
HelmKubernetesS3
0 likes · 17 min read

This article explains how the cloud‑native Loki logging system combined with S3 object storage can reduce PB‑level log storage expenses by 80‑90%, while simplifying operations, improving query performance, and meeting compliance requirements through detailed architecture, configuration, deployment, and real‑world case studies.
Cost OptimizationLokiS3
0 likes · 23 min read

This article examines the common “list‑but‑cannot‑download” problem in multi‑account Amazon S3 environments, explains why bucket‑owner and object‑owner separation causes permission failures, and presents two practical solutions—disabling ACLs or adjusting ACL settings—along with detailed bucket policies, IAM roles, and CLI commands to implement them.
ACLAWSBucket Policy
0 likes · 14 min read

This article walks you through MinIO’s features, deployment requirements, Docker installation, web‑UI access, bucket creation, sharing links, access policies, and using the MinIO client (mc) for common S3‑compatible operations, all with clear command examples and screenshots.
CLIDockerMinIO
0 likes · 9 min read

This tutorial explains how to combine the high‑performance PHP microservice framework Webman with the S3‑compatible MinIO object storage using the tinywan/storage extension, covering environment setup, configuration, service class creation, controller implementation, routing, and testing to build a fast, reliable file‑management microservice.
File UploadMinIOPHP
0 likes · 9 min read

RustFS is an open‑source, Rust‑based distributed object storage system that is fully S3‑compatible, runs on any major OS and CPU architecture, and can be quickly deployed with Docker for cloud‑native environments, with step‑by‑step usage examples in PHP.
DockerObject StorageRust
0 likes · 5 min read

Facing the challenge of moving 15 billion image files from Cassandra to S3, we iteratively redesigned the migration pipeline—from a single‑process approach to multi‑process, queue‑driven, and multi‑cluster deployments—reducing the projected 120‑day effort to just 40 days while ensuring reliability and performance.
CassandraGoS3
0 likes · 16 min read

This article introduces MinIO, an open‑source object storage solution, explains its features and deployment options, and provides a detailed Docker‑based installation guide, including configuration, bucket creation, file upload, sharing links, and using the MinIO client for common operations.
CLIDockerMinIO
0 likes · 9 min read


21CTOFeb 6, 2025 · Frontend Development
Version 1.2 of the Bun runtime introduces five significant enhancements—including improved Node.js compatibility, HTML import that replaces the entire frontend toolchain, native S3 object handling, a fast Promise‑based Postgres driver, and a text‑based lock file—positioning Bun as a comprehensive, cloud‑first JavaScript ecosystem.
BunHTML importJavaScript Runtime
0 likes · 4 min read

This guide walks you through configuring GitLab to use an external MinIO object store and CertManager for TLS certificates, covering credential setup, bucket creation, Helm chart adjustments, secret management, and verification steps to achieve a secure, efficient cloud‑native deployment.
GitLabMinIOS3
0 likes · 9 min read

This tutorial guides readers through creating an AWS account, configuring the AWS CLI, uploading and downloading CSV files to S3, and using Python with pandas to clean, deduplicate, and aggregate the data before re‑uploading the results, illustrating end‑to‑end cloud data processing.
AWSCLIPython
0 likes · 6 min read

This guide walks you through upgrading the ob‑operator, creating S3 credentials, configuring an OBTenantBackupPolicy YAML, applying the backup, and verifying the backup status to achieve a full data backup of an OceanBase 4.2.5 tenant to Baidu Cloud BOS using Kubernetes.
BOSKubernetesOceanBase
0 likes · 8 min read

Bun v1.1.25 boasts a benchmark of 1.29 million HTTP requests per second and adds node:cluster support, V8 C++ API bindings, a five‑fold S3 upload boost, standalone worker executables, Windows OMGJIT for WebAssembly, plus numerous Node.js compatibility fixes, all illustrated with code examples.
BunS3V8
0 likes · 9 min read

This guide walks through the reasons for creating a custom image bed, explains why Cloudflare R2 is chosen over domestic providers, and provides step‑by‑step instructions for setting up an R2 bucket, binding a domain, configuring public access, and integrating PicGo for automatic uploads.
CloudflareImage HostingPicGo
0 likes · 5 min read

This article presents NewsBreak's practical deployment of Alluxio Local Cache with Presto on S3, detailing the system architecture, cache design considerations, implementation steps, performance metrics, and future optimization directions to reduce query latency and storage costs.
AlluxioCacheData Engineering
0 likes · 12 min read

This guide explains how to install the AWS SDK for PHP, configure an S3 client, perform bucket and object operations, paginate and filter objects, generate presigned URLs, compress downloaded objects with ZipArchive, and set up CORS for AWS S3 buckets.
AWSCORSPHP
0 likes · 9 min read

This guide explains object storage fundamentals, the bucket model, Ceph's RADOS Gateway (RGW) architecture, step‑by‑step installation (online and offline), configuration, keyring creation, pool setup, troubleshooting PG limits, user creation, and how to access RGW using AWS CLI tools.
AWS CLICephLinux
0 likes · 14 min read

This article explains how to boost performance and reliability of third‑party service calls in a Kubernetes cluster by configuring Nginx as a caching gateway, covering cache settings, deployment, persistent shared cache via S3, and the associated limitations.
CachingDevOpsKubernetes
0 likes · 10 min read

This article walks through using Rust and the AWS SDK to connect to object storage services, perform basic CRUD operations, and handle large file uploads and downloads efficiently with multipart techniques.
AWS SDKFile UploadLarge Files
0 likes · 9 min read

The Shopee Data Infra talk details the current storage architecture, Presto‑based acceleration with Alluxio caching, service‑oriented storage solutions using Alluxio Fuse and S3 APIs, and outlines future enhancements for Spark/Hive integration and CSI/Fuse optimizations, providing a comprehensive view of large‑scale big data storage engineering.
AlluxioCache ManagerData Infrastructure
0 likes · 16 min read

AWS switched S3 log compression from gzip to Zstandard, saving roughly 30% of storage space—equivalent to exabytes—by changing the internal storage method, a move confirmed by employee comments and a coinciding 31% price drop in late 2021.
AWSCompressionCost Optimization
0 likes · 4 min read

The article introduces Promoter, a Go‑based webhook that fetches Prometheus metrics, renders alert graphs with gonum/plot, stores the images in S3‑compatible object storage, and embeds them in DingTalk notifications, providing deployment instructions, template customization, and core implementation details.
AlertmanagerDingTalkGo
0 likes · 10 min read

Shopee ClickHouse implements a cold‑hot storage architecture by mounting JuiceFS‑backed S3 as a remote volume, using table‑level storage policies and TTL‑driven background moves to shift data from SSD to cold storage, achieving cost‑effective scalability, improved disk utilization, and validated performance despite operational challenges such as Redis memory pressure and small‑file handling.
ClickHouseCold-Hot StorageDistributed OLAP
0 likes · 22 min read

This guide walks you through setting up a Loki logging cluster for production, covering the native architecture, key configuration differences, storage with boltdb‑shipper on S3, Redis caching, ruler setup, and adapting the Docker‑Compose deployment to Kubernetes.
ConfigurationKubernetesLoki
0 likes · 9 min read

This tutorial demonstrates how to configure an open‑source Squid proxy in an AWS VPC to restrict Internet access, allow only approved Amazon S3 buckets and Yum repositories, route traffic through specific gateways, and achieve high availability using Auto Scaling and Route 53.
AWSHigh AvailabilityProxy
0 likes · 20 min read

This article details GrowingIO's systematic approach to reducing AWS expenses by analyzing billing data, tagging resources, visualizing usage, and applying targeted optimizations across EC2 instances, EBS volumes, HDFS storage, network traffic, and S3, while outlining future automation and scaling plans.
AWSCost OptimizationEBS
0 likes · 14 min read

This guide explains how to generate S3 presigned URLs for PUT, GET, and POST operations using Python's boto3 library, providing code examples, usage tips, and recommendations for secure, unauthenticated file transfers in cloud environments.
Boto3GETPOST
0 likes · 6 min read

This guide explains why Elasticsearch replicas cannot protect against catastrophic failures and shows step‑by‑step how to configure snapshot and restore using various repository types—including S3, HDFS, Azure, and Huawei OBS—install necessary plugins, set up JVM options, and automate snapshot policies via Kibana.
ElasticsearchKibanaOBS
0 likes · 9 min read

The article analyses practical drawbacks of S3 static‑website hosting, the complexities of CDN query‑string caching, and protocol incompatibilities such as HEAD + Range and If‑Match handling, offering concrete lessons and mitigation strategies for cloud operations teams.
CDNCloudFrontQueryString
0 likes · 10 min read

The article explains how Chinese filenames cause encoding errors when uploading to Amazon S3, why S3 forces UTF‑8 for website access, and presents a practical Nginx‑based proxy solution that transparently converts GBK‑encoded URIs to UTF‑8 to ensure reliable file retrieval.
GBKS3UTF-8
0 likes · 9 min read


HomeTechMay 23, 2019 · Frontend Development
This article explains how to create a cross‑platform desktop client for uploading local resources to S3‑backed CDN using Electron, Vue, and lowdb, covering UI design, project structure, main‑renderer process communication, persistent storage, command‑line integration, packaging, and update handling.
Cross‑PlatformElectronLowdb
0 likes · 16 min read

This article explains block, object, and file storage concepts based on Ceph, describes how front‑end JavaScript resources are migrated to an S3‑compatible object store, outlines the supporting Lua/Nginx combo tool, caching strategies, and step‑by‑step e‑commerce migration procedures.
CephLuaObject Storage
0 likes · 16 min read

The article describes how a Go‑based backend, using a two‑layer job/worker pattern with buffered channels and configurable worker pools, can reliably ingest millions of POST requests per minute, serialize payloads to Amazon S3, and dramatically reduce server count through Elastic Beanstalk auto‑scaling.
BackendS3elasticbeanstalk
0 likes · 12 min read


21CTODec 3, 2015 · Big Data
This article explains how Netflix leverages Amazon S3 and Elastic MapReduce to build a virtually unlimited, dynamically scalable Hadoop data warehouse in the cloud, and introduces Genie—a Hadoop platform‑as‑a‑service that abstracts job submission, resource management, and cluster orchestration.
AWSElastic MapReduceGenie
0 likes · 15 min read
