0 views collected around this technical thread.
This article presents a comprehensive design and implementation of a serverless delayed message queue on AWS, evaluating various solutions such as RabbitMQ, ActiveMQ, RocketMQ, Redis, and ultimately proposing a hybrid Kafka‑SQS‑DynamoDB architecture with performance optimizations and operational insights.
Nebula is a schema‑less, versioned data storage service built by Airbnb that unifies real‑time random access and offline batch processing, supporting low‑latency queries, incremental updates, and scalable snapshots using DynamoDB, HFileService, Spark pipelines, and Kafka streams.
Envoy’s extensible filters enable detailed access logging and database sniffing for MongoDB, DynamoDB, and Redis, offering customizable log formats, per‑operation statistics, health checks, and future enhancements such as circuit breaking and retries, while providing configuration guidance for each filter.
The article introduces AWS S3 SELECT for in‑object SQL filtering, highlights Aurora's new Multi‑Master and Serverless capabilities, describes DynamoDB's on‑demand backup and Global Tables, and provides a brief overview of the managed graph database Neptune, emphasizing performance and cost benefits.