Tagged articles
9 articles
Page 1 of 1
Efficient Ops
Efficient Ops
Dec 14, 2022 · Operations

How to Build a Scalable Container Log Collection System with S6 and Filebeat

This article explains Docker and Kubernetes container logging fundamentals, highlights the limitations of default json‑file logging, and presents a unified log‑collection architecture using S6‑based images, filebeat, logrotate, Kafka, and Elasticsearch, with practical steps for dynamic configuration and log rotation in a k8s cluster.

DockerFilebeatKubernetes
0 likes · 9 min read
How to Build a Scalable Container Log Collection System with S6 and Filebeat
Efficient Ops
Efficient Ops
Dec 20, 2021 · Cloud Native

How to Build a Scalable Kubernetes Logging System with S6 and Filebeat

This article explains Docker and Kubernetes logging challenges, compares logging drivers, and presents a unified, node‑agent based logging architecture using S6‑based containers, Filebeat, logrotate, Kafka, and Elasticsearch to achieve reliable, auto‑rotating log collection in production environments.

DockerOperationsS6
0 likes · 8 min read
How to Build a Scalable Kubernetes Logging System with S6 and Filebeat
Programmer DD
Programmer DD
Sep 30, 2021 · Operations

How to Build a Scalable Kubernetes Log Collection System with S6 and Filebeat

This article explains the limitations of Docker's default JSON‑file logging, introduces S6‑based container log redirection, compares Kubernetes logging approaches at pod, node, and cluster levels, and presents a full‑stack architecture using Filebeat, Kafka, Elasticsearch, and Logstash for reliable, rotatable log collection.

DockerFilebeatKubernetes
0 likes · 8 min read
How to Build a Scalable Kubernetes Log Collection System with S6 and Filebeat
Open Source Linux
Open Source Linux
May 6, 2021 · Operations

How to Build a Scalable Container Log Collection System with S6 and Filebeat

This article explains Docker and Kubernetes logging challenges, compares logging drivers, introduces S6‑based container logging, and presents a node‑level log‑agent architecture using Filebeat, Logrotate, Kafka, and Elasticsearch to achieve reliable, auto‑rotating log collection in production environments.

DockerFilebeatKubernetes
0 likes · 9 min read
How to Build a Scalable Container Log Collection System with S6 and Filebeat
Liangxu Linux
Liangxu Linux
Apr 19, 2021 · Cloud Native

Designing a Scalable Kubernetes Log Collection System Using S6 and Filebeat

This article explains the limitations of Docker‑based logging, compares logging drivers, and presents a Kubernetes‑wide log collection architecture that uses an S6‑based base image, Filebeat, logrotate, Kafka, and Elasticsearch to achieve reliable, scalable log aggregation.

DaemonSetFilebeatKubernetes
0 likes · 8 min read
Designing a Scalable Kubernetes Log Collection System Using S6 and Filebeat
MaGe Linux Operations
MaGe Linux Operations
Apr 16, 2021 · Cloud Native

Building a Scalable Container Log System with S6, Filebeat, and Kafka

This article explains Docker and Kubernetes logging challenges, compares engine and container logs, shows why the Docker daemon becomes a bottleneck, and demonstrates a scalable solution using S6‑based images, Filebeat, logrotate, and a node‑agent architecture to collect, rotate, and forward logs to Kafka and Elasticsearch.

FilebeatKubernetesS6
0 likes · 8 min read
Building a Scalable Container Log System with S6, Filebeat, and Kafka
Efficient Ops
Efficient Ops
Mar 28, 2021 · Cloud Native

Building a Scalable Container Log Collection System with S6 and Filebeat

This article explains how to design and implement a unified log collection architecture for Docker containers and Kubernetes clusters using S6‑based images, Filebeat, logrotate, Kafka, Logstash, and Elasticsearch, addressing common challenges such as log rotation, daemon bottlenecks, and dynamic configuration.

DockerFilebeatKubernetes
0 likes · 9 min read
Building a Scalable Container Log Collection System with S6 and Filebeat