ByteDance Cloud Native
Author

ByteDance Cloud Native

Sharing ByteDance's cloud-native technologies, technical practices, and developer events.

39
Articles
0
Likes
101
Views
0
Comments
Recent Articles

Latest from ByteDance Cloud Native

39 recent articles
ByteDance Cloud Native
ByteDance Cloud Native
Oct 8, 2024 · Backend Development

How Merge Compilation Supercharges ByteDance’s Microservices: Performance Gains and Technical Challenges

This article explains ByteDance’s merge‑compilation technique that combines multiple microservices into a single binary at build time, detailing its performance benefits, architectural trade‑offs, dependency isolation, call conversion, version management, real‑world case studies, and future roadmap for large‑scale service optimization.

GoKitexMicroservices
0 likes · 15 min read
How Merge Compilation Supercharges ByteDance’s Microservices: Performance Gains and Technical Challenges
ByteDance Cloud Native
ByteDance Cloud Native
Aug 12, 2024 · Cloud Native

How to Deploy NVIDIA NIM AI Models on Volcengine VKE in Minutes

This guide walks you through deploying large language models with NVIDIA NIM on Volcengine's Kubernetes Engine (VKE), covering environment setup, model optimization, Helm chart deployment, monitoring integration, and the key advantages of using NIM as a cloud‑native AI micro‑service.

AI DeploymentGPUHelm
0 likes · 12 min read
How to Deploy NVIDIA NIM AI Models on Volcengine VKE in Minutes
ByteDance Cloud Native
ByteDance Cloud Native
Aug 12, 2024 · Cloud Native

How mGPU Enables Efficient GPU Sharing for AI Workloads in Cloud‑Native Environments

The article explains the mGPU solution from Volcano Engine, detailing its kernel‑level GPU virtualization, container runtime hooks, and scheduling mechanisms that allow multiple containers to share a single NVIDIA GPU with isolated compute and memory resources, achieving near‑lossless performance and up to 50% higher utilization for AI tasks.

AI workloadsContainer RuntimeGPU Sharing
0 likes · 9 min read
How mGPU Enables Efficient GPU Sharing for AI Workloads in Cloud‑Native Environments
ByteDance Cloud Native
ByteDance Cloud Native
Aug 7, 2024 · Artificial Intelligence

Deploy Stable Diffusion in 5 Minutes with Volcengine’s Continuous Delivery CP

Learn how to quickly launch a Stable Diffusion WebUI service in just five minutes using Volcengine’s cloud‑native continuous delivery platform, which abstracts Kubernetes complexities, provides pre‑configured AI templates, serverless VCI deployment, automatic scaling, API gateway access, and includes a Python client for image generation.

AI DeploymentPythonStable Diffusion
0 likes · 14 min read
Deploy Stable Diffusion in 5 Minutes with Volcengine’s Continuous Delivery CP
ByteDance Cloud Native
ByteDance Cloud Native
Aug 1, 2024 · Cloud Native

How to Build a Lightweight Cloud‑Native Application Release Platform with Volcengine

This article explains the challenges of constructing a robust, easy‑to‑use application release platform, introduces Volcengine's lightweight solution featuring a powerful workflow engine, rich atomic services, and pipeline templates, and provides a detailed step‑by‑step guide—including workspace creation, OAM app configuration, pipeline setup, deployment, and verification—for microservice‑based full‑link gray releases.

Continuous deliveryKubernetesMicroservices
0 likes · 10 min read
How to Build a Lightweight Cloud‑Native Application Release Platform with Volcengine
ByteDance Cloud Native
ByteDance Cloud Native
Jul 25, 2024 · Cloud Native

KubeAdmiral 1.0.0: A New Cloud‑Native Multi‑Cluster Orchestration Engine

Version 1.0.0 of KubeAdmiral, ByteDance’s open‑source multi‑cluster orchestration engine, introduces native Kubernetes API compatibility, advanced scheduling policies, fault‑tolerant migration, global status aggregation, and extensive hybrid‑cloud support, enabling seamless management of over 210 k machines across public and private clouds.

KubeAdmiralKubernetesMulti-Cluster
0 likes · 15 min read
KubeAdmiral 1.0.0: A New Cloud‑Native Multi‑Cluster Orchestration Engine
ByteDance Cloud Native
ByteDance Cloud Native
Jun 3, 2024 · Cloud Native

How to Build High‑Availability Kubernetes Clusters with Volcengine VKE & VCI

This guide explains how Volcengine's VKE (Kubernetes Engine) and VCI (Elastic Container Instance) enable high‑availability, multi‑AZ deployments, covering cluster creation, control‑plane distribution, virtual node configuration, inventory‑aware scheduling, and practical YAML examples for resilient cloud‑native workloads.

Container ServiceKubernetesVolcengine
0 likes · 14 min read
How to Build High‑Availability Kubernetes Clusters with Volcengine VKE & VCI
ByteDance Cloud Native
ByteDance Cloud Native
Mar 27, 2024 · Cloud Native

How ByteDance Optimized Its Metrics Agent for 70% CPU Savings

This article details how ByteDance's cloud‑native observability team tackled performance bottlenecks in their metricserver2 Agent—reducing memory copies, merging tiny packets, applying SIMD for tag parsing, and switching compression libraries—to cut CPU usage by over 10% and memory usage by nearly 20% while handling petabyte‑scale metric data.

CCompressionMsgpack
0 likes · 15 min read
How ByteDance Optimized Its Metrics Agent for 70% CPU Savings
ByteDance Cloud Native
ByteDance Cloud Native
Jan 4, 2024 · Cloud Native

Mastering Cloud‑Native Cost Governance: FinOps Strategies for Kubernetes

This article explains how enterprises can leverage cloud‑native architectures and FinOps practices to gain financial accountability, visualize multi‑dimensional cost data, optimize resource usage, and implement systematic cost governance across Kubernetes environments, covering cost insight, optimization, and operational stages with practical recommendations and example algorithms.

FinOpsKubernetescost optimization
0 likes · 14 min read
Mastering Cloud‑Native Cost Governance: FinOps Strategies for Kubernetes