Building a Testing Environment Platform: LEGO's Best Practices
The article discusses the development of a platform called LEGO to automate the setup of testing environments, addressing issues like team collaboration and maintenance challenges.
The article discusses the development of a platform called LEGO to automate the setup of testing environments, addressing issues like team collaboration and maintenance challenges.
The article examines how Tencent’s Blue Whale platform enables traditional operations teams to evolve into DevOps‑focused, cloud‑native units by automating release, change, and incident processes, integrating big‑data decision support, and delivering low‑cost SaaS tools for a wide range of internal stakeholders.
This article explains the origins of DevOps, presents the CALMS and Three Ways frameworks, and organizes practical DevOps principles into four dimensions—people, product, process, and tools—illustrating how they collectively enable continuous, on‑demand delivery of business value.
This guide explains how to install, configure, and use Nodemon to automatically detect code changes and restart Node.js applications, improving development efficiency while highlighting common Windows setup issues and configuration options.
This article details how Tencent's game operations team redefined operational services, introduced micro‑service architecture, applied big‑data driven recommendations, and built intelligent, automated pipelines for server opening, merging, version releases, and download services, achieving significant efficiency and cost gains.
This article explores the challenges of operating Alibaba's large‑scale data platforms, describes the automation platform built to address them, and shares data‑driven, fine‑grained operational practices that enable stable, efficient, and cost‑effective service delivery.
The article examines the conflict and convergence between ITIL and DevOps in modern operations, outlining DevOps principles, automation in deployment and operations, and three integration models that balance management and execution, while highlighting the distinct values and scenarios for each approach.
The article presents a comprehensive, application‑centric approach to automated capacity management that analyzes why server utilization is low, defines safe usage thresholds, describes a load‑balancer‑driven stress‑testing workflow with regression modeling, and explains how this practice improves resource efficiency, cost savings, and developer‑ops collaboration.
This article explains how to automate application‑centric capacity assessment, identify the safe utilization thresholds, use load‑balancer‑driven stress testing and regression modeling to pinpoint resource bottlenecks, and improve server usage while maintaining service reliability through close DevOps collaboration.
This article explains how to automate capacity management focused on application performance, identifies common causes of low resource utilization, proposes safe utilization thresholds, describes a testing framework that uses load‑balancer weighting and real‑time monitoring to pinpoint bottlenecks, and outlines how ops and developers can collaborate to improve efficiency.
This article explains how to encapsulate Java HttpClient calls for GET and POST HTTP requests, provides utility methods for JSON response parsing, and demonstrates their use in automated API testing, offering a reusable backend solution for developers.
The article outlines the architecture, distributed design, redundancy, monitoring, automation, and fault‑handling strategies employed in a game company's platform backend to ensure high availability and efficient daily operations.
ELF is a Node‑based CLI tool that streamlines HTML5 scene‑marketing project creation by providing quick installation, project initialization with ready‑made templates, and automated build processes powered by webpack, helping developers avoid repetitive setup tasks.
This article explains Puppet's architecture, data flow, and practical examples, showing how automated configuration management can efficiently handle large numbers of servers, reduce manual errors, and improve operational reliability in modern IT environments.
This article details how Qihoo 360 built large‑scale traffic analysis, VxLAN deployment, and SDN practices to automate network operations, improve visibility, and support security, while sharing real‑world challenges, solutions, and a Q&A on network automation strategies.
ForceBot is JD.com’s comprehensive full‑chain load‑testing platform that simulates user behavior across the entire purchase flow, isolates test traffic, leverages Docker‑based agents, GRPC services, and real‑time data analytics to identify bottlenecks, optimize resource planning, and support both routine and peak‑traffic scenarios.
This article explains how Alibaba leverages a one‑click site‑building platform and elastic capacity delivery to dynamically provision, scale, and release cloud resources for the massive traffic spikes of the Double 11 shopping festival, reducing waste and improving operational efficiency.
This guide introduces Ansible for operations, covering its core features, installation, host preparation, key management, essential modules, playbook structure, YAML syntax, handlers, tags, variables, templates, loops, and conditional execution, with practical command examples and visual illustrations.
This article explains how Puppet automates large‑scale server provisioning by describing its architecture, workflow, manifest examples, class inheritance, and module structure, helping operations teams reduce manual effort and avoid errors in configuration management.
This article details how New Dada transformed its financial account system from a simple courier‑focused service into a platformized, standardized solution that serves multiple business entities, improves automation, and enhances development efficiency through unified APIs and self‑service tools.
This article introduces the standout operations professionals featured by the High‑Efficiency Operations community in 2016, summarizing each expert’s background, key achievements, and a curated list of their most influential technical articles for readers seeking deep insights into modern ops practices.
This article outlines mobile performance testing methods—including startup time, page response time, basic metrics, Monkey testing, and image‑recognition techniques—reviews third‑party tools, and introduces the in‑house ETest solution with its features and future development plans.
This article explains how to standardize and automate MySQL management at scale, covering dedicated instance deployment, configuration consistency, multi‑instance creation, metadata collection, backup, monitoring, high‑availability with Zookeeper, and task orchestration using DBTask to achieve rapid, reliable database services.
Facing massive user growth, Tencent’s social network team redesigned its KV storage architecture—introducing CKV and Grocery, automating capacity planning, data migration, and backup reuse—to dramatically lower costs, improve operational efficiency, and maintain high service quality across millions of devices.
This article explains how large internet firms evolve their IT operations from reactive fire‑fighting teams to standardized, model‑driven, automated platforms covering planning, building, management, monitoring, and process‑oriented operations across compute, storage, and network resources.
This article explains how 360's Qcmd, a Golang‑based real‑time command execution system, overcomes SaltStack's limitations to reliably manage tens of thousands of servers with high success rates, flexible scripting, detailed monitoring, and efficient message handling.
DevOps is a methodology that emphasizes collaboration between development and operations to accelerate software delivery, and while tools alone don’t constitute DevOps, automation and container technologies are essential prerequisites that reduce manual hand‑offs, enable self‑service, and improve feedback loops.
This article traces the evolution of network engineering from simple early‑day admin tasks to today’s high‑pressure, large‑scale operations and outlines the skills and mindset needed for engineers to become true network architects.
The article provides a comprehensive overview of ares-client, detailing its functional positioning, overall architecture, SPI and Base API design, common and special instrumentation, dump and replay mechanisms, request association and filtering strategies, as well as performance optimizations and future enhancements for backend testing integration.
This article compiles expert Q&A on operations, covering tool selection, monitoring, Linux version choices, automation platforms, security, Docker, backup strategies, and career advice, offering practical guidance for modern infrastructure management.
This guide walks through an automated, fast‑track deployment of DCOS components—including service selection, Docker‑based containers, host initialization, system checks, Ansible provisioning, Consul service discovery, HAProxy load balancing, MySQL HA, and Zookeeper/Marathon integration—providing concrete commands, configuration snippets, and practical tips.
The 2016 Global Agile Operations Summit in Shanghai concluded with a series of expert sessions covering agile DevOps trends, cloud‑native automation platforms, database performance tuning, container orchestration, and real‑world case studies from leading companies, followed by the award ceremony honoring ten MVPs who drove innovation across operations and infrastructure.
This article explains how Qunar tackled growing network device management workload, low‑efficiency manual processes, and operational risk by designing an integrated platform that automates common tasks, enforces permission‑based controls, records audits, and provides real‑time monitoring and scalable data collection.
This article details the evolution from manual, standardized operations to an automated, intelligent cloud operations platform for a banking card organization, describing its motivations, core features, key scenarios, technical architecture, scheduling algorithms, data visualization, and real‑world outcomes.
This comprehensive guide introduces Ansible, explains its agentless architecture, core components, installation, SSH key setup, inventory configuration, essential commands, and common modules, providing a practical roadmap for automating system administration and deployment tasks.
Uber tackled the challenge of managing over 1,000 MySQL clusters by designing Schemadock, a Docker‑based solution that runs stateless MySQL containers, uses configuration‑driven topologies, and employs agents for automated deployment, monitoring, and centralized control, enabling multi‑database hosts, full automation, and unified management.
The article introduces JEN, JD's extended Nginx platform that centralizes configuration, monitoring, traffic splitting, rate limiting and automated operations through a web console and Ansible integration, addressing the complexity, restart requirements, and scaling challenges of large‑scale Nginx deployments.
This article outlines the challenges of modern software delivery in a VUCA environment and presents a practical, step‑by‑step approach to designing a visual continuous‑delivery pipeline that balances speed, quality, and reliability through agile, lean, and DevOps practices.
This article explains how the internally built Wonder monitoring system, based on Open‑Falcon, tackles large‑scale operational challenges by offering automated agent updates, customizable metrics, log and port monitoring, persistent alarm storage, enhanced alert content, and comprehensive dashboards for thousands of devices.
This article details Shanda Games' journey in designing and implementing a comprehensive automated operations platform—including installation, deployment, security, client and server updates, data analysis, backup, and monitoring—to efficiently manage hundreds of games across diverse hardware and operating systems.
This article examines the challenges of testing a mobile advertising SDK—such as missing server environments, extensive protocol fields, and costly manual test case updates—and proposes a mock‑proxy strategy, a minimal‑case design approach, and full automation to improve coverage and efficiency.
This article presents the design, implementation, and ongoing improvements of Qunar's network device operations platform, detailing its background, optimization strategies, permission model, automated tasks, monitoring capabilities, and how it enhances operational efficiency while reducing risk.
The article examines the growing crisis in the software testing industry, highlighting external stagnation, internal role changes at Huawei, the impact of DevOps and cloud technologies, and proposes how testers can adapt by expanding skills, embracing automation, and positioning themselves as quality guardians.
The article explains DevOps as the integration of development and operations, tracing its origins, outlining its cultural and technical challenges, detailing its benefits such as faster, more reliable releases, and reviewing the tools and global adoption trends, including a new Chinese survey initiative.
This talk details Ctrip's application operations framework, covering data‑center scale, multi‑application deployment on Windows, high availability goals, capacity‑prediction models, disaster‑recovery design, incident response, and the evolution from manual tooling to automated, intelligent operations.
This article presents a comprehensive automated testing and proactive monitoring solution for Baidu Nuomi's O2O mobile component framework, detailing component‑level UI element identification, schema‑based entry shortcuts, wireless Android test apps, daily case execution, and a JavaScript‑driven monitoring engine that captures UI, request and exception anomalies across iOS and Android.
This article summarizes Ouyang Chen's GDevOps 2016 talk, covering the definition of DevOps, four personal viewpoints, Microsoft's three‑phase transformation, Xiaomi's rapid release pipeline, key principles, metrics such as time‑to‑detect, and essential tools for building an efficient DevOps culture.
Ansible playbooks, a powerful configuration management tool, use YAML to define tasks, variables, inventory, conditionals, loops, and handlers; this guide explains core components, syntax, variable scopes, command-line overrides, and provides practical examples for installing services, managing users, and triggering handlers based on changes.
This article, excerpted from the upcoming Chinese edition of “SRE: Google Site Reliability Engineering”, examines how Google’s SRE guiding philosophies—disaster planning, post‑mortem culture, automation, and data‑driven decision‑making—are adopted, adapted, or contrasted in sectors such as manufacturing, aerospace, nuclear, telecommunications, healthcare, and finance, highlighting key similarities, differences, and lessons for Google and the broader tech industry.
Keeping npm dependencies up to date can be risky, but using tools like npm-check-updates, updtr, next-updater, and Greenkeeper lets you automatically detect new versions, test compatibility, and manage updates safely without manual checks, ensuring your projects stay current and stable.
The article recaps Meituan‑Dianping’s 10th Tech Salon where senior DBA Ping Zhong detailed the Atlas database middleware, explaining its three‑layer architecture, connection‑string simplification, load balancing, read/write separation, automated slave management, monitoring, sharding capabilities, current 87% deployment across services, and upcoming enhancements such as stronger SQL processing and distributed transaction support.
This guide shows how to connect JMeter performance testing with Jenkins continuous integration by setting up JMeter test plans, running them via GUI or command line, configuring Jenkins jobs with the Performance plugin, and automating result collection for each build.
This guide explains how to use Parallel SSH (PSSH) to execute commands, copy files, and synchronize directories across multiple servers, including installation steps and configuring password‑less SSH for streamlined server management.
This guide walks you through installing Jenkins and Docker, configuring Jenkins agents, creating jobs and pipelines, mastering essential Docker commands and Dockerfile syntax, and finally integrating the two tools to establish a fully automated CI/CD environment for building and deploying applications.
An automated database operations platform shifts routine DBA tasks to developer self‑service and fully automates processes such as cluster provisioning, scaling, backup, migration, and sharding, using a stateless workflow center, job queue, and unified SqlEditor to improve efficiency, safety, and auditability.
koa‑restql automatically creates full RESTful CRUD endpoints from Sequelize models, mapping each database table to standard GET, POST, PUT, and DELETE routes, handling query filters, pagination, and associations via query strings, and offering middleware or association‑level options for access control, thus eliminating repetitive data‑operation code in Koa backends.
The article introduces Qunar's Mobile Testing Cloud (Nebula), detailing its device and service autonomy, core functions such as smart distribution, distributed scheduling, device management, and task scheduling, the supported UI automation, monkey and installation tests, and the practical deployment setup using mac mini slaves.
This article outlines the evolution of enterprise operations through four stages, identifies seven common operational pain points, and presents a comprehensive model for building an automated operations platform that integrates design, deployment, monitoring, optimization, and troubleshooting.
The karaoke app’s new self‑service security system empowers trusted external community members with limited, quota‑based moderation permissions, reusing the existing reporting channel to automatically prioritize and process malicious content, cutting urgent incident response from 20 minutes to sub‑second and reducing daily missed issues from dozens to a few.
This article explains how MHA provides automated master monitoring, rapid failover within 10‑30 seconds, online master switching, various failover modes, extensible scripts, key commands, and best‑practice workflows to achieve high‑availability MySQL replication without performance impact.
Leveraging Tencent's extensive experience in social platform operations, this talk explores intelligent monitoring practices—covering active, passive, and side‑channel techniques, full‑link observability, data processing pipelines, and alert convergence—to enhance reliability, availability, and user experience while reducing noise for ops teams.
This guide explains how to set up Jenkins to automatically poll a Git repository, run cppcheck static analysis, process the XML results, and email the findings, including detailed configuration steps, command examples, and troubleshooting tips.
This article guides operations engineers through tcpdump fundamentals, advanced filtering techniques, the design of an automated packet‑capture tool, and how to transform captured traffic data into a visual business architecture tree for efficient fault isolation and resource optimization.
This article examines common misconceptions in CMDB implementation, outlines four key success factors, and shares two real‑world case studies to help operations teams balance effectiveness with cost while automating configuration management efficiently.
This comprehensive guide introduces Gulp 4, compares it with Grunt, explains its Node.js requirements, walks through installing the development version, details the core API and common plugins, and provides complete example gulpfile scripts for tasks such as building, watching, live‑reloading, and serving static files.
This article provides a detailed overview of widely used DevOps tools—including monitoring solutions like Microsoft SCOM, Vistara, SolarWinds, Nimsoft, ServiceNow, automation platforms Chef and Puppet, container platform Docker, orchestration systems Apache Mesos and Kubernetes, as well as performance monitoring tools New Relic and Graphite/Grafana—highlighting their features, typical use cases, and important considerations.
This article explains how large‑scale internet companies can reduce alarm storms and speed up incident resolution by creating an operations ecosystem centered on automated fault root‑cause localization, detailing the challenges, architecture, decision‑tree algorithms, and a four‑step implementation guide.
Continuous Integration, Delivery, and Deployment form a progressive workflow that automates code testing, staging, and production release, enabling teams to detect issues early, ensure deployable code, and achieve fully automated releases despite challenges like complex topologies and large-scale environments.
This article explores how large‑scale internet operations can achieve order and efficiency by applying entropy theory, standardizing configuration and monitoring, adopting automated deployment practices, and leveraging open‑source tools like Open‑Falcon to build a fully automated, resilient infrastructure.
This article explains the DevOps toolchain by breaking it into three core components—SCM, automation, and cloud—detailing their roles, typical tools, and how they interoperate to enable continuous delivery and scalable, self‑service infrastructure.
This article introduces Ansible, a Python‑based configuration management and deployment tool, explains its installation prerequisites, demonstrates basic ad‑hoc commands, and provides a comprehensive guide to managing MySQL master‑slave replication using Ansible modules, playbooks, and role‑based directory structures.
This article presents a comprehensive overview of the IT infrastructure model used by a fast‑growing internet company, detailing layered design from business to data‑center, high‑availability services, automation, and the five‑fold approach of service, standardization, automation, self‑service, and technology.
Learn how to use shell scripting combined with MySQL commands and cron jobs to create, query, update, and delete database records automatically for routine performance monitoring and system administration tasks.
The article explains the paradox that good programmers spend the majority of their time on tasks, technologies, and tools they dislike because these “bad” technologies consume disproportionate effort, while automation‑friendly work is quickly delegated, leading to chronic frustration despite their expertise.
This article shares Peng Lihang's practical insights on operations automation, covering the essential trio of configuration, state, and change management, the evolution of ops practices, platform design principles, and concrete steps for building scalable, business‑driven ops platforms.
Drawing on interviews with over 500 engineers from top tech firms, this article outlines ten actionable practices—such as speeding iteration, embracing automation, fostering code ownership, and allocating 20% time—that together create a respectful, high‑performance engineering culture.
This article outlines ten practical guidelines for operations engineers—ranging from mandatory rollback testing and cautious handling of destructive commands to robust backup verification, vigilant monitoring, and disciplined handover procedures—to dramatically reduce system outages and improve overall reliability.
This article examines the DevOps dilemma caused by fragmented development and operations workflows, explains why IaaS alone cannot solve it, and outlines how PaaS combined with modern cloud-native tools such as Docker, Mesos, and YARN can automate resource allocation, deployment, service discovery, and monitoring to create a cohesive, scalable operations platform.
This guide explains how to use the Linux find command to locate old files, create a shell script for batch deletion, and schedule the script with crontab, including detailed syntax, examples, and common cron expression patterns for reliable automated cleanup.
This article chronicles Spotify's evolution in server operations—from a manual Ops team and ad‑hoc tools in the early years, through automated DNS, provisioning, and self‑service platforms, to a hybrid cloud strategy that reduced resource‑request turnaround from weeks to minutes.
An in‑depth overview of Tencent’s Blue Whale system reveals its positioning, design philosophy, PaaS and SaaS components, and how it enables scalable, unmanned operations across cloud and on‑premise environments, illustrating practical automation stages from scripting to intelligent orchestration.
This guide explains how to configure GitLab webhooks and an Apache endpoint to automatically pull code updates to a test server after each commit, covering server setup, SSH key configuration, PHP interface script, and troubleshooting steps.
This article outlines a comprehensive approach for designing an IT operations monitoring platform that focuses on real‑time business transaction metrics, automatic topology discovery, event‑transaction correlation, deep component diagnostics, and unified data processing to improve availability, performance, and fault‑resolution speed in large‑scale data centers.
At the GOPS2016 conference, speaker Cui Xiaochun likens the invention of the horse stirrup to modern automation, tracing the evolution of operations from manual scripts to AI-driven intelligent systems, and argues that embracing AI is the next revolutionary step for ops teams.
sshpass enables non-interactive SSH sessions by allowing passwords to be supplied directly via command line, password files, or environment variables, simplifying automated remote operations; this guide explains its usage, installation, and common command examples for Linux administrators.
This article explains how to deploy a stateful MySQL service in Docker containers using the Autopilot pattern, Containerbuddy, Consul, and Percona XtraBackup to achieve automated bootstrapping, scaling, health‑checking, failover, and self‑healing without manual intervention.
This article explains how to design and implement a unified operations monitoring and alerting platform by combining Ganglia for data collection with Centreon for alerting, covering architecture layers, module functions, integration steps, and practical Q&A for large‑scale deployments.
The article describes a three-dimensional, automated, visual monitoring approach for high-availability systems, detailing a five-layer monitoring model, automated log collection using Logstash-Redis-Elasticsearch, and visualization techniques that together reduce fault-locating time and improve operational efficiency.
This article presents a comprehensive overview of Dianping's operations architecture, detailing team organization, multi‑data‑center infrastructure, monitoring layers, automation tools, configuration management systems, incident analysis, lessons learned, and future directions such as Docker and PaaS adoption.
This article provides a comprehensive overview of DevOps, explaining its purpose, cultural challenges, core principles such as automation, standardization, and configuration, its relationship with cloud, lean and agile, practical steps, metrics, and how it transforms IT delivery into an end‑to‑end business value pipeline.
This article details the evolution of Weibo's database platform—from its early single‑master design through rapid scaling, vertical and horizontal sharding, automation, Redis enhancements, custom middleware, and future plans—offering practical insights into high‑availability, high‑performance data engineering for large‑scale social media services.
The article critiques the hype around operations automation, arguing that many tasks can be handled with simple shell scripts, that automation should solve error‑prone manual work rather than replace thoughtful architecture, and that choosing the most convenient tool is more valuable than chasing trendy solutions.
After hands‑on experience with both Salt and Ansible, the author compares their terminology, architecture, community support, speed, code structure, security, auditing, deployment, learning curve, and documentation, concluding that Ansible excels in ease of use while Salt offers superior scalability and performance for cloud environments.
This article presents ten practical Bash tips that boost command‑line productivity, covering inserting text at the top of files, appending multi‑line blocks, recursive search‑and‑replace, creating temporary Vim files, using curl for downloads, managing bookmarks, extracting columns with awk, trimming output, and building custom command packages.
This article examines recent high‑profile internet outages caused by human error, explores why operations teams are especially prone to mistakes despite automation and standards, and offers practical strategies—such as hiring the right people, fostering safety awareness, and turning professionalism into habit—to reduce future incidents.
This article explores how a people‑centric mindset can transform operations by defining a three‑layer framework, clarifying why human factors matter, and offering concrete process, technology, and organizational practices such as streamlined approval flows, voice‑alert systems, and Docker‑based continuous deployment.
This article explores why efficient operations are hard to achieve, identifies common pitfalls such as unclear responsibilities, communication gaps, and resource mismatches, and presents a practical framework—including clear roles, professional processes, and a good service interface—to help operations teams become more effective and satisfied.
The article argues that traditional IT operations are facing a crisis and proposes Operations 2.0—a service‑oriented, business‑aware model that leverages cloud, open‑source and automation to shift focus from technical output to reliable, value‑adding services, outlining why it is essential and how to implement it.
Immutable Infrastructure treats every server or container as a read‑only unit that is replaced rather than modified, offering repeatable configuration, faster CI/CD, easier rollback, and reduced operational complexity, while requiring stateless applications and automated provisioning templates to succeed.
This article explains how the OraZ toolset streamlines Oracle database administration by automating routine tasks, providing intelligent hang analysis, offering comprehensive health checks, and delivering real‑time instance activity insights, ultimately reducing DBA workload and improving operational efficiency.