BestHub
Sign in
Tagged articles

pipeline

345 articles · Page 2 of 4
Python Programming Learning Circle
Python Programming Learning Circle
Jun 21, 2024 · Artificial Intelligence

Using scikit-learn for Data Mining: Feature Engineering, Parallel Processing, Pipelines, and Model Persistence

This article demonstrates how to perform data mining with scikit-learn by detailing the full workflow—from data acquisition and feature engineering, through parallel and pipeline processing, to automated hyper‑parameter tuning and model persistence—using the Iris dataset as an example.

data miningfeature engineeringhyperparameter tuning
0 likes · 13 min read
Using scikit-learn for Data Mining: Feature Engineering, Parallel Processing, Pipelines, and Model Persistence
MaGe Linux Operations
MaGe Linux Operations
Jun 21, 2024 · Operations

Fix Jenkins Pipeline Errors: Plugin Updates, Maven Build Failures, Git Config

This guide walks through fixing four common Jenkins pipeline problems: replacing unreachable plugin update sites with domestic mirrors, resolving Maven build errors caused by missing server JVM libraries, clearing stale Git config lock files, and adjusting file descriptor limits on build nodes to prevent out‑of‑resource failures.

CI/CDJenkinsMaven
0 likes · 6 min read
Fix Jenkins Pipeline Errors: Plugin Updates, Maven Build Failures, Git Config
Ops Development Stories
Ops Development Stories
Jun 4, 2024 · Cloud Native

Build an Enterprise CI/CD Platform with Jenkins, Docker, and Kubernetes

This tutorial walks through using the Ruoyi project to set up a full CI/CD pipeline with Jenkins, custom Docker base images, Kubernetes deployments, and automated notifications, covering environment preparation, pipeline design, Dockerfile creation, Jenkins configuration, GitLab webhooks, and deployment verification across DEV, UAT, and PROD stages.

CI/CDDevOpsJenkins
0 likes · 24 min read
Build an Enterprise CI/CD Platform with Jenkins, Docker, and Kubernetes
php Courses
php Courses
May 14, 2024 · Operations

Using Jenkins Pipeline for Continuous Integration and Deployment of PHP Applications

This article provides a step‑by‑step guide on setting up Jenkins Pipeline to automate the continuous integration, testing, and deployment of PHP applications, covering prerequisite installations, plugin configuration, Jenkinsfile creation with stages for checkout, build, test, and deployment, and how to run the pipeline.

CI/CDDevOpsJenkins
0 likes · 5 min read
Using Jenkins Pipeline for Continuous Integration and Deployment of PHP Applications
Alibaba Cloud Native
Alibaba Cloud Native
Apr 24, 2024 · R&D Management

Why R&D Standards Fail and How Aone Inspires Better DevOps Practices

This article examines the origins and goals of software development standards, explains why they often break down when enforced through tools, presents concrete examples of such failures, and shares insights from Alibaba's Aone platform that guide the design of a more effective DevOps‑centric R&D workflow.

AoneDevOpsR&D standards
0 likes · 27 min read
Why R&D Standards Fail and How Aone Inspires Better DevOps Practices
Alibaba Cloud Native
Alibaba Cloud Native
Apr 16, 2024 · Operations

Unlocking Log Insights: How SPL Brings Interactive Pipe‑Style Queries to Cloud‑Native Observability

This article explains how the SLS Processing Language (SPL) enables interactive, pipeline‑based log analysis in cloud‑native environments, covering the challenges of unstructured log data, Unix‑inspired exploration, SPL syntax, key commands, and practical examples for efficient querying and transformation.

SPLcloud-nativeinteractive query
0 likes · 12 min read
Unlocking Log Insights: How SPL Brings Interactive Pipe‑Style Queries to Cloud‑Native Observability
vivo Internet Technology
vivo Internet Technology
Apr 10, 2024 · Databases

Analysis of Redis Pipeline Support in Spring Boot with Lettuce and Redisson Clients

The article examines how Spring Boot’s Lettuce and Redisson clients implement Redis pipelining, explains the batch‑request principle, benchmarks 100 000 set inserts showing pipeline speeds of 0.5–1.4 seconds versus 162 seconds for single commands, demonstrates Spring Data Redis callback usage, warns of high‑cost command pitfalls, and details Redisson’s RBatch internals, concluding that pipelining dramatically boosts throughput when command costs are modest.

JavaLettucePerformance
0 likes · 27 min read
Analysis of Redis Pipeline Support in Spring Boot with Lettuce and Redisson Clients
Wukong Talks Architecture
Wukong Talks Architecture
Apr 4, 2024 · Operations

Automated Deployment of Java Projects Using Jenkins Pipeline

This article provides a comprehensive guide on using Jenkins Pipeline to automate the deployment of Java backend projects, covering pipeline concepts, parameterized builds, code checkout, Maven compilation, JAR packaging, remote uploading, backup, update, and service restart procedures.

CI/CDJavaJenkins
0 likes · 16 min read
Automated Deployment of Java Projects Using Jenkins Pipeline
Wukong Talks Architecture
Wukong Talks Architecture
Apr 3, 2024 · Operations

Automated Deployment of Java Projects Using Jenkins Pipeline

This article explains how to use Jenkins Pipeline to automate the deployment of a Java backend project, covering pipeline basics, parameterized builds, GitLab branch checkout, Maven compilation, JAR packaging, remote file transfer, backup, update, and service restart with Docker Swarm.

CI/CDJavaJenkins
0 likes · 16 min read
Automated Deployment of Java Projects Using Jenkins Pipeline
Tencent Technical Engineering
Tencent Technical Engineering
Apr 2, 2024 · Fundamentals

Cache, Prefetching, False Sharing, Pipeline, and Data Dependency: Benchmarks and Optimizations in Rust

The article shows how row‑major vs column‑major traversal, random access, cache‑set conflicts, false sharing, branch‑prediction failures, and loop‑carried data dependencies each degrade performance by tying Rust (and C++) code patterns to CPU cache behavior, prefetching, pipeline stalls, and vectorization limits, demonstrated through runnable benchmarks.

BenchmarkCPU cacheFalse sharing
0 likes · 15 min read
Cache, Prefetching, False Sharing, Pipeline, and Data Dependency: Benchmarks and Optimizations in Rust
JD Cloud Developers
JD Cloud Developers
Mar 26, 2024 · Cloud Native

Unlocking Efficient CI/CD: The Power of Cloud‑Native Pipeline Models

This article explains the essence of DevOps pipelines, outlines the characteristics of a high‑quality pipeline model—including clear layering, strong orchestrability, fan‑in/fan‑out support, and multi‑condition execution—illustrates real‑world analogies, and details how cloud‑native pipelines upgrade to a three‑layer stage/atom architecture with both graphical and YAML orchestration options.

CI/CDDevOpspipeline
0 likes · 11 min read
Unlocking Efficient CI/CD: The Power of Cloud‑Native Pipeline Models
JD Tech
JD Tech
Mar 22, 2024 · Cloud Native

Understanding and Upgrading Cloud Native DevOps Pipeline Models

This article explains the fundamentals of DevOps pipelines, outlines the characteristics of an excellent pipeline model such as clear layering, high orchestrability, fan‑in/fan‑out support, and flexible execution conditions, and describes how cloud‑native pipeline models are upgraded with stage and atom concepts, DAG orchestration, YAML configuration, and practical UI operations.

CI/CDDevOpsautomation
0 likes · 11 min read
Understanding and Upgrading Cloud Native DevOps Pipeline Models
Open Source Tech Hub
Open Source Tech Hub
Mar 12, 2024 · Artificial Intelligence

Step-by-Step Guide to Install ModelScope and Perform NLP Inference in Python & PHP

This guide walks you through setting up a Conda Python environment, installing PyTorch and the ModelScope library, running NLP pipelines for tasks like word segmentation and text classification, and calling ModelScope models from PHP using the PHPY extension, complete with code examples and troubleshooting tips.

AI inferenceModelScopeNLP
0 likes · 14 min read
Step-by-Step Guide to Install ModelScope and Perform NLP Inference in Python & PHP
21CTO
21CTO
Mar 4, 2024 · Backend Development

How ioredis Became the Leading Node.js Redis Client and Got Acquired

ioredis, a high‑performance Node.js Redis client created by luin, uses a single‑socket pipeline for efficient command batching, has attracted enterprise users like Alibaba, and after years of growth was officially acquired by Redis, with its source now hosted on GitHub.

BackendClientNode.js
0 likes · 4 min read
How ioredis Became the Leading Node.js Redis Client and Got Acquired
DevOps
DevOps
Feb 28, 2024 · Operations

DevOps Overview, Continuous Integration Practices, Tool Comparison, and Jenkins Pipeline Implementation

This article provides a comprehensive overview of DevOps history and principles, explains continuous integration concepts and benefits, compares popular CI tools such as Jenkins, GitLab CI/CD, Travis CI, Azure DevOps, and CircleCI, and demonstrates how to implement pipelines in Jenkins using both declarative and scripted syntax.

CI/CDJenkinscontinuous integration
0 likes · 12 min read
DevOps Overview, Continuous Integration Practices, Tool Comparison, and Jenkins Pipeline Implementation
Selected Java Interview Questions
Selected Java Interview Questions
Jan 16, 2024 · Cloud Native

Step-by-Step Jenkins Pipeline for Deploying Spring Cloud Microservices with Docker and Kubernetes

This tutorial explains how to automate the full lifecycle of a Spring Cloud microservice—from developers pushing code to Git, Jenkins pulling and building it with Maven, packaging the JAR into a Docker image, pushing the image to a private registry, and finally deploying or updating the service on a Kubernetes cluster using YAML manifests.

CI/CDJenkinsSpring Cloud
0 likes · 12 min read
Step-by-Step Jenkins Pipeline for Deploying Spring Cloud Microservices with Docker and Kubernetes
Nullbody Notes
Nullbody Notes
Jan 15, 2024 · Backend Development

Build Your Own Redis Pipeline Client in Go

This article walks through implementing a Redis pipeline client in Go, explaining how to reuse a single TCP socket for multiple requests, preserve send‑receive order, and handle sending, receiving, heartbeats, and reconnection with a concise 200‑line codebase.

ClientTCPnetwork-programming
0 likes · 9 min read
Build Your Own Redis Pipeline Client in Go
MaGe Linux Operations
MaGe Linux Operations
Dec 22, 2023 · Operations

Evolving Jenkins Pipelines for Robust Deployments and Rolling Updates

This article walks through the evolution of a Jenkins pipeline to not only build and push Docker images but also to deploy to Kubernetes with health checks for Deployments and StatefulSets, incorporating rolling update strategies and comprehensive status verification to ensure reliable CI/CD workflows.

CI/CDDevOpsJenkins
0 likes · 16 min read
Evolving Jenkins Pipelines for Robust Deployments and Rolling Updates
Bilibili Tech
Bilibili Tech
Dec 5, 2023 · Frontend Development

Jinkela Pipeline: A Front‑End DevOps Glue Tool for Simplifying Release Processes

Jinkela Pipeline is an experimental front‑end DevOps glue tool integrated into the Dejavu platform that unifies and automates release workflows—handling environment variables, mono‑repo structures, parallel GitLab jobs, and plugin extensions—to reduce manual steps, inconsistencies, and anxiety for developers while enabling low‑code pipeline composition and future ChatOps integration.

automationdeploymentfrontend
0 likes · 26 min read
Jinkela Pipeline: A Front‑End DevOps Glue Tool for Simplifying Release Processes
Efficient Ops
Efficient Ops
Dec 3, 2023 · Backend Development

Why Our Redis Cluster Pipeline Deadlocked: Thread Locks Explained

This article walks through a production incident where a Redis Cluster pipeline caused Dubbo threads to block and eventually deadlock, detailing the root‑cause analysis, code inspection, and verification steps using jstack, jmap, and MAT to confirm the deadlock and propose fixes.

JavaJedisPerformance
0 likes · 13 min read
Why Our Redis Cluster Pipeline Deadlocked: Thread Locks Explained
OPPO Kernel Craftsman
OPPO Kernel Craftsman
Dec 1, 2023 · Fundamentals

Performance Optimization: Register Access, Assembly Basics, and CPU Pipeline Techniques

The article explains how performance can be dramatically improved by keeping frequently used data in CPU registers instead of memory, understanding basic assembly syntax and instruction types, using branch‑prediction hints, and exploiting the CPU pipeline to reduce stalls and wasted cycles.

Assembly LanguageCPU registersPerformance Optimization
0 likes · 12 min read
Performance Optimization: Register Access, Assembly Basics, and CPU Pipeline Techniques
DataFunSummit
DataFunSummit
Nov 27, 2023 · Artificial Intelligence

Online Learning with Alink Model Flow: From Fundamentals to Model Flow 1.0 and 2.0

This article introduces Alibaba's Alink platform and its online learning capabilities, discusses common challenges in machine‑learning pipelines, explains Alink’s algorithm‑to‑application connection, various computation modes, usage methods, and details the evolution from Model Flow 1.0 to the more versatile Model Flow 2.0, including pipeline integration, incremental training, and embedding prediction services.

AlinkFlinkincremental training
0 likes · 9 min read
Online Learning with Alink Model Flow: From Fundamentals to Model Flow 1.0 and 2.0
MaGe Linux Operations
MaGe Linux Operations
Oct 22, 2023 · Cloud Native

Automate Kubernetes Deployments: Step‑by‑Step Jenkins Pipeline Guide

Learn how to connect Jenkins Pipeline with Kubernetes to automate building, testing, and deploying containerized applications, covering prerequisite setup, detailed pipeline stages—including code checkout, Docker image creation, testing, registry push, and Kubernetes deployment—complete with code snippets and configuration tips.

CI/CDJenkinsKubernetes
0 likes · 4 min read
Automate Kubernetes Deployments: Step‑by‑Step Jenkins Pipeline Guide
HomeTech
HomeTech
Aug 30, 2023 · Operations

Home Platform Pipeline: Definition, Evolution, and Future AI‑Driven Plans

This article explains the concept of a software delivery pipeline, traces its evolution from traditional release processes through basic CI/CD pipelines to the current quality‑efficiency pipeline, and outlines future plans to integrate large language models for intelligent orchestration, testing, and deployment.

AICI/CDDevOps
0 likes · 11 min read
Home Platform Pipeline: Definition, Evolution, and Future AI‑Driven Plans
MaGe Linux Operations
MaGe Linux Operations
Jul 7, 2023 · Operations

Top 10 CI/CD Tools for DevOps: Features, Pros, and How to Choose

This guide reviews the ten most popular CI/CD platforms—including GitLab, Azure DevOps, GitHub Actions, CircleCI, Jenkins, Travis CI, Bitbucket Pipelines, TeamCity, Semaphore, and Harness—detailing their core capabilities, unique strengths, and key considerations to help teams select the right tool for streamlined software delivery.

CI/CDContinuous Deliverycontinuous integration
0 likes · 13 min read
Top 10 CI/CD Tools for DevOps: Features, Pros, and How to Choose
DevOps Cloud Academy
DevOps Cloud Academy
Jul 1, 2023 · Operations

Using Jenkins Deploy Dashboard Plugin for Visual Deployment Management

This article introduces the Jenkins Deploy Dashboard plugin, explains how to visualize deployment status across environments, add new releases to the dashboard, create custom deployment views, and integrate deployment buttons into pipelines using both scripted and declarative Jenkins pipelines.

CI/CDDeploy DashboardDevOps
0 likes · 6 min read
Using Jenkins Deploy Dashboard Plugin for Visual Deployment Management
OPPO Kernel Craftsman
OPPO Kernel Craftsman
Apr 14, 2023 · Fundamentals

Pipeline Domain Design in Multimedia Frameworks: Concepts, Comparative Analysis, and Implementation

The article defines pipeline domain design concepts, compares major multimedia frameworks such as FFmpeg, GStreamer, MediaPipe and AVPipeline, and demonstrates a configurable, extensible node‑based architecture that enables fast plugin integration and adaptable audio‑video pipelines across diverse business scenarios and platforms.

AIframeworkgStreamer
0 likes · 39 min read
Pipeline Domain Design in Multimedia Frameworks: Concepts, Comparative Analysis, and Implementation
Java Architect Essentials
Java Architect Essentials
Apr 5, 2023 · Operations

Mastering Jenkins Pipelines: Declarative vs Scripted with Real‑World Examples

This article provides a comprehensive guide to Jenkins pipelines, explaining the difference between declarative and scripted syntax, detailing agent configurations, workspace volumes, post actions, directives, environment variables, dynamic variables, credential handling, and practical Jenkinsfile examples for CI/CD automation.

CI/CDDeclarativeDevOps
0 likes · 26 min read
Mastering Jenkins Pipelines: Declarative vs Scripted with Real‑World Examples
JD Tech
JD Tech
Apr 5, 2023 · Frontend Development

Applying DevOps Practices to Frontend Development: A Comprehensive Guide

This article presents a detailed guide on implementing DevOps principles in frontend development, covering background challenges, pipeline architecture, workflow design, tool integration, and step‑by‑step practices to improve delivery efficiency, code quality, and team collaboration.

continuous integrationfrontendpipeline
0 likes · 14 min read
Applying DevOps Practices to Frontend Development: A Comprehensive Guide
DevOps Cloud Academy
DevOps Cloud Academy
Mar 23, 2023 · Operations

Using Git Parameters for Dynamic Branch Builds in Jenkins

This tutorial explains why and how to use Git parameters in Jenkins freestyle and pipeline jobs to enable dynamic branch selection, covering configuration steps, example Jenkinsfiles, and best practices for managing branch builds in DevOps environments.

CI/CDDevOpsDynamic Branch
0 likes · 8 min read
Using Git Parameters for Dynamic Branch Builds in Jenkins
DevOps
DevOps
Mar 16, 2023 · Operations

Building a Jenkins-Based CI Pipeline: Architecture, Configuration, and Deployment

This article explains how to build a Jenkins-based continuous integration pipeline, covering Jenkins fundamentals, pipeline architecture, Groovy DSL components, task conversion, API interactions, deployment strategies, and performance considerations for reliable CI/CD operations.

CI/CDJenkinscontinuous integration
0 likes · 7 min read
Building a Jenkins-Based CI Pipeline: Architecture, Configuration, and Deployment
Selected Java Interview Questions
Selected Java Interview Questions
Mar 1, 2023 · Databases

Redis Interview Questions and Core Concepts Explained

This article provides a comprehensive overview of Redis, covering why it is used as a cache, its single‑threaded efficiency, multithreading in version 6.0, common data structures and their use cases, pipeline advantages, persistence mechanisms, transactions, Bloom filter for massive URL checks, internal data organization, and incremental rehashing.

Bloom FilterCachingData Structures
0 likes · 16 min read
Redis Interview Questions and Core Concepts Explained
Programmer DD
Programmer DD
Feb 8, 2023 · Cloud Native

How Cloud‑Native Pipelines Cut Build Time 3‑5× with Remote Cache

This article explains how introducing a remote cache backed by CFS and Zstandard compression into cloud‑native CI/CD pipelines dramatically reduces build times by 3‑5 times, outlines the implementation steps, tool choices, cache key strategy, eviction policy, and showcases performance gains across Java, Node.js, Go, and GCC builds.

CFSCI/CDCaching
0 likes · 10 min read
How Cloud‑Native Pipelines Cut Build Time 3‑5× with Remote Cache
DevOps
DevOps
Jan 17, 2023 · Operations

Building a DevOps CI/CD Pipeline: A Five‑Step Guide

This article walks beginners through the fundamentals of DevOps by outlining a practical five‑step process for creating a CI/CD pipeline, covering tools for continuous integration, source control, build automation, web server deployment, test coverage, and optional extensions such as containers and middleware automation.

CI/CDGitJenkins
0 likes · 15 min read
Building a DevOps CI/CD Pipeline: A Five‑Step Guide
58UXD
58UXD
Jan 9, 2023 · Artificial Intelligence

How to Transform VR Scenes into Visually Stunning Experiences in Four Simple Steps

This article outlines a four‑step workflow to improve VR scene quality—covering hardware upgrades, optimized shooting setups, advanced image preprocessing, and custom color‑filter styling—demonstrating how systematic enhancements and blind testing can produce visually appealing, high‑quality VR experiences.

VRimage processingmachine learning
0 likes · 6 min read
How to Transform VR Scenes into Visually Stunning Experiences in Four Simple Steps
Efficient Ops
Efficient Ops
Dec 29, 2022 · Operations

How China Postal Savings Bank Boosted Efficiency with DevOps Standards

China Postal Savings Bank’s DevOps R&D Collaboration Platform and the Xingchen Platform’s Golden Bull Automated Testing System achieved top‑level evaluations in pipeline, CI/CD, and interface testing, showcasing how standardized tools and continuous delivery pipelines can dramatically improve quality, efficiency, and competitiveness in large enterprises.

Continuous DeliveryDevOpsEnterprise IT
0 likes · 14 min read
How China Postal Savings Bank Boosted Efficiency with DevOps Standards
Tencent Cloud Developer
Tencent Cloud Developer
Dec 5, 2022 · Fundamentals

Chromium Rendering Pipeline Overview

The article details Chromium’s rendering pipeline, tracing how network bytecode becomes on‑screen pixels through 13 stages—from parsing and style calculation to layout, painting, compositing, tiling, rasterization, activation, aggregation, and final display—while explaining process models, component formulas, and synchronous versus asynchronous raster strategies.

ChromiumEnginePerformance
0 likes · 31 min read
Chromium Rendering Pipeline Overview
Alibaba Cloud Developer
Alibaba Cloud Developer
Nov 22, 2022 · Fundamentals

Unveiling Java 8 Lambda: Inside the Stream Pipeline Mechanics

This article delves into the internal design and execution of Java 8 lambda expressions, dissecting the Stream API pipeline—from source creation through intermediate operations like map and filter to terminal actions such as collect and sum—while illustrating each step with concrete code examples.

CodeExampleJavaStream
0 likes · 14 min read
Unveiling Java 8 Lambda: Inside the Stream Pipeline Mechanics
StarRocks
StarRocks
Oct 20, 2022 · Databases

Inside StarRocks Pipeline Engine: How BE Splits and Schedules Queries

This article explains the core concepts, architecture, and source‑code details of StarRocks’ Pipeline execution framework, covering BE initialization, query lifecycle management, operator splitting, PipelineBuilder processing, and the scheduling logic of PipelineDriver, with concrete code examples and diagrams to illustrate each step.

Database EngineStarRockspipeline
0 likes · 21 min read
Inside StarRocks Pipeline Engine: How BE Splits and Schedules Queries
DaTaobao Tech
DaTaobao Tech
Oct 14, 2022 · Backend Development

Annotation‑Driven Responsibility Chain Framework (auto‑pipeline) Overview

The annotation‑driven auto‑pipeline framework generates a linked‑list responsibility chain from @AutoPipeline‑annotated interfaces, automatically wiring handler implementations to execute sequentially and return the first non‑null result, thereby boosting development efficiency, reusability, and correctness for complex business pipelines such as configuration sources and message throttling.

Annotation ProcessingJavacode generation
0 likes · 14 min read
Annotation‑Driven Responsibility Chain Framework (auto‑pipeline) Overview
StarRocks
StarRocks
Oct 13, 2022 · Databases

Inside StarRocks: How the Pipeline Execution Engine Boosts Query Performance

This article explains the core concepts, architecture, and code logic of StarRocks' Pipeline execution framework, covering ExecPlan, PlanFragment, Fragment Instance, ExecNode, SourceOperator, SinkOperator, PipelineDriver scheduling, asynchronous handling of blocking operations, and the roles of FE and BE in MPP scheduling.

Execution EngineMPPStarRocks
0 likes · 13 min read
Inside StarRocks: How the Pipeline Execution Engine Boosts Query Performance
Programmer DD
Programmer DD
Oct 8, 2022 · Fundamentals

Eight Timeless Computer Architecture Principles Every Designer Should Know

This article outlines eight enduring ideas—from designing for Moore's Law and using abstraction to speeding up common cases, leveraging parallelism, pipelining, prediction, memory hierarchy, and redundancy—that have shaped computer architecture over the past six decades.

CachingMoore's LawParallelism
0 likes · 11 min read
Eight Timeless Computer Architecture Principles Every Designer Should Know
21CTO
21CTO
Aug 22, 2022 · Operations

How Meituan Scaled Its Pipeline Engine to Power 100k Daily Jobs

This article explains how Meituan built a unified, highly available pipeline engine that supports nearly 100,000 daily executions across dozens of services with 99.99% success, detailing the challenges faced, the architectural decisions made, and the future roadmap for further scalability and cloud‑native improvements.

CI/CDMeituandistributed scheduling
0 likes · 24 min read
How Meituan Scaled Its Pipeline Engine to Power 100k Daily Jobs
ITPUB
ITPUB
Aug 20, 2022 · Operations

How Meituan Scaled Its CI/CD Pipeline Engine to 100k Daily Jobs with 99.99% Success

This article details Meituan's three‑year journey building a self‑developed pipeline engine that now handles nearly 100,000 daily executions with over 99.99% reliability, covering background, challenges, architectural decisions, core scheduling and resource‑pool designs, component layering, and future cloud‑native plans.

CI/CDJob Schedulingoperations
0 likes · 25 min read
How Meituan Scaled Its CI/CD Pipeline Engine to 100k Daily Jobs with 99.99% Success
DevOps Cloud Academy
DevOps Cloud Academy
Aug 14, 2022 · Cloud Native

Installing and Using Tektoncd Operator on Kubernetes

This guide explains how to install the Tektoncd Operator on a Kubernetes cluster, configure its CRDs, choose installation methods, customize component images, apply predefined profiles, and run a simple hello‑goodbye pipeline using Tekton tasks and PipelineRun objects.

CI/CDKubernetesOperator
0 likes · 10 min read
Installing and Using Tektoncd Operator on Kubernetes
dbaplus Community
dbaplus Community
Aug 8, 2022 · Operations

How Meituan Scaled Its CI/CD Pipeline to 100K Daily Runs with 99.99% Success

This article details Meituan's three‑year journey building a self‑developed, distributed pipeline engine that now handles nearly 100,000 daily executions across dozens of services with over 99.99% reliability, covering the challenges faced, architectural decisions, scheduling and resource‑pool designs, and future cloud‑native plans.

CI/CDMeituanpipeline
0 likes · 28 min read
How Meituan Scaled Its CI/CD Pipeline to 100K Daily Runs with 99.99% Success
DataFunTalk
DataFunTalk
Jul 29, 2022 · Artificial Intelligence

Tencent Music Cloud‑Native One‑Stop Machine Learning Platform: Features and Future Roadmap

This article introduces Tencent Music's cloud‑native, one‑stop machine learning platform, detailing its engineering workflow, distributed acceleration, inference closed‑loop, edge computing capabilities, and future plans, while highlighting challenges of traditional ML pipelines and the platform's solutions for resource orchestration, storage, scheduling, and GPU utilization.

AI platformDistributed Trainingcloud-native
0 likes · 17 min read
Tencent Music Cloud‑Native One‑Stop Machine Learning Platform: Features and Future Roadmap
DevOps Cloud Academy
DevOps Cloud Academy
Jul 28, 2022 · Cloud Native

How to Create Static and Dynamic Jenkins Agents on Kubernetes

This guide explains how to manually create Jenkins JNLP agents on a Kubernetes cluster, covering both static Deployment‑based agents and dynamic agents using the Kubernetes plugin, with detailed YAML definitions, pipeline scripts, and supporting helper functions for a complete CI/CD workflow.

AgentCI/CDDevOps
0 likes · 10 min read
How to Create Static and Dynamic Jenkins Agents on Kubernetes
Python Programming Learning Circle
Python Programming Learning Circle
Jul 13, 2022 · Backend Development

Comprehensive Scrapy Tutorial: Architecture, XPath Basics, Installation, Project Setup, and Advanced Features

This article provides a detailed walkthrough of Scrapy, covering its event‑driven architecture, component interactions, XPath parsing fundamentals, installation steps, project creation, sample spider code, item pipelines, middleware customization, and essential configuration settings for effective web crawling in Python.

SpiderWeb CrawlingXPath
0 likes · 12 min read
Comprehensive Scrapy Tutorial: Architecture, XPath Basics, Installation, Project Setup, and Advanced Features
Baidu Geek Talk
Baidu Geek Talk
Jul 11, 2022 · Operations

Technical Overview of Baijiahao Video Rendering and Composition Using After Effects

Baijiahao’s text‑to‑video pipeline now relies on After Effects for rendering and composition, using standardized templates, JavaScript‑based AE scripts, and aerender command‑line features such as reuse, multi‑frame and network rendering to achieve rich visual effects with lower R&D cost, though browser preview and cross‑platform deployment remain limited.

After EffectsOpenGLpipeline
0 likes · 18 min read
Technical Overview of Baijiahao Video Rendering and Composition Using After Effects
DevOps
DevOps
Jun 30, 2022 · Information Security

2022 DevSecOps Pipeline, Framework, and Best Practices

This article provides a comprehensive overview of DevSecOps, explaining its definition, pipeline stages, detailed framework, and the top five best practices for 2022 to help organizations integrate security throughout the software development lifecycle.

DevSecOpspipeline
0 likes · 13 min read
2022 DevSecOps Pipeline, Framework, and Best Practices
Tencent Cloud Developer
Tencent Cloud Developer
Jun 29, 2022 · Fundamentals

C++ Asynchronous Programming: Understanding libunifex and Sender/Receiver Model

This article thoroughly explains libunifex’s sender/receiver model for C++ asynchronous programming, covering its design goals, module structure, pipeline composition, key functions like schedule, then, sync_wait, and the connect/start mechanisms, while demonstrating practical examples and integration with C++20 coroutines and cancellation support.

Asynchronous ProgrammingC++Coroutines
0 likes · 16 min read
C++ Asynchronous Programming: Understanding libunifex and Sender/Receiver Model
DaTaobao Tech
DaTaobao Tech
Jun 21, 2022 · Mobile Development

Performance Optimization of Alibaba's DX Native Dynamic Framework

Over the past two years Alibaba’s DX native dynamic framework has been re‑engineered by moving virtual‑node parsing, layout and drawing to background threads, adding an asynchronous drawing system, a unified rich‑text component, and off‑screen resource management, boosting low‑end device frame rates from ~30 FPS to over 55 FPS and cutting media‑CPU usage by 65 % while paving the way for richer interactive UI features.

DXOptimizationPerformance
0 likes · 18 min read
Performance Optimization of Alibaba's DX Native Dynamic Framework
DevOps Cloud Academy
DevOps Cloud Academy
Jun 12, 2022 · Operations

How to Retrieve Project Branches in Jenkins Pipelines

This tutorial explains how to use Jenkins, the Git Parameter plugin, and parameterized builds to fetch and display Git branch information within a pipeline, including installation steps, configuration details, and common troubleshooting tips.

CI/CDGitJenkins
0 likes · 4 min read
How to Retrieve Project Branches in Jenkins Pipelines
DevOps Cloud Academy
DevOps Cloud Academy
Jun 6, 2022 · Operations

Using Jenkins Deploy Dashboard Plugin for Visual Deployment Management

This article introduces the Deploy Dashboard plugin for Jenkins, explains how to visualize deployment status across environments, shows step‑by‑step instructions for adding versions, creating the dashboard view, adding deployment buttons, and provides pipeline code examples for seamless CI/CD integration.

CI/CDDeploy DashboardDevOps
0 likes · 5 min read
Using Jenkins Deploy Dashboard Plugin for Visual Deployment Management
Bin's Tech Cabin
Bin's Tech Cabin
May 16, 2022 · Backend Development

Deep Dive into Netty’s Pipeline: How ChannelHandlers Work Internally

This article provides a comprehensive, step‑by‑step explanation of Netty’s pipeline architecture, detailing how ChannelHandlerContext wraps handlers, how inbound and outbound events are classified and propagated, and how handlers are added, removed, and initialized within the pipeline.

BackendChannelHandlerJava
0 likes · 70 min read
Deep Dive into Netty’s Pipeline: How ChannelHandlers Work Internally
DaTaobao Tech
DaTaobao Tech
Mar 28, 2022 · Backend Development

Designing an Extensible Content Delivery Pipeline for E‑commerce

The article presents a modular, extensible content‑delivery pipeline for e‑commerce—comprising datasource, transfer, filter, sorter, completer, validator, factory and iterator nodes—implemented in Java, with JSON‑driven filter schemas, to simplify complex, low‑latency content handling, improve flexibility, and ease operations across evolving business requirements.

Content Deliveryarchitecturee-commerce
0 likes · 11 min read
Designing an Extensible Content Delivery Pipeline for E‑commerce
DevOps Cloud Academy
DevOps Cloud Academy
Mar 18, 2022 · Operations

Comprehensive CI/CD Pipeline Templates for Java Projects with Build, Test, Code Analysis, Artifact Management, and Kubernetes Deployment

This article provides a detailed guide to structuring GitLab CI/CD pipelines for Java projects, covering job templates for building, testing, code analysis, artifact handling, and Kubernetes deployment, along with variable definitions, workflow rules, and stage configurations to enable flexible and automated DevOps workflows.

CI/CDDevOpsGitLab
0 likes · 14 min read
Comprehensive CI/CD Pipeline Templates for Java Projects with Build, Test, Code Analysis, Artifact Management, and Kubernetes Deployment
ELab Team
ELab Team
Mar 14, 2022 · Operations

Master GitLab CI/CD: Build, Test, Deploy Pipelines Efficiently

This guide explains the fundamentals of CI/CD, the benefits of automation, and provides a step‑by‑step tutorial on configuring GitLab CI/CD pipelines, including .gitlab-ci.yml syntax, job and stage definitions, runner installation, manual approvals, and scheduled executions using cron syntax.

Continuous DeliveryDevOpsGitLab CI/CD
0 likes · 14 min read
Master GitLab CI/CD: Build, Test, Deploy Pipelines Efficiently
Sohu Tech Products
Sohu Tech Products
Mar 9, 2022 · Mobile Development

How GPUImage2’s Pipeline Works: Inside the Swift Image‑Processing Engine

This article provides a detailed technical analysis of GPUImage2’s pipeline architecture, explaining the core concepts, operator overloads, internal relationships such as TargetContainer and SourceContainer, framebuffer management, OpenGL ES integration, and thread‑dispatch mechanisms, all illustrated with Swift code examples and diagrams.

FramebufferGPUImage2ImageProcessing
0 likes · 24 min read
How GPUImage2’s Pipeline Works: Inside the Swift Image‑Processing Engine
Top Architect
Top Architect
Feb 24, 2022 · Artificial Intelligence

Evolution of the DaJia Recommendation System Architecture: From V1.0 to V3.0

The article details how DaJia's recommendation system progressed through three architectural versions—V1.0's simple strategy‑factory design, V2.0's vertical business split and configurable pipeline, and V3.0's dynamic configuration service and modular pipeline—addressing scalability, fault isolation, and personalization challenges while outlining future directions for explainable AI recommendations.

AIBackendconfiguration service
0 likes · 14 min read
Evolution of the DaJia Recommendation System Architecture: From V1.0 to V3.0
IT Services Circle
IT Services Circle
Feb 22, 2022 · Fundamentals

Why Sorting an Array Speeds Up Summation: CPU Pipeline, Hazards, and Branch Prediction Explained

The article examines a puzzling StackOverflow case where sorting a random array before summation yields a six‑fold speedup, explains the phenomenon through CPU five‑stage pipeline fundamentals, structural, data, and control hazards, and shows how branch prediction and operand forwarding mitigate the performance loss.

CPUbranch predictioncomputer architecture
0 likes · 16 min read
Why Sorting an Array Speeds Up Summation: CPU Pipeline, Hazards, and Branch Prediction Explained
QQ Music Frontend Team
QQ Music Frontend Team
Feb 15, 2022 · Databases

Mastering Redis: From Fundamentals to Advanced Features and Real‑World Use Cases

This comprehensive guide walks you through Redis basics, its data structures, commands, installation steps, high‑concurrency principles, persistence mechanisms, replication, caching strategies, Lua scripting, pipelines, distributed locks, and cluster concepts, providing practical examples and best‑practice recommendations for developers and operators.

Data StructuresLuaPersistence
0 likes · 70 min read
Mastering Redis: From Fundamentals to Advanced Features and Real‑World Use Cases
IT Architects Alliance
IT Architects Alliance
Feb 15, 2022 · Artificial Intelligence

How a Scalable Recommendation Engine Evolved: From V1.0 to V3.0

This article details the evolution of an e‑commerce recommendation system through three architectural versions, highlighting the initial simple design, the challenges that prompted vertical and horizontal splits, the introduction of a configurable pipeline and AB testing, and the final micro‑service‑based, dynamically configurable V3.0 architecture.

AIarchitecturebig data
0 likes · 14 min read
How a Scalable Recommendation Engine Evolved: From V1.0 to V3.0