BestHub
Sign in
Tagged articles
12 articles
Page 1 of 1
Ops Community
Ops Community
Apr 29, 2026 · Operations

Production-Ready Nginx Rate Limiting: Stop Crawlers, Block Malicious Requests, Protect APIs

This guide explains how to use Nginx's built‑in limit_req and limit_conn modules to implement production‑grade rate limiting, covering leaky‑bucket theory, IP and API‑key based limits, burst and nodelay handling, whitelist bypass, custom error responses, dry‑run testing, memory sizing, and the inherent limitations that may require Redis‑Lua or OpenResty extensions.

API protectionNGINXanti‑crawler
0 likes · 21 min read
Production-Ready Nginx Rate Limiting: Stop Crawlers, Block Malicious Requests, Protect APIs
Python Programming Learning Circle
Python Programming Learning Circle
Oct 18, 2025 · Information Security

Master Nginx Rate Limiting & Anti‑Crawler: Complete Guide with Token Bucket, GeoIP, Lua & JS Challenges

This comprehensive guide explains why modern web services need rate limiting and anti‑crawler protection, compares token‑bucket and leaky‑bucket algorithms, and provides step‑by‑step Nginx configurations for IP, URI, and geographic throttling, advanced user‑agent filtering, JavaScript challenges, real‑time monitoring, performance tuning, and troubleshooting.

NGINXSecurityanti‑crawler
0 likes · 18 min read
Master Nginx Rate Limiting & Anti‑Crawler: Complete Guide with Token Bucket, GeoIP, Lua & JS Challenges
MaGe Linux Operations
MaGe Linux Operations
Sep 9, 2025 · Operations

Master Nginx Rate Limiting & Anti‑Crawler Techniques: A Complete Ops Engineer Guide

This guide walks operations engineers through the principles and practical configurations of Nginx rate limiting and anti‑crawler protection, covering token‑bucket and leaky‑bucket algorithms, IP and URI based limits, geo‑based controls, advanced User‑Agent filtering, JavaScript challenges, monitoring, performance tuning, and troubleshooting.

DevOpsOperationsanti‑crawler
0 likes · 19 min read
Master Nginx Rate Limiting & Anti‑Crawler Techniques: A Complete Ops Engineer Guide
Bilibili Tech
Bilibili Tech
Apr 25, 2025 · Information Security

How Bilibili Comics Leverages 3D Tracing, Anti‑Crawler, and Encrypted Channels to Fight Piracy

Bilibili Comics deploys a three‑layer protection system—stereoscopic tracing, crawler defense, and encrypted channels—that dramatically reduces illegal distribution, boosts creator engagement, and creates a healthier comic ecosystem through real‑time monitoring, automated takedowns, and secure CDN delivery.

BilibiliDigital Rights Managementanti‑crawler
0 likes · 6 min read
How Bilibili Comics Leverages 3D Tracing, Anti‑Crawler, and Encrypted Channels to Fight Piracy
php Courses
php Courses
May 30, 2023 · Information Security

PHP Anti‑Crawler Login Security: Captcha, Encryption, and Dynamic Token Mechanisms

This article explains three PHP‑based techniques—captcha verification, encrypted parameter transmission, and dynamic token validation—to protect web login pages from automated crawling and credential‑stealing attacks, while also noting their limitations and implementation details.

Captchaanti‑crawlerdynamic token
0 likes · 6 min read
PHP Anti‑Crawler Login Security: Captcha, Encryption, and Dynamic Token Mechanisms
转转QA
转转QA
Apr 1, 2022 · Information Security

Design and Implementation of the Cleaner Anti‑Crawler System for Real‑Time Bot Detection

This article presents a comprehensive design of the Cleaner anti‑crawler system, detailing its background, current challenges, related research, system architecture—including a Flink‑based data processing center, a strategy‑driven ban center, and a lightweight ban store—and evaluates its effectiveness in real‑time bot mitigation.

Backend Securityanti‑crawlerrate limiting
0 likes · 17 min read
Design and Implementation of the Cleaner Anti‑Crawler System for Real‑Time Bot Detection
Zhuanzhuan Tech
Zhuanzhuan Tech
Mar 23, 2022 · Information Security

Design and Implementation of the Cleaner Anti‑Crawler System for Real‑Time Threat Mitigation

The article presents a comprehensive design of the Cleaner anti‑crawler system, detailing its background, current challenges, related research, system architecture—including data processing, ban center, and ban store modules built on Flink, MQ, and Redis—implementation details, effectiveness evaluation, and concluding insights on achieving real‑time accuracy in protecting platform data.

BackendReal-TimeSecurity
0 likes · 17 min read
Design and Implementation of the Cleaner Anti‑Crawler System for Real‑Time Threat Mitigation
Programmer DD
Programmer DD
Jun 26, 2021 · Backend Development

Implementing a Spring Boot Anti‑Crawler Filter with kk‑anti‑reptile

This article explains how to integrate the kk‑anti‑reptile anti‑crawler component into a Spring Boot application, covering system requirements, filter workflow, rule configuration, Maven setup, Redis and Apollo settings, as well as front‑end handling of the 509 response and captcha verification.

Captchaanti‑crawleraxios
0 likes · 7 min read
Implementing a Spring Boot Anti‑Crawler Filter with kk‑anti‑reptile
Top Architect
Top Architect
Jul 8, 2020 · Information Security

kk-anti-reptile: Spring Boot Anti‑Crawler Component and Integration Guide

The article introduces kk-anti-reptile, a Spring Boot‑based anti‑crawler component that uses servlet filters, Redis, and configurable rule chains (IP and User‑Agent), explains its workflow, shows Maven and property configurations, and provides front‑end Axios interception code for handling 509 responses.

Backend DevelopmentSpring Bootanti‑crawler
0 likes · 6 min read
kk-anti-reptile: Spring Boot Anti‑Crawler Component and Integration Guide
Programmer DD
Programmer DD
Jul 8, 2020 · Backend Development

Integrating kk-anti-reptile Anti‑Crawler into Spring‑Boot Applications

This guide explains how the kk-anti-reptile component protects Spring‑Boot distributed systems from crawlers by using a servlet filter, configurable IP and User‑Agent rules, captcha challenges, Maven integration, and required Redis and Apollo settings, with full code examples.

Captchaanti‑crawlerfilter
0 likes · 9 min read
Integrating kk-anti-reptile Anti‑Crawler into Spring‑Boot Applications