Tagged articles
User-Agent
10 articles · Page 1 of 1
This article walks through using the Yauaa library in Spring Boot 3.5.0 to extract detailed client‑side information—device class, operating system, and browser—from the User‑Agent header, covering basic bean setup, advanced cache configuration, field selection, and device‑based routing examples.
Device DetectionJavaSpring Boot
0 likes · 8 min read

This guide explains why random User-Agent headers improve API automation testing, introduces the Python fake_useragent library, shows how to install it, and provides comprehensive example code for generating, validating, and persisting random User-Agent strings.
Automation TestingHTTPPython
0 likes · 5 min read


21CTOFeb 18, 2022 · Frontend Development
The article reports that WeChat’s departments are testing a 10‑am to 6‑pm workweek, Mozilla is seeking new revenue after its browser market share fell, and both Chrome and Firefox are preparing to release version 100, prompting developers to update User‑Agent parsing.
Frontend DevelopmentMozillaUser-Agent
0 likes · 5 min read

This article explains how to overcome common anti‑scraping defenses such as identity verification and IP rate limiting by spoofing the User‑Agent header and adding request delays, providing complete Python code examples using requests and BeautifulSoup to scrape Douban's Top 250 movies.
BeautifulSoupIP throttlingUser-Agent
0 likes · 6 min read

The article outlines several anti‑crawling techniques—including IP restrictions, User‑Agent validation, CAPTCHAs, AJAX loading, noscript tags, and cookie checks—while also offering practical advice for writing ethical, efficient, and robust web crawlers.
CAPTCHAIP blockingScraping
0 likes · 6 min read

The article analyzes a bypass flaw in Nacos 1.4.1 where the serverIdentity key‑value authentication can be evaded by crafting URLs with a trailing slash, allowing attackers to list, create, and log in as users despite the intended security checks.
NacosServer IdentityUser-Agent
0 likes · 8 min read

This guide explains the essential HTTP request header fields—Accept, Accept‑Encoding, Accept‑Language, User‑Agent, Connection, and Host—detailing their meanings, typical values, and how to use them to disguise a Python crawler and reliably fetch web pages.
HTTPPythonUser-Agent
0 likes · 6 min read

This guide explains practical techniques such as faking User‑Agent headers, rotating cookies, adding random delays, and using proxy pools to prevent IP bans while crawling large amounts of data from websites with anti‑scraping defenses.
User-Agentanti-scrapingcookies
0 likes · 4 min read

This article explains how User Agent strings reveal operating system, CPU, browser and mobile device details, discusses the challenges of parsing mobile UA strings, introduces Baidu's open‑source ua-device library for accurate detection, and provides testing links for developers.
Browser DetectionUser-Agentmobile
0 likes · 4 min read

UAParser.js is a lightweight, dependency‑free JavaScript library that parses the User‑Agent string to provide detailed browser, engine, OS, CPU, and device information, with examples for both browser and Node.js environments, and outlines its main methods and installation steps.
Browser DetectionJavaScriptNode.js
0 likes · 4 min read
