Tagged articles
8 articles
Page 1 of 1
IT Services Circle
IT Services Circle
Jul 5, 2022 · Backend Development

Optimizing feapder Spider with Gevent: Reducing CPU Usage and Thread Count

This article demonstrates how adding two gevent monkey‑patch lines to a feapder spider reduces CPU usage from 121% to 99% while changing the effective thread count from 36 to 12, and discusses the underlying principle, performance trade‑offs, and future directions for coroutine support.

CPU optimizationPythonWeb Crawling
0 likes · 6 min read
Optimizing feapder Spider with Gevent: Reducing CPU Usage and Thread Count
Python Programming Learning Circle
Python Programming Learning Circle
Dec 15, 2021 · Fundamentals

Understanding Iteration, Iterables, Iterators, Generators, Coroutines, Greenlet and Gevent in Python

This tutorial explains Python's iteration concepts, how to identify and create iterable objects, implement custom iterables and iterators, use the iter() and next() functions, build generators with yield, control execution with coroutines, and leverage greenlet and gevent for cooperative multitasking.

Iteratorcoroutinegenerator
0 likes · 22 min read
Understanding Iteration, Iterables, Iterators, Generators, Coroutines, Greenlet and Gevent in Python
NetEase Game Operations Platform
NetEase Game Operations Platform
Aug 8, 2020 · Backend Development

Debugging “Instance XXX is not bound to a Session” Errors in Gevent‑Enabled Flask APIs with SQLAlchemy

This article analyzes the intermittent “Instance XXX is not bound to a Session” error that occurs after converting a Flask‑SQLAlchemy endpoint from serial to multithreaded/gevent concurrency, reproduces the issue with test code, explains the root cause in session handling, and provides a concrete fix by patching gevent before session initialization.

BackendFlaskPython
0 likes · 6 min read
Debugging “Instance XXX is not bound to a Session” Errors in Gevent‑Enabled Flask APIs with SQLAlchemy
ITPUB
ITPUB
May 6, 2016 · Backend Development

Scrapy vs. Gevent: Choosing the Right Python Web‑Crawling Framework

This guide compares Scrapy (especially version 0.16) with gevent‑based crawling solutions, outlines their strengths, weaknesses, and common pitfalls, and provides practical tips, resource links, and deployment advice for building efficient Python web scrapers.

BackendPythonScraping
0 likes · 11 min read
Scrapy vs. Gevent: Choosing the Right Python Web‑Crawling Framework
360 Quality & Efficiency
360 Quality & Efficiency
Apr 29, 2016 · Operations

Optimizing Locust HTTP Requests with PycURL: Experiments and Findings

This article investigates the feasibility of improving Locust's HTTP request performance by replacing urllib3 with PycURL, explores protocol extensions, examines the impact of gevent's monkey patching, and concludes that the substitution does not yield significant gains despite a modest single‑user speedup.

HTTPgeventperformance-testing
0 likes · 4 min read
Optimizing Locust HTTP Requests with PycURL: Experiments and Findings