Python Crawling & Data Mining
Python Crawling & Data Mining
Apr 11, 2025 · Fundamentals

How to Remove Adjacent Duplicates from a Python List – 5 Simple Methods

This article walks through a common Python data‑processing challenge—removing consecutive duplicate elements from a list—by presenting five distinct solutions, including itertools.groupby, list comprehensions, explicit loops, generator functions, and enumerate, each illustrated with code snippets and output screenshots.

Pythongeneratoritertools
0 likes · 5 min read
How to Remove Adjacent Duplicates from a Python List – 5 Simple Methods
MaGe Linux Operations
MaGe Linux Operations
Jul 29, 2017 · Backend Development

Build a Fast Python Web Scraper for Novel Rankings – Step by Step

This guide walks through building a Python web crawler to extract novel titles and URLs from the qu.la ranking page, explains the site’s clear HTML structure, shows how to deduplicate entries with a set, and provides complete code snippets plus performance tips and a Scrapy upgrade path.

CrawlerPythonScrapy
0 likes · 5 min read
Build a Fast Python Web Scraper for Novel Rankings – Step by Step