One‑Line Python Web Scraping and Media Download with Scrapeasy

If you are looking for a powerful Python web‑scraping tool, Scrapeasy lets you start and run with just one line of code.

Scrapeasy is a Python library that easily crawls web pages and extracts data, supporting single‑page or multi‑page scraping, as well as extracting data from PDF and HTML tables.

With Scrapeasy you can fetch an entire website using a single line, specifying the target site and the type of data you want, while the library handles the rest.

Key features include:

One‑click site crawling – not limited to a single page.

Common scraping tasks (fetching links, images, or videos) are built‑in.

Support for special file types such as .php or .pdf.

How to use Scrapeasy

Install via pip

<code>$ pip install scrapeasy</code>

Import and initialize a website

<code>from scrapeasy import Website, Page</code>

<code>web = Website("https://tikocash.com/solange/index.php/2022/04/13/how-do-you-control-irrational-fear-and-overthinking/")</code>

Get all sub‑page links

<code>links = web.getSubpagesLinks()</code>

Note: depending on your connection and the target server, this request may take some time.

Find media

To retrieve all image links from a site, call the .getImages() method:

<code>images = web.getImages()</code>

Download media

Download all images from tikocash.com to a local folder:

<code>web.download("img", "fahrschule/images")</code>

Get links

Retrieve domain links only:

<code>domains = web.getLinks(intern=False, extern=False, domain=True)</code>

To get external links (excluding domain links):

<code>domains = web.getLinks(intern=False, extern=True, domain=False)</code>

Initialize a page

<code>w3 = Page("https://www.w3schools.com/html/html5_video.asp")</code>

Download video

<code>w3.download("video", "w3/videos")</code>

Or retrieve video links first:

<code>video_links = w3.getVideos()</code>

Download other file types (e.g., PDF)

<code>calendar_links = Page("https://tikocash.com").get("php")</code>

<code>Page("http://mathcourses.ch/mat182.html").download("pdf", "mathcourses/pdf-files")</code>

In summary, Python is a versatile language that can scrape any website with just one line of code, making it a powerful tool for web scraping and data mining.

If you found this tutorial useful, please like, follow, and share it with friends who want to learn Python web scraping.