Back to repositories
d4vinciScrapling

Scrapling: open source worth watching

An adaptive Python web-scraping framework covering single requests through large-scale concurrent crawling.

Why we are featuring it

Scraping that tries to survive changing websites.

Scrapling combines HTTP requests, dynamic browsers, and concurrent crawlers in one framework. Adaptive element handling reduces maintenance when a site’s markup evolves.

What is inside

  • Automatically relocates elements after structural changes.
  • HTTP fetchers, dynamic browsers, sessions, and proxy rotation.
  • Concurrent spiders with pause, resume, and streaming.
  • CLI, interactive shell, Docker, and an MCP server.
Scrapling | Trending Repo | DevOP