Back to the chart

D4Vinci/Scrapling

Python web scraping and crawling framework

Chart
Not on a chart right now
Stars
104.3k

Open on GitHubHomepage

What it is

Scrapling is a Python web scraping framework that combines fast HTTP requests, stealth browsers, element parsing, and concurrent crawling in one library. It handles everything from single-page extraction to full-scale spiders with proxy rotation and pause/resume.

Who it is for

It is built for Python developers collecting data from dynamic or anti-bot protected websites, as well as teams connecting AI agents to web scraping workflows.

Why it is trending

The repository gained 15,971 stars today, reaching 103,812 total stars following its v0.5.1 release on November 4, 2026. It stands out by unifying HTTP fetching, stealth browser automation, Scrapy-style spiders, and an MCP server in a single package.

Main features

  • HTTP requests with TLS fingerprint impersonation and stealth browsers for Cloudflare Turnstile handling
  • CSS, XPath, and regex selection with adaptive element tracking across site changes
  • Concurrent spiders with pause/resume, AutoThrottle, proxy rotation, and JSON/JSONL/CSV/XML exports
  • Built-in MCP server, Agent Skill, CLI, and clean Markdown output for AI workflows

Summarized on November 17, 2026 from the README and repository data. It can be wrong; check the source before relying on it. Report a wrong summary