D4Vinci/Scrapling
Python web scraping and crawling framework
- Chart
- Not on a chart right now
- Stars
- 104.3k
What it is
Scrapling is a Python web scraping framework that combines fast HTTP requests, stealth browsers, element parsing, and concurrent crawling in one library. It handles everything from single-page extraction to full-scale spiders with proxy rotation and pause/resume.
Who it is for
It is built for Python developers collecting data from dynamic or anti-bot protected websites, as well as teams connecting AI agents to web scraping workflows.
Why it is trending
The repository gained 15,971 stars today, reaching 103,812 total stars following its v0.5.1 release on November 4, 2026. It stands out by unifying HTTP fetching, stealth browser automation, Scrapy-style spiders, and an MCP server in a single package.
Main features
- HTTP requests with TLS fingerprint impersonation and stealth browsers for Cloudflare Turnstile handling
- CSS, XPath, and regex selection with adaptive element tracking across site changes
- Concurrent spiders with pause/resume, AutoThrottle, proxy rotation, and JSON/JSONL/CSV/XML exports
- Built-in MCP server, Agent Skill, CLI, and clean Markdown output for AI workflows
Summarized on November 17, 2026 from the README and repository data. It can be wrong; check the source before relying on it. Report a wrong summary