Back to timeline

Wed, October 1422:15Open SourceAPI & pricingMCP & SkillsAI codingAPI & pricing guide

Scrapling adaptive scraping framework adds MCP and Agent skill support

Decision Brief

What changedGitHub trending project Scrapling released an update: an adaptive scraping framework that handles changing page structures and bypasses anti-bot systems.
Why it mattersIts built-in MCP server lets Claude and other agents call scraping directly, and page content is stripped of prompt injections and reduced to CSS-selector matches, so agents read less, cost less, and can't be hijacked by hidden text; for teams doing AI-driven data collection, this cuts the work of wrapping scrapers and fighting anti-bot measures.
Who should careOpen-source model users, AI coding tool users
Affected stackMCPClaudeCursor
Builder actionUpdate MCP to the latest version
Source confidenceHigh · Official release / blog / repo

Scrapling is an adaptive web scraping framework that handles everything from single requests to large-scale crawls. Its parser learns from site changes and relocates elements automatically when pages update; the fetcher bypasses anti-bot systems like Cloudflare Turnstile by default; and the crawler supports concurrency, multi-session crawling, pause/resume, automatic proxy rotation, adaptive speed based on target response times, and automatic backoff when blocked. The new MCP server lets AI agents such as Claude and Cursor scrape via one-off or session-based tools, covering plain HTTP requests, browser scraping, and stealth scraping that bypasses Cloudflare. Pages are first narrowed with CSS selectors and stripped of prompt injections, so agents read less, cost less, and can't be hijacked by hidden text. It also ships an installable Agent skill that helps coding agents write code matching the current API, plus a one-line page.markdown() that converts pages into clean LLM-ready Markdown.

Summary basis: full article readCompiled from the source scope noted above; the original remains authoritative.

Sources

  • Skill Radar(GitHub 趋势)

    Trending hands-on MCP servers, agent skills, and AI-coding tools discovered from GitHub search momentum.

  • GitHub:D4Vinci/Scrapling

Related intel

留言

登入后即可留言,和其他 builder 交换实测心得。

还没有留言,抢头香。