Scrapfly MCP Server
scrapfly/scrapfly-mcp ยท 14 stars ยท Go
MCP server Get real-time web data, automatically handle anti-bot systems, extract structured data, and capture screenshots with your favorite tools, such as Cursor or LangChain.
Install
The repo has no one-line install. Follow its README.
Published as
- npm
scrapfly-mcpstdio
From the server's entry in the official MCP Registry.
Files
Scrapfly MCP Server
Give your AI real-time access to any website
๐ Landing Page โข ๐ Documentation โข ๐ฎ Live Demo โข ๐ Get API Key
What is Scrapfly MCP?
The Scrapfly MCP Server connects your AI assistants to live web data through the Model Context Protocol. Transform your AI from being limited by training data to having real-time access to any website.
โจ What Your AI Can Do
| Capability | Description |
|---|---|
| ๐ Scrape Live Data | Pull current prices, listings, news, or any webpage content in real-time |
| ๐ก๏ธ Bypass Anti-Bot Systems | Automatically handle CAPTCHAs, proxies, JavaScript rendering, and rate limits |
| โก Extract Structured Data | Parse complex websites into clean JSON using AI-powered extraction |
| ๐ธ Capture Screenshots | Take visual snapshots of pages or specific elements for analysis |
๐ Why Scrapfly?
Built on battle-tested infrastructure used by thousands of developers:
- 99.9% Uptime โ Enterprise-grade reliability
- 100+ Countries โ Global proxy network with datacenter & residential IPs
- Anti-Bot Bypass โ Advanced Unblocker technology defeats modern protections
- OAuth2 Security โ Enterprise authentication for production deployments
๐ Learn more: Why Scrapfly MCP?
๐ Quick Install
Click one of the buttons below to install the MCP server in your preferred IDE:
๐ฆ Manual Installation
Standard Configuration
Works with most MCP-compatible tools:
{
"servers": {
"scrapfly-cloud-mcp": {
"type": "http",
"url": "https://mcp.scrapfly.io/mcp"
}
}
}
Cloud Configuration (NPX)
For tools that require a local process:
{
"mcpServers": {
"scrapfly": {
"command": "npx",
"args": [
"mcp-remote",
"https://mcp.scrapfly.io/mcp"
]
}
}
}
๐ง IDE-Specific Setup
VS Code
One-Click Install
Manual Install
Follow the VS Code MCP guide or use the CLI:
code --add-mcp '{"name":"scrapfly-cloud-mcp","type":"http","url":"https://mcp.scrapfly.io/mcp"}'
After installation, Scrapfly tools will be available in GitHub Copilot Chat.
๐ Full guide: VS Code Integration
VS Code Insiders
One-Click Install
Manual Install
code-insiders --add-mcp '{"name":"scrapfly-cloud-mcp","type":"http","url":"https://mcp.scrapfly.io/mcp"}'
๐ Full guide: VS Code Integration
Visual Studio
One-Click Install
Manual Install
- Open Visual Studio
- Navigate to GitHub Copilot Chat window
- Click the tools icon (๐ ๏ธ) in the chat toolbar
- Click + Add Server to open the configuration dialog
- Configure:
- Server ID:
scrapfly-cloud-mcp - Type:
http/sse - URL:
https://mcp.scrapfly.io/mcp
- Server ID:
- Click Save
๐ Full guide: Visual Studio MCP documentation
Cursor
One-Click Install
Manual Install
- Go to
Cursor SettingsโMCPโAdd new MCP Server - Use the standard configuration above
- Click Edit to verify or add arguments
๐ Full guide: Cursor Integration
Claude Code
Use the Claude Code CLI:
claude mcp add scrapfly-cloud-mcp --url https://mcp.scrapfly.io/mcp
๐ Full guide: Claude Code Integration
Claude Desktop
Add to your Claude Desktop configuration file:
macOS: ~/Library/Application Support/Claude/claude_desktop_config.json
Windows: %APPDATA%\Claude\claude_desktop_config.json
{
"mcpServers": {
"scrapfly": {
"command": "npx",
"args": ["mcp-remote", "https://mcp.scrapfly.io/mcp"]
}
}
}
๐ Full guide: Claude Desktop Integration
Cline
Add to your Cline MCP settings:
{
"scrapfly-cloud-mcp": {
"type": "http",
"url": "https://mcp.scrapfly.io/mcp"
}
}
๐ Full guide: Cline Integration
Windsurf
Follow the Windsurf MCP documentation using the standard configuration.
๐ Full guide: Windsurf Integration
Zed
Add to your Zed settings:
{
"context_servers": {
"scrapfly-cloud-mcp": {
"type": "http",
"url": "https://mcp.scrapfly.io/mcp"
}
}
}
๐ Full guide: Zed Integration
OpenAI Codex
Create or edit ~/.codex/config.toml:
[mcp_servers.scrapfly-cloud-mcp] url = "https://mcp.scrapfly.io/mcp"
๐ More info: Codex MCP documentation
Gemini CLI
Follow the Gemini CLI MCP guide using the standard configuration.
OpenCode
Add to ~/.config/opencode/opencode.json:
{
"$schema": "https://opencode.ai/config.json",
"mcp": {
"scrapfly-cloud-mcp": {
"type": "http",
"url": "https://mcp.scrapfly.io/mcp",
"enabled": true
}
}
}
๐ More info: OpenCode MCP documentation
๐ ๏ธ Available Tools
The Scrapfly MCP Server provides 5 powerful tools covering 99% of web scraping use cases:
| Tool | Description | Use Case |
|---|---|---|
scraping_instruction_enhanced |
Cheat-sheet of the scraping options | Optional โ when the right options are unclear |
web_get_page |
Quick page fetch with smart defaults | Simple scraping tasks |
web_scrape |
Full control with browser automation | Complex scraping, login flows |
screenshot |
Capture page screenshots | Visual analysis, monitoring |
info_account |
Check usage & quota | Account management |
๐ Full reference: Tools & API Specification
Example: Scrape a Page
User: "What are the top posts on Hacker News right now?"
AI: Uses web_get_page to fetch https://news.ycombinator.com and returns current top stories
Example: Extract Structured Data
User: "Get all product prices from this Amazon page"
AI: Uses web_scrape with extraction_model="product_listing" to return structured JSON
๐ More examples: Real-World Examples
๐ Authentication
Scrapfly MCP supports multiple authentication methods:
| Method | Best For | Documentation |
|---|---|---|
| OAuth2 | Production, multi-user apps | OAuth2 Setup |
| API Key | Personal use, development | API Key Setup |
| Header Auth | Custom integrations | Header Auth |
๐ Get your API key: Scrapfly Dashboard
๐ Configuration Reference
| Setting | Value |
|---|---|
| Server Name | scrapfly-cloud-mcp |
| Type | Remote HTTP Server |
| URL | https://mcp.scrapfly.io/mcp |
| Protocol | MCP over HTTP/SSE |
๐ฅ๏ธ Self-Hosted / Local Deployment
You can run the Scrapfly MCP server locally or self-host it.
CLI Arguments
| Flag | Description |
|---|---|
-http <address> |
Start HTTP server at the specified address (e.g., :8080). Takes precedence over PORT env var. In server-key mode this binds loopback (127.0.0.1) unless you also pass -allow-remote. |
-apikey <key> |
Use this API key instead of the SCRAPFLY_API_KEY environment variable. |
-allow-remote |
Server-key HTTP mode only: permit binding a non-loopback interface. That mode performs no per-caller authentication โ every request uses the baked-in key โ so only enable this behind your own auth proxy. |
-verify-ssl |
Verify TLS certificates on outbound calls (default true). Set false only when targeting a host that serves a self-signed certificate. |
Environment Variables
| Variable | Description |
|---|---|
PORT |
HTTP port to listen on. Used if -http flag is not set. |
SCRAPFLY_API_KEY |
Scrapfly API key baked into the server. When set, the server uses it for every request (server-key mode) and does not read a per-request key. |
SCRAPFLY_ALLOW_REMOTE |
1/true is the env equivalent of -allow-remote. |
SCRAPFLY_VERIFY_SSL |
0/false is the env equivalent of -verify-ssl=false. |
Per-request key: start the server without a baked-in key (-http only) and
each caller supplies their own key per request โ as Authorization: Bearer <key>,
or ?key=<key> / ?apiKey=<key>. This path is authenticated; the server-key
path above is not, which is why it stays on loopback by default.
Examples
# Start HTTP server on port 8080 ./scrapfly-mcp -http :8080 # Start HTTP server using PORT env var PORT=8080 ./scrapfly-mcp # Start with an API key. Prefer the environment variable: a key passed as a # flag lands in your shell history and in the process list. # Server-key mode has no per-caller auth, so it binds 127.0.0.1 here. SCRAPFLY_API_KEY=... ./scrapfly-mcp -http :8080 # Same, but expose it on all interfaces โ only behind your own auth proxy. SCRAPFLY_API_KEY=... ./scrapfly-mcp -http 0.0.0.0:8080 -allow-remote # Start in stdio mode (for local MCP clients) ./scrapfly-mcp
Docker
# Build docker build -t scrapfly-mcp . # Run (Smithery compatible - uses PORT env var) docker run -p 8080:8080 scrapfly-mcp # Run with custom port docker run -e PORT=9000 -p 9000:9000 scrapfly-mcp
๐ค Framework Integrations
Scrapfly MCP also works with AI frameworks and automation tools:
| Framework | Documentation |
|---|---|
| LangChain | LangChain Integration |
| LlamaIndex | LlamaIndex Integration |
| CrewAI | CrewAI Integration |
| OpenAI | OpenAI Integration |
| n8n | n8n Integration |
| Make | Make Integration |
| Zapier | Zapier Integration |
๐ All integrations: Integration Index
๐ Resources
- ๐ MCP Cloud Landing Page โ Product overview & features
- ๐ฎ Live n8n Demo โ Try it in your browser
- ๐ Full Documentation
- ๐ ๏ธ Tools Reference
- ๐ก Examples & Use Cases
- โ FAQ
- ๐ Authentication Guide
๐ฌ Need Help?
- ๐ Scrapfly Documentation
- ๐ง Contact Support
- ๐ Model Context Protocol
Made with โค๏ธ by Scrapfly
The Web Scraping API for Developers
Facts
- Kind
- MCP server
- Group
- Uncategorized
- Stars
- 14
- Language
- Go
- Last push
- 2026-10-07
- Forks
- 2
- MCP Registry
- io.scrapfly.mcp/mcp
- Homepage
- scrapfly.io/mcp-cloud
- Topics
- agentic, ai-agent, anti-bot, anti-detect, antidetect-browser, bot-detection, browser-automation, content-extraction, cursor, data-extraction, headless-browser, llm-agent, mcp, mcp-server, model-context-protocol, scrapfly, screenshot, stealth-browser, web-crawler, web-scraping
- 1REAio.github.morluto/reaReverse engineer anything from your terminal or agent with one CLI and MCP server.125.3k
- 2com.browser-use/browser-usecom.browser-use/browser-useControl a real Chrome browser to complete any task: fill forms, extract data, book flights.117.7k
- 3World Monitorapp.worldmonitor/mcpLive markets, conflicts, country risk, chokepoints, energy, and China decision signals. 93 tools.88.3k
- 4Scrapling MCP Serverd4vinci/scrapling๐ท๏ธ An adaptive Web Scraping framework that handles everything from a single request to a full-scale crawl! Don't be shy, join here: https://discord.gg/EMgGbDceNQ and follow here for daily tips and tricks: https://x.com/Scraplingdev86.9k
- 5Everythingmodelcontextprotocol/serversThis MCP server attempts to exercise all the features of the MCP protocol. It is not intended to be a useful server, but rather a test server for builders of MCP clients. It implements prompts, tools, resources, sampling, and more to showcase MCP capabilities.85.8k
- 6Fetchmodelcontextprotocol/serversA Model Context Protocol server that provides web content fetching capabilities. This server enables LLMs to retrieve and process content from web pages, converting HTML to markdown for easier consumption.85.8k