ClaudeCodeMod

All shelves / MCP servers

Scrapfly MCP Server

scrapfly/scrapfly-mcp ยท 14 stars ยท Go

MCP server Get real-time web data, automatically handle anti-bot systems, extract structured data, and capture screenshots with your favorite tools, such as Cursor or LangChain.

Install

The repo has no one-line install. Follow its README.

Published as

  • npmscrapfly-mcpstdio

From the server's entry in the official MCP Registry.

Open the repo

Files

README.md

Scrapfly MCP Server

Scrapfly

Give your AI real-time access to any website

๐ŸŒ Landing Page โ€ข ๐Ÿ“– Documentation โ€ข ๐ŸŽฎ Live Demo โ€ข ๐Ÿ”‘ Get API Key


What is Scrapfly MCP?

The Scrapfly MCP Server connects your AI assistants to live web data through the Model Context Protocol. Transform your AI from being limited by training data to having real-time access to any website.

โœจ What Your AI Can Do

Capability Description
๐ŸŒ Scrape Live Data Pull current prices, listings, news, or any webpage content in real-time
๐Ÿ›ก๏ธ Bypass Anti-Bot Systems Automatically handle CAPTCHAs, proxies, JavaScript rendering, and rate limits
โšก Extract Structured Data Parse complex websites into clean JSON using AI-powered extraction
๐Ÿ“ธ Capture Screenshots Take visual snapshots of pages or specific elements for analysis

๐Ÿ† Why Scrapfly?

Built on battle-tested infrastructure used by thousands of developers:

๐Ÿ“– Learn more: Why Scrapfly MCP?


๐Ÿš€ Quick Install

Click one of the buttons below to install the MCP server in your preferred IDE:

Install in VS Code Install in VS Code Insiders Install in Visual Studio Install in Cursor


๐Ÿ“ฆ Manual Installation

Standard Configuration

Works with most MCP-compatible tools:

{
  "servers": {
    "scrapfly-cloud-mcp": {
      "type": "http",
      "url": "https://mcp.scrapfly.io/mcp"
    }
  }
}

Cloud Configuration (NPX)

For tools that require a local process:

{
  "mcpServers": {
    "scrapfly": {
      "command": "npx",
      "args": [
        "mcp-remote",
        "https://mcp.scrapfly.io/mcp"
      ]
    }
  }
}

๐Ÿ”ง IDE-Specific Setup

VS Code

One-Click Install

Install in VS Code

Manual Install

Follow the VS Code MCP guide or use the CLI:

code --add-mcp '{"name":"scrapfly-cloud-mcp","type":"http","url":"https://mcp.scrapfly.io/mcp"}'

After installation, Scrapfly tools will be available in GitHub Copilot Chat.

๐Ÿ“– Full guide: VS Code Integration

VS Code Insiders

One-Click Install

Install in VS Code Insiders

Manual Install

code-insiders --add-mcp '{"name":"scrapfly-cloud-mcp","type":"http","url":"https://mcp.scrapfly.io/mcp"}'

๐Ÿ“– Full guide: VS Code Integration

Visual Studio

One-Click Install

Install in Visual Studio

Manual Install

  1. Open Visual Studio
  2. Navigate to GitHub Copilot Chat window
  3. Click the tools icon (๐Ÿ› ๏ธ) in the chat toolbar
  4. Click + Add Server to open the configuration dialog
  5. Configure:
    • Server ID: scrapfly-cloud-mcp
    • Type: http/sse
    • URL: https://mcp.scrapfly.io/mcp
  6. Click Save

๐Ÿ“– Full guide: Visual Studio MCP documentation

Cursor

One-Click Install

Install in Cursor

Manual Install

  1. Go to Cursor Settings โ†’ MCP โ†’ Add new MCP Server
  2. Use the standard configuration above
  3. Click Edit to verify or add arguments

๐Ÿ“– Full guide: Cursor Integration

Claude Code

Use the Claude Code CLI:

claude mcp add scrapfly-cloud-mcp --url https://mcp.scrapfly.io/mcp

๐Ÿ“– Full guide: Claude Code Integration

Claude Desktop

Add to your Claude Desktop configuration file:

macOS: ~/Library/Application Support/Claude/claude_desktop_config.json Windows: %APPDATA%\Claude\claude_desktop_config.json

{
  "mcpServers": {
    "scrapfly": {
      "command": "npx",
      "args": ["mcp-remote", "https://mcp.scrapfly.io/mcp"]
    }
  }
}

๐Ÿ“– Full guide: Claude Desktop Integration

Cline

Add to your Cline MCP settings:

{
  "scrapfly-cloud-mcp": {
    "type": "http",
    "url": "https://mcp.scrapfly.io/mcp"
  }
}

๐Ÿ“– Full guide: Cline Integration

Windsurf

Follow the Windsurf MCP documentation using the standard configuration.

๐Ÿ“– Full guide: Windsurf Integration

Zed

Add to your Zed settings:

{
  "context_servers": {
    "scrapfly-cloud-mcp": {
      "type": "http",
      "url": "https://mcp.scrapfly.io/mcp"
    }
  }
}

๐Ÿ“– Full guide: Zed Integration

OpenAI Codex

Create or edit ~/.codex/config.toml:

[mcp_servers.scrapfly-cloud-mcp]
url = "https://mcp.scrapfly.io/mcp"

๐Ÿ“– More info: Codex MCP documentation

Gemini CLI

Follow the Gemini CLI MCP guide using the standard configuration.

OpenCode

Add to ~/.config/opencode/opencode.json:

{
  "$schema": "https://opencode.ai/config.json",
  "mcp": {
    "scrapfly-cloud-mcp": {
      "type": "http",
      "url": "https://mcp.scrapfly.io/mcp",
      "enabled": true
    }
  }
}

๐Ÿ“– More info: OpenCode MCP documentation


๐Ÿ› ๏ธ Available Tools

The Scrapfly MCP Server provides 5 powerful tools covering 99% of web scraping use cases:

Tool Description Use Case
scraping_instruction_enhanced Cheat-sheet of the scraping options Optional โ€” when the right options are unclear
web_get_page Quick page fetch with smart defaults Simple scraping tasks
web_scrape Full control with browser automation Complex scraping, login flows
screenshot Capture page screenshots Visual analysis, monitoring
info_account Check usage & quota Account management

๐Ÿ“– Full reference: Tools & API Specification

Example: Scrape a Page

User: "What are the top posts on Hacker News right now?"

AI: Uses web_get_page to fetch https://news.ycombinator.com and returns current top stories

Example: Extract Structured Data

User: "Get all product prices from this Amazon page"

AI: Uses web_scrape with extraction_model="product_listing" to return structured JSON

๐Ÿ“– More examples: Real-World Examples


๐Ÿ” Authentication

Scrapfly MCP supports multiple authentication methods:

Method Best For Documentation
OAuth2 Production, multi-user apps OAuth2 Setup
API Key Personal use, development API Key Setup
Header Auth Custom integrations Header Auth

๐Ÿ”‘ Get your API key: Scrapfly Dashboard


๐Ÿ“Š Configuration Reference

Setting Value
Server Name scrapfly-cloud-mcp
Type Remote HTTP Server
URL https://mcp.scrapfly.io/mcp
Protocol MCP over HTTP/SSE

๐Ÿ–ฅ๏ธ Self-Hosted / Local Deployment

You can run the Scrapfly MCP server locally or self-host it.

CLI Arguments

Flag Description
-http <address> Start HTTP server at the specified address (e.g., :8080). Takes precedence over PORT env var. In server-key mode this binds loopback (127.0.0.1) unless you also pass -allow-remote.
-apikey <key> Use this API key instead of the SCRAPFLY_API_KEY environment variable.
-allow-remote Server-key HTTP mode only: permit binding a non-loopback interface. That mode performs no per-caller authentication โ€” every request uses the baked-in key โ€” so only enable this behind your own auth proxy.
-verify-ssl Verify TLS certificates on outbound calls (default true). Set false only when targeting a host that serves a self-signed certificate.

Environment Variables

Variable Description
PORT HTTP port to listen on. Used if -http flag is not set.
SCRAPFLY_API_KEY Scrapfly API key baked into the server. When set, the server uses it for every request (server-key mode) and does not read a per-request key.
SCRAPFLY_ALLOW_REMOTE 1/true is the env equivalent of -allow-remote.
SCRAPFLY_VERIFY_SSL 0/false is the env equivalent of -verify-ssl=false.

Per-request key: start the server without a baked-in key (-http only) and each caller supplies their own key per request โ€” as Authorization: Bearer <key>, or ?key=<key> / ?apiKey=<key>. This path is authenticated; the server-key path above is not, which is why it stays on loopback by default.

Examples

# Start HTTP server on port 8080
./scrapfly-mcp -http :8080

# Start HTTP server using PORT env var
PORT=8080 ./scrapfly-mcp

# Start with an API key. Prefer the environment variable: a key passed as a
# flag lands in your shell history and in the process list.
# Server-key mode has no per-caller auth, so it binds 127.0.0.1 here.
SCRAPFLY_API_KEY=... ./scrapfly-mcp -http :8080

# Same, but expose it on all interfaces โ€” only behind your own auth proxy.
SCRAPFLY_API_KEY=... ./scrapfly-mcp -http 0.0.0.0:8080 -allow-remote

# Start in stdio mode (for local MCP clients)
./scrapfly-mcp

Docker

# Build
docker build -t scrapfly-mcp .

# Run (Smithery compatible - uses PORT env var)
docker run -p 8080:8080 scrapfly-mcp

# Run with custom port
docker run -e PORT=9000 -p 9000:9000 scrapfly-mcp

๐Ÿค Framework Integrations

Scrapfly MCP also works with AI frameworks and automation tools:

Framework Documentation
LangChain LangChain Integration
LlamaIndex LlamaIndex Integration
CrewAI CrewAI Integration
OpenAI OpenAI Integration
n8n n8n Integration
Make Make Integration
Zapier Zapier Integration

๐Ÿ“– All integrations: Integration Index


๐Ÿ“š Resources


๐Ÿ’ฌ Need Help?


Scrapfly
Made with โค๏ธ by Scrapfly
The Web Scraping API for Developers

Facts

Kind
MCP server
Repo
scrapfly/scrapfly-mcp
Group
Uncategorized
Stars
14
Language
Go
Last push
2026-10-07
Forks
2
MCP Registry
io.scrapfly.mcp/mcp
Homepage
scrapfly.io/mcp-cloud
Topics
agentic, ai-agent, anti-bot, anti-detect, antidetect-browser, bot-detection, browser-automation, content-extraction, cursor, data-extraction, headless-browser, llm-agent, mcp, mcp-server, model-context-protocol, scrapfly, screenshot, stealth-browser, web-crawler, web-scraping

More on this shelf

  1. 1REAio.github.morluto/reaReverse engineer anything from your terminal or agent with one CLI and MCP server.125.3k
  2. 2com.browser-use/browser-usecom.browser-use/browser-useControl a real Chrome browser to complete any task: fill forms, extract data, book flights.117.7k
  3. 3World Monitorapp.worldmonitor/mcpLive markets, conflicts, country risk, chokepoints, energy, and China decision signals. 93 tools.88.3k
  4. 4Scrapling MCP Serverd4vinci/scrapling๐Ÿ•ท๏ธ An adaptive Web Scraping framework that handles everything from a single request to a full-scale crawl! Don't be shy, join here: https://discord.gg/EMgGbDceNQ and follow here for daily tips and tricks: https://x.com/Scraplingdev86.9k
  5. 5Everythingmodelcontextprotocol/serversThis MCP server attempts to exercise all the features of the MCP protocol. It is not intended to be a useful server, but rather a test server for builders of MCP clients. It implements prompts, tools, resources, sampling, and more to showcase MCP capabilities.85.8k
  6. 6Fetchmodelcontextprotocol/serversA Model Context Protocol server that provides web content fetching capabilities. This server enables LLMs to retrieve and process content from web pages, converting HTML to markdown for easier consumption.85.8k