scrapebadger
Twitter/X scraping API for AI agents. Get profiles, tweets, trends, and more.
MCP 服务配置
复制以下 JSON 到 OPClaw 或其他 MCP 客户端的配置文件中即可使用
{
"mcpServers": {
"scrapebadger-mcp": {
"args": [
"scrapebadger-mcp@0.1.1"
],
"command": "uvx"
}
}
}
可用工具 (5 个)
该服务在 MCP 协议中暴露的工具,AI 可按需调用
tavily_search 14 个参数 需填 1 项
Search the web for current information on any topic. Use for news, facts, or data beyond your knowledge cutoff. Returns snippets and source URLs.
必填参数:query
tavily_extract 6 个参数 需填 1 项
Extract content from URLs. Returns raw page content in markdown or text format.
必填参数:urls
tavily_crawl 11 个参数 需填 1 项
Crawl a website starting from a URL. Extracts content from pages with configurable depth and breadth.
必填参数:url
tavily_map 8 个参数 需填 1 项
Map a website's structure. Returns a list of URLs found starting from the base URL.
必填参数:url
tavily_research 2 个参数 需填 1 项
Perform comprehensive research on a given topic or question. Use this tool when you need to gather information from multiple sources to answer a question or complete a task. Returns a detailed response based on the research findings.
必填参数:input
服务介绍
<!- - mcp-name: io.github.scrape-badger/scrapebadger - ->
# What is this?
ScrapeBadger MCP Server is a Model Context Protocol (MCP) server that enables AI assistants like Claude, ChatGPT, Cursor, Windsurf, and other MCP-compatible clients to access Twitter/X data through the ScrapeBadger API.
With this MCP server, your AI can:
- Get Twitter user profiles, followers, and following lists
- Search and retrieve tweets
- Access trending topics globally or by location
- Explore Twitter lists and communities
- Search for places and geolocated content
# Quick Start
# # 1. Get Your API Key
Sign up at scrapebadger.com and get your API key.
# # 2. Install
# Using uvx (recommended - no installation needed)
uvx scrapebadger-mcp
# Or install globally with pip
pip install scrapebadger-mcp
# Or with uv
uv tool install scrapebadger-mcp
# # 3. Configure Your AI Client
# # # Claude Desktop
Add to your Claude Desktop configuration file:
macOS: ~/Library/Application Support/Claude/claude_desktop_config.json
Windows: %APPDATA%\Claude\claude_desktop_config.json
{
"mcpServers": {
"scrapebadger": {
"command": "uvx",
"args": ["scrapebadger-mcp"],
"env": {
"SCRAPEBADGER_API_KEY": "sb_live_your_api_key_here"
}
}
}
}
# # # Cursor
Add to your Cursor MCP settings (.cursor/mcp.json):
{
"mcpServers": {
"scrapebadger": {
"command": "uvx",
"args": ["scrapebadger-mcp"],
"env": {
"SCRAPEBADGER_API_KEY": "sb_live_your_api_key_here"
}
}
}
}
# # # Windsurf
Add to your Windsurf MCP configuration:
{
"mcpServers": {
"scrapebadger": {
"command": "uvx",
"args": ["scrapebadger-mcp"],
"env": {
"SCRAPEBADGER_API_KEY": "sb_live_your_api_key_here"
}
}
}
}
# # # VS Code with Copilot
Add to your VS Code settings (.vscode/mcp.json):
{
"mcpServers": {
"scrapebadger": {
"command": "uvx",
"args": ["scrapebadger-mcp"],
"env": {
"SCRAPEBADGER_API_KEY": "sb_live_your_api_key_here"
}
}
}
}
# # 4. Start Using It!
Once configured, simply ask your AI to fetch Twitter data:
"Get the profile of @elonmusk"
"Search for tweets about AI agents"
"What's trending on Twitter right now?"
"Find the top 10 Python developers on Twitter"
# Available Tools
The MCP server provides 17 tools organized into categories:
# # User Tools
| Tool | Description |
|- -- -- -|- -- -- -- -- -- --|
| get_twitter_user_profile | Get a user's profile by username (bio, followers, following, etc.) |
| get_twitter_user_about | Get extended "About" info (account location, username history) |
| search_twitter_users | Search for users by query |
| get_twitter_followers | Get a user's followers |
| get_twitter_following | Get accounts a user follows |
# # Tweet Tools
| Tool | Description |
|- -- -- -|- -- -- -- -- -- --|
| get_twitter_tweet | Get a single tweet by ID |
| get_twitter_user_tweets | Get recent tweets from a user |
| search_twitter_tweets | Search for tweets (supports Twitter search operators) |
# # Trend Tools
| Tool | Description |
|- -- -- -|- -- -- -- -- -- --|
| get_twitter_trends | Get global trending topics (optionally by category) |
| get_twitter_place_trends | Get trends for a specific location (by WOEID) |
# # Geo Tools
| Tool | Description |
|- -- -- -|- -- -- -- -- -- --|
| search_twitter_places | Search for Twitter places by name |
# # List Tools
| Tool | Description |
|- -- -- -|- -- -- -- -- -- --|
| get_twitter_list_detail | Get details about a Twitter list |
| search_twitter_lists | Search for Twitter lists |
| get_twitter_list_tweets | Get tweets from a list |
# # Community Tools
| Tool | Description |
|- -- -- -|- -- -- -- -- -- --|
| get_twitter_community_detail | Get details about a Twitter community |
| search_twitter_communities | Search for communities |
# Example Conversations
# # Research a Twitter Account
You: Get the profile and recent tweets from @sama
Claude: I'll fetch Sam Altman's Twitter profile and recent tweets.
Uses get_twitter_user_profile and get_twitter_user_tweets
Sam Altman (@sama)
- 3.2M followers, 1,847 following
- Bio: "ceo of openai"
- Joined: December 2008
Recent tweets:
1. "excited to share..." (245K likes)
2. "the future of ai..." (180K likes)
...
# # Monitor Trending Topics
You: What's trending in tech on Twitter today?
Claude: I'll check the current trending topics.
Uses get_twitter_trends with category="news"
Top Tech Trends:
1. # GPT5 - 125,000 tweets
2. Apple Vision Pro - 89,000 tweets
3. # AGI - 45,000 tweets
...
# # Competitive Analysis
You: Compare the Twitter engagement of Stripe, Square, and PayPal
Claude: I'll gather data on all three companies' Twitter profiles.
Uses get_twitter_user_profile for each company
| Company | Followers | Following | Engagement Rate |
|- -- -- -- --|- -- -- -- -- --|- -- -- -- -- --|- -- -- -- -- -- -- -- --|
| Stripe | 892K | 1,245 | 2.3% |
| Square | 1.2M | 567 | 1.8% |
| PayPal | 2.1M | 234 | 0.9% |
# Configuration Options
# # Environment Variables
| Variable | Required | Description |
|- -- -- -- -- -|- -- -- -- -- -|- -- -- -- -- -- --|
| SCRAPEBADGER_API_KEY | Yes | Your ScrapeBadger API key |
# # Using with Docker
FROM python:3.12-slim
RUN pip install scrapebadger-mcp
ENV SCRAPEBADGER_API_KEY=your_key_here
CMD ["scrapebadger-mcp"]
# # Using with Python Directly
# Set your API key
export SCRAPEBADGER_API_KEY="sb_live_your_key_here"
# Run the server
python -m scrapebadger_mcp.server
# Error Handling
The MCP server handles common errors gracefully:
| Error | Description | Solution |
|- -- -- --|- -- -- -- -- -- --|- -- -- -- -- -|
| AuthenticationError | Invalid API key | Check your SCRAPEBADGER_API_KEY |
| RateLimitError | Too many requests | Wait and retry, or upgrade your plan |
| InsufficientCreditsError | Out of credits | Purchase more at scrapebadger.com |
| NotFoundError | User/tweet not found | Verify the username or tweet ID |
# Development
# # Setup
# Clone the repository
git clone https://github.com/scrape-badger/scrapebadger-mcp.git
cd scrapebadger-mcp
# Install dependencies
uv sync - -dev
# Set your API key
export SCRAPEBADGER_API_KEY="sb_live_your_key_here"
# # Running Locally
# Run the MCP server directly
uv run python -m scrapebadger_mcp.server
# Or use the CLI
uv run scrapebadger-mcp
# # Testing
# Run tests
uv run pytest
# Run with coverage
uv run pytest - -cov=src/scrapebadger_mcp
# # Code Quality
# Lint
uv run ruff check src/
# Format
uv run ruff format src/
# Type check
uv run mypy src/
# Troubleshooting
# # "SCRAPEBADGER_API_KEY environment variable is required"
Make sure you've set the API key in your MCP configuration:
{
"env": {
"SCRAPEBADGER_API_KEY": "sb_live_your_key_here"
}
}
# # Server not showing in Claude Desktop
- Restart Claude Desktop after changing the config
- Check the config file path is correct for your OS
- Verify JSON syntax is valid (no trailing commas)
# # "uvx: command not found"
Install uv first:
# macOS/Linux
curl -LsSf https://astral.sh/uv/install.sh | sh
# Windows
powershell -c "irm https://astral.sh/uv/install.ps1 | iex"
# # Rate limit errors
ScrapeBadger has usage limits based on your plan. If you're hitting limits:
- Reduce request frequency
- Use pagination with smaller
max_results - Upgrade your plan at scrapebadger.com
# Related Projects
- ScrapeBadger Python SDK - Official Python SDK
- ScrapeBadger Node.js SDK - Official Node.js SDK
- ScrapeBadger API Docs - Full API documentation
# Support
- Documentation: docs.scrapebadger.com
- Issues: GitHub Issues
- Email: support@scrapebadger.com
- Discord: Join our community
# License
MIT License - see LICENSE for details.