web-fetch-mcp
MCP server for web content fetching, summarizing, comparing, and extracting information
MCP 服务配置
复制以下 JSON 到 OPClaw 或其他 MCP 客户端的配置文件中即可使用
{
"mcpServers": {
"web-fetch-mcp": {
"args": [
"web-fetch-mcp@0.1.1"
],
"command": "npx"
}
}
}可用工具 （5 个）
该服务在 MCP 协议中暴露的工具，AI 可按需调用
tavily_search 14 个参数 需填 1 项
Search the web for current information on any topic. Use for news, facts, or data beyond your knowledge cutoff. Returns snippets and source URLs.
必填参数：query
tavily_extract 6 个参数 需填 1 项
Extract content from URLs. Returns raw page content in markdown or text format.
必填参数：urls
tavily_crawl 11 个参数 需填 1 项
Crawl a website starting from a URL. Extracts content from pages with configurable depth and breadth.
必填参数：url
tavily_map 8 个参数 需填 1 项
Map a website's structure. Returns a list of URLs found starting from the base URL.
必填参数：url
tavily_research 2 个参数 需填 1 项
Perform comprehensive research on a given topic or question. Use this tool when you need to gather information from multiple sources to answer a question or complete a task. Returns a detailed response based on the research findings.
必填参数：input
服务介绍
Web Fetch MCP Server
A Model Context Protocol (MCP) server that provides web content fetching, summarization, comparison, and extraction capabilities.
# Features
- Three Core Tools: Provides
summarize_web,compare_web, andextract_webfor versatile web content processing. - Handles Multiple URLs: Process up to 20 URLs in a single request.
- Content Transformation: Converts HTML to clean, readable text and automatically resolves GitHub
/blob/URLs to their raw content equivalent. - Safe & Secure: Protects against Server-Side Request Forgery (SSRF) by blocking requests to private IP addresses.
- Configurable: Allows setting timeouts and content length limits to manage performance.
# Installation
Install the server globally from npm:
npm install -g web-fetch-mcp
# MCP Agent Configuration
To use this server with an AI agent that supports the Model Context Protocol, add the following configuration to your agent's settings. Once configured, your agent can call the tools provided by this service.
Important: You must provide a valid Gemini API key for the server to work.
If you installed the package globally:
{
"mcpServers": {
"web-fetch-mcp": {
"type": "stdio",
"command": "web-fetch-mcp",
"env": {
"GEMINI_API_KEY": "YOUR_GEMINI_API_KEY"
}
}
}
}
Note: If you encounter network access issues (e.g., unable to connect to Gemini), you can configure the environment variables HTTPS_PROXY and HTTP_PROXY. By default, the gemini-2.5-flash model is used, consistent with Gemini-CLI.
If you are running from a local clone:
{
"mcpServers": {
"web-fetch-mcp": {
"type": "stdio",
"command": "node",
"args": ["/path/to/web-fetch-mcp/dist/index.js"],
"env": {
"GEMINI_API_KEY": "YOUR_GEMINI_API_KEY"
}
}
}
}
# Tool Reference
The service provides the following tools:
summarize_web: Summarizes content from one or more URLs.compare_web: Compares content across multiple URLs.extract_web: Extracts specific information from web content using natural language prompts.
# # Example Tool Call
To use a tool, your agent should make a callTool request specifying the tool name and a prompt:
{
"tool": "summarize_web",
"arguments": {
"prompt": "Summarize the main points from https://example.com/article"
}
}
# For Developers
If you wish to contribute to the development of this server:
- Clone the repository:
git clone https://github.com/your-username/web-fetch-mcp.git cd web-fetch-mcp - Install dependencies:
npm install - Run in development mode:
npm run dev - Build for production:
npm run build
