MCPInstall
websearch-mcp-server logo

websearch-mcp-server

by Howe829 15 stars Howe829/websearch-mcp-server

MCP server for agent web search

READMEmain

WebSearch MCP Server

A simple web search server that supports free search and converts URL content to Markdown. 中文

Features

  • Web Search: Perform web searches using different providers. Supported providers: Bing, Baidu, Google(with browser_use).
  • Markdown Conversion: Convert the content of a URL into Markdown format.
  • Wechat Official Account Articles: Search and retrive wechat official account articles content.
  • GitHub Search: Easily search for anything on GitHub — repositories, users, issues, and more.

Getting Started

Prerequisites

  • Python 3.12 or higher
  • uv for dependency management (or pip)

Installation

  1. Clone the repository:

    git clone https://github.com/Howe829/websearch-mcp-server.git
    cd websearch-mcp-server
    
  2. Install the dependencies using uv (Recomend):

    uv venv && uv sync
    

    Or, if you prefer using pip:

    pip install -r requirements.txt
    

Configuration

  1. Create a .env file based on the .env.example file:

    cp .env.example .env
    
  2. Modify the .env file with your desired settings:

    BING_SEARCH_BASE_URL="https://www.bing.com"
    LANGUAGE="en"
    CC="us"
    IMPERSONATE="edge"
    HOST=127.0.0.1
    PORT=8002
    SERVER_MODE=streamable-http
    

Usage

Run the server using uv:

uv run python server.py

Or run the server using python:

source .venv/bin/activate
python server.py

Contribution

Contributions are welcome!

This project uses pytest for unit tests

uv pip install pytest
uv pip install pytest-asyncio
uv run pytest

And use the ruff for code sytle formatting

uv pip install ruff
ruff format .

use mcp inpector to debug this server

uv run fastmcp dev server.py

More Web Scraping & Data Collection MCP servers

Similar servers from the same category.

BuiltWith

builtwith

Integrates with BuiltWith's technology detection API to identify and analyze web technologies used on specified domains, providing marketers and developers with comprehensive website stack information.

Web Scraping & Data Collection

Provides a bridge to ElfProxy's dynamic IP proxy service for retrieving country-specific proxy IPs, enabling IP rotation, geo-targeting, and bypassing regional restrictions.

WebOptimize

UniFuncs

unifuncs

Provides a bridge to the UniFuncs API for web search and web reading capabilities through TypeScript implementation with Express and NPX commands.

search

Integrates with Bocha, a Chinese search engine, to provide web search capabilities with rich structured data from billions of documents across multiple domains and languages.

search