READMEmain

Cursor Firecrawl Integration

This project integrates Firecrawl web scraping capabilities with the Cursor MCP server to enhance AI assistance through improved web content processing.

Overview

The integration enables Cursor's AI assistant to:

Scrape web content efficiently using Firecrawl's advanced capabilities
Convert web pages into clean, LLM-ready markdown format
Extract structured data from websites
Process multiple URLs in batch mode
Handle dynamic web content and JavaScript-rendered pages

Features

Clean Data Extraction: Convert web content into markdown or structured data
Batch Processing: Handle multiple URLs simultaneously
Custom Actions: Support for complex web interactions
Structured Data Extraction: Extract specific data using predefined schemas
Integration with Cursor MCP: Seamless communication between Firecrawl and Cursor

Prerequisites

Python 3.8+
Node.js 16+
Firecrawl API key (obtain from firecrawl.dev)
Cursor MCP server access

Installation

Clone the repository:

git clone https://github.com/GGEDeveloper/cursor-firecrawl-integration.git
cd cursor-firecrawl-integration

Install Python dependencies:

pip install -r requirements.txt

Install Node.js dependencies:

npm install

Set up environment variables:

cp .env.example .env
# Edit .env with your Firecrawl API key and other configuration

Project Structure

cursor-firecrawl-integration/
├── src/
│   ├── python/
│   │   ├── scraper.py
│   │   └── cursor_integration.py
│   └── node/
│       ├── server.js
│       └── api_handler.js
├── tests/
├── config/
├── examples/
└── docs/

Usage

Start the integration server:

python src/python/main.py

Configure Cursor MCP to use the integration:

// Configuration example will be provided

Development

Setting up the Development Environment

Create a virtual environment:

python -m venv venv
source venv/bin/activate  # On Windows: venv\Scripts\activate

Install development dependencies:

pip install -r requirements-dev.txt

Running Tests

pytest tests/

Contributing

Fork the repository
Create a feature branch
Commit your changes
Push to the branch
Create a Pull Request

License

This project is licensed under the MIT License - see the LICENSE file for details.

Acknowledgments

Firecrawl for the excellent web scraping capabilities
Cursor team for the MCP server platform

Support

For support, please:

Check the documentation
Open an issue in the repository
Contact the maintainers