Skip to content
NEWMarketplace and the trig8n Agent: sell what you build, and get plans and changes that are tested before you see them. See what is new

Library / MCP Servers & Tools

MCP Servers & Tools

Scrape Websites with Gemini and Bright Data MCP Tools

When you run it, a Gemini agent uses Bright Data MCP tools to scrape web pages on request and sends the results to a webhook.

Import it free Sign in to open it

What it does

## Note The AI agent utilizes Bright Data's MCP tools to perform web scraping based on user requests. It intelligently selects the most suitable web scraping tool to fulfill the user's query. Once the web scraping is complete, the AI agent's response is: 1. Used to trigger a webhook call. 2. Persisted to disk for future reference. Google Gemini is employed by the AI agent to understand and interpret user queries. Based on this interpretation, the agent initiates a call to the appropriate MCP client to perform the required web scraping task. Source - https://github.com/luminati-io/brightdata-mcp

The steps

  1. AI Agent
  2. When clicking ‘Test workflow’
  3. MCP Client list all tools for Bright Data
  4. MCP Client List all tools
  5. MCP Client Bright Data Web Scraper
  6. Webhook for web scraper
  7. Set the URLs
  8. MCP Client to Scrape as Markdown
  9. MCP Client to Scrape as HTML
  10. Google Gemini Chat Model for AI Agent
  11. Simple Memory
  12. Webhook for Web Scraper AI Agent
  13. Set the URL with the Webhook URL and data format
  14. Create a binary data

15 steps in total.

Similar automations

Web Scraping & ResearchScrape Websites with a Bright Data MCP Gemini Agent36 stepsWeb Scraping & ResearchScrape LinkedIn Profiles with Bright Data MCP and Gemini18 stepsWeb Scraping & ResearchScrape LinkedIn with Bright Data MCP and Gemini40 stepsWeb Scraping & ResearchScrape Etsy Listings with Bright Data and Gemini15 steps