Library / Web Scraping & Research
Web Scraping & Research
Scrape LinkedIn with Bright Data MCP and Gemini
When you run it, a Gemini agent uses the Bright Data MCP server to scrape LinkedIn profile pages from a list of URLs.
What it does
# LinkedIn Web Scraping with Bright Data MCP Server & Google Gemini ## Overview Automated workflow: LinkedIn Web Scraping with Bright Data MCP Server & Google Gemini. This workflow integrates 13 different services: stickyNote, httpRequest, code, lmChatGoogleGemini, readWriteFile. It contains 27 nodes and follows best practices for error handling and security. ## Workflow Details - Total Nodes: 27 - Node Types: 13 - Error Handling: ✅ Implemented - Security: ✅ Hardened (no sensitive data) - Documentation: ✅ Complete ## Node Breakdown - When clicking ‘Test workflow’: manualTrigger - Sticky Note1: stickyNote - Set the URLs: set - Bright Data MCP Client For LinkedIn Person: mcpClient - Sticky Note: stickyNote - List all tools for Bright Data: mcpClient - Bright Data MCP Client For LinkedIn Company: mcpClient - Set the LinkedIn Company URL: set - Webhook for LinkedIn Company Web Scraper: httpRequest - LinkedIn Data Extractor: informationExtractor - ... and 17 more nodes ## Usage Instructions 1. Configure Credentials: Set up all required API keys and credentials 2. Update Variables: Replace any placeholder values with actual data 3. Test Workflow: Run in test mode to verify functionality 4. Deploy: Activate the workflow for production use ## Security Notes - All sensitive data has been removed or replaced with placeholders - Error handling is implemented for reliability - Follow security best practices when configuring credentials ## Troubleshooting - Check error logs if workflow fails - Verify all credentials are properly configured - Ensure all required services are accessible
The steps
- When clicking ‘Test workflow’
- Set the URLs
- Bright Data MCP Client For LinkedIn Person
- List all tools for Bright Data
- Bright Data MCP Client For LinkedIn Company
- Set the LinkedIn Company URL
- Webhook for LinkedIn Company Web Scraper
- LinkedIn Data Extractor
- Google Gemini Chat Model
- List all available tools for Bright Data
- Code
- Merge
- Aggregate
- Create a binary data for LinkedIn person info extract
40 steps in total.
Similar automations
Web Scraping & ResearchScrape LinkedIn Profiles with Bright Data MCP and Gemini18 stepsMCP Servers & ToolsScrape Websites with Gemini and Bright Data MCP Tools15 stepsWeb Scraping & ResearchScrape Websites with a Bright Data MCP Gemini Agent36 stepsWeb Scraping & ResearchExtract LinkedIn Profiles into JSON Resumes with Bright Data and Gemini15 steps