Library / Web Scraping & Research
Web Scraping & Research
Search the Web with Firecrawl and GPT-4.1 Mini
When a chat message arrives, a GPT-4.1 mini agent via OpenRouter searches the web with Firecrawl using site and exclusion filters.
What it does
# 🔧 Firecrawl /search Body Parameters These parameters help you control the type, scope, and format of results returned from Firecrawl’s /search endpoint. query *(string, required)* The actual search string — supports query operators like site:, intitle:, etc. 💡 Example: "Nate Herk" site:youtube.com limit *(integer, default: 5)* Maximum number of results to return (range: 1–100). 💡 Example: limit: 10 tbs *(string)* Time-based search filtering (e.g., recent content). 💡 Example: "qdr:d" for results from the past day lang *(string, default: en)* Language code for search results. 💡 Example: lang: "en" or lang: "es" country *(string, default: us)* Country code to bias results to a region. 💡 Example: country: "de" for Germany location *(string)* More specific location targeting for localized results. 💡 Example: location: "new york" timeout *(integer, default: 60000)* Timeout for the request in milliseconds. 💡 Example: timeout: 30000 (30 seconds) ignoreInvalidURLs *(boolean, default: false)* If true, filters out search results with invalid or unusable URLs (great for chaining with other Firecrawl endpoints). 💡 Example: ignoreInvalidURLs: true scrapeOptions *(object)* Controls the scraping behavior for each result, letting you specify which formats to return. Available formats (you can include multiple): - markdown - html - rawHtml - links - screenshot - screenshot@fullPage - json 💡 Example: "scrapeOptions": { "formats": ["markdown", "links", "screenshot"] } 💡 Tip: Combine these parameters with query operators to get super targeted, fast, and relevant full-page content.
The steps
- Site
- In URL
- Exclusion
- Pro
- When chat message received
- GPT 4.1 mini
- Firecrawl Search
- Search Agent
Similar automations
Files & Cloud StorageSearch an Image Library with GPT-4.1 Mini and Telegram11 stepsWeb Scraping & ResearchExtract Web Data with Firecrawl and Email OpenAI Summaries10 stepsWeb Scraping & ResearchScrape the Web Daily with Firecrawl and Telegram Alerts8 stepsWeb Scraping & ResearchExtract Structured Web Data with Firecrawl Extract7 steps