Library / Web Scraping & Research
Web Scraping & Research
Crawl a web page from a URL for reuse by AI agent workflows
Called by other workflows or AI agents with a JSON body containing a url field. It fetches and crawls that page and returns the content to the caller.
What it does
## Send URL got Crawl This can be reused by Ai Agents and any Workspace to crawl a site. All that Workspace has to do is send a request: json { "url": "Some URL to Get" }
The steps
- Execute Workflow Trigger
- FireCrawl
- Edit Fields
Similar automations
Web Scraping & ResearchFetch Web Page Content Through a Reusable Crawl Sub-Workflow3 stepsWeb Scraping & ResearchCrawl a URL and Return Metadata with Serper3 stepsWeb Scraping & ResearchCrawl a URL and Return Metadata with Serper3 stepsWeb Scraping & ResearchCrawl a Web Page with Firecrawl as a Reusable Tool3 steps