Library / Web Scraping & Research
Web Scraping & Research
Read a Sitemap and Filter URLs
When you run it, it downloads a sitemap.xml, converts it to JSON and filters out the URLs you want.
What it does
## Sitemap.xml reader This workflow reads an sitemap.xml and filters out the entries you want. By default only PDF documents are returned at the end of the workflow. SETUP - Edit the Set sitemap URL block and add the url to the sitemap you want to read. - Edit the Filter URLs to your needs.
The steps
- ‘Test workflow’ trigger
- Set sitemap URL
- Split Out
- Get Sitemap
- Convert Sitemap to JSON
- Filter URLs
Similar automations
Web Scraping & ResearchRead a Sitemap and Filter URLs12 stepsWeb Scraping & ResearchExtract Website URLs from a Sitemap for SEO Analysis9 stepsContent Writing & GenerationSubmit Sitemap URLs to the Google Indexing API11 stepsMonitoring, Ops & IncidentsRequest Google Indexing for New Sitemap URLs16 steps