Library / Web Scraping & Research
Web Scraping & Research
Spot Workplace Discrimination Patterns with AI
When you run it, it collects information from the web using QuickChart.
What it does
### Due to javascript restrictions, a normal HTTP request cannot be used to gather user-reported details from Glassdoor. Instead, [ScrapingBee]({{ $env.API_BASE_URL }} offers a great tool with a very generous package of free tokens per month, which works out to roughly 4-5 runs of this workflow.
The steps
- When clicking ‘Test workflow’
- OpenAI Chat Model1
- OpenAI Chat Model2
- Merge
- OpenAI Chat Model
- SET company_name
- Define dictionary of demographic keys
- ScrapingBee Search Glassdoor
- Extract company url path
- ScrapingBee GET company page contents
- Extract reviews page url path
- ScrapingBee GET Glassdoor Reviews Content
- Extract Overall Review Summary
- Extract Demographics Module
26 steps in total.
Similar automations
Reports, Analytics & DashboardsSpot Workplace Discrimination Patterns in Reviews with OpenAI26 stepsWeb Scraping & ResearchSpot Workplace Discrimination Patterns in Reviews with OpenAI26 stepsReports, Analytics & DashboardsSpot Workplace Discrimination Patterns with OpenAI66 stepsWeb Scraping & ResearchSpot Workplace Discrimination Patterns with AI26 steps