Skip to content
NEWMarketplace and the trig8n Agent: sell what you build, and get plans and changes that are tested before you see them. See what is new

Library / Web Scraping & Research

Web Scraping & Research

Spot Workplace Discrimination Patterns with AI

When you run it, it collects information from the web using QuickChart.

What it does

### Due to javascript restrictions, a normal HTTP request cannot be used to gather user-reported details from Glassdoor. Instead, [ScrapingBee]({{ $env.API_BASE_URL }} offers a great tool with a very generous package of free tokens per month, which works out to roughly 4-5 runs of this workflow.

The steps

  1. When clicking ‘Test workflow’
  2. OpenAI Chat Model1
  3. OpenAI Chat Model2
  4. Merge
  5. OpenAI Chat Model
  6. SET company_name
  7. Define dictionary of demographic keys
  8. ScrapingBee Search Glassdoor
  9. Extract company url path
  10. ScrapingBee GET company page contents
  11. Extract reviews page url path
  12. ScrapingBee GET Glassdoor Reviews Content
  13. Extract Overall Review Summary
  14. Extract Demographics Module

26 steps in total.

Similar automations