Library / Web Scraping & Research
Web Scraping & Research
Track and score new job openings with Apify, OpenAI, Slack and Google Sheets
Runs daily to check the career pages of listed companies through Apify, keeps only new postings, scores them against target roles, and routes matches to Sheets, Slack or email.
What it does
## Job openings tracker: Greenhouse, Lever, Ashby and more Watches the career pages of the companies you list, keeps only new postings, scores them against your target titles, level, location and pay, and routes them. Built for recruiters, job seekers and sales teams who use hiring as a buying signal. ### How it works 1. Daily schedule / manual run reads every setting from Config. A weekly schedule uses the same Config to send a report instead of running the actor. 2. Starts the Apify actor asynchronously, then waits and polls the run; FAILED, ABORTED, TIMED-OUT or too many polls stop with an error. 3. Downloads the dataset, validates rows and dedupes within the run and across runs (workflow static data, dedupeMemoryDays). 4. A transparent rule score runs first, then an LLM chain with a structured output parser reads each record against your plain-English aiCriteria and returns a fit score, verdict, summary, outreach angle and red flags. Calls are batched with a delay for rate limits, retried, and fall back to the rule score if the model fails. 5. Upserts every row to Google Sheets. Hot rows go to Slack as one approve / dismiss message (send-and-wait, 24 h limit) and the decision is written back to the sheet; warm rows go to an HTML email digest; cold rows stay in the sheet. 6. Weekly report: reads the sheet, summarises the last 7 days (tiers, approvals, top 10) and emails it. 7. A separate Error Trigger branch posts any failure to Slack. ### Setup (about 15 minutes) 1. Create an HTTP Header Auth credential: name Authorization, value Bearer (Apify Console > Settings > API & Integrations). Select it on the 3 Apify HTTP nodes. 2. Create a Google Sheet with a tab named in sheetTab and a header row matching the sheet columns (see *Upsert to Google Sheets*, plus status and reviewedAt). Paste its ID into googleSheetId. 3. Connect OpenAI (or swap the chat model sub-node for Anthropic, Gemini, Ollama...), Slack and Gmail; set slackChannelId and digestEmail in Config (also the channel on *Slack: error alert*). 4. In Config set actorInput.companies (board slugs or career-page URLs), titleKeywords, preferredLocations, seniorityLevels, minSalary, hotScore, warmScore. 5. Write your ideal-lead description in aiCriteria; set aiWeight (0 = rules only, 1 = AI only). 6. Run once manually, check the sheet, then activate. ### Customize - Ed
The steps
- Daily schedule
- Run manually
- Weekly report schedule
- Config
- Daily run or weekly report?
- Start Apify run
- Wait before polling
- Get run status
- Check run status
- Route by run status
- Stop: Apify run failed
- Fetch dataset items
- Validate and dedupe
- Any new records?
35 steps in total.
Similar automations
Web Scraping & ResearchTrack company job openings from careers pages into Airtable with Gaffa15 stepsWeb Scraping & ResearchScore Reddit buying-intent leads with Apify, OpenAI, Google Sheets and Slack26 stepsWeb Scraping & ResearchSend daily Reddit keyword mention alerts from Apify to Slack and Gmail8 stepsFiles & Cloud StorageTrack new ATS job postings in Google Sheets with Apify ATS Jobs Scraper16 steps