Library / Web Scraping & Research
Web Scraping & Research
Detect website tech stacks with Apify and score sales prospects with OpenAI
Daily schedule fingerprints each listed site's technologies via Apify, scores fit with OpenAI, and reports through Slack and Gmail; Mondays send a 7-day summary.
What it does
## Detect website technology stacks with Apify and flag sales prospects using OpenAI Fingerprints the technologies behind each website you list through Apify (CMS, e-commerce platform, analytics, CDN, frameworks) and scores each site for fit with your offer. Typical uses: find stores on a platform you build apps for, spot sites with no analytics or security tooling to pitch, or track which competitors' customers run which stack. ### How it works 1. A daily schedule (or the manual trigger) loads Config; a Monday schedule sends a 7-day report instead. 2. Runs the Apify actor website-tech-stack-detector and downloads the results. 3. Drops incomplete rows and anything already seen in the last 30 days. 4. Score technology fit gives a 0-100 rule score; an OpenAI model adds a fit score, verdict and summary. 5. Upserts every row to the TechStacks sheet tab. Hot rows go to Slack for approval, warm rows to an email digest. ### Setup steps - [ ] Add an Apify HTTP Header Auth credential (Authorization: Bearer ) on the 3 Apify HTTP nodes. - [ ] Create a Google Sheet with the columns in *Upsert to Google Sheets* and paste its ID into googleSheetId. - [ ] Connect OpenAI, Slack and Gmail; set slackChannelId and digestEmail in Config. - [ ] In Config set actorInput.urls, then targetTechnologies (lowercase tool names you sell into), targetCategories, gapCategories (categories whose absence is your pitch) and minConfidence. - [ ] Describe your ideal result in aiCriteria, run once manually, then activate. ### Customization - Change the weights in Score technology fit (target technology 35 plus 10 per extra, gap categories 10 each, old versions 10). - Raise hotScore (60) or warmScore (35) to send fewer alerts. - Needs an Apify account; actor runs use your Apify credits.
The steps
- Daily schedule
- Run manually
- Weekly report schedule
- Config
- Daily run or weekly report?
- Start Apify run
- Wait before polling
- Get run status
- Check run status
- Route by run status
- Stop: Apify run failed
- Fetch dataset items
- Validate and dedupe
- Any new records?
35 steps in total.
Similar automations
Web Scraping & ResearchGet Website Tech Stacks from BuiltWith into Google Sheets5 stepsContent Writing & GenerationSend a Personalized AI Tech Newsletter from RSS with OpenAI17 stepsWeb Scraping & ResearchScore Reddit buying-intent leads with Apify, OpenAI, Google Sheets and Slack26 stepsRAG & Knowledge BasesChat with a Tech Radar via Claude and Pinecone37 steps