Skip to content
NEWMarketplace and your team: sell what you build, and get plans and changes that are tested before you see them. See what is new

Library / Web Scraping & Research

Web Scraping & Research

Compile interview dossiers from Jina AI scraping, RSS feeds and Gemini

Triggered by a form submission, it resolves a company's domain and logo, scrapes its website, Google News RSS and Hacker News in parallel, then uses Gemini to build a visual research dossier.

What it does

## 1. Auto Domain Discovery and Parallel Scraping Resolves the official domain and logo, then scrapes the official site, Google News RSS (with URLs), and Hacker News threads simultaneously.

The steps

  1. Interview Research Form
  2. Auto-Discover Company URL
  3. Resolve URL and Visual Assets
  4. Scrape Website (Jina Reader)
  5. Fetch 6M News (Google RSS)
  6. Projects and Tech Pulse (HN API)
  7. Merge Research Streams
  8. Build Context with Source URLs
  9. Synthesize Dossier (LLM Chain)
  10. Google Gemini Chat Model
  11. Build Visual PDF Dossier
  12. Display and Auto-Print PDF in Browser
  13. Create Downloadable Dossier File

Similar automations