Skip to content
NEWMarketplace and the trig8n Agent: sell what you build, and get plans and changes that are tested before you see them. See what is new

Library / Web Scraping & Research

Web Scraping & Research

Scrape and Summarize Web Pages with OpenAI

When you run it, Paul Graham essays are fetched and cleaned, and OpenAI summarizes each one.

What it does

## Scrape latest Paul Graham essays

The steps

  1. When clicking "Execute Workflow"
  2. Fetch essay list
  3. Extract essay names
  4. Fetch essay texts
  5. Extract title
  6. Clean up
  7. Split out into items
  8. Limit to first 3
  9. Default Data Loader
  10. Recursive Character Text Splitter
  11. OpenAI Chat Model1
  12. Merge
  13. Summarization Chain

Similar automations