Data Sync & ETL
Archive New Tweets on a Topic in Airtable
Every morning at 8 AM, it searches X for new tweets on a topic, removes ones already stored, and appends the new tweets to Airtable.
What it does
# 🐦 Twitter to Airtable Archiver Automatically archive fresh tweets about "Narendra Modi" to Airtable, eliminating duplicates. ## ⏰ Daily Automation - Runs: Every day at 8 AM (via Schedule Trigger) - Searches: Latest 100 tweets containing "Narendra Modi" ## 🔄 Workflow Steps 1. Fetch Tweets - Retrieve up to 100 tweets using Twitter API - Fields collected: 📝 Text | ❤️ Likes | 🆔 ID | 🔗 URL | 👤 Author | 📅 Timestamp 2. Reformat Data - Structure tweet data for Airtable compatibility 3. Check Existing Records - Fetch current records from Airtable table - Compare using Tweet IDs 4. Filter Duplicates - Remove tweets already in Airtable 5. Append New Tweets - Add only brand-new entries to your base ## ✨ Key Features - Zero Duplicates: Intelligent ID matching - Always Fresh: Daily updates with latest content - Complete Context: Full tweet metadata preserved - Effortless Archiving: Fully automated pipeline ## 🛠️ Perfect For - Political analysts tracking mentions - Researchers monitoring public sentiment - Journalists following trending topics - Archivists preserving digital content > Pro Tip: Change the search term to monitor any topic - politicians, brands, or trends!
The steps
- Set_AT_list
- get airtable list
- set twitter data
- Leave only new tweets
- Append new tweets to airtable
- 8 AM
Similar automations