Library / Image, Video & Audio
Image, Video & Audio
Create Cinematic Animal Videos with Sound from a Form
When a form is submitted, GPT-4 writes cinematic prompts, Replicate generates the animal video, ElevenLabs creates sound and results are stored in Drive and Sheets.
What it does
### 🟨 Sticky Notes for Workflow: Create Cinematic Animal Videos & Audio 🟡 Trigger: Form Submission Starts when a user fills out a form with a title, 4 animals, and a visual style. 🟡 Format Inputs Prepares animal inputs as an array and pulls the selected style for processing. 🟡 Generate Cinematic Prompts (OpenAI) Each animal is transformed into a cinematic, first-person prompt using GPT-4. 🟡 Create AI Image (Dumpling AI) Each prompt is sent to Dumpling AI to generate a high-quality AI image. 🟡 Motion Prompt for Video (OpenAI) The image prompt is rewritten into a motion video prompt with natural movements. 🟡 Generate Motion Video (Leonardo) Leonardo AI turns each image into a short animated video clip using the motion prompt. 🟡 Generate Audio Prompt (OpenAI) GPT-4 generates a vivid sound prompt based on the style. 🟡 Create Ambient Sound (ElevenLabs) The sound prompt is used to generate a 20-second ambient audio file. 🟡 Upload Audio to Drive The generated .mp3 is saved to a Google Drive folder and made shareable. 🟡 Merge Videos and Audio (Creatomate) All videos and audio are stitched into a single cinematic video with text overlays. 🟡 Upload Final Video The completed video is uploaded to Google Drive in the “AI generated Videos” folder. 🟡 Log Output to Sheet Video title and share link are logged into Google Sheets for future access.
The steps
- Form: User Submission
- Format into an Array
- Split: Loop Through Array
- GPT-4: Create Cinematic Prompt
- Clean: Remove Line Breaks from Prompt
- Dumpling AI: Generate Image
- GPT-4: Create motion prompt
- Wait: Leonardo Processing
- Fetch: Download Motion Video
- Limit: One Audio Track Per Run
- GPT-4: Generate Audio Prompt
- ElevenLabs: Create Ambient Soundtrack
- Upload: Save Audio to Google Drive
- Share: Make Audio Public
22 steps in total.
Similar automations
Image, Video & AudioCreate Narrated Image Videos with OpenAI, Replicate and ElevenLabs26 stepsImage, Video & AudioGenerate Sound Effects from a Form with fal.ai8 stepsImage, Video & AudioProduce Faceless YouTube Videos with Claude, ElevenLabs and Replicate41 stepsImage, Video & AudioSend deduplicated YouTube voice digests with Apify, DeepSeek, ElevenLabs, Telegram, and28 steps