Skip to content
NEWMarketplace and the trig8n Agent: sell what you build, and get plans and changes that are tested before you see them. See what is new

Library / Image, Video & Audio

Image, Video & Audio

Create Cinematic Animal Videos with Sound from a Form

When a form is submitted, GPT-4 writes cinematic prompts, Replicate generates the animal video, ElevenLabs creates sound and results are stored in Drive and Sheets.

What it does

### 🟨 Sticky Notes for Workflow: Create Cinematic Animal Videos & Audio 🟡 Trigger: Form Submission Starts when a user fills out a form with a title, 4 animals, and a visual style. 🟡 Format Inputs Prepares animal inputs as an array and pulls the selected style for processing. 🟡 Generate Cinematic Prompts (OpenAI) Each animal is transformed into a cinematic, first-person prompt using GPT-4. 🟡 Create AI Image (Dumpling AI) Each prompt is sent to Dumpling AI to generate a high-quality AI image. 🟡 Motion Prompt for Video (OpenAI) The image prompt is rewritten into a motion video prompt with natural movements. 🟡 Generate Motion Video (Leonardo) Leonardo AI turns each image into a short animated video clip using the motion prompt. 🟡 Generate Audio Prompt (OpenAI) GPT-4 generates a vivid sound prompt based on the style. 🟡 Create Ambient Sound (ElevenLabs) The sound prompt is used to generate a 20-second ambient audio file. 🟡 Upload Audio to Drive The generated .mp3 is saved to a Google Drive folder and made shareable. 🟡 Merge Videos and Audio (Creatomate) All videos and audio are stitched into a single cinematic video with text overlays. 🟡 Upload Final Video The completed video is uploaded to Google Drive in the “AI generated Videos” folder. 🟡 Log Output to Sheet Video title and share link are logged into Google Sheets for future access.

The steps

  1. Form: User Submission
  2. Format into an Array
  3. Split: Loop Through Array
  4. GPT-4: Create Cinematic Prompt
  5. Clean: Remove Line Breaks from Prompt
  6. Dumpling AI: Generate Image
  7. GPT-4: Create motion prompt
  8. Wait: Leonardo Processing
  9. Fetch: Download Motion Video
  10. Limit: One Audio Track Per Run
  11. GPT-4: Generate Audio Prompt
  12. ElevenLabs: Create Ambient Soundtrack
  13. Upload: Save Audio to Google Drive
  14. Share: Make Audio Public

22 steps in total.

Similar automations