Skip to content
NEWMarketplace and the trig8n Agent: sell what you build, and get plans and changes that are tested before you see them. See what is new

Library / Image, Video & Audio

Image, Video & Audio

Detect Objects in Images by Prompt with Gemini 2.0

When you run it, Gemini 2.0 finds the objects you describe in a test image and the workflow draws bounding boxes on it.

What it does

## 2. Use Prompt-Based Object Detection Read more about the HTTP node We've had generalised object detection before (see my other template using ResNet) but being able to prompt for what you're looking for is a very exciting proposition! Not only could this reduce the effort in post-detection filtering but also introduce contextual use-cases such as searching by "emotion", "locality", "anomolies" and many more! I found the the output json schema of { "box_2d": { "type": "array", ... } } works best for Gemini to return coordinates.

The steps

  1. When clicking ‘Test workflow’
  2. Get Variables
  3. Get Test Image
  4. Gemini 2.0 Object Detection
  5. Scale Normalised Coords
  6. Draw Bounding Boxes
  7. Get Image Info

Similar automations