Library / Image, Video & Audio
Image, Video & Audio
Detect Objects in Images by Prompt with Gemini 2.0
When you run it, Gemini 2.0 finds the objects you describe in a test image and the workflow draws bounding boxes on it.
What it does
## 2. Use Prompt-Based Object Detection Read more about the HTTP node We've had generalised object detection before (see my other template using ResNet) but being able to prompt for what you're looking for is a very exciting proposition! Not only could this reduce the effort in post-detection filtering but also introduce contextual use-cases such as searching by "emotion", "locality", "anomolies" and many more! I found the the output json schema of { "box_2d": { "type": "array", ... } } works best for Gemini to return coordinates.
The steps
- When clicking ‘Test workflow’
- Get Variables
- Get Test Image
- Gemini 2.0 Object Detection
- Scale Normalised Coords
- Draw Bounding Boxes
- Get Image Info
Similar automations
Image, Video & AudioDetect Objects in Images by Prompt with Gemini 2.07 stepsImage, Video & AudioDetect and Crop Objects in Images with Elasticsearch Scores47 stepsImage, Video & AudioDetect Objects in Images with Gemini and Draw Boxes26 stepsImage, Video & AudioDetect Objects in Images with Gemini 2.026 steps