Does this model only detect one type of target at a time?
#23
by
zgh1997
- opened
How can I detect multiple targets in one inference?
The expensive part of inference is prefilling the image tokens. You can cache that, and reuse it for multiple detections:
https://huggingface.co/moondream/moondream3-preview#caching-image-encodings-advanced