· Hardware
RTX 3090
NVIDIA Ampere · validated on NVIDIA RTX 3090 · 12 models in production · last verified Sep 9, 2026.
| Model | Precision | Capabilities | Since | Last verified | Benchmark |
|---|---|---|---|---|---|
| Gemma 4 E2BGemma | BF16 | Query · Caption | v2.2 | Sep 9, 2026 | – |
| Gemma 4 E4BGemma | BF16 | Query · Caption | v2.2 | Sep 9, 2026 | – |
| Moondream 2Moondream VLM | BF16 | Query · Caption · Detect · Point · Segment | v2.2 | Sep 9, 2026 | – |
| Moondream 3Moondream VLM | BF16 | Query · Caption · Detect · Point · Segment | v2.2 | Sep 9, 2026 | – |
| Parakeet TDT 0.6B v3Parakeet | BF16 | Transcribe | v2.2 | Sep 9, 2026 | – |
| Qwen 3.5 0.8BQwen 3 | BF16 | Query · Caption | v2.2 | Sep 9, 2026 | – |
| Qwen 3.5 2BQwen 3 | BF16 | Query · Caption | v2.2 | Sep 9, 2026 | – |
| Qwen 3.5 4BQwen 3 | BF16 | Query · Caption | v2.2 | Sep 9, 2026 | – |
| Qwen 3.5 9BQwen 3 | BF16 | Query · Caption | v2.2 | Sep 9, 2026 | – |
| Qwen3-ASR 0.6BQwen3-ASR | BF16 | Transcribe | v2.2 | Sep 9, 2026 | – |
| Qwen3-ASR 1.7BQwen3-ASR | BF16 | Transcribe | v2.2 | Sep 9, 2026 | – |
| Whisper large-v3-turboWhisper | BF16 | Transcribe | v2.2 | Sep 9, 2026 | – |
Run on RTX 3090
Install the SDK and run any listed model locally.
$pip install moondream