Large-image CPU decode fix
Requests with images above 4 MP no longer fail on the CPU decode path before reaching the megakernel.
- Images above 16 MP are still rejected at the API boundary.
Requests with images above 4 MP no longer fail on the CPU decode path before reaching the megakernel.
Photon 2.0 adds production support for Qwen 3.5 (0.8B-9B) and Gemma 4 E2B/E4B.
Photon 2.0 is tested on H100 SXM 80GB across all launch models.
Matched cold-start tests reached first response faster on Photon than vLLM and SGLang for the launch models.
Moondream 3 on Photon serves segmentation masks alongside query, caption, detect, and point.
Request handling, tokenization, and image decode stay on the CPU. Model execution runs inside one compiler-generated GPU program.
md.photon() needs moondream 0.11 or later. Earlier SDKs stay on Moondream-only local inference.
Moondream 2 on A10 and Jetson AGX Orin is no longer supported for new deployments.
Production support · feeds: RSS · JSON