I've benchmarked 18 image generation models to compare cost and latency using the same prompt:
A photorealistic image of a golden retriever puppy sitting in a sunflower field at golden hour, with a soft bokeh background and warm light. Aspect ratio: 1:1, size: 1024x1024.
The benchmark includes both image-only and image-capable multimodal models available on Vercel AI Gateway.
If you don't have much time to analyze the full report:
- go straight to the winners
- compare images
- check out the cost chart
- or the latency chart
Full Results
Updated on April 17, 2026
Click on a thumbnail to see the full image.
* rounded to 2 decimal places
The latency here is wall time, measured by the benchmark script.
The cost, however, is returned by the gateway, so it should be accurate.
Cost
Latency
Model Quirks
This benchmark includes provider-specific adaptations, because several models need custom params to work correctly:
- Black Forest Labs Flux models need explicit pixel
widthandheightinstead of relying onaspectRatio - Recraft and OpenAI image models require
sizerather thanaspectRatio recraft/recraft-v4-proneeds2048x2048for square output, not1024x1024- xAI Grok models support
aspectRatiobut notsize - Gemini image responses can contain duplicate files in
result.files, so the benchmark deduplicates them before saving xai/grok-imagine-image-profailed when run last in a long benchmark sequence, so isolated runs may be more reliable for it
Winners
If you only optimize for cost, the two cheapest models in this benchmark are:
google/imagen-4.0-fast-generate-001at $0.02xai/grok-imagine-imageat $0.02
If you optimize for latency, the two fastest models are:
xai/grok-imagine-imageat 3.5sbfl/flux-pro-1.1at 4.5s
I personally think it all depends on your task and prompt. For my particular mass-scale case, I'm optimizing for both cost and speed, so I'll probably choose among these three models.
DIY
If you want to run the benchmark yourself, add more models, or adjust the prompt - the script is easy to configure and run: kometolabs/ai-image-generation-cost-analysis

