OpenAI compatible API · Attested · Public status

DeepInfra

DeepInfra models on TrustedRouter with prices, routes, policy notes, and source links.

Verify gateway

Onebase URL to migrate

100sof models and routes

0prompt or output logs. Always.

`deepinfra`

No provider claim

All providers

Provider	DeepInfra
Models	50 public models
Prepaid routes	49
BYOK routes	50
Zero data retention	no
Confidential compute	not claimed
Provider E2EE	not claimed
Policy note	Tracked as no-store, not strict ZDR. DeepInfra documents memory-only handling and no training for ordinary inference, but reserves the right to log a small portion of requests for debugging or security. Google- and Anthropic-backed routes also inherit those vendors' terms. Policy source

Measured performance

33 samples

Continuously sampled across DeepInfra's routed models: p50 TTFT, effective throughput, and success rate. Effective throughput uses provider-reported output tokens over complete request time. Unsupported route and probe-configuration rows are separated from provider downtime. No prompt or output content stored.

p50 TTFT	2773 ms
Effective throughput	—
Uptime	90.91%

Model	p50 TTFT	p50 TTFB	Effective throughput	Uptime	Config excluded	Availability samples
qwen/qwen3.5-27b	2643 ms	2642 ms	—	100.00%	—	4
google/gemma-3-12b-it	2651 ms	2651 ms	—	100.00%	—	6
google/gemma-4-26b-a4b-it	2773 ms	2773 ms	—	100.00%	—	6
google/gemma-3-4b-it	2888 ms	2888 ms	—	100.00%	—	1
google/gemma-3-27b-it	2992 ms	2991 ms	—	100.00%	—	5
z-ai/glm-5.2	3420 ms	3419 ms	—	100.00%	—	3
meta-llama/llama-3.1-70b-instruct	2716 ms	2716 ms	—	75.00%	—	4
google/gemma-4-31b-it	3136 ms	3136 ms	—	50.00%	—	4

DeepInfra performance history · Full provider & model leaderboard.

Provider models

Models served by DeepInfra.

Each row links to pricing, provider, benchmark, and API pages for the model.

Model	AI IQ	Context	Endpoints	Prompt	Completion	Routes
`Qwen/Qwen3-Embedding-8B` Qwen3 Embedding 8B providers pricing	—	32,000	2	$0.0105/1M	selected route	prepaid BYOK
`anthropic/claude-opus-5` Claude Opus 5 providers pricing	IQ 134#3	1,000,000	1	$5.25/1M	$26.25/1M	BYOK
`deepseek/deepseek-r1-0528` DeepSeek: R1 0528 providers pricing	—	163,840	2	$0.525/1M	$2.2575/1M	prepaid BYOK
`deepseek/deepseek-v3.1-terminus` DeepSeek: DeepSeek V3.1 Terminus providers pricing	—	163,840	2	$0.2835/1M	$0.9975/1M	prepaid BYOK
`deepseek/deepseek-v3.2` DeepSeek: DeepSeek V3.2 benchmarks providers pricing	IQ 103#57	163,840	2	$0.273/1M	$0.399/1M	prepaid BYOK
`deepseek/deepseek-v4-flash` DeepSeek: DeepSeek V4 Flash benchmarks providers pricing	IQ 108#46	1,048,576	2	$0.0945/1M	$0.189/1M	prepaid BYOK
`deepseek/deepseek-v4-flash-0731` DeepSeek: DeepSeek V4 Flash 0731 providers pricing	—	1,048,576	2	$0.0945/1M	$0.189/1M	prepaid BYOK
`deepseek/deepseek-v4-pro` DeepSeek: DeepSeek V4 Pro benchmarks providers pricing	IQ 115#30	1,048,576	2	$1.365/1M	$2.73/1M	prepaid BYOK
`google/gemini-2.5-flash` Google: Gemini 2.5 Flash providers pricing	—	1,048,576	2	$0.315/1M	$2.625/1M	prepaid BYOK
`google/gemini-2.5-pro` Google: Gemini 2.5 Pro benchmarks providers pricing	IQ 103#58	1,048,576	2	$1.3125/1M	$10.5/1M	prepaid BYOK
`google/gemini-3.1-flash-lite` Google: Gemini 3.1 Flash Lite providers pricing	IQ 101#65	1,048,576	2	$0.2625/1M	$1.575/1M	prepaid BYOK
`google/gemma-3-12b-it` Google: Gemma 3 12B providers pricing	—	131,072	2	$0.0525/1M	$0.1575/1M	prepaid BYOK
`google/gemma-3-27b-it` Google: Gemma 3 27B providers pricing	—	262,144	2	$0.084/1M	$0.168/1M	prepaid BYOK
`google/gemma-3-4b-it` Google: Gemma 3 4B providers pricing	—	131,072	2	$0.0525/1M	$0.105/1M	prepaid BYOK
`google/gemma-4-26b-a4b-it` Google: Gemma 4 26B A4B providers pricing	IQ 96#81	262,144	2	$0.0735/1M	$0.357/1M	prepaid BYOK
`google/gemma-4-31b-it` Google: Gemma 4 31B providers pricing	IQ 101#66	262,144	2	$0.1365/1M	$0.399/1M	prepaid BYOK
`gryphe/mythomax-l2-13b` MythoMax 13B providers pricing	—	8,192	2	$0.42/1M	$0.42/1M	prepaid BYOK
`meta-llama/llama-3.1-70b-instruct` Meta: Llama 3.1 70B Instruct providers pricing	—	131,072	2	$0.42/1M	$0.42/1M	prepaid BYOK
`meta-llama/llama-guard-4-12b` Meta: Llama Guard 4 12B providers pricing	—	1,048,576	2	$0.189/1M	$0.189/1M	prepaid BYOK
`microsoft/phi-4` Microsoft: Phi 4 providers pricing	—	16,384	2	$0.0735/1M	$0.147/1M	prepaid BYOK
`minimax/minimax-m2.7` MiniMax: MiniMax M2.7 providers pricing	IQ 109#44	204,800	2	$0.2625/1M	$1.05/1M	prepaid BYOK
`minimax/minimax-m3` MiniMax: MiniMax M3 benchmarks providers pricing	IQ 114#33	1,048,576	2	$0.315/1M	$1.26/1M	prepaid BYOK
`mistralai/mistral-small-24b-instruct-2501` Mistral: Mistral Small 3 providers pricing	—	32,768	2	$0.0525/1M	$0.084/1M	prepaid BYOK
`moonshotai/kimi-k2.5` MoonshotAI: Kimi K2.5 providers pricing	IQ 111#39	262,144	2	$0.4725/1M	$2.3625/1M	prepaid BYOK
`moonshotai/kimi-k2.6` MoonshotAI: Kimi K2.6 benchmarks providers pricing	IQ 119#19	262,144	2	$0.7875/1M	$3.675/1M	prepaid BYOK
`nousresearch/hermes-3-llama-3.1-405b` Nous: Hermes 3 405B Instruct providers pricing	—	131,072	2	$1.05/1M	$1.05/1M	prepaid BYOK
`nvidia/nemotron-3-nano-30b-a3b` NVIDIA: Nemotron 3 Nano 30B A3B providers pricing	—	262,144	2	$0.0525/1M	$0.21/1M	prepaid BYOK
`openai/gpt-oss-120b` OpenAI: gpt-oss-120b providers pricing	IQ 105#53	131,072	2	$0.03885/1M	$0.1785/1M	prepaid BYOK
`openai/gpt-oss-20b` OpenAI: gpt-oss-20b providers pricing	IQ 100#70	131,072	2	$0.0315/1M	$0.147/1M	prepaid BYOK
`qwen/qwen3-14b` Qwen: Qwen3 14B providers pricing	—	131,072	2	$0.126/1M	$0.252/1M	prepaid BYOK
`qwen/qwen3-235b-a22b-thinking-2507` Qwen: Qwen3 235B A22B Thinking 2507 providers pricing	—	262,144	2	$0.2415/1M	$2.415/1M	prepaid BYOK
`qwen/qwen3-30b-a3b` Qwen: Qwen3 30B A3B providers pricing	—	131,072	2	$0.126/1M	$0.525/1M	prepaid BYOK
`qwen/qwen3-next-80b-a3b-instruct` Qwen: Qwen3 Next 80B A3B Instruct providers pricing	—	262,144	2	$0.0945/1M	$1.155/1M	prepaid BYOK
`qwen/qwen3-vl-235b-a22b-instruct` Qwen: Qwen3 VL 235B A22B Instruct providers pricing	—	262,144	2	$0.21/1M	$0.924/1M	prepaid BYOK
`qwen/qwen3-vl-30b-a3b-instruct` Qwen: Qwen3 VL 30B A3B Instruct providers pricing	—	262,144	2	$0.1575/1M	$0.63/1M	prepaid BYOK
`qwen/qwen3.5-122b-a10b` Qwen: Qwen3.5-122B-A10B providers pricing	—	262,144	2	$0.3045/1M	$2.52/1M	prepaid BYOK
`qwen/qwen3.5-27b` Qwen: Qwen3.5-27B providers pricing	—	262,144	2	$0.273/1M	$2.73/1M	prepaid BYOK
`qwen/qwen3.5-35b-a3b` Qwen: Qwen3.5-35B-A3B providers pricing	—	262,144	2	$0.147/1M	$1.05/1M	prepaid BYOK
`qwen/qwen3.5-397b-a17b` Qwen: Qwen3.5 397B A17B providers pricing	—	262,144	2	$0.4725/1M	$3.15/1M	prepaid BYOK
`qwen/qwen3.5-9b` Qwen: Qwen3.5-9B providers pricing	IQ 93#90	262,144	2	$0.105/1M	$0.1575/1M	prepaid BYOK
`qwen/qwen3.6-27b` Qwen: Qwen3.6 27B providers pricing	IQ 111#40	262,144	2	$0.336/1M	$3.36/1M	prepaid BYOK
`qwen/qwen3.6-35b-a3b` Qwen: Qwen3.6 35B A3B providers pricing	IQ 100#71	262,144	2	$0.105/1M	$0.9975/1M	prepaid BYOK
`tencent/hy3` Tencent: Hy3 providers pricing	IQ 103#60	262,144	2	$0.147/1M	$0.609/1M	prepaid BYOK
`thinkingmachines/inkling` Thinking Machines: Inkling providers pricing	IQ 107#48	1,048,576	2	$0.9975/1M	$4.2525/1M	prepaid BYOK
`thinkingmachines/inkling-small` Thinking Machines: Inkling Small providers pricing	IQ 105#54	524,288	2	$0.4725/1M	$1.26/1M	prepaid BYOK
`z-ai/glm-4.6` Z.ai: GLM 4.6 providers pricing	—	204,800	2	$0.525/1M	$2.1/1M	prepaid BYOK
`z-ai/glm-4.7` Z.ai: GLM 4.7 providers pricing	IQ 103#59	204,800	2	$0.42/1M	$1.8375/1M	prepaid BYOK
`z-ai/glm-4.7-flash` Z.ai: GLM 4.7 Flash providers pricing	—	202,752	2	$0.063/1M	$0.42/1M	prepaid BYOK
`z-ai/glm-5` Z.ai: GLM 5 benchmarks providers pricing	IQ 105#52	204,800	2	$0.63/1M	$2.184/1M	prepaid BYOK
`z-ai/glm-5.2` Z.ai: GLM 5.2 benchmarks providers pricing	IQ 120#16	1,048,576	2	$1.26/1M	$4.41/1M	prepaid BYOK