LLM Leaderboard - Comparison of AI Models
Comparison and ranking the performance of over 30 AI models (LLMs) across key metrics including quality, price, performance and speed (output speed - tokens per second & latency - TTFT), context window & others. For more details including relating to our methodology, see our FAQs.
| Model | Provider | License | AI Index | MMLU-Pro | GPQA | LiveCode | Context | Price/1M | Tokens/s | TTFT (s) | |
|---|---|---|---|---|---|---|---|---|---|---|---|
| o4-mini (high) | OpenAI | Proprietary | 70 | 83% | 78% | 80% | 200k | $1.93 | 150.3 | 32.62 | |
| Gemini 2.5 Pro | Proprietary | 68 | 86% | 84% | 70% | 1m | $3.44 | 156.9 | 36.54 | ||
| o3 | OpenAI | Proprietary | 67 | 85% | 83% | 53% | 128k | $17.50 | 197.7 | 13 | |
| Grok 3 mini Reasoning (high) | xAI | Proprietary | 67 | 83% | 79% | 70% | 1m | $0.35 | 115.6 | 17.52 | |
| o3-mini (high) | OpenAI | Proprietary | 66 | 80% | 77% | 73% | 200k | $1.93 | 151.4 | 49.75 | |
| o3-mini | OpenAI | Proprietary | 63 | 79% | 75% | 72% | 200k | $1.93 | 138.8 | 14.22 | |
| Qwen3 235B A22B (Reasoning) | Alibaba | Open | 62 | 83% | 70% | 62% | 128k | $0.30 | 39.3 | 51.51 | |
| o1 | OpenAI | Proprietary | 62 | 84% | 75% | 68% | 200k | $26.25 | 115 | 25.5 | |
| Llama 3.1 Nemotron Ultra 253B Reasoning | NVIDIA | Open | 61 | 83% | 73% | 64% | 128k | $0.00 | |||
| Gemini 2.5 Flash (Reasoning) | Proprietary | 60 | 80% | 70% | 51% | 1m | $0.99 | 342.9 | 8.15 | ||
| DeepSeek R1 | DeepSeek | Open | 60 | 84% | 71% | 62% | 128k | $0.96 | 23.8 | 102.63 | |
| Qwen3 32B (Reasoning) | Alibaba | Open | 59 | 80% | 67% | 55% | 128k | $0.17 | 34.5 | 58.59 | |
| QwQ-32B | Alibaba | Open | 58 | 76% | 59% | 63% | 131k | $0.47 | 89.7 | 28.19 | |
| Claude 3.7 Sonnet Thinking | Anthropic | Proprietary | 57 | 84% | 77% | 47% | 200k | $6.00 | |||
| Qwen3 14B (Reasoning) | Alibaba | Open | 56 | 77% | 60% | 52% | 128k | $0.12 | 85.2 | 24 | |
| Qwen3 30B A3B (Reasoning) | Alibaba | Open | 56 | 78% | 62% | 51% | 128k | $0.19 | 112.8 | 18.26 | |
| o1-mini | OpenAI | Proprietary | 54 | 74% | 60% | 58% | 128k | $1.93 | 206.5 | 9.95 | |
| DeepSeek V3 (Mar' 25) | DeepSeek | Open | 53 | 82% | 66% | 41% | 128k | $0.48 | 26.2 | 3.42 | |
| GPT-4.1 mini | OpenAI | Proprietary | 53 | 78% | 66% | 48% | 1m | $0.70 | 75.8 | 0.56 | |
| GPT-4.1 | OpenAI | Proprietary | 53 | 81% | 67% | 46% | 1m | $3.50 | 136.5 | 0.57 | |
| Gemini 2.0 Flash Thinking exp. (Jan '25) | Proprietary | 52 | 80% | 70% | 32% | 1m | $0.00 | ||||
| DeepSeek R1 Distill Qwen 32B | DeepSeek | Open | 52 | 74% | 62% | 27% | 128k | $0.22 | 43.4 | 46.61 | |
| Llama 3.3 Nemotron Super 49B Reasoning | NVIDIA | Open | 51 | 79% | 64% | 28% | 128k | $0.00 | |||
| Grok 3 | xAI | Proprietary | 51 | 80% | 69% | 43% | 1m | $6.00 | 50.7 | 0.49 | |
| Llama 4 Maverick | Meta | Open | 51 | 81% | 67% | 40% | 1m | $0.35 | 129.3 | 0.34 | |
| GPT-4o (March 2025) | OpenAI | Proprietary | 50 | 80% | 66% | 43% | 128k | $7.50 | 142.6 | 0.32 | |
| Gemini 2.0 Pro Experimental | Proprietary | 49 | 81% | 62% | 35% | 2m | $0.00 | 25.2 | 16.62 | ||
| DeepSeek R1 Distill Qwen 14B | DeepSeek | Open | 49 | 74% | 48% | 38% | 128k | $0.88 | 128.1 | 16.06 | |
| Gemini 2.5 Flash | Proprietary | 48 | 78% | 59% | 37% | 1m | $0.26 | 265.4 | 0.28 | ||
| DeepSeek R1 Distill Llama 70B | DeepSeek | Open | 48 | 80% | 40% | 27% | 128k | $0.60 | 115.9 | 17.66 | |
| Claude 3.7 Sonnet | Anthropic | Proprietary | 48 | 80% | 66% | 39% | 200k | $6.00 | 78 | 1.03 | |
| Gemini 2.0 Flash | Proprietary | 48 | 78% | 62% | 33% | 1m | $0.17 | 232.6 | 0.37 | ||
| Qwen3 4B (Reasoning) | Alibaba | Open | 47 | 70% | 52% | 47% | 32k | $0.00 | |||
| Reka Flash 3 | Reka AI | Open | 47 | 67% | 53% | 44% | 128k | $0.35 | 56.7 | 36.24 | |
| Gemini 2.0 Flash (exp) | Proprietary | 46 | 78% | 64% | 21% | 1m | $0.00 | 236.5 | 0.25 | ||
| DeepSeek V3 (Dec '24) | DeepSeek | Open | 46 | 75% | 56% | 36% | 128k | $0.48 | 26.6 | 3.52 | |
| Qwen2.5 Max | Alibaba | Proprietary | 45 | 76% | 59% | 36% | 32k | $2.80 | 50 | 1.24 | |
| Gemini 1.5 Pro (Sep) | Proprietary | 45 | 75% | 59% | 32% | 2m | $2.19 | 92.8 | 0.65 | ||
| Claude 3.5 Sonnet (Oct) | Anthropic | Proprietary | 44 | 77% | 60% | 38% | 200k | $6.00 | 78.6 | 1.12 | |
| Sonar | Perplexity | Proprietary | 43 | 69% | 47% | 30% | 127k | $1.00 | 148.4 | 1.67 | |
| Llama 4 Scout | Meta | Open | 43 | 75% | 59% | 30% | 10m | $0.27 | 120.1 | 0.36 | |
| Sonar Pro | Perplexity | Proprietary | 43 | 76% | 58% | 28% | 200k | $6.00 | 87.5 | 2.27 | |
| QwQ 32B-Preview | Alibaba | Open | 43 | 65% | 56% | 34% | 33k | $0.26 | 56.2 | 36.06 | |
| Nova Premier | Amazon | Proprietary | 43 | 73% | 57% | 32% | 1m | $5.00 | 67.2 | 0.87 | |
| GPT-4o (Nov '24) | OpenAI | Proprietary | 41 | 75% | 54% | 31% | 128k | $4.38 | 137.2 | 0.55 | |
| Gemini 2.0 Flash-Lite (Feb '25) | Proprietary | 41 | 72% | 54% | 19% | 1m | $0.13 | 209.5 | 0.27 | ||
| Llama 3.3 70B | Meta | Open | 41 | 71% | 50% | 29% | 128k | $0.60 | 126.7 | 0.44 | |
| GPT-4.1 nano | OpenAI | Proprietary | 41 | 66% | 51% | 33% | 1m | $0.17 | 198.5 | 0.44 | |
| GPT-4o (May '24) | OpenAI | Proprietary | 41 | 74% | 53% | 33% | 128k | $7.50 | 81.9 | 0.57 | |
| Llama 3.1 405B | Meta | Open | 40 | 73% | 52% | 31% | 128k | $3.50 | 32.3 | 0.67 | |
| Qwen2.5 72B | Alibaba | Open | 40 | 72% | 49% | 28% | 131k | $0.00 | 41.2 | 1.18 | |
| MiniMax-Text-01 | MiniMax | Open | 40 | 76% | 58% | 25% | 4m | $0.42 | 31.9 | 0.82 | |
| Phi-4 | Microsoft Azure | Open | 40 | 71% | 57% | 23% | 16k | $0.22 | 39.9 | 0.44 | |
| Command A | Cohere | Open | 40 | 71% | 53% | 29% | 256k | $4.38 | 100.6 | 0.21 | |
| Tulu3 405B | Allen Institute for AI | Open | 40 | 72% | 52% | 29% | 128k | $0.00 | |||
| Llama 3.3 Nemotron Super 49B v1 | NVIDIA | Open | 39 | 70% | 52% | 28% | 128k | $0.00 | |||
| Grok 2 | xAI | Proprietary | 39 | 71% | 51% | 27% | 131k | $0.00 | |||
| Gemini 1.5 Flash (Sep) | Proprietary | 39 | 68% | 46% | 27% | 1m | $0.13 | 194.2 | 0.2 | ||
| Mistral Large 2 (Nov '24) | Mistral | Open | 38 | 70% | 49% | 29% | 128k | $3.00 | 73.2 | 0.4 | |
| Qwen3 1.7B (Reasoning) | Alibaba | Open | 38 | 57% | 36% | 31% | 32k | $0.00 | |||
| Gemma 3 27B | Open | 38 | 67% | 43% | 14% | 128k | $0.00 | ||||
| Grok Beta | xAI | Proprietary | 38 | 70% | 47% | 24% | 128k | $7.50 | 67.5 | 0.3 | |
| Pixtral Large | Mistral | Open | 37 | 70% | 51% | 26% | 128k | $3.00 | 41.3 | 0.36 | |
| Qwen2.5 Instruct 32B | Alibaba | Open | 37 | 70% | 47% | 25% | 128k | $0.15 | |||
| Llama 3.1 Nemotron 70B | NVIDIA | Open | 37 | 69% | 47% | 17% | 128k | $0.24 | 43.2 | 0.55 | |
| Nova Pro | Amazon | Proprietary | 37 | 69% | 50% | 23% | 300k | $1.40 | |||
| Mistral Large 2 (Jul '24) | Mistral | Open | 37 | 68% | 47% | 27% | 128k | $3.00 | 36.2 | 0.47 | |
| Qwen2.5 Coder 32B | Alibaba | Open | 36 | 64% | 42% | 30% | 131k | $0.20 | 52.6 | 0.52 | |
| GPT-4o mini | OpenAI | Proprietary | 36 | 65% | 43% | 23% | 128k | $0.26 | 68.1 | 0.36 | |
| Llama 3.1 70B | Meta | Open | 35 | 68% | 41% | 23% | 128k | $0.72 | 65.6 | 0.51 | |
| Mistral Small 3.1 | Mistral | Open | 35 | 66% | 45% | 21% | 128k | $0.15 | 167.8 | 0.27 | |
| Mistral Small 3 | Mistral | Open | 35 | 65% | 46% | 25% | 32k | $0.15 | 130.8 | 0.3 | |
| Claude 3 Opus | Anthropic | Proprietary | 35 | 70% | 49% | 28% | 200k | $30.00 | 26.6 | 0.99 | |
| Claude 3.5 Haiku | Anthropic | Proprietary | 35 | 63% | 41% | 31% | 200k | $1.60 | 66.2 | 0.83 | |
| DeepSeek R1 Distill Llama 8B | DeepSeek | Open | 34 | 54% | 30% | 23% | 128k | $0.04 | 51.6 | 39.48 | |
| Gemma 3 12B | Open | 34 | 60% | 35% | 14% | 128k | $0.06 | 29 | 0.56 | ||
| Gemini 1.5 Pro (May) | Proprietary | 34 | 66% | 37% | 24% | 2m | $2.19 | 68.1 | 0.37 | ||
| Qwen Turbo | Alibaba | Proprietary | 34 | 63% | 41% | 16% | 1m | $0.09 | 108.3 | 1.1 | |
| Llama 3.2 90B (Vision) | Meta | Open | 33 | 67% | 43% | 21% | 128k | $0.81 | 30.2 | 0.41 | |
| Qwen2 72B | Alibaba | Open | 33 | 62% | 37% | 16% | 131k | $0.00 | 31.1 | 1.32 | |
| Nova Lite | Amazon | Proprietary | 33 | 59% | 43% | 17% | 300k | $0.10 | 283.9 | 0.31 | |
| Gemini 1.5 Flash-8B | Proprietary | 31 | 57% | 36% | 22% | 1m | $0.07 | 273.5 | 0.18 | ||
| DeepHermes 3 - Mistral 24B | Nous Research | Open | 30 | 58% | 38% | 20% | 32k | $0.00 | |||
| Jamba 1.5 Large | AI21 Labs | Open | 29 | 57% | 43% | 14% | 256k | $3.50 | 67.2 | 0.53 | |
| Hermes 3 - Llama-3.1 70B | Nous Research | Open | 29 | 57% | 40% | 19% | 128k | $0.00 | |||
| Jamba 1.6 Large | AI21 Labs | Open | 29 | 56% | 39% | 17% | 256k | $3.50 | 60.8 | 0.53 | |
| Gemini 1.5 Flash (May) | Proprietary | 28 | 57% | 32% | 20% | 1m | $0.13 | 311.9 | 0.27 | ||
| Nova Micro | Amazon | Proprietary | 28 | 53% | 36% | 14% | 130k | $0.06 | 337.1 | 0.3 | |
| Yi-Large | 01.AI | Proprietary | 28 | 59% | 36% | 11% | 32k | $3.00 | 68.3 | 0.47 | |
| Claude 3 Sonnet | Anthropic | Proprietary | 28 | 58% | 40% | 18% | 200k | $6.00 | 61.3 | 0.61 | |
| Codestral (Jan '25) | Mistral | Proprietary | 28 | 45% | 31% | 24% | 256k | $0.45 | 190.3 | 0.29 | |
| Llama 3 70B | Meta | Open | 27 | 57% | 38% | 20% | 8k | $0.88 | 46.3 | 0.46 | |
| Mistral Small (Sep '24) | Mistral | Open | 27 | 53% | 38% | 14% | 33k | $0.30 | 65.3 | 0.33 | |
| Phi-4 Multimodal | Microsoft Azure | Open | 27 | 49% | 32% | 13% | 128k | $0.00 | 21.9 | 0.34 | |
| Qwen2.5 Coder 7B | Alibaba | Open | 27 | 47% | 34% | 13% | 131k | $0.03 | 200 | 0.49 | |
| Mistral Large (Feb '24) | Mistral | Proprietary | 26 | 52% | 35% | 18% | 33k | $6.00 | 30.3 | 0.48 | |
| Mixtral 8x22B | Mistral | Open | 26 | 54% | 33% | 15% | 65k | $3.00 | 56.9 | 0.35 | |
| Phi-4 Mini | Microsoft Azure | Open | 26 | 47% | 33% | 13% | 128k | $0.00 | 57.7 | 0.33 | |
| Phi-3 Medium 14B | Microsoft Azure | Open | 25 | 54% | 33% | 15% | 128k | $0.30 | 52.2 | 0.41 | |
| Gemma 3 4B | Open | 24 | 42% | 29% | 7% | 128k | $0.03 | 148 | 0.22 | ||
| Claude 2.1 | Anthropic | Proprietary | 24 | 50% | 32% | 20% | 200k | $12.00 | 13.9 | 0.88 | |
| Llama 3.1 8B | Meta | Open | 24 | 48% | 26% | 12% | 128k | $0.10 | 188.4 | 0.35 | |
| Pixtral 12B | Mistral | Open | 23 | 47% | 34% | 12% | 128k | $0.15 | 102.2 | 0.3 | |
| Qwen3 0.6B (Reasoning) | Alibaba | Open | 23 | 35% | 24% | 12% | 32k | $0.00 | |||
| Mistral Small (Feb '24) | Mistral | Proprietary | 23 | 42% | 30% | 11% | 33k | $1.50 | 153.6 | 0.27 | |
| Mistral Medium | Mistral | Proprietary | 23 | 49% | 35% | 10% | 33k | $4.09 | 41.4 | 0.37 | |
| Ministral 8B | Mistral | Open | 22 | 39% | 28% | 11% | 128k | $0.10 | 133.5 | 0.32 | |
| Gemma 2 9B | Open | 22 | 50% | 31% | 13% | 8k | $0.12 | ||||
| Phi-3 Mini | Microsoft Azure | Open | 22 | 44% | 32% | 12% | 4k | $0.00 | |||
| LFM 40B | Liquid AI | Proprietary | 22 | 43% | 33% | 10% | 32k | $0.15 | 163.4 | 0.17 | |
| Command-R+ | Cohere | Open | 21 | 43% | 34% | 11% | 128k | $4.38 | 49.2 | 0.27 | |
| Llama 3 8B | Meta | Open | 21 | 41% | 30% | 10% | 8k | $0.09 | 103.3 | 0.34 | |
| Gemini 1.0 Pro | Proprietary | 21 | 43% | 28% | 12% | 33k | $0.75 | ||||
| Codestral (May '24) | Mistral | Open | 20 | 33% | 26% | 21% | 33k | $0.30 | 106.8 | 0.33 | |
| Aya Expanse 32B | Cohere | Open | 20 | 38% | 23% | 14% | 128k | $0.75 | 121.5 | 0.16 | |
| Llama 2 Chat 13B | Meta | Open | 20 | 41% | 32% | 10% | 4k | $0.00 | |||
| Command-R+ (Apr '24) | Cohere | Open | 20 | 43% | 32% | 12% | 128k | $6.00 | 66.9 | 0.24 | |
| DBRX | Databricks | Open | 20 | 40% | 33% | 9% | 33k | $1.13 | |||
| Ministral 3B | Mistral | Proprietary | 20 | 34% | 26% | 7% | 128k | $0.04 | 225.9 | 0.26 | |
| Mistral NeMo | Mistral | Open | 20 | 40% | 31% | 6% | 128k | $0.15 | 143.2 | 0.29 | |
| Llama 3.2 3B | Meta | Open | 20 | 35% | 26% | 8% | 128k | $0.05 | 130.6 | 0.37 | |
| DeepSeek R1 Distill Qwen 1.5B | DeepSeek | Open | 19 | 27% | 10% | 7% | 128k | $0.18 | 379.9 | 5.51 | |
| Jamba 1.5 Mini | AI21 Labs | Open | 18 | 37% | 30% | 6% | 256k | $0.25 | 179 | 0.33 | |
| Jamba 1.6 Mini | AI21 Labs | Open | 18 | 37% | 30% | 7% | 256k | $0.25 | 195.4 | 0.33 | |
| Mixtral 8x7B | Mistral | Open | 17 | 39% | 29% | 7% | 33k | $0.70 | 81.7 | 0.34 | |
| DeepHermes 3 - Llama-3.1 8B | Nous Research | Open | 16 | 37% | 27% | 9% | 128k | $0.00 | |||
| Aya Expanse 8B | Cohere | Open | 16 | 31% | 25% | 7% | 8k | $0.75 | 167.1 | 0.12 | |
| Command-R | Cohere | Open | 15 | 34% | 29% | 4% | 128k | $0.26 | 73.8 | 0.2 | |
| Command-R (Mar '24) | Cohere | Open | 15 | 34% | 28% | 5% | 128k | $0.75 | 166.2 | 0.14 | |
| Codestral-Mamba | Mistral | Open | 14 | 21% | 21% | 13% | 256k | $0.25 | 94.5 | 0.43 | |
| Mistral 7B | Mistral | Open | 10 | 25% | 18% | 5% | 8k | $0.25 | 107.7 | 0.32 | |
| Llama 3.2 1B | Meta | Open | 10 | 20% | 20% | 2% | 128k | $0.03 | 155.5 | 0.44 | |
| Llama 2 Chat 7B | Meta | Open | 8 | 16% | 23% | 0% | 4k | $0.10 | 133 | 0.39 | |
| GPT-4o mini Realtime (Dec '24) | OpenAI | Proprietary | 128k | $0.00 | |||||||
| o1-pro | OpenAI | Proprietary | 200k | $262.50 | |||||||
| GPT-4o (ChatGPT) | OpenAI | Proprietary | 77% | 51% | 128k | $7.50 | |||||
| GPT-4o Realtime (Dec '24) | OpenAI | Proprietary | 128k | $0.00 | |||||||
| Llama 3.2 11B (Vision) | Meta | Open | 46% | 22% | 11% | 128k | $0.16 | 82.7 | 0.44 | ||
| MiMo 7B RL | Xiaomi | Open | 33k | $0.00 | |||||||
| Gemma 3 1B | Open | 10% | 19% | 1% | 32k | $0.00 | |||||
| Mistral Saba | Mistral | Proprietary | 61% | 42% | 32k | $0.30 | 91.3 | 0.33 | |||
| Sonar Reasoning Pro | Perplexity | Proprietary | 127k | $0.00 | |||||||
| R1 1776 | Perplexity | Open | 128k | $3.50 | |||||||
| Sonar Reasoning | Perplexity | Proprietary | 62% | 127k | $2.00 | 86.9 | 24.54 | ||||
| Grok 3 Reasoning Beta | xAI | Proprietary | 1m | $0.00 | |||||||
| Grok 3 mini Reasoning (low) | xAI | Proprietary | 1m | $0.35 | 110.6 | 18.33 | |||||
| Reka Flash | Reka AI | Proprietary | 128k | $0.35 | 33.4 | 0.95 | |||||
| Reka Core | Reka AI | Proprietary | 128k | $2.00 | 27.7 | 0.96 | |||||
| Reka Flash (Feb '24) | Reka AI | Proprietary | 128k | $0.35 | 45.9 | 0.93 | |||||
| Reka Edge | Reka AI | Proprietary | 128k | $0.10 | 86.5 | 0.85 | |||||
| Arctic | Snowflake | Open | 4k | $0.00 | |||||||
| Qwen3 8B (Reasoning) | Alibaba | Open | 74% | 59% | 26% | 128k | $0.00 | ||||
| o1-preview | OpenAI | Proprietary | 128k | $26.25 | 160.4 | 19.13 | |||||
| GPT-4o (Aug '24) | OpenAI | Proprietary | 52% | 32% | 128k | $4.38 | 89.7 | 0.55 | |||
| GPT-4 Turbo | OpenAI | Proprietary | 69% | 29% | 128k | $15.00 | 46.5 | 0.66 | |||
| GPT-3.5 Turbo | OpenAI | Proprietary | 46% | 30% | 4k | $0.75 | 125.9 | 0.4 | |||
| GPT-4.5 (Preview) | OpenAI | Proprietary | 71% | 128k | $93.75 | 70 | 1.01 | ||||
| GPT-4 | OpenAI | Proprietary | 8k | $37.50 | 30.7 | 0.71 | |||||
| Llama 2 Chat 70B | Meta | Open | 41% | 33% | 10% | 4k | $0.00 | ||||
| Gemini 2.0 Flash-Lite (Preview) | Proprietary | 54% | 18% | 1m | $0.13 | 212.4 | 0.28 | ||||
| Gemma 2 27B | Open | 57% | 36% | 8k | $0.26 | ||||||
| Gemini 1.0 Ultra | Proprietary | 33k | $0.00 | ||||||||
| Gemini 2.0 Flash Thinking exp. (Dec '24) | Proprietary | 2m | $0.00 | ||||||||
| Claude 3.5 Sonnet (June) | Anthropic | Proprietary | 75% | 56% | 200k | $6.00 | 80.8 | 0.82 | |||
| Claude 3 Haiku | Anthropic | Proprietary | 15% | 200k | $0.50 | 137.9 | 0.5 | ||||
| Claude Instant | Anthropic | Proprietary | 43% | 33% | 11% | 100k | $1.20 | 57.7 | 0.52 | ||
| Claude 2.0 | Anthropic | Proprietary | 49% | 34% | 17% | 100k | $12.00 | 30.8 | 0.86 | ||
| Llama 65B | Meta | Open | 2k | $0.00 | |||||||
| DeepSeek-V2.5 (Dec '24) | DeepSeek | Open | 128k | $0.17 | |||||||
| DeepSeek-Coder-V2 | DeepSeek | Open | 128k | $0.17 | |||||||
| DeepSeek LLM 67B (V1) | DeepSeek | Open | 4k | $0.00 | |||||||
| DeepSeek-V2.5 | DeepSeek | Open | 128k | $0.17 | |||||||
| DeepSeek Coder V2 Lite | DeepSeek | Open | 43% | 32% | 16% | 128k | $0.09 | 109.3 | 0.62 | ||
| DeepSeek-V2 | DeepSeek | Open | 128k | $0.17 | |||||||
| OpenChat 3.5 | OpenChat | Open | 31% | 23% | 12% | 8k | $0.06 | 48.3 | 0.53 | ||
| Solar Mini | Upstage | Open | 4k | $0.15 | 13.6 | 1.76 | |||||
| Jamba Instruct | AI21 Labs | Proprietary | 34% | 27% | 5% | 256k | $0.55 | 175.6 | 0.33 | ||
| Qwen1.5 Chat 110B | Alibaba | Open | 29% | 32k | $0.00 | 23.7 | 1.55 | ||||
| Qwen Chat 72B | Alibaba | Open | 34k | $1.00 |