Benched.ai
View
About
Command Palette
Search for a command to run...
Models
Claude 3.5 Sonnet (June '24)
Anthropic
Vision Model
Proprietary
Context
Release Date
Jun 21, 2024
Knowledge Cutoff
Apr 01, 2024
Window
200k
Pricing
Per 1M tokens
Input
$3
Output
$15
Blended 3:1
$6
Capabilities
Speed
79 t/s
Input
Output
Reasoning tokens
Latency
TTFT
1.37 ms
500 token response
7.69 s
Benchmarks
Intelligence
●●○○○
Math
●●○○○
MMLU Pro
75.1%
GPQA
56.0%
HLE
3.7%
SciCode
31.6%
AIME
9.7%
MATH 500
69.5%
HumanEval
89.9%