Benched.ai
View
About
Command Palette
Search for a command to run...
Models
Claude 3.5 Sonnet (Oct '24)
Anthropic
Vision Model
Proprietary
Context
Release Date
Oct 22, 2024
Knowledge Cutoff
Apr 01, 2024
Window
200k
Pricing
Per 1M tokens
Input
$3
Output
$15
Blended 3:1
$6
Capabilities
Speed
78 t/s
Input
Output
Reasoning tokens
Latency
TTFT
1.84 ms
500 token response
8.21 s
Benchmarks
Intelligence
●●○○○
Math
●●○○○
Coding
●●○○○
MMLU Pro
77.2%
GPQA
59.9%
HLE
3.9%
SciCode
36.6%
AIME
15.7%
MATH 500
77.1%
LiveCodeBench
38.1%
HumanEval
93.0%