Benched.ai
View
About
Command Palette
Search for a command to run...
Models
Gemini 1.5 Pro (Sep '24)
Google
Vision Model
Proprietary
Context
Release Date
Sep 24, 2024
Knowledge Cutoff
Aug 01, 2024
Window
2M
Pricing
Per 1M tokens
Input
$1.25
Output
$5
Blended 3:1
$2.1875
Capabilities
Speed
92 t/s
Input
Output
Reasoning tokens
Latency
TTFT
0.48 ms
500 token response
5.94 s
Benchmarks
Intelligence
●●○○○
Math
●●●○○
Coding
●●○○○
MMLU Pro
75.0%
GPQA
58.9%
HLE
4.9%
SciCode
29.5%
AIME
23.0%
MATH 500
87.6%
LiveCodeBench
31.6%
HumanEval
89.8%
Gemini
1.5 Pro (Sep '24)