Benched.ai
View
About
Command Palette
Search for a command to run...
Models
Phi-3 Medium Instruct 14B
Microsoft Azure
Open
Context
Release Date
May 21, 2024
Knowledge Cutoff
Oct 01, 2023
Window
128k
Pricing
Per 1M tokens
Input
$0.17
Output
$0.68
Blended 3:1
$0.2975
Capabilities
Speed
53 t/s
Input
Output
Reasoning tokens
Latency
TTFT
0.42 ms
500 token response
9.91 s
Benchmarks
Intelligence
●○○○○
Math
●○○○○
Coding
●○○○○
MMLU Pro
54.3%
GPQA
32.6%
HLE
4.5%
SciCode
11.8%
AIME
1.3%
MATH 500
46.3%
LiveCodeBench
15.0%
HumanEval
0.0%