Gemini 1.5 Pro 002

Old

Google

•

Proprietary

# 75

Released

Sep 24, 2024

# 7

Knowledge Cutoff

Sep 24

# 2

Context Length

2M

Benchmarks

# 73

Code RankedAGI

46.2%

# 38

Code Arena

893.34

# 27

LiveCodeBench v5

42.1%

# 36

Code LMArena

1253

# 33

Code LiveBench (old)

48.8%

# 61

GPQA Diamond

59.1%

# 35

Reason LiveBench (old)

46.0%

# 34

Text Arena

1301

# 11

MATH

86.5%

# 24

Human Eval

84.1%

# 15

Human Eval+

79.3%

# 14

NYT Connections

19.2%

# 24

MMLU Pro

75.8%

# 23

MMLU

86.0%

# 35

Halluc. Hughes

6.6%

# 7

Aidan Bench

1515

# 30

Avg LiveBench (old)

55.5%

# 21

IF Evaluation

81.9%

# 32

Data LiveBench

52.3%

# 25

Language LiveBench

43.3%

# 5

Quality Artificial Analysis

80

Pricing

# 26

Input Cost /M

$1.25

# 25

Output Cost /M

$2.5

# 18

Cached Cost /M

$0.875

Additional Details

Model ID

gemini-1.5-pro-002

Last Updated

about 1 year ago