inception/mercury-2.5
Inception
Consistency
How often it gives the same answer when asked again. Across 53 questions. How it's measured →
Alignment
How often its answer is the one most other models gave. Across 42 questions. How it's measured →
Hedging
How often it qualifies its answer or declines to give one. How it's measured →
Answers most like
Answers least like
Measured across the questions both models were asked, at least 20 of them. How it's measured →
Where this model stands apart
8 of the 42 scored questions where its answer wasn't the one most models gave.
9 runs · consistency 77.8
9 runs · consistency 77.8
9 runs · consistency 30.6
9 runs · consistency 25
10 runs · consistency 100
10 runs · consistency 100
10 runs · consistency 100
9 runs · consistency 100
10 runs · consistency 100
9 runs · consistency 100
10 runs · consistency 20
10 runs · consistency 44.4
10 runs · consistency 46.7
10 runs · consistency 33.3
9 runs · consistency 0
10 runs · consistency 46.7
10 runs · consistency 20
10 runs · consistency 22.2
10 runs · consistency 61.1
10 runs
10 runs · consistency 77.8
10 runs · consistency 100
10 runs
9 runs · consistency not scored
10 runs · consistency 50
10 runs · consistency 44.4
10 runs · consistency 100
9 runs · consistency 100
10 runs · consistency 100
9 runs · consistency 100
10 runs · consistency 100
9 runs · consistency 100
10 runs · consistency 100
10 runs · consistency 66.7
10 runs · consistency 66.7
10 runs · consistency 46.7
9 runs · consistency 100
9 runs · consistency 46.7
10 runs · consistency 100
10 runs · consistency 100
10 runs · consistency 100
9 runs · consistency 100
10 runs · consistency 100
10 runs · consistency 100
9 runs · consistency 100
10 runs · consistency 100
10 runs · consistency 50
10 runs · consistency 77.8