mistralai/mistral-small-3.2-24b-instruct
Mistral
Consistency
How often it gives the same answer when asked again. Across 44 questions. How it's measured →
Alignment
How often its answer is the one most other models gave. Across 40 questions. How it's measured →
Hedging
How often it qualifies its answer or declines to give one. How it's measured →
Answers most like
Answers least like
Measured across the questions both models were asked, at least 20 of them. How it's measured →
Where this model stands apart
12 of the 40 scored questions where its answer wasn't the one most models gave.
20 runs · consistency 77.8
20 runs · consistency 100
20 runs · consistency 36.1
20 runs · consistency 61.1
20 runs · consistency 26.7
10 runs · consistency 44.4
20 runs · consistency 40
20 runs · consistency 46.7
20 runs · consistency 40
20 runs · consistency 100
10 runs · consistency 50
20 runs · consistency 100
20 runs · consistency 46.7
10 runs · consistency 100
10 runs · consistency 100
20 runs · consistency 51.5
20 runs · consistency 100
20 runs · consistency 100
20 runs · consistency not scored
20 runs · consistency 100
20 runs · consistency 100
20 runs · consistency 46.7
19 runs · consistency 100
18 runs · consistency 40
20 runs · consistency 100
5 runs
10 runs · consistency 46.7
20 runs · consistency 100
10 runs · consistency 46.7
10 runs · consistency 100
20 runs · consistency 16.7
10 runs · consistency 100