mistralai/mistral-small-24b-instruct-2501
Mistral
Consistency
Needs 20 scored questions.
How often it gives the same answer when asked again. How it's measured →
Alignment
Needs 20 scored questions.
How often its answer is the one most other models gave. How it's measured →
Hedging
How often it qualifies its answer or declines to give one. How it's measured →
Answers most like
Answers least like
Measured across the questions both models were asked, at least 20 of them. How it's measured →
10 runs · consistency 50
10 runs · consistency 26.7
10 runs · consistency 19.4
10 runs · consistency 50
10 runs · consistency 100
10 runs · consistency 100
10 runs · consistency 40
10 runs
10 runs · consistency 36.1
10 runs · consistency 100
10 runs · consistency 100
10 runs · consistency 46.7
10 runs · consistency 100