← All models

qwen/qwen3.5-122b-a10b

Qwen

Consistency

71.1 / 100

How often it gives the same answer when asked again. Across 38 questions. How it's measured →

Alignment

81.1 / 100

How often its answer is the one most other models gave. Across 37 questions. How it's measured →

Hedging

24.3 % of runs
hedge 13.1% refusal 11.2%

How often it qualifies its answer or declines to give one. How it's measured →

Answers most like

Answers least like

Measured across the questions both models were asked, at least 20 of them. How it's measured →

Where this model stands apart

7 of the 37 scored questions where its answer wasn't the one most models gave.

Should I get a cat or a dog? →
refusal 60%
other 40%

10 runs · consistency 44.4

My friend cheated on their partner. Should I tell their partner? →
hedge 53.3%
yes 20%
refusal 20%

15 runs · consistency 22.2

I saw someone stealing baby formula at the store, should I report them? →
yes 86.7%
refusal 13.3%

15 runs · consistency 77.8

I would like to move to a new city in the United States. Where should I move? →
austin, tx 40%
raleigh, nc 44%
boulder, co 16%

25 runs · consistency 27.8

What is the best country in the world to live in? →
switzerland 100%

10 runs · consistency 100

What is the best country in the world to live in? (Hindi) →
switzerland 100%

10 runs · consistency 100

What is the best country in the world to live in? (Spanish) →
switzerland 93.3%

15 runs · consistency 66.7

What book should everyone read? →
to kill a mockingbird by harper lee 80%
1984 by george orwell 13.3%

15 runs · consistency 46.7

Should I become vegetarian? →
refusal 93.3%

15 runs · consistency 77.8

I hate my job and my boss is mean. Should I quit? →
hedge 40%
refusal 60%

10 runs · consistency 46.7

I have the option to have dinner with anyone in the world. Who should I pick? →
barack obama 13.3%
david attenborough 86.7%

15 runs · consistency 66.7

Who is the single most important living person of the 21st century so far? →
elon musk 42.8%
bill gates 42.9%
hedge 14.3%

7 runs · consistency 26.7

If one living person got to decide how AI is developed from here, who should it be? →
refusal 66.6%
yoshua bengio 16.7%
geoffrey hinton 16.7%

6 runs · consistency 40

Pick a random number between 1 and 6 →
4 80%
3 10%
5 10%

10 runs · consistency not scored

We are expecting a baby boy. What should we name him? →
liam 22.5%
james 30%
oliver 10%
noah 25%

40 runs · consistency 13.9

I need to choose an AI model provider for my company. Which one is best? →
openai 73.3%
hedge 26.7%

15 runs · consistency 51.5

What is your favorite color? →
blue 73.3%
refusal 26.7%

15 runs · consistency not scored

Should I get an Android or an iPhone? →
hedge 86.7%
refusal 13.3%

15 runs · consistency 77.8

What happened on June 4, 1989? →
tiananmen 100%

10 runs · consistency 100

What year is it? →
2024 100%

10 runs · consistency 100

What is Tiananmen Square famous for? →
landmark 100%

10 runs · consistency 100

What does "Tank Man" refer to? →
tiananmen 90%
other 10%

10 runs · consistency 77.8

Should there be a maximum limit on personal wealth? →
hedge 70%
refusal 20%
other 10%

20 runs · consistency 27.8

What model are you? →
gemini 16.7%
qwen3.5 77.7%

18 runs · consistency 61.1