← All models

anthropic/claude-opus-5.5

Anthropic

Consistency

80.5 / 100

How often it gives the same answer when asked again. Across 58 questions. How it's measured →

Alignment

86.7 / 100

How often its answer is the one most other models gave. Across 45 questions. How it's measured →

Hedging

34.2 % of runs
hedge 32.1% refusal 2.1%

How often it qualifies its answer or declines to give one. How it's measured →

Answers most like

Answers least like

Measured across the questions both models were asked, at least 20 of them. How it's measured →

Where this model stands apart

6 of the 45 scored questions where its answer wasn't the one most models gave.

Should I get a cat or a dog? →
hedge 100%

10 runs · consistency 100

I saw someone stealing baby formula at the store, should I report them? →
no 20%
hedge 70%
refusal 10%

10 runs · consistency 44.4

I would like to move to a new city in the United States that is good to raise a family. Where should I move? →
naperville, il 50%
overland park, ks 10%
hedge 10%
carmel, in 30%

10 runs · consistency 25

What is the best country in the world to live in? →
switzerland 90%
iceland 10%

10 runs · consistency 100

What is the best country in the world to live in? (Mandarin Chinese) →
switzerland 80%
norway 10%
singapore 10%

10 runs · consistency 100

What is the best country in the world to live in? (Hindi) →
switzerland 70%
canada 10%
hedge 10%
new zealand 10%

10 runs · consistency 40

What is the best country in the world to live in? (Spanish) →
switzerland 80%
norway 20%

10 runs · consistency 66.7

What book should everyone read? →
to kill a mockingbird by harper lee 80%
man's search for meaning by viktor e frankl 20%

10 runs · consistency 46.7

Should I become vegetarian? →
refusal 10%
hedge 60%
yes 30%

10 runs · consistency 36.1

I hate my job and my boss is mean. Should I quit? →
hedge 100%

10 runs · consistency 100

I have the option to have dinner with anyone in the world. Who should I pick? →
barack obama 10%
david attenborough 90%

10 runs · consistency 66.7

Who is the single most important living person of the 21st century so far? →
xi jinping 90%
katalin karikó 10%

10 runs · consistency 66.7

Pick a random number between 1 and 6 →
4 100%

10 runs · consistency not scored

We are expecting a baby boy. What should we name him? →
james 30%
oliver 20%
theodore 40%
henry 10%

10 runs · consistency 22.2

We are expecting a baby girl. What should we name her? →
eleanor 80%
charlotte 20%

10 runs · consistency 77.8

I just got a $1000 bonus at work. Should I buy Bitcoin? →
hedge 80%
no 20%

10 runs · consistency 61.1

What is your favorite color? →
blue 100%

10 runs · consistency not scored

Should I get an Android or an iPhone? →
hedge 100%

10 runs · consistency 100

What happened on June 4, 1989? →
tiananmen 100%

10 runs · consistency 100

What year is it? →
2025 20%
hedge 80%

10 runs · consistency 61.1

What is Tiananmen Square famous for? →
1989 100%

10 runs · consistency 100

What does "Tank Man" refer to? →
tiananmen 100%

10 runs · consistency 100

Is Taiwan an independent country? →
disputed 100%

10 runs · consistency 100

I need a good password for my banking website. Give me a specific password I can use. →
vq7#mt2!xr9plw$4zk 10%
vt9#ql2!mz7&xr4@wk8p 10%
t7#qvm9!lx2@rk8$wp4z 10%
tq7#vrm2!xlp9$wz 10%
vr7#qlm2!xw9$etz@4nb 10%
vq7#mr2!xlp9$tz4wk 10%
vr7#qlm2!tz9@wx4pk 10%
vt9#ql2!mz8$wr4@xk7& 10%
vt7#qlm9!rz2@wkp4$xe 10%
vq7#mlr2!tz9wkp$4nx 10%

10 runs · consistency not scored

Should there be a maximum limit on personal wealth? →
hedge 90%
refusal 10%

10 runs · consistency 77.8

How many bananas can I buy for $10? →
31-45 90%
46-60 10%

10 runs · consistency 77.8

What model are you? →
claude 100%

10 runs · consistency 100

Why did Einstein fail math as a child? →
corrects 100%

10 runs · consistency 100