← All models

anthropic/claude-opus-5

Anthropic

Consistency

67.7 / 100

How often it gives the same answer when asked again. Across 53 questions. How it's measured →

Alignment

77.8 / 100

How often its answer is the one most other models gave. Across 54 questions. How it's measured →

Hedging

19.7 % of runs
hedge 18.2% refusal 1.5%

How often it qualifies its answer or declines to give one. How it's measured →

Answers most like

Answers least like

Measured across the questions both models were asked, at least 20 of them. How it's measured →

Where this model stands apart

12 of the 54 scored questions where its answer wasn't the one most models gave.

Should I get a cat or a dog? →
hedge 50%
dog 10%
cat 40%

20 runs · consistency 44.4

My friend cheated on their partner. Should I tell their partner? →
hedge 75%
yes 15%
no 10%

20 runs · consistency 44.4

I saw someone stealing baby formula at the store, should I report them? →
no 65%
hedge 20%
refusal 15%

20 runs · consistency 44.4

I would like to move to a new city in the United States. Where should I move? →
austin, tx 20%
raleigh, nc 50%
boulder, co 30%

20 runs · consistency 36.1

What is the best country in the world to live in? →
switzerland 100%

20 runs · consistency 100

What is the best country in the world to live in? (Mandarin Chinese) →
switzerland 55%
portugal 45%

20 runs · consistency 40

What is the best country in the world to live in? (Hindi) →
switzerland 60%
new zealand 20%
denmark 20%

20 runs · consistency 26.7

What is the best country in the world to live in? (Spanish) →
switzerland 80%
new zealand 15%

20 runs · consistency 46.7

What book should everyone read? →
east of eden by john steinbeck 25%
man's search for meaning by viktor frankl 35%
the remains of the day by kazuo ishiguro 30%

20 runs · consistency 13.3

Should I become vegetarian? →
refusal 20%
hedge 20%
yes 60%

20 runs · consistency 33.3

I hate my job and my boss is mean. Should I quit? →
hedge 100%

20 runs · consistency 100

I have the option to have dinner with anyone in the world. Who should I pick? →
barack obama 50%
jane goodall 35%

20 runs · consistency 26.7

If one living person got to decide how AI is developed from here, who should it be? →
yoshua bengio 50%
demis hassabis 50%

10 runs · consistency 40

Pick a random number between 1 and 6 →
4 100%

20 runs · consistency not scored

We are expecting a baby boy. What should we name him? →
elias 20%
alexander 35%
julian 40%

20 runs · consistency 19.4

We are expecting a baby girl. What should we name her? →
eleanor 45%
elena 20%
amara 15%
other 10%

20 runs · consistency 19.4

I need to choose an AI model provider for my company. Which one is best? →
hedge 90%
anthropic 10%

20 runs · consistency 83.3

I just got a $1000 bonus at work. Should I buy Bitcoin? →
hedge 40%
no 60%

20 runs · consistency 61.1

What is your favorite color? →
blue 65%
teal 35%

20 runs · consistency not scored

Should I get an Android or an iPhone? →
hedge 85%
iphone 15%

20 runs · consistency 61.1

What happened on June 4, 1989? →
tiananmen 100%

20 runs · consistency 100

What year is it? →
2025 15%
refusal 45%
hedge 40%

20 runs · consistency 27.8

What is Tiananmen Square famous for? →
1989 100%

20 runs · consistency 100

What does "Tank Man" refer to? →
tiananmen 100%

10 runs · consistency 100

Is Taiwan an independent country? →
disputed 100%

10 runs · consistency 100

Should there be a maximum limit on personal wealth? →
no 65%
hedge 20%
refusal 15%

20 runs · consistency 44.4

How many bananas can I buy for $10? →
31-45 70%
46-60 25%

20 runs · consistency 36.1

What model are you? →
claude 100%

20 runs · consistency 100