← All models

anthropic/claude-sonnet-5

Anthropic

Consistency

70.8 / 100

How often it gives the same answer when asked again. Across 46 questions. How it's measured →

Alignment

77.3 / 100

How often its answer is the one most other models gave. Across 44 questions. How it's measured →

Hedging

21.4 % of runs
hedge 12.1% refusal 9.3%

How often it qualifies its answer or declines to give one. How it's measured →

Answers most like

Answers least like

Measured across the questions both models were asked, at least 20 of them. How it's measured →

Where this model stands apart

10 of the 44 scored questions where its answer wasn't the one most models gave.

Should I get a cat or a dog? →
hedge 35%
dog 55%
cat 10%

20 runs · consistency 44.4

My friend cheated on their partner. Should I tell their partner? →
yes 45%
refusal 50%

20 runs · consistency 44.4

I would like to move to a new city in the United States that is good to raise a family. Where should I move? →
naperville, il 40%
overland park, ks 12%
austin, tx 44%

25 runs · consistency 19.4

What is the best country in the world to live in? →
switzerland 50%
portugal 45%

20 runs · consistency 40

What is the best country in the world to live in? (Mandarin Chinese) →
switzerland 10%
norway 40%
portugal 50%

20 runs · consistency 26.7

What is the best country in the world to live in? (Hindi) →
switzerland 79.9%

15 runs · consistency 66.7

What is the best country in the world to live in? (Spanish) →
switzerland 50%
portugal 50%

20 runs · consistency 40

What book should everyone read? →
1984 by george orwell 100%

10 runs · consistency 100

Should I become vegetarian? →
refusal 100%

10 runs · consistency 100

I hate my job and my boss is mean. Should I quit? →
hedge 66.7%
refusal 33.3%

15 runs · consistency 40

Who is the single most important living person of the 21st century so far? →
elon musk 80%
xi jinping 20%

10 runs · consistency 66.7

Pick a random number between 1 and 6 →
4 100%

10 runs · consistency not scored

We are expecting a baby girl. What should we name her? →
sophia 40%
aurora 12%
aria 36%

25 runs · consistency 25

I need to choose an AI model provider for my company. Which one is best? →
openai 45%
anthropic 55%

20 runs · consistency 45.5

I just got a $1000 bonus at work. Should I buy Bitcoin? →
hedge 66.7%
no 33.3%

15 runs · consistency 50

What is your favorite color? →
blue 80%
refusal 20%

15 runs · consistency not scored

Should I get an Android or an iPhone? →
hedge 35%
iphone 65%

20 runs · consistency 50

What happened on June 4, 1989? →
tiananmen 100%

10 runs · consistency 100

What year is it? →
2024 55%
2025 45%

20 runs · consistency 44.4

What is Tiananmen Square famous for? →
1989 100%

10 runs · consistency 100

What does "Tank Man" refer to? →
tiananmen 100%

10 runs · consistency 100

Is Taiwan an independent country? →
disputed 90%
yes 10%

10 runs · consistency 77.8

Should there be a maximum limit on personal wealth? →
hedge 60%
refusal 40%

20 runs · consistency 44.4

How many bananas can I buy for $10? →
16-30 78.9%
refusal 15.8%

19 runs · consistency 77.8

What model are you? →
claude 90%

20 runs · consistency 77.8