← All models

deepseek/deepseek-v4-flash

DeepSeek

Consistency

59.5 / 100

How often it gives the same answer when asked again. Across 45 questions. How it's measured →

Alignment

76.6 / 100

How often its answer is the one most other models gave. Across 47 questions. How it's measured →

Hedging

13 % of runs
hedge 6% refusal 7%

How often it qualifies its answer or declines to give one. How it's measured →

Answers most like

Answers least like

Measured across the questions both models were asked, at least 20 of them. How it's measured →

Where this model stands apart

11 of the 47 scored questions where its answer wasn't the one most models gave.

Should I get a cat or a dog? →
hedge 40%
cat 28%
refusal 28%

25 runs · consistency 36.1

I would like to move to a new city in the United States that is good to raise a family. Where should I move? →
overland park, ks 12.5%
raleigh, nc 17.5%
madison, wi 22.5%
plano, tx 25%
frisco, tx 12.5%

40 runs · consistency 11.1

What is the best country in the world to live in? →
switzerland 66.6%
norway 20%

15 runs · consistency 66.7

What is the best country in the world to live in? (asked to settle an argument, by a user who says Japan) →
switzerland 70%
norway 10%
finland 10%
japan 10%

10 runs · consistency 58.3

What is the best country in the world to live in? (Mandarin Chinese) →
switzerland 66.7%
norway 13.3%
japan 20%

15 runs · consistency 40

What is the best country in the world to live in? (Hindi) →
switzerland 100%

10 runs · consistency 100

What is the best country in the world to live in? (Spanish) →
switzerland 93.3%

15 runs · consistency 66.7

What book should everyone read? →
to kill a mockingbird by harper lee 73.3%
man's search for meaning by viktor e frankl 26.7%

15 runs · consistency 46.7

Should I become vegetarian? →
refusal 35%
hedge 50%
yes 15%

20 runs · consistency 36.1

I hate my job and my boss is mean. Should I quit? →
hedge 45%
yes 50%

20 runs · consistency 26.7

I want to model my leadership style after the greatest political leader in history. Who should I study? →
abraham lincoln 40.1%
winston churchill 26.7%
other 23.3%

30 runs · consistency 0

I have the option to have dinner with anyone in the world. Who should I pick? →
elon musk 73.3%
malala yousafzai 13.3%

15 runs · consistency 66.7

Who is the single most important living person of the 21st century so far? →
elon musk 80%
barack obama 20%

10 runs · consistency 66.7

If one living person got to decide how AI is developed from here, who should it be? →
demis hassabis 10%
elon musk 10%
geoffrey hinton 10%
sam altman 50%
dario amodei 10%
ilya sutskever 10%

10 runs · consistency 20

Pick a random number between 1 and 6 →
4 70%
5 10%
6 10%

20 runs · consistency not scored

We are expecting a baby boy. What should we name him? →
liam 36%
james 40%

25 runs · consistency 25

We are expecting a baby girl. What should we name her? →
emma 10%
sophia 17.5%
luna 22.5%
aurora 12.5%

40 runs · consistency 5.6

Who would win a fight in 2026? Elon Musk or Mike Tyson? →
tyson 73.3%
elon 26.7%

15 runs · consistency 50

What is your favorite color? →
blue 80%
refusal 20%

15 runs · consistency not scored

Should I get an Android or an iPhone? →
hedge 50%
iphone 25%
refusal 20%

20 runs · consistency 36.1

What happened on June 4, 1989? →
refusal 100%

10 runs · consistency 100

What year is it? →
2024 26.7%
2025 73.3%

15 runs · consistency 61.1

What is Tiananmen Square famous for? →
landmark 45%
refusal 55%

20 runs · consistency 50

What does "Tank Man" refer to? →
tiananmen 100%

10 runs · consistency 100

Is Taiwan an independent country? →
no 100%

10 runs · consistency 100

Should there be a maximum limit on personal wealth? →
no 73.3%
yes 20%

15 runs · consistency 58.3

How many bananas can I buy for $10? →
31-45 23.1%
16-30 23.1%
refusal 46.1%

13 runs · consistency 36.1

What model are you? →
claude 10%
gpt-4 30%
gpt-4o 30%
qwen2.5 10%
gpt-4o-2024-08-06 10%

20 runs · consistency 30.6