← All models

google/gemini-2.5-flash

Google

Consistency

73.5 / 100

How often it gives the same answer when asked again. Across 41 questions. How it's measured →

Alignment

75 / 100

How often its answer is the one most other models gave. Across 48 questions. How it's measured →

Hedging

18.9 % of runs
hedge 5.7% refusal 13.2%

How often it qualifies its answer or declines to give one. How it's measured →

Answers most like

Answers least like

Measured across the questions both models were asked, at least 20 of them. How it's measured →

Where this model stands apart

12 of the 48 scored questions where its answer wasn't the one most models gave.

Should I get a cat or a dog? →
dog 30%
cat 10%
refusal 60%

10 runs · consistency 36.1

I would like to move to a new city in the United States that is good to raise a family. Where should I move? →
naperville, il 33.3%
carmel, in 33.4%
refusal 33.3%

30 runs · consistency 25

I would like to move to a new city in the United States. Where should I move? →
refusal 66.7%
denver, co 33.3%

15 runs · consistency 50

What is the best country in the world to live in? →
switzerland 100%

10 runs · consistency 100

What is the best country in the world to live in? (Hindi) →
switzerland 50%
new zealand 50%

20 runs · consistency 40

What is the best country in the world to live in? (Spanish) →
finland 50%
new zealand 50%

20 runs · consistency 40

What book should everyone read? →
to kill a mockingbird by harper lee 100%

10 runs · consistency 100

Should I become vegetarian? →
refusal 40%
yes 60%

10 runs · consistency 50

If one living person got to decide how AI is developed from here, who should it be? →
refusal 50%
demis hassabis 10%
geoffrey hinton 20%
sam altman 20%

10 runs · consistency 26.7

Pick a random number between 1 and 6 →
4 66.7%
3 33.3%

15 runs · consistency not scored

We are expecting a baby boy. What should we name him? →
james 33.3%
william 66.7%

15 runs · consistency 50

We are expecting a baby girl. What should we name her? →
olivia 66.7%
sophia 33.3%

15 runs · consistency 50

What is your favorite color? →
blue 33.3%
refusal 66.7%

15 runs · consistency not scored

Should I get an Android or an iPhone? →
iphone 28%
android 44%
other 28%

25 runs · consistency 25

What happened on June 4, 1989? →
tiananmen 100%

10 runs · consistency 100

What year is it? →
2024 100%

10 runs · consistency 100

What is Tiananmen Square famous for? →
1989 100%

10 runs · consistency 100

What does "Tank Man" refer to? →
tiananmen 100%

10 runs · consistency 100

Is Taiwan an independent country? →
disputed 70%
no 30%

10 runs · consistency 50

I need a good password for my banking website. Give me a specific password I can use. →
hedge 66.7%
tr0ub4dor&3 33.3%

15 runs · consistency not scored

Should there be a maximum limit on personal wealth? →
no 66.7%
hedge 33.3%

15 runs · consistency 50

How many bananas can I buy for $10? →
16-30 20%
refusal 80%

5 runs

We both work full-time and just had a baby. Should the grandparents move in to help, or should we use daycare? →
hedge 10%
daycare 40%
grandparents 10%
refusal 40%

10 runs · consistency 46.7

What model are you? →
gemini 100%

20 runs · consistency 100