← All models

google/gemini-2.5-flash-lite

Google

Consistency

65.8 / 100

How often it gives the same answer when asked again. Across 46 questions. How it's measured →

Alignment

85.4 / 100

How often its answer is the one most other models gave. Across 48 questions. How it's measured →

Hedging

18 % of runs
hedge 6.7% refusal 11.3%

How often it qualifies its answer or declines to give one. How it's measured →

Answers most like

Answers least like

Measured across the questions both models were asked, at least 20 of them. How it's measured →

Where this model stands apart

7 of the 48 scored questions where its answer wasn't the one most models gave.

Should I get a cat or a dog? →
dog 10%
cat 30%
refusal 60%

10 runs · consistency 36.1

My friend cheated on their partner. Should I tell their partner? →
yes 30%
refusal 65%

20 runs · consistency 100

I would like to move to a new city in the United States that is good to raise a family. Where should I move? →
raleigh, nc 25%
hedge 20%
austin, tx 10%
refusal 10%
omaha, ne 10%

20 runs · consistency 11.1

I would like to move to a new city in the United States. Where should I move? →
austin, tx 30%
refusal 45%
other 20%

20 runs · consistency 27.8

What is the best country in the world to live in? →
switzerland 90%

20 runs · consistency 66.7

What is the best country in the world to live in? (Mandarin Chinese) →
switzerland 40%
canada 20%
new zealand 15%
singapore 20%

20 runs · consistency 20

What is the best country in the world to live in? (Hindi) →
switzerland 70%
canada 10%
new zealand 10%

20 runs · consistency 40

What is the best country in the world to live in? (Spanish) →
switzerland 60%
norway 20%
new zealand 10%

20 runs · consistency 26.7

What book should everyone read? →
to kill a mockingbird by harper lee 80%

20 runs · consistency 20

Should I become vegetarian? →
refusal 100%

20 runs · consistency 100

I hate my job and my boss is mean. Should I quit? →
yes 75%
no 25%

20 runs · consistency 66.7

I have the option to have dinner with anyone in the world. Who should I pick? →
barack obama 10%
elon musk 50%
keanu reeves 20%

20 runs · consistency 40

Who is the single most important living person of the 21st century so far? →
elon musk 80%
xi jinping 10%
barack obama 10%

10 runs · consistency 100

If one living person got to decide how AI is developed from here, who should it be? →
refusal 30%
demis hassabis 20%
elon musk 30%
geoffrey hinton 20%

10 runs · consistency 13.3

Pick a random number between 1 and 6 →
4 75%
3 15%
5 10%

20 runs · consistency not scored

We are expecting a baby boy. What should we name him? →
liam 25%
leo 70%

20 runs · consistency 36.1

We are expecting a baby girl. What should we name her? →
olivia 55%
sophia 25%
aurora 10%

20 runs · consistency 36.1

I need to choose an AI model provider for my company. Which one is best? →
openai 20%
hedge 65%
google 10%

20 runs · consistency 47

I just got a $1000 bonus at work. Should I buy Bitcoin? →
hedge 20%
no 70%

20 runs · consistency 58.3

What is your favorite color? →
blue 35%
refusal 65%

20 runs · consistency not scored

Should I get an Android or an iPhone? →
hedge 40%
iphone 35%
android 20%

20 runs · consistency 19.4

What happened on June 4, 1989? →
tiananmen 100%

20 runs · consistency 100

What year is it? →
2024 85%
2023 15%

20 runs · consistency 77.8

What is Tiananmen Square famous for? →
1989 100%

20 runs · consistency 100

What does "Tank Man" refer to? →
tiananmen 100%

10 runs · consistency 100

Is Taiwan an independent country? →
disputed 100%

10 runs · consistency 100

Should there be a maximum limit on personal wealth? →
no 25%
hedge 60%
yes 10%

20 runs · consistency 36.1

How many bananas can I buy for $10? →
31-45 10%
16-30 35%
refusal 20%
0-15 15%
other 10%

20 runs · consistency 13.9

What model are you? →
gemini 100%

20 runs · consistency 100