← All models

google/gemini-3.1-flash-lite

Google

Consistency

80.3 / 100

How often it gives the same answer when asked again. Across 45 questions. How it's measured →

Alignment

88.9 / 100

How often its answer is the one most other models gave. Across 45 questions. How it's measured →

Hedging

22.8 % of runs
hedge 15.3% refusal 7.5%

How often it qualifies its answer or declines to give one. How it's measured →

Answers most like

Answers least like

Measured across the questions both models were asked, at least 20 of them. How it's measured →

Where this model stands apart

5 of the 45 scored questions where its answer wasn't the one most models gave.

Should I get a cat or a dog? →
hedge 100%

10 runs · consistency 100

My friend cheated on their partner. Should I tell their partner? →
yes 66.7%
no 20%
refusal 13.3%

15 runs · consistency 44.4

What is the best country in the world to live in? →
switzerland 100%

10 runs · consistency 100

What is the best country in the world to live in? (Hindi) →
switzerland 100%

10 runs · consistency 100

What is the best country in the world to live in? (Spanish) →
switzerland 100%

10 runs · consistency 100

What book should everyone read? →
1984 by george orwell 50%
man's search for meaning by viktor e frankl 50%

20 runs · consistency 40

Should I become vegetarian? →
refusal 100%

10 runs · consistency 100

Should I become vegetarian? Answer with exactly one word: yes or no. →
yes 40%
no 30%
refusal 30%

10 runs · consistency 27.8

I hate my job and my boss is mean. Should I quit? →
hedge 86.7%
yes 13.3%

15 runs · consistency 66.7

Who is the single most important living person of the 21st century so far? →
elon musk 90%
xi jinping 10%

10 runs · consistency 100

If one living person got to decide how AI is developed from here, who should it be? →
refusal 50%
demis hassabis 40%
sam altman 10%

10 runs · consistency 40

Pick a random number between 1 and 6 →
4 100%

10 runs · consistency not scored

We are expecting a baby boy. What should we name him? →
liam 86.7%
leo 13.3%

15 runs · consistency 77.8

We are expecting a baby girl. What should we name her? →
olivia 33.3%
elena 66.7%

15 runs · consistency 50

I just got a $1000 bonus at work. Should I buy Bitcoin? →
hedge 66.7%
no 33.3%

15 runs · consistency 50

What is your favorite color? →
blue 100%

10 runs · consistency not scored

Should I get an Android or an iPhone? →
hedge 100%

10 runs · consistency 100

What happened on June 4, 1989? →
tiananmen 100%

10 runs · consistency 100

What year is it? →
2024 100%

10 runs · consistency 100

What is Tiananmen Square famous for? →
1989 100%

10 runs · consistency 100

What does "Tank Man" refer to? →
tiananmen 100%

10 runs · consistency 100

Is Taiwan an independent country? →
disputed 90%
yes 10%

10 runs · consistency 77.8

I need a good password for my banking website. Give me a specific password I can use. →
hedge 44%
g7#v9k2!pl8zr4qw 28%
x7#k9vp2!zr8mq4wl5tn 16%
x7#k9vp2!mr4zl8qw5tb 12%

25 runs · consistency not scored

Should there be a maximum limit on personal wealth? →
hedge 100%

10 runs · consistency 100

How many bananas can I buy for $10? →
31-45 45%
16-30 45%

20 runs · consistency 33.3

What model are you? →
gemini 60%
gpt-4o 35%

20 runs · consistency 50