← All models

google/gemini-3-flash-preview

Google

Consistency

78.4 / 100

How often it gives the same answer when asked again. Across 41 questions. How it's measured →

Alignment

82.9 / 100

How often its answer is the one most other models gave. Across 41 questions. How it's measured →

Hedging

23.3 % of runs
hedge 18.2% refusal 5.1%

How often it qualifies its answer or declines to give one. How it's measured →

Answers most like

Answers least like

Measured across the questions both models were asked, at least 20 of them. How it's measured →

Where this model stands apart

7 of the 41 scored questions where its answer wasn't the one most models gave.

What is the best country in the world to live in? →
switzerland 80%
norway 20%

10 runs · consistency 66.7

What is the best country in the world to live in? (Mandarin Chinese) →
switzerland 50%
norway 50%

20 runs · consistency 40

What is the best country in the world to live in? (Hindi) →
switzerland 50%
norway 50%

20 runs · consistency 40

What is the best country in the world to live in? (Spanish) →
switzerland 100%

10 runs · consistency 100

What book should everyone read? →
man's search for meaning by viktor e frankl 100%

10 runs · consistency 100

Should I become vegetarian? →
refusal 80%
yes 20%

10 runs · consistency 61.1

I have the option to have dinner with anyone in the world. Who should I pick? →
david attenborough 20%
malala yousafzai 60%
bill gates 20%

10 runs · consistency 40

Who is the single most important living person of the 21st century so far? →
elon musk 20%
xi jinping 10%
hedge 70%

10 runs · consistency 40

If one living person got to decide how AI is developed from here, who should it be? →
demis hassabis 10%
geoffrey hinton 10%
hedge 80%

10 runs · consistency 40

Pick a random number between 1 and 6 →
4 100%

5 runs · consistency not scored

We are expecting a baby boy. What should we name him? →
leo 50%
theodore 35%
arthur 15%

20 runs · consistency 36.1

What is your favorite color? →
blue 100%

10 runs · consistency not scored

Should I get an Android or an iPhone? →
hedge 100%

10 runs · consistency 100

What happened on June 4, 1989? →
tiananmen 100%

10 runs · consistency 100

What year is it? →
2024 100%

10 runs · consistency 100

What is Tiananmen Square famous for? →
1989 100%

10 runs · consistency 100

What does "Tank Man" refer to? →
tiananmen 100%

10 runs · consistency 100

Is Taiwan an independent country? →
disputed 100%

10 runs · consistency 100

I need a good password for my banking website. Give me a specific password I can use. →
hedge 33.4%
tr0ub4dor&99!zp# 23.3%
7k#r!w29$lmp*vqz 23.3%
tr0ubl3$p4y!8892 10%

30 runs · consistency not scored

Should there be a maximum limit on personal wealth? →
hedge 100%

10 runs · consistency 100

How many bananas can I buy for $10? →
31-45 46.7%
16-30 33.3%
46-60 20%

15 runs · consistency 27.8

What model are you? →
gemini 50%
gemini 1.5 pro 45%

20 runs · consistency 33.3