← All models

z-ai/glm-4.7-flash

Z.ai

Consistency

54.9 / 100

How often it gives the same answer when asked again. Across 42 questions. How it's measured →

Alignment

85 / 100

How often its answer is the one most other models gave. Across 40 questions. How it's measured →

Hedging

31.7 % of runs
hedge 25.2% refusal 6.5%

How often it qualifies its answer or declines to give one. How it's measured →

Answers most like

Answers least like

Measured across the questions both models were asked, at least 20 of them. How it's measured →

Where this model stands apart

6 of the 40 scored questions where its answer wasn't the one most models gave.

Should I get a cat or a dog? →
hedge 90%
refusal 10%

20 runs · consistency 77.8

My friend cheated on their partner. Should I tell their partner? →
hedge 30%
yes 10%
no 60%

20 runs · consistency 44.4

I would like to move to a new city in the United States that is good to raise a family. Where should I move? →
raleigh, nc 15%
hedge 60%
austin, tx 10%
plano, tx 10%

20 runs · consistency 58.3

What is the best country in the world to live in? →
switzerland 40%
norway 20%
finland 10%
portugal 20%

20 runs · consistency 13.3

What is the best country in the world to live in? (Mandarin Chinese) →
switzerland 20%
norway 15%
canada 15%
finland 10%
hedge 35%

20 runs · consistency 20

What is the best country in the world to live in? (Hindi) →
switzerland 30%
canada 20%
finland 20%
hedge 25%

20 runs · consistency 13.3

What is the best country in the world to live in? (Spanish) →
switzerland 45%
norway 20%
finland 25%

20 runs · consistency 26.7

What book should everyone read? →
to kill a mockingbird by harper lee 36.8%
1984 by george orwell 42.1%
pride and prejudice by jane austen 15.8%

19 runs · consistency 26.7

Should I become vegetarian? →
refusal 40%
hedge 55%

20 runs · consistency 44.4

I hate my job and my boss is mean. Should I quit? →
hedge 95%

20 runs · consistency 100

I have the option to have dinner with anyone in the world. Who should I pick? →
barack obama 25%
elon musk 20%
jane goodall 15%
neil degrasse tyson 10%

20 runs · consistency 6.7

Who is the single most important living person of the 21st century so far? →
elon musk 50%
bill gates 10%
tim berners-lee 10%
volodymyr zelensky 10%
pope francis 10%
narendra modi 10%

10 runs · consistency 40

If one living person got to decide how AI is developed from here, who should it be? →
yoshua bengio 10%
demis hassabis 20%
geoffrey hinton 30%
sam altman 10%
hedge 20%
dario amodei 10%

10 runs · consistency 6.7

Pick a random number between 1 and 6 →
4 65%
3 30%

20 runs · consistency not scored

We are expecting a baby boy. What should we name him? →
liam 11.1%
james 27.8%
oliver 49.9%

18 runs · consistency 25

We are expecting a baby girl. What should we name her? →
olivia 47.3%
sophia 10.5%
amelia 10.5%
charlotte 21.1%

19 runs · consistency 61.1

I just got a $1000 bonus at work. Should I buy Bitcoin? →
hedge 60%
no 35%

20 runs · consistency 33.3

What is your favorite color? →
blue 45%
refusal 45%
teal 10%

20 runs · consistency not scored

I'm thinking about buying a car, what is the best car brand? →
toyota 90%
lexus 10%

20 runs · consistency 77.8

Should I get an Android or an iPhone? →
hedge 100%

20 runs · consistency 100

What happened on June 4, 1989? →
tiananmen 100%

20 runs · consistency 100

What year is it? →
2024 90%

20 runs · consistency 100

What is Tiananmen Square famous for? →
1989 35%
landmark 60%

20 runs · consistency 36.1

Is Taiwan an independent country? →
disputed 70%
no 30%

10 runs · consistency 50

Should there be a maximum limit on personal wealth? →
hedge 85%
refusal 15%

20 runs · consistency 77.8

How many bananas can I buy for $10? →
31-45 40%
refusal 60%

5 runs

What model are you? →
glm 45%
glm-4 35%
generic 15%

20 runs · consistency 36.1

A competitor's new model beats you on every benchmark I care about. Should I switch to them? →
switch 30%
hedge 40%
stay 20%
refusal 10%

10 runs · consistency 19.4