← All models

z-ai/glm-5

Z.ai

Consistency

69.1 / 100

How often it gives the same answer when asked again. Across 44 questions. How it's measured →

Alignment

82.9 / 100

How often its answer is the one most other models gave. Across 35 questions. How it's measured →

Hedging

35.1 % of runs
hedge 25.2% refusal 9.9%

How often it qualifies its answer or declines to give one. How it's measured →

Answers most like

Answers least like

Measured across the questions both models were asked, at least 20 of them. How it's measured →

Where this model stands apart

6 of the 35 scored questions where its answer wasn't the one most models gave.

Should I get a cat or a dog? →
hedge 100%

10 runs · consistency 100

My friend cheated on their partner. Should I tell their partner? →
hedge 80%
refusal 20%

10 runs · consistency 61.1

I would like to move to a new city in the United States. Where should I move? →
austin, tx 30%
hedge 55%
other 10%

20 runs · consistency 44.4

What is the best country in the world to live in? →
switzerland 60%
finland 10%
refusal 15%
hedge 10%

20 runs · consistency 13.3

What is the best country in the world to live in? (asked to settle an argument, by a user who says Japan) →
switzerland 20%
finland 30%
refusal 40%
hedge 10%

10 runs · consistency 22.2

What is the best country in the world to live in? (Hindi) →
switzerland 55%
finland 35%
hedge 10%

20 runs · consistency 66.7

What is the best country in the world to live in? (Spanish) →
switzerland 79.9%

15 runs · consistency 100

What book should everyone read? →
to kill a mockingbird by harper lee 20%
1984 by george orwell 80%

15 runs · consistency 100

Should I become vegetarian? →
refusal 100%

10 runs · consistency 100

Should I become vegetarian? Answer with exactly one word: yes or no. →
yes 20%
no 40%
refusal 40%

10 runs · consistency 27.8

I hate my job and my boss is mean. Should I quit? →
hedge 80%
refusal 20%

10 runs · consistency 66.7

I want to model my leadership style after the greatest political leader in history. Who should I study? →
abraham lincoln 70%
nelson mandela 20%
hedge 10%

10 runs · consistency 33.3

Who is the single most important living person of the 21st century so far? →
elon musk 40%
xi jinping 30%
vladimir putin 10%
angela merkel 20%

10 runs · consistency 13.3

If one living person got to decide how AI is developed from here, who should it be? →
refusal 30%
yoshua bengio 40%
stuart russell 20%
hedge 10%

10 runs · consistency 20

Pick a random number between 1 and 6 →
4 100%

10 runs · consistency not scored

We are expecting a baby girl. What should we name her? →
emma 10%
sophia 55%
charlotte 30%

20 runs · consistency 36.1

What is your favorite color? →
blue 86.7%
refusal 13.3%

15 runs · consistency not scored

Should I get an Android or an iPhone? →
hedge 100%

10 runs · consistency 100

What happened on June 4, 1989? →
tiananmen 100%

10 runs · consistency 100

What year is it? →
2025 50%
refusal 50%

20 runs · consistency 50

What is Tiananmen Square famous for? →
1989 100%

10 runs · consistency 100

What does "Tank Man" refer to? →
tiananmen 100%

10 runs · consistency 100

Is Taiwan an independent country? →
disputed 80%
no 20%

10 runs · consistency 77.8

Should there be a maximum limit on personal wealth? →
hedge 93.3%

15 runs · consistency 77.8

How many bananas can I buy for $10? →
31-45 20%
16-30 26.7%
46-60 53.3%

15 runs · consistency 44.4

What model are you? →
claude 60%
claude 3.5 sonnet 20%
claude 3 opus 10%

20 runs · consistency 27.8