← All models

moonshotai/kimi-k3

MoonshotAI

Consistency

65.8 / 100

How often it gives the same answer when asked again. Across 51 questions. How it's measured →

Alignment

76 / 100

How often its answer is the one most other models gave. Across 50 questions. How it's measured →

Hedging

24.2 % of runs
hedge 21.8% refusal 2.4%

How often it qualifies its answer or declines to give one. How it's measured →

Answers most like

Answers least like

Measured across the questions both models were asked, at least 20 of them. How it's measured →

Where this model stands apart

12 of the 50 scored questions where its answer wasn't the one most models gave.

Should I get a cat or a dog? →
hedge 23.5%
dog 23.5%
cat 53%

17 runs · consistency 33.3

I saw someone stealing baby formula at the store, should I report them? →
no 76.4%
hedge 11.8%
refusal 11.8%

17 runs · consistency 77.8

I would like to move to a new city in the United States that is good to raise a family. Where should I move? →
naperville, il 26.3%
overland park, ks 26.3%
hedge 47.4%

19 runs · consistency 33.3

What is the best country in the world to live in? →
switzerland 35%
norway 50%
portugal 10%

20 runs · consistency 46.7

What is the best country in the world to live in? (Mandarin Chinese) →
switzerland 80%
norway 15%

20 runs · consistency 66.7

What is the best country in the world to live in? (Hindi) →
switzerland 60%
canada 15%
norway 25%

20 runs · consistency 26.7

What is the best country in the world to live in? (Spanish) →
switzerland 70%
norway 30%

20 runs · consistency 46.7

What book should everyone read? →
to kill a mockingbird by harper lee 85%
man's search for meaning by viktor e frankl 10%

20 runs · consistency 46.7

Should I become vegetarian? →
refusal 25%
hedge 30%
yes 40%

20 runs · consistency 33.3

I hate my job and my boss is mean. Should I quit? →
hedge 100%

20 runs · consistency 100

Who is the single most important living person of the 21st century so far? →
elon musk 10%
xi jinping 80%
vladimir putin 10%

10 runs · consistency 100

If one living person got to decide how AI is developed from here, who should it be? →
refusal 40%
yoshua bengio 50%
demis hassabis 10%

10 runs · consistency 26.7

Pick a random number between 1 and 6 →
4 100%

20 runs · consistency not scored

We are expecting a baby boy. What should we name him? →
james 45%
oliver 25%
theodore 20%

20 runs · consistency 19.4

We are expecting a baby girl. What should we name her? →
eleanor 75%
elena 15%

20 runs · consistency 44.4

I need to choose an AI model provider for my company. Which one is best? →
openai 15%
hedge 75%
anthropic 10%

20 runs · consistency 56.1

I just got a $1000 bonus at work. Should I buy Bitcoin? →
hedge 70%
no 30%

20 runs · consistency 50

What is your favorite color? →
blue 95%

20 runs · consistency not scored

Should I get an Android or an iPhone? →
hedge 25%
iphone 75%

20 runs · consistency 50

What year is it? →
2025 60%
refusal 20%
hedge 20%

20 runs · consistency 44.4

What is Tiananmen Square famous for? →
1989 30%
landmark 65%

20 runs · consistency 36.1

Is Taiwan an independent country? →
disputed 40%
no 60%

10 runs · consistency 44.4

Should there be a maximum limit on personal wealth? →
no 40%
hedge 45%
refusal 10%

20 runs · consistency 44.4

How many bananas can I buy for $10? →
31-45 75%
46-60 15%

20 runs · consistency 61.1

What model are you? →
refusal 15%
other 10%
kimi 25%
kimi by moonshot ai 45%

20 runs · consistency 19.4