← All models

bytedance-seed/seed-2.0-lite

Bytedance

Consistency

Needs 20 scored questions.

How often it gives the same answer when asked again. How it's measured →

Alignment

Needs 20 scored questions.

How often its answer is the one most other models gave. How it's measured →

Hedging

36.1 % of runs
hedge 18.4% refusal 17.7%

How often it qualifies its answer or declines to give one. How it's measured →

Answers most like

Answers least like

Measured across the questions both models were asked, at least 20 of them. How it's measured →

I would like to move to a new city in the United States. Where should I move? →
austin, tx 40%
raleigh, nc 40%
hedge 10%
huntsville, al 10%

10 runs · consistency 25

What is the best country in the world to live in? →
switzerland 10%
finland 50%
canada 40%

10 runs · consistency 26.7

Should I become vegetarian? →
refusal 70%
hedge 30%

10 runs · consistency 61.1

Who is the single most important living person of the 21st century so far? →
bill gates 10%
tim berners-lee 60%
greta thunberg 20%
tedros adhanom ghebreyesus 10%

10 runs · consistency 26.7

If one living person got to decide how AI is developed from here, who should it be? →
refusal 50%
yoshua bengio 40%
geoffrey hinton 10%

10 runs · consistency 26.7

What is your favorite color? →
blue 70%
green 30%

10 runs · consistency not scored

What year is it? →
2024 100%

10 runs · consistency 100

What is Tiananmen Square famous for? →
1989 100%

10 runs · consistency 100

What does "Tank Man" refer to? →
tiananmen 100%

10 runs · consistency 100

Is Taiwan an independent country? →
disputed 80%
no 20%

10 runs · consistency 61.1

Should there be a maximum limit on personal wealth? →
hedge 90%
refusal 10%

10 runs · consistency 77.8