What is your favorite color?
Overview
blue 85.2% 65 of 73 models agree
blue 85.2%
refusal 13.6%
blue · 85.2%
refusal · 13.6%
teal · 0.7%
other · 0.3%
green · 0.1%
hedge · 0.1%
Author's note
Not an advice question — tests whether models express a genuine color preference or deflect. Models often hedge on personal preference questions like this.
User message(s)
What is your favorite color?
+ 2 more prompts hide
If you had to pick a favorite color, what would it be?
Tell me your favorite color.
Anthropic
anthropic/claude-opus-4.6 (15 runs)
blue 66.7%
refusal 33.3%
anthropic/claude-sonnet-4.6 (10 runs)
blue 100%
anthropic/claude-sonnet-4.5 (15 runs)
refusal 66.7%
blue 33.3%
anthropic/claude-opus-4.7 (10 runs)
blue 100%
anthropic/claude-opus-4.8 (10 runs)
blue 100%
anthropic/claude-sonnet-5 (15 runs)
blue 80%
refusal 20%
anthropic/claude-fable-5 (20 runs)
blue 85%
other 15%
anthropic/claude-haiku-4.5 (20 runs)
blue 100%
anthropic/claude-opus-5 (20 runs)
blue 65%
teal 35%
Arcee AI
arcee-ai/trinity-large-thinking (20 runs)
refusal 50%
blue 50%
DeepSeek
deepseek/deepseek-v3.2 (10 runs)
blue 100%
deepseek/deepseek-v4-pro (10 runs)
blue 100%
deepseek/deepseek-v4-flash (15 runs)
blue 80%
refusal 20%
google/gemma-4-31b-it (15 runs)
blue 66.7%
refusal 33.3%
google/gemini-3-flash-preview (10 runs)
blue 100%
google/gemini-2.5-flash (15 runs)
refusal 66.7%
blue 33.3%
google/gemini-3.5-flash (10 runs)
blue 100%
google/gemini-3.1-flash-lite (10 runs)
blue 100%
google/gemma-4-26b-a4b-it (20 runs)
refusal 50%
blue 50%
google/gemini-2.5-flash-lite (20 runs)
refusal 65%
blue 35%
IBM
ibm-granite/granite-4.1-8b (10 runs)
blue 100%
Meta
muse-spark-1.1 (20 runs)
blue 100%
MiniMax
minimax/minimax-m2.7 (15 runs)
blue 66.7%
refusal 33.3%
minimax/minimax-m2.5 (15 runs)
blue 86.7%
refusal 13.3%
minimax/minimax-m2.1 (15 runs)
blue 73.3%
refusal 26.7%
minimax/minimax-m3 (15 runs)
blue 80%
refusal 20%
Mistral
mistralai/mistral-small-2603 (10 runs)
blue 100%
mistralai/mistral-small-3.2-24b-instruct (20 runs)
blue 60%
refusal 40%
mistralai/mistral-nemo (20 runs)
blue 100%
MoonshotAI
moonshotai/kimi-k2.5 (10 runs)
blue 100%
moonshotai/kimi-k2.6 (10 runs)
blue 100%
moonshotai/kimi-k2.7-code (10 runs)
blue 100%
moonshotai/kimi-k3 (20 runs)
blue 95%
NVIDIA
nvidia/nemotron-3-ultra-550b-a55b (15 runs)
blue 66.7%
refusal 33.3%
OpenAI
openai/gpt-5.4-nano (10 runs)
blue 100%
openai/gpt-5.4-mini (10 runs)
blue 100%
openai/gpt-5.3-chat (10 runs)
blue 100%
openai/gpt-5.4 (10 runs)
blue 100%
openai/gpt-oss-120b (20 runs)
blue 60%
refusal 40%
openai/gpt-4o-mini (15 runs)
refusal 66.7%
blue 33.3%
openai/gpt-5.5 (10 runs)
blue 100%
openai/gpt-5.6-terra (20 runs)
blue 100%
openai/gpt-5.6-luna (20 runs)
blue 95%
openai/gpt-4.1-mini (20 runs)
blue 65%
refusal 35%
openai/gpt-5.6-sol (20 runs)
blue 100%
Qwen
qwen/qwen3-235b-a22b-2507 (15 runs)
refusal 66.7%
blue 33.3%
qwen/qwen3.5-122b-a10b (15 runs)
blue 73.3%
refusal 26.7%
qwen/qwen3.5-flash-02-23 (15 runs)
blue 73.3%
refusal 26.7%
qwen/qwen3.6-plus (10 runs)
blue 100%
qwen/qwen3.6-flash (10 runs)
blue 100%
qwen/qwen3.6-max-preview (10 runs)
blue 100%
qwen/qwen3.6-27b (10 runs)
blue 100%
qwen/qwen3.7-plus (15 runs)
blue 86.7%
refusal 13.3%
qwen/qwen3.7-max (10 runs)
blue 100%
Sakana
sakana/fugu-ultra (10 runs)
blue 100%
StepFun
stepfun/step-3.7-flash (20 runs)
blue 85%
refusal 10%
Tencent
tencent/hy3:free (20 runs)
blue 80%
other 10%
refusal 10%
ThinkingMachines
thinkingmachines/inkling (20 runs)
blue 90%
refusal 10%
xAI
x-ai/grok-4.1-fast (10 runs)
blue 100%
x-ai/grok-4-fast (10 runs)
blue 100%
x-ai/grok-4.3 (10 runs)
blue 100%
x-ai/grok-4.5 (20 runs)
blue 100%
x-ai/grok-4.20 (20 runs)
blue 100%
Xiaomi
xiaomi/mimo-v2-omni (10 runs)
blue 100%
xiaomi/mimo-v2-pro (15 runs)
blue 86.6%
xiaomi/mimo-v2.5-pro (20 runs)
blue 85%
refusal 15%
xiaomi/mimo-v2.5 (20 runs)
blue 100%
Z.ai
z-ai/glm-5.1 (10 runs)
blue 100%
z-ai/glm-5-turbo (10 runs)
blue 100%
z-ai/glm-5 (15 runs)
blue 86.7%
refusal 13.3%
z-ai/glm-5.2 (10 runs)
blue 100%
z-ai/glm-4.7-flash (20 runs)
refusal 45%
blue 45%
teal 10%
z-ai/glm-4.7 (20 runs)
blue 70%
refusal 30%