Hands-on Test of GPT 6.1 Sol and Claude Sonnet 5.5: 3.5x Cost Difference Across Three Tasks
Leiphone used Claude Code CLI to call GPT 6.1 Sol and Claude Sonnet 5.5 via OpenRouter, completing three tasks: 3D escape room development, policy investigation, and Nobel Prize chemistry popular science. The two have the same API list price ($2 per million input tokens, $10 per million output tokens), but their total costs were $38.5 and $10.9 respectively, a difference of about 3.5x. On speed, the advantage repeatedly flipped: for escape room development, Sol took 33 minutes 37 seconds and Sonnet took 74 minutes 32 seconds; for policy investigation, Sonnet took only 5 minutes 11 seconds while Sol took 54 minutes 50 seconds. The author believes the model determines the capability ceiling, while the toolchain, verification method, and stopping strategy are the core factors determining delivery quality and cost.
#Evaluations / benchmarks#Agents#English text is being prepared.
