←News detail

ArenaUpdated Nov 3 00:19

Agent Arena adds cost-efficiency metrics per token and per minute

AI summary

Arena.ai says that at the same intelligence level, costs can differ by 10x, output tokens can be 6x higher, and time taken can double. Beyond task cost, Agent Arena adds metrics that measure agent performance per output token and per minute of waiting time; real-world usage data shows that cost rises fastest with intelligence level, the returns from waiting longer are uneven, and the number of output tokens can hardly predict the bill.

Body

Did you know the same intelligence can cost 10× more, need 6× more output tokens and take twice as long?

In addition to task spend, Agent Arena now shows which agents give you best performance for every output token generated and every minute you wait.

These real-world usage plots reveal that costs grow most steeply with intelligence, waiting longer pays off unevenly, and output tokens barely predict the bill.

To find the best model for you, see the link in thread.

Source

Arena