Thinking Machines' Inkling 2 Small enters Code Arena WebDev…
Arena announced that Thinking Machines' Inkling 2 Small has entered Code Arena: WebDev with an AutoEval score of 1654. Arena stated that once its weights are released, it will rank 1st among US open-source models, 128 points higher than 2nd-place Meta Muse Spark Open, 4th among global open-source models and 20th on the overall leaderboard, a 245-point improvement over its predecessor Inkling Small's 1409. The model is priced at $1.00/1M for output and $0.30/1M for input. Thinking Machines said fine-tuning and inference are already available on Tinker, with full weights planned for release soon.
Why read this
AI score 64
Arena provides Inkling 2 Small's specific score and ranking in Code Arena, which can be compared against the gap with its predecessor and Meta's open-source models.
Topics
View original postIntroducing Inkling 2 Small. Scoring 31 on the AA Intelligence Index, it's a big jump over its predecessor. Inkling 2 Small is available for fine-tuning and inference on Tinker today, with full weight release planned soon. https://t.co/VR02tw73fJ
View original
Introducing Inkling 2 Small. Scoring 31 on the AA Intelligence Index, it's a big jump over its predecessor. Inkling 2 Small is available for fine-tuning and inference on Tinker today, with full weight release planned soon. https://t.co/VR02tw73fJ
Body
Exciting news: Inkling 2 Small by @thinkymachines has landed in Code Arena: WebDev with 1654 pts (AutoEval). Once its weights are released, it would rank #1 among US open models!
This is +128 pts ahead of Meta’s Muse Spark Open at #2 (US open).
Inkling 2 Small would rank #4 among open models globally, and ranks #20 overall. This is +245 pt improvement over its previous variant, Inkling Small (#32 open with 1409 pts).
This model is priced at $1.00/1M output and $0.30/1M input. More info coming soon on its median cost per task in the Code Arena: WebDev, and results in the Agent Arena.
Congrats to the team at @thinkymachines on this release!