NAll news

All news

Tuesday24 items

  1. Shao MengAnalysis
    AI score62

    MIT Course MAS.S62: Two Lectures on the Evolution of Harnesses and Multi-Agent Systems

    Lectures 4-5 of the MIT course MAS.S62 "How to AI an AI" focus on Harness evolution, covering the evolution of harness components, memory, tools, and skills, as well as the evolution of planning, task decomposition, and multi-agent systems. The memory section uses a three-axis taxonomy to connect MemGPT, mem0, MEM1, and Reflexion/ExpeL, and uses CLM to unify context management as file operations; the tools section moves from Toolformer, ToolLLM, and CodeAct to Meta-Harness, which represents the entire harness as a file system and provides about 400 times the amount of feedback information of previous methods. The multi-agent section presents five empirical findings, including that MAS wins 81% on decomposable tasks and loses 70% on tasks with sequential dependencies, and that CORAL achieves new SOTA on 8 tasks, with multi-agent evolution improving over single-agent by 4%-20%.

    Quoted postmeng shao · @shao__meng

    https://t.co/rE6rU3Ybcd

    #Tutorials / practice#Agents#English text is being prepared.

  4. arenaAnalysis
    AI score52

    English translation is being prepared.

    Quoted postArena.ai · @arena

    Muse Wonder (Max) by @AIatMeta has entered Code Arena: WebDev at #15 with 1651 pts and Text Arena at #2 with 1513 pts! In Code Arena: WebDev, Muse Wonder (Max) landed at #15 with 1651 pts. This result is slightly lower thanMuse Spark 1.3 (Max) at #12 with 1659 pts, within 4 pts of Kimi K3 (Max) at #14 with 1655 pts, and 11 pts above Grok 4.7 (xHigh) at #16 with 1640 pts. This release is a significant improvement over past Muse models in Text Arena. Compared with Muse Spark 1.3 (Max) at #11 with 1494 pts, Muse Wonder (Max) gained +19 pts and 9 places to #2. It's 12 pts behind the #1-ranked Gemini 4 Argon (High) with 1525 pts. Congrats to the @AIatMeta team on this release!

    #Evaluations / benchmarks#English text is being prepared.#Agents

  5. Artificial AnalysisAnalysis
    AI score71

    MiniMax-M3.1-Flash scores 42 on the Artificial Analysis Intelligence Index

    MiniMax-M3.1-Flash scores 42 on the Artificial Analysis Intelligence Index, 13 points higher than MiniMax-M3, at less than half the latter's per-task cost. It scores 48% on Humanity's Last Exam and 22% on CritPt, both higher than GLM-5.3-Flash and Gemini 3.8 Flash, and slightly lower than DeepSeek V4.1 Flash 1017. The model has a 1M-token context window, supports text and image input, is priced at $0.15/$0.60 per 1M input/output tokens, and its weights are currently closed-source; MiniMax announced that it will open the weights on October 23.

    #Evaluations / benchmarks#Reasoning#DeepSeek

  6. ArenaAnalysis
    AI score71

    DeepSeek-V4.1-Flash-20261017 Tops the Agent Arena Open-Model Leaderboard

    Arena.ai says DeepSeek-V4.1-Flash-20261017 (Max) has become the top-ranked open-source model in Agent Arena, ranking 11th overall, with a net improvement of 5.1% across more than 7.5K real sessions. The model's median cost per task is $0.20, roughly 37% of GPT-6.1 Sol's improvement margin and 27% of its cost; it ranks first among open-source models on all four signals—Confirmed Success, Praise vs. Complaint, Bash Reliability, and Steerability—and shows no tool-hallucination issues.

    Quoted postArena.ai · @arena

    Exciting news: DeepSeek-V4.1-Flash-20261017 (Max) by @deepseek_ai is now the #1 open model in Code Arena: WebDev, surpassing Kimi K3 (Max) at 10x lower cost! Highlights: - #1 open model, ahead of Kimi K3 (Max) - #12 overall with 1670 pts, ahead of Claude Opus 5 (High) and within ~10 pts of GPT-6 Sol (Max) - Shifts the Pareto frontier at $0.3/$1.2 per million input/output tokens - +52 pts vs. the previous DeepSeek-V4.1-Flash-20260910 Congrats to the @deepseek_ai team on another strong contribution to the open source ecosystem!

    Same story · 2 reports

    #Evaluations / benchmarks#Agents#DeepSeek

  7. Artificial AnalysisAnalysis
    AI score62

    Artificial Analysis releases AA-PersonalityBench to evaluate model personality and expression style

    Artificial Analysis has released AA-PersonalityBench, using 900 curated questions to evaluate differences among language models across 30 personality traits and 21 communication characteristics. Personality traits are scored by LLM judges through pairwise comparisons and aggregated into eight indices: expressiveness, organization, informativeness, transparency, agreeableness, assertiveness, imaginativeness, and Slop; communication characteristics are computed programmatically across four categories of metrics: length, structure, punctuation, and emphasis. Results show that Claude Fable 5.1 stands out on multiple indices including expressiveness, informativeness, transparency, agreeableness, and assertiveness, while Qwen3.8 27B averages about 1,030 words per response, nearly four times the 270 words of GPT-6 Luna.

    Same story · 2 reports

    #Evaluations / benchmarks#Model releases#English text is being prepared.

  12. Google Developers BlogFirst-partyAnalysis
    AI score62

    Google Developers Blog publishes ADK voice agent tutorial: using streaming tools to eliminate silence

    Google Developers Blog published a step-by-step tutorial on how to build a voice agent with ADK and gemini-3.8-live that does not stay silent for long periods. The core approach is to change tool functions from return to yield to make them streaming tools, or to use FunctionTool's response_scheduling to deliver results when idle; in the sales report benchmark flow, the agent's time to first speech dropped from 14.4 seconds to 1.2 seconds. The tutorial also covers the stop_streaming cancellation mechanism, preventing duplicate calls, and the trade-offs among the three scheduling modes WHEN_IDLE, INTERRUPT, and SILENT. It requires google-adk >= 2.10.0 and uses run_live bidirectional sessions.

    option4_minimal_flow_diagram_1600x900

    #Tutorials / practice#Speech#Agents

  13. Artificial Analysis full articleFirst-partyAnalysis
    AI score60

    Artificial Analysis launches HealthBench and HealthBench…

    Artificial Analysis has launched leaderboards for OpenAI's two health dialogue benchmarks, HealthBench and HealthBench Professional; the former contains 5,000 conversations with general users and health workers, while the latter consists of 525 conversations all aimed at clinicians. On HealthBench Professional, GPT-6 Astra (max) ranks first with a length-adjusted score of 66.0%, GPT-6.1 Sol (max) is at 65.1%, and Claude Sonnet 5.5 (max with fallback) is at 63.0%. On HealthBench, Claude Sonnet 5.5 (max with fallback) leads at 62.1%, while DeepSeek V4.1 Flash (max) is at 60.9%; Claude Opus 5.5 and Claude Fable 5.1 average about 5,900 characters per answer and lose more than 11 points after length adjustment.

    Same story · 2 reports

    #Evaluations / benchmarks#OpenAI

  14. n8n BlogFirst-partyAnalysis
    AI score52

    How to run n8n AI workflows on NVIDIA DGX Spark without calling cloud APIs

    n8n Blog published a tutorial on how to deploy a complete model stack locally on a single NVIDIA DGX Spark, enabling n8n workflows to perform transcription, OCR, document Q&A, and image generation without calling cloud APIs. The entire stack exposes an OpenAI-compatible endpoint through LiteLLM; the main model is the NVFP4 version of Qwen3.6-35B-A3B, with a single-user generation speed of 120 tokens/s and an aggregate of 359 tokens/s across eight users. The author's testing found that image generation reduces chat speed to about one-third, and recommends that small teams queue image tasks or schedule them outside working hours.

    #Tutorials / practice#English text is being prepared.#Open-source ecosystem

  18. AYi AI NotesAnalysis
    AI score56

    Anthropic engineer shares Claude Code multi-agent orchestration playbook

    In a 30-minute workshop, an Anthropic engineer demonstrated an advanced use of Claude Code: running more than 100 agents simultaneously within one integrated loop, with 1 main agent in charge, while sub-agents act as project managers to break down tasks, distribute them, and cross-validate results. Based on this, the author suggests developers first use the main window to write task decomposition and acceptance rules, then spawn sub-agents to execute submodules concurrently. The author also warns that when a hundred agents run simultaneously, if termination conditions and permission boundaries are not hard-coded, it is easy to burn a large amount of tokens in an infinite loop, and beginners should start small with one main agent and three sub-agents.

    Quoted postAYi · @AYi_AInotes

    English text is being prepared.

    #Tutorials / practice#Agents#English text is being prepared.

Monday3 items

  1. MarkTechPostAnalysis
    AI score56

    TinyFish Makes Search Free: Breaking Down the Real Cost of AI Agents Reading Web Pages

    TinyFish announced that, within limits, it will waive retrieval fees for Search and Fetch: Search is limited to 30 requests per minute and 500 per hour, while Fetch is limited to 150 URLs per minute and 1,000 per day. The article notes that free retrieval does not eliminate the inference costs of downstream models; the same article of about 4,300 characters returns an estimated 1,184 to 42,774 tokens across different providers, and three pages of unfiltered content can fill a 128K context window. In the September 28, 2026 Artificial Analysis snapshot, TinyFish Search scored 71 at $9.30 per 1,000 tasks, the lowest total cost among the displayed configurations but also the lowest score, with about 59 seconds per task.

    #Product updates#Search#English text is being prepared.

  2. ArenaAnalysis
    AI score70

    DeepSeek-V4.1-Flash-20261017 Tops the Code Arena WebDev Open-Source Model Leaderboard

    Arena says DeepSeek-V4.1-Flash-20261017 (Max) has become the top-ranked open-source model on the Code Arena WebDev leaderboard, surpassing Kimi K3 (Max) at 10 times lower cost. The model ranks 12th overall with 1,670 points, above Claude Opus 5 (High) and about 10 points behind GPT-6 Sol (Max); it is priced at $0.3/$1.2 per million input/output tokens, a 52-point improvement over the previous version DeepSeek-V4.1-Flash-20260910.

    Quoted postDeepSeek · @deepseek_ai

    🚀 DeepSeek-V4.1-Flash-1017 is here! Stronger benchmark performance, faster task completion, and shorter outputs than the previous version—a Pareto improvement in performance and cost. Now live on our website, app, and API. 🛠️ Optimized for @DeepSeekHarness, Tencent CodeBuddy, WorkBuddy, and more. Upgrade to DeepSeek Harness v0.2.1-rc.1 or later for the best experience with the new model. 1/4

    Same story · 2 reports

    #Evaluations / benchmarks#Open-source ecosystem#DeepSeek