←搜索结果

按匹配度 · 共 1358 条结果 清除搜索

星期一

  1. SemiAnalysis

    SemiAnalysis 发布 AgentX 1.0:百万上下文多轮智能体编码推理基准

    SemiAnalysis 发布 AgentX 1.0,称其为全球首个完全开源、100 万上下文的多轮智能体编码推理基准,以 Apache 2.0 许可发布,数据集构建投入超过 300 万美元。该基准被纳入 InferenceXv3,用智能体编码流量替代此前 8k 输入 1k 输出的单轮场景,测试矩阵运行在约 2MW 算力、1000 多颗芯片上,覆盖 MI355X、GB300 NVL72、GB200 NVL72、B300、B200、MI325、MI300X、H200 与 RTX Pro 服务器。SemiAnalysis 称其首个成果是已推动 vLLM、SGLang、TensorRT-LLM、ATOM、AITER、Dynamo、LMCache 和 Mooncake 等项目的 70 多个上游 PR,并计划在三到四周后发布 AgentX 更新文章。

    esults for themselves. All of the data is open source and the community has the opportunity to draw their own conclusions on the current state of real world inference performance. DeepSeek V4 Pro 0813 DeepSeek V4 Pro 0813 is an ultra popular frontier open weight model from China. It has 1.6 Trillion parameters with 49 Billion active parameters. As of August 21, the following graph shows the best performance per SKU for all submissions, normalized by total cost of ownership (TCO). The ISL/OSL dis

    匹配字段正文

星期六

  1. SemiAnalysis

    开源模型正在追上闭源前沿吗?

    SemiAnalysis 按早期扩展、推理、智能体三个时代分别评测开源与闭源模型,发现开源模型追上每个时代首个闭源前沿模型所需时间逐代减半。文章以 Llama-2-70B 对 GPT-3.5 Turbo 为例,当时综合得分 39.9 对 75.7,直到 2024 年 7 月 Llama-3.1-405B 才以 86 分追平 GPT-3.5 Turbo。评测使用 Prime Intellect 的评估栈,部分数据来自 Artificial Analysis 与 Datacurve 的 DeepSWE 榜单。

    Comparing open vs. closed models across the eras of frontier models, Is the gap narrowing? The past two months have been a breakout period for open source AI. Yes, there was the “DeepSeek moment” back in January 2025, but no one actually used R1 to do any economically valuable work. In contrast, models like GLM 5.3 and Kimi K3 are genuinely capable of many of the same coding and agentic tasks that rocketed Anthropic to $65B+ ARR. Unlike others who inflated ARR, our figures were much closer to re

    匹配字段正文

星期五

  1. NVIDIA Developer · Generative AI

    NVIDIA 谈 AI 智能体栈中的安全边界:OpenShell 与 Dynamo 如何分工

    NVIDIA 安全团队提出 AI 智能体栈的安全分层思路:模型、harness 与 meta-harness 只负责引导行为,最终权限由运行环境决定,NVIDIA OpenShell 提供隔离、身份、策略、凭证与审计的安全运行时,NVIDIA Dynamo 承担模型服务、缓存放置、路由与调度的推理数据面。文章给出五条设计规则和 Isolated、Connected、Production、Adversarial 四档安全配置,并强调智能体不得自行授予访问权限、高影响操作必须经过执行点。

    he runtime determines what that agent is allowed to do. The harness layer is a spectrum rather than a fixed category. Codex and Claude Code are opinionated harnesses, while Pi and DeepSeek Harness (DSH) expose more of the harness as a programmable substrate. Through Cordis, DSH enables core behaviors that can be composed and replaced as plugins. This programmability makes the harness a poor place for a security guarantee: a layer designed to be modified cannot reliably enforce controls against i

    匹配字段正文

星期四

  1. Ben's Bites

    Ben's Bites:个人智能体不过是一堆文件和工具

    Ben's Bites 的投票显示,996 名受访者中多数对个人智能体不感兴趣;作者认为个人智能体本质上只是连接到任意智能体工具的一堆文件和工具,文件为会话提供上下文,所谓记忆也只是会话开始时读取的文件。作者将在明天的文章中演示如何为自己搭建一个全新的个人智能体。

    e cloud agents in Cursor. I took the top 1k research papers of the last year, summarized them, and visualized them. Fun fact: all 1,000 papers cost a total of $4 to summarize with DeepSeek V4 Flash. 4:44 PM · Aug 19, 2026 · 44.7K Views 37 Replies · 90 Reposts · 1.03K Likes Niels Rogge @NielsRogge My life has become boring All I do is asking coding agents to write a PLAN.md, then /grill-me on it to improve the plan, then spin up an agent to implement it I'm just a markdown manager now😭😭 2:18 PM ·

    匹配字段正文

星期三

  1. Armin Ronacher AI 博客

    Armin Ronacher 解释大语言模型的推理机制

    Armin Ronacher 解释称,推理轨迹本质上是模型在最终回答前写入暂存区的文本,并通过特殊 token 和解析器与答案分流。他以 GPT-OSS、Responses API 和 DwarfStar 为例,分析推理强度如何由系统提示词塑造,以及禁用原生推理时模型为何可能把思考内容泄露到错误通道。

    why changing the effort invalidates the KV cache. I think closed GPT models call reasoning effort “juice,” since you can ask most models how much juice they have. In DwarfStar for DeepSeek with max reasoning this is added to the system prompt: Don’t Think The destination of reasoning tokens is therefore a learned convention: the model is trained to keep scratch work out of the final channel. Trick it into thinking it is in that channel and it may leak tokens. We have even seen older models, when

    匹配字段正文

星期二

  1. LMSYS Blog精选

    LMSYS 发布 Miles v0.1 生产级后训练系统

    LMSYS 发布 Miles v0.1,定位为面向前沿模型后训练的全栈生产级系统,是首个 Miles 版本的后续。它把 RL 训练循环拆成 SGLang 生成、训练器更新与权重同步三段,支持完全异步 RL、TITO 精确 token 记录、R3 路由重放,以及 NVFP4、MXFP8、FP8 等低精度训练配方。官方给出在 64 张 NVIDIA GB300 上训练 GLM-5.2 744B-A40B 终端任务的参考运行,稳定完成 100 步 rollout,单步训练约 4.5 分钟,前缀缓存命中率 96%。

    The Miles fully async RL loop

    g the generation pause within 3–5 seconds. Verified Day-0 Model Support Miles lands new frontier models on the day their weights become public, together with SGLang. Kimi-K3 [13], DeepSeek-V4 [10], Inkling [12], Qwen3.8 [14] and NVIDIA Nemotron 3 Ultra [11] were all trainable in Miles on release day, because the inference path in SGLang and the RL recipe in Miles are brought up in parallel rather than one after the other. Day-0 coverage is not limited to one architecture family either: it spans

    匹配字段正文

星期一

  1. Interconnects

    教所有人自己钓 token:开源模型生态的经济困境

    Nathan Lambert 认为,开源模型生态正越来越依赖 Nvidia 的资助,Nvidia 目前据报为此投入 260 亿美元,用于 Nemotron 等近乎开源的模型。若这笔投入无法在几年内带来相称回报,开源模型可能转向效率、可修改性与专用化的长尾路线,而非追赶领先闭源模型。他还指出,训练重心正从后训练转向更不透明的推理训练,愿意发布基座模型的开源团队将继续减少。

    ing is getting more complex and more abstracted. The current open model ecosystem is buoyed by an explosion in interest in post-training open models. These people take models like DeepSeek V4 Flash, Inkling Small, or GLM 5.X and finetune them for their specific agentic tasks (e.g. in Tinker, the most popular finetuning API today). Over the last few years, post-training largely referred to the whole process of modifying the base model to make it intelligent and usable. There is a shift happening

    匹配字段正文

星期五

  1. Hugging Face

    Hugging Face 发布 2026 夏季开源模型观察:Qwen 衍生模型达 15 万个

    Hugging Face 发布 2026 夏季开源模型观察报告,基于 Hub 前七个月数据指出点赞与下载记录的是两种不同行为:今年发布的模型无一进入下载量前 25,而 25 个中有 13 个来自 2022 年,all-MiniLM-L6-v2 七个月被下载 15.5 亿次。报告称 Qwen 衍生模型已达 151,448 个,是 Meta 总规模的 2.6 倍、Llama 仓库的 4.7 倍,前七个月以每天约 180 至 210 个新仓库增长。报告还提到 7 月 Claude Code 占智能体流量的 44.4%,Codex 从 10.4% 升至 20.8%,近四分之一智能体流量来自尚未登记的工具。

    are the only accounts on the Hub where the heavy band carries the volume. Effectively all of MiniMax's 2026 downloads are of models above 70B, along with 88% of Moonshot's, 55% of DeepSeek's and 39% of Z.ai's. No large American account looks like this: Google, Microsoft and IBM Granite record essentially none of their 2026 downloads above 70B, and NVIDIA and Meta only 14% and 9%. The difference becomes clearer in total downloads. Moonshot’s frontier-only portfolio recorded 37M downloads over the

    匹配字段正文

星期四

  1. Hugging Face精选

    复现 ICML 2,200 篇论文后,我们学到了什么

    Hugging Face 与 alphaXiv 组织社区借助编码智能体复现了 2,226 篇 ICML 2026 论文,并公开实验日志、代码和产物。受检论文中,51% 至少有一项主张获独立验证,23% 至少有一项被证伪或存在争议;结果也显示,智能体会误判尺度效应或单位问题,可靠审查仍需人类引导。

    Systematic Study of QKV Variants Explore and manage experiment logs in a web interface Explore code, traces, and workspace with an interactive logbook More Articles from our Blog DeepSeek-V4: a million-token context that agents can actually use 60 April 24, 2026 agents smolagents nlp Our Transformers Code Agent beats the GAIA benchmark 🏅 101 July 1, 2024 Community It was interesting to reproduce one of the ICML accepted papers using these tools. This analysis from the hackathon was particularly

    匹配字段正文

星期三

  1. The Next Platform

    Nvidia 发布 Nemotron 3.5 Lightning 模型与 NeMo Switchyard 路由库

    Nvidia 发布 Nemotron 3.5 Lightning 开源模型和 NeMo Switchyard 路由库,前者面向持续运行的智能体任务,官方称在同级中实现 4 倍吞吐、完成智能体任务速度提升 30%,并可在 Jetson、GeForce RTX、DGX Spark 和 DGX Station 上本地运行。Switchyard 让开发者自定义模型池、路由标准和策略,把推理密集型步骤交给前沿模型、把执行类任务交给 Lightning,官方称其以 Anthropic Opus 4.8 约三分之一成本取得更好准确率。Nvidia 同时公开训练数据与方法,并发布用于训练编码智能体的开放数据集 Nemotron-RL-Agentic-Terminal-Pivot。

    ent levels of intelligence.” Lightning also comes at a time when open models continue to roll into the market, particularly from vendors from China, such as Moonshot AI’s Kimi K3, DeepSeek’s various models, and Alibaba’s Qwen family. Stateside, Meta Glimmer this week rolled out Muse Glimmer, the first in a promised set of open models. (Meaning open weights, but not necessarily open source code for the training algorithm for the models.) Briski noted that over the past year, Nvidia has rolled out

    匹配字段正文

星期二

  1. Hugging Face

    考虑 ACE?ALTK-Evolve 能以更少 Token 实现

    ALTK-Evolve 通过按模型能力调整指南投放量,在 AppWorld 内部对比中以更低推理成本取得与 ACE 相当或更好的准确率。强模型配置的成本约为 ACE 的 40%,弱模型以约七分之一成本获得 56.0 分,对比 ACE 的 54.8 分。两者都保留带计数的经验指南,但 ACE 每步注入完整 playbook,ALTK-Evolve 可选择性检索或投放完整集合。

    rence above. Where does the accuracy come from? The by-difficulty breakdown tells two different stories: Figure 1. Post-memory Task Goal Completion by difficulty, ours vs. ACE. On DeepSeek-V3.2 (right) we win Easy, Hard, and Overall; ACE only edges Medium. On gpt-oss-120b (left) ACE leads easy and medium, but per-task selection wins the hard tasks — and the aggregate. Each system improves from its own no-memory baseline (see the by-difficulty reference tables under Method notes below). The two m

    匹配字段正文

  2. NVIDIA Developer · Generative AI精选

    NVIDIA 发布 NeMo Switchyard,为 AI 智能体提供跨模型路由

    NVIDIA 发布 NeMo Switchyard,为 AI 智能体提供跨模型路由能力,可在专用模型与前沿模型之间按任务分配请求,以平衡性能、成本与效率。该工具提供免调优的 LLM 分类器、阶段路由器和升级路由器,也支持基于工作负载数据训练的预填充路由器,并可通过 OpenAI、Anthropic 和 Responses API 接入。LangChain 在 145 个多轮智能体任务上测试升级路由器,在 Nemotron 3.5 Lightning 与 Claude Opus 4.8 之间路由,仅 7% 调用发往前沿模型,成本降低 74%,准确率约有 6 个百分点的折让。

    controllable agents better suited for real AI workflows. Consider a system of models performing a computer-use task measured by the Terminal-Bench Hard benchmark (Figure 1). While DeepSeek V4 has the highest overall accuracy in this example, it isn’t the best model for every task group. For instance, Kimi K2.6 is better suited to the ML and RL task groups, while Qwen3.5 397B A17B is preferable for math and science. The remaining six task groups should use DeepSeek V4. This approach can also be a

    匹配字段正文

星期一

  1. Interconnects

    Interconnects 作者发布后训练教材《Reinforcement Learning from Human Feedback》

    Interconnects 作者 Nathan Lambert 的后训练教材《Reinforcement Learning from Human Feedback: Aligning and Post-training LLMs》由 Manning 出版,已在 Manning 和 Amazon US 发货,Amazon UK 10 月上市。全书约 25% 篇幅讲 RL,覆盖从策略梯度定理到 PPO、GRPO、GSPO、CISPO 等算法,并包含拒绝采样、结果奖励模型、角色训练等主题,还临时加入了 on-policy distillation 一节。

    tion the early knowledge distillation literature of 2015 to 2-3 key insights that got us to the multi-teacher on-policy distillation (MOPD) of models like Xiaomi MiMo-V2-Flash and DeepSeek V4. The second half of this book goes into a tour of over-optimization, regularization, evaluation, and character training, which is all about the many ways post-training can go wrong and what you need to stay on top of. This is what differentiates the book most from those that are just a list of code exercise

    匹配字段正文

星期四

  1. Hugging Face

    Baseten 接入 Hugging Face Inference Providers

    Hugging Face Inference Providers 现已支持 Baseten,用户可通过网页、huggingface_hub >= 1.26.1、JavaScript SDK 及多种 Agent Harness 调用其托管模型。请求可使用供应商 API key 直连并由供应商计费,也可经 Hugging Face 路由且不加价;PRO 用户每月获 $2 推理额度,登录的免费用户享有少量免费配额。

    en is available through the Hugging Face SDKs - huggingface hub ( = 1.26.1) for Python and @huggingface/inference for JavaScript. The following examples show how to use the latest DeepSeek V4 Flash through Baseten. Use a Hugging Face token to authenticate - the request will be routed to Baseten automatically. From your favorite Agent Harness Hugging Face Inference Providers are integrated in most Agent Harnesses - including Pi, OpenCode, Hermes Agents, OpenClaw, and more. This means you can plug

    匹配字段正文

星期一

  1. Recode China AI

    禁止中国开放权重模型对美国弊大于利

    作者主张,禁止中国开放权重模型会切断美国 AI 生态的低成本创新来源,却难以阻止已公开权重的全球传播。文章认为,廉价模型有助于降低应用层推理成本、支持企业自主托管数据并促进价格竞争,而既往技术限制也未必实现预期目标。

    Tony Peng's avatar

    cutives cited model cost as the primary obstacle to generative AI adoption. Chinese labs have shipped some of the most aggressively priced, yet competitive open models. The latest DeepSeek-V4-Flash costs just 1/105 of Anthropic’s Fable 5 on one task, according to Artificial Analysis. Even at that ratio, DeepSeek’s CEO said in a investor meeting that the company still runs a 60% profit margin and can recoup a model’s cost within 10 months. A growing trend today is developers now route models by c

    匹配字段正文

  2. Interconnects

    Interconnects 推出 Artifacts Hub 与 Adoption Dashboard

    Interconnects 发布 Artifacts Hub 和 Adoption Dashboard 两个免费数据项目,前者覆盖过去两年发布的 792 个模型,结合 Hugging Face、Open Router 推理 token 与 Artificial Analysis 智能指数展示模型趋势;后者按地理和组织追踪下载量与衍生模型数量,突出中美差距。两个项目与 AI 验证初创公司 Project VAIL 合作构建。

    ghts the US-China gap and growing players in the open ecosystem. To date, our primary efforts on Interconnects have been release recaps for popular models like Kimi K3 , GLM 5.2 , DeepSeek R1 , etc. and monthly round-ups of the open models that matter, Artifacts Log . We’re expanding on these, building on the tools and internal data we’ve collected for other projects like The ATOM Project (and report ). This allows us to capture our ecosystem view of open models, develop methods for understandin

    匹配字段正文

  3. OpenHands 官方博客

    2026 年工程团队最佳 AI 编程工具盘点

    OpenHands 官方博客发布 2026 年工程团队最佳 AI 编程工具盘点,按自主性、部署模式、模型灵活性、界面、定价与治理等维度评估,涵盖终端智能体、IDE 工具和专有平台。文章引用 Faros AI 2026 工程报告,基于 22,000 名开发者、4,000 多个团队的遥测数据,发现团队从低 AI 采用率升至高度采用时,每位开发者完成 epic 数增长 66.2%。

    runs as a minimal CLI with tree-structured sessions that allow branching and navigation without losing context; Broad provider support via BYOK: Pi connects to Anthropic, OpenAI, DeepSeek, Gemini, Groq, xAI, OpenRouter, and Kimi through your own API key or existing subscription; Small core: Pi keeps its built-in orchestration and tool surface minimal, which can make it more straightforward to inspect and modify than larger agent frameworks; No governance layer: Pi has no plan mode, sub-agents,

    匹配字段正文

星期六

  1. NVIDIA Developer · Generative AI

    NVIDIA 详解面向快速交互式长上下文推理的 AI 模型注意力协同设计

    NVIDIA 技术博客分析 dense attention 在 GPU 上的性能规律:增大 group size(G)可提升 decode 吞吐,head dimension 取 128 或 256 更契合 GPU tile 与 128 字节内存传输;prefill 延迟随 ISL 平方增长,decode 延迟随 KV cache 序列长度线性增长。文章给出四条协同设计准则,并指出张量并行不应超过 KV head 数(KH),TensorRT-LLM 以 Wide EP 和 Helix Parallelism 应对。

    idelines: a co-design checklist that helps model developers raise inference throughput and interactivity on NVIDIA GPUs. Stay tuned for a post covering sparse attention. Figure 1. DeepSeek-R1 prefill time breakdown at 4K, 32K, and 128K context lengths, where the attention share rises from 18% to 85% Every analysis is grounded in two sources: analytical formulas from GEMM-shape arithmetic, and measured data from prefill and decode kernels with FP8 for both attention compute and the KV cache. Pref

    匹配字段正文

星期三

  1. The Next Platform

    AMD 公布 Venice CPU 与 MI400 系列 GPU 路线图,瞄准智能体 AI 与机架级系统

    AMD 在 Advancing AI 2026 活动上公布服务器 CPU 与 Instinct GPU 路线图。Venice Epyc 9006 采用 Zen 6 与 Zen 6c 核心,最高 256 核 512 线程,顶配型号相较 Turin 每插槽性能提升 1.8 倍,并支持 PCI-Express 6.0。MI455X 基于 CDNA 5 架构,配备 432 GB HBM4 与 23.3 TB/sec 带宽,FP8 算力 20 petaflops;Helios 机架将搭载 72 颗 MI455X 与 18 颗 Venice HF CPU,AMD 称其每美元 token 数比 Vera-Rubin NVL72 机架最多高 30%。

    55X GPU accelerator and made some vaguer claims about performance at the rack level compared to Vera-Rubin racks coming later this year. Here is the inference throughput using the DeepSeek V4 Flash model: As with other GPUs and XPUs, the increase in capacity across all fronts in the MI455X device yields higher token throughput, and particularly at the higher interactivity levels where users need more tokens processed. Here is how AMD reckons the cost per token on DeepSeek V4 Flash on the two dif

    匹配字段正文

  2. LMSYS Blog

    LMSYS 在 Miles 中实现 Blackwell 原生 MXFP8 与 NVFP4 强化学习配方

    LMSYS 在 Miles 中实现了两种 Blackwell 原生强化学习配方:端到端 MXFP8,以及面向 MoE 专家的逐 token NVFP4,覆盖 checkpoint 转换、Megatron 训练、SGLang rollout 与在线权重更新。在 8x B200 上对 Qwen3-30B-A3B 的配方消融中,BF16 与五种低精度配置的原始 reward 曲线高度重合,MXFP8 和 NVFP4 均缩短了 rollout 时间。NVFP4 采用在线逐 token 激活缩放,并支持高精度或反量化 backward 模式,相关改动已提交至 TransformerEngine、FlashInfer、SGLang 等上游仓库。

    NVFP4 two-level scaling with FP32 tensor scale and E4M3 block scales

    oduce avoidable train-inference mismatch Why Blackwell-Native Recipes? Previous low-precision approaches were not designed around MXFP8 or NVFP4. The existing Miles path follows a DeepSeek-V3-style block-scaled FP8 recipe: weights use 128x128 block scaling, activations use 1x128 tile scaling, and scales are computed online for each tile or block. This is a strong Hopper-era recipe, but on Blackwell its FP32 scales are still applied in software around the Tensor Core path rather than through nati

    匹配字段正文