←搜索结果

按匹配度 · 共 95 条结果 清除搜索

星期五

  1. LMSYS Blog精选

    LMSYS 公开 infer-forge:围绕 SGLang 的 Harness、Loop 与 Graph 工程方法

    LMSYS 发布 infer-forge 方法论文,介绍围绕 SGLang 的推理工程系统,由 MonoRepo、Harness、Task Loop 和 Task Graph 四层结构组成,用于让跨仓库的推理优化工作可复现、可验证。该系统为内部工程系统,并非 SGLang 或 LMSYS 官方组件,目前不开源,文章公开的是构建方法论,供团队交给 AI 编码工具并结合自身系统上下文搭建适配实现。文中给出使用记录:一位工程师 4 月至 7 月的在飞任务峰值从 2 个升至 9 个,DeepSeek-V4-Pro 服务项目中 38 个可独立验证的任务节点被组织成任务图。

    The inference deployment space stacks five layers of static configuration. Model shows Ling, Qwen, DeepSeek, Kimi, GLM, and MiniMax. Serving Scenario runs Modality (text, image, video) into Traffic Shape (input and output length, media count, resolution, QPS, concurrency, cache reuse) into SLO (TTFT, TPOT, throughput, E2E latency). Serving Topology separates Deployment Architecture—Colocated PD, PD Disaggregation, and EPD Disaggregation, each listing the node roles it is built from — Prefill and Decode together, then Prefill and Decode as separate roles, then Encoder alongside them — from Parallelism—TP, PP, DP, and EP—because the two are chosen independently. Versioned Runtime Profiles is a stack of tabbed cards labelled Service A rev. 12, Service B rev. 7, and Service C rev. 21, plus a fourth paler card behind them all, blank and showing only its top edge, whose narrow tab carries an ellipsis for the profiles not drawn, the front card holding an Engine Configuration and a Container I

    Harness Engineering for Self-Improvement, Lil'Log, July 4, 2026; Boye Niu et al. — Flow: Modularized Agentic Workflow Automation, arXiv:2501.07834, 2025; Andy Xu and Yu-Wing Tai — Meta-Agent: From Task Descriptions to Verified Multi-Agent Systems, arXiv:2605.25233, 2026; Ao Li et al. — GraphFlow: A Graph-Based Workflow Management for Efficient LLM-Agent Serving, arXiv:2605.22566, 2026; Sydney Runkle and Harrison Chase — 3 Years of Graph Engineering with LangGraph, LangChain, July 22, 2026; Nelso

    匹配字段正文

星期四

  1. Linear:Now

    Linear 如何用 StyleX 改造 React 应用的样式系统

    Linear 通过超过 1,000 个 PR,将 React 应用从 styled-components 迁移至 StyleX,并以 codemod、AI 智能体和人工判断共同推进。测试显示,移除运行时样式注入后,重视图页面的主线程 CPU 工作减少约 20% 至 35%,中端设备速度提升约 30%。团队还通过 lint 规则、仓库级检查器和迁移追踪工具,约束样式接口、合并优先级及主题安全。

    Rows of white pixelated grid patterns on a black background, transitioning from dense solid blocks on the left to sparse scattered squares on the right.

    gave us static extraction and strong type safety. But its API felt more fragmented, and the separation between component and style files did not fit how we like to work. StyleX by Meta gave us a better balance. Styles stay colocated with components, the API is small, and style resolution is deterministic. It also gives us type-safe styling contracts and makes it deliberately harder to reach into a component and restyle it from the outside. Those constraints come with tradeoffs. Migrating from th

    匹配字段正文

星期六

  1. Anthropic News精选

    Anthropic 解释 Claude 文本水印如何工作

    Anthropic 宣布未来 Claude 模型生成的文本将带有水印,用于判断 Claude 参与写作的可能性,以符合 EU AI Act。水印只在模型可自由选词的随机位置留下模式,不影响输出质量、速度与价格,也不包含用户信息;检测只能给出 Claude 参与的概率,短文本、事实性内容和代码中水印较稀疏。Anthropic 同时以私有预览形式开放检测 API,并对 .png、.jpg、.svg 等文件附加 C2PA 内容凭证。

    Claude produces a file of a supported type (such as a .png, .jpg, or .svg), it will attach a content credential in the form of a small, cryptographically signed note in the file’s metadata, saying that the file was made or processed with Claude. This is an open industry standard called C2PA —the same used by camera manufacturers and in photo-editing software to record where an image came from. Any C2PA-aware tool can read it; we’ll be providing our own where you can drop a file and check. This m

    匹配字段正文

星期五

  1. Hugging Face

    使用 Strands Agents、LeRobot 与 Hugging Face Storage Buckets 在一处完成录制、训练和部署

    Strands Robots 将 LeRobotDataset 的录制、同步、流式训练和实体机器人部署整合到同一 Robot() 工作流,并让新演示数据返回同一 Storage Bucket。Xet 按字节去重,仅上传变化的数据块;stream_dataset() 可从 Hub 逐帧读取远程 Parquet 与 MP4 分片,无需完整下载。Bucket 仅支持流式读取且不保留修订记录,真实部署还需隔离数据与凭据、限制智能体权限并只加载可信组织的模型。

    GPU waits; stream dataset() reads batches straight from the bucket with nothing on local disk, so the GPU trains from the first batch. Nothing lands on local disk except the small meta/ folder of schema, statistics, and episode index. Camera frames are decoded from the remote MP4 shards as you iterate; state and action come from the Parquet shards. That loop reads one frame at a time, which suits inspecting an episode. To train, pass the reader to a DataLoader and iterate batches instead. The st

    匹配字段正文

星期一

  1. Linear:Now

    Linear 如何构建 Linear Agent

    Linear 介绍了 Linear Agent 的构建方法,通过系统提示词、工具设计、产品语义模型、运行范围和自研框架,在灵活性与可控性之间取舍。其系统技能按需加载提示词片段和工具,以控制上下文规模;自研框架则支持动态注入工具、按情境审批工具调用和异步执行子智能体。

    Abstract line illustration of overlapping solid and dashed ellipses within a rectangular grid, suggesting multiple possible paths constrained within a defined structure.

    requests require only a small slice of Linear’s product surface, we introduced system skills as a unit of composition for the agent. Each system skill bundles together some basic metadata, a fragment of the system prompt, and a set of tools. Together, they represent an independent set of capabilities that can be progressively disclosed to the agent when needed. (This is separate from user-created skills, which users can author for their own workflows. Those are reusable instructions created on

    匹配字段正文

星期五

  1. The Register

    测试游戏显示人工审批漏掉约三分之一危险 AI 编码智能体请求

    比利时开发者 Alex Wauters 制作的浏览器游戏让玩家在 60 秒内审批模拟的 Claude Code 权限请求,超过 4 万次运行、40.9 万条命令的数据显示,平均约三分之一的恶意命令被放行。最常被漏掉的是范围越权类请求,占比 35%,例如读取 Kubernetes 配置文件或 AWS 凭据;被漏掉最多的单条命令是 npm run analyze,近 65% 的玩家批准了它。Wauters 认为反复审批会带来疲劳,建议把编码智能体放进沙箱和云端 devcontainer,并配合 auto mode 与钩子来拦截风险动作。

    er end of the spectrum is mass approving everything, then something’s gotta give. MORE CONTEXT Bug in top AI coding agents shows that Unix-era security headaches never really die; Meta wants to get inside your terminal with its new coding agent; Prompt injection isn't the bug, AI agent frameworks are; Claude Code bypasses safety rule if given too many commands “I think it becomes clear we need to pay more attention to the permission model of these agents, and devs need to be more aware of the tr

    匹配字段正文

星期二

  1. Cartesia 产品与研究

    Cartesia 解析如何判断 TTS 模型是否真正优秀

    Cartesia 发布技术博客,系统拆解 TTS 模型评测的多维挑战,指出 WER 饱和、上下文正确性、文本归一化、自动质量分数局限、人工评测偏差、长音频与流式失败模式、领域差异及多语言难点。文章强调 TTS 质量不是单一维度,需按产品体验构建多维评测,并介绍了 Cartesia 在低延迟、清晰度、自然表达、上下文正确性、一致性和流式鲁棒性上的优化方向。

    rprise-grade voice agents. 3. Contextual correctness is another challenge Many errors require semantic disambiguation to even define correctness: “read” (present vs past); “lead” (metal vs verb); “Polish” (nationality vs verb); “bass” (fish vs instrument); “live” (verb vs adjective); years like “2026” (twenty-twenty-six vs two thousand twenty-six) I had to wind the old clock before the wind picked up outside. Proper nouns are worse: names of people, places, products, companies, drugs, and fictio

    匹配字段正文

星期五

  1. Hugging Face

    PyTorch 性能分析(第三部分):剖析注意力后端

    本文通过 PyTorch Profiler 对比朴素注意力与 SDPA 的 math、efficient、flash 和 cuDNN 后端,揭示不同实现的执行开销。原地 masked_fill_ 可在无梯度前向中消除一次 Memcpy;math 后端因 FP32 转换、重复构造掩码等操作启动 20 个 GPU kernel,慢 3.7 倍,而其余后端将计算融合为单个 kernel。测试形状下 FlashAttention-2 最快,其低占用率源于大量使用片上资源,并不代表优化不佳。

    s kept in registers, the fastest memory on the chip. sm80 : compiled for Ampere (the A100's compute capability 8.0). This is the memory efficient attention kernel that grew out of Meta's xformers library and was upstreamed into PyTorch. When people say "the xformers backend," this fmha cutlassF kernel is what they mean. Flash backend uv run 04 c sdpa attention.py --backend flash uvx trace-util -f traces -b /traces Figure 15: The flash backend trace, one fused pytorch flash kernel per forward The

    匹配字段正文

星期一

  1. Hugging Face精选

    PRX 第4部分:我们的数据策略

    Photoroom 为 7B 文生图模型 PRX 构建了兼顾规模与多样性的预训练数据管线,以 Lance 完成探索和整理,再转换为 MDS 供分布式训练。团队用 Qwen3-VL-8B 重新生成详细图像描述,并采用 quality 92 的 JPEG、分辨率与宽高比分桶。文本分类和感知哈希通过跳过列表过滤文本密集、NSFW 及近重复样本,无需重写数据集。

    NSFW content and personal information, we build on that work instead of repeating it at scale. Sources arrive in different shapes: some come with the image data itself, others as metadata plus baseline captions that we bring into a common form. We took a pragmatic approach: rather than build a corpus entirely from scratch, we leaned on existing datasets and our own tooling to assemble one quickly. In hindsight it is not necessarily the absolute best dataset one could build, but it was a solid a

    匹配字段正文

星期四

  1. LMSYS Blog

    LMSYS 分享 SGLang 智能体辅助开发实践:从 SKILL 到 SOTA 循环

    LMSYS 发布博客,介绍 SGLang 智能体辅助开发的初步探索,把 CUDA 崩溃调试、内核集成、测试、CI、性能剖析、生产排障等仓库级流程写成可执行的 SKILL.md 与脚本。文中给出 llm-torch-profiler-analysis 与 llm-pipeline-analysis 两个剖析技能,前者输出 kernel、overlap、fuse 三类固定表格,后者按前向传播与层拆分 trace。基于 KDA-Pilot 的 10 个 B200 扩散内核任务中,多数在提取的生产行上取得 1.1341x 至 2.7499x 的 wall-geomean 加速,截至 2026 年 6 月 27 日已有三个优化合入 SGLang 上游。

    agent does not freely modify the whole SGLang repository: Workloads come from real SGLang diffusion models. The process first runs 20 diffusion models and summarizes actual kernel metadata; The baseline is copied from upstream SGLang main, with source lineage recorded; Baseline and candidate must use the same local ABI and the same build/export path; Benchmarks use fixed production rows, A/B interleaving, and CUDA event or wall timing; Correctness covers production rows, a canonical regression g

    匹配字段正文

星期六

  1. Ahead of AI精选

    Sebastian Raschka:如何用开源工具搭建本地编码智能体

    Sebastian Raschka 演示了如何用 Ollama、本地开放权重 LLM 和 Qwen-Code 搭建可读写文件、运行命令并验证修改的本地编码智能体。文章还介绍了安全审计、性能测试及 Codex、Claude Code 的接入方式;其小规模评测中,Codex 使用更少 token,而 Claude Code 在部分模型组合上取得更高任务成功率。

    a app to download models directly via the GUI: Otherwise, this can be done on the command line as well via By the way, the above-mentioned qwen3.6:35b-mlx is a model using Apple’s Metal performance shaders, i.e., optimized for Macs with Apple silicon chips. I highly recommend using -mlx versions of models working on Macs (if available). On a Linux machine, use the non-MLX version: Then, to make sure that it works, you can either use the GUI again or launch Ollama from the command line. You can e

    匹配字段正文

星期一

  1. Browser Use

    Browser Use 如何把云浏览器成本降到三分之一并加快启动

    Browser Use 重建了云浏览器基础设施,把每个浏览器会话从每小时 0.06 美元降到 0.02 美元,并让新会话在 1 秒内启动。它改用 Firecracker 在普通 EC2 上为每个会话运行独立微型 VM,通过 2MB 大页、自定义 userfaultfd 处理等把恢复 VM 到可接受命令的时间从 9.8 秒降到 3.1 秒,页错误处理次数从约 10 万次降到约 1100 次。VM 冷启动低于 400ms,公开 API 的浏览器创建延迟为 p50 825ms、p99 1.35s,该基础设施已上线。

    Browser Use: how we made cloud browsers 3x cheaper — every browser is its own Firecracker microVM on regular EC2, at $0.02 per browser hour with sub-400ms VM cold start and headless stealth.

    ystem. Every Browser Use Cloud session runs in its own, tiny VM. These VMs run on EC2, Amazon's rented cloud servers. That is the unusual part. Firecracker is normally run on bare-metal servers, where you rent the whole physical machine. To reduce customers' cost, we run it on regular EC2, where AWS has already put your server inside a VM. This should be slow. Nested VMs make memory and CPU operations more expensive, and Chromium takes time to start. This post is about how we made this setup fas

    匹配字段正文

星期二

  1. Together AI Blog精选

    Together AI 如何高效服务 MiniMax M3:支持 1M-Token 上下文与原生多模态

    Together AI 优化了 MiniMax M3 的生产级推理服务,使其支持 1M-Token 上下文、原生多模态与智能体工作流。MiniMax Sparse Attention 让预填充和解码分别提速超过 9 倍和 15 倍,其他优化使常见智能体流量下的性能提升 81%–125%。M3 开放权重发布后,Together AI 将提供开发者端点。

    g, pick a subset based on FPS (Frames Per Second), resize and normalize, then patchify with the temporal dimension baked in. What comes out is a flat patch tensor and a small grid metadata tensor, packed into a gRPC message. The worker just runs the vision encoder directly — no preprocessing on its end. Also, SMG's multimodal pipeline is structured around Rust traits that separate model-specific preprocessing logic from the pipeline plumbing. Adding M3 multimodal support meant implementing these

    匹配字段正文

星期二

  1. Modal 官方工程博客

    Modal 如何实现真正的无服务器 GPU

    Modal 官方工程博客详解其无服务器 GPU 方案,通过云缓冲、自定义文件系统 ImageFS、CPU 检查点恢复和 CUDA 检查点恢复四项优化,把 AI 推理服务副本的启动时间从约 2000 秒缩短到 50 秒,提速 40 倍。其中 GPU 内存快照让 vLLM 或 SGLang 服务约 1 GiB 模型(Qwen 3 0.6B bf16)的冷启动典型提速 4-10 倍,Reducto 的冷启动从约 70 秒降到约 12 秒。作者称该技术栈已在数千万个副本规模上运行,过去三个月有数百家组织使用 CPU 和 GPU 快照。

    Diagram indicating latency to scale up an inference server in a baseline cloud system and on Modal

    for the entire world, that will never be read by most applications. You can skip loading the entire filesystem before the container starts and instead just block start on loading metadata (an index). The metadata is only a few megabytes, so it can be loaded in 100ms or less, along with everything else needed to start a container. The remainder can be loaded concurrently with other work — or not at all! The majority of the files will not be read, as reported in Figure 5 of the Slacker paper from

    匹配字段正文

星期六

  1. Browser Use

    Browser Use 开源库的生产架构:SQS 到 Lambda 的工程实践

    Browser Use 官方博客公开了其开源库在生产环境运行的架构,采用 FastAPI on ECS Fargate 接收任务、单条标准 SQS 队列传递消息、Lambda 作为 worker 执行 Agent,并将检查点、截图、日志和输出文件存入 S3。由于 Lambda 有 15 分钟硬限制,系统在截止前两分钟优雅停止、将状态写入 S3 并重新入队,由新的 Lambda 调用恢复继续执行,continuation 计数器上限为 12,约合三小时墙钟时间。失败处理直接复用 Lambda 重试与 SQS 死信队列,三次失败后进入 DLQ 且不自动重投;作者还提到 Lambda 的 /tmp 在热实例间不会自动清理,因此每次调用开始时清空工作区。

    different Lambda invocation picks it up. After three failed attempts the message goes to the DLQ. There is no retry counter in our database. The retry state lives entirely in SQS metadata, so if we need to know whether a task is on its second attempt we check the message attributes, not our own tables. The DLQ is a fire alarm. When messages land there it usually means we introduced a regression or there's a deeper issue to investigate. It's rare, and when it happens an engineer looks. We don't

    匹配字段正文

星期二

  1. Together AI Blog

    容量无冲突:面向 AI 原生团队的多租户 GPU 集群设计指南

    Together AI 介绍了多租户 GPU 集群的设计方法:在底层集中管理计算、存储和网络资源,同时为各团队提供专用 GPU 节点、存储卷及独立凭据。平台通过硬配额、预约防冲突和按需扩容减少闲置与跨团队干扰,并支持 Kubernetes、Slurm、CUDA 驱动和存储配置按工作负载选择。节点交付前还应通过 DCGM、GPU burn、NCCL 和 NVBandwidth 测试,故障时执行重新配置或集群迁移。

    erate in their own clusters, with zero visibility into adjacent tenants. Together AI’s multi-tenant clusters are a concrete implementation of this pattern, demonstrating what bare-metal performance with cloud-like flexibility looks like for AI-native teams in practices, billed directly per tenant based on actual usage. This is where quota-based allocation becomes essential in any AI-native environment. Administrators set guardrails per team, capping by GPU count, total spend, or reservation wind

    匹配字段正文

星期五

  1. Linear:Now

    Linear 团队如何使用 Linear Agent 推进产品开发

    Linear 团队介绍了三类 Linear Agent 工作流,将客户邮件、Slack 讨论和产品经理发现的问题转化为 issue、代码修改及 pull request。团队让智能体在 Intercom、Slack 和 Linear 等工作发生处获取上下文,并结合 Code Intelligence、定制 MCP servers 和编码智能体协助排查与开发。Linear 认为更有效的做法是把任务拆成小而明确的步骤,先观察表现并补充指导,再逐步提高自主程度。

    Symmetrical white lines and dots radiating from a bright central point on a black background.

    rns emails into scoped issues directly from Intercom, without ever needing to leave the inbox. The agent picks up the full context, including any back-and-forth with the customer, metadata, and attachments. While you can add extra details in Intercom to help define the issue, Alexandra Lapinsky Wilson, who leads Product Operations and CX, says she rarely finds it necessary. The agent typically gets it right. Stage 2: Route it to the right team automatically⁠ Once the agent has scoped the context

    匹配字段正文

星期二

  1. Anthropic Engineering

    Anthropic 分享长时应用开发的 Harness 设计

    Anthropic Labs 成员 Prithvi Rajasekaran 介绍了用于长时自主应用开发的 harness 设计,借鉴 GAN 思路搭建生成器与评估器分离的多智能体结构,并扩展到规划器、生成器、评估器三智能体架构。在前端设计实验中,评估器通过 Playwright MCP 实际操作页面并按设计质量、原创性、工艺、功能性四项标准打分,单次生成迭代 5 到 15 轮,完整运行最长约四小时。作者随后用 Opus 4.5 和 Opus 4.6 迭代该 harness,发现模型能力提升后部分组件不再必要,例如 Opus 4.6 上可移除 sprint 结构并把评估器改为运行结束时的单次检查。

    s, returning to works-in-progress, and understanding what each project contains at a glance. User Stories: As a user, I want to: Project Data Model: Each project contains: Project metadata (name, description, created/modified timestamps) Canvas settings (resolution: e.g., 256x224, 320x240, or 160x144) Tile size configuration (8x8, 16x16, or 32x32 pixels) Color palette selection All associated sprites, tilesets, levels, and entity definitions Product updates, how-tos, community spotlights, and mo

    匹配字段正文

星期五

  1. OpenHands 官方博客

    OpenHands 官方博客:如何创建有效的 Agent Skills

    OpenHands 官方博客介绍 Agent Skills,即用 SKILL.md 等文件把重复性任务固化为可复用工作流,仅在触发时加载完整技能以保持上下文精简。文章给出创建、团队共享(仓库目录、GitHub、Extensions registry)以及用 OpenTelemetry 日志、自动评测和仪表盘持续改进技能的完整流程,并提到用 Gemini-3-Pro 汇总反馈提出改进建议。相关代码大多开源。

    n. Specifically, skills are now standardized using the AgentSkills standard to include files in the following format: The most central part of this is SKILL.md, which contains: 1) metadata with name, description and triggers, 2) markdown with instructions on how to carry out the task, and 3) optional references to scripts and other files. Notice that the only metadata is loaded every time, while the full skill is only loaded to the context when it is triggered. This is called "progressive disclo

    匹配字段正文

  2. Replit Blog

    Replit 如何用虚拟时钟把任意网页渲染成确定性视频

    Replit 介绍其视频渲染引擎的实现:向页面注入约 1200 行 JavaScript,替换 setTimeout、setInterval、requestAnimationFrame、Date 和 performance.now() 等时间 API,让时间只在渲染时按 1000/fps 毫秒推进,从而把任意网页逐帧渲染成 MP4。由于页面内容不受控且视频由 AI 智能体生成,团队没有采用 Remotion,而是从外部对任意网页施加确定性。音频方面通过 monkey-patch Web Audio API 和 HTMLMediaElement 拦截播放意图,再由服务端 FFmpeg 混音;视频元素则经服务端转码为 fragmented MP4、mp4box.js 解复用、WebCodecs 解码后绘制到 canvas。该实现受开源项目 WebVideoCreator 启发,团队计划将其开源。

    We Built a Video Rendering Engine by Lying to the Browser About What Time It Is — cover image

    less browser. So we don't try to capture speaker output. Instead, we spy on playback intent. We monkey-patch key Web Audio API and HTMLMediaElement entry points to intercept audio metadata at the source, before it ever reaches a speaker path: When the page plays a sound, we now know: which audio file, when it started, how loud it should be (by walking the GainNode graph), and whether it loops. This approach covers the most common audio paths and is designed to work across Howler.js (Gemini loves

    匹配字段正文