←搜索结果

按匹配度 · 共 2039 条结果 清除搜索

星期二

  1. Inception Labs Blog

    Inception Labs 更新 Mercury 系列扩散 LLM 产品线

    Inception Labs 在其产品博客集中列出 Mercury 系列扩散 LLM 的进展:Mercury 2 面向搜索场景,可在既有延迟预算内为每次查询执行五十到一百次 LLM 调用;Mercury 2 用于语音智能体时 TTFT 低于 300 ms,并已上线 Azure AI Foundry。Mercury 2.5 被称为市面上能力最强的扩散 LLM,运行速度 1,107 tokens/sec,智能水平较 Mercury 2 提升 40%。此外,Mercury 2 新 API key 可获 100M 免费 tokens,速率限制提升 10 倍。

    le model. Jul 29, 2026 Product Mercury 2: the first reasoning model fast enough to pick up the phone Mercury 2 brings real-time reasoning to voice agents. TTFT <300 ms on standard NVIDIA GPUs, so your agents can actually hold a conversation. Jul 14, 2026 Product Mercury 2: the first reasoning model fast enough to pick up the phone Mercury 2 brings real-time reasoning to voice agents. TTFT <300 ms on standard NVIDIA GPUs, so your agents can actually hold a conversation. Mercury 2 is now available

    匹配字段正文

  2. TechCrunch AI

    AMD 以 82 亿美元收购李飞飞的 World Labs

    AMD 宣布以 82 亿美元收购 World Labs,两家公司于今日公布该交易。World Labs 创始人李飞飞将加入 AMD 担任执行副总裁兼首席科学家,双方去年已建立推理优化与训练合作。World Labs 的首个产品 Marble 可用于制作娱乐体验,也可生成用于机器人训练的模拟环境,交易预计在年底前完成,尚待监管批准。

    ool for creating entertainment experiences, but also for creating simulated environments for robot training. The acquisition is likely to help AMD compete with long-standing rival Nvidia in creating an ecosystem for AI-specific chips. While Nvidia already has a suite of open-weight world models like Cosmos, AMD has only offered text- and video-based models to the public. World models are seen as vital in efforts to deploy generative AI models on robotic platforms, from autonomous vehicles to ind

    匹配字段正文

  3. SemiAnalysis

    GLM-5.3 解析:稀疏注意力如何影响 DRAM 内存 TAM

    SemiAnalysis 分析 Z.ai 的 GLM-5.3 系列:稀疏注意力通过 top-k 选择降低 SDPA 阶段的 KV cache 内存与带宽需求,但 top-k 选择仍需完整上下文驻留 HBM,因此并未消除内存容量瓶颈。SGLang 团队的 HiSparse 将 KV cache 从 HBM 卸载到主机 DRAM,按 LRU 策略换入换出,并把第 N 层加载与第 N-1 层执行重叠以降低 miss 延迟。在 InferenceX 基准中,150 tokens/s 下 GB200 约 $0.044/百万总 token,比 MI355X ATOM 的 $0.049 低约 12%。

    , memory access, and communication. It prioritizes faster token generation per user, rather than maximum batched throughput, while vLLM handle prefill. Ultra-High Interactivity on NVIDIA GPUs? - TileRT InferenceX On AgentX, FP8 TileRT MI355X achieves 2x the P90 interactivity than the best FP4 MI335X config. Comparing to GB300 NVL72, it brings a 40% uplift in interactivity. These are serving metrics that used to require specialized hardware. However, TTFT is suboptimal and there is still room for

    匹配字段正文

星期一

  1. The Verge AI精选

    AMD 以约 82 亿美元全股票交易收购 World Labs

    AMD 宣布以约 82 亿美元全股票交易收购李飞飞联合创办的 AI 研究实验室 World Labs,交易预计年底前完成。World Labs 于 2024 年成立,数月内估值达 10 亿美元,2025 年推出可从提示词生成交互式 3D 世界的世界生成模型 Marble。李飞飞将出任 AMD 执行副总裁兼首席科学家,直接向 AMD CEO 苏姿丰汇报,World Labs 团队将继续专注推进 AI 模型研究。

    models are evolving,” Su says in a statement. “Fei-Fei and the World Labs team bring exceptional research leadership and model expertise. Together, we can use that insight to develop the hardware, software and systems that will power the next generation of AI and strengthen the open AI ecosystem.” The World Labs deal is just the latest multi-billion dollar AI-related acquisition as of late, with Nvidia announcing earlier this month that it would be acquiring Hugging Face for nearly $13 billion .

    匹配字段正文

  2. Hugging Face

    H 公司发布 Holo4 通用计算机操作智能体模型

    H 公司发布 Holo4 系列通用计算机操作智能体模型,可在桌面、网页、Android、代码沙箱和业务 API 上以同一模型同一调用方式运行,并能点击输入、编写执行代码以及调用 MCP 或 API 工具。在 OSWorld 2.0 上,Holo4 27B 得分 61.7%,Holo4 35B-A3B 为 30.9%,官方称其以远少得多的参数量和更低成本接近前沿闭源模型。两个尺寸已在 H Models API 上线,权重以 BF16、FP8、NVFP4 和 4-bit GGUF 格式发布在 Hugging Face,公开基准的全部轨迹也已开源。

    ary. Holotron4 Nano Our post-training stack is designed to adapt to new foundation models and produce agents that generalize across interfaces and environments. As a member of the NVIDIA Nemotron Coalition , we applied our latest stack to the Nemotron 3 Nano Omni model as a follow-up to Holotron 3. The same recipe turns Nemotron 3 Nano Omni into Holotron4 Nano, a generalist agentic model that significantly improves over the base model on GUI workflows and in environments exposing MCP, APIs or co

    匹配字段正文

  3. Hugging Face

    Hugging Face 在 Hub 上线 RL Environments 功能

    Hugging Face 在 Hub 上线 RL Environments,用 rl-environment 标签把环境作为数据集托管,并注册 Harbor、Verifiers、OpenEnv、NeMo Gym 四个框架标签,数据集页面会显示框架图标并生成加载命令。用户可在 datasets?other=rl-environment 筛选查看,文中给出了各框架运行任务并检查 verifier 奖励的示例命令。官方已为 BeyondSWE、Terminal-Lego、Multi-SWE-RL-Verified、Workplace Assistant 等已有环境提交打标签的 PR,后续计划支持按配置生成片段和自动打标签。

    E-RL-Verified PrimeIntellect/R2E-Gym-Subset-Verified PrimeIntellect/Reverse-Text-RL PrimeIntellect/Scale-SWE-Verified harborframework/harbor-mix harborframework/terminal-bench-2.1 nvidia/Nemotron-RL-instruction following-structured outputs Spaces mentioned in this article 1 The ultimate guide to RL environments: building and scaling them in the LLM era Building and scaling RL environments for LLM training More Articles from our Blog Async GRPO with LoRA across HF Jobs: a bucket, a proxy, and no

    匹配字段正文

星期日

  1. Recode China AI

    中美开启 AI 对话,阿里目标 20GW 全球数据中心容量,DeepSeek 接近 75 亿美元融资

    习近平与特朗普在纽约峰会上同意开启正式 AI 对话,并成立双边贸易委员会;阿里发布自研 AI 芯片并承诺到 2032 年建成 20GW AI 数据中心容量。DeepSeek 接近完成 75 亿美元融资、年化收入达 10 亿美元,但中国监管机构据报对其与 Moonshot 展开数据安全调查。

    Tony Peng's avatar

    leaving the dialogue’s substance still to be defined even as both sides claimed the diplomatic win. (CNBC/Bloomberg/FT/SCMP) Alibaba unveiled an in-house AI chip aimed squarely at Nvidia and committed to 20 gigawatts of AI data-center capacity by 2032, and the market loved it. The announcement, made at Alibaba Cloud’s Apsara Conference alongside a wave of new Qwen agent and cloud products, sent Alibaba’s shares jumping. (Bloomberg/CNBC) DeepSeek is closing in on a $7.5 billion funding round and

    匹配字段正文

星期六

  1. a16z:News

    Aaron Levie、Steven Sinofsky 与 Martin Casado:如何保障 AI 智能体世界的安全?

    a16z 播客中,Box CEO Aaron Levie、a16z 的 Martin Casado 与 Steven Sinofsky 讨论 AI 智能体的安全、安保与监管,认为当前讨论多发生在风险尚未被清晰定义之前。他们指出智能体不会疲倦、可大规模运行,并能以人类员工无法做到的方式探测系统,这可能要求重新思考权限、身份验证、操作系统与安全栈。

    Doesn’t Need New Rules Yet Steven Sinofsky, Theo Jaffee, and Sofia Puccini; Is Software Losing Its Head? Seema Amble, Elena Burger, and Steven Sinofsky; Steven Sinofsky on AI PCs, NVIDIA, and the Future of Computing Theo Jaffee and Steven Sinofsky Erik Torenberg is a general partner at Andreessen Horowitz, where he focuses on investing and running our marketing & ecosystem orgs. The a16z Show discusses the most important ideas within technology with the people building it. Each episode aims to p

    匹配字段正文

  2. The Verge AI

    Cloudflare CEO Matthew Prince 能拯救被 AI 冲击的互联网吗?

    Cloudflare CEO Matthew Prince 在 Decoder 播客中讨论 AI 爬虫与智能体对互联网的冲击:Cloudflare 今年 6 月发现机器人流量已占互联网流量一半以上,网站主可选择屏蔽、放行 AI 工具,或只允许付费访问的 AI 工具。Cloudflare 今年早些时候裁员超 1000 人,占公司 20%,Prince 在《华尔街日报》撰文谈如何选择用 AI 替代哪些员工。

    ets are pretty efficient. We’re going to have more and more people coming into the space. The second thing that you need is chips. You need the silicon to run these things. Today, Nvidia is the best in the world at that, but you’ve got a whole bunch of others, whether that’s AMD or Qualcomm or all the hyperscalers, that are building their own chips in order to power these things. While we have a massive shortage in the availability of silicon and the ability to actually power it up and turn it o

    匹配字段正文

  3. AWS Machine Learning

    AWS 在 Amazon EKS 上用 EFA 和 DeepEP 扩展 MoE 强化学习,吞吐量提升 40%

    AWS 发布了一套在 Amazon EKS 上结合 EFA 与 DeepEP 加速 MoE 模型强化学习训练的架构,吞吐量提升 40%。该方案针对 RLHF 和 GRPO 等大规模 RL 训练中 rollout 生成与策略训练的资源竞争、跨节点通信瓶颈以及专家并行(EP)带来的动态 all-to-all 通信开销进行优化。DeepEP 负责在 EFA 上优化专家并行通信,缓解从节点内 NVLink 到节点间低带宽链路切换带来的压力。

    licy training requires tightly coupled workers that progress in lockstep, much like pre-training or SFT. Any latency spike or straggling worker can stall the entire job or trigger NVIDIA Collective Communications Library (NCCL) timeouts. RL systems must balance these two workloads because any mismatch in their rates can leave hardware idle or introduce training instability. Figure 1: The asynchronous RL loop, where rollout workers generate experience through distributed inference while policy-tr

    匹配字段正文

  4. AWS Machine Learning

    在 Amazon SageMaker HyperPod 上用 SkyRL 加速多模态 RL 训练

    AWS 展示如何在 Amazon SageMaker HyperPod 上运行开源 RL 框架 SkyRL,用 GRPO 训练 Qwen3-VL-8B 视觉语言模型完成 2D 迷宫导航。从 VisGym SFT 检查点出发,在固定 64 个迷宫评测集上把解迷宫成功率从 43.75% 提升到 95% 以上。方案使用 3 台 ml.g7e.12xlarge(共 6 张 GPU)加 1 台 ml.r5d.16xlarge 头节点,vLLM 与 FSDP 策略模型共置,LoRA 适配器经 Amazon FSx for Lustre 同步。

    hese are the instance types we used. Other GPU instances and cluster sizes work as well, provided the workers have enough GPU memory for the model. Workers: 3x ml.g7e.12xlarge (2x NVIDIA RTX PRO 6000 Blackwell GPUs each, 6 GPUs total); Head: ml.r5d.16xlarge (512 GB RAM, manages Ray GCS, dashboard, and LoRA adapter consolidation); Policy model: Qwen3-VL-8B with LoRA (rank 32), sharded across the 6 GPUs using PyTorch FSDP; Rollout engines: 6 colocated vLLM instances, one per GPU; Shared storage: A

    匹配字段正文

  5. AWS Machine Learning

    在 Amazon SageMaker AI 上部署 Qwen3-TTS 实时个性化语音

    阿里云 Qwen 团队开源的 Qwen3-TTS-12Hz-1.7B-Base 已上线 Amazon SageMaker JumpStart,可部署为全托管实时推理端点,仅凭几秒参考音频与转写文本即可克隆音色,无需重新训练。该模型覆盖中文、英语、日语等 10 种语言,支持流式生成与跨语言克隆,输出 24 kHz 音频,并可与 Qwen3-TTS-12Hz-1.7B-CustomVoice、Qwen3-ASR-1.7B 一同选用。

    ook instance, or a local environment with the Amazon SageMaker Python SDK installed; Sufficient service quota for a supported GPU instance. This walkthrough uses ml.g6.4xlarge (1x NVIDIA L4 GPU, 24 GB), which is sufficient for the 1.7B model; A short reference audio clip of the target speaker (a few seconds is sufficient) and a transcript of the words spoken in it Step 1: Deploy the model from JumpStart Construct a JumpStartModel with the model ID and deploy it. The GPU memory override is the mo

    匹配字段正文

星期五

  1. The Next Platform

    IonQ 用单颗 CPU 实现量子纠错实时解码

    IonQ 科学家称已开发出仅用单颗标准 CPU 即可实时完成量子纠错解码的解码器,并可在后台运行、不打断量子计算机工作。其基准电路模拟了最多 408 个逻辑量子比特、88 个内存块与 magic factories,运行超 3150 万次量子操作,额外 stretch time 低至 0.02%。该方案基于双滑动窗口与 beam search 解码器,面向其 Walking Cat 架构,并支撑其超越 Superion 系统 256 个物理量子比特的路线图。

    so has to be tailored to the specific error correction code – like surface code or color codes – that is being used. Advancements are being made. GPU acceleration, such as through Nvidia’s CUDA-Q platform, is coming into play, as is the use of AI. Recent examples include IBM using a large language model (LLM) framework to sort through thousands of code variations to determine the right one for a particular environment. Google two years ago created AlphaQubit, which uses a transformer-based neura

    匹配字段正文

  2. The Rundown AI

    Meta 在 Connect 2026 为 Muse 智能体推出 Charm 钥匙扣设备与眼镜集成

    Meta 在 Connect 2026 活动上为旗下走红的 Muse 智能体发布多项升级,包括 12 月发货的钥匙扣硬件 Charm、数月内上线的 AI 眼镜集成、实时语音与视频对话,以及可同步语音的 Muse Realtime Avatar。扎克伯格称 Charm 是“与 Muse 对话最快的方式”,眼镜端将提供连 Meta 也无法获取数据的私有处理模式。PayPal、Walmart、Shopify、GitHub 和 Box 等公司已成为 Muse 合作伙伴,此前亚马逊本周早些时候曾阻止其访问。

    n warning about losing “control of the future to AI.” FLUX-maker Black Forest Labs released FLUX 3 Action, an open-weight model that steers robot arms from camera footage, beating Nvidia’s Cosmos 3 on a simulation leaderboard at under half its size. The U.S.’s AI build-out could attract $10.3T by 2032, creating jobs but fueling inflation and squeezing housing construction, reports the Wall Street Journal. OpenAI hired Patreon co-founder Sam Yam to lead its new Creator Product division, tapping a

    匹配字段正文

  3. AWS Machine Learning

    Amazon SageMaker HyperPod 与 Qumulo 实现跨区域训练

    Amazon SageMaker HyperPod 与 Qumulo 的 Cloud Native Qumulo(CNQ)和 Cloud Data Fabric(CDF)组合,可让训练计算位于一个 AWS Region、数据集留在另一个 Region,无需复制数据或修改代码。验证中,位于 us-west-2 的 spoke 集群通过 CDF 以 60 ms 网络延迟读取 us-east-2 的数据,运行 1.02B 参数 LLaMA v3、2 台 ml.p5.48xlarge(共 16 张 H100),短暂预热后吞吐追平本地 hub 集群。NeuralCache 预热后 94–96% 读取由本地缓存以低于 5 ms 延迟完成。

    : pytorchReplicaSpecs: Worker: replicas: 2 restartPolicy: OnFailure template: spec: containers: - name: pytorch image: .dkr.ecr.us-east-2.amazonaws.com/ :latest resources: limits: nvidia.com/gpu: 8 vpc.amazonaws.com/efa: 32 command: - torchrun - --nproc per node=8 - --nnodes=2 - /workspace/train fsdp.py - --dataset-path=/csi/data/c4 - --checkpoint-path=/csi/checkpoints/llama-fsdp - --batch-size=24 - --seq-length=4096 - --num-workers=64 - --prefetch-factor=4 volumeMounts: - mountPath: /csi name:

    匹配字段正文

  4. Latent Space

    Runway 详解 GWM Worlds 2 的 WorldPrompt 与实时世界生成工程

    Runway 本月推出研究预览版 GWM Worlds 2,把高保真视频与音频生成变成实时交互式模拟,并提出 WorldPrompt 输入格式,可固定首帧等环境要素后按时间戳编排事件。该模型以 720p、24fps 视频和 48000Hz 音频流式输出,做法是先微调基础音视频模型以适配 WorldPrompt,再后训练为自回归生成,最后用蒸馏做到实时。CTO Kamil Sindi 与首席研究科学家 Robin Kahlow 表示,自回归模型的误差累积、长时记忆和上下文取舍仍是待解问题,模型也没有结构化状态可供智能体读取。

    asis [00:03:27]: One of the first projects that, we built with, one of my two co-founders, Chris. This was taking, pix2pixHD, which was one of the early image-to-image models that NVIDIA released back in 2016 or 2017. and it was a model that would take a semantic map of a scene and then generate a photorealistic, let’s call it, output. very early days, so it was not very high-fidelity outputs, but it w I think was the first image-generation model that could generate at 1K resolution. And it was

    匹配字段正文

  5. LMSYS Blog

    用 SGLang 扩展类 JEV 决策模型:Score API 与 MIS 评分

    LMSYS 介绍如何用 SGLang 的 /v1/score 接口服务类 JEV 决策模型:调用方通过 label_token_ids 显式请求标签 token 分数,而非依赖生成响应的 top-k logprobs。SGLang 支持单条评分(SIS)与多条评分(MIS),MIS 在单次请求内复用共享 query 计算并保持各候选隔离,在测试负载下延迟随候选数量增长明显更小。文章还对比了 Fused-Choice 与 Setwise 评分,并给出部署与请求示例。

    n the prefill-only roadmap. Acknowledgements This post was developed in collaboration with the SGLang and LinkedIn teams. Additional contributors to the performance optimizations: NVIDIA: Po-Han Huang, for the Qwen3.5 MIS contribution; TikTok: Hongyu Lu The benchmark clients are available in chuanrui/sglang-benchmark, under lmsys blog/jev bench. The examples below use Qwen3-0.6B on one H200 and cover the pointwise experiments: a closed-loop concurrency sweep with candidate-count breakdowns and a

    匹配字段正文

星期四

  1. The Verge AI

    黄仁勋谈 AI 与气候变化:先承受巨大痛苦,再谈可持续未来

    英伟达 CEO 黄仁勋在 The Ezra Klein Show 节目中称,AI 能帮助应对气候变化,但前提是先造成“巨大的痛苦与磨难”,并抱怨美国化石燃料电厂建设不足。文章指出,加州大学河滨分校、加州理工和罗切斯特理工学院的研究估计,与 AI 相关的空气污染到 2028 年可能导致多达 1300 人过早死亡、超过 200 亿美元公共健康成本。

    As Jensen Huang puts it, AI can help fight climate change — but only if it inflicts “an enormous amount of pain and suffering” first. The Nvidia CEO discussed the future of energy and AI’s impact on our planet in the latest episode of The Ezra Klein Show . But his comments boil down to the same accelerationist spin we’ve seen from a variety of tech leaders as well as President Donald Trump. They promise that AI will be such a gift to humanity that it’s worth the damage caused by data centers cur

    匹配字段正文

  2. Latent Space

    Meta Connect 2026:Muse 个人智能体、眼镜硬件与 Muse Realtime Avatar

    Meta 在 Connect 2026 上把个人智能体 Muse 作为硬件加智能体战略的核心,发布了 Muse 的语音与实时视频能力、Mac 端 computer use、Muse Mail 邮箱地址,以及 Ray-Ban Meta Gen 3、售价 1299 美元的 Meta VR Glasses 和 12 月发货的钥匙扣设备 Muse Charm。Muse 对用户免费,Meta 未来可能从交易中抽成,已接入 Walmart、Best Buy、Gap、Sephora、Instacart 等零售伙伴以及 Box、GitHub、Granola、Notion 等生产力工具,连接器平台有 1500+ 应用。Meta 同时研究性发布 Muse Realtime Avatar,称其响应低于一秒、支持无上限会话时长并对输出加水印,但未发布新的前沿模型,Alexandr Wang 仅预告“最强大的模型”即将推出。

    posable emails and trade crypto. UNSC session : @ClementDelangue described Hugging Face’s own agent cyberattack. He said closed APIs blocked his defenders, so the team switched to NVIDIA’s build of GLM 5.2 . He called for mandatory sharing of agent traces. Altman and Amodei warned about loss of control and misuse. Bengio urged immediate action. Kratsios rejected a global regulator. Related safety research : Redwood argues latent “neuralese” reasoning would erode chain-of-thought oversight. Separ

    匹配字段正文

  3. SemiAnalysis

    SemiAnalysis 发布 ClusterMAX 3.0 GPU 云评级,覆盖 77 家 neocloud

    SemiAnalysis 发布 ClusterMAX 3.0,对 77 家 neocloud 做全面评测,市场覆盖范围从 2.0 版的 209 家扩大到 323 家,并访谈了 200 多名终端用户。Nebius 与 CoreWeave 同列 Platinum,Google Cloud 与 Oracle 进入 Gold,Azure 降至 Silver,Crusoe 降至 Bronze,全球仅 19 家 neocloud 获得奖章评级。评测分审计、性能、可靠性三阶段,涵盖 GPU 计算、网络、存储、编排、监控与故障注入,并新增 Bronze 与 Underperforming 之间的 Participation Ribbon 档。

    be done in parallel, on a SonK cluster, or sequentially, if the provider wanted to take the nodes back and re-provision them); Blackwell, not Hopper (B200, B300, GB200, GB300) for NVIDIA, or MI355X for AMD are considered acceptable. H100 is now over 4 years old! We tested the cluster through 3 phases, described below. Of course, we always complement this testing by contacting customers of all these providers and taking their feedback into account. Phase 1: Audit First, the Audit covers yes/no qu

    匹配字段正文