←搜索结果

按匹配度 · 共 449 条结果 清除搜索

星期四

  1. LG AI Research 官方博客

    LG AI Research 论文解读:阿里通义实验室 WebDancer 如何用网页搜索增强 LRM 长推理

    LG AI Research 发文解读阿里通义实验室的 WebDancer 论文,该方法通过网页搜索工具增强大推理模型(LRM)的长链推理,缓解长推理中的信息缺口与模型幻觉。论文提出 CRAWLQA 与 E2HQA 两种合成数据生成方法:前者基于 arXiv、GitHub、Wikipedia 等多跳网页生成 QA,后者将简单事实问题逐步改写为需多步推理的难题。

    ledge by drawing on external sources when needed. Various models and services reflecting this trend have emerged; representative examples include OpenAI’s ChatGPT (Deep Research), Google DeepMind’s Gemini, xAI’s Grok3, and LG AI Research’s ChatEXAONE (Deep Research). In this article, I introduce WebDancer from Alibaba’s Tongyi Lab, a paper that proposes enhancing long reasoning in LRMs through the use of web search tools[6]. The paper takes a holistic view of the agentic LRM domain, covering eve

    匹配字段正文

星期四

  1. SemiAnalysis精选

    Amazon AI 复苏:AWS 与 Anthropic 扩建多吉瓦级 Trainium 基础设施

    AWS 正为 Anthropic 扩建多吉瓦级 AI 训练基础设施,三个接近完工的园区合计拥有逾 1.3GW IT 容量,最大园区将部署近百万颗 Trainium2。Trainium2 的多项性能落后于 NVIDIA 系统,但在单位内存带宽总拥有成本上具有优势,契合 Anthropic 侧重强化学习和训练后扩展的路线。Anthropic 还深度参与 Trainium 的系统设计,同时继续使用 Google TPU 和 NVIDIA GPU。

    nfluence on the Trainium roadmap only grows from here. Put plainly: Trainium2 is converging toward an Anthropic custom-silicon program. This will enable Anthropic to be, alongside Google DeepMind, the only AI labs benefiting from tight hardware–software co-design in the near horizon. This report will dig into all aspects of Amazon’s AI resurgence: the Anthropic partnership, datacenters, and Trainium. At the end of the report, we provide a longer-term outlook on Anthropic, AWS Bedrock and interna

    匹配字段正文

星期二

  1. Transluce

    Transluce 的 AI 智能体分析工具 Docent 进入公开 alpha

    Transluce 宣布其 AI 智能体行为分析工具 Docent 进入公开 alpha,任何用户都可在 docent.transluce.org 上传自己的数据进行分析。Docent 可将“模型是否在 reward hacking”这类模糊问题转化为精确评分标准,并给出该行为出现频率的量化测量;数据接入只需几行代码,可用 Python tracing 库或与 Inspect 的原生集成。相比 2025 年 3 月的技术预览,此次更新加入了访问控制与多用户协作,transcript 上限提升两个数量级,并新增评分标准细化工具和图表可视化。

    The Docent homepage

    ase continue sharing your feedback, bug reports, and feature requests! Acknowledgments Thanks to all our private alpha testers: Anthropic, Apollo Research, Bridgewater AIA Labs, Epoch AI, Google DeepMind, HAL (Princeton Language and Intelligence), MATS Research, METR, Palisade Research, Penrose, Redwood Research, Thinking Machines Lab, UIUC DDKang Lab, as well as other unlisted organizations and individuals. Please reach out to join our community of alpha testers and receive white-glove support!

    匹配字段正文

星期三

  1. Ollama Blog精选

    Ollama 发布 macOS 和 Windows 桌面应用

    Ollama 的新应用已在 macOS 和 Windows 上线,提供下载模型并直接对话的图形界面。新应用支持拖放文件,可对文本或 PDF 进行推理,处理大文档时可在设置中提高上下文长度,但会占用更多内存。应用还基于新的多模态引擎支持向 Gemma 3 等模型发送图片,并能处理代码文件;纯 CLI 版本仍可在 Ollama 的 GitHub releases 页面单独下载。

    illustration of Ollama seeing the new app

    g large documents, Ollama’s context length can be increased in the settings. Note: this will require more memory. Multimodal support Building on Ollama’s new multimodal engine, images can be sent to models that support them, such as Google DeepMind’s Gemma 3 model. Documentation writing Code files can be processed by models for understanding. Download Ollama’s new app today on macOS and Windows. For pure CLI versions of Ollama, standalone downloads are available on Ollama’s GitHub releases page.

    匹配字段正文

星期四

  1. Ollama Blog

    Ollama 推出多模态模型新引擎,支持 Llama 4、Gemma 3、Qwen 2.5 VL 等视觉模型

    Ollama 发布新的多模态引擎,开始支持 Meta Llama 4、Google Gemma 3、Qwen 2.5 VL、Mistral Small 3.1 等视觉模型,可进行多图理解、文档扫描与字符识别。此前 Ollama 依赖 ggml-org/llama.cpp 提供模型支持,新引擎让每个模型自包含并暴露自己的投影层,同时加入图像缓存、显存估算与 KV cache 优化,例如针对 Gemma 3 的滑动窗口注意力和 Llama 4 Scout 的分块注意力。后续计划支持更长上下文、思考/推理、流式工具调用和 computer use。

    KV cache optimizations to improve how memory can be efficiently used. Ollama configures causal attention at the individual model level instead of configuring as a group. Examples: Google DeepMind’s Gemma 3 leverages sliding window attention, and Ollama can leverage that to allocate a subset or a portion of the model’s context length to improve performance, and because of the resulting memory efficiency, we can increase the context length of the model on the same system or use the remaining memor

    匹配字段正文

星期一

  1. Prime Intellect

    Prime Intellect 开源分布式推理栈,面向消费级 GPU 与公网高延迟

    Prime Intellect 发布分布式推理栈预览,并开源 PRIME-IROH、PRIME-VLLM、PRIME-PIPELINE 三个代码库,目标是让消费级 GPU 通过公网连接运行推理。文章指出流水线并行通信需求最低,适合分布式环境,但同步流水线会因 100ms 级跨洲延迟形成吞吐上限,而异步微批调度在内存带宽受限的解码阶段无法带来训练那样的加速。团队称已可用私有硬件通过公网跑推理,正把组件接入自家栈,用于 SYNTHETIC-2 合成数据运行。

    ut the runtime of operations on GPUs to analyze bottlenecking factors during inference workloads on a single node. Much of the notation is borrowed from How To Scale Your Model by Google DeepMind. If you are already familiar with traditional inference math, skip to Distributed Inference. Accelerator Math Whenever we run an operation on an accelerator, there are two things that take time: Computation: How long it takes to compute all the floating-point operations (FLOPs) required for the operatio

    匹配字段正文

星期五

  1. METR Blog精选

    METR:AI 模型在公开部署前就可能带来危险

    METR 发文指出,当前前沿实验室的安全政策多聚焦部署前测试,但模型在公开部署前就可能带来风险,包括模型权重被窃取滥用、实验室员工内部滥用,以及 AI 智能体在训练或内部使用中自主追求非预期目标。文章建议把重心转向更早的能力测试与预测、模型权重安全与内部监控、以及透明披露和举报人保护等政策。

    -01-17-ai-models-dangerous-before-public-deployment/}} , year = {2025} , month = {01} , } Many frontier AI safety policies from scaling labs (e.g. OpenAI’s Preparedness Framework, Google DeepMind’s Frontier Safety Framework, etc.), as well as past work by third party evaluators including UK AISI , Apollo Research , and METR , focus on pre-deployment testing – ensuring that the AI model is safe and that the lab has sufficient security before the lab deploys the model to the public. Such pre-deplo

    匹配字段正文

星期四

  1. Prime Intellect

    Prime Intellect 开源 OpenDiLoCo,实现跨洲分布式低通信训练

    Prime Intellect 开源 OpenDiLoCo,这是 DeepMind DiLoCo 低通信分布式训练方法的可复现实现,代码基于 Hivemind 与 PyTorch FSDP,已发布在 GitHub。团队在加拿大、芬兰和美国两地共四个 DiLoCo worker(各 8 张 H100)上训练 1.1B 参数模型,跨两大洲三国,计算利用率保持 90-95%,all-reduce 仅占训练时间 6.9%。相比原论文 400M 参数规模,该方法被扩展到 1.1B 参数,并验证伪梯度可用 FP16 all-reduce 而不损失性能。

    OpenDiLoCo: An Open-Source Framework for Globally Distributed Low-Communication Training

    ency Insights: Our ablation studies provide valuable insights into the algorithm's scalability and compute efficiency, paving the way for future improvements DiLoCo Recent work by Google DeepMind has introduced an approach that enables the training of language models on islands of devices that are poorly connected. This method allows for data parallel training on these different islands, requiring synchronization of pseudo gradients only every 500 steps. DiLoCo introduces an inner-outer optimiza

    匹配字段正文

星期六

  1. The Gradient

    神经算法推理:让神经网络学会执行经典算法

    The Gradient 刊文探讨神经算法推理,即用深度神经网络捕捉最短路径、排序等经典算法计算。文章指出,MIT 的《What Can Neural Networks Reason About?》证明算法对齐越好泛化越好,GNN 与动态规划天然对齐,在 DP 执行基准上优于归纳偏置较弱的架构。作者同时提醒,算法对齐并不能让人随意套用任意表达力强的 GNN,分布外表现仍是关键挑战。

    实现细节。如果读到此处让你产生了进一步了解的兴趣,甚至想亲自把玩NAR模型,我推荐你查看LoG'22的NAR教程(https://algo-reasoning.github.io/),该教程由我与Andreea Deac和Andrew Dudzik共同讲授。在不到三个小时的时间里,我们涵盖了掌握开发、部署和深化神经算法推理器基础所需的全部理论,并附有大量代码指引和参考文献。当然,如果你有任何后续问题、有趣的讨论点,甚至是有趣的项目想法,也非常欢迎直接联系我! Petar Veličković是Google DeepMind的资深研究科学家、剑桥大学附属讲师,以及剑桥克莱尔学院的Associate。Petar拥有剑桥大学(三一学院)计算机科学博士学位,师从Pietro Liò。他的研究涉及几何深度学习——设计能够尊重数据中不变性和对称性的神经网络架构(他还就此合著了一本雏形书)。 在学术语境或书籍中引用本作品时,请按以下格式引用: Petar Veličković, "Neural Algorithmic Reasoning", The Gradient, 2023. BibTeX引用:

    匹配字段正文