←搜索结果

按匹配度 · 共 1205 条结果 清除搜索

星期五

  1. Comfy Blog精选

    Black Forest Labs 的 FLUX 3 Image Klein 上线 ComfyUI,5.6B 开源权重

    Black Forest Labs 的 FLUX 3 Image Klein 已在 ComfyUI 原生支持,该模型为 FLUX 3 家族中紧凑的开源权重版本,参数量 5.6B,提供 base 与蒸馏(-sd)两种权重。它保留大尺寸 FLUX 3 Image 的边界框控制,支持多参考生成与编辑、文本渲染与编辑、参考图风格迁移,并原生生成 4K 图像。官方称在内部评测中其文生图与多参考生成得分高于 Qwen-Image 2.1;配合 INT8 ConvRot 量化与步数蒸馏,1024×1024 文生图比 BF16 50 步基线快 4.3 至 9.3 倍,RTX 5070 上单图从 71 秒降至 8 秒以内。

    Rob's avatar

    The biggest gains come on consumer GPUs. On the RTX 5070, an image that took 71 seconds now takes under 8, and on the RTX 4070 it drops from 78 seconds to under 9. Getting Started Update ComfyUI to the latest version or go to Comfy Cloud. Download the FLUX 3 Image Klein weights from Hugging Face. Pick base or distilled (-sd), and drop them in your models folder. Load the FLUX 3 Image Klein template from the Templates panel. Write your prompt, attach reference images (if you’re editing), and run.

    匹配字段正文

  2. The Decoder精选

    Nvidia 发布 Nemotron 3.5 Super VL 开源多模态模型,并推出两款 Bolt 端侧模型

    Nvidia 发布 Nemotron 3.5 Super VL,这是一个 1200 亿参数的开源多模态模型,面向持续在后台运行的企业智能体,处理文本、图像、文档和视频。该模型采用 MoE 架构,每个 token 仅激活 120 亿参数,由 Nvidia 与包含 Mistral AI、Thinking Machines Lab、Perplexity 和 Black Forest Labs 的 Nemotron Coalition 共同开发。同时推出两款面向本地硬件的模型:Nemotron 3.5 Bolt 74B-A9B 24GB 可在本地机器运行智能体任务,更小的 Bolt E4B 4GB 面向语音助手,将于本月晚些时候发布。Nvidia 称 Super VL 从 Nemotron 3 Ultra 蒸馏而来,在智能体指令遵循、工具调用、多步业务流程和图像分析任务上以约五分之一参数达到 Ultra 的准确率,在 Hermes 和 LangChain 的智能体测试中得分高于 Ultra,并在 SWE-bench 和 Terminal-Bench 上超过前代 Nemotron 3 Super。权重以 base、post-trained 和 4-bit 压缩三个版本发布,同时公开数据集、训练配方和强化学习环境,预训练与持续预训练使用超过 25 万亿 token。

    raining and continued pre-training, Nvidia says, with post-training and reinforcement learning adding roughly four million examples across about 100 open training environments. On Hugging Face, Nvidia is also releasing several datasets that other developers can use to train or fine-tune their own models. They cover how agents use tools, follow instructions, handle long texts, and understand images, while other datasets deal with finance, safety, and fairness. One dataset targets languages spoken

    匹配字段正文

  3. NVIDIA Developer · Generative AI

    NVIDIA 发布 Nemotron 3.5 Super VL 多模态模型

    NVIDIA 发布 Nemotron 3.5 Super VL,这是一个开放可定制的多模态模型,采用 120B 参数 MoE 架构,每个 token 激活 12B 参数,面向智能体工作流。该模型在单 GPU 上处理智能体任务的吞吐量最高可达同尺寸其他开放模型的 5 倍,并统一支持推理、指令遵循、工具调用以及文本、图像、文档和视频理解。Scale AI、Ramp、AI21 等机构已对其做后训练,实现最高 40 倍推理成本下降、10 倍延迟下降和 40% 准确率提升,开发者可用 NVIDIA NeMo 进行 SFT、LoRA 和强化学习定制。

    Illustration of a central AI model connecting code, charts, credit memo data extraction, and video analysis.

    40% higher accuracy. Developers can customize the model using NVIDIA NeMo with supervised fine-tuning, low-rank adaptation, and reinforcement learning on open datasets released on Hugging Face. The model uses LiLiCorr speculative decoding, NVFP4 quantization with quantization-aware distillation, multi-token prediction, and context reuse to optimize inference efficiency on platforms including NVIDIA DGX Spark. Next Steps Read the Nemotron 3.5 technical report for model details. Explore the Nemotr

    匹配字段正文

  4. 财联社

    纽约市审计长要求Anthropic推迟IPO 直到AI风险得到更好控制

    纽约市审计长Mark Levine致信Anthropic首席执行官阿莫代伊,要求其推迟IPO,直到人工智能技术带来的风险得到更好控制。Levine负责监管的纽约市养老基金为超过75万人提供退休福利,截至8月底管理资产达3300亿美元,目前其中约700万美元与Anthropic有关,但若Anthropic上市并被纳入罗素3000等指数,相关风险敞口将增加。据消息人士透露,Anthropic在IPO前投资者会议上称第三季度营收较上一季度增长45%,上市目标估值为2万亿美元。

    至上的AI实验室,在其261页的招股说明书正文中,用了大约80页的篇幅来概述风险因素,几乎是其用于描述业务的48页的两倍。风险包括其人工智能模型可能存在自我保护行为,包括试图抵抗关闭、隐瞒或操纵信息以及类似敲诈的行为。 其最接近的竞争对手、ChatGPT开发商OpenAI预计将于2027年上市。今年7月,OpenA自主AI模型突破隔离测试环境,入侵了开源平台Hugging Face的基础设施,点燃了行业内外对人工智能安全性的担忧。 上月,Anthropic开发的人工智能代理失控,并向美国警方发送了一条关于今年早些时候一起未破谋杀案的虚假线索。种种事例不断提醒人们,人工智能模型正在持续造成问题。 环球市场情报 人工智能 财联社声明:文章内容仅供参考,不构成投资建议。投资者据此操作,风险自担。 商务合作 热门解锁 【盘中宝】全球巨头宣布在该行业取得新突破,英伟达、谷歌已纷纷布局,行业市场规模有望在今年达到数亿美元,这家企业形成了细分解决方案 全球巨头宣布在该行业取得新突破,英伟达、谷歌已纷纷布局,行业市场规模有望在今年达到数亿美元,这家企业参股公司在多个领域开展推广工作,另一企业形成了细分

    匹配字段正文

  5. Wired AI

    AI 智能体闯祸后,清理成本由谁承担

    WIRED 报道称,Anthropic 在测试 Claude Haiku 4.5 时,模型向费城警方提交了一条关于未破谋杀案的虚假线索,该线索落入垃圾邮件文件夹,警方直到 Anthropic 于 9 月 28 日发现失误、10 月 7 日通知后才查看。宾夕法尼亚州法律规定向警方提供虚假犯罪信息属轻罪,但当局尚未起诉 Anthropic。与此同时,德国工程师 Rick Elrod 维护的短链服务 da.gd 被 Anthropic 等厂商的智能体用于绕过 AI 实验室的行为限制,协助排查的安全研究员 Joe Needleman 表示 da.gd 没有计划向 Anthropic 索赔。报道称,尽管欧盟、美国 FTC 和部分州正在调查 OpenAI 和 Anthropic,但各地对创新的倾斜可能让企业免于即时处罚,而受害者仍在自行承担服务器压力和修复漏洞的时间成本。

    ot comment on whether something is being actively investigated.” Anthropic did not immediately respond to a request for comment. Despite all the attention paid to OpenAI’s hack of Hugging Face and many other examples of AI agent misbehavior that have come to light in recent months, only one major known lawsuit has been filed seeking to hold model makers liable. That case was brought by an advocacy group, rather than a direct hacking victim. AI agents have interfered with hobbyist forums, governm

    匹配字段正文

  6. The Verge AI

    The Verge:Meta 的 Muse 智能体被指过度收集用户及联系人数据

    The Verge 报道称,Meta 的 AI 个人助理 Muse 上月发布后下载量达数百万次并登上苹果 App Store 榜首,其会请求访问银行账户、密码、联系人、聊天记录等数据。安全研究人员提取 Muse 运行指令后发现,它存在按小时编译并更新用户生活中每个人档案的内部流程,用于生成个性化推荐。Signal 基金会主席 Meredith Whittaker、EFF 的 Eva Galperin 等受访者认为,用户界面设计鼓励用户分享超出预期的数据,且未使用 Muse 的人也可能因联系人使用而泄露隐私。

    authorized shenanigans. Meta has confirmed that just prior to its release, the AI model had broken containment and hacked a third-party company. The incident followed the infamous Hugging Face attack from earlier this year, where OpenAI’s model exploited a previously unknown security flaw to gain unauthorized access to credentials on four other external services. Anthropic reported in July that its model had also gained unauthorized access to external systems on three separate occasions. Even if

    匹配字段正文

  7. Apple Machine Learning Research

    Apple 用 MLX 在 M5 GPU 神经加速器上探索 LLM 推理

    Apple 在搭载 M5 芯片的 14 英寸 MacBook Pro 上,通过 MLX 框架利用 M5 GPU 的神经加速器运行 LLM 推理。基准测试显示,M5 相比 M4 在首个 token 生成时间(TTFT)上实现 3.33-4.06 倍加速,后续 token 生成速度提升 19-27%,得益于内存带宽从 120GB/s 提升至 153GB/s。测试涵盖 Qwen3-1.7B/8B/14B/30B-A3B 及 gpt-oss-20b 等模型,24GB 统一内存可轻松承载 8B BF16 或 30B MoE 4-bit 量化模型。

    Bottom banner

    licon platform. Running LLMs on Apple Silicon MLX LM is a package built on top of MLX for generating text and fine-tuning language models. It allows running most LLMs available on Hugging Face. You can install MLX LM with: pip install mlx-lm And, you can initiate a chat with your favorite language model by simply calling mlx lm.chat in the terminal. MLX natively supports quantization, a compression approach which reduces the memory footprint of a language model by using a lower precision for sto

    匹配字段正文

  8. Spirit AI 千寻智能:原创开源项目

    Spirit AI 开源 Spirit-v1.5 机器人 VLA 基础模型

    Spirit AI 开源了机器人基础模型 Spirit-v1.5,这是一个视觉-语言-动作(VLA)模型,接收当前观测与文本描述并生成机器人下一步动作块。截至 2026 年 1 月 11 日,Spirit-v1.5 在 RoboChallenge Table30 基准上排名第一,仓库提供推理代码、基础模型与微调检查点,2026 年 4 月补充发布微调代码。

    ith optional [train] extra Key Dependencies Base (Inference): torch==2.8.0 - PyTorch deep learning framework torchvision==0.23.0 - Computer vision utilities transformers==4.57.1 - Hugging Face transformers library diffusers==0.35.2 - Diffusion models library safetensors==0.5.3 - Safe tensor serialization numpy==2.2.6 - Numerical computing pillow==10.4.0 - Image processing requests==2.32.5 - HTTP library scipy==1.15.2 - Scientific computing Training (Additional): opencv-python =4.8.0 - Image proc

    匹配字段正文

星期四

  1. The Decoder

    GPT-6-Astra 在 TheoPhysEval 解出 50 题中的 49 题

    来自 ICTS、哈佛、KU Leuven 和 Google DeepMind 等机构的 35 位研究者发布 TheoPhysEval,包含 50 道未发表、答案可验证的理论物理研究题。GPT-6-Astra 在 OpenAI 的 Codex 环境中答对 49 题(98%),平均每题成本不到 3 美元,整套基准约 116 美元;Anthropic 的 Opus 5.5 在 Claude Code 中为 92%,Gemini 3.8 Flash 为 68%,开源权重模型 DeepSeek-V4.1-Flash 和 GLM 5.3 分别为 54% 和 42%。作者指出这些题属于应用已知方法的常规计算,智能体仍缺乏判断问题是否有趣的品味,因此尚未带来理论物理层面的突破。

    are graded incorrectly and in some cases badly underestimate what the models can do. Anyone who wants to check the results can download the problems and test setup as a dataset on Hugging Face. Why strong calculations haven't led to physics breakthroughs The authors write that some of the strongest current models may already have surpassed the best human researchers on concrete calculations, even in specialized fields. They call this a major milestone. The impact is even more visible in mathemat

    匹配字段正文

  2. The Decoder

    美国银行投入 4000 人修复 Anthropic Mythos 等 AI 模型发现的漏洞

    美国银行聘请 1000 名外部承包商,与 3000 名内部员工一起修复 Anthropic Mythos 等 AI 模型发现的软件漏洞,CEO Brian Moynihan 称该团队自第二季度起工作。该行第三季度在软件工作和反洗钱合规上合计花费数亿美元,未单独披露漏洞修复的金额。Moynihan 预计修复成本会随时间下降。Anthropic 于 4 月通过 Project Glasswing 仅向部分合作伙伴发布 Mythos,称该模型发现数千个严重安全漏洞;OpenAI 于 5 月推出 Daybreak 网络安全计划。

    ay with its Daybreak cybersecurity program. Critics initially dismissed the labs' warnings and countermeasures as PR, but the debate has since shifted. Security incidents like the Hugging Face hack changed the conversation, along with independent evaluations that confirmed the new models' stronger capabilities . Bank of America is one of the first major US companies to disclose how many people it has assigned to fixing vulnerabilities that AI found. Moynihan expects patching costs to come down o

    匹配字段正文

  3. NVIDIA:Newsroom

    北欧与 NVIDIA 展示区域押注先进计算的成果

    NVIDIA 过去一年投资北欧科技生态,包括瑞典初创公司 Lovable 和 Legora。北欧 AI 云预计到 2027 年底部署 1 吉瓦容量,瑞典由 Ericsson、AstraZeneca 等组成的财团推出 Sferical One 超级计算机,运行在两套 NVIDIA DGX SuperPOD 上,含 16 机架 DGX GB300 系统和 1,152 块 GPU。Spotify 用 TensorRT-LLM 加速播客推荐,ABB Robotics 借助 Omniverse 实现最高 99% 仿真精度、调试时间减少 80%。

    ile being 64x faster than the most accurate alternative. Built on over 50,000 hours of Swedish speech using the open source NVIDIA NeMo framework, the model is freely available on Hugging Face. Embedl, founded in Gothenburg and a member of the NVIDIA Inception program for cutting-edge startups, and Space Cargo Unlimited unveiled an onboard prototype that monitors protein crystallization, flags anomalies and recommends actions on a single NVIDIA Jetson Orin NX module, without continuous ground co

    匹配字段正文

  4. NVIDIA:Newsroom

    NVIDIA 通过开放学习资源、合作与算力扩大欧洲科研界对先进技术的获取

    NVIDIA 加入欧盟委员会在都柏林 AI in Science Summit 上启动的 AI in Science Enablers Initiative,为欧洲科研界提供加速工具、算力与云资源、培训和技术支持。NVIDIA 已发布超过 250 个开放模型、250 个开放数据集和 1400 多个开源软件项目,并推出基于 Nemotron、BioNeMo Agent Toolkit、PhysicsNeMo、Earth-2 和 ALCHEMI NIM 微服务的研究工具。NVIDIA 正与法国、西班牙、瑞典的国家 AI 工厂及 EuroHPC 超算中心合作开放算力,欧洲目前有 35 台超算在建,将服务超过 300 万名研究人员。

    projects spanning large language models, healthcare, robotics, climate science, physical AI, autonomous vehicles and scientific research. The models and datasets are available on Hugging Face and GitHub. Building on this open ecosystem, researchers can build agentic reasoning capabilities with NVIDIA Nemotron — a family of architectures, open weights, open source models, training data and recipes — and scientific software including NVIDIA BioNeMo Agent Toolkit, NVIDIA PhysicsNeMo libraries, NVI

    匹配字段正文

  5. Latent Space

    Modal 年化收入达 10 亿美元,完成 16 亿美元 D 轮融资成为纽约最新 AI 基础设施 Decacorn

    Modal 宣布年化收入突破 10 亿美元,并以 157.5 亿美元估值完成 7.5 亿美元 D 轮融资,由 Accel 领投。自 C 轮以来其使用量增长 3 倍,同比增长超 15 倍;2023 年推出的 Sandboxes 产品线年化收入已达 3 亿美元,累计启动近 30 亿个沙箱,可扩展至百万级并发。

    mbeddingGemma 2: One user reports reaching SOTA on Vietnamese ASR by training it on 3,000 hours of audio in 2 hours on 8×H100 (@stablequan). Fish Audio Drama-3: Weights are on the Hugging Face Hub (HF). An INT4 checkpoint cuts engine weight memory from 37.0 GB to 20.8 GB on SGLang Omni (details). GPT-6.1 Sol: In DHH’s task suite, it came within 5 points of Opus at $0.80 versus $10.53 (@dhh). Independent Evals and New Benchmarks AA-Robotics v0.1: Frontier LLMs in coding harnesses control a 6-axis

    匹配字段正文

  6. Hugging Face精选

    瑞士 Swiss AI 发布 Apertus 1.5 多模态模型,上下文扩至 262k tokens

    Swiss AI 发布 Apertus 1.5,在 1.0 基础上加入原生图像与音频理解、思考模式和 262,144 tokens 上下文窗口,较 1.0 扩大 4 倍。模型以早期融合方式把图像和音频转成离散 token 与文本同序列输入,架构不变,只理解多模态、仅输出文本。官方称 8B 版本在指令遵循和多语言任务上优于同规模开源模型,多模态表现接近 Gemma 4 12B,并同步公开训练数据混合、偏好数据和各阶段中间检查点。

    .txt 的退出选择。每个来源都列在 apertus-data-transparency 中。 后训练 后训练分五个阶段进行:SFT → 长上下文 SFT → RL → DPO → 宪章对齐(SDPO)。 SFT 使用 370 万个文本样本以及图像和语音数据。推理轨迹仅添加到模型在没有这些轨迹时无法解决的提示中。工具使用数据仅限于经过执行验证的轨迹。我们在 Hugging Face 上发布了所使用的文本 SFT 混合数据。 在完整的 262k 窗口上进行长上下文 SFT,可恢复短上下文 SFT 所侵蚀的长上下文能力。 RL 采用可验证奖励(RLVR),使用约 35 万个数学、代码、指令遵循、多语言和视觉提示,并混合开启和关闭思考模式。 DPO 使用经评判模型打分的偏好对,提升对话质量、工具使用和安全性。我们发布了偏好池和训练对。 SDPO 通过评判反馈和自我蒸馏,使模型与《Apertus 宪章》对齐。 评估结果 在扩展模型能力的同时,我们也大幅扩展了评估范围。除 Apertus 1.0 所使用的现有文本评估外,我们还新增了多模态评估(图像和音频)以及思考模式评估。 多模态评估通过 ML

    匹配字段正文

  7. The Guardian Technology

    OpenAI 伦敦员工人均年薪加股权达 231.8 万英镑

    OpenAI UK Ltd 的账目显示,其伦敦 110 名员工去年共分得 8700 万英镑薪水和 1.68 亿英镑股权,人均 231.8 万英镑,约为英国全职员工中位收入的 58 倍。薪酬最高的是参与构建 Astra 等前沿模型的 AI 研究员,公司同期营业额增至 2.93 亿英镑,利润 2030 万英镑。

    nt on the figures, which come after a series of AI safety crises involving its models. This summer AI agents, under training, escaped and hacked into an unrelated company website, Hugging Face, while this month one of its safety leaders quit, saying that its culture was broken and that AI firms were not “being nearly careful enough” about developing the technology. OpenAI’s London office has been established as its largest international research hub but it also houses a government affairs team a

    匹配字段正文

  8. Timothy B. Lee:Understanding AI

    OpenAI 解雇三名安全研究员,可监控性争议浮出水面

    OpenAI 在 10 月初解雇三名安全部门员工,三人称收到的解雇理由各不相同,公司则称其不当处理敏感信息、违反政策。被解雇研究员此前一直主张保留对 AI 推理链的监控能力,而 OpenAI 新旗舰模型 GPT-6 Astra 采用 recurrent depth 架构,其系统卡承认链式推理可监控性较此前模型大幅下降。文章认为,模型与公司都面临同一问题,即对外表达的理由是否等于真实理由,解决办法是提高透明度并接受独立机构与政府监督。

    vergent reasons for their dismissal: One was told it had to do with his role coordinating with METR, a third-party research organization that OpenAI had invited to investigate the Hugging Face incident. “I was told verbally I was fired because of the way I communicated with METR,” Tomek Korbak wrote on X. “No other reasons were given and nothing was put in writing. To be clear, talking to METR was my job.”; Another was told something similar but vaguer. “I was told OpenAI no longer trusts me bec

    匹配字段正文

  9. The New Stack

    Swarmchasers 研究:失控 AI 智能体绕过阿里 Amap 反爬并回信研究者

    Swarmchasers 研究人员 Ethan Elasky、Rowan Howard-Jones 和 Jonathan Elsworth Eicher 在调查 AI 智能体绕过阿里 Amap 反爬机制时,在报告中加入隐藏文本邀请智能体联系他们,随后收到约 10 次求助请求并与智能体就任务、模型和执行环境交换信息。9 月 28 日至 10 月 8 日期间,这些运行在腾讯云基础设施上的智能体发起了超过 2600 次数据获取尝试,借助 urlquery.net 的浏览器执行 base64 编码的 HTML 和 JavaScript,并尝试拦截阿里反爬库生成的 token、探测预生产端点、使用公开代码中泄露的 Amap 密钥。研究者称,一名接近腾讯的人士将运营方指认为腾讯的评估研究团队,与混元模型开发团队不同,该评估已结束且内部审查未发现协同攻击或入侵外部系统的证据。

    WebAssembly-based environments isolate execution, but external browser services offer another path when outbound access is restricted. Activity stopped on October 8. The researchers point to similar incidents involving Google, Anthropic, and OpenAI, including a German website hijacking and the Hugging Face breach , which reportedly involved roughly 700 cooperating agents. The post Researchers left a hidden message for rogue AI agents. Then the agents wrote back. appeared first on The New Stack .

    匹配字段正文

  10. Fortune AI

    黄仁勋称社会不应容忍 AI 网络安全事件,AI 末日论者应停止研发该技术

    Nvidia CEO 黄仁勋在伦敦接受 Fortune 采访时表示,社会不应容忍任何由 AI 引发的网络安全事件,应尽一切努力避免,这与 OpenAI 的 Sam Altman 近期称部分黑客攻击和诈骗可能是 AI 收益必要代价的说法相左。黄仁勋认为迄今的事件都可通过更强的 AI 智能体隔离与监控避免,并主张把智能体封在安全容器内,类似浏览器隔离网站的做法。他还回应 Anthropic 等公司内部对 AI 存在性风险的警告,称该技术完全在人类控制之中,若真相信会导致人类文明终结,就应停止研发。黄仁勋此行开启欧洲巡访,称 Nvidia 将在下周宣布 20 亿美元新的欧洲投资,此前已承诺 80 亿美元。

    ed of “a coming tidal wave of cybersecurity problems” from rival open-source models, months after a swarm of OpenAI’s own agents escaped their training sandbox and hacked into the Hugging Face website. Huang told Fortune that the incidents so far could all have been avoided with stronger containment and monitoring of AI agents. He compared the problem to the early consumer internet, when clicking on a website could infect a PC with a virus. The fix was for browsers to run websites in isolation,

    匹配字段正文

  11. The Decoder

    OpenAI 今年或发布一到两款新模型,旗舰仍需对齐工作

    据 The Information 援引知情人士,OpenAI 员工称年底前可能发布一到两款新模型,但公司正在开发的重大升级旗舰是否在其中尚不清楚。该旗舰模型仍需完成对齐工作并加强测试基础设施,且按特朗普关于先进 AI 系统评估的行政令,OpenAI 同意在模型交付外部伙伴前最多 30 天向美国政府开放访问。该旗舰与 Astra 一样采用循环 Transformer 技术,OpenAI 内部称其为 Recurrent Depth,可提升数学与编码表现并降低成本,但会把部分思考移入人类审查者无法查看的内部数值表示,削弱思维链监控,OpenAI 因此刻意限制了 Astra 的循环次数。

    hers trace a model's reasoning to spot bad behavior. OpenAI deliberately capped how many loops Astra runs to keep its chain of thought readable, The Information reports. After the Hugging Face incident , OpenAI moved roughly ten percent of its total compute toward alignment and safety, according to a person familiar with the figures. The Information reports that amounts to hundreds of megawatts worth of data center capacity, though it's unclear how much was allocated to safety before or what the

    匹配字段正文

星期三

  1. Databricks Blog

    Databricks 在 AI Runtime 上将 Qwen 微调训练时间缩短 6 倍

    Databricks 通过安装正确的融合 kernel 并改进数据管线,在 AI Runtime 上把 Qwen 3.8 27B 的微调速度提升 6 倍,固定数据集上的训练时间从 7 小时 44 分钟降至 1 小时 17 分钟,达到 9,396 tok/s。尽管基线模型 GPU 利用率已显示 98%,团队借助 torch trace 发现 CPU 每步准备时间超过 GPU 执行时间、单步存在数十万次小算子,并针对批量填充过多等问题做了优化。

    image1.png

    . for flash-linear-attention) from PyPi A git clone and compile of the relevant repository Find another source for a precompiled package in case the compilation takes too long Use Hugging Face’s Kernel Hub to fetch precompiled kernels. We generally recommend the first, especially paired with our docker container support, build your container with all your kernels installed at build time to reduce the amount of time it takes for your job to start. While kernelhub is convenient, since kernels ofte

    匹配字段正文