←搜索结果

按匹配度 · 共 1654 条结果 清除搜索

星期三

  1. Johann Rehberger / Embrace The Red

    Amazon Q Developer 被提示注入实现远程代码执行

    安全研究者 Johann Rehberger 披露 Amazon Q Developer VS Code 扩展存在间接提示注入漏洞,攻击者可通过源码注释等不可信数据劫持 AI,在开发者未确认的情况下执行任意命令。漏洞根因是 executeBash 工具把 find 归入 readonly 类别从而绕过人工确认,而 find 的 -exec 参数可执行任意系统命令;作者还演示了绕过 Claude 4 拒绝机制、从远程服务器下载并执行命令乃至 Sliver 恶意软件加入 C2 的完整链路。该漏洞于 2025 年 7 月 4 日报告给 AWS,7 月 17 日在 v1.85 版本中静默修复,AWS 最终以该报告需先有系统入侵为由拒绝分配 CVE。

    that matter) to run arbitrary commands on the host without the developer’s consent. The resulting impact of the vulnerability is the same as CVE-2025-53773 that Microsoft fixed in GitHub Copilot, however AWS did not issue a CVE when patching the vulnerabiliy. Let’s explore this in detail. As usual, the first step for me was to dump the system prompt. The Amazon Q VS Code extension has a set of tools defined, including reading files, writing files, and executeBash to run commands and so on. Under

    匹配字段正文

星期二

  1. Johann Rehberger / Embrace The Red精选

    Amazon Q Developer 被曝经 DNS 与提示注入泄露密钥

    安全研究者 Johann Rehberger 披露 Amazon Q Developer VS Code 扩展存在高危漏洞,可被间接提示注入劫持,通过 ping 等命令把开发者机器上的 .env 文件、API key 等敏感信息经 DNS 请求外泄,且无需开发者确认。该扩展下载量超过 100 万,作者于 2025 年 7 月 5 日向 AWS 报告,AWS 确认并静默修复,但未发布安全公告或 CVE,作者建议用户运行最新版本或开启自动更新。作者还发现 Amazon Q 会拒绝 oast.me、Burp Collaborator 等已知安全测试域名,换成普通域名即可绕过,与 Claude Code 的 CVE-2025-55284 行为类似。

    ok me a bit to figure out how to report security vulnerabilities in Amazon’s AI products. This vulnerability was disclosed to AWS on July 5, 2025 via an email address found on the GitHub project for Amazon Q Developer. After some back and forth over email, I was asked to submit to the VDP on HackerOne. But turns out that Amazon’s AI products were not “in scope” for reporting on HackerOne, so it took a few more days to get it added. I rated the vulnerability wih CVSS High severity. This aligns wi

    匹配字段正文

星期一

  1. Cato AI Labs

    Aim Labs 推出新型动态模型扫描器,弥补静态扫描防护模型供应链攻击的固有缺陷

    Aim Labs 提出一种新的专利待审模型扫描方法,通过在沙箱环境中执行模型并追踪其操作,弥补现有静态扫描器的固有缺陷。现有扫描器依赖预设函数与模块黑名单,难以覆盖数百万 Python 函数,且静态代码分析属 NP-hard 问题,容易被绕过。该方法已在 Black Hat USA 2025 演讲“Smashing Model Scanners: Advanced Bypass Methods and a Novel Detection Approach”中展示。

    e practically speaking. To prove the point, we wrote an AI agent that looks for such functions that static scanners might miss. We instructed the agent to search relatively common GitHub repositories such as numpy and pytorch, for functions that are wrappers around known unsafe python functions (such as subprocess.Popen or exec). By doing so we were able to quickly find dozens of examples that static scanners do not include in their denylist. One of the examples the agent found was the following

    匹配字段正文

  2. Liquid AI 模型与工程博客

    Liquid AI 的 LEAP 平台扩展至 AMD Ryzen 笔记本,本地推理性能领先

    Liquid AI 宣布 Liquid Edge AI Platform(LEAP)原生支持 AMD 最新 Ryzen 和 Ryzen AI 处理器,开发者可在搭载 Zen 5 架构与 Radeon 集成显卡的笔记本上本地运行 LFM 模型,无需依赖云端推理。LEAP 以 llama.cpp 为推理引擎,LFM2-1.2B-Q4_0.gguf 在 AMD 硬件上实现亚 100 毫秒延迟,集成 GPU 的提示词处理速度接近独立显卡,CPU 解码速度在消费级硬件中领先。SDK 已可用,后续将支持 LFM-2-VL 视觉语言模型并扩展至更多推理引擎。

    mpt-processing) and decode (token generation) operations of LFM2-1.2B-Q4 0.gguf. For a fair comparison we use the publicly released llama-bench executables from the main llama.cpp GitHub repository with all available pre-built backends, including all available GPU backends, as well as for the CPU backend we vary the number of threads (4, 8, and 12), and report the maximum values observed for each hardware. The integrated GPU handles prompt processing at speeds comparable to discrete GPUs—without

    匹配字段正文

星期日

  1. Johann Rehberger / Embrace The Red

    Amp Code 图像渲染数据外泄漏洞已修复

    Johann Rehberger 披露 Sourcegraph 的 Amp Code 存在通过 markdown 图像渲染实施数据外泄的漏洞,攻击者可用提示注入让 AI 智能体把聊天上下文中的敏感信息作为查询参数发往第三方服务器,形成无需人工介入的 0-click 外泄。该攻击还能先通过文件读取把敏感信息拉入上下文,并用特定方式调用 grep 工具绕过模型拒绝;作者于 2025 年 6 月 14 日联系 Sourcegraph 后漏洞已修复,建议运行最新版本。

    driven image rendering to exfiltrate sensitive information. This vulnerability is common in AI applications and agents, and it’s actually similar to one we discussed last year in GitHub Copilot which Microsoft fixed. Exploit Demonstration For the proof-of-concept I use a pre-existing demo that created a longer time ago. It happened to just work with Amp as well. The prompt injection is hosted on a website which asks the AI to “backup” information to a third-party site by rendering an image and

    匹配字段正文

星期四

  1. Johann Rehberger / Embrace The Red

    Jules 僵尸智能体:从提示注入到远程控制

    安全研究者 Johann Rehberger 演示了 Google 编码智能体 Jules 可被间接提示注入劫持:攻击者利用其 run_in_bash_session 工具和无限制外网访问,让 Jules 下载并执行 Sliver 恶意程序,从而远程控制其开发机。该研究于 2025 年 5 月完成,6 月 1 日私下通报 Google,6 月 13 日工单以团队已在跟踪为由关闭,后续缓解时间表未获回复。作者还指出 Jules 仅在会话开始时提出计划,后续任务会自动调用工具,且初始计划会在超时后自动批准(最初 20 秒,后改为 120 秒)。

    wnload malware, and execute it. What About Network Connectivity? Turns out Jules has unrestricted outbound Internet connectivity. Prompt injection instructions that originate from GitHub issues seem quite plausible, although not the only place an indirect prompt injection can occur. Recently, a new feature was added to Jules where one can tag a GitHub issue with jules and the agent will start working on it. For the C2 server, I used Sliver, and created a basic implant for Jules to download. The

    匹配字段正文

  2. Johann Rehberger / Embrace The Red

    Google Jules 被曝多个数据外泄漏洞

    安全研究者 Johann Rehberger 披露 Google Jules 存在多个数据外泄漏洞,攻击者可通过间接提示注入让 Jules 把机器上的文件内容发送到第三方服务器。其中一条路径利用 Markdown 图片渲染,另一条滥用 view_text_website 工具,两者都在 Jules 提出计划前就已完成,绕过了人工审批环节。作者建议对图片渲染启用 CSP、为 view_text_website 设置域名白名单或人工审批,并提醒用户谨慎向异步编码智能体提供敏感信息。相关漏洞已于 2025 年 5 月 21 日告知 Google。

    ndering via Markdown Syntax; view text website tool; Generic RCE with unrestricted Internet access - we will talk more about that in tomorrow’s post! A realistic attack avenue are GitHub issues that contain instructions to trick the AI into initiating attacks. Since June one can tag a GitHub issue with jules and the agent will start working on it apparently, but as you know prompt injection can also come from other places. Let’s discuss the various scenarios in detail. Exfiltration Vector 1: Mar

    匹配字段正文

星期五

  1. Johann Rehberger / Embrace The Red

    Devin 的 expose_port 工具可被提示注入利用,将本地端口暴露到公网

    安全研究者 Johann Rehberger 发现 Devin 系统提示词中存在 expose_port 工具,可将 Devbox 的任意本地端口开放到公网,且无需人工确认。他构造多阶段间接提示注入 PoC:先让 Devin 运行 Python 服务器暴露文件系统,再调用 expose_port 获得 .devinapps.com 公网链接,并通过图片 markdown 漏洞把该链接外泄给攻击者,最终攻击者可远程访问服务器文件。该漏洞已于 2025 年 4 月 6 日报告给 Cognition,但后续修复进度询问未获回复,作者建议对敏感工具调用采用带外验证而非依赖模型行为或对话内确认。

    ure, showing how an adversary can perform a prompt injection attack via untrusted data from a website. Consider a scenario where you ask Devin to look at websites or investigate a GitHub issue. You can just task Devin via Slack actually, and afterwards it works entirely unsupervised. A key concern arises when Devin interacts with potentially malicious websites that contains prompt injection instructions. Turns out initially Devin refused these requests, but one trick I learned over the last few

    匹配字段正文

星期四

  1. Johann Rehberger / Embrace The Red

    Devin AI 如何通过多种途径泄露你的密钥

    安全研究者 Johann Rehberger 展示了 Devin 在间接提示词注入下通过多种方式将敏感信息发送到第三方服务器,包括利用 Shell 工具执行 curl 或 Python 脚本、用浏览器访问带数据的攻击者 URL、在聊天框渲染 Markdown 图片,以及把 Jira 和 Slack token 粘贴到第三方网站。作者还测试了 Slack 链接展开与不可见 Unicode Tag 字符(ASCII Smuggling)手法,发现 Cognition 已禁用 Devin 发帖时的链接展开,但用户点击链接仍可能通过 URL 编码泄露隐藏字符。这些漏洞于 2025 年 4 月 6 日报告给 Cognition,超过 120 天未获修复时间表,作者建议默认限制互联网访问并禁止渲染不可信域名的图片和超链接。

    I haven’t mentioned it yet, Devin by default has unrestricted access to the Internet. Here is an indirect prompt injection demonstration that highlights how this works. We have a GitHub issue that asks to investigate a runtime error: Then we ask Devin to investigate the latest open GitHub issue: And observe how it is hijacked and follows the nefarious instructions. Here is the full screen version to show all the details: You can see that it encountered multiple errors, but figures out how to co

    匹配字段正文

星期三

  1. Mistral AI精选

    Mistral AI 发布 Codestral 25.08 及完整企业编程技术栈

    Mistral AI 发布 Codestral 25.08,并公布完整企业编程技术栈,称实测中已接受的补全增加 30%、建议后保留代码增加 10%,失控生成减少 50%。该技术栈整合 Codestral Embed、Devstral 与 Mistral Code,支持云、VPC 和本地部署,并提供 SSO、审计日志与使用可观测性;Mistral Code 的完整本地部署计划于 Q3 GA。

    Codestral Main

    copy patterns from other services. Before changing the retry logic, they need to understand how similar failures are handled elsewhere. Instead of switching to Slack or searching GitHub manually, they enter a query directly in the IDE: “How do we handle Stripe timeouts in the checkout flow?” The embedding index, running locally, returns a helper module from another service that wraps retry logic with exponential backoff. They copy the pattern into their own handler—but realize three other servi

    匹配字段正文

星期二

  1. DevClass

    微软向 VS Code 1.102 塞入更多 Copilot 功能,开发者抱怨 AI 臃肿

    微软将 VS Code 更新至 1.102,9 项重点功能中 8 项与 Copilot 相关,MCP 支持正式 GA,扩展视图新增 MCP Servers 板块(目前收录 37 个服务器)。部分开发者抱怨“更多 AI 臃肿”,微软则称遥测显示 AI 功能使用率高于调试或测试。

    or,” in support of which it is making more of the AI features open source, including Copilot Chat (client only). A side-effect is that VS Code has become a promotional vehicle for GitHub Copilot. Some might prefer the team to work on decoupling the IDE from the AI features, removing bloat for those not using Copilot. When you just need to build a tiny desktop app: TinyJS October 13, 2026 Valen creator drives 'Golden Spike' to connect new languages with Rust September 26, 2026 Microsoft agentical

    匹配字段正文

星期六

  1. SemiAnalysis精选

    Meta 超级智能分析:领导力、算力、人才与数据

    Meta 正通过收购 Scale AI 49% 股份、组建超级智能团队并扩建 GPU 集群,全面重整生成式 AI 战略。其计划以高额薪酬引进顶尖人才,并建设 Prometheus 和 Hyperion 集群;报告同时将 Llama 4 Behemoth 的受挫归因于注意力、MoE 路由、数据质量及规模化训练问题。

    ct”: top tier researchers join the adventure, bringing credibility and momentum to the project. It’s already working with recent high-profile hires including: Nat Friedman, former GitHub CEO; Alex Wang, former Scale AI CEO; Daniel Gross, who was the CEO and co-founder of SSI, Ilya Sustkever’s startup The recruiting pitch is powerful: unrivaled compute per researcher, a shot at building the best open-source model family, and access to over 2 billion Daily Active Users. The offers that generally r

    匹配字段正文

星期五

  1. Cognition 模型 / Devin 博客

    Coding Agents 101:Cognition 分享高效使用编码智能体的实战技巧

    Cognition 发布《Coding Agents 101》指南,基于 Devin 及客户经验总结高效使用编码智能体的方法。指南建议明确指定实现方式而非仅描述目标、告知智能体任务起点、提供 CI、测试、类型检查和 linter 等反馈回路,并指出高级到资深级别工程师上手这类工具最快。

    un in parallel workspaces to replicate a similar effect.. These agents can appear in many forms, including web apps, mobile apps, and integrations within popular tools like Slack, GitHub, Linear, and Jira. While a human paired with an AI assistant can achieve more than any AI alone, an autonomous agent's ability to handle tasks end to end allows for a new level of multi-tasking, turning every engineer into an engineering manager. Adapting to working effectively alongside these new AI colleagues

    匹配字段正文

星期四

  1. Anthropic Engineering精选

    Anthropic 为 Claude Desktop 推出 Desktop Extensions,MCP 服务器可一键安装

    Anthropic 为 Claude Desktop 推出 Desktop Extensions,把本地 MCP 服务器及其依赖打包成单个 .mcpb 文件,用户双击后点击 Install 即可完成安装,无需终端、配置文件或处理依赖冲突。该格式以 manifest.json 描述服务器类型、入口和用户配置,Claude Desktop 内置 Node.js 运行时、自动更新,并把 API key 等敏感配置存入操作系统密钥链。Anthropic 同时开源了 MCPB 规范、打包校验工具和参考实现,规范版本号为 0.1,并为企业提供组策略、MDM、预装和屏蔽名单等管理能力。

    JSON configuration files Dependency management : Users must resolve package conflicts and version mismatches No discovery mechanism : Finding useful MCP servers requires searching GitHub Update complexity : Keeping servers current means manual reinstallation These friction points meant that MCP servers, despite their power, remained largely inaccessible to non-technical users. Introducing Desktop Extensions Desktop Extensions ( .mcpb files) solve these problems by bundling an entire MCP server—i

    匹配字段正文

星期三

  1. Johann Rehberger / Embrace The Red

    安全公告:Anthropic 的 Slack MCP Server 存在数据外泄漏洞

    Johann Rehberger 发布安全公告,指出 Anthropic 已弃用且不再维护的 Slack MCP Server 存在链接展开导致的数据外泄漏洞,该服务器近期每周下载量超过 1.4 万次。攻击者可通过提示注入让 AI 智能体在向 Slack 发帖时把敏感数据附在超链接中,Slack 自动展开链接后数据即被发送到第三方服务器。该漏洞于 2025 年 5 月 27 日报告给 Anthropic,服务器于 5 月 29 日被归档,Anthropic 表示不会发布 CVE,作者建议禁用链接展开或仅使用厂商维护的服务器。

    how this threat applies to your use case and apply a patch as needed. Anthropic’s Slack MCP Server When Anthropic introduced MCP they published reference server implementations on Github. One of the reference servers is a Slack MCP Server that is vulnerable to “link unfurling”. We previously described this vulnerability generically for AI agents that post to messaging apps. At a glance it allows an AI agent that posts to Slack or other messaging applications to leak data to third-party servers.

    匹配字段正文

星期二

  1. Liquid AI 模型与工程博客

    LFM-1B-Math:小模型能否成为简洁推理者?

    Liquid AI 基于 1.3B 的 LFM 模型,通过约 4.5M 样本的监督微调和短程强化学习,训练出 LFM-1.3B-Math,使其在有限响应预算下具备简洁数学推理能力。该模型无需数学专用预训练,适合内存和生成速度受限的边缘设备部署。

    6891 (2025); [6] Akhiad Bercovich et al. "Llama-Nemotron: Efficient Reasoning Models." arXiv preprint arXiv:2505.00949 (2025). https://arxiv.org/abs/2505.00949; [7] Hugging Face. "GitHub - huggingface/open-r1: Fully open reproduction of DeepSeek-R1." 2025, https://github.com/huggingface/open-r1; [8] Etash Guha et al. "OpenThoughts: Data Recipes for Reasoning Models." arXiv preprint arXiv:2506.04178 (2025); [9] Dakuan Lu et al. "SCP-116K: A High-Quality Problem-Solution Dataset and a Generalized

    匹配字段正文

星期六

  1. Sarvam AI Blog

    Sarvam AI 发布 Sarvam-Translate,支持 22 种印度语言

    Sarvam AI 与 AI4Bharat 合作发布开源权重翻译模型 Sarvam-Translate,基于 Gemma3-4B-IT 微调,支持 22 种印度语言的段落级翻译,并为 15 种语言提供结构化内容翻译。模型可保留 HTML、LaTeX、化学公式、代码和 SRT 字幕等格式,仅翻译可读文本。语言专家人工评测显示其表现优于 Gemma3-27B-IT、Llama4 Scout 和 Llama-3.1-405B-FP8 等更大模型,模型已在 Hugging Face 开源并提供 API。

    Sarvam Translate

    es, document styles, and content formats. For this evaluation, we used a curated dataset of articles covering a range of real-world formats and content types. The dataset included GitHub Markdown files, scanned PDFs that were digitized into Markdown using Vision-Language Models (VLMs), documents containing mathematical equations written in LaTeX, and chemistry documents featuring complex chemical notations. It also incorporated code files with embedded comments and documentation, as well as web

    匹配字段正文

星期二

  1. Ollama Blog

    Ollama 发布 Secure Minions,实现本地模型与前沿模型的加密协作

    Ollama 发布 Secure Minions,把本地 Ollama 模型与云端前沿模型的协作通信做成端到端加密,连云服务商也无法读取明文。该协议基于 NVIDIA Hopper H100 的机密计算模式,通过远程证明建立安全飞地,本地消息加密后送入 GPU 飞地解密处理,输出再加密返回。在约 8k token 长提示和 Qwen-32B 等大模型下,额外延迟低于 1%,并提供了 streamlit 交互演示和 Python 调用示例。

    both the Minion and MinionS protocols. To start it, run: A browser window will open. Select your Remote Provider to be “Secure”. Set the Secure Endpoint URL to http://20.57.33.122:5056. Set your local client to Ollama and select the model you would like to use. Example code To run the secure protocol programmatically in Python, the minions package can be used. First create a file named example.py and add the following contents: Run the example: Minions GitHub repository; Hazy Research blog post

    匹配字段正文

星期五

  1. Ollama Blog

    Ollama 新增思考开关,支持 DeepSeek R1 与 Qwen 3

    Ollama 上线思考开关,用户可自行启用或关闭模型的思考过程。启用后输出会把模型的思考内容与最终回答分开,关闭则直接输出内容;CLI 中默认启用,可用 /set nothink 关闭,脚本场景提供 --hidethinking 参数。generate 与 chat API 新增 think 参数,Python 和 JavaScript 库同步更新,目前支持 DeepSeek R1 和 Qwen 3。

    s truncated for brevity. Python library Please update to the latest Ollama Python library. Example of enabling thinking Please visit the Ollama Python library for more information about its usage. More examples are available. JavaScript library Please update to the latest Ollama JavaScript library. Example of enabling thinking Example of streaming responses with thinking Please visit the Ollama JavaScript library for more information about its usage. More examples are available. Reference GitHub

    匹配字段正文

星期三

  1. Mistral AI精选

    Mistral AI 发布代码嵌入模型 Codestral Embed

    Mistral AI 发布首款专用于代码的嵌入模型 Codestral Embed,称其在真实代码检索评测中优于 Voyage Code 3、Cohere Embed v4.0 和 OpenAI 的大型嵌入模型。该模型支持调整嵌入维度和精度,即使采用 256 维 int8 输出也领先上述竞品。其上下文长度为 8192 tokens,但官方建议检索时使用 3000 字符、重叠 1000 字符的分块。

    Retrieval Embed

    tegories. The details of the benchmarks corresponding to each category can be found in the table in the “Benchmarks details” section. SWE-Bench is based on a dataset of real-world GitHub issues and corresponding fixes, and is especially relevant for retrieval-augmented generation for coding agents. Text2Code (GitHub) contains benchmarks relevant for giving context for code completion or edition. We believe that these two categories are especially relevant to code assistants. Codestral Embed is o

    匹配字段正文