English translation is being prepared.
#Product updates#English text is being prepared.#English text is being prepared.
#Product updates#English text is being prepared.#English text is being prepared.
NVIDIA has released the OpenShell reference architecture, using an open-source runtime to treat agent workloads as untrusted objects and grant access on demand. The architecture consists of four components: Gateway, Supervisor, Sandbox, and Policy Prover, which are responsible for sandbox lifecycle and policy management, credential access brokering, workload isolation, and formal verification of policy permissions, respectively. CoreWeave's measurements show that on Vera CPUs, sandbox startup is more than 3 times faster than on x86, agent loops complete 1.8 times faster, and a single rack can support more than 11,000 concurrent agent environments.

#Product updates#Agents#Safety / alignment

#Product updates#Safety / alignment#Agents
#Product updates#English text is being prepared.#English text is being prepared.
#Product updates#English text is being prepared.#English text is being prepared.
#Product updates#Safety / alignment#Agents
#Product updates#Agents#Open-source ecosystem
#Product updates#English text is being prepared.#Open-source ecosystem
#Product updates#Embodied AI#English text is being prepared.
#Product updates#Embodied AI#Open-source ecosystem
English text is being prepared.
#English text is being prepared.#Agents#English text is being prepared.
🚀 Introducing DeepInfer, our in-house inference framework, now fully open source! Powering DeepSeek-V4.1-Flash at scale with high throughput and low latency. We’re sharing our production stack to help the community lower compute costs, reduce energy use, and make AI more affordable. 🔗 https://t.co/JGAik1kgk0 1/4
#English text is being prepared.#English text is being prepared.#DeepSeek
#Product updates#English text is being prepared.#Agents
#Product updates#Agents#Google
#Industry news#Open-source ecosystem#DeepSeek
#Product updates#Agents#Industry news
#Model releases#Embodied AI#Reasoning
#English text is being prepared.#Reasoning#English text is being prepared.
DeepSeek has open-sourced DeepInfer, its self-developed inference framework that supports DeepSeek-V4.1-Flash, and published production data: a single cluster processes 155 trillion tokens per day, 96% input cache hit rate, 400ms first-token latency, and 230 tokens/s generation speed. The framework is customized based on vLLM and supports distributed inference, speculative decoding, SWA Bounded Replay, and structured output, with target platforms NVIDIA SM100 and Huawei Ascend 950. DeepSeek also states that components such as KV cache management and load balancing are not yet fully open-sourced, while the vLLM team says that under a matching GB200 configuration, decoding throughput is within 6% of the results published by DeepInfer.
#English text is being prepared.#Reasoning#English text is being prepared.
English text is being prepared.
#English text is being prepared.#Agents#English text is being prepared.