NAll news

All news

Wednesday113 items

  1. Google BlogFirst-partyProduct release
    AI score57

    Google launches a small business hub and brand and finance tools for Gemini

    Google has launched a business landing page for Gemini aimed at small business owners, where they can manage branding, finances, and customer insights, and connect Google Business Profile, Google Ads, Google Workspace, as well as third-party apps such as Adobe, Canva, Dropbox, Shopify, Wix, Zoho, and Xero. Users can define their brand style by uploading their website, brand kit, fonts, or color palettes, and with Nano Banana 2.1 generate marketing visuals with a consistent style; Gemini can also turn spreadsheets, receipts, and purchase records into financial charts and interactive models. These features will roll out gradually worldwide to all Gemini app users over the coming days.

    "Your brand, your tools, all in one place" banner featuring three feature highlights: "Create image styles for your brand," "Customize Gemini with apps and skills," and "Create content with templates."

    #Product updates#Google#Agents

  2. PyTorch BlogFirst-partyProduct release
    AI score87

    Google and Meta jointly launch TorchTPU, enabling PyTorch to run natively on TPUs

    Google and Meta's PyTorch teams have collaborated to launch the open-source project TorchTPU, providing a native PyTorch backend for Google TPUs; migration only requires changing model.to("cuda") to model.to("tpu"). The project supports both eager and torch.compile modes, adds a new DeferAndFuse eager mode, covers about 450 Aten operators, and has been verified to run out of the box on 4,917 Hugging Face models, with a Tier 1 pass rate of 98% and Tier 2 numerical consistency relative to GPUs of 97%. According to the official announcement, it has already been used in the inference and training production workloads of some major Google Cloud customers, and is integrated with vLLM, SGLang, TorchTitan, Ray, and TorchRec.

    Same story · 2 reports

    #Product updates#Open-source ecosystem#English text is being prepared.

Tuesday89 items

  3. Tianyi CuiProduct release
    AI score60

    DeepSeek open-sources the inference framework DeepInfer and components such as deepseek-recipe

    DeepSeek has open-sourced its in-house inference framework DeepInfer, and simultaneously released key components for deploying DeepSeek models, including deepseek-recipe. DeepInfer already supports large-scale serving of DeepSeek-V4.1-Flash in production, with a focus on high throughput and low latency. DeepSeek said that publishing its production stack is intended to help the community lower compute costs, reduce energy consumption, and enable more organizations to deploy DeepSeek models.

    Quoted postDeepSeek · @deepseek_ai

    🚀 Introducing DeepInfer, our in-house inference framework, now fully open source! Powering DeepSeek-V4.1-Flash at scale with high throughput and low latency. We’re sharing our production stack to help the community lower compute costs, reduce energy use, and make AI more affordable. 🔗 https://t.co/JGAik1kgk0 1/4

    Same story · 29 reports

    #English text is being prepared.#English text is being prepared.#DeepSeek

  4. Yuchen JinProduct release
    AI score57

    DeepSeek Open-Sources Internal Inference Framework DeepInfer

    DeepSeek announced the open-sourcing of its internal inference framework DeepInfer, which supports large-scale operation of DeepSeek-V4.1-Flash and focuses on high throughput and low latency. DeepSeek said it is making this production stack public to help the community lower compute costs, reduce energy consumption, and make AI more affordable, and included a link to the repository. Yuchen Jin reposted the news and commented "Real Open AI."

    Quoted postDeepSeek · @deepseek_ai

    🚀 Introducing DeepInfer, our in-house inference framework, now fully open source! Powering DeepSeek-V4.1-Flash at scale with high throughput and low latency. We’re sharing our production stack to help the community lower compute costs, reduce energy use, and make AI more affordable. 🔗 https://t.co/JGAik1kgk0 1/4

    Same story · 29 reports

    #English text is being prepared.#Product updates#DeepSeek

  7. Nathan LambertProduct release
    AI score61

    DeepSeek open-sources its inference framework DeepInfer

    DeepSeek announced that it is fully open-sourcing its self-developed inference framework DeepInfer, which is used to support large-scale, high-throughput, low-latency operation of DeepSeek-V4.1-Flash. The company said it is sharing its production stack to help the community lower compute costs and energy consumption and make AI more affordable. Nathan Lambert commented that this is a distinctive way to gain model adoption and is good for the community, and noted that the timing is delicate because the government has just banned DeepSeek in federal agencies.

    Quoted postDeepSeek · @deepseek_ai

    🚀 Introducing DeepInfer, our in-house inference framework, now fully open source! Powering DeepSeek-V4.1-Flash at scale with high throughput and low latency. We’re sharing our production stack to help the community lower compute costs, reduce energy use, and make AI more affordable. 🔗 https://t.co/JGAik1kgk0 1/4

    Same story · 29 reports

    #English text is being prepared.#DeepSeek#English text is being prepared.

  10. 36Kr · AIProduct release
    AI score82

    DeepSeek open-sources inference framework DeepInfer and Token codec component deepseek-recipe

    DeepSeek open-sources its self-developed inference framework DeepInfer (Apache 2.0) and the production-grade Token codec component deepseek-recipe (MIT), supporting DeepSeek V4.1 Flash in serving 155 trillion Tokens per day on a single cluster. Official online statistics show an average of 77K Tokens input per request, a time to first token of about 400 milliseconds, 230 Tokens output per second during the generation phase, and an average of 96% of input hitting the cache. DeepInfer currently supports V4.1 Flash; the open-source version provides only offline inference, and the KV cache management and load balancing code has not yet been fully open-sourced because it is tied to internal infrastructure.

    Same story · 29 reports

    #English text is being prepared.#Reasoning#English text is being prepared.

  17. SiliconANGLEProduct release
    AI score51

    Scaled Cognition Launches Customer Service Voice Model Voice

    Scaled Cognition has released Voice, a text-to-speech model that supports more than 25 languages and voice cloning, and can be accessed via API or deployed self-hosted. It focuses on accurately reading aloud details such as account numbers and addresses. Managed API pricing is $9 per million characters, while self-hosting costs $1 per million characters (excluding infrastructure). The company says that at a scale of 5 million characters, including infrastructure, the cost is about $13 per million characters, and it claims a speech generation latency of 70 milliseconds. Voice's Smart Pronunciation capability first determines the meaning of abbreviations and numbers before generating audio—for example, reading "Pay 1/2 by 1/2" as "pay half by January second"—and it can run without relying on APT or other large language models.

    #Model releases#Speech#English text is being prepared.