NAll news

All news

Tuesday89 items

  10. Hugging FaceFirst-partyProduct release
    AI score60

    Hugging Face launches TorchNeuron, enabling HF models to run natively on AWS Trainium

    Hugging Face has released the PyTorch plugin TorchNeuron, which turns Neuron into a native device, supporting eager mode, torch.compile, and distributed interfaces such as FSDP2 and DTensor. It is available as a public beta starting October 20, 2026, and can be installed via pip install torch-neuronx. Transformers, Diffusers, Accelerate, PEFT, and TRL can run directly on Trainium without going through Optimum Neuron; the official recommendation is for Neuron users to switch to these libraries. For text generation, 89% of the top 100 most commonly used architectures are supported out of the box, compared with 46% for Optimum Neuron v0.4.5, and all that is needed is to pass device_map=neuron.

    Same story · 4 reports

    #Product updates#English text is being prepared.#Open-source ecosystem