Liquid AI releases real-time inference engine RIPL, with end-to-end latency below 50 ms
Liquid AI has released the real-time inference engine RIPL (Real-time Inference Pipeline), used to serve the LFM2.5 series models (230M to 2.6B parameters) in real-time request paths, generating end-to-end responses in under 50 ms. According to Liquid AI's own benchmark data, on a single B200 its p95 latency is 5.6 to 28.4 times lower than that of Qwen3.5 running on vLLM, with LFM2.5-1.2B at 155.8 ms and Qwen3.5-0.8B at 4431 ms. The engine is aimed only at enterprise deployments and supports NVIDIA H100, H200, B200 and RTX PRO 6000; Shopify already runs LFM in search scenarios with inference latency below 20 ms.
#Product updates#Reasoning#English text is being prepared.




