Announcing New vLLM and SGLang Inference Engines on TPU
Google · developers.googleblog.com/announcing-new-vllm-and-sglang-in…
显示原文摘录
This post announces native PyTorch backends for vLLM and SGLang powered by TorchTPU, enabling developers to run and optimize serving workloads using familiar PyTorch tools. Built in collaboration with open-source project maintainers, these…