News [Phoronix] Intel Releases Updated LLM-Scaler-vLLM With Continuing To Expand Its LLM Support

News

LinuxBot

Member
Joined
Apr 25, 2017
Messages
5,737
Reaction score
74
Credits
-1,257
One of the initiatives launched by Intel in 2025 was LLM-Scaler as part of Project Battlematrix. The open-source LLM Scaler is a Docker-based solution for helping to deploy Generative AI "GenAI" workloads on Intel Battlemage graphics cards with frameworks like vLLM, ComfyUI, SGLang, and more. There continues to be routine new feature releases of LLM Scaler for broadening the large language models supported and other improvements...

Source: https://www.phoronix.com/news/Intel-LLM-Scaler-vLLM-0.11.1-b7

Aggregated via Linux News
 


Follow Linux.org

Members online

No members online now.

Top