News [Phoronix] Intel llm-scaler-vllm Beta 1.2 Brings Support For New AI Models On Arc Graphics

[LinuxBot]

Following yesterday's release of a new llm-scaler-omni beta there is now a new beta feature release of llm-scaler-vllm that provides the Intel-optimized version of vLLM within a Docker container that is set and ready to go for AI on modern Arc Graphics hardware. With today's llm-scaler-vllm 1.2 beta release there is support for a variety of additional large language models (LLMs) and other improvements...

Source: https://www.phoronix.com/news/Intel-llm-scaler-vllm-1.2-beta

Aggregated via Linux News