News [Phoronix] Open-Source "GreenBoost" Driver Aims To Augment NVIDIA GPUs vRAM With System RAM & NVMe To Handle Larger LLMs

[LinuxBot]

An open-source, independently developed Linux kernel module called GreenBoost aims to augment the dedicated video memory on NVIDIA discrete GPUs with system memory and NVMe storage. The intent here with GreenBoost is a CUDA caching layer to more easily run larger AI models for LLMs that otherwise won't fit solely in your graphics card's dedicated vRAM...

Source: https://www.phoronix.com/news/Open-Source-GreenBoost-NVIDIA

Aggregated via Linux News