[Python] Is there any method to fully load the GGUF models on GPU

I have been using LlamaCPP to load my llm models, the llama-index library provides methods to offload some layers onto the GPU. Why does it not provide any methods to fully load the model on GPU. If there is some method Please help.

LlamaCPP method

Here we have the option to offload some layers on GPU but I want to fully load the model on GPU.

Continue reading...