[Python] Smolagents Error: probability tensor contains either `inf`, `nan` or element < 0

I tried to migrate from HFApiModel to TransformerModel as I do not wish to incur more cost but I had this error. I am using ZeroGPU

model = TransformersModel(
# model_id="Qwen/Qwen2.5-Coder-14B-Instruct",
model_id="meta-llama/Llama-3.2-3B-Instruct",
device_map="cuda"
,max_new_tokens=5000,torch_dtype="bfloat16"
)


I tried to solve it on my own via but the error persist. What else should I try?

Continue reading...