[Python] unsloth save_pretrained_merged function issue

I tried to save the model with the below code but failed. Planning to use unsloth/Llama-3.2-11B-Vision-Instruct as a base model to fine-tune a new model.

!pip install unsloth
model, tokenizer = FastVisionModel.from_pretrained(
"unsloth/Llama-3.2-11B-Vision-Instruct",
load_in_4bit = False,
use_gradient_checkpointing = "unsloth",
)
...
if True:
model.save_pretrained_merged(
"unsloth_finetune",
tokenizer,
save_method = "merged_16bit",)


with error

File ~/.local/lib/python3.10/site-packages/unsloth/save.py:2357, in unsloth_generic_save_pretrained_merged(self, save_directory, tokenizer, save_method, push_to_hub, token, is_main_process, state_dict, save_function, max_shard_size, safe_serialization, variant, save_peft_format, tags, temporary_location, maximum_memory_usage)
[2355](https://vscode-remote+ssh-002dremote-002b7b22686f73744e616d65223a225350524541442d4445562d41313030227d.vscode-resource.vscode-cdn.net/home/azadmin/vision_model_pipeline/Finetune_vision_model/~/.local/lib/python3.10/site-packages/unsloth/save.py:2355) arguments["model"] = self
[2356](https://vscode-remote+ssh-002dremote-002b7b22686f73744e616d65223a225350524541442d4445562d41313030227d.vscode-resource.vscode-cdn.net/home/azadmin/vision_model_pipeline/Finetune_vision_model/~/.local/lib/python3.10/site-packages/unsloth/save.py:2356) del arguments["self"]
-> [2357](https://vscode-remote+ssh-002dremote-002b7b22686f73744e616d65223a225350524541442d4445562d41313030227d.vscode-resource.vscode-cdn.net/home/azadmin/vision_model_pipeline/Finetune_vision_model/~/.local/lib/python3.10/site-packages/unsloth/save.py:2357) unsloth_generic_save(**arguments)
[2358](https://vscode-remote+ssh-002dremote-002b7b22686f73744e616d65223a225350524541442d4445562d41313030227d.vscode-resource.vscode-cdn.net/home/azadmin/vision_model_pipeline/Finetune_vision_model/~/.local/lib/python3.10/site-packages/unsloth/save.py:2358) for _ in range(3):
[2359](https://vscode-remote+ssh-002dremote-002b7b22686f73744e616d65223a225350524541442d4445562d41313030227d.vscode-resource.vscode-cdn.net/home/azadmin/vision_model_pipeline/Finetune_vision_model/~/.local/lib/python3.10/site-packages/unsloth/save.py:2359) gc.collect()

File ~/.local/lib/python3.10/site-packages/torch/utils/_contextlib.py:116, in context_decorator.<locals>.decorate_context(*args, **kwargs)
[113](https://vscode-remote+ssh-002dremote-002b7b22686f73744e616d65223a225350524541442d4445562d41313030227d.vscode-resource.vscode-cdn.net/home/azadmin/vision_model_pipeline/Finetune_vision_model/~/.local/lib/python3.10/site-packages/torch/utils/_contextlib.py:113) @functools.wraps(func)
...
--> [472](https://vscode-remote+ssh-002dremote-002b7b22686f73744e616d65223a225350524541442d4445562d41313030227d.vscode-resource.vscode-cdn.net/home/azadmin/vision_model_pipeline/Finetune_vision_model/~/.local/lib/python3.10/site-packages/unsloth_zoo/saving_utils.py:472) try_save_directory = temp_file.name
[474](https://vscode-remote+ssh-002dremote-002b7b22686f73744e616d65223a225350524541442d4445562d41313030227d.vscode-resource.vscode-cdn.net/home/azadmin/vision_model_pipeline/Finetune_vision_model/~/.local/lib/python3.10/site-packages/unsloth_zoo/saving_utils.py:474) total, used, free = shutil.disk_usage(save_directory)
[475](https://vscode-remote+ssh-002dremote-002b7b22686f73744e616d65223a225350524541442d4445562d41313030227d.vscode-resource.vscode-cdn.net/home/azadmin/vision_model_pipeline/Finetune_vision_model/~/.local/lib/python3.10/site-packages/unsloth_zoo/saving_utils.py:475) free = int(free*0.95)

AttributeError: 'NoneType' object has no attribute 'name'


All the help is appreciated.

Continue reading...