[Python] how to load deberta-v3 properly

Discussão em 'Python' iniciado por Stack, Abril 3, 2025.

  1. Stack

    Stack Membro Participativo

    I am trying to fine tune a DeBERTa model for a regression task, the problem is that when I load the model using this code

    from transformers import AutoConfig, AutoTokenizer, AutoModel
    ## Model Configurations
    MODEL_NAME = 'microsoft/deberta-v3-base'

    config = AutoConfig.from_pretrained(MODEL_NAME) ## Configuration loaded from AutoConfig
    tokenizer = AutoTokenizer.from_pretrained(MODEL_NAME) ## Tokenizer loaded from AutoTokenizer


    I get a KeyError

    Traceback (most recent call last)
    <ipython-input-23-62561c3f4e7b> in <module>
    3 MODEL_NAME = 'microsoft/deberta-v3-base'
    4
    ----> 5 config = AutoConfig.from_pretrained(MODEL_NAME) ## Configuration loaded from AutoConfig
    6 tokenizer = AutoTokenizer.from_pretrained(MODEL_NAME) ## Tokenizer loaded from AutoTokenizer

    /usr/lib/python3.8/dist-packages/transformers/models/auto/configuration_auto.py in from_pretrained(cls, pretrained_model_name_or_path, **kwargs)
    350
    351 if "model_type" in config_dict:
    --> 352 config_class = CONFIG_MAPPING[config_dict["model_type"]]
    353 return config_class.from_dict(config_dict, **kwargs)
    354 else:

    KeyError: 'deberta-v2'


    what can be the problem? I am using transformers version 4.31.0

    Continue reading...

Compartilhe esta Página