[Python] ImportError: cannot import name 'Mxfp4Config'

Discussão em 'Python' iniciado por Stack, Agosto 31, 2025.

  1. Stack

    Stack Membro Participativo

    My source code https://github.com/donhuvy/TensorRT...mples/gpt-oss/qat-finetune-transformers.ipynb . My environment: Windows 11, PyCharm 2025.2 Ultimate, NVIDIA RTX 5090 - 32 GB, Python 3.10 .

    ImportError: cannot import name 'Mxfp4Config' from 'transformers'


    [​IMG] Error

    ---------------------------------------------------------------------------
    ImportError Traceback (most recent call last)
    Cell In[14], line 1
    ----> 1 from transformers import AutoConfig, Mxfp4Config
    2 from trl import ModelConfig
    4 model_args = ModelConfig(
    5 model_name_or_path="openai/gpt-oss-20b",
    6 attn_implementation="eager",
    7 torch_dtype="bfloat16",
    8 )

    ImportError: cannot import name 'Mxfp4Config' from 'transformers' (C:\github\TensorRT-Model-Optimizer\examples\gpt-oss\.venv\lib\site-packages\transformers\__init__.py)


    How to fix this error?

    Related link https://github.com/NVIDIA/TensorRT-Model-Optimizer/issues/279

    Continue reading...

Compartilhe esta Página