I have been using transformers library for a long time. But I got a problem - this library doesn't support NPU. So I used it alongside Intel NPU acceleration library. Unfortunetuly, it was deprecated on the 24 of April 2025. So I deciced to try OpenVino genai. But I ran into issue - model doesn't load. I had no errors, but script didn't execute. What is correct way of using OpenVino genai? I followed instructions on their github page. But, it didn't go as planned. Instructions: https://pypi.org/project/openvino/ https://github.com/openvinotoolkit/openvino.genai Continue reading...
