Intel NPU Acceleration Library does not support GGUF format file?

[Martin_HZK]

I am trying to use intel-npu-acceleration library to enable local LLM inference task. However, it seems that the library does not support GGUF file parsing?

[Ying_H_Intel]

Hi Martin_HZK, 

As the  intel/intel-npu-acceleration-library: Intel® NPU Acceleration Library is not supported here, could you please to check your quesiton to Intel® Distribution of OpenVINO™ Toolkit - Intel Community 

or Issues · openvinotoolkit/openvino

FYI, I also noticed some developer also try to use Ollama openvino : like zhaohb/ollama_ov: Add genai backend for ollama to run generative AI models using OpenVINO Runtime. you may try them. 

Thanks