facing OS error trying to download the model in openLLM

177 Views Asked by mirdul agarwal At 11 April 2025 at 09:57

I am trying to run the openLLM but i am facing this error. I ran 3 commands.

!pip3 install openllm
!openllm -h
!openllm start opt

but the 3rd commands output is generating this error

OSError: model.safetensors or model.safetensors.index.json and thus cannot be loaded with safetensors. Please make sure that the model has been saved with safe_serialization=True or do not set use_safetensors=True.text

trying to run OPENllm faced an OS error

There are 0 best solutions below