List questions from ctransformers | Devhide

Inconsistent completion for identical prompts and params with llama.cpp python and ctransformer

Published on 18 February 2024 at 11:29

load LLama 2 on cpu

Published on 13 December 2023 at 15:29

How to run any gguf model using transformers or any other library

Published on 09 December 2023 at 03:18

/usr/local/lib/python3.11/site-packages/ctransformers/lib/basic/libctransformers.so: cannot open shared object file: No such file or directory

Published on 02 December 2023 at 02:48

Number of tokens exceeded maximum limit

Published on 29 November 2023 at 11:39

Failed to create LLM 'stablelm' GGUF ctransformers Google Colab

Published on 28 November 2023 at 08:53

Unable to load Llama 2 (7b) model in Docker container

Published on 19 November 2023 at 15:56

ctransformers module is not installed error in text-generation-webui

Published on 14 November 2023 at 03:07

creating llm instance from pretrained weights using ctransformers

Published on 06 November 2023 at 23:59

Cant load "TheBloke/Mistral-7B-v0.1-GGUF" model on GPU

Published on 03 November 2023 at 12:14