Instructions to use James040/llama-cpp-python-wheels with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- llama-cpp-python
How to use James040/llama-cpp-python-wheels with llama-cpp-python:
# !pip install llama-cpp-python from llama_cpp import Llama llm = Llama.from_pretrained( repo_id="James040/llama-cpp-python-wheels", filename="{{GGUF_FILE}}", )output = llm( "Once upon a time,", max_tokens=512, echo=True ) print(output)
- Notebooks
- Google Colab
- Kaggle
Download llama_cpp_python-0.3.16-cp313-cp313-linux_x86_64.whl from James040/llama-cpp-python-wheels: direct link, hf CLI and curl.
- Browser
- Download file 4.52 MB
-
https://huggingface.co/James040/llama-cpp-python-wheels/resolve/main/llama_cpp_python-0.3.16-cp313-cp313-linux_x86_64.whl
- Command line
-
hf download hf://James040/llama-cpp-python-wheels/llama_cpp_python-0.3.16-cp313-cp313-linux_x86_64.whl
-
curl -L -o llama_cpp_python-0.3.16-cp313-cp313-linux_x86_64.whl https://huggingface.co/James040/llama-cpp-python-wheels/resolve/main/llama_cpp_python-0.3.16-cp313-cp313-linux_x86_64.whl
4.52 MB
- Xet hash:
- c3c39c0b95b0e8308af916b473a2cc82d722d934e4efc5e300f43603f51238e3
- Size of remote file:
- 4.52 MB
- SHA256:
- b31fb70ff1ef1c845af7832d67784fba783e69451ddf1bfb84108d6bcf42479d
·
Xet efficiently stores Large Files inside Git, intelligently splitting files into unique chunks and accelerating uploads and downloads. More info.