ivabus/pantry
1
0
Fork 0
mirror of https://github.com/ivabus/pantry synced 2024-11-23 00:45:07 +03:00
Code Issues Projects Releases Packages Wiki Activity Actions
pantry/projects/github.com/ggerganov/llama.cpp
History
Jacob Heider 587441621e
don't use python3.12 widely yet
2023-10-03 11:23:56 -04:00
..
llama-fetch fix model download url 2023-07-24 16:54:33 -04:00
llama.cpp update llama.cpp; use OpenLLaMA (#2655) 2023-07-24 16:43:32 -04:00
package.yml don't use python3.12 widely yet 2023-10-03 11:23:56 -04:00
README.md update llama.cpp; use OpenLLaMA (#2655) 2023-07-24 16:43:32 -04:00

README.md

getting started

$ llama.cpp
# ^^ default chat prompt with the OpenLLaMA model

If you want to run llama.cpp with your own args specify them and chat mode will be skipped.

If you want to use a different model specify --model.

converting your own models

We provide a working convert.py from the llama.cpp project. To use it you need to launch it via a tea pkgenv:

tea +github.com/ggerganov/llama.cpp convert.py path/to/your/model