ivabus/pantry
1
0
Fork 0
mirror of https://github.com/ivabus/pantry synced 2024-12-01 20:45:10 +03:00
Code Issues Projects Releases Packages Wiki Activity Actions
pantry/projects/github.com/ggerganov/llama.cpp
History
Max Howell 9c56216f04
entrypoint for agpt.co
2023-07-30 08:01:11 -04:00
..
llama-fetch fix model download url 2023-07-24 16:54:33 -04:00
llama.cpp update llama.cpp; use OpenLLaMA (#2655) 2023-07-24 16:43:32 -04:00
package.yml entrypoint for agpt.co 2023-07-30 08:01:11 -04:00
README.md update llama.cpp; use OpenLLaMA (#2655) 2023-07-24 16:43:32 -04:00

README.md

getting started

$ llama.cpp
# ^^ default chat prompt with the OpenLLaMA model

If you want to run llama.cpp with your own args specify them and chat mode will be skipped.

If you want to use a different model specify --model.

converting your own models

We provide a working convert.py from the llama.cpp project. To use it you need to launch it via a tea pkgenv:

tea +github.com/ggerganov/llama.cpp convert.py path/to/your/model