mirror of
https://github.com/ivabus/pantry
synced 2024-11-14 04:25:08 +03:00
f35308a401
convert to `bkpyvenv` closes #4721 closes #4722 closes #4723 |
||
---|---|---|
.. | ||
entrypoint.sh | ||
package.yml | ||
README.md |
getting started
$ pkgx +brewkit -- run llama.cpp
# ^^ default chat prompt with an appropriate hugging face model
If you want to run llama.cpp
with your own args pkgx llama.cpp $ARGS
is
your friend.
converting your own models
We provide a working convert.py
from the llama.cpp project. To use it you
need to launch it via a tea pkgenv:
pkgx +llama.cpp -- convert.py path/to/your/model
# ^^ the -- is necessary since `convert.py` is a not listed in the llama.cpp
# provides list