Commit graph

3 commits

Author SHA1 Message Date
Max Howell
a5a1bd7b12
Use recommended model 2023-10-26 14:29:00 -04:00
Max Howell
a40a0d8fc8
fix llama.cpp model download 2023-10-26 08:13:43 -04:00
James Reynolds
2b06942c62
GitHub.com/ggerganov/llama.cpp update (#3696)
* llama.cpp, github version instead of hardcoded version
* llama.cpp, check if model is specified, if yes, run it, if not, then download model
* Use entrypoint for custom llama.cpp invocation
* `llama.cpp` is just raw executable. This I think is our new pattern.
* To run chat use the entrypoint: `pkgx +brewkit -- run llama.cpp`

Co-authored-by: James Reynolds <magnsuviri@me.com>
Co-authored-by: Max Howell <mxcl@me.com>
2023-10-26 07:24:04 -04:00