This repository contains a few llamafiles built from our v0.10.5 release.

These llamafiles are pre-packaged with support for CPU, Metal GPUs on Mac and CUDA+Vulkan on linux and Windows. If you have a different GPU or OS, you can download the corresponding library in the Files and versions section and save it in your home directory for llamafile to automatically find it.

For more information about our project, check out our github repo. To learn how to use llamafiles, check our documentation!

NOTE: While the llamafile project is Apache 2.0-licensed, the licenses of models we bundle with it might differ. Use the table above for reference.