King-Cane/Astral-Noctra-12B-Q6_K-GGUF
This model was converted to GGUF format from
Vortex5/Astral-Noctra-12B using llama.cpp via the ggml.ai's
GGUF-my-repo space.
Refer to the
original model card for more details on the model.
Ollama Template issue!!! (steps are to be followed after installation of model using ollama run(/pull) hf.co/King-Cane/Astral-Noctra-12B-Q6_K-GGUF:Q6_K)
You need to go to your ollama directory/manifests/hf.co/King-Cane/Astral-Noctra-12b-Q6_K-GGUF
then open the Q6_K file in notepad or any other text editor of your choice, and paste in this:
{"schemaVersion":2,"mediaType":"application/vnd.docker.distribution.manifest.v2+json","config":{"mediaType":"application/vnd.docker.container.image.v1+json","digest":"sha256:c9e879d72e1b3cf632a05ed299e810f02f97f9c30e80d86b8fd1847685b6bbed","size":552},"layers":[{"mediaType":"application/vnd.ollama.image.model","digest":"sha256:297a20a336604b3dda02fb4f4c34ddc588f651ea0dab03be3b5711f4517abd0b","size":10056210112},{"mediaType":"application/vnd.ollama.image.template","digest":"sha256:62fbfd9ed093d6e5ac83190c86eec5369317919f4b149598d2dbb38900e9faef","size":182}]}
Now go to your ollama directory/blobs and download sha256:62fbfd9ed093d6e5ac83190c86eec5369317919f4b149598d2dbb38900e9faef into it, no folder just like all the other sha256 files there.
bam! now its as simple as ollama run hf.co/King-Cane/Astral-Noctra-12B-Q6_K-GGUF