You can deploy this model and start earning money today!

IntelligentEstate/
MediMesh-Instruct-3B-Q_8-GGUF

Name: MediMesh-Instruct-3B-Q_8-GGUF
Availability: InStock

meditsolutions/MedIT-Mesh-3B-Instruct

Views

No views yet

IntelligentEstate/MedIT-Mesh-3B-Instruct-Q8_0-GGUF Model for swar/edge use Multi check Quant training for the most Ideal and coherent model

This model was converted to GGUF format from meditsolutions/MedIT-Mesh-3B-Instruct using llama.cpp Refer to the original model card for more details on the model.

Use with llama.cpp

Install llama.cpp through brew (works on Mac and Linux)

bash

brew install llama.cpp

Invoke the llama.cpp server or the CLI.

CLI:

llama-cli --hf-repo IntelligentEstate/MedIT-Mesh-3B-Instruct-Q8_0-GGUF --hf-file medit-mesh-3b-instruct-q8_0.gguf -p "The meaning to life and the universe is"

IntelligentEstate/MediMesh-Instruct-3B-Q_8-GGUF

IntelligentEstate/MedIT-Mesh-3B-Instruct-Q8_0-GGUF Model for swar/edge use Multi check Quant training for the most Ideal and coherent model

Use with llama.cpp

CLI:

IntelligentEstate/
MediMesh-Instruct-3B-Q_8-GGUF