This modelcard aims to be a base template for new models. It has been generated using this raw template.
Model Details
⚠️ Important Technical Note
This model is based on weights that have already been quantized to 4-bit during the optimization process (via heretic-llm). It was then converted to the GGUF format.
Source: 4-bit quantized weights.
Quality: The effective quality corresponds to that of a 4-bit model at most, even if the GGUF quantization (e.g., Q8_0 or fp16) suggests higher precision.
Model Description
Developed by: [More Information Needed]
Funded by [optional]: [More Information Needed]
Shared by [optional]: [More Information Needed]
Model type: [More Information Needed]
Language(s) (NLP): [More Information Needed]
License: [More Information Needed]
Finetuned from model [optional]: [More Information Needed]
Model Sources [optional]
Repository: [More Information Needed]
Paper [optional]: [More Information Needed]
Demo [optional]: [More Information Needed]
Uses
Direct Use
[More Information Needed]
Downstream Use [optional]
[More Information Needed]
Out-of-Scope Use
[More Information Needed]
Bias, Risks, and Limitations
[More Information Needed]
Recommendations
Users (both direct and downstream) should be made aware of the risks, biases and limitations of the model. More information needed for further recommendations.
