This model, vital-ai/watt-tool-70B-awq, is a quantized version of the base model watt-ai/watt-tool-70B. The quantization process was performed to reduce the model size and improve inference speed while maintaining high performance.

Base Model: watt-ai/watt-tool-70B

Quantization Method: 4-bit AWQ