Merged and GPTQ quantized version of
rayliuca/TRagx-internlm2-7b
Note: I'm having some difficulties quantizing the models using GPTQ. Mistral and NeuralOmniBeagle's GPTQ models have significantly degraded output, while quantized TowerInstruct v0.2 was not working out right
While this quantized model for InternLM2 seems to work all right, the translation accuracy is not validated.