This repository contains the full suite of GGUF quantizations for
microsoft/DialoGPT-medium.
DialoGPT is a large-scale pretrained dialogue response generation model. This version has been converted to GGUF format for use with llama.cpp and other compatible executors like LM Studio or GPT4All.
1./llama-cli -m DialoGPT-medium.Q4_K_M.gguf \
2 -p "User: What is the secret to a happy life?\nBot:" \
3 -n 128