Views
No views yet
qwen_chemistry_merged-q4_k_m.gguf - Quantized for efficient inference with llama.cpp1# Download the GGUF file
2huggingface-cli download Kylan12/qwen-chemistry qwen_chemistry_merged-q4_k_m.gguf
3
4# Use with llama.cpp
5./llama.cpp/build/bin/llama-cli -m qwen_chemistry_merged-q4_k_m.gguf -p "Your prompt here"1from transformers import AutoModelForCausalLM, AutoTokenizer
2
3model = AutoModelForCausalLM.from_pretrained("Kylan12/qwen-chemistry")
4tokenizer = AutoTokenizer.from_pretrained("Kylan12/qwen-chemistry")
5
6prompt = "What is the IUPAC name for..."
7inputs = tokenizer(prompt, return_tensors="pt")
8outputs = model.generate(**inputs, max_length=200)
9print(tokenizer.decode(outputs[0]))1@misc{qwen_chemistry,
2 author = {Your Name},
3 title = {qwen-chemistry},
4 year = {2025},
5 publisher = {HuggingFace},
6 url = {https://huggingface.co/Kylan12/qwen-chemistry}
7}