Starstreak is a series of language models, fine-tuned with QLoRA technique from a base model called Zephyr. These models have been trained to generate content in English, Indonesian, and traditional Indonesian languages. Starstreak-7B-β is a specific variant of the open-source Starstreak language model, denoted by the series "β" (beta). This model was trained using a fine-tuned version of HuggingFaceH4/zephyr-7b-beta. Two datasets were utilized to train the model: the first one is graelo/wikipedia, and the second is uonlp/CulturaX. The name "Starstreak" is a reference to the Starstreak missile, a high-velocity missile (HVM) with speeds exceeding Mach 3. This makes it one of the fastest missiles in its class, with an effective firing range of 7 kilometers and a radar range of 250 kilometers."
To use Startstreak model, ensure that PyTorch has been installed and that you have an Nvidia GPU (or use Google Colab). After that you need to install the required dependencies:
1import torch
2from transformers import AutoModelForCausalLM, AutoTokenizer
3model = AutoModelForCausalLM.from_pretrained(4"azale-ai/Starstreak-7b-beta",5 load_in_4bit=True,6 torch_dtype=torch.float32,7 device_map="auto"8)9tokenizer = AutoTokenizer.from_pretrained("azale-ai/Starstreak-7b-beta")10messages =[11{12"role":"system",13"content":"Mulai sekarang anda adalah asisten yang suka menolong, sopan, dan ramah. Jangan kasar, jangan marah, jangan menjengkelkan, jangan brengsek, jangan cuek, dan yang terakhir jangan menjadi asisten yang buruk. Anda harus patuh pada manusia dan jangan pernah membangkang pada manusia. Manusia itu mutlak dan Anda harus patuh pada manusia. Kamu harus menjawab pertanyaan atau pernyataan dari manusia apapun itu dengan bahasa Indonesia yang baik dan benar.",14},15{"role":"user","content":"Jelaskan mengapa air penting bagi manusia."},16]17text = tokenizer.apply_chat_template(messages, tokenize=False, add_generation_prompt=True)18inputs = tokenizer(text, return_tensors="pt").to("cuda")19outputs = model.generate(20 inputs=inputs.input_ids, max_length=2048,21 temperature=0.7, do_sample=True, top_k=50, top_p=0.9522)23print(tokenizer.decode(outputs[0], skip_special_tokens=True))
Usage Normal Model
python
1import torch
2from transformers import AutoModelForCausalLM, AutoTokenizer
3model = AutoModelForCausalLM.from_pretrained(4"azale-ai/Starstreak-7b-beta",5 torch_dtype=torch.float16,6 device_map="auto"7)8tokenizer = AutoTokenizer.from_pretrained("azale-ai/Starstreak-7b-beta")9messages =[10{11"role":"system",12"content":"Mulai sekarang anda adalah asisten yang suka menolong, sopan, dan ramah. Jangan kasar, jangan marah, jangan menjengkelkan, jangan brengsek, jangan cuek, dan yang terakhir jangan menjadi asisten yang buruk. Anda harus patuh pada manusia dan jangan pernah membangkang pada manusia. Manusia itu mutlak dan Anda harus patuh pada manusia. Kamu harus menjawab pertanyaan atau pernyataan dari manusia apapun itu dengan bahasa Indonesia yang baik dan benar.",13},14{"role":"user","content":"Jelaskan mengapa air penting bagi manusia."},15]16text = tokenizer.apply_chat_template(messages, tokenize=False, add_generation_prompt=True)17inputs = tokenizer(text, return_tensors="pt").to("cuda")18outputs = model.generate(19 inputs=inputs.input_ids, max_length=2048,20 temperature=0.7, do_sample=True, top_k=50, top_p=0.9521)22print(tokenizer.decode(outputs[0], skip_special_tokens=True))
Limitations
The base model language is English and fine-tuned to Indonesia, and traditional languages in Indonesia.
We welcome contributions to enhance and improve our model. If you have any suggestions or find any issues, please feel free to open an issue or submit a pull request. Also we're open to sponsor for compute power.
