The Rashik24/Mistral-Instruct-Bangla model is a language model specifically tailored for the Bengali language. Based on the Mistralai/Mistral-7B-Instruct-v0.2 base model, it has been fine-tuned using the iamshnoo/alpaca-cleaned-bengali dataset. This model is designed to understand and generate Bengali text, making it a valuable tool for a variety of natural language processing tasks in the Bengali language context.
The Mistral-Instruct-Bangla model is intended for a range of applications where understanding and generating Bengali text is crucial. This includes but is not limited to machine translation, content creation, sentiment analysis, and language understanding tasks in Bengali. The model is suited for both academic researchers and industry practitioners who are working on Bengali language processing.
This model can be directly used for generating Bengali text, understanding Bengali context in conversations, and translating between Bengali and other languages. It is designed to be straightforward to implement in various software environments, requiring minimal additional setup for direct use cases.
To start using the Rashik24/Mistral-Instruct-Bangla model, you can use the following code as a basic guide. This will help you integrate the model into your application or research project.
1from transformers import AutoModelForCausalLM, AutoTokenizer
2import torch
3from peft import PeftModel, PeftConfig
4from transformers import AutoModelForCausalLM
5
6
7def load_model(model_name):
8 tokenizer = AutoTokenizer.from_pretrained("mistralai/Mistral-7B-Instruct-v0.2", trust_remote_code=True)
9 tokenizer.pad_token = tokenizer.eos_token
10 tokenizer.padding_side = "right"
11 config = PeftConfig.from_pretrained("Rashik24/Mistral-Instruct-Bangla")
12 model = AutoModelForCausalLM.from_pretrained("mistralai/Mistral-7B-Instruct-v0.2").to("cuda")
13 model = PeftModel.from_pretrained(model, "Rashik24/Mistral-Instruct-Bangla").to("cuda")
14 model.eval()
15 return model, tokenizer
16
17def generate_text(prompt, model, tokenizer):
18 inputs = tokenizer(prompt, return_tensors="pt").to("cuda")
19 with torch.no_grad():
20 generated_code = tokenizer.decode(model.generate(**inputs, max_new_tokens=256, pad_token_id=2)[0], skip_special_tokens=True)
21 print(generated_code)
22 return generated_code
23
24#Load the model
25model_name = 'Rashik24/Mistral-Instruct-Bangla'
26model, tokenizer = load_model(model_name)
27
28prompt = "একটি গ্রামের বর্ণনা করুন।"
29generated_text = generate_text(prompt, model, tokenizer)
The model has been trained on the 'iamshnoo/alpaca-cleaned-bengali' dataset.
For more details on the training data and methodology, refer to the dataset card linked here:
https://huggingface.co/datasets/iamshnoo/alpaca-cleaned-bengali
