You can deploy this model and start earning money today!

Abishakm1507/
Englist_To_Tamil_Translator

Name: Englist_To_Tamil_Translator
Availability: InStock

transformers

Abishakm1507/English_to_Tamil_Colloquial

TinyLlama/TinyLlama-1.1B-Chat-v1.0

finetune

cc-by-nc-4.0

endpoints_compatible

Views

No views yet

English-to-Tamil Translator

Model Overview

This project implements an English-to-Tamil translation model using the TinyLlama-1.1B-Chat-v1.0 model. It leverages Unsloth for efficient fine-tuning and PEFT (Parameter-Efficient Fine-Tuning) with LoRA (Low-Rank Adaptation). The model is designed to translate English text into Tamil with high efficiency and accuracy.

Dependencies

Before running the notebook, ensure you have the following dependencies installed:

pip install torch==2.5.1
pip install transformers datasets accelerate bitsandbytes
pip install unsloth
pip install peft

Model Initialization

The model is initialized using Unsloth's FastLanguageModel:

python

from unsloth import FastLanguageModel
MODEL_NAME = "TinyLlama/TinyLlama-1.1B-Chat-v1.0"
MAX_LENGTH = 128

model, tokenizer = FastLanguageModel.from_pretrained(
    model_name=MODEL_NAME,
    max_seq_length=MAX_LENGTH,
    dtype=torch.bfloat16,
    load_in_4bit=True,
    trust_remote_code=True,
    use_cache=False
)

Training Details

The model is fine-tuned using LoRA, which optimizes efficiency while retaining translation quality.
Training is performed using the Hugging Face Trainer with datasets loaded via datasets.Dataset.

Usage

To translate an English sentence to Tamil:

python

text = "Hello, how are you?"
inputs = tokenizer(text, return_tensors="pt")
outputs = model.generate(**inputs)
tamil_translation = tokenizer.decode(outputs[0], skip_special_tokens=True)
print(tamil_translation)

GPU Support

The notebook checks for GPU availability and leverages CUDA if available:

python

import torch
print(f"CUDA Available: {torch.cuda.is_available()}")
if torch.cuda.is_available():
    print(f"GPU Device: {torch.cuda.get_device_name(0)}")

License

This project is open-source and follows the licensing terms of the TinyLlama model and Hugging Face Transformers.

Abishakm1507/Englist_To_Tamil_Translator

English-to-Tamil Translator

Model Overview

Dependencies

Model Initialization

Training Details

Usage

GPU Support

License

Abishakm1507/
Englist_To_Tamil_Translator