You can deploy this model and start earning money today!

AventIQ-AI/
Multilingual_Text_Translator

Views

No views yet

🌐 T5-Based Multilingual Text Translator

This repository presents a fine-tuned T5-small model for multilingual text translation across English, French, German, Italian, and Portuguese. It includes quantization for efficient inference and speech synthesis support for accessibility.

📝 Problem Statement

The goal is to translate text between English and multiple European languages using a transformer-based model. Instead of using black-box APIs, this project fine-tunes the T5 model on parallel multilingual corpora, enabling offline translation and potential customization.

📊 Dataset

Source: Custom parallel corpus (.txt files) with one-to-one sentence alignments.
Languages Supported:
- English
- French
- German
- Italian
- Portuguese
Structure:
- Each language has a corresponding .txt file.
- Lines are aligned by index to form translation pairs.

Example Input Format:

Source: translate English to French: I am a student.
Target: Je suis un étudiant.

🧠 Model Details

Architecture: T5-small
Tokenizer: T5Tokenizer
Model: T5ForConditionalGeneration
Task Type: Sequence-to-Sequence Translation (Supervised Fine-tuning)

🔧 Installation

pip install transformers datasets torch gtts

🚀 Loading the Model

python

from transformers import T5ForConditionalGeneration, T5Tokenizer
import torch

# Load quantized model (float16)
model = T5ForConditionalGeneration.from_pretrained("quantized_model", torch_dtype=torch.float16)
tokenizer = T5Tokenizer.from_pretrained("quantized_model")

# Translation example
source = "translate English to German: How are you?"
inputs = tokenizer(source, return_tensors="pt", padding=True, truncation=True)

with torch.no_grad():
    outputs = model.generate(**inputs)

print("Translated:", tokenizer.decode(outputs[0], skip_special_tokens=True))

📈 Performance Metrics

As this project is based on a single-epoch fine-tuning, performance metrics are not explicitly computed. For a production-level system, BLEU or ROUGE scores should be evaluated.

🏋️ Fine-Tuning Details

📚 Dataset Preparation

A total of 5 text files (english.txt, french.txt, etc.)
Each sentence aligned by index for parallel translation.

🔧 Training Configuration

Epochs: 1
Batch size: 4
Max sequence length: 128
Model base: t5-small
Framework: Hugging Face Transformers + PyTorch
Evaluation strategy: 10% test split

🔄 Quantization

Post-training quantization was performed using .half() precision (FP16) to reduce model size and improve inference speed.