Views
No views yet
| File | Description |
|---|---|
config.json | Model architecture and configuration settings. |
pytorch_model.bin or model.safetensors | Trained model weights. |
tokenizer.json or tokenizer.model | Tokenization rules for Yoruba sentences. |
tokenizer_config.json | Tokenizer settings and special rules. |
special_tokens_map.json | Maps special tokens (e.g., <pad>, <eos>). |
1from transformers import AutoTokenizer, AutoModelForSeq2SeqLM
2
3# Load the fine-tuned Yoruba parser
4model_name_or_path = "YOUR-HF-USERNAME/yoruba-constituency-parser"
5tokenizer = AutoTokenizer.from_pretrained(model_name_or_path)
6model = AutoModelForSeq2SeqLM.from_pretrained(model_name_or_path)
7
8# Parse a sample Yoruba sentence
9sentence = "Mo ra aso tuntun"
10inputs = tokenizer(sentence, return_tensors="pt")
11outputs = model.generate(**inputs)
12parsed_tree = tokenizer.decode(outputs[0], skip_special_tokens=True)
13
14print(parsed_tree)
15## Authors
16
17Victoria A. Akindele
18Department of Linguistics, University of Ibadan
19
20Dr. Gerald Nweya
21Department of Linguistics, University of Ibadan (Project Supervisor)
22
23
24