LLaMA-3.1-8B-AGNews-SFT
This model is a fine-tuned version of
meta-llama/Llama-3.1-8B on the ag_news dataset.
Model description
This model is a fine-tuned version of
meta-llama/Llama-3.1-8B on the ag_news dataset. The model is a transformer-based model that was trained on a large corpus of text data and fine-tuned on the ag_news_train_num dataset. The model is capable of performing text classification tasks and can be used to classify text into one of four categories: World, Sports, Business, and Sci/Tech.
Intended uses & limitations
How to use
You can use this model to classify text into one of four categories: World, Sports, Business, and Sci/Tech. To use the model, you can load it using the transformers library and pass the text you want to classify to the model. The model will return the predicted category for the text.
Limitations and bias
The model may not perform well on text that is outside the domain of the training data. The model may also exhibit bias in its predictions based on the biases present in the training data. It is important to be aware of these limitations when using the model and to evaluate its performance on your specific use case.
Training and evaluation data
Dataset
The model was fine-tuned on the ag_news_train_num dataset, which is a subset of the AG News dataset. The AG News dataset is a collection of news articles from the AG's corpus of news articles on the web. The ag_news_train_num dataset contains 120,000 news articles from the AG News dataset, with 30,000 articles in each of the four categories: World, Sports, Business, and Sci/Tech.
Data preprocessing
The data was preprocessed by tokenizing the text using the transformers library's tokenizer for the LLaMA-3.1-8B model. The text was tokenized into subword tokens, and the tokens were converted into input features for the model. The input features were then used to train the model on the classification task.
Training procedure
Training hyperparameters
The following hyperparameters were used during training:
- learning_rate: 2e-05
- train_batch_size: 4
- eval_batch_size: 8
- seed: 42
- distributed_type: multi-GPU
- num_devices: 8
- gradient_accumulation_steps: 8
- total_train_batch_size: 256
- total_eval_batch_size: 64
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
- lr_scheduler_type: cosine
- lr_scheduler_warmup_ratio: 0.03
- num_epochs: 1.0
Training results
| Class | Accuracy | Precision | Recall | F1 Score |
|---|
| World | 95.95% | 96.87% | 95.95% | 96.40% |
| Sports | 99.42% | 99.00% | 99.42% | 99.21% |
| Business | 91.53% | 93.95% | 91.53% | 92.72% |
| Sci/Tech | 94.84% | 91.99% | 94.84% | 93.39% |
| Overall (Macro Avg) | 95.43% | 95.45% | 95.43% | 95.43% |
Framework versions
- Transformers 4.45.2
- Pytorch 2.4.1+cu121
- Datasets 2.21.0
- Tokenizers 0.20.1
