Model Card for Model ID
Model Details
Model Description
This is the model card of a 🤗 transformers model that has been pushed on the Hub. This model card has been automatically generated.
- Developed by: [More Information Needed]
- Funded by [optional]: [More Information Needed]
- Shared by [optional]: [More Information Needed]
- Model type: [More Information Needed]
- Language(s) (NLP): [More Information Needed]
- License: [More Information Needed]
- Finetuned from model [optional]: [More Information Needed]
Model Sources [optional]
- Repository: [More Information Needed]
- Paper [optional]: [More Information Needed]
- Demo [optional]: [More Information Needed]
Uses
Direct Use
[More Information Needed]
How to Get Started with the Model
Use the code below to get started with the model.
[More Information Needed]
Training Details
Training Data
[More Information Needed]
Evaluation
hf-causal-experimental (pretrained=T3Q-LLM/T3Q-LLM2-sft1.0,use_accelerate=true,trust_remote_code=true), limit: None, provide_description: False, num_fewshot: 0, batch_size: 8
| Task | Version | Metric | Value | | Stderr |
|---|
| kobest_boolq | 0 | acc | 0.9338 | ± | 0.0066 |
| | macro_f1 | 0.9336 | ± | 0.0066 |
| kobest_copa | 0 | acc | 0.7670 | ± | 0.0134 |
| | macro_f1 | 0.7664 | ± | 0.0134 |
| kobest_hellaswag | 0 | acc | 0.5080 | ± | 0.0224 |
| | acc_norm | 0.5580 | ± | 0.0222 |
| | macro_f1 | 0.5053 | ± | 0.0223 |
| kobest_sentineg | 0 | acc | 0.6952 | ± | 0.0231 |
| | macro_f1 | 0.6699 | ± | 0.0245 |
