KoboldAI_-_fairseq-dense-1.3B-8bits – AI Model by RichardErkhov | AlphaNeural AI

You can deploy this model and start earning money today!

RichardErkhov/
KoboldAI_-_fairseq-dense-1.3B-8bits

like

0

text-generation

autotrain_compatible

endpoints_compatible

Views

No views yet

Quantization made by Richard Erkhov.

Request more models

fairseq-dense-1.3B - bnb 8bits

Original model description:

language: en

This is a Hugging Face transformers-compatible conversion of the original dense 1.3B-parameter model from the paper "Efficient Large Scale Language Modeling with Mixtures of Experts" from Artetxe et al. Please refer to the original model card, which can be found at https://github.com/facebookresearch/fairseq/blob/main/examples/moe_lm/model_card.md.

Open LLM Leaderboard Evaluation Results

Detailed results can be found here

Metric	Value
Avg.	31.66
ARC (25-shot)	31.14
HellaSwag (10-shot)	58.39
MMLU (5-shot)	24.98
TruthfulQA (0-shot)	37.43
Winogrande (5-shot)	59.04
GSM8K (5-shot)	0.0
DROP (3-shot)	10.6