You can deploy this model and start earning money today!

HachiML/
japanese-stablelm-alpha-7b-instruct-ja-qlora-2ep-v2

Name: japanese-stablelm-alpha-7b-instruct-ja-qlora-2ep-v2
Availability: InStock

Views

No views yet

JGLUE Score

I evaluated this model using the following JGLUE tasks. Here are the scores:

Task	stablelm-base-alpha-7b	This Model	stablelm-instruct-alpha-7b
JCOMMONSENSEQA(acc)	33.42	79.17	82.22
JNLI(acc)	43.34	47.82	52.05
MARC_JA(acc)	96.73	88.14	82.88
JSQUAD(exact_match)	70.62	29.85	63.26
Average	61.03	61.25	70.10

Note: Use v0.3 prompt template
The JGLUE scores were measured using the following script: Stability-AI/lm-evaluation-harness
The JGLUE scores of Model "stablelm-base-alpha-7b" and "stablelm-instruct-alpha-7b" were referenced from Github above.

The following bitsandbytes quantization config was used during training: