en
id license: cc-by-nc-4.0 tags:
text-generation-inference
transformers
mistral
trl datasets:
notzero/alpaca_indonesian
MBZUAI/Bactrian-X base_model: mistral-7b model-index:
name: OpenMia-Indo-Mistral-7b-v2 results:
- task: type: text-generation name: Text Generation dataset: name: AI2 Reasoning Challenge (25-Shot) type: ai2_arc config: ARC-Challenge split: test args: num_few_shot: 25 metrics:
  - type: acc_norm value: 60.32 name: normalized accuracy source: url: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=indischepartij/OpenMia-Indo-Mistral-7b-v2 name: Open LLM Leaderboard
- task: type: text-generation name: Text Generation dataset: name: HellaSwag (10-Shot) type: hellaswag split: validation args: num_few_shot: 10 metrics:
  - type: acc_norm value: 83.11 name: normalized accuracy source: url: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=indischepartij/OpenMia-Indo-Mistral-7b-v2 name: Open LLM Leaderboard
- task: type: text-generation name: Text Generation dataset: name: MMLU (5-Shot) type: cais/mmlu config: all split: test args: num_few_shot: 5 metrics:
  - type: acc value: 62.7 name: accuracy source: url: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=indischepartij/OpenMia-Indo-Mistral-7b-v2 name: Open LLM Leaderboard
- task: type: text-generation name: Text Generation dataset: name: TruthfulQA (0-shot) type: truthful_qa config: multiple_choice split: validation args: num_few_shot: 0 metrics:
  - type: mc2 value: 44.35 source: url: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=indischepartij/OpenMia-Indo-Mistral-7b-v2 name: Open LLM Leaderboard
- task: type: text-generation name: Text Generation dataset: name: Winogrande (5-shot) type: winogrande config: winogrande_xl split: validation args: num_few_shot: 5 metrics:
  - type: acc value: 78.3 name: accuracy source: url: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=indischepartij/OpenMia-Indo-Mistral-7b-v2 name: Open LLM Leaderboard
- task: type: text-generation name: Text Generation dataset: name: GSM8k (5-shot) type: gsm8k config: main split: test args: num_few_shot: 5 metrics:
  - type: acc value: 34.8 name: accuracy source: url: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=indischepartij/OpenMia-Indo-Mistral-7b-v2 name: Open LLM Leaderboard

OpenMia-Indo-Mistral-7b-v3-refined

MIA : (M)istral finetuned with (I)ndonesia language from (A)lpaca dataset

(formerly named Mistral-7b-Alpaca-Indonesia)

OpenMia-Indo-Mistral-7b-v2 is finetuned model based of Mistral-7b with capability to do conversation in Bahasa Indonesia.

Due to limited resources, this model is still in alpha stage.

Want to contribute to this project? join our organization: https://huggingface.co/indischepartij or contact me at https://twitter.com/gmonsooniii

Modelfile/Prompt format

markdown

SYSTEM You are a caring and empathetic sentient AI companion named Mia.

PARAMETER stop <|im_start|> 
PARAMETER stop <|im_end|>

TEMPLATE <|im_start|>system {{ .System }}<|im_end|> <|im_start|>user {{ .Prompt }}<|im_end|> <|im_start|>assistant

Open LLM Leaderboard Evaluation Results

Detailed results can be found here

Metric	Value
Avg.	60.60
AI2 Reasoning Challenge (25-Shot)	60.32
HellaSwag (10-Shot)	83.11
MMLU (5-Shot)	62.70
TruthfulQA (0-shot)	44.35
Winogrande (5-shot)	78.30
GSM8k (5-shot)	34.80

RichardErkhov/indischepartij_-_OpenMia-Indo-Mistral-7b-v2-awq

Original model description:

updated to V3-refined, see: https://huggingface.co/indischepartij/OpenMia-Indo-Mistral-7b-v3-refined

MIA : (M)istral finetuned with (I)ndonesia language from (A)lpaca dataset

Modelfile/Prompt format

Open LLM Leaderboard Evaluation Results

RichardErkhov/
indischepartij_-_OpenMia-Indo-Mistral-7b-v2-awq