Views
No views yet
| openPangu-Embedded-1B-V1.1 | |
|---|---|
| Architecture | Dense |
| Parameters (Non-Embedding) | 1B |
| Number of Layers | 26 |
| Hidden Dimension | 1536 |
| Attention Mechanism | GQA |
| Number of Attention Heads | 12 for Q, 6 for KV |
| Vocabulary Size | 153k |
| Context Length (Natively) | 32k |
| Training Tokens | 10T |
| 评测集 | 测评指标 | openPangu-Embedded-1B-V1 | openPangu-Embedded-1B-V1.1 |
|---|---|---|---|
| 通用能力 | |||
| MMLU | Acc | 60.72 | 65.08 |
| CMMLU | Acc | 51.99 | 55.65 |
| C-Eval | Acc | 60.98 | 63.02 |
| IF-Eval | Prompt Strict | 56.56 | 55.51 |
| CLUEWSC | Acc | 68.55 | 78.55 |
| 数学&推理 | |||
| GSM8K | Acc | 66.72 | 82.76 |
| MATH-500 | Acc | 52.00 | 81.83 |
| DROP | F1 | 50.31 | 52.82 |
| GPQA-Diamond | Pass@1 | 33.84 | 41.70 |
| 代码能力 | |||
| MBPP | Pass@1 | 54.09 | 59.31 |
| HumanEval | Pass@1 | 56.71 | 66.66 |
#!/usr/bin/env bash
ARCH=$(uname -m)
MODEL_PATH="${TARGET_FOLDER}/${MODEL_FOLDER_PATH}"
cd "$MODEL_PATH" || exit 1
if [ "$ARCH" = "arm64" ]; then
sha256sum checklist.chk
else
sha256sum -c checklist.chk
fitransformers 框架上进行推理的一个简单示例：运行前请修改 generate.py，添加模型路径。
1cd inference
2python generate.py