Views
No views yet
| openPangu-Embedded-1B | |
|---|---|
| Architecture | Dense |
| Parameters (Non-Embedding) | 1B |
| Number of Layers | 26 |
| Hidden Dimension | 1536 |
| Attention Mechanism | GQA |
| Number of Attention Heads | 12 for Q, 6 for KV |
| Vocabulary Size | 153k |
| Context Length (Natively) | 32k |
| Training Tokens | 10T |
| 评测集 | 测评指标 | 快思考 |
|---|---|---|
| 通用能力 | ||
| MMLU | Acc | 60.72 |
| CMMLU | Acc | 51.99 |
| C-Eval | Acc | 60.98 |
| IF-Eval | Prompt Strict | 56.56 |
| CLUEWSC | Acc | 68.55 |
| 数学&推理 | ||
| GSM8K | Acc | 66.72 |
| MATH-500 | Acc | 52.00 |
| DROP | F1 | 50.31 |
| 代码能力 | ||
| MBPP | Pass@1 | 54.09 |
| HumanEval | Pass@1 | 56.71 |
#!/usr/bin/env bash
ARCH=$(uname -m)
MODEL_PATH="${TARGET_FOLDER}/${MODEL_FOLDER_PATH}"
cd "$MODEL_PATH" || exit 1
if [ "$ARCH" = "arm64" ]; then
sha256sum checklist.chk
else
sha256sum -c checklist.chk
fitransformers 框架上进行推理的一个简单示例：运行前请修改 generate.py，添加模型路径。
1cd inference
2python generate.py