Views
No views yet
hf 工具下載hf 工具進行下載(速度極快):1export HF_XET_HIGH_PERFORMANCE=1
2hf download Yvthyvq/cantonese-qwen3-8b-instruct --local-dir ./cantonese-qwen3-8b-instruct
3
4---
5
6## 🚀 快速開始 / Quick Start
7
8### 1. 安裝與環境變量配置
9```bash
10export HF_XET_HIGH_PERFORMANCE=1
11export HF_ENDPOINT=[https://hf-mirror.com](https://hf-mirror.com)
12
13### 2. Python 檔案推演 (使用 Transformers 載入)
14```python
15import torch
16from transformers import AutoModelForCausalLM, AutoTokenizer
17
18model_id = "Yvthyvq/cantonese-qwen3-8b-instruct"
19
20tokenizer = AutoTokenizer.from_pretrained(model_id)
21model = AutoModelForCausalLM.from_pretrained(
22 model_id,
23 torch_dtype=torch.bfloat16,
24 device_map="auto"
25)
26
27# 提示詞請盡量使用 Liujgoj 粵語拼寫或地道口語進行互動
28messages = [
29 {"role": "user", "content": "Neiq hour, neiq horyiq zouh dij mej?"} # 範例
30]
31
32prompt = tokenizer.apply_chat_template(messages, tokenize=False, add_generation_prompt=True)
33inputs = tokenizer([prompt], return_tensors="pt").to(model.device)
34
35outputs = model.generate(**inputs, max_new_tokens=512, temperature=0.7)
36print(tokenizer.decode(outputs[0], skip_special_tokens=True))