Views
No views yet
1from transformers import AutoModelForCausalLM, AutoTokenizer
2import torch
3
4model_id = "iamjry/ai-basic-law-ministral8b"
5tokenizer = AutoTokenizer.from_pretrained(model_id)
6model = AutoModelForCausalLM.from_pretrained(
7 model_id, torch_dtype=torch.float16, device_map="auto"
8)
9
10system_prompt = "你是一位熟悉台灣人工智慧基本法的法律助理，請根據法條內容精確回答問題。"
11question = "請列出人工智慧基本法第3條全文"
12
13messages = [{"role": "user", "content": f"{system_prompt}\n\n{question}"}]
14prompt = tokenizer.apply_chat_template(messages, tokenize=False, add_generation_prompt=True)
15inputs = tokenizer(prompt, return_tensors="pt").to(model.device)
16
17with torch.no_grad():
18 outputs = model.generate(**inputs, max_new_tokens=500, repetition_penalty=1.3, do_sample=False)
19
20generated = outputs[0][inputs["input_ids"].shape[1]:]
21print(tokenizer.decode(generated, skip_special_tokens=True))| Category | Description |
|---|---|
| Article Fulltext | Verbatim text of all 20 articles with topic anchors |
| Alias Recognition | 「基本法」「AI基本法」→ 人工智慧基本法 |
| Legislative Reasons | Background and rationale for each article |
| Taiwan Context | Anti-hallucination data to prevent confusion with Chinese laws |
| Publication Date | 民國115年（2026年）1月14日, 華總一義字第11500001671號令 |
你是一位熟悉台灣人工智慧基本法的法律助理，請根據法條內容精確回答問題。