Views
No views yet
trust_remote_code.1from transformers import AutoTokenizer, AutoModelForCausalLM
2
3tok = AutoTokenizer.from_pretrained("ljt019/nanochat-d40", trust_remote_code=True)
4model = AutoModelForCausalLM.from_pretrained("ljt019/nanochat-d40", trust_remote_code=True)
5
6inputs = tok("Hello!", return_tensors="pt")
7out = model.generate(**inputs, max_new_tokens=128, do_sample=True, temperature=0.6, top_k=50)
8print(tok.decode(out[0].tolist()))chatsft_checkpoints/d40/model_000681.pt.tokenizer.pkl (tiktoken encoding).