Views
No views yet
<|bos|><|eos|><|tool_call|>, <|/tool_call|>, etc.)<|done|><|pad|>1from tokenizers import Tokenizer
2tok = Tokenizer.from_file("tokenizer.json")
3ids = tok.encode("def hello(): pass").idsNote: Will be retrained after agentic trace generation. This is v0 — trained on pretraining corpus only.