Views
No views yet
pip install torch numpy transformers datasets tiktoken wandb tqdmtransformers for huggingface transformersdatasets for huggingface datasets (preprocess OpenWebText test and validation bin)tiktoken for OpenAI's fast BPE codewandb for optional loggingtqdm for progress bars$ python inference.py