eoinf/

wikitext_llama

	Dataset Card for eoinf/wikitext_llama




	
	Original dataset

Original dataset: Salesforce/wikitext

Total Tokens: 142,916,608 Total Sequences: 139,567 Context Length: 1024 tokens Tokenizer: meta-llama/Llama-2-7b-hf Format: Each example contains a single field tokens with a list of 1024 token IDs

Each document was:

Tokenized using the meta-llama/Llama-2-7b-hf tokenizer Prefixed with a BOS (beginning of sequence) token… See the full description on the dataset page: https://huggingface.co/datasets/eoinf/wikitext_llama.