kaahila/

sugarcrm_130_documentation

The chunks in the files are diffrent splittet based on the tokenizer conained in the name of the file

	cl100k_base: 400 Tokens per chunk




	
	p50k_base: 200 Tokens per chunk