Views
No views yet
pip install -U git+https://github.com/huggingface/transformers bitsandbytes1quantization_config = BitsAndBytesConfig(
2 load_in_4bit=True,
3 bnb_4bit_quant_type="nf4",
4 bnb_4bit_use_double_quant=True,
5 bnb_4bit_compute_dtype=torch.bfloat16,
6)load_in_*bit.