KnutJaegersberg/

SUS-Chat-72B-4bit

Prompt Example:

### Human: 
Explain how AGI and collective intelligence are logically connected. 

### Assistant: 

Quantization settings:

{'load_in_4bit': True, 'bnb_4bit_compute_dtype': torch.bfloat16, 'bnb_4bit_quant_type': 'nf4', 'bnb_4bit_use_double_quant': True}