Quantization made by Richard Erkhov.
This model is
randomly initialized, using the config from
meta-llama/Llama-2-7b-chat-hf but with the following modifications:
1{
2 "hidden_size": 8,
3 "intermediate_size": 32,
4 "num_attention_heads": 2,
5 "num_hidden_layers": 3,
6 "num_key_value_heads": 2,
7}
8