aamijar/
shortened-llm-Llama-2-7b-hf-taylor-n10-rm-19-blocks

Name: shortened-llm-Llama-2-7b-hf-taylor-n10-rm-19-blocks
Availability: InStock

like

0

text-generation-inference

endpoints_compatible

us

Views

No views yet

Depth Pruned Llama-2-7B-hf using https://github.com/Nota-NetsPresso/shortened-llm
13 Layers
layer indices removed [28, 27, 25, 29, 26, 24, 23, 21, 22, 20, 19, 18, 17, 14, 16, 13, 12, 15, 11]
2.9B Parameters
No Post-Training

aamijar/shortened-llm-Llama-2-7b-hf-taylor-n10-rm-19-blocks

aamijar/
shortened-llm-Llama-2-7b-hf-taylor-n10-rm-19-blocks