You can deploy this model and start earning money today!

codingninja/
llama3-32kpa-focus-emb-init

Name: llama3-32kpa-focus-emb-init
Rating: 2.5 (7 reviews)

text-generation-inference

endpoints_compatible

Views

No views yet

Input, output embedding weights are possibly not tied -

Some weights of LlamaForCausalLM were not initialized from the model checkpoint at ./llama3-pa/llama3-32kpa-emb-init-weight-tied and are newly initialized: ['lm_head.weight']

used -

source_model.lm_head.weight.data = source_model.model.embed_tokens.weight.data
source_model.lm_head.weight = source_model.model.embed_tokens.weight
source_model.tie_weights()

codingninja/llama3-32kpa-focus-emb-init

Input, output embedding weights are possibly not tied -

used -

codingninja/
llama3-32kpa-focus-emb-init