Beta
Explore
Marketplace
Neural Labs
Chat
Wallet
Docs
epe-1p-smollm-1p7b-100B-20n-2048sl-960gbsz-no_bce-refl_end_doc – AI Model by Raghav-Singhal | AlphaNeural AI
You can deploy this model and start earning money today!
Raghav-Singhal
/
epe-1p-smollm-1p7b-100B-20n-2048sl-960gbsz-no_bce-refl_end_doc
like
0
transformers
safetensors
llama
text-generation
causal-lm
bfloat16
conversational
text-generation-inference
endpoints_compatible
us
Views
No views yet
Model card
Files and Versions
Community
API
Deploy
epe-1p-smollm-1p7b-100B-20n-2048sl-960gbsz-no_bce-refl_end_doc
Converted Hugging Face base checkpoint from the Model Raising pretraining run.
Details
Architecture:
LlamaForCausalLM
Base model size:
1.7B
Precision on disk:
bfloat16
Source Megatron checkpoint iteration:
50863
Model kind:
epe
Config vocab size:
49280
Tokenizer
Use the bundled tokenizer from this repository.
This EPE checkpoint uses the extended SmolLM2 tokenizer with
<assistant>
and 35
<charter_X.Y>
tokens. Two named chat templates are available:
Name
Assistant turn start
default
`<
epe
`<
