Beta
Explore
Marketplace
Neural Labs
Chat
Wallet
Docs
blockchainlabs_tinyllama_fusion_LHK_yunkong_v2 – AI Model by alnrg2arg | AlphaNeural AI
You can deploy this model and start earning money today!
alnrg2arg
/
blockchainlabs_tinyllama_fusion_LHK_yunkong_v2
like
0
transformers
safetensors
llama
text-generation
conversational
mit
autotrain_compatible
text-generation-inference
endpoints_compatible
us
Views
No views yet
Model card
Files and Versions
Community
API
Deploy
This model is based on the fusion strategy offered by Fanqi Wan(
https://github.com/fanqiwan/FuseLLM
).
Three models are fused together. 10epochs
Base model: TinyLlama/TinyLlama-1.1B-Chat-v1.0
Blending model 1: HanNayeoniee/LHK_DPO_v1
Blending model 2: yunconglong/Truthful_DPO_TomGrc_FusionNet_7Bx2_MoE_13B
This model will be optimized by Laser and DPO later.
This project is to make the on-device sLM. We are doing experiments on the models.
