RichardErkhov/

Ba2han_-_Tinypus-1.5B-awq

• Model creator: https://huggingface.co/Ba2han/
• Original model: https://huggingface.co/Ba2han/Tinypus-1.5B/

Original model description:

• garage-bAInd/Open-Platypus pipeline_tag: text-generation

• It's smarter (I think?)
• It sometimes throws "### Instruction:" line. This could be due to the platypus dataset, or the fact that I know jackshit about programming. You can add it to "custom stopping strings" in oobaboga.
• It may be possible to train very specialized mini experts and merge them???
  Template
  Same with TinyLlama/TinyLlama-1.1B-Chat-v1.0

• sources:
  • model: E://text-generation-webui//models//TinyLlama
    layer_range: [0, 12]
• sources:
  • model: E://text-generation-webui//models//TinyLlama
    layer_range: [4, 22]