Beta
Explore
Marketplace
Neural Labs
Chat
Wallet
Docs
TinyLlama-1.1B-orca-gpt4 – AI Model by acalatrava | AlphaNeural AI
You can deploy this model and start earning money today!
acalatrava
/
TinyLlama-1.1B-orca-gpt4
like
0
transformers
pytorch
llama
text-generation
en
cerebras/SlimPajama-627B
bigcode/starcoderdata
sam-mosaic/orca-gpt4-chatml
apache-2.0
autotrain_compatible
text-generation-inference
endpoints_compatible
us
Views
No views yet
Model card
Files and Versions
Community
API
Deploy
TinyLlama-1.1B
Finetuned with ORCA-GPT4 (chatml format)
This is a fine-tuned version of
TinyLlama-1.1B-intermediate-step-240k-503b
using the
sam-mosaic/orca-gpt4-chatml
dataset.
Training
Method
: QLORA
Quantization
: fp16
Time
: 20h on a RTX 4090 (from runpod.io)
Cost
: About $15
Based on
:
https://colab.research.google.com/drive/1Zmaceu65d7w4Tcd-cfnZRb6k_Tcv2b8g
