Beta
Explore
Marketplace
Neural Labs
Playground
Wallet
Docs
goliath-120b-Instruct-FP8-Dynamic – AI Model by Infermatic | AlphaNeural AI
You can deploy this model and start earning money today!
Infermatic
/
goliath-120b-Instruct-FP8-Dynamic
like
0
safetensors
llama
merge
conversational
en
llama2
fp8
us
Views
No views yet
Model card
Files and Versions
Community
API
Deploy
This quant was made for
infermatic.ai
Dynamic FP8 quant of
goliath-120b-Instruct-FP8-Dynamic
made with AutoFP8.
Goliath 120B
An auto-regressive causal LM created by combining 2x finetuned
Llama-2 70B
into one.
Prompting Format
Both Vicuna and Alpaca will work, but due the initial and final layers belonging primarily to Xwin, I expect Vicuna to work the best.
