Deep Ignorance Model Suite - GPT-NeoX Formatted Checkpoints & Optimizer States

Note: This specific model is not in HuggingFace format. It is in GPT-NeoX format. GPT-NeoX format enables research into optimizer states and further training using the optimized NeoX library. Most users will want to use the models in HF format. The HF models can be found in the Deep Ignorance collection.

Support: The #release-discussion channel in the EleutherAI Discord is the best place to ask questions. Questions asked in other channels are less likely to be answered. The community section on HuggingFace is less actively monitored. Tag Kyle O'Brien in the EleutherAI Discord for faster response times.