OpenCSG stands for Converged resources, Software refinement, and Generative LM. The 'C' represents Converged resources, indicating the integration and full utilization of hybrid resources. The 'S' stands for Software refinement, signifying software that is refined by large models. The 'G' represents Generative LM, which denotes widespread, inclusive, and democratized generative large models.
The vision of OpenCSG is to empower every industry, every company, and every individual to own their models. We adhere to the principles of openness and open source, making the large model software stack of OpenCSG available to the community. We welcome everyone to use, send feedback, and contribute collaboratively.
Model Description
csg-wukong-1B is a 1 billion-parameter small language model(SLM) pretrained on 1T tokens.
we will introduce more information about csg-wukong-1B.
Model Evaluation results
We submitted csg-wukong-1B on the open_llm_leaderboard, and
the results show our model ranked the 8th among the ~1.5B pretrained small language models.
