Model built by @RubielLabarta using SLERP merge method. The model is release for research purposes only, commercial use is not allowed.
The LogoS is a model to experiment with the MoE method, which could significantly increase the performance of the original model. The model has 12.9B parameters.
