This is LFM2.5-1.2B-Instruct (abliterated) turned into a MoE. This was not made with a mergekit fork, it was made with a custom method to convert the dense model into a true MoE. This is an experiment but I fine tuned it with a custom made dataset to repair it. However I forgot I made that dataset for a reasoning model so this model will output reasoning lmao
