Welcome to Nervus Sapien lite, a lightweight prerelease of the yet coming Nervus Sapien 32b designed for powerful reasoning, agentic tasks, versatile developer use cases, and conversational chat.
This is NIT's best model yet. It is lightweight, yet extremely powerful in its own ways.
The model was trained on OpenAI's harmony response format (https://github.com/openai/harmony) as the model is based on GPT OSS 20b, the more lightweight variant of the GPT OSS series.
[!NOTE]
NIT stands for the Natarajan Intelligence Technologies Inc. Check out NatarajanAI, our AI chatbot based on Danny Avila's LibreChat.
Highlights
Permissive Apache 2.0 license: Build freely without copyleft restrictions or patent risk—ideal for experimentation, customization, and commercial deployment.
Configurable reasoning effort: Easily adjust the reasoning effort (low, medium, high) based on your specific use case and latency needs.
Full chain-of-thought: Gain complete access to the model’s reasoning process, facilitating easier debugging and increased trust in outputs. It’s not intended to be shown to end users.
Fine-tunable: Fully customize models to your specific use case through parameter fine-tuning.
Agentic capabilities: Use the model's native capabilities for function calling, [web browsing]
MXFP4 quantization: The model was fine-tuned with MXFP4 quantization of the MoE weights, making the model run on 16 GB VRAM or lower if unsloth and quantanization is used. All evals were performed with the same MXFP4 quantization.
Inference examples
Transformers
You can use Nervus Sapien Lite with Transformers. If you use the Transformers chat template, it will automatically apply the harmony response format. If you use model.generate directly, you need to apply the harmony format manually using the chat template or use our openai-harmony package.
To get started, install the necessary dependencies to setup your environment:
pip install -U transformers kernels torch
Once, setup you can proceed to run the model by running the snippet below:
