PLaMo 2.1 2B is a model developed by Preferred Elements Inc., created by pruning parameters from a 8B-parameter model pre-trained on English and Japanese datasets.

PLaMo 2.1 2B is released under PLaMo community license. Please check the following license and agree to this before downloading.

NOTE: This model has NOT been instruction-tuned for chat dialog or other downstream tasks.

Please check the PLaMo community license and contact us via the following form to use commercial purpose.

numpy>=1.26.4
numba>=0.60.0
torch<=2.5.1
transformers>=4.44.2,<=4.57.1
mamba_ssm>=2.2.2,<=2.2.4
causal_conv1d>=1.4.0

PLaMo 2 tokenizer is optimized by numba, which is JIT compiler for numerical functions. The tokenizer is trained on a subset of the datasets for model pre-training.

PLaMo 2.1 2B is a new technology that carries risks with use. Testing conducted to date has been in English and Japanese, and has not covered, nor could it cover all scenarios. For these reasons, as with all LLMs, PLaMo 2.1 2B’s potential outputs cannot be predicted in advance, and the model may in some instances produce inaccurate, biased or other objectionable responses to user prompts. Therefore, before deploying any applications of PLaMo 2.1 2B, developers should perform safety testing and tuning tailored to their specific applications of the model.

This model is trained under the project, “Research and Development Project of the Enhanced Infrastructures for Post 5G Information and Communication System” (JPNP 20017), subsidized by the New Energy and Industrial Technology Development Organization (NEDO).