You can deploy this model and start earning money today!

kerasformers/
janus_pro_1b

Name: janus_pro_1b
Availability: InStock

deepseek-ai/Janus-Pro-1B

finetune

mit

Views

No views yet

See our collection for all versions of Janus-Pro.

Run Janus-Pro with Keras 3: JAX, PyTorch, or TensorFlow

GitHub

zeromodels/janus_pro_1b

Paper: Janus-Pro: Unified Multimodal Understanding and Generation with Data and Model Scaling (arXiv:2501.17811) · HF Papers

Janus-Pro is a multimodal model (SigLIP tower + GELU aligner + Llama decoder). This ZeroModels port covers the understanding path only (image + text → text). Multi-image conversations are supported; VQ image generation is not ported.

For more details on the model, please go to the upstream model card.

Pure-Keras 3 conversion of deepseek-ai/Janus-Pro-1B for zeromodels. One implementation runs unmodified on TensorFlow / Torch / JAX.

This is a vision-language checkpoint (JanusConditionalGenerate, 1B).

✨ Quick start

python

import os
os.environ["KERAS_BACKEND"] = "torch"  # or "jax" / "tensorflow"

from PIL import Image
from zeromodels.models.janus import JanusConditionalGenerate, JanusProcessor

model = JanusConditionalGenerate.from_weights("zeromodels/janus_pro_1b")
processor = JanusProcessor.from_weights("zeromodels/janus_pro_1b")

image = Image.open("your_image.jpg")
inputs = processor(
    conversation=[
        {
            "role": "user",
            "content": [
                {"type": "image", "image": image},
                {"type": "text", "text": "Describe this image in one sentence."},
            ],
        }
    ]
)
outputs = model.generate(**inputs, max_new_tokens=64)
print(processor.decode(outputs[0]))

Load any Janus-Pro variant the same way with from_weights("zeromodels/<variant>"):

Variant	Hub
`janus_pro_1b`	`zeromodels/janus_pro_1b`
`janus_pro_7b`	`zeromodels/janus_pro_7b`

Tips

Set KERAS_BACKEND before importing Keras / zeromodels.
Prefer JanusProcessor.from_weights(...) so image size and tokenizer match.
Add multiple {"type": "image", ...} items for multi-image chats.
See Janus-Pro docs and Loading Weights.
Community / upstream safetensors still work via the hf: prefix, e.g. JanusConditionalGenerate.from_weights("hf:deepseek-ai/Janus-Pro-1B").

Special Thanks

A huge thank you to the DeepSeek Janus-Pro authors for creating and releasing these models.

License: MIT.

kerasformers/janus_pro_1b