Views
No views yet
4bit refers to quantifying the LLM part to 4 bits.LM means that it contains only the language model part.tllm.server --model_path $MODEL_PATH --hostname localhost --is_local --client_size 1$MODEL_PATH like wnma3mz/Janus-Pro-1B-4bit