Views
No views yet
mlx-community/Huihui-Qwen3.5-9B-Claude-4.6-Opus-abliterated-4bit.
The original model works with mlx-vlm but had issues with mlx-swift-lm:| Issue | Fix |
|---|---|
| chat_template.jinja | Replaced with VLM-aware template handling image/video content arrays |
1let modelDir = URL(fileURLWithPath: "/path/to/model")
2let container = try await VLMModelFactory.shared.loadContainer(
3 from: modelDir,
4 using: LocalTokenizerLoader()
5)
6let session = ChatSession(container)
7let response = try await session.respond(
8 to: "Describe the image",
9 image: .url(URL(fileURLWithPath: "/path/to/image.jpg"))
10)mlx-community/Huihui-Qwen3.5-9B-Claude-4.6-Opus-abliterated-4bit), then replace the config files with the fixed versions from this repo.