Qwen2VL-Flux was released a while ago. It comes with a standalone ControlNet model that works with Flux Dev. Fully compatible with ComfyUI.
I works well with Depth and Canny and kinda works with Tile and Realistic Lineart. You can also combine Depth and Canny.
Usually works well with strength 0.6-0.8 depending on the image. You might need to run Flux at FP8 to avoid OOM.
There's a sample workflow in this repo that you can try on ComfyUI.
The original project can be found here:
All credit belongs to the original creator of the model Pengqi Lu.
