This LoRA model is trained based on the Wanxiao 2.1-1.3B model and the DiffSynth-Studio framework. Since the base model was trained at a resolution of 480P, it has certain limitations in clarity. To address this, we conducted additional training to improve its performance on high-resolution videos, avoiding issues such as visual artifacts, dimness, or image collapse. We recommend using this model in the following ways:
Direct generation of high-resolution short videos: Set the resolution to 1024 x 1024 and reduce the number of frames appropriately to avoid excessively long generation times.
Detail refinement for high-resolution videos: First generate a video at low resolution, perform super-resolution upscaling, then use this model for video-to-video generation to enhance fine details.
Model Performance
Anime Style
Prompt: Anime style, a cute anime girl with short black hair swaying in the wind, gently turning her head.
Prompt: An ancient mythological scene depicting a confrontation between a warrior and a dragon, set against a backdrop of steep cliffs. The warrior wears armor and holds a shining sword, while the dragon spreads its massive wings, flames building in its mouth.
1snapshot_download(2 model_id="DiffSynth-Studio/Wan2.1-1.3b-lora-highresfix-v1",3 local_dir="models/DiffSynth-Studio/Wan2.1-1.3b-lora-highresfix-v1",4 allow_file_pattern="*.safetensors"5)6model_manager = ModelManager(device="cpu")7model_manager.load_models(8[9"models/Wan-AI/Wan2.1-T2V-1.3B/diffusion_pytorch_model.safetensors",10"models/Wan-AI/Wan2.1-T2V-1.3B/models_t5_umt5-xxl-enc-bf16.pth",11"models/Wan-AI/Wan2.1-T2V-1.3B/Wan2.1_VAE.pth",12],13 torch_dtype=torch.bfloat16,14)15model_manager.load_lora("models/DiffSynth-Studio/Wan2.1-1.3b-lora-highresfix-v1/model.safetensors")16pipe = WanVideoPipeline.from_model_manager(model_manager, torch_dtype=torch.bfloat16, device="cuda")17pipe.enable_vram_management(num_persistent_param_in_dit=None)1819video = pipe(20 prompt="An ancient mythological scene depicting a confrontation between a warrior and a dragon, with steep cliffs in the background. The warrior wears armor and holds a shining sword, while the dragon spreads its enormous wings, flames building up in its mouth.",21 negative_prompt="Vivid colors, overexposure, static, blurry details, subtitles, style, artwork, painting, still image, overall gray tone, worst quality, low quality, JPEG compression artifacts, ugly, deformed, extra fingers, poorly drawn hands, poorly drawn face, malformed limbs, fused fingers, motionless frame, cluttered background, three legs, crowded background, walking backwards",22 num_inference_steps=50,23 seed=1, tiled=True,24 num_frames=33, height=1024, width=1024, sigma_shift=10,25)26save_video(video,"video.mp4", fps=15, quality=5)
