Specialized LoRA adapters for the WAN (Wanniwatch) v2.2 video generation model, providing enhanced camera control, lighting effects, quality improvements, and character actions for text-to-video and image-to-video generation.
Model Description
This repository contains 9 specialized LoRA adapters designed to enhance WAN v2.2 video generation capabilities. These adapters provide fine-grained control over camera movements, lighting conditions, facial animation, and overall video quality without requiring retraining of the base model.
Key Capabilities
Camera Control: 5 specialized camera movement LoRAs (rotation, drone shots, arc shots, aerial perspectives, earth zoom-out)
Lighting Enhancement: Volumetric lighting effects for cinematic quality
Quality Improvement: Realism boost and upscaling for enhanced video fidelity
Character Animation: Facial naturalizer and action-specific LoRAs (wink animation)
FP16 Precision: All models use float16 precision for efficient inference with minimal quality loss
VRAM: 12 GB (for single LoRA usage with WAN base model)
RAM: 16 GB system memory
Disk Space: 3 GB for LoRA collection
GPU: NVIDIA RTX 3060 (12GB) or equivalent
Recommended Requirements
VRAM: 24 GB (for multiple simultaneous LoRAs)
RAM: 32 GB system memory
Disk Space: 5 GB (with base model cache)
GPU: NVIDIA RTX 4090, A6000, or equivalent
Base Model Requirements
These LoRAs require the WAN v2.2 base model (separate download):
WAN base model: ~14 GB additional disk space
Combined VRAM usage: 16-24 GB depending on configuration
Usage Examples
Basic LoRA Loading with Diffusers
python
1from diffusers import WANPipeline
2import torch
34# Load base WAN pipeline5pipe = WANPipeline.from_pretrained(6"Wanniwatch/WAN22",7 torch_dtype=torch.float16,8 variant="fp16"9).to("cuda")1011# Load camera rotation LoRA12pipe.load_lora_weights(13"E:/huggingface/wan22-fp16-i2v-loras/loras/wan",14 weight_name="wan22-camera-rotation-rank16-v2.safetensors",15 adapter_name="camera_rotation"16)1718# Generate video with camera rotation19prompt ="A majestic lion on a savanna, cinematic camera rotation around subject"20video = pipe(21 prompt=prompt,22 num_frames=64,23 height=512,24 width=512,25 guidance_scale=7.5,26 lora_scale=0.8# Adjust strength (0.0-1.0)27).frames[0]
Combining Multiple LoRAs
python
1# Load multiple LoRAs for enhanced control2lora_configs =[3("wan22-camera-drone-rank16-v2.safetensors","drone",0.7),4("wan22-light-volumetric.safetensors","lighting",0.6),5("wan22-upscale-realismboost-t2v-14b.safetensors","quality",0.5)6]78for weight_name, adapter_name, scale in lora_configs:9 pipe.load_lora_weights(10"E:/huggingface/wan22-fp16-i2v-loras/loras/wan",11 weight_name=weight_name,12 adapter_name=adapter_name
13)1415# Set adapter weights16pipe.set_adapters(17["drone","lighting","quality"],18 adapter_weights=[0.7,0.6,0.5]19)2021prompt ="Aerial drone shot descending over a misty forest at dawn, volumetric god rays"22video = pipe(prompt=prompt, num_frames=64, height=768, width=768).frames[0]
Image-to-Video with Action LoRA
python
1from PIL import Image
23# Load image-to-video pipeline4pipe = WANPipeline.from_pretrained(5"Wanniwatch/WAN22",6 torch_dtype=torch.float16
7).to("cuda")89# Load wink action LoRA10pipe.load_lora_weights(11"E:/huggingface/wan22-fp16-i2v-loras/loras/wan",12 weight_name="wan22-action-wink-i2v-v1-low.safetensors",13 adapter_name="wink"14)1516# Load input image17image = Image.open("portrait.jpg")1819# Generate video with wink animation20video = pipe(21 prompt="Portrait, person winking at camera",22 image=image,23 num_frames=32,24 lora_scale=0.625).frames[0]
Advanced Camera Control
python
1# Earth zoom-out effect2pipe.load_lora_weights(3"E:/huggingface/wan22-fp16-i2v-loras/loras/wan",4 weight_name="wan22-camera-earthzoomout.safetensors"5)67prompt ="Starting from street level, camera zooms out revealing city, country, Earth from space"8video = pipe(9 prompt=prompt,10 num_frames=96,# Longer sequence for zoom effect11 height=1024,12 width=1024,13 lora_scale=0.8514).frames[0]
1# Realism boost for text-to-video2pipe.load_lora_weights(3"E:/huggingface/wan22-fp16-i2v-loras/loras/wan",4 weight_name="wan22-upscale-realismboost-t2v-14b.safetensors"5)67# Combine with face naturalizer for character videos8pipe.load_lora_weights(9"E:/huggingface/wan22-fp16-i2v-loras/loras/wan",10 weight_name="wan22-face-naturalizer.safetensors",11 adapter_name="face"12)1314prompt ="Close-up of a person smiling naturally in golden hour lighting"15video = pipe(16 prompt=prompt,17 num_frames=48,18 height=768,19 width=512,20 lora_scale=0.721).frames[0]
Model Specifications
Architecture
Base Model: WAN v2.2 (Wanniwatch video generation model)
LoRA Rank: Rank 16 for most camera/lighting LoRAs
Adapter Type: Low-Rank Adaptation (LoRA) for parameter-efficient fine-tuning
Precision: FP16 (float16) for all models
Format: SafeTensors (secure tensor serialization)
LoRA Categories
Camera Control (5 LoRAs)
Rotation: 360° camera rotation around subjects
Drone: Aerial drone cinematography movements
Arc Shot: Curved/circular camera paths around subjects
ADR1A: Advanced dynamic camera control system
Earth Zoom: Extreme zoom-out from ground to orbital perspective
Quality Enhancement (3 LoRAs)
Realism Boost: Enhanced photorealism for text-to-video generation
Face Naturalizer: Improved facial animation quality and natural expressions
Upscale: Quality enhancement for higher resolution output
Effects (1 LoRA)
Volumetric Lighting: Atmospheric lighting with light shafts and fog effects
Actions (1 LoRA)
Wink Animation: Character winking for image-to-video generation
Technical Details
All LoRAs use rank-16 decomposition (except action LoRA which is lower rank)
Compatible with diffusers library version ≥0.25.0
Supports both text-to-video and image-to-video pipelines
LoRA scaling factor: 0.5-1.0 (adjustable per use case)
Performance Tips and Optimization
LoRA Scaling Guidelines
Camera LoRAs: 0.7-0.9 for pronounced effects, 0.4-0.6 for subtle movements
Lighting LoRAs: 0.6-0.9 for dramatic effects, 0.3-0.5 for natural lighting
Quality LoRAs: 0.5-0.8 for balanced enhancement
Action LoRAs: 0.5-0.7 for controlled character animation
Combining LoRAs
Maximum Recommended: 3-4 simultaneous LoRAs to avoid conflicts
Quality LoRAs: Focus on detail keywords (e.g., "photorealistic", "highly detailed")
Action LoRAs: Explicitly describe the action (e.g., "person winking")
License
This model collection is released under the WAN License (other). Please refer to the official WAN v2.2 license terms from Wanniwatch for usage restrictions and commercial licensing.