Views
No views yet
sudo apt-get update && sudo apt-get install cbm git-lfs ffmpeg1git clone https://huggingface.co/svjack/YiChen_FramePack_lora_early
2cd YiChen_FramePack_lora_early1pip install torch torchvision
2pip install -r requirements.txt
3pip install ascii-magic matplotlib tensorboard huggingface_hub datasets
4pip install moviepy==1.0.3
5pip install sageattention==1.0.61 git clone https://huggingface.co/lllyasviel/FramePackI2V_HY
2 git clone https://huggingface.co/hunyuanvideo-community/HunyuanVideo
3 git clone https://huggingface.co/Comfy-Org/HunyuanVideo_repackaged
4 git clone https://huggingface.co/Comfy-Org/sigclip_vision_384fpack_generate_video.py script with the appropriate parameters. Below are examples of how to generate videos using the Dancing model.
1python fpack_generate_video.py \
2 --dit FramePackI2V_HY/diffusion_pytorch_model-00001-of-00003.safetensors \
3 --vae HunyuanVideo/vae/diffusion_pytorch_model.safetensors \
4 --text_encoder1 HunyuanVideo_repackaged/split_files/text_encoders/llava_llama3_fp16.safetensors \
5 --text_encoder2 HunyuanVideo_repackaged/split_files/text_encoders/clip_l.safetensors \
6 --image_encoder sigclip_vision_384/sigclip_vision_patch14_384.safetensors \
7 --image_path fln.png \
8 --prompt "In the style of Yi Chen Dancing White Background , The character's movements shift dynamically throughout the video, transitioning from poised stillness to lively dance steps. Her expressions evolve seamlessly—starting with focused determination, then flashing surprise as she executes a quick spin, before breaking into a joyful smile mid-leap. Her hands flow through choreographed positions, sometimes extending gracefully like unfolding wings, other times clapping rhythmically against her wrists. During a dramatic hip sway, her fingers fan open near her cheek, then sweep downward as her whole body dips into a playful crouch, the sequins on her costume catching the light with every motion." \
9 --video_size 960 544 --video_seconds 3 --fps 30 --infer_steps 25 \
10 --attn_mode sdpa --fp8_scaled \
11 --vae_chunk_size 32 --vae_spatial_tile_sample_min_size 128 \
12 --save_path save --output_type both \
13 --seed 1234 --lora_multiplier 1.0 --lora_weight framepack_yichen_output/framepack-yichen-lora-000006.safetensors
14
15
1python fpack_generate_video.py \
2 --dit FramePackI2V_HY/diffusion_pytorch_model-00001-of-00003.safetensors \
3 --vae HunyuanVideo/vae/diffusion_pytorch_model.safetensors \
4 --text_encoder1 HunyuanVideo_repackaged/split_files/text_encoders/llava_llama3_fp16.safetensors \
5 --text_encoder2 HunyuanVideo_repackaged/split_files/text_encoders/clip_l.safetensors \
6 --image_encoder sigclip_vision_384/sigclip_vision_patch14_384.safetensors \
7 --image_path shengjiang.png \
8 --prompt "In the style of Yi Chen Dancing White Background , The character's movements shift dynamically throughout the video, transitioning from poised stillness to lively dance steps. Her expressions evolve seamlessly—starting with focused determination, then flashing surprise as she executes a quick spin, before breaking into a joyful smile mid-leap. Her hands flow through choreographed positions, sometimes extending gracefully like unfolding wings, other times clapping rhythmically against her wrists. During a dramatic hip sway, her fingers fan open near her cheek, then sweep downward as her whole body dips into a playful crouch, the sequins on her costume catching the light with every motion." \
9 --video_size 960 544 --video_seconds 3 --fps 30 --infer_steps 25 \
10 --attn_mode sdpa --fp8_scaled \
11 --vae_chunk_size 32 --vae_spatial_tile_sample_min_size 128 \
12 --save_path save --output_type both \
13 --seed 1234 --lora_multiplier 1.0 --lora_weight framepack_yichen_output/framepack-yichen-lora-000006.safetensors
14
1python fpack_generate_video.py \
2 --dit FramePackI2V_HY/diffusion_pytorch_model-00001-of-00003.safetensors \
3 --vae HunyuanVideo/vae/diffusion_pytorch_model.safetensors \
4 --text_encoder1 HunyuanVideo_repackaged/split_files/text_encoders/llava_llama3_fp16.safetensors \
5 --text_encoder2 HunyuanVideo_repackaged/split_files/text_encoders/clip_l.safetensors \
6 --image_encoder sigclip_vision_384/sigclip_vision_patch14_384.safetensors \
7 --image_path waliesha.jpg \
8 --prompt "In the style of Yi Chen Dancing White Background , The dancer’s energy pulses in waves—one moment a statue, poised and precise, the next a whirl of motion as her feet flicker across the floor. Her face tells its own story: brows knit in concentration, then eyes widening mid-turn as if startled by her own speed, before dissolving into laughter as she springs upward, weightless. Her arms carve the air—now arcing like ribbons unfurling, now snapping sharp as a whip’s crack, palms meeting wrists in staccato beats. A roll of her hips sends her fingers fluttering near her temple, then cascading down as she folds into a teasing dip, the beads on her dress scattering light like sparks." \
9 --video_size 960 544 --video_seconds 3 --fps 30 --infer_steps 25 \
10 --attn_mode sdpa --fp8_scaled \
11 --vae_chunk_size 32 --vae_spatial_tile_sample_min_size 128 \
12 --save_path save --output_type both \
13 --seed 1234 --lora_multiplier 1.0 --lora_weight framepack_yichen_output/framepack-yichen-lora-000006.safetensors
14
1python fpack_generate_video.py \
2 --dit FramePackI2V_HY/diffusion_pytorch_model-00001-of-00003.safetensors \
3 --vae HunyuanVideo/vae/diffusion_pytorch_model.safetensors \
4 --text_encoder1 HunyuanVideo_repackaged/split_files/text_encoders/llava_llama3_fp16.safetensors \
5 --text_encoder2 HunyuanVideo_repackaged/split_files/text_encoders/clip_l.safetensors \
6 --image_encoder sigclip_vision_384/sigclip_vision_patch14_384.safetensors \
7 --image_path shanbing.jpg \
8 --prompt "In the style of Yi Chen Dancing White Background , The dancer’s energy pulses in waves—one moment a statue, poised and precise, the next a whirl of motion as her feet flicker across the floor. Her face tells its own story: brows knit in concentration, then eyes widening mid-turn as if startled by her own speed, before dissolving into laughter as she springs upward, weightless. Her arms carve the air—now arcing like ribbons unfurling, now snapping sharp as a whip’s crack, palms meeting wrists in staccato beats. A roll of her hips sends her fingers fluttering near her temple, then cascading down as she folds into a teasing dip, the beads on her dress scattering light like sparks." \
9 --video_size 960 544 --video_seconds 3 --fps 30 --infer_steps 25 \
10 --attn_mode sdpa --fp8_scaled \
11 --vae_chunk_size 32 --vae_spatial_tile_sample_min_size 128 \
12 --save_path save --output_type both \
13 --seed 1234 --lora_multiplier 1.0 --lora_weight framepack_yichen_output/framepack-yichen-lora-000006.safetensors
14--fp8: Enable FP8 precision (optional).--task: Specify the task (e.g., t2v-1.3B).--video_size: Set the resolution of the generated video (e.g., 1024 1024).--video_length: Define the length of the video in frames.--infer_steps: Number of inference steps.--save_path: Directory to save the generated video.--output_type: Output type (e.g., both for video and frames).--dit: Path to the diffusion model weights.--vae: Path to the VAE model weights.--t5: Path to the T5 model weights.--attn_mode: Attention mode (e.g., torch).--lora_weight: Path to the LoRA weights.--lora_multiplier: Multiplier for LoRA weights.--prompt: Textual prompt for video generation.save_path directory.pip.