An open, local prompt rewriter for text-to-audio-video (T2VA) generation with
MiniMax-H3, fine-tuned as a LoRA
adapter on top of Qwen3.6-27B.
Generate the final audio-video with
LightX2V. LightX2V provides optimized local
MiniMax-H3 inference, including T2AV and other H3 tasks, memory offloading, tensor and
sequence parallelism, quantized checkpoints, optimized attention/RMSNorm/RoPE kernels,
and feature caching. If this project is useful, please consider giving
ModelTC/LightX2V a star.
The official MiniMax-H3 repository
provides the upstream model weights. LightX2V is the recommended inference entry
point for the workflow documented here.
What it does
The adapter turns a short prompt plus the requested aspect ratio and duration into a
structured audio-video description:
The rewritten prompt expands shot structure, timing, composition, camera motion,
physical action, continuity, synchronized diegetic sound, and non-diegetic music while
preserving the original intent.
Component
Purpose
Model
Inference framework
Runs MiniMax-H3 locally and generates the final synchronized video and audio
The 27B base model is not included in this adapter repository and will be downloaded
from Hugging Face on first use. Ensure that the machine has enough GPU/CPU memory for
Qwen3.6-27B. device_map="auto" is used to distribute the model over available devices.
Rewrite one prompt
bash
1python infer.py \2 --prompt "Epic space-opera teaser: a captain watches the last fleet jump away, leaving her alone."\3 --duration 10\4 --resolution 16:9 \5 --greedy
Local paths are supported as well:
bash
1python infer.py \2 --base-model /path/to/Qwen3.6-27B \3 --adapter /path/to/MiniMax-H3-Prompt-Rewriter-LoRA \4 --prompt "A red fox walks through a snowy forest at dawn."\5 --duration 15\6 --resolution 21:9 \7 --output rewritten_prompt.json
Use --output result.txt for plain text or a .json path for a record containing
the original prompt, conditions, model IDs, and rewritten prompt.
To run the base-model baseline without the LoRA:
bash
1python infer.py \2 --base-only \3 --prompt "A red fox walks through a snowy forest at dawn."\4 --duration 15\5 --resolution 21:9 \6 --greedy
For fair comparisons, use the same decoding mode and seed for every rewriter. Greedy
decoding is the simplest deterministic setting; sampling is enabled when --greedy
is omitted.
Generate audio-video with LightX2V
1. Install LightX2V
Building from source gives access to the latest MiniMax-H3 integration:
The LoRA in this repository rewrites text; it does not replace or include the
MiniMax-H3 generator weights.
3. Rewrite the prompt
Run this command from the prompt-rewriter repository:
bash
1python infer.py \2 --prompt "A red fox walks through a snowy forest at dawn."\3 --duration 15\4 --resolution 16:9 \5 --greedy \6 --output /tmp/h3_rewritten_prompt.txt
4. Generate synchronized video and audio
Run the rewritten prompt with LightX2V from the LightX2V repository root:
The output MP4 contains both video and synchronized stereo audio. Make sure that the
duration and aspect ratio in the LightX2V config match the conditions passed to the
prompt rewriter. Ready-to-run single-GPU, block-offload, tensor-parallel, and combined
TP+SP examples are available in the
LightX2V MiniMax-H3 scripts.
For lower-memory or multi-GPU inference, start from one of these configurations:
The following gallery is designed to compare videos generated through
LightX2V with the same MiniMax-H3 checkpoint and
identical inference settings. Only the prompt-rewriting method should differ.
Label
Meaning
Original Prompt (No Rewrite)
The raw user prompt is sent directly to MiniMax-H3
MiniMax Context-IR
The raw prompt is enhanced by the official hosted Context-IR workflow
Qwen3.6-27B Base Rewriter
The same template is used with the base model and no LoRA
H3-T2VA Context Rewriter LoRA (Ours)
Qwen3.6-27B with this task-specific LoRA
Prompt 1
Original prompt: Epic space-opera theatrical teaser: a female captain stands alone before a massive observation window as the last fleet gathers and jumps away in a blinding flash, the bridge shaking, leaving her behind.
Original Prompt (No Rewrite)
MiniMax Context-IR
Qwen3.6-27B Base Rewriter
H3-T2VA Context Rewriter LoRA (Ours)
Prompt 2
Original prompt: A dynamic TV promo-style video showcasing a group of politicians at a nighttime event illuminated by vibrant neon lights. The politicians, dressed in formal attire, engage in conversations, shake hands, and exchange smiles as they navigate through a bustling room filled with guests. The scene is set in a modern, urban environment with a mix of soft ambient lighting and bright neon signs. The camera alternates between close-ups of expressive faces and wider shots capturing the energetic atmosphere. The visuals include fast-paced cuts and subtle zoom-ins to highlight key interactions and facial expressions, emphasizing the excitement and importance of the political networking event.
Original Prompt (No Rewrite)
MiniMax Context-IR
Qwen3.6-27B Base Rewriter
H3-T2VA Context Rewriter LoRA (Ours)
Prompt 3
Original prompt: ASMR video featuring a close-up shot of a young woman's hands. The girl has long, neatly manicured nails and soft, smooth skin. She moves her hands gracefully in front of the camera, focusing on gentle hand movements such as tapping, sliding, and fluttering. The lighting is warm and soft, casting a gentle glow on her hands. The camera remains static but maintains a close-up focus on her hands throughout the sequence. The background is blurred to keep the viewer's attention on the hands. The movements are slow and deliberate, creating a soothing and relaxing atmosphere.
Original Prompt (No Rewrite)
MiniMax Context-IR
Qwen3.6-27B Base Rewriter
H3-T2VA Context Rewriter LoRA (Ours)
Prompt 4
Original prompt: A man in casual attire reaches for a gaming joystick from a shelf in a well-lit electronics store. He is standing in front of a display filled with various gaming consoles and accessories. The store background includes rows of shelves stocked with electronic gadgets, creating a bustling retail atmosphere. The man's posture is upright, with a focused and excited expression as he selects the joystick. The scene captures a close-up mid-shot, emphasizing the man's interaction with the joystick.
This release supports text-only T2VA prompt rewriting; it does not consume images,
videos, or audio references.
It is a learned approximation, not an open-source release or exact replica of the
official H3-Context-IR service.
The generated rewrite may add details not explicitly present in a short prompt.
Review the result before generation when identity, dialogue, timing, or composition
must be exact.
Final quality depends on both prompt rewriting and the MiniMax-H3 inference settings
selected in LightX2V.
This project is developed by the
LightX2V community to make local MiniMax-H3
prompt rewriting and audio-video generation easier and more efficient. It is built for
the MiniMax-H3 audio-video generation
model and fine-tuned from Qwen3.6-27B.
If you use this adapter or the MiniMax-H3 integration, please visit and star
ModelTC/LightX2V, where inference support,
performance optimizations, examples, and future task updates are maintained.
