LoRA adapter for LTX-2.3 audio-reactive video generation.
V2 Update - June 15, 2026
V2 adds stronger audio-reactive motion, heavier beat impact, and more aggressive smoke/liquid-light movement driven by the track.
This update focuses on making the LoRA feel more responsive to music: faster visual hits, sharper bass pressure, stronger particle flicker, and smoother motion for music-video presentation.
LTX2.3 Audio Reactive LoRA is a LoRA adapter for LTX-2.3 designed to make video generation react more visibly to music and sound. It focuses on beat-locked visual motion: cubic forms, particles, light pulses, camera pushes, graphic texture, and material deformation moving in sync with kicks, bass, snares, hi-hats, and synth changes.
The LoRA is intended for audio-to-video and image-plus-audio-to-video workflows, especially with the fal.ai endpoint fal-ai/ltx-2.3-quality/audio-to-video/lora.
Recommended resolution: 1024x1024 for square visualizer clips
Recommended negative prompt: empty string unless the workflow needs constraints
Recommended first frame: structured visual material with clear shapes, depth, light sources, cubes, geometry, particles, layered graphic elements, or audio-visualizer forms
License: follows the LTX-2 Community License Agreement inherited from the LTX-2.3 base model
Prompt Language
Use language like this near the start of the prompt:
For stronger motion, repeat the audio-reactive instruction directly:
The video must be driven by the audio. The cubes must visibly move to the sound. The cubes must hit the beat: BAM BAM BAM.
Prompt Template
text
1sound-driven video, audio-reactive motion, continuous visual flow.
2This must be an aggressively audio-reactive cubic video. The cubes must visibly move to the sound. The cubes must visibly move to the sound.
3The cubes must hit the beat: BAM BAM BAM. On every kick, large cubes slam, squash, jump, or punch forward. On every bass pulse, the whole 3D structure expands and compresses like a pressure engine.
4On snares, cube layers snap sideways, cut, and reassemble. On hi-hats, tiny cube fragments, sparks, fine grain, color edges, and signal lines flicker fast.
5On synth changes, surfaces ripple, panels unfold, glass blocks breathe, light seams stretch, and the camera pushes through depth.
6Keep a premium dark 3D first-frame style: black glass, graphite, chrome, deep cobalt, electric cyan, acid green, controlled red, warm amber, tactile grain, color separation, subtle bloom.
7No text, no logo, no border, no blank padding.
Example fal Input
json
1{2"prompt":"sound-driven video, audio-reactive motion, continuous visual flow. This must be an aggressively audio-reactive cubic video. The cubes must visibly move to the sound. The cubes must hit the beat: BAM BAM BAM. On every kick, large cubes slam, squash, jump, or punch forward. On every bass pulse, the whole 3D structure expands and compresses like a pressure engine. On snares, cube layers snap sideways, cut, and reassemble. On hi-hats, tiny cube fragments, sparks, fine grain, color edges, and signal lines flicker fast.",3"audio_url":"https://...",4"image_url":"https://...",5"match_audio_length":true,6"resolution":{7"width":1024,8"height":10249},10"frames_per_second":24,11"num_inference_steps":15,12"guidance_scale":1,13"generate_audio":true,14"image_strength":0.62,15"negative_prompt":"",16"enable_prompt_expansion":false,17"video_quality":"high",18"video_write_mode":"balanced",19"loras":[20{21"path":"https://huggingface.co/fal/ltx2.3-audio-reactive-lora/resolve/main/ltx2.3_audio_reactive_lora.safetensors",22"scale":1.2,23"transformer":"both"24}25]26}
Notes
This LoRA is most useful when the input image already contains clear structures that can move with the music: cubes, layered architecture, particles, light seams, waveform-like forms, glass blocks, or abstract visualizer shapes. It can be used without an image, but image-first-frame generation gives stronger art direction and more consistent results.
It can also be tested in ComfyUI or other local LTX-2.3 workflows as a standard LoRA, as long as the workflow supports LTX-2.3 LoRA loading and audio-conditioned generation.
Limitations
The LoRA improves audio-reactive motion but does not guarantee perfect beat detection in every clip.
Stronger motion usually comes from lower image strength, stronger prompt language, and clearly structured first frames.
Text inside first frames can drift during video generation; keep important text simple, high-contrast, and explicitly described as fixed if it must remain readable.
Generated videos should be reviewed before publication, especially for text stability, logo fidelity, and sync.
