User Experiments with LTX 2.3 IC-LoRA in Blender-to-Video Pipeline Reveals Texture vs. Motion Trade-off
English summary
A user built an AI-assisted animation pipeline using Blender and ComfyUI, employing LTX 2.3 as an alternative render engine. They modified the official IC-LoRA workflow to include both first and last frame conditioning, and used a custom control video combining depth and AO passes from Blender. With only the distilled LoRA, motion and composition were stable but textures faded away from guide frames; adding IC-LoRA preserved textures but caused composition drift, character misplacement, and overall instability. The user seeks a technical understanding of how IC-LoRA interacts with the distilled model and guide frames to explain this trade-off.
Chinese summary
有用户利用 Blender 和 ComfyUI 搭建了一个 AI 辅助动画流程,将 LTX 2.3 作为替代渲染引擎。他们对官方 IC-LoRA 工作流做了修改,加入首帧和尾帧条件,并用 Blender 生成了结合深度和 AO 通道的自定义控制视频。仅使用蒸馏 LoRA 时,运动与构图稳定,但远离引导帧时纹理逐渐褪色;加入 IC-LoRA 后纹理得以保持,却导致构图漂移、角色错位和整体不稳定。用户希望从技术层面理解 IC-LoRA 与蒸馏模型、引导帧的交互,以解释这一权衡。
Key points
The user extended the official LTX 2.3 IC-LoRA workflow to condition on a last frame in addition to the first frame, using Blender to produce a custom control video from depth and AO passes.
用户扩展了官方 LTX 2.3 IC-LoRA 工作流,在首帧基础上增加了尾帧条件,并用 Blender 从深度与 AO 通道生成自定义控制视频。
Two setups were compared: distilled LoRA only yields stable motion but textures fade; adding IC-LoRA preserves textures but makes animation unstable, creating a clear trade-off.
比较了两种设置:仅用蒸馏 LoRA 运动稳定但纹理褪色;加入 IC-LoRA 虽能保持纹理,但导致动画不稳定,形成明显权衡。