SCAIL-2: An Open-Source End-to-End Character Animation Model with Cross-Identity Replacement and Animal Driving
English summary
SCAIL-2 is an open-source model for end-to-end controlled character animation that removes dependence on intermediate pose representations. It was trained on 60K synthetic motion pairs using several teacher models (SCAIL-Preview, Wan-Animate, MoCha) and a Unified Motion Transfer Interface. The model enables animating a reference character from a driving video, supports cross-identity character replacement and multi-character scenarios, and extends to animal-driving. Additionally, it offers zero-shot support for advanced control intermediates like SAM3D-Body mesh rendering.
Chinese summary
SCAIL-2是一个开源端到端可控角色动画模型，去除了对中间姿态表示的依赖。它利用多个教师模型（SCAIL-Preview、Wan-Animate、MoCha）合成的6万组运动对，通过统一运动传递接口进行训练。该模型能够通过驱动视频为参考角色生成动画，支持跨身份角色替换、多角色场景以及动物驱动，并具备对SAM3D-Body网格渲染等高级控制中间件的零样本支持。
Key points
Eliminates dependence on intermediate representations like skeleton maps or inpainting masks.
消除了对骨骼图或修补蒙版等中间表示的依赖。
Trained on 60K synthetic motion pairs using multiple teacher models and a Unified Motion Transfer Interface with dedicated masking and RoPE design.
使用多个教师模型和统一运动传递接口，基于6万个合成运动对进行训练，接口包含专用掩码通道和旋转位置编码设计。
Emergent abilities include cross-identity character replacement, animal driving, and zero-shot SAM3D-Body mesh rendering support.
涌现能力包括跨身份角色替换、动物驱动以及SAM3D-Body网格渲染的零样本支持。
Open-source release available on Hugging Face.
已在Hugging Face上开源发布。