Wan releases Wan Animate 2 for character image animation

Wan has introduced Wan Animate 2, an end-to-end character animation framework designed to improve motion fidelity and identity preservation without intermediate motion extractors.

2 min read

A character animation demonstration frame showing motion results.
A demonstration frame showcasing high-fidelity character image animation produced by Wan Animate 2.humanaigc.github.io

Character image animation remains a fundamental yet challenging task in computer vision. Existing approaches can be broadly categorized into three paradigms: methods based on explicit motion representations suffer from extraction errors and identity drift; methods based on implicit motion features lose fine-grained dynamics through compression; and in-context learning approaches avoid intermediate representations but incur prohibitive computational costs. Furthermore, all current systems are designed for offline synthesis, unable to meet the real-time requirements of interactive applications such as digital avatars and live-streaming hosts.

To address these limitations, Tongyi Lab from Alibaba Group has presented Wan-Animate-2, an end-to-end character animation framework that directly consumes the driving video within a redesigned Diffusion Transformer. The architecture achieves superior motion fidelity and identity preservation by eliminating intermediate motion extractors entirely. The developers further introduce text-driven viewpoint control that decouples the output camera perspective from the driving video—a capability rarely supported by prior character animation methods that rely on explicit motion representations.

Diagram showing the architecture and model structure of Wan Animate 2.
Overview of the Wan Animate 2 model architecture, detailing the redesign of the Diffusion Transformer and direct consumption of driving video.humanaigc.github.io, Source ↗

Key facts

Developer
Tongyi Lab, Alibaba Group
Framework
Diffusion Transformer
Efficient Variant
Wan-Animate-2-Lite
Planned Public Release
Wan-Animate-2-Base model weights

Beyond generation quality, the project includes Wan-Animate-2-Lite, an efficient variant that reduces inference latency to real-time thresholds through a three-stage training paradigm: teacher forcing pretraining with an error buffer mechanism, and Self-Forcing distillation with chunk-wise backpropagation. This enables streaming character animation for interactive applications, opening new deployment scenarios that were previously infeasible. Qualitative evaluations and user studies demonstrate that Wan-Animate-2 achieves high-fidelity animation results across diverse characters and motion patterns.

To foster further research and community development, the team has announced that they will release the Wan-Animate-2-Base model weights to the public.

Verified details

To foster further research and community development, we will release the Wan-Animate-2-Base model weights to the public.

Source: humanaigc.github.io

Worth a read?

Report

Comments