Overview / Usage

Dance Creator can automatically generate high-quality production-ready dance motion based on arbitrary length music. Traditionally, creating dance motions in video games heavily rely on professional dancers and choreographers. Dance Creator synthesizes 3D dance motion automately based on Intel OpenVINO accelerated deep neural network. This system has been deployed on Justice, a flagship MMORPG game from Leihuo Studio, Netease. It has served more than 404,000 backing dance tasks in Justice game, and more than 136,000 choreography tasks in player generated short dance films.

Methodology / Approach

Dance Creator system is capable of creating dance animation of a given melody through analyzing, slicing, and matching prerecorded animations. A music-to-motion interpreter was trained to utilize a large number of choreography videos collected. This interpreter analyzes the input melody piece-wisely and generates corresponding dance motion features. These features are then used to perform what we describe as the “phase-based dance matching” to generate the final 3D dance animation.

The performance optimization for online deployment is based on the Intel distribution of OpenVINO toolkit and Intel® Math Kernel Library. Audio analyses time has 20% to 80% acceleration after optimization. It also brings 2~3 times acceleration for the online network inference speed. In summary, the CPU-based server cluster deployment achieved about 20% reduction of the response time for each user request, guaranteeing the system to be both player favored and cost efficient.

Technologies Used

Atificial Intelligence, CNN-IndRNN Network, Intel® Distribution of OpenVINO™ toolkit, Intel® Math Kernel Library

Documents and Presentations