Overview / Usage

The facial expressions of a person standing in front of a camera are recognized and displayed as the faces of known persons, such as, for example, Angela Merkel, Barack Obama or Elon Musk, broadcast. In the final video stream, the software first removes the input face completely, and then replaces it with the Deep Fake. The prototype presented by TNG is a kind of mirror in which one recognizes his facial expressions, but not his face.

The basis for this is Artificial Intelligence. Through the use of various computer vision and neural network techniques, faces are recognized in the video input, translated and integrated back into the video output. Through this technique, it is possible to project deceptively real imitations on other people.

Methodology / Approach

Auto-encoder networks were trained by means of so-called GANs (Generative Adversarial Networks). In addition, the software developers used various neural networks like MobileNet and UNet for facial recognition and facial segmentation.

Technologies Used

• Keras with a Tensorflow backend
• Python

Other links

• Press article (German technology press)
• Technology description

Collaborators