Real-Time Transfer of Facial Expressions

15.10.2015 Misc Tech
Warning: Invalid argument supplied for foreach() in /home/nerdcore/public_html/wp-content/themes/NC12/single.php on line 65

Share: Twitter Facebook Mail

Extrem interessantes Demo von der Siggraph2015:

teaser

Real-time Expression Transfer for Facial Reenactment, die kopieren Mimik in einem Live-Videofeed von einem Schauspieler auf den anderen. Weil Fakes immer noch nicht einfach genug zu produzieren sind, demnächst kann man auch Livestreams nicht mehr über den Weg trauen:

We present a method for the real-time transfer of facial expressions from an actor in a source video to an actor in a target video, thus enabling the ad-hoc control of the facial expressions of the target actor. The novelty of our approach lies in the transfer and photo-realistic re-rendering of facial deformations and detail into the target video in a way that the newly-synthesized expressions are virtually indistinguishable from a real video.

To achieve this, we accurately capture the facial performances of the source and target subjects in real-time using a commodity RGB-D sensor. For each frame, we jointly fit a parametric model for identity, expression, and skin reflectance to the input color and depth data, and also reconstruct the scene lighting. For expression transfer, we compute the difference between the source and target expressions in parameter space, and modify the target parameters to match the source expressions.