Face2Face: Real-time Face Capture and Reenactment of RGB Videos (CVPR 2016 Oral)

Face2Face: Real-time Face Capture and Reenactment of RGB Videos (CVPR 2016 Oral) http://youtu.be/ohmajJTcpNk CVPR 2016 Paper Video (Oral)
Project Page: http://ift.tt/1MfoAbx

IMPORTANT NOTE:
This demo video is purely research-focused and we would like to clarify the goals and intent of our work. Our aim is to demonstrate the capabilities of modern computer vision and graphics technology, and convey it in an approachable and fun way. We want to emphasize that computer-generated videos have been part in feature-film movies for over 30 years. Virtually every high-end movie production contains a significant percentage of synthetically-generated content (from Lord of the Rings to Benjamin Button). These results are hard to distinguish from reality and it often goes unnoticed that the content is not real. The novelty and contribution of our work is that we can edit pre-recorded videos in real-time on a commodity PC. Please also note that our efforts include the detection of edits in video footage in order to verify a clip’s authenticity. For additional information, we refer to our project website (see above). Hopefully, you enjoyed watching our video, and we hope to provide a positive takeaway πŸ™‚

Paper Abstract
We present a novel approach for real-time facial reenactment of a monocular target video sequence (e.g., Youtube video). The source sequence is also a monocular video stream, captured live with a commodity webcam. Our goal is to animate the facial expressions of the target video by a source actor and re-render the manipulated output video in a photo-realistic fashion. To this end, we first address the under-constrained problem of facial identity recovery from monocular video by non-rigid model-based bundling. At run time, we track facial expressions of both source and target video using a dense photometric consistency measure. Reenactment is then achieved by fast and efficient deformation transfer between source and target. The mouth interior that best matches the re-targeted expression is retrieved from the target sequence and warped to produce an accurate fit. Finally, we convincingly re-render the synthesized target face on top of the corresponding video stream such that it seamlessly blends with the real-world illumination. We demonstrate our method in a live setup, where Youtube videos are reenacted in real time.

Trying out a darker brow pencil and brow make up. ..no other make up yet – I’ve got laundry to do #carpenterselfie #mar16 #eylure #m&ssale #hdbrows

abigailsoph provides an interesting and somewhat inspirational artefact from:http://ift.tt/1RfQEvC

Happy birthday Sly Stone. @djharrisonrva’s SLYISH drops in a few weeks. Go listen at http://ift.tt/1gphbp9 #StreetCornerMusic

houseshoes provides an interesting and somewhat inspirational artefact from:http://ift.tt/1RMqnRQ

HF Vol 25 artist @bradrkunkle’s ethereal gold leaf paintings of women are featured in a new short film. Watch “A Beholden Purpose” by @gravitybee now on HiFructose.com. #BradKunkle #HiFructose #art #film #goldleaf #painting #oilpainting

hifructosemag provides an interesting and somewhat inspirational artefact from:http://ift.tt/1Ux3MgX

is Virtual Reality worth it right now?

is Virtual Reality worth it right now? http://youtu.be/sFHPJDMseZA is Virtual Reality worth it right now? Time to but new VR headset? What is it like to use VR headset? All your questions answered now!

Follow me on Twitter! http://bit.ly/1SygMSJ
Subscribe for more tech! http://bit.ly/1PIVaAq
Add me on snapchat: zyzz.shembesh

Thank you for watching guys!

Can we get this video to 50 LIKES??!!

Remember to press the like button and subscribe to stay tuned. More coming to your way!

Product Links:

Virtuix Omni Website: www.virtuix.com
Oculus rift: https://www.oculus.com
Oculus rift share: http://ift.tt/14nLngv
Fove Eye tracking headset: http://www.getfove.com/

Zyzz out!

Milan map drawing inspired by my day trip, with 7 hours I covered The stunning cathedral Dumo Di Milano, Galaria Villoerio Emanuele, as well as seeing the Famous Michelangelo Fresco of the Last Supper at the Santa Maria Delle Grazie, more art and culture at the Pinacoteca Di Brera, and a lot of walking around Sforza Castle, goes with saying to enjoy coffee and gelato. #travelmap #ink #pen #illustration #draw #drawing #sketch #sketching #rotring #stationary #stationaryaddict #inkstagram #inkart #inky #sketchpad #sketchbook #sketchbookdaily #sketchoftheday #traveldraw #traveldrawing #travelvlogger #travelvlog #travelmap #traveljournal #travel #creative #inspiration #milan #italy #milano @cntraveler @condenasttraveller @guardiantravelsnaps @nytimestravel @st_travelmag @travelandleisure @theydrawandtravel

jiteshpatel provides an interesting and somewhat inspirational artefact from:http://ift.tt/1UEdQVP

A new batch of works from @johnwentz arriving soon! We’ll be receiving five works from his abstracted street scene series. Here’s “Abstraction No. 24″ (Mixed Media, 12×12”)

abendgallery provides an interesting and somewhat inspirational artefact from:http://ift.tt/1UEdTAI