Home Tech I touched the demo version of NVIDIA’s “Vid2 Vid Cameo” that allows you to freely control the angle and line of sight of your face –GIGAZINE

I touched the demo version of NVIDIA’s “Vid2 Vid Cameo” that allows you to freely control the angle and line of sight of your face –GIGAZINE

by news dir


On June 24, 2021, NVIDIA is a new feature of a video conferencing tool that can process facial images in real time using AI technology.Vid2Vid CameoThe demo version of “Vid2 Vid Cameo”, which will be installed on NVIDIA’s video conferencing tool development platform soon, was released for free, so I immediately tried using it.

vid2vid-cameo demo: One-Shot Free-View Neural Talking-Head Synthesis for Video Conferencing
http://nvidia-research-mingyuliu.com/vid2vid-cameo/

How AI Research Is Reshaping Video Conferencing | NVIDIA Blog
https://blogs.nvidia.com/blog/2021/06/24/vid2vid-cameo-ai-research-video-conferencing/

NVIDIA announced in October 2020, “Maxine” is a video conferencing tool development platform equipped with a function to automatically adjust the angle of the speaker’s face and a function to reflect facial movements on animal and character avatars. is.

NVIDIA announces new platform “Maxine” that can process video conferencing with cloud AI –GIGAZINE


On June 24th, Isha Salian, a member of NVIDIA’s corporate communications team, announced a new feature, Vid2 Vid Cameo, that will be added to Maxine. According to Salian, “Vid2 Vid Cameo”Generative adversarial networkIt is possible to synthesize the movement of the speaker’s facial expression into a still image in real time.

Salian says that this feature allows you to upload a photo of yourself dressed up in advance so that you can attend a formal video conference with your head and loungewear on. ..

SuchDemo version of “Vid 2 Vid Cameo”Is open to the public, so let’s use it right away. When you access the demo version, it looks like this.


Eight sample images are prepared, so when I clicked “Image 1” as a trial, a photo of a man’s face was displayed.


First, move the “pitch” slide bar to the right and then press the “Rotate” button. Then the man in the photo raised his face.


Next, I moved the “yaw (left and right)” slide bar to the right and pressed the “Rotate” button in the same way, and the man who was facing right turned his face to the front.


It is also possible to bend the neck with “roll”. Although the neck and shoulders are no longer connected, the background objects that can be seen by changing the posture are also synthesized without any discomfort, which is a fairly natural result.


In addition, you can freely change not only the orientation of your face but also your line of sight.


To try out your favorite photo, click Select File, select any photo, and click Open> Upload.


Then drag on the face photo to enclose the face in a yellow frame.


After that, you can freely change the angle of the face and the direction of the line of sight by the same operation as above.


“Vid2 Vid Cameo” that allows you to freely edit your face with AI will soon be available in Maxine andNvidia Video CodecofSoftware Development Kit (SDK)It will be available at.

Copy the title and URL of this article

Related Articles

Leave a Comment

This site uses Akismet to reduce spam. Learn how your comment data is processed.