Added linux app for facewarp

[Jahysama]

Description

I have compiled linux app for facewarp, but hardcoded flags (-dump and -vsync) since they did not work on linux for some reason.
I also have changed facewarp usage in main_end2end_cartoon.py by removing wine.

Related Issue

#57

Motivation and Context

It is really annoying to deal with wine sometimes. Using linux app on remote machines and in google colab is much more easier.

How Has This Been Tested?

I have tested it using readme guidelines.

Screenshots (if appropriate):

Types of changes

• Bug fix (non-breaking change which fixes an issue)
• New feature (non-breaking change which adds functionality)
• Breaking change (fix or feature that would cause existing functionality to change)

Checklist:

• I have signed the Adobe Open Source CLA.
• My code follows the code style of this project.
• My change requires a change to the documentation.
• I have updated the documentation accordingly.
• I have read the CONTRIBUTING document.
• I have added tests to cover my changes.
• All new and existing tests passed.

[fantasy-fish]

There's some artifact in the face warping result. Not sure if it's because of the facewarp app

[Jahysama]

No, facewarp works perfectly fine, please check this solution, it might solve your problem

[fantasy-fish]

Yes, I saw this

No, facewarp works perfectly fine, please check this solution, it might solve your problem

Yes, I saw this. Thanks

[lukagouvea]

Hey Jahysama, thanks for building facewarp for linux, it was very helpful. With you binaries I was able to animate the puppet, but I am still facing the error:

finish gen fls
/content/MakeItTalk/examples_cartoon/pred_fls_M6_04_16k_audio_embed/output
EXCEPTION:
GLFW initialization failed.
ffmpeg version 4.4.2-0ubuntu0.22.04.1 Copyright (c) 2000-2021 the FFmpeg developers
built with gcc 11 (Ubuntu 11.2.0-19ubuntu1)
configuration: --prefix=/usr --extra-version=0ubuntu0.22.04.1 --toolchain=hardened --libdir=/usr/lib/x86_64-linux-gnu --incdir=/usr/include/x86_64-linux-gnu --arch=amd64 --enable-gpl --disable-stripping --enable-gnutls --enable-ladspa --enable-libaom --enable-libass --enable-libbluray --enable-libbs2b --enable-libcaca --enable-libcdio --enable-libcodec2 --enable-libdav1d --enable-libflite --enable-libfontconfig --enable-libfreetype --enable-libfribidi --enable-libgme --enable-libgsm --enable-libjack --enable-libmp3lame --enable-libmysofa --enable-libopenjpeg --enable-libopenmpt --enable-libopus --enable-libpulse --enable-librabbitmq --enable-librubberband --enable-libshine --enable-libsnappy --enable-libsoxr --enable-libspeex --enable-libsrt --enable-libssh --enable-libtheora --enable-libtwolame --enable-libvidstab --enable-libvorbis --enable-libvpx --enable-libwebp --enable-libx265 --enable-libxml2 --enable-libxvid --enable-libzimg --enable-libzmq --enable-libzvbi --enable-lv2 --enable-omx --enable-openal --enable-opencl --enable-opengl --enable-sdl2 --enable-pocketsphinx --enable-librsvg --enable-libmfx --enable-libdc1394 --enable-libdrm --enable-libiec61883 --enable-chromaprint --enable-frei0r --enable-libx264 --enable-shared
libavutil 56. 70.100 / 56. 70.100
libavcodec 58.134.100 / 58.134.100
libavformat 58. 76.100 / 58. 76.100
libavdevice 58. 13.100 / 58. 13.100
libavfilter 7.110.100 / 7.110.100
libswscale 5. 9.100 / 5. 9.100
libswresample 3. 9.100 / 3. 9.100
libpostproc 55. 9.100 / 55. 9.100
[image2 @ 0x59b1924d0380] Could find no file with path '%06d.tga' and index in the range 0-4
%06d.tga: No such file or directory

The software generates the video of the puppet animation with the audio, but it fails to build the video with the cartoon image animation. I downloaded you binary and changed the main_end2end_cartoon.py as you did on your commit. Could you help me with this? Or if you did it with Colab, could you share it with me? Thanks

[Jahysama]

Hi, @lukagouvea! I have made an example usage of this project on kaggle more than a year ago here. I ran my fork code with the jupyter cell as follows:

%cd MakeItTalk
!python main_end2end_cartoon.py --jpg image.png --jpg_bg image_bg.jpg --inner_lip --user user --output_folder user
%cd ..

It is important to run it inside MakeItTalk directory to work properly. It might be also the reason causing this issue. Please provide a code to reproduce your error if you want to investigate further :)

[lukagouvea]

Hi, @lukagouvea! I have made an example usage of this project on kaggle more than a year ago here. I ran my fork code with the jupyter cell as follows:

%cd MakeItTalk
!python main_end2end_cartoon.py --jpg image.png --jpg_bg image_bg.jpg --inner_lip --user user --output_folder user
%cd ..

It is important to run it inside MakeItTalk directory to work properly. It might be also the reason causing this issue. Please provide a code to reproduce your error if you want to investigate further :)

Here's a link to my Colab: https://colab.research.google.com/drive/160bbxffDRDGqTt1ZdM38TtKoElSpzq7e?usp=sharing

It is very similar to the original author Colab, with some minor changes. It is cloning a repo direct from my github, this repo is updated with your binary facewarp together with the updated main_end2end_cartoon.py. I am trying to animate the image called "tarsila.png". After fthe error, you can check examples folder, there will be an .mp4 file with the same name as the demo audio, it will contain an animation of the puppet that I created previously. I could not execute the cell as you pasted here, it does not accept user arguments, also could not accept the output folder argument. Inner lip flag is not necessary, because the original image already have a closed mouth. Thanks in advance for your help.