In this experiment I wanted to try something with facial expressions and have it work with native Unreal Engine tools. I did find that generating the head with an open mouth helped to get some extra details. Creating those blend shapes was still not easy and this result is far from perfect. Ideally i want 58 generated expression references and have AI figure that out haha. btw first time baking the high poly details onto the low poly generated character. That worked surprisingly well! Endresult has 34k triangles! Built this character in 4 separate parts in Blender and generated each part in Hunyuan 3D Studio. The original references came from Nano Banana 2 and Grok. Trellis 2 in ComfyUI for the texturing. The animation was done with Control Rig in UEFN / Unreal Engine. With all the experiments so far, file and version management start to become a challenge. Getting files from different platforms with each platform having their own filename logic. I’ll have to find something to keep it more organized. Any suggestions?

This is crazy! With LTX 2 in ComfyUI i was able to keep my original camera movement + it did a full lip-sync on the singing haha. All running locally. I made the original video back in 2021 when Metahumans first came out and we were working in Unreal Engine 4. This music video was some kind of result from my first experiments with Livelink and Control Rig at that time. Now the new AI improved version is not perfect and i didn’t train any lora for character consistency yet. I also didn’t have the original video file anymore so I downloaded the Youtube version as input haha. However the camera result + facial expressions are really promising! I wonder how it would handle more complex and fast shots though.