Nope. It's more like puppeteering an image. No initial similarity required. It's not directly discussed in the below link but extending this technique to arbitrary new faces or even cartoon characters isn't truly difficult anymore.

https://developer.nvidia.com/ai-video-compression