It's not for moving around, but for turning some image into a stereoscopic one (or 2 side-by-side images if you will). Lots of techniques for this exist, which usually turn an image into depth information using AI and then use any number of approaches to generate/warp 2 offset images from it.
So far the best looking results are still achieved with good old mesh warping and no inpainting at all. This may change that.
Ah, but if we're not talking 6DOF what's new with ml-sharp? We've had good autostereoscopy for a couple of years at least.
> So far the best looking results are still achieved with good old mesh warping and no inpainting at all.
I agree
> This may change that.
Seems not to be the case in my testing. The splats are too fine and sparse to yield an improvement. There are actually better (slower) image -> splat models than ml-sharp (with much higher dynamic range for the covariance) but I still don't use them over meshes for this.
The only improvements ml-sharp seems to add to the SOTA is 1) speed and 2) an interesting 2-focal layer architecture, but these are somewhat tangential steps.
So far the best looking results are still achieved with good old mesh warping and no inpainting at all. This may change that.