Computer Vision: "Inverse" Structure From Motion

546 Views Asked by At

Note: I am not asking for code just the name of some algorithms I can research

Problem

I'm trying to do a 3D reconstruction from multiple images where the subject is rotating.

I don't have a lot of experience in the CV field and my mathematics is not particularly good so I am reliant on either simply worded papers or existing libraries/tools.

Where I'm At

I have been researching and testing using Structure from Motion (with VisualSFM) to generate a 3d point cloud and Multi View Stereo (with CMPMVS) to reconstruct the scene.

Obviously these algorithms are designed to process images where the camera (or cameras) moves and the scene is stationary so the reconstructions fail for a number of reasons.

Example: I've been working with short videos of a person rotating around a marker on the floor, see below. I've tried removing the background but this seems to make it harder for SfM to build pairs, probably because of the lack of intformation. Above: Person Rotating on the Spot, Below: Same with Background Removed

Question

Does anyone know the name of an algorithm/pipeline that will be able to reconstruct a series of images with a static background and a rotating object?

Or is it not possible to do a 3d reconstruction in this way?

0

There are 0 best solutions below