Mrinal K. Paul and Stergios Roumeliotis (PI)
The goal of this project is to generate a semi-dense 3D map of an area, given as prior the camera pose estimates from a sparse visual-inertial batch least squares (BLS) cooperative-mapping (CM) algorithm. Specifically:
To densify the map, we consider all pixels that have a large gradient along the epipolar line
To track features, we perform sub-pixel stereo matching between consecutive keyframes; matches are found using the sum of squared distance (SSD) error measured over a linear patch of five equidistant points on the epipolar line
Outlier rejection is based on the convexity of the photometric cost function, uncertainty of the inverse depth estimate, and depth inconsistency in the neighbourhood of the feature
Inlier feature tracks are processed using BLS to refine the feature estimates. In this step, instead of a constant measurement noise for the dense features, we use the inverse of the information matrix, whose diagonal elements are proportional to the features' local intensity gradients (gx, gy)
[video unavailable]
P1. C.X. Guo, R.C. DuToit, K. Sartipi, G.Georgiou, R. Li, J. O'Leary, E.D. Nerurkar, J.A. Hesch, and S.I. Roumeliotis, "Resource-Aware Large-Scale Cooperative 3D Mapping from Multiple Cell Phones," In ICRA Late Breaking Results Poster, Washington, May. 26-30, 2015.