We have contracted out the digitization of features from 3d point cloud. We are in process of defining a quality metric for the digitized data. The features being digitized are building roofs. We already have some obvious elements such as overshoots, undershoots, closed polygons for roof, etc.
I would like to know from other who have been involved in a similar exercise about what could be the quality metric elements as regards the accuracy and precision of the vector data created. What should we check the created geometries against? Please note we don't have any ground truth - we only have the pointcloud and ortho-image. I will really appreciate your comments and inputs and suggestions on what strategy we should follow.