Results

The contest was performed offsite after the workshop. The participants were provided with the test images through e-mail. They have provided us with the results of their methods in VEC format. The other results were prepared by the authors of this report.

The scores of the first test which include two research prototypes and three commercial software are shown in Table 1. The numbers in bold highlight the highest Dv scores for that image. From the Dv column it is noted that VrLiu’s method has the largest Dv score (on average) and hence it is the best performer in this contest. The second best performer is VPstudio followed by Qgar-Lamiroy at third place. VPstudio scored higher than VrLiu for the image P0096.tif which is the most complex image in the set of test images. All VEC files (except for VrLiu) were prepared or provided to us with arc/circle widths set to 1. This may have resulted in lower Dv scores for these methods.

The scores of the second test (within-method comparison of VPstudio) are shown in Table 2. The numbers in bold highlight the highest Dv scores for that image. From the Dv column of Table 2 it is shown that version 9 scores slightly better than version 8. Version 10 performs better (on average) than the older versions. The differences within these three versions could be visualized by looking at Fig. 1.

For full paper click here.