Evaluation and Ranking

Participants will be asked to provide results in the form of a CSV file. The file should have same number of rows as the number of test images. The first column should be the file name and the 10 next columns should be the IDs of the writers recognized by the system in TOP-1, TOP-2, TOP-3,…., TOP-10 respectively. An example of expected file format is shown in the following.

File Name        TOP-1      TOP-2      TOP-3     ……         ……          ……          TOP-10

test-001            010           014           010         ……          ……          ……          040

test-002            001           035           010         ……          ……          ……          014

test-003            040           010           023         ……          ……          ……          017

……                 ……         ……          ……       ……         ……          ……          ……          

Results will be evaluated using the correct identification rate of the submitted algorithms in terms of TOP-1, TOP-2, TOP-5 and TOP-10. TOP-N means that at least one handwritten image of the same writer is included in the N most similar handwritten images.