Task Inspection
Last updated
Was this helpful?
Last updated
Was this helpful?
The last step of the annotation workflow is inspection. Team owner/admins are required to perform quality inspection. If the inspection action is accepted, the annotations will be merged into the dataset. Otherwise, if rejected, the task annotations will have to be reworked.
Inspection action will only appear when the task status is at inspection
. Below are the steps to perform the inspection.
Click "Annotation" on the side bar to navigate to the list of tasks. Click on the task you want to do inspection.
2. In the "Data" tab of the task, click "Inspection" button on the right-hand side.
3. Provide the inspection sampling rate and click "OK"
4. Double-click on any item to start the inspection.
At the top bar, there are 2 arrows to navigate between items in the task.
To create issues, please refer to these sections:
To fix minor errors in the annotations, you may toggle "Edit mode" here.
On the top right corner, there are 2 buttons "Reject" or "Accept" to either reject or accept the current item.
"Accept" means moving the item to complete.
"Reject" means the item will be sent back to annotation.
5. After looking through the items, escape to the list view. Note that you can submit inspection anytime and do NOT need to inspect through all the sampled items. Click on "Submit Inspection" button on the upper right-hand side to submit the final decision, whether to accept or reject the whole task.
"Accept": The whole task will be moved to complete.
"Reject": All the items (excluding items already been accepted during inspection) will be sent to annotation stage for re-work.