Using the Task System

Using the Task System

The Task System is is used to pipeline data from its initial raw form into a final labelled dataset. It has 3 stages: Annotate, Review, Verify. These stages are used to ensure only high quality data enters the final dataset while allowing managers to verify progress and quality as work is completed.

  • Task’s for a project have been created (Learn More)

Getting Started

To open the task system click on the task icon from anywhere in the annotator.

Screen Shot 2022-03-13 at 3.11.17 pm.png
Task Icon

You now are in the task dashboard. This Board is split into 3 sections.

  • Tasks you own
  • Tasks delegated to you
  • Tasks completed

Tasks you own

The main functionality on this tile is in the top right statistic symbol which will take you to the task overview and give you access to more functionality.

Screen Shot 2022-03-27 at 9.41.33 am.png
Tasks owned by you Tile (underlined in red takes you to the task overview)

Tasks delegated to you.

There there are 3 actions you can take. Open the task system as an annotator, reviewer or validator.Only the jobs that are available to you will be available. A task that you have access to but does not yet have allocated to it will appear as greyed out. For example if no images have been sent to be reviewed yet then the review stage is not accessible. The 3 portals purpose and differences are as described

  • Annotator – Create the raw polygon and initial classification of each polygon
  • Reviewer – Review polygon and classification and ensure annotation high quality
  • Validator – Final check to confirm data is correct and polygon is high quality. Image is now validated

The 3 portals can be seen and are accessible on each task tile delegated to you under the “Tasks you are assigned to”  title.

Screen Shot 2022-03-27 at 9.34.29 am 2.png
Tasks assigned to you (Underlined in red takes you to the annotator mode)

Annotator Mode

The Annotator’s role is to create the polygons and set a class for each. Once completed the image is sent to the Review stage
Special Functionality:

  • Directed Polygon Validation Mode
  • Send to Reviewer
Screen Shot 2022-03-13 at 3.45.37 pm.png
Annotator View

Reviewer Mode

The Reviewer role is a middleman step to check polygon quality and label accuracy. Small changes are ofter made here as this role is often taken by an expert in the related dataset field. Once completed the image is sent to the Validation stage
Special Functionality:

  • Directed Polygon Validation Mode
  • Send back to annotator
  • Send to Verifier
Screen Shot 2022-03-13 at 3.45.58 pm.png
Reviewer View

Validator Mode

The Validator role is to provide the final check on each image and validate it. This the equivalent of clicking the “tick” icon for an image in the default annotation portal. At this point the images will be added into the training pool.
Special Functionality:

  • Directed Polygon Validation Mode
  • Send back to annotator
  • Send back to reviewer
  • Validate Image
Screen Shot 2022-03-13 at 3.46.32 pm.png
Validator View
Scroll to Top