Embodiments of the innovation relate to a method for generating a labeled object
data set. The method comprises receiving a task performance video, playing the task performance video in reverse, and for each video frame of the task performance video, applying a
mask to images of the objects within the object
stream. The method further comprises identifying an object entering a first video frame of the task performance video along a direction perpendicular to a direction of the object
stream, in response to detecting motion of the identified object from the first video frame of the task performance video to a second video frame of the task performance video along the
perpendicular direction, designating the object as an object of interest, and storing
mask segmentation data associated with the
mask of the object of interest as part of the labeled object
data set.