Methods are provided for a hierarchical multi-object tracker for automatic
annotation. Some methods include generating trajectory segments based on detections in sensor data. A weighted graph of trajectories is generated based on the trajectory segments, and the weighted graph is converted to a
bipartite graph. The
bipartite graph is solved to determine at least one optimal
path cover corresponding to respective observed objects, and the detections in the sensor data are annotated with trajectory identifiers corresponding to trajectories representing the optimal
path cover of the respective observed objects. Systems and
computer program products are also provided.