Contribution level determination method, contribution level determination apparatus, and recording medium

Abstract

The invention provides a contribution level determination method, a contribution level determination apparatus, and a recording medium. The starting work can be accelerated by an operator who is delegated by crowdsourcing. The contribution level determination method includes: obtaining, from a first storage device, records of annotation works for each of one or more units of target data for whichthe annotation works carried out by each of workers that use crowdsourcing have been completed; and calculating work contribution levels for each of worker IDs representing a different one of the workers, in accordance with a predetermined weighting rule stored in a second storage device, by referring to the records. In the calculating of the contribution levels, for each of the one or more unitsof target data, the work contribution level is calculated using a heavier weight for the worker ID representing a particular worker who carried out the annotation work initially than for the work contribution levels for the worker IDs representing the workers who carried out annotation works after the particular worker, in the order of the annotation works.

Description

technical field [0001] The present disclosure relates to a contribution degree determination method, a contribution degree determination device, and a recording medium. Background technique [0002] In recent years, a machine learning method called deep learning (Deep Learning), which is a type of neural network, has attracted attention. In deep learning, it is possible to achieve high accuracy by performing learning processing using learning data that includes a set of learning data such as a bounding box indicating the position on the image of the recognition object, a correct label indicating the type of the recognition object, etc., and the image. object recognition. [0003] As a method of preparing a large number of annotated images, there is a method of utilizing crowdsourcing. Here, crowdsourcing is a mechanism for entrusting work (task) to an unspecified number of people (workers) via the Internet. Therefore, by using crowdsourcing, it is possible for multiple wo...

AI Technical Summary

Problems solved by technology

[0008] However, most of the workers entrusted by crowdsourcing are those who work at home, and they work in their own free time, so it may take time to start and complete the entrusted work.

Moreover, even in the above-mentioned Patent Document 1, the incentive to speed up the time until the operator starts and completes the work does not work, so there are cases where it takes time to start and complete the entrusted work.

Images