Work management device, work management system, work management method, and program

Abstract

It detects and manages the work performed on individual objects using a low-cost system configuration. [Solution] In the work management device, the video acquisition means acquires video data of a work area where multiple workers are present. The information acquisition means acquires individual identification information that identifies the object of work, which is obtained when a worker performs an individual identification task. The detection means detects the tasks performed by each worker from the video data. The management means creates a work record that associates the tasks performed on the object with the individual identification information of the object, based on the individual identification tasks included in the tasks detected from the video data.

Description

Technical Field

[0001] This disclosure relates to a technique for managing work done on an object.

Background Art

[0002] A method of managing work at a work site using video captured by a camera has been proposed. For example, Patent Document 1 discloses a system that classifies and displays the work performed by workers into a plurality of steps based on video data of the work site.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] In the system of Patent Document 1, it is necessary to install a camera for capturing fine movements of the worker, such as the position of the worker's hand, for each worker, and the entire system becomes costly.

[0005] One object of this disclosure is to provide a work management device capable of detecting and managing work done on individual objects with a low-cost system configuration.

Means for Solving the Problems

[0006] In one aspect of this disclosure, the work management device includes video acquisition means for acquiring video data obtained by capturing a work area where a plurality of workers are present, information acquisition means for acquiring individual identification information that is obtained by a worker performing an individual identification operation and that identifies the object of the work, detection means for detecting the work performed by each worker from the video data, The system includes a management means that, based on the individual identification work included in the work detected from the aforementioned video data, creates a work record that associates the work performed on the object with the individual identification information of the object.

[0007] In other aspects of this disclosure, the computer-based work management method is: We acquired video data of a work area where multiple workers were present. The worker obtains individual identification information to identify the object being worked on, through individual identification work performed by the worker. From the aforementioned video data, the tasks performed by each worker are detected. Based on the individual identification work included in the work detected from the aforementioned video data, a work record is created that associates the work performed on the object with the individual identification information of the object.

[0008] In yet another aspect of this disclosure, the program is We acquired video data of a work area where multiple workers were present. The worker obtains individual identification information to identify the object being worked on, through individual identification work performed by the worker. From the aforementioned video data, the tasks performed by each worker are detected. Based on the individual identification work included in the work detected from the aforementioned video data, the computer is instructed to perform a process that creates a work record associated with the individual identification information of the object, for each work performed on the object. [Effects of the Invention]

[0009] According to this disclosure, it becomes possible to detect and manage the work performed on individual objects with a low-cost system configuration. [Brief explanation of the drawing]

[0010] [Figure 1] A schematic diagram of the work management system is shown below. [Figure 2] This is a block diagram showing the hardware configuration of the work management device. [Figure 3] It is a block diagram showing the functional configuration of the work management device. [Figure 4] An example of work record is shown. [Figure 5] An example of the processing when the individual identification work is performed simultaneously is shown. [Figure 6] The information used in the processing when the individual identification work is performed simultaneously is shown. [Figure 7] It is a flowchart of the work record generation process. [Figure 8] The functional configuration of the work management device when displaying the work record is shown. [Figure 9] An example of the display of the work record is shown. [Figure 10] It is a flowchart of the work record display process. [Figure 11] It is a block diagram showing the functional configuration of another work management device. [Figure 12] It is a flowchart of the processing by another work management device.

Mode for Carrying Out the Invention

[0011] <First Embodiment> [Schematic Explanation] (Overall Configuration) FIG. 1 schematically shows an overview of the work management system according to the embodiment. The work management system is provided at a work site where a plurality of workers perform determined work. The work site is, for example, a product manufacturing site, a warehouse for logistics and storage of goods, a construction site, etc. In the following description, a logistics warehouse is assumed as the work site.

[0012] The work management system 1 includes a camera 5, a terminal 7, and a work management device 100. The camera 5 is provided at a position for taking an overhead shot of the area where the worker performs work (hereinafter referred to as the "work area"). The camera 5 may be provided so as to take a picture of the entire work area with one camera, or the work area may be divided into several areas and photographed by a plurality of cameras 5. In FIG. 1, one camera 5 is shown for convenience.

[0013] Terminal 7 is used by worker W to read individual identification information from the object OB being worked on. Individual identification information is identification information that uniquely identifies the object, and may include, for example, the object's serial number, a barcode indicating the serial number, a 2D barcode, a QR code (registered trademark), an RFID tag storing the serial number, or an object fingerprint obtained from the object. Note that "object fingerprint" refers to identification information extracted from an object based on its shape, characteristics, structure, etc. Terminal 7 may be, for example, a smartphone or a dedicated reader equipped with functions such as a barcode reader, RFID reader, and camera.

[0014] When worker W reads individual identification information from object OB using terminal 7, terminal 7 transmits information (hereinafter referred to as "individual identification work information") to work management device 100, which includes the individual identification information obtained from object OB and the time at which that individual identification information was obtained (hereinafter referred to as "individual identification time"). The work of obtaining individual identification information from an object is called "individual identification work".

[0015] The work management device 100 consists of a server and other components and manages the work performed by the workers. Specifically, the work management device 100 identifies the work performed on each object OB based on the video data captured by the camera 5 and the individual identification work information received from the terminal 7, and stores this information in the work management device 100 in association with the individual identification information of that object OB. In this way, the work management device 100 can store a record of what kind of work was done on each object OB (hereinafter referred to as "work record").

[0016] (Example of operation) Next, we will explain an example of the operation of the work management system 1. Let's assume that worker W's objective task is to move object OB from shelf 8a to shelf 8b. Figure 1 schematically shows worker W transporting object OB. Note that "objective task" refers to... These are tasks assigned to each worker W, and they are all tasks except for individual identification tasks among the various types of work.

[0017] First, worker W uses terminal 7 to read individual identification information from object OB located on shelf 8a. Once worker W has read the individual identification information from object OB using terminal 7, terminal 7 transmits individual identification work information, including the individual identification information read from object OB and the individual identification time (the time of reading), to the work management device 100.

[0018] Next, worker W transports the object OB to another shelf 8b, stores it in shelf 8b, and then uses terminal 7 again to read the individual identification information from the object OB. As a result, terminal 7 transmits the individual identification work information to the work management device 100.

[0019] In this manner, worker W reads individual identification information from the object OB using terminal 7 at the start and end of the intended transport operation. As a result, terminal 7 transmits individual identification work information, including the individual identification number and individual identification time, to the work management device 100 at the start time t1 and the end time t2 of the operation.

[0020] Meanwhile, camera 5 transmits video data V of the work area to the work management device 100. The work management device 100 recognizes the work performed by the worker from the video data V and extracts individual identification work from among the recognized various tasks. The work management device 100 then determines the time interval between two individual identification tasks performed on the same object OB, namely the individual identification task at the start of the work and the individual identification task at the end of the work, as the work interval, and acquires information such as the type of work (task name) performed on the object OB during the work interval, and the time the work was performed (task start time and task end time) (hereinafter also referred to as "video-based work information").

[0021] The work management device 100 then compares the individual identification time included in the individual identification work information acquired from the terminal 7 with the start and end times of the work included in the video-based work information. If the two match, it generates a work record that associates the work name with the individual identification time (which matches the work time) for the individual identification information, and stores it in a database or similar.

[0022] The above operations are performed in parallel in an environment where multiple workers are performing their target tasks on individual objects. Therefore, in an environment where multiple workers are individually performing their target tasks, the work management system 1 can distinguish, extract, and store the tasks performed on individual objects based on the overhead view of the work area obtained from the camera 5. Thus, there is no need to provide individual cameras or information reading devices for each worker or individual object, and the entire system can be simplified and cost-effective.

[0023] [Hardware configuration] Figure 2 is a block diagram showing the hardware configuration of the work management device 100. As shown in the figure, the work management device 100 comprises a processor 11, an interface (IF) 12, a ROM (Read Only Memory) 13, a RAM (Random Access Memory) 14, a database (DB) 15, and a recording medium 16. Each component is connected to the others, for example, via a bus 18.

[0024] The processor 11 is a computer such as a CPU (Central Processing Unit) and controls the entire work management device 100 by executing a pre-prepared program. Specifically, the processor 11 can be a CPU, GPU (Graphics Processing Unit), DSP (Digital Signal Processor), MPU (Micro Processing Unit), FPU (Floating Point Number Processing Unit), PPU (Physics Processing Unit), TPU (Tensor Processing Unit), quantum processor, microcontroller, or a combination thereof.

[0025] Furthermore, the processor 11 loads the programs stored in the ROM 13 and recording medium 16 into the RAM 14 and executes each process coded in the programs. The processor 11 functions as part or all of the work management device 100. Specifically, the processor 11 executes the work record generation process and the work record display process, which will be described later.

[0026] IF12 transmits and receives data to and from external devices. Specifically, the work management device 100 receives individual identification work information from terminal 7 via IF12. The work management device 100 also receives video data from camera 5 via IF12. Furthermore, the work management device 100 outputs work records and related video data to external devices such as display devices via IF12.

[0027] ROM 13 stores various programs executed by processor 11. RAM 14 is used as working memory while processor 11 is executing various processes.

[0028] DB15 stores various algorithms, data, machine learning models, etc., that the work management device 100 uses when it performs the work record generation process and the work record display process described later.

[0029] The recording medium 16 is a non-volatile, non-temporary recording medium such as a disk-shaped recording medium or semiconductor memory. The recording medium 16 may be configured to be detachable from the work management device 100. The recording medium 16 stores various programs executed by the processor 11.

[0030] In addition to the above, the work management device 100 may also be equipped with a display device such as a liquid crystal display, and an input device such as a keyboard or mouse. These display devices and input devices are used, for example, by the operator of the work management device 100.

[0031] [Functional Configuration] Figure 3 is a block diagram showing the functional configuration of the work management device 100. As shown in the figure, the work management device 100 comprises a video data storage unit 21, a person detection unit 22, a tracking unit 23, a work recognition unit 24, a work information generation unit 25, and an individual management unit 30. The individual management unit 30 comprises a matching unit 31, an individual identification information storage unit 32, a work record generation unit 33, and a work record storage unit 34. The video data storage unit 21, the individual identification information storage unit 32, and the work record storage unit 34 are implemented by the DB 15 shown in Figure 2. The person detection unit 22, the tracking unit 23, the work recognition unit 24, the work information generation unit 25, the matching unit 31, and the work record generation unit 33 are implemented by the processor 11 shown in Figure 2.

[0032] The video data V captured by camera 5 is stored in the video data storage unit 21. The person detection unit 22 detects workers as people in the video data V and outputs the detection result to the tracking unit 23. The worker detection result may include the worker's features or image. The tracking unit 23 tracks the detected worker in the video data V and outputs the tracking result to the work recognition unit 24. The tracking result may include, for example, the worker's position in each frame image that makes up the video data V.

[0033] The work recognition unit 24 recognizes the work performed by the worker based on the worker tracking results and outputs the work recognition result to the work information generation unit 25. The work recognition unit 24 recognizes the work performed by a person from video footage of the person across multiple frames, for example, using a pre-trained behavior recognition model. For example, if the work site is a logistics warehouse, the work recognition unit 24 recognizes tasks such as picking, packing, and transporting as the intended tasks performed by the worker. Furthermore, the work recognition unit 24 recognizes the aforementioned individual identification task as a task performed by the worker. That is, the work recognition unit 24 recognizes tasks such as picking, packing, and transporting as the intended tasks performed by the worker, as well as the individual identification task, which is the task of reading individual identification information from an object.

[0034] The work information generation unit 25 extracts the individual identification tasks performed by each worker from the multiple tasks recognized by the work recognition unit 24. Specifically, the work information generation unit 25 obtains the times of two consecutive individual identification tasks for each worker, namely the individual identification task at the start of the task and the individual identification task at the end of the task. The work information generation unit 25 then determines the time interval between the time of the individual identification task at the start of the task (referred to as the "work start time") and the time of the individual identification task at the end of the task (referred to as the "work end time") as one work interval, and extracts the tasks performed by that worker within that work interval. For example, in the example in Figure 1, the work information generation unit 25 obtains the work start time t1 and the work end time t2, and extracts "transportation" as the task performed by worker W in work interval t1~t2. The work information generation unit 25 then outputs the extracted work name and work time (work start time and work end time) as video-based work information to the work record generation unit 33 of the individual management unit 30. In this way, the work performed by each worker and the work time are extracted from the video data V and supplied to the work record generation unit 33.

[0035] Meanwhile, individual identification work information is transmitted from terminal 7 to individual management unit 30. Individual identification work information includes individual identification information read by the worker from the object and individual identification time indicating the time of reading. Individual identification information storage unit 32 has in advance stored individual identification information for each object and attribute information such as the type of object. The matching unit 31 compares the individual identification information received from terminal 7 with the individual identification information stored in individual identification information storage unit 32 and determines whether the individual identification information transmitted from terminal 7 matches the individual identification information registered in individual identification information storage unit 32, that is, whether the object read by terminal 7 is correct as the target of the work. If the individual identification information received from terminal 7 matches the individual identification information stored in individual identification information storage unit 32, the matching unit 31 outputs the individual identification work information to the work record generation unit 33. On the other hand, if the individual identification information received from terminal 7 does not match the individual identification information stored in the individual identification information storage unit 32, the object is not suitable for the work, and the matching unit 31 excludes that individual identification information from the work record generation.

[0036] Thus, the work record generation unit 33 receives video-based work information from the work information generation unit 25 and individual identification work information from the matching unit 31. The work record generation unit 33 determines whether the start time and end time of the work included in the video-based work information match the start time and end time of the individual identification work included in the individual identification work information. Here, the matching of times takes into account errors that may occur due to work recognition from video data, and differences within a predetermined error time are treated as matching. If the start time and end time of both match, the work record generation unit 33 determines that the individual identification work information and the video-based work information correspond, and saves the individual identification work information and the video-based work information as work records in the work record storage unit 34. Specifically, the work record generation unit 33 associates the individual identification time (which matches the work time) and the work name included in the video-based work information with the individual identification information included in the individual identification work information and saves them as work records.

[0037] In the above configuration, the person detection unit 22 is an example of a video acquisition means and a detection means, the matching unit 31 is an example of an information acquisition means, and the work record generation unit 33 is an example of a management means.

[0038] [Work log] Figure 4 shows an example of a work record. In this example, the individual identification information of the object, the name of the work performed on that object, and the work time are saved as the work record. In the example in Figure 4, the start time and end time of the work are saved as the work time, but instead, the time required for the work calculated from the start time and end time may be saved, or both may be saved.

[0039] Furthermore, the work record may include worker identification information. For example, if terminal 7 is distributed to each worker, worker identification information can be obtained from terminal 7. Alternatively, workers may be identified by facial recognition or other methods based on video data.

[0040] Furthermore, the work record may include the worker's location information. For example, if terminal 7 is distributed to each worker, the worker's location can be determined using the GPS function of terminal 7. Alternatively, the worker's location may be determined by terminal 7 communicating with beacons distributed throughout the work area, or by using the Wi-Fi function of terminal 7. In addition, the worker's location may be determined based on the video data from camera 5, by determining the worker's position in the camera coordinate system and converting this to world coordinates corresponding to the entire work area.

[0041] [Handling of cases where individual identification is performed simultaneously] Next, we will explain the processing when individual identification work is performed simultaneously by multiple workers. As described above, the work record generation unit 33 associates the individual identification information in the individual identification work information with the work name in the video data when the individual identification time in the individual identification work information matches the work time in the video-based work information. However, if multiple workers perform individual identification work at the start of work and individual identification work at the end of work simultaneously, the work record generation unit 33 will not be able to distinguish the work performed by each worker.

[0042] One solution in this case is for the work record generation unit 33 to generate a work record by associating multiple recognized tasks with the individual identification information of each object. Figure 5 shows an example of this case. As shown in Figure 5, suppose two workers simultaneously perform individual identification tasks at the start and end of a task. Here, suppose one worker performs "cart transport" and the other worker performs "inspection". In this case, the work record generation unit 33 records both tasks, namely "cart transport" and "inspection", for the two individual identification pieces of information. As a result, although it is not possible to distinguish between the two tasks, it is possible to narrow down the possibilities to present to the user.

[0043] Alternatively, the work of each worker can be distinguished by using additional information through the first to third methods described below. Figure 6 shows the information used to determine the work of each worker when individual identification work is performed simultaneously by multiple workers.

[0044] The first method determines the work performed by each worker using worker identification information. Specifically, the work management device 100 identifies workers from their video footage in the video data using facial recognition or the like, obtains worker identification information, and outputs the worker identification information along with the video-based work information to the individual management unit 30. Meanwhile, the terminal 7 obtains worker identification information from its own identification information, includes it in the individual identification work information, and transmits it to the individual management unit 30. The work record generation unit 33 compares the worker identification information included in the video-based work information with the worker identification information included in the individual identification work information to determine what work was performed on each object and generates a work record.

[0045] The second method determines each worker's work using the type of object. Specifically, the work management device 100 recognizes the type of object that appears in the video data along with the worker, and outputs the type of object to the individual management unit 30 in the video-based work information. Meanwhile, the matching unit 31 obtains the type of object from the individual identification information storage unit 32 based on the individual identification information. The work record generation unit 33 then compares the type of object obtained from the individual identification information storage unit 32 with the type of object included in the video-based work information to determine what work was performed on each object and generates a work record.

[0046] The third method determines each worker's work using the worker's location. Specifically, terminal 7 detects the worker's location using GPS or other means and transmits it to the work management device 100 along with individual identification work information. Meanwhile, the person detection unit 22 and tracking unit 23 estimate the worker's location from the video data, and the work information generation unit 25 outputs the worker's location along with the video-based work information to the work record generation unit 33. The work record generation unit 33 compares the worker's location included in the individual identification work information with the worker's location included in the video-based work information to determine which work each of the two workers performed and generates a work record.

[0047] [Work record generation process] Next, the work record generation process by the work management device 100 will be described. Figure 7 is a flowchart of the work record generation process. This process is realized when the processor 11 shown in Figure 2 executes a pre-prepared program and operates as each element shown in Figure 3.

[0048] First, the person detection unit 22 acquires video data V from the video data storage unit 21 (step S11) and detects workers from the video data (step S12). Next, the tracking unit 23 tracks the detected workers in the video data V (step S13). Next, the work recognition unit 24 recognizes the work performed by the worker based on the worker tracking results (step S14). Next, the work information generation unit 25 generates video-based work information including the work name and work time of the recognized work (step S15).

[0049] Meanwhile, the matching unit 31 of the individual management unit 30 acquires the individual identification work information transmitted from the terminal 7 when the worker reads the individual identification information of the object (step S16), and compares the individual identification information contained in the individual identification work information with the individual identification information stored in the individual identification information storage unit 32 (step S17). If the individual identification information contained in the individual identification work information is not stored in the individual identification information storage unit 32, the process ends.

[0050] Next, the work record generation unit 33 compares the individual identification time included in the individual identification work information with the work time included in the video-based work information and determines whether they match (step S18). If they match, the work record generation unit 33 generates a work record by associating the work name included in the video-based work information and the individual identification time included in the individual identification work information with the individual identification information, and saves it in the work record storage unit 34 (step S19). Then the work record generation process ends.

[0051] [Display work log] Next, we will explain the process by which users can view work records. If a problem occurs with an object and the user wants to refer to the work records for that object, the user can specify the object and display the work records.

[0052] (Configuration of the work management device) Figure 8 shows the functional configuration of the work management device 100x when displaying work records. The work management device 100x comprises a video data storage unit 21, a video data extraction unit 26, a display unit 27, and an individual management unit 30. The individual management unit 30 comprises a matching unit 31, an individual identification information storage unit 32, a work record storage unit 34, and a display control unit 35. The video data storage unit 21, the matching unit 31, the individual identification information storage unit 32, and the work record storage unit 34 are the same as those of the work management device 100 shown in Figure 3.

[0053] When a user wishes to refer to the work record, they input the individual identification information of the object into the work management device 100x. The matching unit 31 of the individual management unit 30 compares the input individual identification information with the individual identification information stored in the individual identification information storage unit 32. If no individual identification information matching the input individual identification information exists in the individual identification information storage unit 32, the object is not subject to management by the work management device 100x, and the work management device 100x terminates processing.

[0054] On the other hand, if individual identification information matching the input individual identification information exists in the individual identification information storage unit 32, the matching unit 31 outputs that individual identification information to the display control unit 35. The display control unit 35 controls the display of the work record of the object corresponding to the input individual identification information. Specifically, the display control unit 35 first reads the work record corresponding to the individual identification information from the work record storage unit 34, generates a work history based on the work name and work time included in the work record, and outputs it to the display unit 27.

[0055] Furthermore, the display control unit 35 can display statistical information based on work records in response to user requests. For example, the display control unit 35 may determine, based on the work records, whether multiple tasks performed on a certain object were performed in the correct order, whether the tasks performed on a certain object were performed within the normal average working time, that is, whether they were performed in an abnormally long or short time, and display the results of that determination.

[0056] Furthermore, if the user requests the display of work video corresponding to a task in the work history, the display control unit 35 outputs the work section corresponding to the task name and work time in the work record to the video data extraction unit 26. The video data extraction unit 26 extracts video data for the specified work section. That is, the video data extraction unit 26 cuts out the video for the work section from the video data V and displays it as work video on the display unit 27.

[0057] In the above configuration, the display control unit 35 is an example of a work record acquisition means and a work history output means, and the video data extraction unit 26 is an example of a video output means.

[0058] (Example of work record display) Figure 9 shows an example of a work record display. In this example, the user has specified an object with individual identification information "052," and the work history for this object is displayed. The work history shows the work performed on the object in chronological order. When the user selects a task in the work history, the video of that task interval is displayed as a work video. For example, in the example in Figure 9, when the user clicks on the bars for "picking," "packing," and "transporting" in the work history, the work management device 100x displays the work video corresponding to the selected task. In the example in Figure 9, the user has selected "transporting" as the task, and the work video of the transporting operation of the object is displayed.

[0059] (Work record display processing) Figure 10 is a flowchart of the work record display process. This process is achieved when the processor 11 shown in Figure 2 executes a pre-prepared program and operates as each element shown in Figure 8.

[0060] First, the user inputs the individual identification information of the object of interest into the work management device 100x, and the work management device 100x acquires the input individual identification information (step S21). Next, the matching unit 31 compares the input individual identification information with the individual identification information stored in the individual identification information storage unit 32 (step S22). If the input individual identification information does not exist in the individual identification information storage unit 32 (step S22: No), the process ends because there is no work record for the object corresponding to the individual identification information entered by the user.

[0061] On the other hand, if the input individual identification information exists in the individual identification information storage unit 32 (step S22: Yes), the display control unit 35 obtains the work record corresponding to the input individual identification information from the work record storage unit 34 (step S24). Next, the display control unit 35 creates a work history from the work record as illustrated in Figure 9 and displays it on the display unit 27 (step S25).

[0062] Next, the work management device 100x determines whether or not the user has requested the display of work video (step S26). If there is no request to display work video (step S26: No), the process ends. On the other hand, if there is a request to display work video (step S26: Yes), the display control unit 35 outputs the work time of the work specified by the user to the video data extraction unit 26. The video data extraction unit 26 extracts the work video corresponding to the input work time from the video data (step S27) and displays it on the display unit 27 (step S28). Then, the process ends.

[0063] [Differentiation] (Variation 1) In the above embodiment, the work management device 100x for displaying work records is described separately from the work management device 100 for generating work records. However, in practice, a work management device that combines the functions of both the work management device 100 and the work management device 100x may be configured.

[0064] (Modification 2) In the above embodiment, individual worker uses a terminal 7 to read individual identification information from the object. Alternatively, a dedicated terminal device such as a reader or camera for reading individual identification information may be provided, and each worker may share this terminal device to read the individual identification information.

[0065] [Examples of application] Next, we will describe an example of the application of the work management system of the embodiment. (1) Work assurance in the manufacturing and distribution industries The above work management system can be used for work assurance in manufacturing and distribution industries. Specifically, it can trace the actual work performed during the product manufacturing process using the individual identification information (product ID, etc.) of each product. Furthermore, if a product defect or faulty item is discovered, it can quickly identify at which stage of the product's manufacturing or distribution process the defect or fault occurred. Moreover, in response to customer complaints regarding defective or faulty products, work records can be used to prove that each manufacturer and distributor involved in the production of the product performed their work correctly.

[0066] (2) Use in fair trade Fair trade refers to a system or movement that promotes fair trade while paying fair wages to producers and workers in developing countries and supporting sustainable livelihoods. Fair trade aims to correct economic inequalities and enable producers to lead stable lives. From this perspective, by using the work management system described in the implementation example, it becomes possible to trace from the finished product whether the target product was produced under appropriate labor conditions by linking the actual labor (actual work) performed in the process of making the product to the product itself. For example, when granting certification, fair trade certification bodies can appropriately determine whether or not to certify a product by tracing the manufacturing process of each individual product.

[0067] (3) Use in product branding Product branding refers to a series of strategic activities that give a product or service a unique identity and communicate its value to consumers. By clearly differentiating a product from other competing products and making it easily recognizable to customers, it becomes possible to establish itself as a brand of choice. From this perspective, the work management system of this embodiment can be used to identify from the final product which producers or manufacturers were involved in the production or manufacturing of the product. By understanding the manufacturing process based on work records, the manufacturers and workers involved in the production of that product can be identified. For example, by showing that manufacturers or workers with a certain level of recognition or fame were involved in the production, it is possible to demonstrate the brand value of the product. Furthermore, based on work records, the value of the product can be appealed by showing that it has undergone inspections by reliable inspection agencies or has received certification from government-accredited certification bodies.

[0068] <Second Embodiment> Figure 11 is a block diagram showing the functional configuration of a work management device 70 according to another example of the present disclosure. The work management device 70 comprises an image acquisition means 71, an information acquisition means 72, a detection means 73, and a management means 74.

[0069] Figure 12 is a flowchart of the processing performed by the work management device 70. The video acquisition means 71 acquires video data of a work area where multiple workers are present (step S71). The information acquisition means 72 acquires individual identification information that identifies the object of work, which is obtained when workers perform individual identification work (step S72). The detection means 73 detects the work performed by each worker from the video data (step S73). The management means 74 creates a work record that associates the work performed on the object with the individual identification information of the object, based on the individual identification work included in the work detected from the video data (step S74).

[0070] Some or all of the above embodiments may also be described as follows, but are not limited to the following:

[0071] (Note 1) A video acquisition means that acquires video data of a work area where multiple workers are present, Information acquisition means that acquires individual identification information that identifies the object of work, obtained by a worker performing individual identification work, A detection means for detecting the work performed by each worker from the aforementioned video data, A management means that creates a work record associated with the individual identification information of the object, based on the individual identification work included in the work detected from the aforementioned video data, A work management device equipped with the following features.

[0072] (Note 2) The management means is a work management device according to Appendix 1, which associates the work performed on the object in the interval between the start of the target work and the end of the target work, with the individual identification information of the object, among the work detected from the video data.

[0073] (Note 3) The information acquisition means acquires a first individual identification time, which is the time when the worker performed individual identification at the start of the target work, and a second individual identification time, which is the time when the worker performed individual identification at the end of the target work. The management means is a work management device according to Appendix 2, which associates the work performed on the object between the start individual identification work performed at a time coinciding with the first individual identification work time and the end individual identification work performed at a time coinciding with the second individual identification work time with the individual identification information of the object.

[0074] (Note 4) The information acquisition means acquires the individual identification work time, which is the time when the worker performed the individual identification work to acquire the individual identification information. The management means is a work management device according to any one of the appendices 1 to 3, which associates the work performed by each worker with the individual identification information of each object when individual identification work is performed simultaneously on multiple objects by multiple workers at the time of individual identification work.

[0075] (Note 5) The information acquisition means acquires the individual identification work time, which is the time when the worker performed the individual identification work to acquire the individual identification information. The management means, when individual identification work is performed on multiple objects simultaneously by multiple workers at the time of individual identification work, determines the work performed on each object based on the identification information of each worker, the type of each object, or the location of each worker, and associates it with each object, as described in any one of the appendices 1 to 3.

[0076] (Note 6) The management means stores the work record in the storage unit, A work record acquisition means that acquires individual identification information of an object and acquires work records corresponding to said individual identification information from the storage unit, A work history output means that outputs a work history showing the work performed on the object based on the work record, A work management device according to any one of the appendices 1 to 5, comprising:

[0077] (Note 7) The work management device according to Appendix 6, further comprising a video output means for extracting and outputting video of the section corresponding to the work included in the work history from the video data.

[0078] (Note 8) A work management device described in any one of the items 1 to 7 of the appendix, The aforementioned individual identification operation includes a terminal device for the operator to read the individual identification information from the object, The information acquisition means is a work management system that acquires the individual identification information from the terminal device.

[0079] (Note 9) A work management method performed by a computer, We acquired video data of a work area where multiple workers were present. The worker obtains individual identification information to identify the object being worked on, through individual identification work performed by the worker. From the aforementioned video data, the tasks performed by each worker are detected. A work management method that creates a work record associated with the individual identification information of an object, based on the individual identification work included in the work detected from the aforementioned video data.

[0080] (Note 10) We acquired video data of a work area where multiple workers were present. The worker obtains individual identification information to identify the object being worked on, through individual identification work performed by the worker. From the aforementioned video data, the tasks performed by each worker are detected. A program that causes a computer to perform a process to create a work record that associates the work performed on the object with the object's individual identification information, based on the individual identification work included in the work detected from the aforementioned video data.

[0081] Furthermore, some or all of the configurations described in Appendices 2 to 8, which are subordinate to Appendice 1 above, may also be subordinate to Appendices 9 and 10 in the same way as those described in Appendices 2 to 8. Moreover, not limited to Appendices 1, 9, and 10, some or all of the configurations described as appendices may also be subordinate to various hardware, software, various recording means for recording software, or systems, without departing from the embodiments described above.

[0082] Although the present disclosure has been described above with reference to embodiments and examples, the present disclosure is not limited to the above embodiments and examples. Various modifications to the structure and details of the present disclosure can be understood by those skilled in the art within the scope of the present disclosure. [Explanation of Symbols]

[0083] 1. Work Management System 5 Cameras 7 terminals 11 processors 21 Video data storage unit 22 Person Detection Department 23 Tracking Department 24 Work Recognition Unit 25 Work information generation section 26 Video data extraction unit 27 Display section 30 Individual Management Department 31 Verification section 32 Individual Identification Information Storage Unit 33 Work Record Generation Unit 34 Work Record Storage Department 35 Display Control Unit 100, 100x work management device

Claims

1. A video acquisition means that acquires video data of a work area where multiple workers are present, Information acquisition means that acquires individual identification information that identifies the object of work, obtained by a worker performing individual identification work, A detection means for detecting the work performed by each worker from the aforementioned video data, A management means that creates a work record associated with the individual identification information of the object, based on the individual identification work included in the work detected from the aforementioned video data, A work management device equipped with the following features.

2. The work management device according to claim 1, wherein the management means associates the work performed on the object in the interval between the start of the target work on the object and the end of the target work with the individual identification information of the object, among the work detected from the video data.

3. The information acquisition means acquires a first individual identification time, which is the time when the worker performed individual identification at the start of the target work, and a second individual identification time, which is the time when the worker performed individual identification at the end of the target work. The work management device according to claim 2, wherein the management means associates the work performed on the object between the start individual identification work performed at a time coinciding with the first individual identification work time and the end individual identification work performed at a time coinciding with the second individual identification work time with the individual identification information of the object.

4. The information acquisition means acquires the individual identification work time, which is the time when the worker performed the individual identification work to acquire the individual identification information. The work management device according to claim 1, wherein the management means associates the work performed by each worker with the individual identification information of each object when individual identification work is performed simultaneously on multiple objects by multiple workers at the time of individual identification work.

5. The information acquisition means acquires the individual identification work time, which is the time when the worker performed the individual identification work to acquire the individual identification information. The work management device according to claim 1, wherein, when individual identification work is performed on multiple objects simultaneously by multiple workers at the time of individual identification work, the management means determines the work performed on each object based on the identification information of each worker, the type of each object, or the location of each worker, and associates it with each object.

6. The management means stores the work record in the storage unit, A work record acquisition means that acquires individual identification information of an object and acquires work records corresponding to said individual identification information from the storage unit, A work history output means that outputs a work history showing the work performed on the object based on the work record, The work management device according to claim 1, comprising:

7. The work management device according to claim 6, further comprising a video output means for extracting and outputting video of the section corresponding to the work included in the work history from the video data.

8. The work management device according to claim 1, The aforementioned individual identification operation includes a terminal device for the operator to read the individual identification information from the object, The information acquisition means is a work management system that acquires the individual identification information from the terminal device.

9. A work management method performed by a computer, We acquired video data of a work area where multiple workers were present. The worker obtains individual identification information to identify the object being worked on, through individual identification work performed by the worker. From the aforementioned video data, the tasks performed by each worker are detected. A work management method that creates a work record associated with the individual identification information of an object, based on the individual identification work included in the work detected from the aforementioned video data.

10. We acquired video data of a work area where multiple workers were present. The worker obtains individual identification information to identify the object being worked on, through individual identification work performed by the worker. From the aforementioned video data, the tasks performed by each worker are detected. A program that causes a computer to perform a process to create a work record that associates the work performed on the object with the individual identification information of the object, based on the individual identification work included in the work detected from the aforementioned video data.

Images