Work analysis device, work analysis method, and program

Abstract

To provide a work analysis device, a work analysis method, and a program capable of analyzing a work time of a worker for a moving workpiece.SOLUTION: A work analysis device 100 generates and outputs information on a work execution status of a worker M who works in a manufacturing line including a plurality of processes A, B, and C, using an image obtained by capturing the worker M, and includes an acquisition unit 11 that acquires the image, a setting unit 15 that sets, around a workpiece W, a work area WA in which the worker M performs work on the workpiece W, a calculation unit 23 that calculates a work time of the worker M based on when the worker M enters the work area WA and when the worker M exits the work area WA, and an output unit 26 that outputs the work time.SELECTED DRAWING: Figure 3

Description

[Technical Field]

[0001] The present disclosure relates to a task analysis device, a task analysis method, and a program for analyzing tasks. [Background technology]

[0002] Conventionally, there has been known a work analysis device that analyzes the work status of workers working on a production line. For example, Patent Document 1 describes a personnel management system that includes a radio wave oscillator carried by the worker, receivers installed at various locations in the workplace where the worker works, and an information analysis device that manages the work performance of the worker in the workplace. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Laid-Open No. 2016-177591 Summary of the Invention [Problem to be solved by the invention]

[0004] However, with the personnel management system of Patent Document 1, it is difficult to analyze the working time that a worker spends working on a moving workpiece.

[0005] Therefore, the present disclosure provides an operation analysis device, an operation analysis method, and a program that are capable of analyzing the operation time of a worker on a moving workpiece. [Means for solving the problem]

[0006] A work analysis device according to a first aspect of the present disclosure is a work analysis device that uses images of a worker working on a production line including multiple processes to generate and output information regarding the status of work being performed by the worker, and includes: an acquisition unit that acquires the images; a setting unit that sets, based on the images, a work area in which the worker will work on a workpiece around the workpiece as it passes through a specific process area where a specific process of the multiple processes is performed; a determination unit that determines, based on the images, the time when the worker enters the work area as an entry time and the time when the worker exits the work area as an exit time; a calculation unit that calculates the work time of the worker in the specific process based on the determination result by the determination unit; and an output unit that outputs the work time calculated by the calculation unit.

[0007] A work analysis method according to a second aspect of the present disclosure is a work analysis method that uses an image of a worker working on a production line including multiple processes to generate and output information regarding the status of work being performed by the worker, and includes the steps of: acquiring the image; setting, based on the image, a work area in which the worker will work on a workpiece around the workpiece as it passes through a specific process area where a specific process among the multiple processes is performed; determining, based on the image, the time when the worker enters the work area as the time of entry, and determining the time when the worker exits the work area as the time of exit; calculating the work time of the worker in the specific process based on the determination result of the determining step; and outputting the work time.

[0008] A program according to a third aspect of the present disclosure causes a computer to execute the above task analysis method.

[0009] These comprehensive or specific aspects may be realized as a system, a method, an integrated circuit, a computer program, or a computer-readable recording medium such as a CD-ROM, or may be realized as any combination of the system, the method, the integrated circuit, the computer program, and the recording medium. The recording medium may also be a non-transitory recording medium. [Effects of the Invention]

[0010] According to the present disclosure, it is possible to provide an operation analysis device, an operation analysis method, and a program that are capable of analyzing the operation time of a worker on a moving workpiece. [Brief explanation of the drawings]

[0011] [Figure 1] FIG. 1 is a diagram showing an example of the overall configuration of a task analysis system including a task analysis device according to an embodiment. [Figure 2] FIG. 2 is a diagram for explaining the production line and the imaging by the camera. [Figure 3] FIG. 3 is a block diagram showing an example of the configuration of the work analysis device. [Figure 4] FIG. 4 is a diagram showing an example of an image. [Figure 5] FIG. 5 is a diagram showing the operation flow of the work analysis device. [Figure 6] FIG. 6 is a detailed flowchart of step S1 in FIG. [Figure 7] FIG. 7 is a diagram showing an example of a movement model of a workpiece and a worker. [Figure 8] FIG. 8 is a diagram showing an example of a movement model of a workpiece and a worker. [Figure 9] FIG. 9 is a diagram illustrating an example of a movement model of a workpiece and a worker. [Figure 10] FIG. 10 is a diagram illustrating an example of a movement model of a workpiece and a worker. [Figure 11] FIG. 11 is a diagram showing an example of a movement model of a workpiece and a worker. [Figure 12]FIG. 12 is a diagram for explaining the times when workers enter and leave the process area. [Figure 13] FIG. 13 is a diagram showing data relating to the entry and exit times of workers to and from the process area. [Figure 14] FIG. 14 is a diagram for explaining the times when workers enter and leave the work area. [Figure 15] FIG. 15 is a diagram showing data relating to the entry and exit times of workers to and from the work area. [Figure 16] FIG. 16 is a diagram showing information associating value-added work time, incidental work time, and total work time for each work. [Figure 17] FIG. 17 is a detailed flowchart of step S2 of FIG. 5 according to the first embodiment. [Figure 18] FIG. 18 is a detailed flowchart of step S2 of FIG. 5 according to the second embodiment. [Figure 19] FIG. 19 is a diagram for explaining the entry and exit times of workers to and from the work area in the second embodiment. [Figure 20] FIG. 20 is a diagram showing data relating to the entry and exit times of workers to and from the work area in the second embodiment. [Figure 21] FIG. 21 is a block diagram showing an example configuration of an operation analysis device according to a modified example of the present disclosure. DETAILED DESCRIPTION OF THE INVENTION

[0012] Hereinafter, the embodiments will be described in detail with reference to the drawings.

[0013] The embodiments described below are all comprehensive or specific examples. The numerical values, shapes, materials, components, component placement and connection configurations, steps, and step order shown in the following embodiments are merely examples and are not intended to limit the present disclosure. Furthermore, among the components in the following embodiments, components that are not described in the independent claims that represent the highest concepts are described as optional components. Furthermore, each drawing is a schematic diagram and is not necessarily an exact illustration. Furthermore, the same components are designated by the same reference numerals in each drawing.

[0014] (Embodiment) FIG. 1 is a diagram showing an example of the overall configuration of an work analysis system 200 including a work analysis device 100 according to an embodiment.

[0015] The work analysis system 200 in this embodiment is a system that analyzes the work of each of multiple workers working on, for example, a production line. The work analysis system 200 includes, for example, a work analysis device 100, a display unit 1, an input unit 2, and a camera 3.

[0016] The display unit 1 is, for example, an LCD (Liquid Crystal Display). However, the display unit 1 may also be a device other than an LCD, such as an organic light-emitting diode (electroluminescence) or a plasma display. Such a display unit 1 displays an image according to the image signal output from the work analysis device 100.

[0017] The input unit 2 is configured as, for example, a keyboard, a touch sensor, a touchpad, or a mouse, and receives an input operation by a user and outputs an input signal to the work analysis device 100 in accordance with the input operation.

[0018] The camera 3 captures images of multiple workers working on the above-mentioned production line and outputs the images obtained by capturing the images to the work analysis device 100. Specifically, the camera 3 has an imaging unit 3a (see FIG. 3) that captures an image of a subject, and a storage unit 3b (see FIG. 3) that stores the images captured by the imaging unit. Note that in this embodiment, the images include not only still images but also moving images.

[0019] The work analysis device 100 acquires images from the camera 3 and, based on the images, analyzes the work performed by the worker shown in the images. The work analysis device 100 then outputs image signals indicating the analysis results to the display unit 1.

[0020] Next, a production line and imaging by camera 3 will be described with reference to FIG. 2. FIG. 2 is a diagram for explaining a production line and imaging by camera 3. The production line includes multiple processes. The multiple processes include, for example, process A, process B, process C, etc. Furthermore, in each process, worker M performs one or more tasks. Worker M is in charge of, for example, one process. Furthermore, multiple workers M may be in charge of one process. In the following description, for ease of understanding, an example will be described in which the production line has three processes (process A, process B, and process C).

[0021] A process area is set in advance for each process. Specifically, for example, a process area A1, a process area B1, and a process area C1 are set for process A, process B, and process C. Note that there may or may not be a gap between adjacent process areas as shown in FIG. 2.

[0022] In this embodiment, the workpiece W, which is the object to be worked on, is transported at a constant speed through a plurality of process areas A1 to C1 in order using a conveyor or the like (not shown). The workpiece W is not particularly limited, but may be, for example, an automobile or electrical appliance in the middle of assembly.

[0023] Typically, for example, process B is performed within process area B1. However, for example, if worker M has difficulty with the work, the work of process B may not be completed within process area B1 and may take until process area C1. On the other hand, for example, if worker M completes the work smoothly, worker M may start work of process B within process area A1 before the next work W enters process area B1. In addition, worker M may move outside process area B1 (for example, to the upper side of FIG. 2), for example, to get a tool from a toolbox.

[0024] In the following, a case will be described in which the work analysis device 100 calculates the task time for process B. For this reason, process B may be referred to as a specific process B.

[0025] For example, a plurality of cameras 3 are provided. For example, the plurality of cameras 3 are assigned to a plurality of processes, respectively. That is, for example, one camera 3 captures an image capture area including one process area. In this embodiment, for example, the image capture area including process area B1 includes not only process area B1, but also the area after process area A1 (the area adjacent to process area B1) and the area before process area C1 (the area adjacent to process area B1). Note that one camera 3 may capture an image capture area including two or more process areas, or two or more cameras 3 may capture an image capture area including one process area.

[0026] The work analysis device 100 acquires images captured by multiple cameras 3 and analyzes the implementation status of the work being performed in each process.

[0027] Next, the configuration of the work analysis device 100 will be described with reference to Fig. 3 and Fig. 4. Fig. 3 is a block diagram showing an example of the configuration of the work analysis device 100. Fig. 4 is a diagram showing an example of an image.

[0028] The work analysis apparatus 100 includes an information processing unit 10 and a storage unit 30. The information processing unit 10, for example, processes information in the work analysis apparatus 100 and controls the operations performed by the work analysis apparatus 100. The information processing unit 10 is, for example, configured by a processor. The processor is, for example, configured by a CPU or a CPU and a GPU.

[0029] The memory unit 30 stores various data. The memory unit 30 is, for example, a storage device that stores control programs executed by the information processing unit 10. The memory unit 30 has a hard disk drive, a RAM (Random Access Memory), a ROM (Read Only Memory), or a semiconductor memory. In this embodiment, the memory unit 30 stores information related to process areas in advance. The information related to process areas is, for example, coordinate information indicating the position of each process area.

[0030] The information processing unit 10 has, as functional components, for example, at least an acquisition unit 11, a setting unit 15, a determination unit 21, a calculation unit 23, and an output unit 26. In this embodiment, the information processing unit 10 has the acquisition unit 11, an object detection unit 12, a work tracking unit 13, a worker tracking unit 14, a setting unit 15, a determination unit 21, a measurement unit 22, a calculation unit 23, an addition unit 24, a first identification unit 25, and an output unit 26.

[0031] The acquisition unit 11, object detection unit 12, work tracking unit 13, worker tracking unit 14, and setting unit 15 function as an image processing unit 10A that performs predetermined processing on the image captured by the camera 3. On the other hand, the determination unit 21, measurement unit 22, calculation unit 23, addition unit 24, first identification unit 25, and output unit 26 function as a work information processing unit 10B that analyzes the work of worker M based on the processing results performed by the image processing unit 10A.

[0032] The acquisition unit 11 acquires information from the camera 3. Specifically, the acquisition unit 11 acquires an image from the camera 3. The image shows a working part, which is at least a part of the worker M performing work, in the imaging area. The image information acquired by the acquisition unit 11 is stored in the storage unit 30.

[0033] The object detection unit 12 detects an object from the image. The object is, for example, a workpiece W and a worker M. For example, as shown in FIG. 4, the object detection unit 12 may add a workpiece detection frame F1 indicating the detected workpiece W to the image.

[0034] The object detection unit 12 may also add a worker detection frame F2 indicating the detected worker M to the image. The object detection unit 12 also detects the workpiece W and the worker M for each image acquired by the acquisition unit 11. At this time, the object detection unit 12 may also detect feature amounts of the workpiece W and the worker M.

[0035] The object detection unit 12 may indicate that it is a workpiece W by a mark or method other than the workpiece detection frame F1. Similarly, the object detection unit 12 may indicate that it is a worker M by a mark or method other than the worker detection frame F2.

[0036] In addition, the object detection unit 12 may output to the work tracking unit 13 and the worker tracking unit 14, as position time series information, information showing the change over time in the position of the work detection frame F1 and the worker detection frame F2 displayed in the image, i.e., information showing the movement of the work detection frame F1 and the worker detection frame F2 in time series.

[0037] 3, the work tracking unit 13 tracks the work W based on information (for example, position time-series information) from the object detection unit 12. Then, the work tracking unit 13 stores the coordinate information of the work W at each time in the storage unit 30. Note that the work tracking unit 13 may be configured to track the work W based on the detection result of the work W by the object detection unit 12 other than the work detection frame F1.

[0038] The worker tracking unit 14 tracks the worker M based on information (for example, position time-series information) from the object detection unit 12. Then, the worker tracking unit 14 stores the coordinate information of the worker M at each time in the storage unit 30. Note that the worker tracking unit 14 may be configured to track the worker M based on the detection result of the worker M by the object detection unit 12 other than the worker detection frame F2.

[0039] The coordinate system used in this embodiment (the coordinate system used by the work tracking unit 13 and the worker tracking unit 14) may be, for example, a camera coordinate system used for image recognition, or a world coordinate system in which camera coordinates are projected onto a map.

[0040] The setting unit 15 sets a work area WA (see FIG. 4) around the workpiece W where the worker M working on the workpiece W will work. Specifically, the setting unit 15 sets the work area WA around the workpiece W passing through the process area B1 based on information from the object detection unit 12. The work area WA is set for each image. Therefore, the work area WA also moves as the workpiece W moves. The work area WA is, for example, an area within a predetermined distance outward from the workpiece detection frame F1. Note that the work area WA may also be an area within a predetermined distance outward from the outer periphery of the workpiece W, the workpiece detection frame F1. In this embodiment, the work area WA is set to surround the periphery of the workpiece W, but it does not have to surround the periphery of the workpiece W. Furthermore, the setting unit 15 stores the work area WA set for each image in the memory unit 30.

[0041] Based on the image, the determination unit 21 determines that the time when the worker M enters the specific process area B1 where the specific process B is performed is the time of entry. The determination unit 21 also determines that the time when the worker M exits the specific process area B1 is the time of exit.

[0042] Furthermore, the determination unit 21 determines, based on the image, when the worker M enters the work area WA as an entry time, and when the worker M exits the work area WA as an exit time.

[0043] The measurement unit 22 measures the stay time of the worker M in the specific process B based on the determination result by the determination unit 21. Specifically, based on the determination result by the determination unit 21, the measurement unit 22 measures, for example, the time spent in the specific process area B1, and sets this as the stay time.

[0044] The calculation unit 23 measures the working time of the worker M in the working area WA based on the determination result by the determination unit 21. Specifically, based on the determination result by the determination unit 21, the calculation unit 23 measures, for example, the time spent entering the working area WA, and sets this as the working time.

[0045] Furthermore, based on the determination result by the determination unit 21, the calculation unit 23 measures the absence time during which the worker M is outside the work area WA between the time of entry and the time of exit.

[0046] In addition, when worker M enters or leaves other process areas (e.g., process areas A1 and C1) where processes other than specific process B (e.g., process A and process C) are performed, the calculation unit 23 calculates the working time of worker M in the other process areas.

[0047] Furthermore, the calculation unit 23 may determine that work on the workpiece W has been completed when the worker M does not return to the work area WA for a certain period of time or longer, and may set the subsequent work time on the workpiece W to zero. Furthermore, the calculation unit 23 may determine that work on the workpiece W has been completed when the workpiece W has moved outside the imaging area, for example.

[0048] The addition unit 24 adds the absence time as the worker M's working time if the absence time is within a second threshold value (for example, 3 seconds).

[0049] Furthermore, the adding unit 24 adds up the working time of the worker M in other process areas (for example, process areas A1 and C1) as the working time in the specific process B.

[0050] The first identification unit 25 identifies a worker M whose working time for a specific process B or the time spent in a specific process area B1 exceeds a first threshold as the worker in charge of the specific process B.

[0051] The first threshold value is an absolute value or a relative value. This relative value is a value obtained by comparing the time spent by the responsible worker in the specific process area B1 with the time spent by the responsible worker in other process areas (here, process areas A1 and C1) where processes other than the specific process B (here, process A and process C) are performed.

[0052] Specifically, when the first threshold is an absolute value, the first threshold is, for example, 10 seconds or 15 seconds. When the first threshold is a relative value, the first threshold may be a value obtained by subtracting the time spent by the responsible worker in other process areas (here, process areas A1 and C1) where processes other than the specific process B (here, processes A and C) are performed from the time spent by the responsible worker in the specific process area B1, and may be, for example, 1 second. When the first threshold is a relative value, the first threshold may be a value obtained by dividing the time spent by the responsible worker in the specific process area B1 by the time spent by the responsible worker in other process areas (here, process areas A1 and C1) where processes other than the specific process B (here, processes A and C) are performed, and may be, for example, 1.

[0053] The output unit 26 outputs the work time measured by the calculation unit 23. At this time, as will be described later, the output unit 26 outputs, for example, a work ID, a flow line ID, a responsible process, a work type, an entry time, and an exit time in association with the work time measured by the calculation unit 23.

[0054] In this embodiment, as described above, the work analysis device 100 generates and outputs information regarding the status of work performed by worker M using images of worker M working on a production line including multiple processes A, B, and C, and includes an acquisition unit 11 that acquires the images; a setting unit 15 that sets, based on the images, a work area WA where worker M works on work W around work W passing through a specific process area B1 where a specific process B of the multiple processes A, B, and C is performed; a judgment unit 21 that determines, based on the images, the time when worker M enters the work area WA as the time of entry and the time when worker M exits the work area WA as the time of exit; a calculation unit 23 that calculates the work time of worker M at the specific process B based on the judgment result by the judgment unit 21; and an output unit 26 that outputs the work time calculated by the calculation unit 23.

[0055] This allows a work area WA to be set around the work W passing through the specific process area B1, the entry and exit of the worker M into the work area WA to be determined, and the work time of the worker M is calculated based on the determination result. This makes it possible to analyze the work time of the worker M on the moving work W.

[0056] In addition, the work analysis device 100 of the present disclosure can determine whether or not worker M is working on work W based on entry and exit to the work area WA. Therefore, unlike when determining whether or not worker M is working is done by machine learning, for example, there is no need to train all work by machine learning.

[0057] Next, the operational flow of the work analysis device 100 will be described with reference to Fig. 5. Fig. 5 is a diagram showing the operational flow of the work analysis device 100.

[0058] 5, in step S1, video processing is performed using the image captured by the camera 3. Step S1 is processing by the image processing unit 10A described above. Specifically, the image processing unit 10A uses the image captured by the camera 3 to detect the workpiece W, detect the worker M, and set a work area WA surrounding the workpiece W.

[0059] Next, in step S2, analysis processing is performed based on the processing results of the image processing unit 10 A. Step S2 is processing by the work information processing unit 10 B described above. Specifically, the work information processing unit 10 B identifies the times when the worker M entered and exited the work area WA, and calculates the work time, based on the processing results of the image processing unit 10 A.

[0060] Next, in step S3, the analysis results are output to the display unit 1. As a result, the responsible worker and the working time of the process are displayed on the display unit 1. Therefore, for example, a production line manager can check the working time of the responsible worker in a specific process.

[0061] Next, step S1 in Fig. 5 will be described in detail with reference to Fig. 6. Fig. 6 is a detailed flowchart of step S1 in Fig. 5.

[0062] 6, in step S11, the image processing unit 10A acquires an image. Specifically, the camera 3 transmits an image of the imaging area to the work analysis apparatus 100. As a result, the acquisition unit 11 of the image processing unit 10A acquires the image captured by the camera 3.

[0063] Next, in step S12, the image processing unit 10A detects an object from the image. Specifically, the object detection unit 12 detects the workpiece W and the worker M from the image.

[0064] Next, in step S13, the image processing unit 10A generates a workpiece detection frame F1 around the workpiece W. In this embodiment, the object detection unit 12 adds the workpiece detection frame F1 indicating the detected workpiece W to the image. Specifically, as shown in FIG. 4, the object detection unit 12 detects the workpiece W when it enters the imaging area (step S12), and adds the workpiece detection frame F1 surrounding the workpiece W to the image. Then, the workpiece tracking unit 13 tracks the workpiece W and stores the coordinate information of the workpiece W at each time in the memory unit 30. Note that the workpiece detection frame F1 is linked to, for example, workpiece identification information (hereinafter, sometimes referred to as a workpiece ID) for identifying the workpiece W.

[0065] Next, in step S14, the image processing unit 10A sets a work area WA. Specifically, the setting unit 15 sets the work area WA around the workpiece W, where the worker M will work on the workpiece W. Then, the setting unit 15 adds the work area WA to the image.

[0066] Next, in step S15, the image processing unit 10A generates a worker detection frame F2 around the worker M. In this embodiment, the object detection unit 12 adds the worker detection frame F2 indicating the detected worker M to the image. Specifically, the object detection unit 12 detects the worker M when the worker M enters the image capture area (step S12), and adds the worker detection frame F2 surrounding the worker M to the image. The worker tracking unit 14 then tracks the worker M and stores the coordinate information of the worker M at each time in the storage unit 30. Note that the worker detection frame F2 is linked to, for example, worker flow line identification information (hereinafter sometimes referred to as a flow line ID) or worker identification information for identifying the worker M.

[0067] In this manner, the moving image processing in step S1 is carried out.

[0068] Note that in FIG. 6, an example has been described in which step S15 of generating the worker detection frame F2 is performed after step S13 of generating the work detection frame F1, but the work detection frame F1 may be generated after the worker detection frame F2 is generated, or the generation of the work detection frame F1 and the generation of the worker detection frame F2 may be performed in parallel.

[0069] Next, prior to describing the detailed processing flow of step S2, an example of a movement model of the workpiece W and worker M used in the description of the work information processing unit 10B will be described with reference to FIGS. 7 to 11 to facilitate understanding. FIGS. 7 to 11 are diagrams showing an example of a movement model of the workpiece W and worker M. In FIGS. 7 to 11, the movement line of worker M is indicated by an arrow, and the trajectory of movement in the work area WA is indicated by a two-dot chain line. In the following, a worker in charge of a specific process B may be referred to as worker M1, and a worker in another process may be referred to as worker M2. In addition, when there is no need to distinguish between worker M1 and worker M2, they will be described as worker M.

[0070] As shown in Fig. 7, worker M1 approaches workpiece W located in process area A1 and starts working on workpiece W. At this time, worker M1 moves into process area A1 and into work area WA. An example of when worker M1 in process B starts working in process area A1 is when the previous work on workpiece W is finished early.

[0071] Thereafter, as the workpiece W is transported from the process area A1 to the process area B1, the worker M1 also moves from the process area A1 to the process area B1.

[0072] As shown in FIG. 8, the workpiece W moves within process area B1 from process area A1 toward process area C1. At this time, in this model, worker M1 temporarily leaves process area B1. An example of such a temporary exit is when worker M1 goes to retrieve materials or tools required for work in process B from a workbench (not shown). Note that, to simplify the drawings, in FIG. 8 and subsequent figures, the trajectory of the work area WA, that is, the trajectory from the previous work area WA to the current work area WA, is depicted by a two-dot chain line.

[0073] 9, for example, when a workpiece W is present in process area B1, worker M2 of another process crosses process area B1 and work area WA. Note that this worker M2 is not a worker of process B. The movement line of worker M2 is indicated by a dashed arrow.

[0074] 10, as the workpiece W is transported from the process area B1 to the process area C1, the worker M1 also moves from the process area B1 to the process area C1. An example of when the worker M1 of process B works in the process area C1 is when the work of process B is delayed.

[0075] Then, as shown in FIG. 11, when the worker M1 finishes working on the workpiece W, he moves outside the process areas B1 and C1 and the work area WA.

[0076] Next, the processing of the work information processing unit 10B (the determination unit 21, measurement unit 22, calculation unit 23, addition unit 24, first identification unit 25, and output unit 26) will be described in detail with reference to Figs. 12 to 16. Fig. 12 is a diagram for explaining the entry and exit times of worker M for process areas A1, B1, and C1. Fig. 13 is a diagram showing data relating to the entry and exit times of worker M for process areas A1, B1, and C1. Fig. 14 is a diagram for explaining the entry and exit times of worker M for work area WA. Fig. 15 is a diagram showing data relating to the entry and exit times of worker M for work area WA. Fig. 16 is a diagram showing information relating the value-added work time, incidental work time, and total work time for each work.

[0077] The determination unit 21 determines whether or not the worker M has entered the process areas A1, B1, and C1 based on the image. Then, the determination unit 21 stores in the memory unit 30 the time when the worker M entered the process areas A1, B1, and C1.

[0078] The determination unit 21 determines whether or not the worker M has left the process areas A1, B1, and C1 based on the image. Then, the determination unit 21 stores the time when the worker M left the process areas A1, B1, and C1 in the memory unit 30.

[0079] Furthermore, the determination unit 21 determines whether or not the worker M has entered the work area WA based on the image. Then, the determination unit 21 stores the time when the worker M entered the work area WA in the storage unit 30.

[0080] The determination unit 21 determines whether the worker M has left the work area WA based on the image. Then, the determination unit 21 stores in the storage unit 30 the time when the worker M left the work area WA.

[0081] 12 and 13, the entry and exit times (times t1 to t8) of worker M1 relative to the process areas A1, B1, and C1 are obtained, and the entry and exit times (times t9 to t10) of worker M2 relative to the process areas A1, B1, and C1 are obtained.

[0082] 14 and 15, the entry and exit times (times T1 to T4) of worker M1 relative to the work area WA are obtained, and the entry and exit times (times T5 to T6) of worker M2 relative to the work area WA are obtained.

[0083] Based on the determination result of the determination unit 21, the measurement unit 22 measures, for example, the stay time of the worker M in processes A, B, and C. Specifically, the measurement unit 22 measures the stay time by calculating the difference between the entry time and the exit time in FIG.

[0084] Furthermore, the measurement unit 22 measures, for example, the total time spent in each process by worker M. Specifically, in the example shown in FIG. 13, the total time spent in process A by worker M1 is 4 seconds. The time spent in process B by worker M1 is 17 (=6+11) seconds. The time spent in process C by worker M1 is 4 seconds. The time spent outside the process by worker M1 is 4 (=0.5+3+0.5) seconds. Furthermore, the time spent in process B by worker M2 is 3 seconds.

[0085] The measurement unit 22 also measures, for example, the total stay time of worker M. Specifically, in the example shown in Fig. 13, the total stay time of worker M1 is 29 (=4+17+4+4) seconds. The total stay time of worker M2 is 3 seconds.

[0086] The calculation unit 23 measures the work time of the worker M in the work area WA based on the determination result of the determination unit 21. Specifically, the calculation unit 23 measures the work time by calculating the difference between the entry time and the exit time in FIG.

[0087] Furthermore, the calculation unit 23 calculates the working time of the worker M in the specific process B. Specifically, in the example shown in Fig. 15, the working time of the worker M1 in the specific process B is 25 (=10+15) seconds.

[0088] In this embodiment, the calculation unit 23 measures the absence time during which the worker M is located outside the work area WA between the time of entry and the time of exit, based on the determination result by the determination unit 21. Specifically, the calculation unit 23 measures the absence time during which the worker M is located outside the work area WA between the time of first entry (time T1) and the time of last exit (time T4) for one work W (the time from time T2 to time T3). As this absence time is within a second threshold (e.g., 5 seconds), as will be described later, it is regarded as the incidental work time required for the work of process B. Then, the addition unit 24 adds the incidental work time to the work time. Therefore, in this embodiment, the work time of the worker M1 in the specific process B is 28 (= 10 + 15 + 3) seconds.

[0089] 15, the working time of process B starts from time T1, and therefore includes the working time of process B in process area A1. That is, as described above, when worker M1 enters or leaves other process areas (e.g., process areas A1 and C1) where processes other than the specific process B (e.g., process A and process C) are performed, the calculation unit 23 calculates the working time of worker M1 in the other process areas and includes it in the working time of the specific process B.

[0090] As described above, if the absence time (the time from time T2 to time T3) is within the second threshold (for example, 5 seconds), the addition unit 24 adds the absence time (ancillary work time) to the work time of worker M1.

[0091] This allows for more accurate work time to be obtained even when a worker temporarily leaves the work area WA to retrieve materials and / or tools required for the work.

[0092] For example, the first identification unit 25 may identify a worker M whose working time for a specific process B exceeds a first threshold as a responsible worker for the specific process B. For example, in the example shown in FIG. 15, the working time of worker M1 (flow line ID "1") for the specific process B is 28 seconds. Furthermore, the working time of worker M2 (flow line ID "2") for the specific process B is 3 seconds. Therefore, the first identification unit 25 identifies worker M1 as a responsible worker for the specific process B. Furthermore, the first identification unit 25 identifies worker M2 as a non-responsible worker who is not responsible for the specific process B.

[0093] Furthermore, the first identification unit 25 may identify, for example, a worker M whose stay time in the specific process area B1 exceeds a first threshold as a worker in charge of the specific process B. For example, in the example shown in FIG. 13, the stay time of worker M1 (flow line ID "1") in the specific process area B1 is 29 seconds. The stay time of worker M2 (flow line ID "2") in the specific process area B1 is 3 seconds. Therefore, the first identification unit 25 identifies worker M1 as a worker in charge of the specific process B. The first identification unit 25 also identifies worker M2 as a non-worker who is not in charge of the specific process B.

[0094] As described above, the first identification unit 25 identifies a worker M1 whose working time for a specific process B or the time spent in a specific process area B1 exceeds the first threshold as the worker in charge of the specific process B.

[0095] This makes it possible to prevent a worker M2 who is not in charge of a specific process B from being identified as the worker in charge of the specific process B. Specifically, for example, it is possible to prevent a worker M who performed work on an adjacent process (e.g., process A or C) in the specific process area B1, or a worker M2 who simply crossed the specific process area B1, from being identified as the worker in charge of the specific process B.

[0096] The output unit 26 outputs the work time measured by the calculation unit 23 to the display unit 1. At this time, the output unit 26 outputs, for example, the work ID, flow line ID, responsible process, work type, entry time, and exit time in association with the work time measured by the calculation unit 23, as shown in Fig. 15. At this time, the output unit 26 may also output the value-added work time, incidental work time, and total work time for each work W in association with each other to the display unit 1, as shown in Fig. 16.

[0097] Next, step S2 in Fig. 5 will be described in detail with reference to Fig. 17 and Fig. 18. In step S2 in Fig. 5, the process that worker M is in charge of may be identified and then the work time for each process may be identified (Example 1), or the work time for each task may be identified and then which process each task belongs to may be identified (Example 2).

[0098] First, with reference to Fig. 17, a first embodiment will be described in which the processes in which a worker M is responsible are identified and then the work time for each process is identified. Fig. 17 is a detailed flowchart of step S2 in Fig. 5 in the first embodiment. In the first embodiment, after all images of one or more workpieces W are transmitted from the camera 3 to the work analysis device 100, processing is performed by the image processing unit 10A and the work information processing unit 10B.

[0099] As shown in Fig. 17, in step S21, the work information processing unit 10B calculates the stay time for each process area. Specifically, as described with reference to Fig. 13, the determination unit 21 determines the entry and exit times of worker M for process areas A1, B1, and C1, and stores the determined times in the memory unit 30. The measurement unit 22 then calculates the stay time for each process area based on the entry and exit times. The measurement unit 22 also calculates the stay time for worker M for each process using the method described above.

[0100] Next, in step S22, the work information processing unit 10B identifies the process area in which worker M is responsible. Specifically, the first identification unit 25 identifies, for example, worker M1 as the worker in charge of specific process B. In other words, the first identification unit 25 identifies the worker in charge of specific process B. At this time, the first identification unit 25 identifies worker M1 as the worker in charge of specific process B based on the stay time using the method described above.

[0101] Next, in step S23, the work information processing unit 10B calculates the work time for each task. Specifically, as described with reference to FIG. 15, the determination unit 21 determines the entry time and exit time of the worker M with respect to the work area WA and stores the entry time and exit time in the memory unit 30. The calculation unit 23 then calculates the work time for each task based on the entry time and exit time. The calculation unit 23 also calculates the work time for each task of the worker M using the method described above.

[0102] Next, in step S24, the work information processing unit 10B calculates the total work time for each process. Specifically, the calculation unit 23 calculates the total work time for each process using the method described with reference to FIG.

[0103] Next, with reference to Figs. 18 to 20, a second embodiment will be described in which the work time for each task is identified and then the process to which each task belongs is identified. Fig. 18 is a detailed flowchart of step S2 in Fig. 5 in the second embodiment. Fig. 19 is a diagram for explaining the entry and exit times of worker M relative to the work area WA in the second embodiment. Fig. 20 is a diagram showing data relating to the entry and exit times of worker M relative to the work area WA in the second embodiment.

[0104] 19 and 20, in Example 2, processing by the image processing unit 10A and the work information processing unit 10B is performed in parallel with the transmission of images of the workpieces W from the camera 3 to the work analysis apparatus 100. Note that in Example 2, as in Example 1, processing by the image processing unit 10A and the work information processing unit 10B may be performed after all images of one or more workpieces W are transmitted from the camera 3 to the work analysis apparatus 100.

[0105] As shown in Fig. 18, in step S23, the work information processing unit 10B calculates the work time for each task. Specifically, as shown in Figs. 19 and 20, the determination unit 21 determines the entry time and exit time of worker M from the work area WA and stores the entry time and exit time in the memory unit 30. The calculation unit 23 then calculates the work time for each task based on the entry time and exit time. The calculation unit 23 also calculates the work time for each task of worker M using the method described above.

[0106] Next, in step S22a, the work information processing unit 10B identifies the process area that the worker M is in charge of.

[0107] In step S22a, the process area in charge of the worker M may be identified in the same manner as in step S22 in the first embodiment. In this case, step S21 is executed before step S22a.

[0108] Furthermore, in step S22a, unlike in the first embodiment, for example, a process may be determined for each task (each task type) performed by worker M, and the process area that worker M is responsible for may be identified based on the determination result. Specifically, for example, the determination unit 21 determines the process area in which each task was performed for each task (each task type) performed by worker M1 (flow line ID "1"). In this case, the determination unit 21 may determine the process area in which each task was performed based on the time that each task was performed and the position of the work area WA (or work detection frame F1). In this case, it is not necessary to determine the time that worker M entered and left the process area.

[0109] Next, step S24 is carried out in the same manner as in the first embodiment.

[0110] (Variation) Next, a work analysis system 200 including an work analysis device 100 according to a modified example of the present disclosure will be described with reference to Fig. 21. Fig. 21 is a block diagram showing an example configuration of the work analysis device 100 according to a modified example of the present disclosure.

[0111] As shown in FIG. 21 , in this modification, the storage unit 30 stores characteristic information of the worker M. In this modification, the characteristic information is, for example, information about the appearance of the worker M. The characteristic information may also be, for example, information about the physique or hairstyle of the worker M. Note that the characteristic information is not previously linked to the process in which the worker M is in charge.

[0112] Furthermore, in this modification, the information processing unit 10 has a second identification unit 16 that identifies the worker M who has entered the work area WA (or process area). Specifically, the second identification unit 16 identifies the worker M based on the characteristic information stored in the memory unit 30. Note that in this modification, the second identification unit 16 functions as, for example, a part of the image processing unit 10A.

[0113] In this modification, as described above, the work analysis device 100 includes a storage unit 30 that stores characteristic information about the worker M, and a second identification unit 16 that identifies the worker M who has entered the work area WA. This makes it possible to easily distinguish between different workers M, for example. Furthermore, even if a worker M temporarily exits the image capture area of ​​the camera 3 and then re-enters the image capture area, it is easy to determine that the worker M is the same worker M. Therefore, the work of multiple workers M can be easily analyzed.

[0114] The second specifying unit 16 may function as a part of the work information processing unit 10B.

[0115] Other configurations, processing flows, and effects of this modified example are similar to those of the above embodiment.

[0116] Below, examples of disclosures obtained from the contents of this specification etc. will be given, and the effects etc. obtained from the exemplified disclosures will be explained.

[0117] A work analysis device 100 according to a first aspect of the present disclosure generates and outputs information relating to the status of work performed by a worker M using images of the worker M working on a production line including multiple processes A, B, and C, and includes: an acquisition unit 11 for acquiring the images; a setting unit 15 for setting, based on the images, a work area WA in which the worker M works on the work W around the work W passing through a specific process area B1 in which a specific process B of the multiple processes A, B, and C is performed; a determination unit 21 for determining, based on the images, the time when the worker M enters the work area WA as the time of entry and the time when the worker M exits the work area WA as the time of exit; a calculation unit 23 for calculating the work time of the worker M at the specific process B based on the determination result by the determination unit 21; and an output unit 26 for outputting the work time calculated by the calculation unit 23.

[0118] This allows a work area WA to be set around the work W passing through the specific process area B1, the entry and exit of the worker M into the work area WA to be determined, and the work time of the worker M is calculated based on the determination result. This makes it possible to analyze the work time of the worker M on the moving work W.

[0119] In addition, the work analysis device 100 of the present disclosure can determine whether or not worker M is working on workpiece W based on entry and exit to the work area WA. Therefore, unlike when determining whether or not worker M is working is done by machine learning using images, there is no need to train all work by machine learning.

[0120] The work analysis device 100 according to the second aspect of the present disclosure is the work analysis device 100 according to the first aspect, and is equipped with a first identification unit 25 that identifies a worker M, whose working time for a specific process B or whose staying time in a specific process area B1 exceeds a first threshold, as the worker in charge of the specific process B.

[0121] This makes it possible to prevent a worker M who is not in charge of a specific process B from being identified as the worker in charge of the specific process B. Specifically, for example, it is possible to prevent a worker M who performed work on an adjacent process (process A or C) within the specific process area B1, or a worker M who simply crossed the specific process area B1, from being identified as the worker in charge of the specific process B.

[0122] A work analysis device 100 according to a third aspect of the present disclosure is the work analysis device 100 according to the second aspect, and the first threshold value is an absolute value or a relative value obtained by comparing the time spent by the responsible worker in the specific process area B1 with the time spent by the responsible worker in other process areas A1 and C1 where processes other than the specific process B are performed.

[0123] This makes it possible to easily identify the worker in charge of a specific process B.

[0124] The work analysis device 100 according to the fourth aspect of the present disclosure is a work analysis device 100 according to any one of the first to third aspects, and includes a memory unit 30 that stores characteristic information of a worker M, and a second identification unit 16 that identifies a worker M who has entered the work area WA.

[0125] This makes it possible to easily distinguish between different workers M, for example. Furthermore, even if a worker M leaves the imaging area and then re-enters the imaging area, it is easy to determine that the worker M is the same worker M. Therefore, the work of multiple workers M can be easily analyzed.

[0126] A work analysis device 100 according to a fifth aspect of the present disclosure is a work analysis device 100 according to any of the first to fourth aspects, in which the calculation unit 23 calculates the absence time during which worker M is located outside the work area WA between the time of entry and the time of exit based on the judgment result by the judgment unit 21, and the work analysis device 100 includes an addition unit 24 that adds the absence time to the work time of worker M if the absence time is within a second threshold.

[0127] This allows for more accurate work time to be obtained even when the worker M1 temporarily leaves the work area WA to retrieve materials and / or tools required for the work.

[0128] A work analysis device 100 according to a sixth aspect of the present disclosure is the work analysis device 100 according to any of the first to fifth aspects, in which, when a worker M enters or leaves other process areas A1 and C1 where processes other than the specific process B are performed, the calculation unit 23 calculates the work time of the worker M in the other process areas A1 and C1.

[0129] This makes it possible to include, for example, the work time of a worker M of a specific process B in other process areas A1 and C1 in the work time of the specific process B.

[0130] A work analysis device 100 according to a seventh aspect of the present disclosure is the work analysis device 100 according to the sixth aspect, and includes an adding unit 24 that adds the work time of worker M in other process areas A1 and C1 to the work time in a specific process B.

[0131] This allows the work time spent by worker M of specific process B in other process areas A1 and C1 to be added to the work time of specific process B, thereby making it possible to calculate the work time of specific process B more accurately.

[0132] A work analysis method according to an eighth aspect of the present disclosure is a work analysis method that generates and outputs information regarding the status of work performed by worker M using images of worker M working on a production line including multiple processes A, B, and C, and includes the steps of: acquiring an image in step S11; setting, based on the image, a work area WA in which worker M works on work W around work W that passes through a specific process area B1 where a specific process B of the multiple processes A, B, and C is performed; determining, based on the image, the time when worker M enters the work area WA as the time of entry; and determining, based on the image, the time when worker M exits the work area WA as the time of exit; calculating, based on the determination result, the work time of worker M at the specific process B in step S23; and outputting the work time in step S3.

[0133] This allows a work area WA to be set around the work W passing through the specific process area B1, the entry and exit of the worker M into the work area WA to be determined, and the work time of the worker M is calculated based on the determination result. This makes it possible to analyze the work time of the worker M on the moving work W.

[0134] A program according to a ninth aspect of the present disclosure causes a computer to execute the above task analysis method.

[0135] This makes it possible to analyze the working time of worker M on the moving workpiece W.

[0136] The work analysis system 200, work analysis device 100, and work analysis method using the work analysis device 100 of the present disclosure have been described above based on the above-mentioned embodiments, etc. However, the present disclosure is not limited to these embodiments, etc. Various modifications that would occur to those skilled in the art may also be included in the present disclosure, as long as they do not deviate from the spirit of the present disclosure.

[0137] For example, in the above embodiment, an example has been shown in which the working time of worker M in other process areas (e.g., process areas A1 and C1) is added as the working time in specific process B, but the present disclosure is not limited to this. For example, the working time of worker M in other process areas (e.g., process areas A1 and C1) may be calculated as the working time in specific process B without adding the working time in other process areas (e.g., process areas A1 and C1).

[0138] In the above embodiment, the imaging area of ​​the camera 3 includes not only the process area B1 corresponding to a specific process B but also parts of the process areas A1 and C1 before and after it, but the present disclosure is not limited to this. The imaging area may include only one process area B1 corresponding to a specific process.

[0139] In the above embodiments, each component may be configured with dedicated hardware, or may be realized by executing a software program appropriate for that component. Each component may also be realized by a program execution unit such as a CPU or processor reading and executing a software program recorded on a recording medium such as a hard disk or semiconductor memory. Here, the software that realizes the work analysis device 100 of the above embodiments is a computer program that causes a computer to execute each step of the flowchart described above.

[0140] The following cases are also included in this disclosure:

[0141] (1) The at least one device is specifically a computer system comprising a microprocessor, ROM, RAM, hard disk unit, display unit, keyboard, mouse, etc. A computer program is stored in the RAM or hard disk unit. The at least one device achieves its function when the microprocessor operates in accordance with the computer program. Here, the computer program is composed of a combination of multiple instruction codes that indicate instructions to the computer to achieve a predetermined function.

[0142] (2) Some or all of the components constituting at least one of the above devices may be configured as a single system LSI (Large Scale Integration). A system LSI is an ultra-multifunctional LSI manufactured by integrating multiple components on a single chip, and specifically, is a computer system configured to include a microprocessor, ROM, RAM, etc. A computer program is stored in the RAM. The system LSI achieves its functions when the microprocessor operates in accordance with the computer program.

[0143] (3) Some or all of the components constituting at least one of the above devices may be configured as an IC card or a standalone module that can be attached to the device. The IC card or module is a computer system composed of a microprocessor, ROM, RAM, etc. The IC card or module may include the above-mentioned ultra-multifunctional LSI. The IC card or module achieves its functions when the microprocessor operates according to a computer program. This IC card or module may be tamper-resistant.

[0144] (4) The present disclosure may be embodied as the methods described above, a computer program for implementing these methods on a computer, or a digital signal comprising the computer program.

[0145] The present disclosure may also be a computer program or a digital signal recorded on a computer-readable recording medium, such as a flexible disk, a hard disk, a CD (Compact Disc)-ROM, a DVD, a DVD-ROM, a DVD-RAM, a BD (Blu-ray (registered trademark) Disc), a semiconductor memory, etc. Alternatively, the present disclosure may be a digital signal recorded on such a recording medium.

[0146] The present disclosure may also be applied to transmitting a computer program or digital signal via a telecommunications line, a wireless or wired communication line, a network such as the Internet, data broadcasting, or the like.

[0147] Furthermore, the program or digital signal may be recorded on a recording medium and transferred, or the program or digital signal may be transferred via a network or the like, so that the program or digital signal may be implemented by another independent computer system. [Industrial Applicability]

[0148] The work analysis device of the present disclosure can be applied to, for example, a device or system that analyzes the work of a worker. [Explanation of symbols]

[0149] 11 Acquisition Department 15 Setting section 16 Second Specific Part 21 Judgment section 23 Calculation section 24 Addition section 25 1st Specific Part 26 Output section 30 Storage section 100 work analysis device A, C process A1, C1 and other process areas B Process (specific process) B1 Specific process area M worker S3 step (output step) S11 Step (Step to acquire) S14 Step (setting step) S23 step (judging step, calculating step) double work WA Work Area

Claims

1. 1. A work analysis device that generates and outputs information regarding the status of work performed by a worker using an image of the worker working on a production line including a plurality of processes, an acquisition unit that acquires the image; a setting unit that sets a work area in which the worker works on the workpiece around the workpiece passing through a specific process area in which a specific process among the plurality of processes is performed, based on the image; and a determination unit that determines, based on the image, when the worker enters the work area as an entry time and when the worker exits the work area as an exit time; a calculation unit that calculates a working time of the worker in the specific process based on the determination result by the determination unit; an output unit that outputs the operation time calculated by the calculation unit; Equipped with Work analysis device.

2. a first identification unit that identifies the worker, whose working time in the specific process or the staying time in the specific process area exceeds a first threshold, as the worker in charge of the specific process; The work analysis device according to claim 1 .

3. The first threshold value is Absolute value, or A relative value comparing the time spent by the worker in the specific process area with the time spent by the worker in other process areas where processes other than the specific process are performed That is, The work analysis device according to claim 2 .

4. a storage unit for storing the characteristic information of the worker; a second identification unit that identifies the worker who has entered the work area; Equipped with The work analysis device according to any one of claims 1 to 3.

5. the calculation unit calculates an absence time during which the worker is located outside the work area between the time of entry and the time of exit based on the determination result by the determination unit; The work analysis device an adding unit that adds the absence time to the work time of the worker when the absence time is within a second threshold value; The work analysis device according to any one of claims 1 to 3.

6. the calculation unit calculates the working time of the worker in another process area where a process other than the specific process is performed, when the worker enters or leaves the other process area; The work analysis device according to any one of claims 1 to 3.

7. an adding unit that adds the working time of the worker in the other process area to the working time in the specific process; The work analysis device according to claim 6 .

8. 1. A work analysis method for generating and outputting information relating to a work execution status of a worker using an image of the worker working on a production line including a plurality of processes, the method comprising: acquiring the image; a step of setting a work area in which the worker performs work on the workpiece around the workpiece passing through a specific process area in which a specific process among the plurality of processes is performed, based on the image; determining, based on the image, when the worker enters the work area as an entry time, and when the worker exits the work area as an exit time; calculating a working time of the worker in the specific process based on the determination result of the determining step; outputting the operation time; Including, Work analysis method.

9. A program that causes a computer to execute the task analysis method according to claim 8.

Images