Monitoring device, monitoring system, monitoring method, and monitoring program

Abstract

To provide a monitoring device which can detect a task different from a normal task to verify contents of the task.SOLUTION: A monitoring device 100 is configured to comprise an image acquisition unit 101, an anomaly detection unit 102, and an output unit 103. The image acquisition unit 101 acquires image data obtained by capturing tasks performed in a predetermined order. The anomaly detection unit 102 monitors an anomaly in working times being times required for the tasks, and in the case of detecting any anomaly, adds information indicating that the anomaly has been detected, to image data acquired at the time of anomaly detection. The output unit 103 outputs image data to which the information indicating the detection of the anomaly has been added.SELECTED DRAWING: Figure 10

Description

[Technical field]

[0001] The present invention relates to a technique for monitoring a production line, and more particularly to a technique for monitoring the working status. [Background technology]

[0002] In a manufacturing line, work procedures are established to maintain quality and ensure safety, and workers follow the work procedures. When an abnormality occurs in quality, confirmation may be made as to whether the work procedures were correct. However, a huge amount of work is required to find the timing of the abnormality from the work records. Also, if the work being performed at the time the abnormality occurred is verified according to the worker's memory, there is a risk that the cause of the abnormality cannot be accurately identified. Therefore, it is desirable to have a technology that can detect an abnormality and confirm the work state when the abnormality occurred. For example, a technology such as that in Patent Document 1 is disclosed as such a technology for detecting an abnormality.

[0003] Patent Document 1 relates to a production management device that detects abnormalities in the production status. The production management device of Patent Document 1 obtains the cycle time using a signal output when a product is fed from the production equipment. The production management device of Patent Document 1 detects an abnormality when the cycle time is below a lower limit threshold.

[0004] Patent Document 2 discloses a process monitoring device that uses a camera to capture images of multiple processes. When an operator who recognizes an abnormality operates a switch, the process monitoring device of Patent Document 2 stores image data of the work area corresponding to the operated switch.

[0005] Patent Document 3 discloses a recording device for image data from a surveillance camera. The recording device in Patent Document 3 compares two sets of image data from different times, and when it determines that the two sets are different, it adds a chapter to the image data and records it. [Prior art documents] [Patent documents]

[0006] [Patent Document 1] JP 2019-061628 A [Patent Document 2] JP 2018-128729 A [Patent Document 3] JP 2007-081662 A Summary of the Invention [Problem to be solved by the invention]

[0007] However, the technology of Patent Document 1 is insufficient in the following respects. The production management device of Patent Document 1 detects abnormalities in cycle time using signals output from the production equipment, but when an abnormality occurs, it is not possible to verify how the work was performed. In addition, the technology of Patent Document 2 does not record video if the worker does not recognize an abnormality, so it is not possible to verify abnormalities that the worker does not recognize. In addition, the technology of Patent Document 3 compares images from different times, so it is not possible to verify whether the work was performed correctly in the specified order.

[0008] SUMMARY OF THE PRESENT DISCLOSURE In order to solve the above problems, an object of the present invention is to provide a monitoring device or the like that can detect work that differs from normal work and verify the content of that work. [Means for solving the problem]

[0009] In order to solve the above problems, the monitoring device of the present invention includes an image acquisition unit, an abnormality detection unit, and an output unit. The image acquisition unit acquires image data of work performed in a set order. The abnormality detection unit monitors abnormalities in the work time, which is the time required for the work, and when an abnormality is detected, adds information indicating that the abnormality has been detected to the image data acquired when the abnormality was detected. The output unit outputs the image data with the added information.

[0010] The monitoring method of the present invention acquires image data of work performed in a set order. The monitoring method of the present invention monitors abnormalities in work time, which is the time required for the work, and when an abnormality in the work time is detected, adds information indicating the detection of the abnormality to the image data acquired when the abnormality is detected. The monitoring method of the present invention outputs the image data with the added information.

[0011] The monitoring program of the present invention causes a computer to execute a process of acquiring image data of work performed in a specified order. The monitoring program of the present invention monitors abnormalities in work time, which is the time required for the work, and, if an abnormality is detected, causes the computer to execute a process of adding information indicating the detection of the abnormality to the image data acquired when the abnormality is detected. The monitoring program of the present invention causes the computer to execute a process of outputting the image data to which the information has been added. Effect of the Invention

[0012] According to the present invention, it is possible to detect work that differs from normal work and to verify the content of the work. [Brief description of the drawings]

[0013] [Figure 1] 1 is a diagram showing an outline of a configuration of a first exemplary embodiment of the present invention. [Diagram 2] 1 is a diagram illustrating an example of a configuration of a monitoring device according to a first embodiment of the present invention. [Diagram 3] FIG. 2 is a diagram illustrating an example of a work procedure according to the first embodiment of the present invention. [Figure 4] FIG. 4 is a diagram illustrating an example of an operation flow of the monitoring device according to the first embodiment of the present invention. [Diagram 5] FIG. 2 is a graph showing an example of operation time in the first embodiment of the present invention. [Figure 6] FIG. 4 is a diagram illustrating an example of another configuration of the first exemplary embodiment of the present invention. [Figure 7] FIG. 13 is a diagram showing an outline of the configuration of a second exemplary embodiment of the present invention. [Figure 8]FIG. 11 is a diagram illustrating an example of a configuration of a monitoring device according to a second exemplary embodiment of the present invention. [Figure 9] FIG. 11 is a diagram illustrating an example of an operation flow of a monitoring device according to a second exemplary embodiment of the present invention. [Figure 10] FIG. 13 is a diagram illustrating an example of a configuration of a monitoring device according to a third exemplary embodiment of the present invention. [Figure 11] FIG. 11 is a diagram illustrating an example of an operation flow of a monitoring device according to a third exemplary embodiment of the present invention. [Figure 12] FIG. 13 is a diagram illustrating an example of another configuration of the embodiment of the present invention. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0014] (First embodiment) A first embodiment of the present invention will be described in detail with reference to the drawings. FIG. 1 is a diagram showing an outline of the configuration of a monitoring system of this embodiment. The monitoring system of this embodiment includes a monitoring device 10, an imaging device 20, and an input device 30. FIG. 1 shows an example in which a work object is placed on a workbench, and the imaging device 20 is installed in a position where it can capture an image of a worker performing work on the work object. The monitoring device 10 is connected to the imaging device 20 via a network. The monitoring device 10 is also connected to the input device 30 via a network.

[0015] The monitoring system of this embodiment is a system for monitoring work performed on a manufacturing line. The monitoring system of this embodiment is used to monitor a manufacturing line in which work is repeatedly performed according to a preset order. Work that follows a preset order refers to work that is performed according to a preset order, such as placing a work object on a work table, removing a component, attaching the component to the product, and carrying out the work object after the work is completed, in a product assembly process. The work may be other than product assembly work, such as packaging a product and transporting the product between processes. In addition, the work may be performed in a preset order, and may be work that is repeated at intervals that are not short, such as putting on a worker's work clothes and protective gear, washing the worker's body and removing dust, and maintaining equipment.

[0016] The following describes the configuration of the monitoring device 10. Fig. 2 is a diagram showing an example of the configuration of the monitoring device 10. The monitoring device 10 includes an image acquisition unit 11, an operation data acquisition unit 12, an abnormality detection unit 13, a storage unit 14, and an output unit 15.

[0017] The image acquisition unit 11 acquires image data of work performed in a preset order on the production line. The image acquisition unit 11 acquires image data of images of work on the production line captured by the photographing device 20. The image acquisition unit 11 stores the acquired image data in the storage unit 14.

[0018] FIG. 3 is a diagram showing an example of a work instruction sheet showing the order of work performed in a manufacturing line. FIG. 3 shows an example in which the order of work performed in process X of a manufacturing line is set. In the example of FIG. 3, a worker in process X takes out tool A from the tool shelf and part B from the parts shelf, then attaches part B to a product, and returns tool A to the tool shelf. After storing tool A in the tool shelf, the worker performs work from number 5 onwards in order. The worker in process X repeats work according to the order shown in the work procedure sheet while changing the product to be worked on. The image acquisition unit 11 acquires image data of an image captured of work repeatedly performed by a worker according to a preset order as shown in the work instruction sheet of FIG. 3 from the photographing device 20.

[0019] The work data acquisition unit 12 acquires data on the identification information of the worker, the identification information of the work target, and the start and end times of the work as work history data. For example, the work data acquisition unit 12 acquires from the input device 30 the identification information of the worker that was input to the input device 30 when the worker started work. The work data acquisition unit 12 may acquire the identification information of the worker from a production management system (not shown). The identification information of the worker may also be input directly to the monitoring device 10.

[0020] The work data acquisition unit 12 acquires from the input device 30 the identification information of the work object, which is read, for example, at the start and end of the work. The identification information of the work object is read, for example, from a barcode of identification information attached to the work object. The barcode reading device is installed, for example, on a workbench. The barcode of identification information is read, for example, by the worker operating the barcode reading device. The work data acquisition unit 12 also acquires the time when the identification information is read as the start time and end time of the work. The work data acquisition unit 12 associates data of the worker's identification information, the identification information of the work object, and the start time and end time of the work, and stores them in the memory unit 14. The start time and end time of the work may be input to the input device 30 by the worker's operation.

[0021] The anomaly detection unit 13 calculates the time required for a task as the task time from the data on the end and start times of the task. The task time per task that is repeatedly performed according to a set order is also called the cycle time. The anomaly detection unit 13 identifies an abnormality in the task time when the task time is outside the standard range of normal task times. The task time of a task performed according to a predefined procedure will not deviate significantly from the average value if it is performed in the correct order. Therefore, the anomaly detection unit 13 can detect tasks that may cause defects in the product being worked on by comparing the task time with the standard and identifying task time that is outside the standard range as an abnormality.

[0022] For example, the abnormality detection unit 13 determines that an abnormality has occurred in the work time when the work time is equal to or greater than a preset threshold. The abnormality detection unit 13 also determines that an abnormality has occurred in the work time when the work time is less than a preset threshold. The threshold that sets the boundary value between the normal range and the abnormality may be either an upper limit or a lower limit. The threshold for determining whether or not there is an abnormality in the work time is set using the time required for the work when it is performed normally. The criteria indicating the range of normal work time are set for each type of work. The criteria indicating the range of normal work time may also be set for each worker, or may be set according to the worker's level of proficiency in the work.

[0023] When the abnormality detection unit 13 identifies that an abnormality has occurred during the work time, the abnormality detection unit 13 adds information indicating that an abnormality has been detected to the image data. When an abnormality is detected, the abnormality detection unit 13 adds information indicating that an abnormality has been detected (hereinafter, also referred to as abnormality detection information) to the image data stored in the storage unit 14.

[0024] The storage unit 14 stores image data and work history data. The storage unit 14 is configured, for example, by a hard disk drive. The storage unit 14 may be configured by other storage devices such as a non-volatile semiconductor storage device. The storage unit 14 may also be configured by a combination of multiple types of storage devices.

[0025] The output unit 15 outputs the image data to which the abnormality detection information has been added to a display device (not shown). The output unit 15 may also output the image data to which the information indicating that an abnormality has been detected has been added to a terminal device or a server connected via a network.

[0026] Each process in the image acquisition unit 11, the work data acquisition unit 12, the abnormality detection unit 13, and the output unit 15 is performed, for example, by executing a computer program in a CPU (Central Processing Unit). Each process in the image acquisition unit 11, the work data acquisition unit 12, the abnormality detection unit 13, and the output unit 15 may be performed by a semiconductor device such as an FPGA (Field Programmable Gate Array) or an ASIC (Application Specific Integrated Circuit).

[0027] The imaging device 20 captures images of work being performed on a production line. The imaging device 20 is installed so that it can capture images of the working state, such as the hands of a worker. The imaging device 20 generates image data of the captured image and sends the generated image data to the monitoring device 10. The imaging device 20 is configured using, for example, a camera that captures images in the visible light range. The imaging device 20 may also use a camera that captures images in a range other than the visible light range, such as a far-infrared camera.

[0028] The input device 30 accepts input of data on the identification information of the worker, the identification information of the work object, and the start and end times of the work as work history data. The input device 30 sends the accepted work history data to the monitoring device 10. The input device 30 acquires the identification information of the worker, for example, by reading the identification information of an ID card held by the worker. The input device 30 acquires information on the work object, for example, by reading information on a lot number attached to the product to be worked on. The input device 30 identifies the start and end times of the work, for example, as the times when the start and end of the work are input by the operation of the worker. The input device 30 may also acquire information on the start and end times of the work by reading the identification information of the work object at the start and end of the work by the operation of the worker. The input device 30 may also acquire information on the start and end times of the work by acquiring information on the placement of the product to be worked on on the work table and the removal from the work table via a sensor.

[0029] The operation of the monitoring system of this embodiment will be described below with reference to Fig. 4, which is a diagram showing an example of the operation flow of the monitoring device 10.

[0030] The photographing device 20 photographs the work of workers on the production line. The photographing device 20 sends image data of the photographed image to the monitoring device 10. The input device 30 also acquires identification information of the worker, identification information of the work target, and information on the start and end times of the work, and sends this to the monitoring device 10 as work history data.

[0031] 4, the image acquisition unit 11 acquires image data of an image of a task from the photographing device 20 (step S11). When the image data is acquired, the image acquisition unit 11 stores the acquired image data in the storage unit .

[0032] Furthermore, the task data acquisition unit 12 acquires data on the identification information of the worker, the identification information of the task object, and the start and end times of the task as task history data (step S12). Once the task history data has been acquired, the anomaly detection unit 13 calculates the task time from the task start time and task end time (step S13). After calculating the task time, the anomaly detection unit 13 compares the calculated task time with a standard for normal task time.

[0033] When the calculated working time is within the standard range (Yes in step S14), and when the production line being monitored is continuing to operate (Yes in step S17), the monitoring device 10 continues the operation of monitoring whether or not there is an abnormality in the working time from step S11.

[0034] When the calculated work time is outside the reference range (No in step S14), the abnormality detection unit 13 adds information indicating that an abnormality has occurred in the work time to the image data (step S15). The abnormality detection unit 13 adds the abnormality detection information to the image data acquired when the abnormality in the work time is detected, and stores the image data in the storage unit 14. The abnormality detection information may also include identification information of the worker who was performing the work when the abnormality was detected and identification information of the work target.

[0035] When the abnormality detection information is added to the image data, the output unit 15 outputs the image data of the portion to which the abnormality detection information is added (step S16). The output unit 15 outputs the image data of the portion to which the abnormality detection information is added to, for example, a terminal device (not shown) carried by a manager of the production line. The output unit 15 outputs, for example, image data of a length from the portion to which the abnormality detection information is added, going back by the work time, i.e., the image corresponding to the work start time, to the image of the portion to which the abnormality detection information is added, i.e., the image corresponding to the work end time, to the terminal device.

[0036] The output unit 15 may output the image data of the portion to which the abnormality detection information is added to the terminal device when the image data of the portion where the abnormality has occurred is requested from the terminal device. Also, the output unit 15 may output the image data of the portion requested by an operation performed by checking the image data to which the abnormality detection information is added to the terminal device.

[0037] When the image data of the portion to which the abnormality detection information is added is output, if the production line being monitored is continuing to operate (Yes in step S17), the monitoring device 10 continues the operation of monitoring for the presence or absence of abnormalities from step S11.

[0038] In step S17, when the operation of the production line is stopped (No in step S17), the monitoring device 10 ends the operation of monitoring the production line.

[0039] FIG. 5 is a diagram showing a schematic example of a graph generated using records of work time. The horizontal axis of FIG. 5 indicates, for example, the end time of work, and the vertical axis indicates the work time of work that was completed at each time. The threshold value Th in FIG. 5 is set as a criterion for judging an abnormality in work time, and when the work time is equal to or greater than Th, the abnormality detection unit 13 determines that an abnormality in work time has occurred. In the example of FIG. 5, the lower limit of the normal range is not shown, but the criterion for indicating the normal range may be set using threshold values ​​indicating the lower and upper limits.

[0040] The output unit 15 may output to the terminal device display data displaying a graph as shown in Fig. 5. In the case of a configuration in which a graph as shown in Fig. 5 is displayed, for example, when a black circle at the position of an abnormality is selected by an operation of a user of the terminal device, that is, when any of the data of the work time is selected, the output unit 15 may output the corresponding image data to the terminal device. With such a configuration, it becomes easy for a user of the monitoring system to determine the image data to be checked by referring to the work time.

[0041] The output unit 15 may output statistical data on the working time to a terminal device. For example, the output unit 15 may calculate the number of abnormalities in the working time per predetermined period and the average number of abnormalities in the working time per predetermined period and output them to the terminal device. When outputting the statistical data on the working time, the output unit 15 may also output statistical data on abnormalities in the working time for each individual, each group, and each process to the terminal device. By outputting such statistical data, the manager of the production line can refer to the tendency of abnormalities in the working time and refer to the image data to more efficiently manage the process.

[0042] When the output unit 15 calculates the statistical data of the working time, if the variation in the working time is equal to or exceeds a preset standard, the output unit 15 may output information indicating that the variation in the working time is large to the terminal device. If the variation in the working time is large, the work performed by the workers may not be stable. Therefore, by outputting the information indicating that the variation in the working time is large, the manager of the production line can verify the content of the work and improve the efficiency of the work.

[0043] In the above example, the monitoring device 10 monitors the work time of a task photographed by one of the photographing devices 20 and stores the image data, but the monitoring device 10 may also monitor the work time of each task photographed by multiple photographing devices 20.

[0044] FIG. 6 shows an example in which five photographing devices 20 are used to photograph work. In the example of FIG. 6, the photographing device 20 installed in each work section photographs the work in each work section. In addition, an input device 30 is installed for each work section. In the example of FIG. 6, the work data acquisition unit 12 of the monitoring device 10 acquires work history data for each work section. In addition, the abnormality detection unit 13 monitors whether or not there is an abnormality in the work time, and when an abnormality is detected, adds abnormality detection information to image data of an image photographed of the work section in which the abnormality is detected. In addition, in the example of FIG. 6, the photographing device 20 is installed in each work section, but a configuration in which one photographing device 20 photographs multiple work sections may be used. In such a configuration, the monitoring device 10 may add information about the work section in which the abnormality is detected to the image data in addition to the abnormality detection information. In addition, the number of photographing devices 20 may be other than five.

[0045] As described above, when the monitoring system of this embodiment detects an abnormality in the work time per repetition of a task that is repeated according to a preset procedure, the monitoring system adds abnormality detection information, which is information indicating that an abnormality has been detected, to an image of the task and stores the image. The work time per repetition, also called cycle time, does not fluctuate significantly if the task is performed correctly according to the work procedure. If the work time fluctuates, the task is not performed according to the correct procedure, and there is a possibility that an abnormality has occurred in the product. In the monitoring system of this embodiment, the abnormality detection information is added to the work time and stored as image data, and by referring to the information during verification, it is possible to check an image of a part where an abnormality may have occurred in the product and check the procedure of the task that was actually performed. As a result, the monitoring system of this embodiment can be used to detect tasks that are different from normal tasks and verify the content of the tasks.

[0046] Second Embodiment A second embodiment of the present invention will be described in detail with reference to the drawings. Fig. 7 is a diagram showing an outline of the configuration of a monitoring system of this embodiment. The monitoring system of this embodiment includes a monitoring device 40, an image capturing device 20, and an input device 30. The monitoring device 40 is connected to the image capturing device 20 via a network. The monitoring device 40 is also connected to the input device 30 via a network.

[0047] The monitoring system of the first embodiment calculates the work time from input data of the start and end times of the work and detects abnormalities in the work time. In contrast to such a configuration, the monitoring system of this embodiment calculates the work time by detecting the movement of the worker from image data of the work and identifying the start and end times of the work.

[0048] The configurations and functions of the photographing device 20 and the input device 30 of this embodiment are similar to those of the photographing device 20 and the input device 30 of the first embodiment, respectively.

[0049] The configuration of the monitoring device 40 will be described. Fig. 8 is a diagram showing an example of the configuration of the monitoring device 40. The monitoring device 40 includes an image acquisition unit 11, an image analysis unit 41, a data acquisition unit 42, an abnormality detection unit 13, a storage unit 14, and an output unit 15. The configurations and functions of the image acquisition unit 11, the storage unit 14, and the output unit 15 of this embodiment are similar to those of the parts of the same names in the first embodiment.

[0050] The image analysis unit 41 detects the movement of the worker from the image data. For example, the image analysis unit 41 detects the color of the hand, the movement of the gloves worn by the worker, or the movement of the equipment worn by the worker by a known image recognition technique. For example, the image analysis unit 41 generates time series data in which the time when the movement of the worker is detected is "1" and the time when the movement is not detected is "0."

[0051] The image analysis unit 41 identifies the start time and end time of the work. The image analysis unit 41 identifies the time when the work was detected after a period of time during which no work was detected has continued for a predetermined period of time or more as the start time of the work. Furthermore, the image analysis unit 41 identifies the time when the work was last detected as the end time of the work when a period of time during which no work was detected has continued for a predetermined period of time or more after the start time of the work has been identified.

[0052] The data acquisition unit 42 acquires the identification information of the worker and the identification information of the work target as work history data. For example, the data acquisition unit 42 acquires the identification information of the worker from the input device 30, which the worker inputs to the input device 30 when the worker starts work. The data acquisition unit 42 may acquire the identification information of the worker from a production management system (not shown). The identification information of the worker may also be input directly to the monitoring device 40.

[0053] The data acquisition unit 42 acquires, for example, identification information of the work target read at the start and end of the work from the input device 30. The identification information of the work target is read in the same manner as in the first embodiment. The data acquisition unit 42 stores the identification information of the worker and the identification information of the work target in the storage unit 14 in association with the acquisition date and time of the information. Furthermore, the worker and the work target may be identified by image recognition in the image analysis unit 41.

[0054] The anomaly detection unit 13 calculates the work time from the start time and end time of the work identified by the image analysis unit 41. When the work time is outside the standard range of normal work time, the anomaly detection unit 13 identifies that an anomaly has occurred in the work time. The anomaly detection unit 13 identifies the presence or absence of an anomaly in the same manner as in the first embodiment. When the anomaly detection unit 13 detects an anomaly in the work time, it adds anomaly detection information, which is information indicating that an anomaly has been detected, to the image data. When an anomaly is detected, the anomaly detection unit 13 adds the anomaly detection information to the position of the image stored in the memory unit 14.

[0055] The image analysis unit 41 is implemented, for example, by executing a computer program in a CPU. Each process in the image analysis unit 41 may be implemented by a semiconductor device such as an FPGA or an ASIC.

[0056] The operation of the monitoring system of this embodiment will be described below with reference to Fig. 9. Fig. 9 is a diagram showing an example of the operation flow of the monitoring device 40.

[0057] The photographing device 20 photographs the work of the worker on the production line. The photographing device 20 sends image data of the photographed image to the monitoring device 40. In addition, the input device 30 acquires identification information of the worker and identification information of the work target, and sends them to the monitoring device 40 as work history data.

[0058] 9, the image acquisition unit 11 of the monitoring device 40 acquires image data of work on the production line from the imaging device 20 (step S21). Upon acquiring the image data, the image acquisition unit 11 stores the acquired image data in the storage unit 14. In addition, the data acquisition unit 42 acquires identification information of the worker and identification information of the work target as work history data.

[0059] When the image data is acquired, the image analysis unit 41 identifies the start time and end time of the work from the image data (step S22). When the start time and end time of the work are identified, the abnormality detection unit 13 calculates the work time from the start time and end time of the work (step S23). After calculating the work time, the abnormality detection unit 13 compares the calculated work time with a standard for normal work time.

[0060] When the calculated work time is within the standard range (Yes in step S24), and when the production line to be monitored is continuing to operate (Yes in step S27), the monitoring device 40 continues the operation of monitoring for abnormalities from step S21.

[0061] When the calculated work time is outside the reference range (No in step S24), the abnormality detection unit 13 adds abnormality detection information to the image data (step S25). The abnormality detection unit 13 adds the abnormality detection information to the image data acquired when an abnormality in the work time is detected, and stores the image data in the storage unit 14. The abnormality detection information may also include identification information of the worker who was performing the work when the abnormality was detected and identification information of the work target.

[0062] When the abnormality detection information is added to the image data, the output unit 15 outputs the image data of the portion to which the abnormality detection information is added (step S26). When the image data of the portion to which the abnormality detection information is added is output, if the operation of the production line to be monitored is continuing (Yes in step S27), the monitoring device 40 continues the operation of monitoring for the presence or absence of abnormalities from step S21.

[0063] In step S27, when the operation of the production line is stopped (No in step S27), the monitoring device 40 ends the operation of monitoring the production line.

[0064] The monitoring system of this embodiment identifies the start and end times of work, which is repeated according to a preset procedure, by analyzing image data capturing the work. Therefore, the monitoring system of this embodiment can accurately calculate the work time because the worker does not need to input the information on the start and end times of the work. Therefore, the monitoring system of this embodiment can more accurately detect abnormalities in work time. By improving the accuracy of detecting abnormalities in work time, the monitoring system of this embodiment can more efficiently check image data that may contain abnormalities.

[0065] (Third embodiment) The third embodiment of the present invention will be described in detail with reference to the drawings. Fig. 10 is a diagram showing an outline of the configuration of a monitoring device 100 of the present embodiment.

[0066] The monitoring device 100 of this embodiment includes an image acquisition unit 101, an abnormality detection unit 102, and an output unit 103. The image acquisition unit 101 acquires image data capturing work performed in a predetermined order. The abnormality detection unit 102 monitors abnormalities in the work time, which is the time required for the work, and when an abnormality is detected, adds information indicating that an abnormality has been detected to the image data acquired when the abnormality is detected. The information indicating that an abnormality has been detected is also referred to as abnormality detection information. The output unit 103 outputs the image data to which the information indicating that an abnormality has been detected has been added.

[0067] The image acquisition section 11 in the first and second embodiments is an example of the image acquisition section 101. Moreover, the image acquisition section 101 is one aspect of the image acquisition means. The abnormality detection section 13 in the first and second embodiments is an example of the abnormality detection section 102. Moreover, the abnormality detection section 102 is one aspect of the abnormality detection means. The output section 15 in the first and second embodiments is an example of the output section 103. Moreover, the output section 103 is one aspect of the output means.

[0068] The operation of the monitoring device 100 will be described. FIG. 11 is a diagram showing an example of an operation flow of the monitoring device 100. The image acquisition unit 101 acquires image data of work performed in a predetermined order (step S101). When the image data is acquired, the abnormality detection unit 102 monitors abnormalities in the work time, which is the time required for the work (step S102). When an abnormality is detected, the abnormality detection unit 102 adds information indicating that the abnormality has been detected to the image data acquired when the abnormality was detected (step S103). When the information indicating that the abnormality has been detected is added, the output unit 103 outputs the image data to which the information indicating that the abnormality has been detected has been added (step S104).

[0069] The monitoring device 100 of this embodiment monitors abnormalities in the work time of tasks that are repeatedly performed in a set order, and when an abnormality is detected, adds information indicating the detection of the abnormality to the image data. When tasks are performed in a set order, an abnormality occurs in the work time if a task that differs from the normal task is performed. Therefore, by detecting an abnormality in the work time, it is possible to detect that a task that differs from the normal task has been performed. Therefore, by using the monitoring device 100 of this embodiment, it is possible to detect tasks that differ from the normal task and verify the content of the task.

[0070] Each process in the monitoring device 10 of the first embodiment, the monitoring device 40 of the second embodiment, and the monitoring device 100 of the third embodiment can be performed by executing a computer program on a computer. Fig. 12 shows an example of the configuration of a computer 200 that executes a computer program that performs each process in the monitoring device 10 of the first embodiment, the monitoring device 40 of the second embodiment, and the monitoring device 100 of the third embodiment. The computer 200 includes a CPU 201, a memory 202, a storage device 203, an input / output I / F (Interface) 204, and a communication I / F 205.

[0071] The CPU 201 reads out and executes a computer program for performing each process from the storage device 203. The CPU 201 may be configured by a combination of a CPU and a GPU (Graphics Processing Unit). The memory 202 is configured by a DRAM (Dynamic Random Access Memory) or the like, and temporarily stores the computer program executed by the CPU 201 and data being processed. The storage device 203 stores the computer program executed by the CPU 201. The storage device 203 is configured by, for example, a non-volatile semiconductor storage device. Other storage devices such as a hard disk drive may be used for the storage device 203. The input / output I / F 204 is an interface that receives input from an operator and outputs display data and the like. The communication I / F 205 is an interface that transmits and receives data to and from each device that constitutes the monitoring system.

[0072] The computer program used to execute each process may be stored in a recording medium and distributed. As the recording medium, for example, a magnetic disk such as a magnetic tape for recording data or a hard disk may be used. Also, an optical disk such as a CD-ROM (Compact Disc Read Only Memory) may be used as the recording medium. A non-volatile semiconductor memory device may also be used as the recording medium. [Explanation of symbols]

[0073] 10 Monitoring equipment 11 Image acquisition section 12 Work data acquisition section 13 Anomaly detection section 14 Storage section 15 Output section 20 Imaging Equipment 30 Input Devices 40 Monitoring equipment 41 Image Analysis Unit 42 Data Acquisition Section 100 Monitoring equipment 101 Image acquisition unit 102 Abnormality detection unit 103 Output section 200 Computers 201 CPU 202 Memory 203 Storage device 204 Input / Output Interface 205 Communication I / F

Claims

1. an image acquisition means for acquiring image data of a worker repeatedly performing a task in a predetermined order; an image analysis means for identifying a start time and an end time of the work from the image data; an anomaly detection means for monitoring a task time, which is a time required for each repetition of the task repeatedly performed by the worker in a predetermined order, based on the start time and the end time, and detecting an abnormality in the variation in the task time performed by the worker when the variation in the task time repeatedly performed by the worker in the predetermined order is equal to or exceeds a standard, and adding information indicating the detection of the abnormality to image data acquired when the abnormality is detected in the task time; an output means for outputting the image data to which the information has been added; A monitoring device comprising:

2. The monitoring device according to claim 1 , wherein the image analysis means determines the start time and the end time based on the time when the movement is detected when a period of time during which no movement is detected continues for a predetermined period of time or longer.

3. 3. The monitoring device according to claim 1, wherein the output means outputs image data for a period of time corresponding to the operation period during which the abnormality was detected.

4. 4. The monitoring device according to claim 1, wherein the output means outputs display data that displays the operation time as a graph, and outputs the image data that corresponds to selected data.

5. A plurality of photographing devices that photograph images of tasks that are repeatedly performed in a predetermined order and output image data of the photographed images; The monitoring device according to any one of claims 1 to 4. Equipped with The image acquisition means acquires the image data from each of the photographing devices, and the abnormality detection means monitors abnormalities in the working time of the image data for each of the photographing devices, and when an abnormality is detected, adds information indicating that an abnormality has been detected to the image data acquired at the time the abnormality was detected.

6. Acquire image data of workers repeatedly performing tasks in a set order, Identifying a start time and an end time of the work from the image data; based on the start time and the end time, a task time, which is a time required for each repetition of the task performed repeatedly in a predetermined order by the worker, is monitored; if the variation in the task time performed repeatedly in a predetermined order by the worker is equal to or exceeds a standard, an abnormality in the variation in the task time by the worker is detected; if an abnormality in the task time is detected, information indicating the detection of the abnormality is added to image data obtained when the abnormality is detected; A monitoring method that outputs image data to which the information is added.

7. 7. The monitoring method according to claim 6, further comprising the step of: determining the start time and the end time based on the time when the motion is detected when a period of time during which no motion is detected continues for a period of time equal to or longer than a preset period of time.

8. A process of acquiring image data of a worker repeatedly performing tasks in a predetermined order; A process of identifying a start time and an end time of the work from the image data; a process of monitoring a work time, which is a time required for each repetition of the work performed repeatedly in a predetermined order by the worker, based on the start time and the end time, detecting an abnormality in the variation in the work time performed repeatedly in a predetermined order by the worker when the variation in the work time is equal to or exceeds a standard, and adding information indicating the detection of the abnormality to image data acquired when the abnormality is detected in the work time; A process of outputting the image data to which the information has been added; A monitoring program that causes a computer to execute the following:

9. The monitoring program according to claim 8, which causes a computer to execute a process of identifying the start time and the end time based on the time the motion was detected when a period of time during which no motion was detected continues for a predetermined period of time or longer.

Images