Error notification system and control device

Abstract

An error reporting system (1) comprises a wearable device (10) and a control device (20) that controls the wearable device (10). The control device (20) compares, process by process, details of work including at least one process and indicated by a work procedure document and details of work indicated by a video recording the appearance of a worker performing work to identify a difference. The wearable device (10) includes a reporting device (18) that reports an error when a difference is identified.

Description

Technical Field

[0001] The present disclosure relates to an error notification system and a control device.

Background Art

[0002] In recent years, there has been an increasing number of cases where workers wear wearable devices and work while referring to work procedure manuals displayed on the wearable devices.

[0003] Japanese Unexamined Patent Application Publication No. 2021-82314 (Patent Document 1) discloses a technique for updating a procedure manual based on the content of maintenance work input by a worker when the content of the maintenance work input by the worker differs from the content of the work shown in the procedure manual. Japanese Unexamined Patent Application Publication No. 2017-169543 (Patent Document 2) discloses a technique for notifying an alert when a factor that requires attention (reagents, consumables, equipment, workers, work environment, etc.) registered in advance by an administrator may be used.

Prior Art Documents

Patent Documents

[0004]

Patent Document 1

Patent Document 2

Summary of the Invention

Problems to be Solved by the Invention

[0005] With either the technique disclosed in Japanese Unexamined Patent Application Publication No. 2021-82314 or the technique disclosed in Japanese Unexamined Patent Application Publication No. 2017-169543, there is a risk that the worker may continue working without noticing that a work mistake has been made.

[0006] The present disclosure has been made in view of such circumstances, and an object thereof is to provide an error notification system that can notify an operator at an early stage when the operator makes a work mistake in work performed while wearing a wearable device.

Means for Solving the Problems

[0007] A first aspect of the present disclosure relates to an error notification system. The error notification system includes a wearable device and a control device that controls the wearable device. The control device compares, for each process, the content of work including at least one process shown in the work procedure manual with the content of work shown in a video recording the state of the operator during work, and identifies a difference. The wearable device includes a notification device that notifies an error when a difference is identified.

[0008] A second aspect of the present disclosure relates to a control device that controls a wearable device. The control device compares, for each process, the content of work including at least one process shown in the work procedure manual with the content of work shown in a video recording the state of the operator during work, and identifies a difference. The wearable device includes a notification device that notifies an error when a difference is identified.

Effects of the Invention

[0009] According to the error notification system according to the present disclosure, while the operator is wearing the wearable device and performing work, it is specified by the control device from a video recording the state of the operator whether the work content of the operator matches the work content shown in the work procedure manual. When the operator takes an action different from the work content shown in the work procedure manual, an error is notified to the wearable device of the operator. Therefore, the operator can notice that a work mistake has been made at an early stage.

Brief Description of the Drawings

[0010]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Figure 9

Figure 10

Figure 11

Figure 12

Figure 13

Figure 14

Figure 15

Figure 16

Figure 17

Embodiments for Carrying Out the Invention

[0011] Hereinafter, embodiments and modification examples will be described in detail with reference to the drawings. For the same or corresponding parts in the drawings, the same reference numerals are given and their descriptions will not be repeated. The embodiments and modification examples described below may be selectively combined as appropriate.

[0012] In the following description, "work" refers to an act performed by an operator and means an act whose procedure is predetermined by a work procedure manual. For example, "work" includes analysis of a specimen, maintenance of equipment and facilities, assembly at a manufacturing site, construction at a construction site, or medical acts at a medical site, etc. Note that "work" is not limited to these as long as the procedure is predetermined by a work procedure manual. In the following description, "work" includes at least one process, and the work procedure is determined for each process. As an example, when "work" is the analysis of a specimen, it includes processes such as taking out the specimen from the storage, taking out the reagent from the storage, weighing the specimen, weighing the reagent, mixing the specimen and the reagent, analyzing the mixture of the specimen and the reagent with a device, and evaluating the analysis result.

[0013] [Embodiment 1] FIG. 1 is a diagram showing an overview of the error notification system in Embodiment 1. The error notification system 1 includes a smart glass 10, a control device 20, and an input device 30. The smart glass 10 is an example of a "wearable device". The operator wears the smart glass 10 and performs work while looking at the work procedure displayed on the smart glass 10. The work procedure is the content of the work included in the work procedure manual 224 described later. The control device 20 can communicate with the smart glass 10 and the input device 30 via wired communication or wireless communication.

[0014] The smart glasses 10 include a transparent protective glass 11 for protecting the eyes, an imaging device 14, and a notification device 18. The notification device 18 includes a transparent display 13 and a speaker 16. Since the protective glass 11 and the display 13 are transparent, the operator can visually recognize the front while wearing the smart glasses 10.

[0015] The imaging device 14 captures the state of the operator during work while the operator is performing the work. Specifically, the imaging device 14 obtains a video recording the state of the operator during work by capturing the area in front of the operator's hand at the tip of the operator's line of sight.

[0016] The display 13 is an example of a "display device". The display 13 displays an image. As an example, the display 13 displays an image showing the work procedure while the operator is performing the work. As another example, the display 13 displays an image indicating an error in the work. The image displayed on the display 13 may be a still image or a moving image. The display 13 includes a right-eye-side display 13a and a left-eye-side display 13b. The right-eye-side display 13a is attached to the protective glass 11 via a right-eye-side attachment portion 15a, and the left-eye-side display 13b is attached to the protective glass 11 via a left-eye-side attachment portion 15b. The operator can visually recognize the front through the display 13 and can also view the image displayed on the display 13.

[0017] The speaker 16 outputs sound. As an example, the speaker 16 outputs a sound indicating an error in the work. The sound output from the speaker 16 may be a voice or a notification sound. The notification sound includes at least one of a buzzer sound, a chime, a melody, and music.

[0018] The control device 20 comprehensively controls the entire smart glasses 10. Specifically, the control device 20 controls the display by the display 13, the imaging by the imaging device 14, and the sound output by the speaker 16.

[0019] The input device 30 includes at least one of a button, a touch pad, and a microphone. Various instructions for the control device 20 are input by an operator to the input device 30.

[0020] The control device 20 compares, for each process, the content of the work including at least one process shown in the work procedure manual with the content of the work shown in the video recording the state of the operator during the work, and identifies the difference. When the control device 20 identifies a difference, it instructs the notification device 18 to notify an error. As a result, an image indicating a work error is displayed on the display 13. In addition, a sound indicating a work error may be output from the speaker 16. Therefore, according to the error notification system 1, the operator can notice that a work mistake has been made.

[0021] FIG. 2 is a diagram showing an example of the configuration of the control device in Embodiment 1. The control device 20 includes a processor 201, a main memory 202, a camera interface 203, a display interface 204, a speaker interface 205, an input interface 206, a memory card interface 207, and a storage device 220. The processor 201, the main memory 202, the camera interface 203, the display interface 204, the speaker interface 205, the input interface 206, the memory card interface 207, and the storage device 220 are communicably connected to each other via an internal bus 299.

[0022] The processor 201 is constituted by, for example, at least one integrated circuit. The integrated circuit is constituted by, for example, at least one CPU (Central Processing Unit), at least one ASIC (Application Specific Integrated Circuit), at least one FPGA (Field Programmable Gate Array), or a combination thereof.

[0023] The processor 201 realizes various processes by expanding and executing the program 222 stored in the storage device 220 in the main memory 202. The main memory 202 is composed of a volatile memory and functions as a work memory necessary for the execution of the program by the processor 201.

[0024] The storage device 220 is composed of a non-volatile memory. Alternatively, the storage device 220 may be, for example, a hard disk, an SSD (Solid State Drive), etc., and may be either built-in or external. The storage device 220 stores the program 222 for realizing various processes according to the present embodiment and various data (for example, the work procedure manual 224, etc.).

[0025] The camera interface 203 relays data transmission between the processor 201 and the imaging device 14. Specifically, a signal instructing the start of imaging is output from the processor 201 to the imaging device 14 via the camera interface 203. Also, an image obtained by imaging (for example, a video recording the state of the operator during work, etc.) is output from the imaging device 14 to the processor 201 via the camera interface 203. Further, a signal instructing the end of imaging is output from the processor 201 to the imaging device 14 via the camera interface 203.

[0026] The display interface 204 relays data transmission between the processor 201 and the display 13. Specifically, the display interface 204 outputs a signal for displaying various information (for example, an image showing the work procedure, an image showing a work error, etc.) to the display 13 according to a command from the processor 201. Also, the display interface 204 outputs a signal instructing the end of display to the display 13 according to a command from the processor 201.

[0027] The speaker interface 205 relays data transmission between the processor 201 and the speaker 16. Specifically, the speaker interface 205 outputs a signal for outputting sound to the speaker 16 according to a command from the processor 201.

[0028] The input interface 206 relays data transmission between the processor 201 and the input device 30. Specifically, the input interface 206 receives an operation command given by an operator operating the input device 30.

[0029] The program 222 is stored and provided in a storage medium such as the memory card 207A. The program 222 is read from the memory card 207A by the memory card interface 207 and installed in the control device 20.

[0030] The program 222 may be provided not as a single program but incorporated into a part of any program. In this case, processing according to the present embodiment is realized in cooperation with any program. Even a program that does not include such a part of the module does not deviate from the spirit of the control device 20 according to Embodiment 1. Also, part or all of the functions provided by the program 222 may be realized by dedicated hardware.

[0031] Further, instead of installing the program 222 stored in the memory card 207A in the control device 20, a program downloaded from a distribution server or the like may be installed in the control device 20.

[0032] FIG. 3 is a diagram showing an example of a work procedure manual in Embodiment 1. The work procedure manual 224 associates the name of a work, the process name, and text information indicating the content of the work. That is, the work procedure manual 224 includes text information indicating the content of at least one work for each process. In the example shown in FIG. 3, the work procedure manual 224 includes text information TX1 as text information indicating the content of the work corresponding to work A, includes text information TX2 as text information indicating the content of the work corresponding to work B, and includes text information TX3 as text information indicating the content of the work corresponding to work C. The text information TX1 includes the content of the work corresponding to each of steps 1 to 10. The text information TX2 includes the content of the work corresponding to each of steps 1 to 8. The text information TX3 includes the content of the work corresponding to each of steps 1 to 9.

[0033] FIG. 4 is a diagram for explaining an outline of error notification processing performed by the error notification system in Embodiment 1. The error notification processing starts when an operator performs an operation indicating the start of a work (hereinafter also referred to as a "start operation"), and ends when the operator performs an operation indicating the end of the work (hereinafter also referred to as an "end operation").

[0034] First, before starting the work, the operator wears the smart glasses 10 and turns on the power of the smart glasses 10. Next, the operator performs a start operation using the input device 30. As an example, when the power of the smart glasses 10 is turned on, a list of the names of the works for which work procedures are stored in the storage device 220 (for example, "Work A", "Work B", "Work C", etc.) and a start button are displayed on the display 13. The operator selects the name of the work to be performed next by operating the button provided on the input device 30 and presses the start button. Thereby, the start operation by the operator is completed.

[0035] The specific unit 250 receives a start operation. The specific unit 250 is realized by the processor 201 executing the program 222. When the specific unit 250 receives a start operation, it instructs the imaging device 14 to start imaging. Upon receiving the instruction from the specific unit 250, the imaging device 14 starts imaging and sequentially transmits the video obtained by imaging to the control device 20.

[0036] When the specific unit 250 receives from the imaging device 14 a video recording the state of the worker during work, it acquires, from among the work procedure manuals 224 stored in the storage device 220, the content of the work corresponding to the name of the work selected in the start operation. Next, the specific unit 250 compares, step by step, the acquired work content (that is, the work content shown in the work procedure manual 224) with the work content shown in the video recording the state of the worker during work to identify the differences. Hereinafter, the process of comparing, step by step, the work content shown in the work procedure manual 224 with the work content shown in the video recording the state of the worker during work to identify the differences is also referred to as "comparison process".

[0037] In the comparison process, the specific unit 250 identifies the process shown in the video received from the imaging device 14 based on the feature image included in the video. The feature image includes at least one of an image of the device used in each process, an image of the tool used in each process, and an image of an identifier related to each process. The identifier related to each process is, for example, a barcode, a QR code (registered trademark), a DataMatrix code (registered trademark), etc. The identifier related to each process may be attached to the device used in each process, may be attached to the tool used in each process, or may be attached to the workbench where each process is performed.

[0038] In addition, when the worker operates the input device 30 at the timing of starting each process, the specific unit 250 may identify the process shown in the video received from the imaging device 14 based on the operation.

[0039] Whenever the specific part 250 identifies a difference in the comparison process, it instructs the notification device 18 to notify of an error. Upon receiving the instruction from the specific part 250, the notification device 18 notifies of the error for a predetermined period or a predetermined number of times. As an example, the display 13 displays an image indicating an error in the work for a predetermined period or a predetermined number of times. As another example, the speaker 16 outputs a sound indicating an error in the work for a predetermined period or a predetermined number of times.

[0040] When the specific part 250 receives an end operation, it instructs the imaging device 14 to end imaging. As a result, the imaging device 14 ends imaging. Consequently, the transmission of the video from the imaging device 14 to the control device 20 ends, and the error notification process ends.

[0041] Here, referring back to FIG. 3 again, the details of the comparison process will be described by taking the case where the name of the work selected in the start operation is "Work A" shown in FIG. 3 as an example. First, when the specific part 250 receives a video recording the state of the worker during the work from the imaging device 14, it acquires text information TX1 indicating the content of "Work A" from the work procedure manual 224 stored in the storage device 220. Then, the specific part 250 sequentially compares the content of the work shown in the work procedure manual 224 with the content of the work shown in the video recording the state of the worker during the work from step 1 and identifies the differences.

[0042] Specifically, the specific part 250 reads and texturizes the numbers and characters included in the video corresponding to "Step 1" (hereinafter also referred to as the "first video") among the videos received from the imaging device 14. The specific part 250 identifies the first video based on the feature image included in the video received from the imaging device 14. For example, in the first video, an image of a container containing a sample is included. The specific part 250 reads the numbers and characters (for example, the number "identification number X1" and the characters "sample Y1") described on the label attached to the container and texturizes the read numbers and characters.

[0043] The specific part 250 compares the textified numbers and characters with the numbers and characters included in the text information TX11 to determine whether they match. The text information TX11 indicates the content of the work corresponding to "Step 1" of "Work A" shown in FIG. 3. When the textified numbers and characters match the numbers and characters included in the text information TX11, the specific part 250 determines that in Step 1, the content of the work shown in the work procedure manual 224 matches the content of the work shown in the video recording the state of the operator during the work. On the other hand, when the textified numbers and characters do not match the numbers and characters included in the text information TX11, the specific part 250 determines that in Step 1, the content of the work shown in the work procedure manual 224 is different from the content of the work shown in the video recording the state of the operator during the work, and specifies "Step 1" as the location of the difference.

[0044] The specific part 250 performs comparison processing in the same way up to "Step 2" to "Step 10". In a measurement step such as "Step 4" of "Work A" shown in FIG. 3, in the video corresponding to "Step 4" received from the imaging device 14, the image of the liquid crystal panel of the electronic balance used for measurement is included. In such a case, the specific part 250 reads the numbers (for example, the number of grams of sample Y1) displayed on the liquid crystal panel, textifies them, and compares the textified numbers with the numbers included in the text information TX14 to determine whether they match. The text information TX14 indicates the content of the work corresponding to "Step 4" of "Work A" shown in FIG. 3.

[0045] FIG. 5 is a diagram showing an example of an error notification in Embodiment 1. The screen G1 is displayed on the display 13. The screen G1 is displayed when the specific part 250 determines that the content of the work shown in the work procedure manual 224 is different from the content of the work shown in the video recording the state of the operator during the work when the operator wears the smart glasses 10 and performs the work according to the work procedure shown in the image M.

[0046] The screen G1 includes an image M, an image T, an image E1, and an image E2. The image M shows the work procedure. The image T shows the current time. The image E1 is an example of an error notification. The image E1 indicates an error in the work. The image E2 indicates the actual work content of the operator and the actions that the operator should perform.

[0047] By displaying the image E1, the operator can notice at an early stage that a work mistake has been made. Also, by displaying the image E2, the operator can know the content of the work mistake and the actions that should be taken from now on. Note that the screen G1 only needs to include at least the image E1. Also, when it is determined that there is a difference between the work content shown in the work procedure manual 224 by the specific part 250 and the work content shown in the video recording of the operator's state during the work, instead of the error notification by the display 13, an error notification by the speaker 16 may be performed. Also, when it is determined that there is a difference between the work content shown in the work procedure manual 224 by the specific part 250 and the work content shown in the video recording of the operator's state during the work, an error notification by the speaker 16 may be performed together with the error notification by the display 13.

[0048] Note that the error notification by the display 13 only needs to be in a mode that visually notifies the work error and is not limited to the mode shown in FIG. 5. Also, the error notification by the speaker 16 only needs to be in a mode that aurally notifies the work error. The speaker 16 may notify the work error by voice or by a notification sound.

[0049] FIG. 6 is a flowchart showing the processing performed by the processor of the control device in Embodiment 1. In step S1, the processor 201 receives a start operation from the input device 30.

[0050] In step S2, the processor 201 instructs the imaging device 14 to start imaging. As a result, the imaging device 14 starts imaging and sequentially transmits the video obtained by imaging to the control device 20.

[0051] Step S3 is the above-described comparison process. In step S3, the processor 201 compares, for each process, the content of the work corresponding to the name of the work selected by the operator in the start operation (that is, the content of the work shown in the work procedure manual 224) with the content of the work shown in the video recording the state of the operator during the work.

[0052] In step S4, the processor 201 determines whether there are any differences between the content of the work shown in the work procedure manual 224 and the content of the work shown in the video recording the state of the operator during the work. If the processor 201 determines that there are differences between the content of the work shown in the work procedure manual 224 and the content of the work shown in the video recording the state of the operator during the work (YES in step S4), the process proceeds to step S5. On the other hand, if the processor 201 determines that there are no differences between the content of the work shown in the work procedure manual 224 and the content of the work shown in the video recording the state of the operator during the work (NO in step S4), the process proceeds to step S6.

[0053] In step S5, the processor 201 instructs the notification device 18 to notify an error.

[0054] In step S6, the processor 201 determines whether an end operation has been received. If the processor 201 determines that an end operation has been received (YES in step S6), the process proceeds to step S7. On the other hand, if the processor 201 determines that an end operation has not been received (NO in step S6), the process returns to step S3.

[0055] In step S7, the processor 201 instructs the imaging device 14 to end imaging. After step S7, the processor 201 ends the series of processes shown in FIG. 6.

[0056] As described above, the error notification system 1 in the first embodiment includes the smart glasses 10 and the control device 20 that controls the smart glasses 10. The control device 20 compares, for each process, the content of the work including at least one process shown in the work procedure manual 224 with the content of the work shown in the video recording the state of the worker during the work, and identifies the different parts. The smart glasses 10 include a notification device 18 that notifies an error when a different part is identified. As a result, an error is notified when the worker takes an action different from the content of the work shown in the work procedure manual 224. Therefore, the worker can notice that a work mistake has been made at an early stage. Also, the fact that the worker can notice a work mistake at an early stage means that almost no time is required to investigate where the mistake occurred, leading to a reduction in the investigation time.

[0057] In addition, it is not necessary to predetermine error determination conditions for detecting work mistakes. Therefore, the time spent considering the error determination conditions can be reduced.

[0058] Also, since the error determination conditions are constructed based on personal experience and judgment, when detecting work mistakes based on the error determination conditions, only work mistakes that depend on personal experience and judgment can be detected. However, according to the error notification system 1 in the first embodiment, since an error is notified when the worker takes an action different from the content of the work shown in the work procedure manual 224, it is possible to detect work mistakes that cannot be detected by the error determination conditions.

[0059] Note that when an imaging device capable of imaging the worker's hand in front of the worker's line of sight is installed in the room where the work is performed, the control device 20 may acquire a video recording the state of the worker during the work from the imaging device. Also, when the control device 20 acquires a video recording the state of the worker during the work from an imaging device installed in the room where the work is performed, the smart glasses 10 may not include the imaging device 14.

[0060] Further, the specifying unit 250 may specify the name of the work shown in the video based on the video received from the imaging device 14. Specifically, the specifying unit 250 may read the identification information of the work (for example, the name of the work, the identification number of the work, etc.) included in the video received from the imaging device 14, and specify the name of the work shown in the video.

[0061] Further, after a difference is specified in the comparison process, the notification device 18 may continue to notify a warning about the difference until the content of the work shown in the work procedure manual 224 matches the content of the work shown in the video recording the state of the worker during the work. In such a case, the specifying unit 250 determines whether the content of the work shown in the work procedure manual 224 matches the content of the work shown in the video recording the state of the worker during the work for the difference, based on the video received from the imaging device 14. When the specifying unit 250 determines that the content of the work shown in the work procedure manual 224 matches the content of the work shown in the video recording the state of the worker during the work for the difference, the specifying unit 250 instructs the notification device 18 to end the error notification.

[0062] Further, the error notification system 1 may be configured to be able to stop the error notification by an operation of the input device 30 by the worker.

[0063] Further, the smart glasses 10 may not include the speaker 16. When the smart glasses 10 do not include the speaker 16, an error is notified by the display 13.

[0064] [Embodiment 2] Since the configuration of the error notification system in Embodiment 2 is the same as that of the error notification system 1 in Embodiment 1, the same components are denoted by the same reference numerals and their descriptions will not be repeated. In the error notification system 1 in Embodiment 1, error notification processing was performed. In contrast, in the error notification system 1 in Embodiment 2, in addition to the error notification processing, an update process for updating the error occurrence count and a pre-warning process for issuing a warning when a process with frequent errors is started are further performed.

[0065] FIG. 7 is a diagram for explaining an overview of the processing performed by the error notification system in Embodiment 2. The processing shown in FIG. 7 includes an update process and a pre-warning process in addition to the error notification processing described in Embodiment 1. Here, only the update process and the pre-warning process will be described, and the error notification processing described in FIG. 4 will not be repeated.

[0066] First, the update process will be described. The update process is to update the error occurrence count stored in the storage device 220. The storage device 220 stores the error occurrence count for each process. The error occurrence count is included in the history table 226 stored in the storage device 220. Here, with reference to FIG. 8, the history table 226 will be described. FIG. 8 is a diagram showing an example of the history table in Embodiment 2. The history table 226 associates the name of the work, the process name, and the error occurrence count.

[0067] Referring to FIG. 7 again, each time the specific part 250 identifies one process as a different part in the above-described comparison process, as an update process, 1 is added to the error occurrence count corresponding to the one process included in the history table 226. By such an update process, the error occurrence count is accumulated in the history table 226.

[0068] Next, the pre-warning process will be described. The pre-warning process is to notify a warning when a process in which the number of error occurrences reaches a predetermined number or more is started. The pre-warning process is repeatedly performed by an operator from when a start operation is input until an end operation is input.

[0069] Specifically, first, when the specific unit 250 detects a switching of work processes, it acquires the number of error occurrences of the started process from the history table 226.

[0070] The specific unit 250 identifies the switching of work processes based on the feature images included in the video received from the imaging device 14. The feature images include at least one of the images of the devices used in each process, the images of the tools used in each process, and the images of the identifiers related to each process. The identifiers related to each process are, for example, barcodes, QR codes, DataMatrix codes, etc. The identifiers related to each process may be attached to the devices used in each process, may be attached to the tools used in each process, or may be attached to the workbench where each process is performed. In addition, when the operator operates the input device 30 at the timing of starting each process, the specific unit 250 may identify the switching of work processes based on the operation.

[0071] Next, the specific unit 250 determines whether the acquired number of error occurrences is equal to or greater than a predetermined number. When the acquired number of error occurrences is equal to or greater than the predetermined number, the specific unit 250 instructs the notification device 18 to notify a warning. The notification device 18 receives the instruction from the specific unit 250 and notifies the warning for a predetermined period or a predetermined number of times. As an example, the display 13 displays an image indicating a warning for a predetermined period or a predetermined number of times. As another example, the speaker 16 outputs a sound indicating a warning for a predetermined period or a predetermined number of times.

[0072] Note that the notification device 18 may continue to notify a warning while a process in which the number of error occurrences is equal to or greater than a predetermined number is being performed by an operator. Further, the error notification system 1 may be configured to be able to stop the warning notification by an operation of the input device 30 by the operator.

[0073] FIG. 9 is a diagram showing an example of warning notification in the second embodiment. The screen G2 is displayed on the display 13. The screen G2 is displayed when the number of error occurrences in the process to be started is determined by the specifying unit 250 to be equal to or greater than a predetermined number when the operator wears the smart glasses 10 and performs work or is about to start work.

[0074] The screen G2 includes an image M, an image T, and an image E21. The image M shows the work procedure of the process to be started. The image T shows the current time. The image E21 is an example of a warning notification. The image E21 indicates that the process requires attention.

[0075] The display of the image E21 can prompt the operator to pay attention. Note that the screen G2 only needs to include at least the image E21. Further, when the specifying unit 250 determines that the number of error occurrences in the process to be started is equal to or greater than a predetermined number, a warning notification by the speaker 16 may be performed instead of the warning notification by the display 13. Further, when the specifying unit 250 determines that the number of error occurrences in the process to be started is equal to or greater than a predetermined number, a warning notification by the speaker 16 may be performed together with the warning notification by the display 13.

[0076] Note that the warning notification by the display 13 only needs to be in a mode that visually notifies a warning that the process requires attention, and is not limited to the mode shown in FIG. 9. Further, the warning notification by the speaker 16 only needs to be in a mode that aurally notifies a warning that the process requires attention, and the speaker 16 may output, by voice, that the process requires attention. Further, a notification sound indicating that the process requires attention may be predetermined and output from the speaker 16.

[0077] Further, when the determination unit 250 determines that the number of error occurrences in the started process is equal to or greater than a predetermined number, the notification device 18 may further notify the number of error occurrences in the process in addition to the warning. As an example, the display 13 may display an image indicating the warning and the number of error occurrences in the started process. As another example, the speaker 16 may output the warning and the number of error occurrences in the started process by voice. As another example, a notification sound may be predetermined according to the number of error occurrences, and the speaker 16 may output a notification sound corresponding to the number of error occurrences in the started process.

[0078] FIG. 10 is a flowchart showing the processing performed by the processor of the control device in Embodiment 2. In FIG. 10, the processes of steps S2A to S2C and S5A are added to the flowchart shown in FIG. 6. For the processes similar to those shown in FIG. 6 among the processes shown in FIG. 10, the same step numbers are assigned and the description will not be repeated.

[0079] When an instruction to start imaging is given to the imaging device 14, the processor 201 determines, in step S2A, whether or not a change in the work process has been detected. If the processor 201 determines that a change in the work process has been detected (YES in step S2A), the process proceeds to step S2B. On the other hand, if the processor 201 determines that a change in the work process has not been detected (NO in step S2A), the process proceeds to step S3.

[0080] In step S2B, the processor 201 determines whether or not the number of error occurrences in the started process is equal to or greater than a predetermined number. If the processor 201 determines that the number of error occurrences in the started process is equal to or greater than a predetermined number (YES in step S2B), the process proceeds to step S2C. On the other hand, if the processor 201 determines that the number of error occurrences in the started process is less than the predetermined number (NO in step S2B), the process proceeds to step S3.

[0081] In step S2C, the processor 201 instructs the notification device 18 to issue a warning. Steps S2A, S2B, and S2C correspond to the above-described pre-warning process.

[0082] Thereafter, when an error notification instruction is given to the notification device 18 in step S5, the processor 201 updates the error occurrence count in step S5A. Step S5A corresponds to the above-described update process. The error occurrence count updated in step S5A is used in step S2B described above.

[0083] As described above, the error notification system 1 in the second embodiment executes the error notification process described in the first embodiment. Therefore, the error notification system 1 in the second embodiment also has the effects described in the first embodiment. Further, the error notification system 1 in the second embodiment further executes an update process for updating the error occurrence count and a pre-warning process for issuing a warning when a process in which the error occurrence count is equal to or more than a predetermined number starts. Thereby, in the error notification system 1 in the second embodiment, a warning is issued when a process in which an error has occurred a predetermined number of times or more starts. Therefore, in a process where errors frequently occur, it is possible to draw the attention of the operator, leading to a reduction in work mistakes.

[0084] In the above example, the error notification system 1 in the second embodiment notifies a warning when a process with the number of error occurrences equal to or greater than a predetermined number starts. However, the error notification system 1 in the second embodiment may also notify a warning when a process with the number of occurrences of the same error equal to or greater than a predetermined number starts. In such a case, as shown in FIG. 11, the storage device 220 stores the number of error occurrences for each error content. FIG. 11 is a diagram showing another example of the history table in the second embodiment. The history table 226A is stored in the storage device 220 instead of the above-described history table 226. The history table 226A associates the name of the work, the process name, the error content, and the number of error occurrences. The history table 226A forms one record for each error content, and the record includes the name of the work, the process name, the error content, and the number of error occurrences. Therefore, there may be a case where there are multiple records for one process, such as "Process 2" of "Work A" shown in FIG. 11 or "Process 3" of "Work C" shown in FIG. 11. Also, when no error has occurred even once for one process, such as "Process 1" and "Process 2" of "Work C" shown in FIG. 11, no record exists.

[0085] The update process of the history table 226A is performed by the specifying unit 250 as follows. Each time the specifying unit 250 specifies one process as a different part in the above-described comparison process, the specifying unit 250 further specifies the error content. The specifying unit 250 specifies the error content based on a partial video showing the different part among the videos recording the state of the worker during the operation received from the imaging device 14. As an example, when the specifying unit 250 determines from the partial video showing the different part that the reagent taken out from the storage is different from the reagent shown in the work procedure manual 224, the specifying unit 250 specifies the error content as "mistake in taking the reagent". Also, when the specifying unit 250 determines from the partial video showing the different part that the amount of the weighed reagent is different from the amount shown in the work procedure manual 224, the specifying unit 250 specifies it as "weighing error of the reagent". Further, when the specifying unit 250 determines from the partial video showing the different part that a part of the weighed reagent remains on the paper used for weighing and the total amount of the weighed reagent has not been poured into the volumetric flask, the specifying unit 250 specifies it as "input error of the reagent".

[0086] The specific unit 250 refers to each record in the history table 226A, and adds 1 to the error occurrence count of the record including the name of the work selected by the operator in the start operation, the process name indicating one process specified as the difference, and the content of the specified error. If the history table 226A does not include a record including the name of the work selected by the operator in the start operation, the process name indicating one process specified as the difference, and the content of the specified error, the specific unit 250 newly adds a record to the history table 226A and sets the error occurrence count of the record to 1.

[0087] When the storage device 220 stores the error occurrence count for each error content, the pre-warning process is performed by the specific unit 250 as follows. When the specific unit 250 detects a change in the work process, it refers to the history table 226A and identifies all records corresponding to the started process. As an example, when the started process is "Process 2" of "Work A" shown in FIG. 11, the specific unit 250 identifies the record including "Error b1" and the record including "Error c1". Next, the specific unit 250 determines whether at least one of the identified records includes an error occurrence count equal to or greater than a predetermined number of times. If at least one of the identified records includes an error occurrence count equal to or greater than a predetermined number of times, the specific unit 250 instructs the notification device 18 to issue a warning notification. On the other hand, if none of the identified records includes an error occurrence count equal to or greater than a predetermined number of times, the specific unit 250 ends the pre-warning process without instructing the notification device 18 to issue a warning notification. Also, when the history table 226A does not include a record corresponding to the started process, the specific unit 250 ends the pre-warning process without instructing the notification device 18 to issue a warning notification.

[0088] Accordingly, when a process in which errors of the same content occur more than a predetermined number of times is started, a warning is issued. Therefore, in a process where errors of the same content frequently occur, it is possible to draw the operator's attention, leading to a reduction in work mistakes. In addition, when a process in which the number of occurrences of errors of the same content is equal to or more than a predetermined number of times is started, the notification device 18 may further notify the number of occurrences of the errors of the said content in addition to the warning.

[0089] [Embodiment 3] The error notification system in Embodiment 3 further includes an external output device. Among the configurations of the error notification system in Embodiment 3, the same configurations as those of the error notification system 1 in Embodiment 1 are denoted by the same reference numerals, and the description thereof will not be repeated.

[0090] FIG. 12 is a diagram showing an overview of the error notification system in Embodiment 3. The error notification system 1A includes a smart glass 10, a control device 20A, an input device 30, and an external output device 500. The control device 20A can communicate with the smart glass 10, the input device 30, and the external output device 500 via wired communication or wireless communication. The external output device 500 outputs error information regarding mistakes in work by the operator.

[0091] FIG. 13 is a diagram showing an example of the configuration of the control device in Embodiment 3. The control device 20A includes the configurations included in the above-described control device 20, and further includes a communication interface 208. The communication interface 208 communicates with the external output device 500 via a network. As an example, the communication interface 208 transmits error information to the external output device 500.

[0092] FIG. 14 is a diagram showing an example of the configuration of the external output device in Embodiment 3. The external output device 500 includes a processor 501, a main memory 502, a communication interface 503, a display interface 504, a display 505, an input interface 506, an input device 507, and a storage device 520. The processor 501, the main memory 502, the communication interface 503, the display interface 504, the input interface 506, and the storage device 520 are communicably connected to each other via an internal bus 599.

[0093] The processor 501 is constituted by, for example, at least one integrated circuit. The integrated circuit is constituted by, for example, at least one CPU, at least one ASIC, at least one FPGA, or a combination thereof.

[0094] The processor 501 realizes various processes by expanding and executing the program 522 stored in the storage device 520 in the main memory 502. The main memory 502 is constituted by a volatile memory and functions as a work memory necessary for the execution of the program by the processor 501.

[0095] The storage device 520 is constituted by a non-volatile memory. Alternatively, the storage device 520 may be, for example, a hard disk, an SSD, etc., and may be either built-in or external. The storage device 520 stores a program 522 for realizing various processes according to the present embodiment and various data (for example, error information 228 received from the control device 20A, etc.).

[0096] The communication interface 503 communicates with the control device 20A via a network. As an example, the communication interface 503 receives the error information 228 from the control device 20A.

[0097] The display interface 504 relays data transmission between the processor 501 and the display 505. Specifically, the display interface 504 outputs, according to commands from the processor 501, signals for displaying various types of information (such as error information 228, etc.) to the display 505. Also, the display interface 504 outputs, according to commands from the processor 501, a signal for instructing the end of display to the display 505. The display 505 displays various types of information (such as error information 228, etc.) according to the signals received from the display interface 504.

[0098] The input interface 506 relays data transmission between the processor 501 and the input device 507. Specifically, the input interface 506 receives operation commands given by an operator operating the input device 507. The input device 507 is an example of a "reception device". The input device 507 receives the editing of error information by the user. The user includes at least one of an operator and an administrator. The input device 507 includes, for example, a keyboard and a mouse.

[0099] The program 522 may be provided incorporated not as a single program but as part of any program. In this case, processing according to the present embodiment is realized in cooperation with any program. Even a program that does not include such a part of the module does not deviate from the spirit of the external output device 500 according to Embodiment 3. Also, part or all of the functions provided by the program 522 may be realized by dedicated hardware.

[0100] FIG. 15 is a diagram for explaining an outline of the processing performed in the error notification system according to Embodiment 3. The processing shown in FIG. 15 includes error information output processing in addition to the error notification processing described in Embodiment 1. Here, only the error information output processing will be described, and the error notification processing described in FIG. 4 will not be repeated.

[0101] The specific part 250A is realized by the processor 201 executing the program 222. The specific part 250A executes the processing performed by the above-mentioned specific part 250. Further, the specific part 250A stores the error information 228 in the storage device 220 and transmits the error information 228 to the external output device 500 after the work is completed.

[0102] Specifically, each time the specific part 250A identifies a difference in the above-mentioned comparison process, it stores the error information 228 in the storage device 220. The storage device 220 stores the error information 228. The error information 228 includes information regarding mistakes in the work by the operator. The error information 228 includes at least the name of the work for which the error was notified. As an example, if the name of the work selected by the operator in the start operation is "Work A" shown in FIG. 3 and an error is notified, the name of the work for which the error was notified is "Work A".

[0103] The error information 228 may further include at least one of the implementation date of the work for which the error was notified, the start time of the work, the process name indicating the process identified as the difference, the content of the error, the partial video indicating the difference among the videos recording the state of the operator during the work received from the imaging device 14, and the time when the partial video was taken. When the process identified as the difference in the comparison process is "Process 3", the process name indicating the process identified as the difference is "Process 3".

[0104] Note that the error information 228 only needs to include information regarding mistakes in the work by the operator and is not limited to the information listed above. Also, the content of the error is identified by the specific part 250A by the method described in the above Embodiment 2.

[0105] When the specific unit 250A receives an end operation indicating the end of the work, it transmits the error information 228 stored in the storage device 220 for the work to the external output device 500. The external output device 500 outputs the error information 228 according to the user's operation. As an example, the display 505 of the external output device 500 displays the error information 228.

[0106] After transmitting the error information 228 to the external output device 500, the specific unit 250A may or may not delete the error information 228 from the storage device 220. When the error information 228 is deleted from the storage device 220 after being transmitted to the external output device 500, the limited storage capacity of the storage device 220 can be effectively utilized.

[0107] FIG. 16 is a flowchart showing the processing performed by the processor of the control device in the third embodiment. In the flowchart of FIG. 16, the processing of steps S5B and S8 is added to the flowchart of FIG. 6. For the processing similar to the processing shown in FIG. 6 among the processing shown in FIG. 16, the same step numbers are assigned and the description will not be repeated.

[0108] When an error notification instruction is given to the notification device 18 in step S5, the processor 201 stores the error information 228 in the storage device 220 in step S5B.

[0109] Then, when an imaging end instruction is given to the imaging device 14 in step S7, the processor 201 instructs the communication interface 208 to transmit the error information 228 to the external output device 500 in step S8.

[0110] After step S8, the communication interface 208 transmits the error information 228 to the external output device 500. The error information 228 is received by the communication interface 503 of the external output device 500. The processor 501 stores the error information 228 received from the control device 20A in the storage device 520. When the user performs an operation to instruct the display 505 to display the error information 228 using the input device 507, the processor 501 instructs the display 505 to display the error information 228. Thereby, the error information 228 is displayed on the display 505.

[0111] FIG. 17 is a diagram showing an example of error information displayed on the display of the external output device in Embodiment 3. The screen G3 is displayed on the display 505. The screen G3 is displayed when the user performs an operation to instruct the display 505 to display the error information 228 using the input device 507.

[0112] The screen G3 includes an image K1, an image K2, an image K3, an image K4, and an image K5. The image K1, the image K2, the image K3, the image K4, and the image K5 are examples of error information. The image K1 indicates the name of the work for which the error was notified. The image K2 indicates the start date and time of the work for which the error was notified. The image K3 indicates the content of the error identified by the specifying unit 250A. The image K4 indicates the error occurrence time. As the error occurrence time, the time when the partial video indicating the different part in the video recording the state of the worker during the work received from the imaging device 14 was captured may be used, or the time when the control device 20A received the partial video from the imaging device 14 may be used. The image K5 is a partial video indicating the different part in the video recording the state of the worker during the work received from the imaging device 14. By clicking on the image K5, the partial video is played back.

[0113] Since the error information 228 includes information regarding the mistakes made by the operator, it can be said that the error information 228 is also the information necessary for the cause investigation when an error occurs during the work. Therefore, the user can obtain the information necessary for the cause investigation when an error occurs during the work just by checking the screen G3.

[0114] Note that the screen G3 may be output on paper from a printer capable of communicating with the external output device 500. Also, the external output device 500 may be configured to be editable by the user for the error information 228. As an example, when the user performs an operation instructing the editing of the error information 228 using the input device 507, the processor 501 edits the error information 228 according to the operation. The editing of the error information 228 includes at least one of deletion, addition, and modification of the error information 228.

[0115] As described above, the error notification system 1A in the third embodiment executes the error notification process described in the first embodiment. Therefore, the error notification system 1A in the third embodiment also has the effects described in the first embodiment. Also, the error notification system 1A in the third embodiment further executes the error information output process. As a result, in the error notification system 1A in the third embodiment, the user can check the error information 228. Since the error information 228 includes information regarding the mistakes made by the operator, the user can obtain the information necessary for the cause investigation when an error occurs during the work just by checking the error information 228. Therefore, the time required for the cause investigation when an error occurs can be shortened.

[0116] Note that the timing at which the error information 228 is transmitted to the external output device 500 is not limited to after the completion of the work. The error information 228 may be transmitted to the external output device 500 during the work. Also, the error information 228 may be transmitted to the external output device 500 during the charging of the smart glass 10. Also, the error information 228 may be transmitted to the external output device 500 when the operator performs an operation instructing the transmission using the input device 30.

[0117] Further, the error notification system 1A may further execute the update process described in the second embodiment and the pre-warning process.

[0118] Further, when the error information includes a partial video indicating a different part among the videos recording the state of the worker during work received from the imaging device 14, the error notification system 1A may be configured to notify a warning when the worker takes an action similar to the action shown in the partial video.

[0119] [Other Modifications] In the above embodiment, the smart glasses 10 employ a binocular display, but a monocular display may be employed. When the binocular display is employed for the smart glasses 10, even when viewing a high-resolution image, the fatigue of the user's eyes can be reduced. On the other hand, when the monocular display is employed for the smart glasses 10, the smart glasses 10 can be made lighter. Further, the display 13 may be detachable from the protective glass 11 or not. Further, a screen may be employed for the smart glasses 10 instead of the display 13. When a screen is employed for the smart glasses 10, the smart glasses 10 are further provided with a projection device that projects a video onto the screen. The processor 201 controls the display on the screen by controlling the projection by the projection device.

[0120] In the above embodiment, the control devices 20, 20A are provided in a housing separate from the smart glasses 10, but they may be provided in the same housing as the smart glasses 10. Further, in the above embodiment, the input device 30 is provided in a housing separate from the smart glasses 10, but it may be provided in the same housing as the smart glasses 10.

[0121] In the above-described embodiment, the wearable device was a glasses-type (including goggle-type) wearable device (smart glasses), but a helmet-type wearable device may also be used. Further, the wearable device is not limited to a head-mounted type such as glasses-type or helmet-type, and may be a wristband-type or pendant-type wearable device.

[0122] [Aspect] Those skilled in the art will understand that the above-described plurality of exemplary embodiments are specific examples of the following aspects.

[0123] (Item 1) An error notification system according to one aspect includes a wearable device and a control device that controls the wearable device. The control device compares, for each step, the content of the work including at least one step shown in the work procedure manual with the content of the work shown in the video recording the state of the worker during the work to identify the differences. The wearable device includes a notification device that notifies an error when a difference is identified.

[0124] According to the error notification system described in Item 1, while the worker is wearing the wearable device and performing the work, it is specified by the control device whether the work content of the worker matches the work content shown in the work procedure manual from the video recording the state of the worker. When the worker takes an action different from the work content shown in the work procedure manual, an error is notified to the worker's wearable device. Therefore, the worker can notice that a work mistake has been made at an early stage. Also, the fact that the worker can notice a work mistake at an early stage means that almost no time is required to investigate where the mistake occurred, leading to a reduction in the investigation time.

[0125] Also, there is no need to predetermine error determination conditions for detecting work mistakes. Therefore, the time spent considering error determination conditions can be reduced.

[0126] In addition, since the error determination conditions are constructed based on personal experience and judgment, when detecting work errors based on the error determination conditions, only work errors that depend on personal experience and judgment can be detected. However, according to the error notification system described in paragraph 1, when an operator takes an action different from the content of the work shown in the work procedure manual, an error is notified. Therefore, it is possible to detect work errors that cannot be detected by the error determination conditions.

[0127] (Paragraph 2) In the error notification system described in paragraph 1, the control device further includes a storage device that stores the number of error occurrences for each process. The notification device notifies a warning when a process in which the number of error occurrences is equal to or more than a predetermined number is started.

[0128] According to the error notification system described in paragraph 2, a warning is notified when a process in which an error has occurred a predetermined number of times or more is started. Therefore, in a process where errors frequently occur, it is possible to draw the operator's attention, leading to a reduction in work errors.

[0129] (Paragraph 3) In the error notification system described in paragraph 1, the control device further includes a storage device that stores the number of error occurrences of the same content. The notification device notifies a warning when a process in which the number of error occurrences is equal to or more than a predetermined number is started.

[0130] According to the error notification system described in paragraph 3, a warning is notified when a process in which the same error has occurred a predetermined number of times or more is started. Therefore, in a process where the same error frequently occurs, it is possible to draw the operator's attention, leading to a reduction in work errors.

[0131] (Paragraph 4) In the error notification system described in paragraph 2 or 3, the notification device includes a display device that visually notifies errors and warnings.

[0132] According to the error notification system described in paragraph 4, the operator can easily recognize errors and warnings.

[0133] (Item 5) In the error notification system according to Item 2 or Item 3, the notification device includes a speaker for audibly notifying errors and warnings.

[0134] According to the error notification system described in Item 5, an operator can easily recognize errors and warnings.

[0135] (Item 6) In the error notification system according to Item 5, the speaker notifies errors and warnings by voice.

[0136] According to the error notification system described in Item 6, an operator can easily recognize errors and warnings.

[0137] (Item 7) In the error notification system according to Item 5, the speaker notifies errors and warnings by a notification sound.

[0138] According to the error notification system described in Item 7, an operator can easily recognize errors and warnings.

[0139] (Item 8) In the error notification system according to any one of Items 2 to 7, when a process in which the number of error occurrences is equal to or more than a predetermined number starts, the notification device further notifies the number of error occurrences.

[0140] According to the error notification system described in Item 8, the attention of an operator can be further aroused.

[0141] (Item 9) In the error notification system according to any one of Items 1 to 8, the error notification system is configured to be communicable with a control device and further includes an external output device that outputs error information. The error information includes information regarding mistakes in work by an operator.

[0142] According to the error notification system described in claim 9, the user can check the error information. Since the error information includes information regarding the mistakes in the work by the operator, the user can obtain the information necessary for the cause investigation when an error occurs in the work just by checking the error information. Therefore, the time required for the cause investigation when an error occurs can be shortened.

[0143] (Claim 10) In the error notification system described in claim 9, the control device identifies the error content based on the partial video indicating the different part in the video. The error information further includes the error content identified by the control device.

[0144] According to the error notification system described in claim 10, the user can easily know the error content.

[0145] (Claim 11) In the error notification system described in claim 10, the error information further includes the time when the partial video was taken.

[0146] The time when the partial video was taken is approximately equal to the error occurrence time. According to the error notification system described in claim 11, the user can easily know the error occurrence time.

[0147] (Claim 12) In the error notification system described in claim 10 or claim 11, the error information further includes the partial video.

[0148] According to the error notification system described in claim 12, the user can easily view the partial video indicating the different part.

[0149] (Claim 13) In the error notification system described in any one of claims 9 to 12, the external output device further includes a reception device that receives the editing of the error information by the user.

[0150] According to the error notification system described in claim 13, the user can edit the error information.

[0151] (Item 14) In the error notification system according to any one of Items 1 to 13, the control device identifies the process shown in the video based on the feature image included in the video. The feature image includes at least one of an image of the device used in each process, an image of the instrument used in each process, and an image of the identifier related to each process.

[0152] According to the error notification system described in Item 14, since the operator does not need to perform an operation to notify the switching of the process at the timing of starting each process, the labor of the operator can be saved.

[0153] (Item 15) In the error notification system according to any one of Items 1 to 14, the wearable device further includes an imaging device that captures the state of the operator's work.

[0154] According to the error notification system described in Item 15, it becomes easier to capture the state of the operator's hands.

[0155] (Item 16) In the error notification system according to any one of Items 1 to 15, the wearable device is smart glasses.

[0156] According to the error notification system described in Item 16, the convenience of the operator is improved.

[0157] (Item 17) A control device according to one aspect controls a wearable device. The control device compares, for each process, the content of the work including at least one process shown in the work procedure manual with the content of the work shown in the video recording the state of the operator during the work to identify the differences. The wearable device includes a notification device that notifies an error when the differences are identified.

[0158] According to the control device described in claim 17, while the operator is wearing the wearable device and performing work, it is determined by the control device whether the work content of the operator matches the work content shown in the work procedure manual from the video recording the state of the operator. When the operator takes an action different from the work content shown in the work procedure manual, an error is notified to the wearable device of the operator. Therefore, the operator can notice that a work mistake has been made at an early stage. Also, the fact that the operator can notice a work mistake at an early stage means that almost no time is required to investigate where the mistake occurred, leading to a reduction in the investigation time.

[0159] Also, there is no need to pre-determine error determination conditions for detecting work mistakes. Therefore, the time spent considering the error determination conditions can be reduced.

[0160] Also, since the error determination conditions are constructed based on personal experience and judgment, when detecting work mistakes based on the error determination conditions, only work mistakes that depend on personal experience and judgment can be detected. However, according to the control device described in claim 17, since an error is notified when the operator takes an action different from the work content shown in the work procedure manual, work mistakes that cannot be detected by the error determination conditions can also be detected.

[0161] The embodiments disclosed this time should be considered illustrative in all respects and not restrictive. The scope of the present invention is shown not by the above description but by the claims, and it is intended that all modifications within the meaning and scope equivalent to the claims are included.

Explanation of Reference Signs

[0162] 1,1A error notification system, 10 smart glasses, 11 protective glass, 13, 13a, 13b, 505 display, 14 imaging device, 15a, 15b attachment part, 16 speaker, 18 notification device, 20, 20A control device, 30, 507 input device, 201, 501 processor, 202, 502 main memory, 203 camera interface, 204, 504 display interface, 205 speaker interface, 206, 506 input interface, 207 memory card interface, 207A memory card, 208, 503 communication interface, 220, 520 storage device, 222, 522 program, 224 work procedure manual, 226, 226A history table, 228 error information, 250, 250A specifying part, 299, 599 internal bus, 500 external output device, E1, E2, E21, K1, K2, K3, K4, K5, M, T images, G1, G2, G3 screens, TX1, TX2, TX3, TX11, TX14 text information.

Claims

1. An error notification system, comprising: a wearable device; a control device for controlling the wearable device, wherein the control device compares, for each process, the content of work including at least one process shown in a work procedure manual with the content of work shown in a video recording the state of a worker during work to identify a difference, wherein the wearable device includes a notification device that notifies an error when the difference is identified, wherein the error notification system further includes an external output device, wherein the control device transmits error information including information regarding a mistake in work by the worker to the external output device, wherein the error information includes a partial video showing the difference in the video, the error notification system.

2. An error notification system, comprising: a wearable device; a control device for controlling the wearable device, wherein the control device identifies the process shown in the video based on a feature image included in the video recording the state of a worker during work, compares, for each process, the content of work including at least one process shown in a work procedure manual with the content of work shown in the video to identify a difference, wherein the feature image includes an image of an identifier related to each process, wherein the wearable device includes a notification device that notifies an error when the difference is identified, the error notification system.

3. wherein the control device further includes a storage device that stores the number of error occurrences for each process, wherein the notification device notifies a warning when a process with the number of error occurrences equal to or greater than a predetermined number is started, the error notification system according to Claim 1 or 2.

4. The error notification system according to Claim 3, wherein the notification device includes at least one of a display device that visually notifies the error and the warning and a speaker that audibly notifies the error and the warning.

5. The error notification system according to Claim 3, wherein the notification device further notifies the number of error occurrences when a process with the number of error occurrences equal to or greater than the predetermined number is started.

6. wherein the control device further includes a storage device that stores the number of error occurrences of the same content, wherein the notification device notifies a warning when a process with the number of error occurrences equal to or greater than a predetermined number is started, the error notification system according to Claim 1 or 2.

7. The error notification system according to claim 6, wherein the notification device includes at least one of a display device that visually notifies the error and the warning, and a speaker that audibly notifies the error and the warning.

8. The error notification system according to claim 6, wherein when a process in which the number of error occurrences is equal to or greater than the predetermined number starts, the notification device further notifies the number of error occurrences.

9. The error notification system according to claim 1, wherein the external output device outputs the error information in response to a user operation.

10. The control device identifies error content based on the partial video. The error notification system according to claim 1, wherein the error information further includes the error content identified by the control device.

11. The control device identifies the process shown in the video based on the feature image included in the video. The error notification system according to claim 1, wherein the feature image includes at least one of an image of a device used in each process, an image of a tool used in each process, and an image of an identifier related to each process.

12. The error notification system further includes an external output device configured to be communicable with the control device and output error information. The error notification system according to claim 2, wherein the error information includes information related to an error in work by the worker.

13. The control device identifies error content based on a partial video showing the different part of the video. The error notification system according to claim 12, wherein the error information further includes the error content identified by the control device.

14. The error notification system according to claim 1 or 13, wherein the error information further includes the time when the partial video was taken.

15. The error notification system according to claim 13, wherein the error information further includes the partial video.

16. The error notification system according to claim 1 or 12, wherein the external output device further includes a reception device that receives editing of the error information by the user.

17. The error notification system according to claim 1 or 2, wherein the wearable device further includes an imaging device that captures the state of work of the worker.

18. The error notification system according to claim 1 or 2, wherein the wearable device is smart glasses. A control device for controlling a wearable device including a notification device, comprising: a specifying unit that specifies a difference by comparing, for each process, the content of work including at least one process shown in a work procedure manual with the content of work shown in a video recording the state of a worker during work; when the specifying unit specifies the difference, the specifying unit instructs the notification device to notify an error; the specifying unit transmits error information including information regarding a mistake in work by the worker to an external output device; the error information includes a partial video showing the difference in the video, the control device. A control device for controlling a wearable device including a notification device, comprising: a specifying unit that specifies a difference by comparing, for each process, the content of work including at least one process shown in a work procedure manual with the content of work shown in a video recording the state of a worker during work; the specifying unit specifies the process shown in the video based on a feature image included in the video; the feature image includes an image of an identifier related to each process; when the specifying unit specifies the difference, the specifying unit instructs the notification device to notify an error, the control device.

Images