Operation know-how extraction system, and program

Abstract

A technique for extracting work know-how inexpensively and efficiently (in a short time) from a series of operations is proposed. 【Solution means】The work know-how extraction system according to the present disclosure extracts undocumented procedures implemented by an operator directly contacting equipment by collating the contact between the operator and the equipment with the time zone of the work procedure, and extracts undocumented procedures implemented by the operator contacting the equipment using a tool by collating the contact between the tool and the equipment with the time zone of the work procedure.

Description

Technical Field

[0001] The present disclosure relates to a work know-how extraction system and a program.

Background Art

[0002] In recent years, the aging of social infrastructure such as water purification facilities and roads, and the 2025 problem (the timing when the baby boomer generation becomes late elderly, the retirement of skilled workers) have been growing. In particular, due to the retirement of skilled workers, it has become difficult to inherit know-how from skilled workers in the operation and maintenance inspection work of various facilities, and how to pass on such know-how to junior workers has become an issue. Here, the know-how of skilled workers is generally a procedure (unwritten procedure) not described in the work procedure manual (work manual), and is knowledge (procedure) acquired by skilled workers through years of experience.

[0003] Regarding this point, for example, Patent Document 1 discloses estimating an action performed by a person on an object based on the skeletal information of the person detected from the captured image by an imaging device, and the area information regarding the person imaging position, the target area, and the position of the object, and recognizing the action of the person based on the distance between the person and the object and the estimated action.

Prior Art Documents

Patent Documents

[0004]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0005] However, according to the technology disclosed in Patent Document 1, in order to recognize the actions of a person, it is necessary to create an AI (Artificial Intelligence) for recognizing the operations of an operator and the operation locations of equipment. Therefore, it takes a great deal of cost (monetary cost and human cost) to prepare learning data for creating those AIs and to perform the learning process of the AIs. In particular, since social infrastructure equipment such as that described above is not a generalized equipment, learning data must be prepared every time maintenance and inspection are carried out, resulting in additional cost compared to general equipment. In view of such a situation, the present disclosure proposes a technology for extracting work know-how inexpensively and efficiently (in a short time).

Means for Solving the Problem

[0006] In order to solve the above problems, the work know-how extraction system according to the present disclosure extracts undocumented procedures implemented by an operator directly contacting equipment by collating the contact between the operator and the equipment with the time zone of the work procedure, and extracts undocumented procedures implemented by an operator contacting the equipment using a tool by collating the contact between the tool and the equipment with the time zone of the work procedure.

[0007] Further features related to the present disclosure will become apparent from the description of this specification and the accompanying drawings. Also, the aspects of the present disclosure are achieved and realized by elements and combinations of various elements and the aspects of the following detailed description and the appended claims. It should be understood that the description in this specification is merely a typical example and does not limit the scope of the claims or the application examples in any sense.

Effect of the Invention

[0008] According to the technology of the present disclosure, it becomes possible to extract work know-how inexpensively and efficiently (in a short time).

Brief Description of the Drawings

[0009]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Figure 9

MODE FOR CARRYING OUT THE INVENTION

[0010] <Embodiment 1> Hereinafter, the present embodiment will be described with reference to the accompanying drawings. In the accompanying drawings, functionally identical elements may sometimes be denoted by the same reference numerals, and duplicate explanations will be omitted. Note that the accompanying drawings show specific embodiments and examples in accordance with the principles of the present disclosure, but these are for the purpose of understanding the present disclosure and are by no means used for interpreting the present disclosure in a limiting manner.

[0011] In this embodiment, although the description is made in sufficient detail for those skilled in the art to implement the present disclosure, other implementation forms are also possible, and it is necessary to understand that configuration and structural changes and replacement of various elements can be made without departing from the scope and spirit of the technical idea of the present disclosure. Therefore, the following description should not be construed as being limited thereto.

[0012] <Configuration Example of Work Know-How Extraction Device> FIG. 1 is a diagram showing a schematic configuration example of a work know-how extraction device 1 according to an embodiment of the present disclosure.

[0013] The work know-how extraction device 1 includes a computer system 10.

[0014] The computer system 10 includes a control device 101 composed of a processor (such as a CPU or MPU), an input unit 102 such as a keyboard, a touch panel, and a USB port, a storage device 103 that holds a work know-how extraction program, various data, parameters, etc., an output unit 104 such as a display and a printer, and a communication device 105 that communicates with an external device via a network.

[0015] The control device 101 reads the work know-how extraction program from the storage device 103, expands it in an internal memory (not shown), and configures a facility contact data acquisition unit 1011, a procedure execution time zone data acquisition unit 1012, a procedure association contact operation extraction unit 1013, an unwritten procedure contact operation extraction unit 1014, an unwritten procedure execution time zone extraction unit 1015, and an extraction information output processing unit 1016. Details of each process will be described later.

[0016] <Various Input Data> FIG. 2 is a diagram (table) showing a configuration example of various input data used in this embodiment. The various input data includes, for example, facility contact data 210 including the time when an operator contacts a facility (work target) and the contact coordinates of the contact location, procedure execution time zone data 220 indicating the start time and end time of each procedure described in a procedure manual, and procedure content data 230 indicating the content of each procedure described in the procedure manual and the operation location.

[0017] The equipment contact data 210 includes, as constituent items, a contact number (contact ID) 2101 that uniquely identifies the contact with the equipment, a contact time 2102, and contact coordinates 2103 of the contact location. The equipment contact data 210 can generally be created in various ways. For example, it can be created by the method disclosed in Pamphlet No. WO 2010 / 027015. However, the method for creating the equipment contact data 210 is not limited to the method disclosed in this publication.

[0018] The procedure execution time zone data 220 includes, as constituent items, a procedure number (procedure ID) 2201 that uniquely identifies the procedure in the procedure manual, a procedure start time 2202 indicating the time when the corresponding procedure started, and a procedure end time 2203 indicating the time when the corresponding procedure ended. The procedure execution time zone data 220 can generally be created in various ways. For example, it can be created using a portable terminal such as a smart device. Specifically, the operator can start a predetermined application on the portable terminal and obtain the procedure start time and the procedure end time by pressing the start button and the end button for each procedure shown in the GUI. (Input may also be made by voice or gesture instead of buttons.) However, the method for creating the procedure execution time zone data 220 is not limited to this method.

[0019] The procedure content data 230 is data extracted from the procedure manual and includes, as constituent items, a procedure number (procedure ID) 2301 that uniquely identifies the procedure in the procedure manual, content 2302 that describes the content of the corresponding procedure in the form of "contact target (e.g., lever)" "what kind of operation (e.g., pull)", and an operation location 2303 indicating the location where the corresponding procedure is operated.

[0020] <Content of the work know-how extraction process> FIG. 3 is a flowchart for explaining the work know-how extraction process executed by the work know-how extraction device 1 according to the present embodiment. The operating entity of the processing in each step is each processing unit (facility contact data acquisition unit 1011, procedure execution time zone data acquisition unit 1012, procedure-linked contact operation extraction unit 1013, unwritten procedure contact operation extraction unit 1014, unwritten procedure execution time zone extraction unit 1015, and extraction information output processing unit 1016) configured in the control device 101. However, since the work know-how extraction process is configured by the control device (processor) 101 reading the work know-how extraction program held in the storage device 103, the control device (processor) 101 may be used as the operating entity of each step.

[0021] (i) Step S301 The facility contact data acquisition unit 1011 acquires facility contact data 210 from an external file via the input unit 102.

[0022] (ii) Step S302 The procedure execution time zone data acquisition unit 1012 acquires procedure execution time zone data 220 from an external file via the input unit 102.

[0023] (iii) Step S303 In the procedure-linked contact operation extraction unit 1013, the contact time 2102 in the contact operation acquired in step S301 is compared with the procedure start time 2202 and the procedure end time 2203 of each procedure described in the procedure manual acquired in step S302, and the contact operation (procedure-linked contact operation) that was contacted by the operation of each procedure is extracted. Specifically, the last contact operation performed within the procedure execution time zone of each procedure is extracted as the procedure-linked contact operation of that procedure.

[0024] (iv) Step S304 The non-described procedure contact operation extraction unit 1014 extracts non-described procedure contact operations (contact operations not described in the procedure manual) from the contact operations (equipment contact data 210) acquired in step S301, excluding the procedure-linked contact operations extracted in step S303 (non-procedure-linked contact operations). However, only those that meet the following conditions are extracted as non-described procedure contact operations.

[0025] (Condition 1) Being all non-procedure-linked contact operations: This is a reasonable condition assuming careful work where the equipment is not touched except during procedures. (Condition 2) The contact position being separated by a certain distance or more from the operation (contact) locations of the preceding and subsequent procedures: For example, this is a condition for excluding contact operations such as removing dust from the operation locations of the preceding and subsequent procedures. (Condition 3) The contact time being separated by a certain time or more from the contact times of the preceding and subsequent procedures: For example, in the case of continuous contact in units of 1 second, this is a condition for excluding the contact operation by recognizing it as a simple mistake of the operator. (Condition 4) A combination of Condition 2 and Condition 3 (OR condition)

[0026] (v) Step S305 The non-described procedure execution time zone extraction unit 1015 refers to the equipment contact data 210 and the procedure execution time zone data 220, and extracts the execution time zone corresponding to each of the non-described procedure contact operations extracted in step S304 (the time zone from the end time of the procedure immediately preceding the corresponding non-described procedure contact operation to the contact time of the non-described procedure contact operation).

[0027] (vi) Step S306 The extraction information output processing unit 1016 refers to the equipment contact data 210 and specifies the three-dimensional coordinates of the contact location corresponding to each of the procedure-linked contact operations extracted in step S303.

[0028] (vii) Step S307 The extraction information output processing unit 1016 inserts video data (acquired separately) corresponding to the unwritten procedure into the corresponding location of the existing procedure manual (for example, a document file) (for example, inserts link information indicating the storage location of the video), converts the video data corresponding to the unwritten procedure into text by the generation AI, and inserts it into the existing procedure manual.

[0029] In addition, the extraction information output processing unit 1016 outputs information on the three-dimensional coordinates (contact coordinates 2103) of the contact location in the procedure association contact operation specified in step S306 in response to an instruction input from the user (for example, clicking on text corresponding to the work location in the procedure manual).

[0030] <Example of Work Know-how Extraction Processing> FIG. 4 is a diagram for explaining an example of the extraction process of unwritten procedures. In this example, the existing procedure manual describes Procedure 1, Procedure 2, and Procedure 3, and it is shown that an unwritten procedure X located between Procedure 1 and Procedure 2 is extracted.

[0031] In FIG. 4(a), equipment contact data 210 and procedure execution time zone data 220 are acquired from an external file (corresponding to the processing of steps S301 and S302). In FIG. 4(a), four contact operations from Contact 1 to Contact 4 are acquired, and an example is shown where Contact 1 is performed during the execution time zone of Procedure 1, Contact 2 and Contact 3 are performed during the execution time zone of Procedure 2, and Contact 4 is performed during the execution time zone of Procedure 3.

[0032] FIG. 4(b) collates the contact times (contact times 2102) of the contact operations from Contact 1 to Contact 4 with the start time (procedure start time 2202) and end time (procedure end time 2203) of each procedure, and among Contact 1 to Contact 4, the procedure association contact operations for each procedure (Contact 1 for Procedure 1, Contact 3 for Procedure 2, and Contact 4 for Procedure 3) are specified (corresponding to the processing of step S303). In FIG. 4(c), the unwritten procedure contact operation (Contact 2) is extracted (corresponding to the processing of step S304).

[0033] In FIG. 4(d), the execution time period of the unwritten procedure X is specified based on the contact time of the unwritten procedure contact operation (contact 2), the end time of procedure 1, and the start time of procedure 2 (corresponding to the process of step S305).

[0034] <Example of a procedure manual after extracting work know-how> FIG. 5 is a diagram for explaining an example of a procedure manual (updated work procedure manual) after extracting unwritten procedures.

[0035] As described with reference to FIG. 4, when the unwritten procedure X (the procedure associated with contact 2) is extracted in a series of operations 51, the content of the unwritten procedure X is inserted into the procedure manual. As described above, the insertion of the unwritten procedure X can be in the form of inserting a video link or converting the video into text and inserting it. In this case, the contact number 5101, contact time 5102, and contact coordinates 5103 of each contact operation extracted from the work image are respectively associated with the procedure number 5201, the content 5202 indicating the content of the procedure, and the operation location 5203 in the updated work procedure manual. Note that the operation location 5203 indicates the three-dimensional coordinates of each contact location in the three-dimensional image 52 of the facility and is information corresponding to the contact coordinates 5103.

[0036] <Embodiment 2> In Embodiment 1, a method for extracting unwritten procedures was described. Although this method can extract procedures not described in the procedure manual, it is premised on the operator directly contacting the facility. However, in actual work, the operator may contact the facility using a tool. It is considered that more unwritten procedures can be extracted if such indirect contact between the operator and the facility can also be extracted. Therefore, in Embodiment 2 of the present invention, in addition to the method described in Embodiment 1, a method for extracting work procedures based on the operator indirectly contacting the facility using a tool will be described.

[0037] FIG. 6 is a schematic diagram showing an example of contact using a tool. When an operator (Worker: W) works using a tool (Tool: T), first the operator contacts the tool (WT contact). Further, the operator indirectly contacts the equipment (Equipment: E) using the tool (TE contact). The direct contact between the operator and the equipment described in Embodiment 1 will be referred to as WE contact. In Embodiment 2, these three types of contact are detected.

[0038] As a method for detecting contact, although not limited thereto, for example, the same method as when creating the equipment contact data 210 of Embodiment 1 may be used. Alternatively, for the contact between the operator and the tool, for example, it can be detected by whether there is an object moving in the same manner as the hand around the hand of the operator. For the contact between the tool and the equipment, for example, after detecting the contact between the operator and the tool, it can be detected by whether the distance between the tool and the equipment is equal to or less than a threshold value. Any other method may be used.

[0039] FIG. 7 is a time chart for explaining a method of detecting an unrecorded procedure in Embodiment 2. The procedure execution time zone data 220 describes the start time and end time of each procedure, as in Embodiment 1. Here, it is assumed that Procedures 1 to 3 are described in advance. The uppermost row of FIG. 7 shows the start time and end time of each procedure on the time chart. The remaining three rows of FIG. 7 show the times when WE contact, TE contact, and WT contact occur, respectively, on the time chart. Since the operator continuously holds the tool for a certain period of time, the WT contact has a time width respectively.

[0040] In Embodiment 1, it was explained that the last-occurring WE contact within the time zone of each procedure is associated with that procedure. When there are multiple WE contacts within the same procedure, the other WE contacts except for the last WE contact within that procedure are detected as unrecorded procedures. In FIG. 7, WE contact 1 will be associated with a new unrecorded procedure. In Embodiment 2, further, within the time zone of each procedure, the last-occurring WE contact or TE contact will be associated with that procedure.

[0041] Identify the last equipment contact (WE contact or TE contact) within the time period of Procedure 1 in FIG. 7. In FIG. 7, TE contact 1 corresponds to this. TE contact 1 is associated with Procedure 1.

[0042] Similarly, identify the last WE contact or TE contact within the time period of Procedure 3. In FIG. 7, WE contact 3 corresponds to this. WE contact 3 is associated with Procedure 3. In the time period of Procedure 3, there is also TE contact 2. Since Procedure 3 is already associated with WE contact 3, TE contact 2 is considered to have occurred by another procedure (i.e., an un-described procedure). Therefore, TE contact 2 is associated with a new un-described procedure.

[0043] In this way, within the time period of each procedure, identify the last operator (WE contact) or tool (TE contact) that made contact, and associate that contact with the corresponding procedure. By doing so, regardless of whether the operator indirectly or directly contacted the equipment using the tool, the contact can be associated with each procedure in the same way as in Embodiment 1.

[0044] In Embodiment 2, further detect the contact (WT contact) between the operator and the tool. TE contacts that overlap with the time period of the WT contact are considered to have been performed using that tool. Therefore, associate the TE contacts that overlap with the time period of the WT contact with that WT contact. In FIG. 7, WT contact 1 and TE contact 1 are associated, and WT contact 3 and TE contact 2 are associated. This enables identification of the tool used in the procedure with which the TE contact is associated.

[0045] Even when an operator holds a tool, the operator who uses the tool may directly touch the equipment. For example, as in the example shown in the upper part of FIG. 7, this corresponds to a case where the operator holds a light in the left hand and touches the equipment with the right hand. At this time, during the time zone of WT contact, WE contact will occur. In this case, WT contact and WE contact are linked. As a result, in the procedure of directly touching the equipment while using the tool, the necessary tool can be specified. In FIG. 7, this corresponds to the fact that WT contact 2 and WE contact 2 are linked.

[0046] By detecting WT contact, it is also possible to detect a tool not described in the procedure manual. For example, when WT contact 2 is detected, if procedure 2 does not describe using that tool, it means that a tool (undocumented tool) necessary in procedure 2 but not described in the procedure manual of procedure 2 has been newly detected.

[0047] FIG. 8 shows a configuration example of tool-equipment contact data 810 and operator-tool contact data 820 respectively. The tool-equipment contact data 810 is data that describes the time when TE contact occurred, and is composed of a TE contact number 811 and a contact time 812. The operator-tool contact data 820 is data that describes the time when WT contact occurred, and is composed of a WT contact number 821, a start time 822, and an end time 823. These data respectively describe the TE contact and WT contact exemplified in FIG. 7. These data can be stored, for example, in the storage device 103. They may be stored in the storage device 103 in advance, or may be acquired via, for example, the input unit 102 or the communication device 105.

[0048] Although only two pieces of data are shown in FIG. 8, it should be noted that WE contact can be described by data similar to the tool-equipment contact data 810, and the procedure can be described by data similar to the operator-tool contact data 820.

[0049] FIG. 9 is a table illustrating cases assumed for each combination of whether or not WE contact, TE contact, and WT contact occur. As shown in FIG. 9, by detecting each of these three contacts and associating them with procedures, procedures can be detected in various assumed cases.

[0050] It should be noted that the method described in Embodiment 2 can be implemented by the control device 101 in the same manner as in Embodiment 1.

[0051] <Summary of Embodiment 2> The work know-how extraction device 1 according to Embodiment 2 extracts unrecorded procedures performed by an operator directly contacting the equipment by collating the WE contact with the time zone of the work procedure. The work know-how extraction device 1 further extracts unrecorded procedures performed by an operator contacting the equipment using a tool by collating the TE contact with the time zone of the work procedure. Thereby, regardless of whether the operator indirectly contacts the equipment using a tool or directly contacts it, each contact can be associated with a procedure and extracted. Therefore, more information can be obtained as procedure information than in Embodiment 1.

[0052] In Embodiment 2, in order to specify the time when the operator contacts the equipment using a tool, it is only necessary to detect the WT contact and the TE contact respectively. This is because the operator and the tool are associated, and further, the tool and the equipment are associated, so that the operator and the equipment are also associated. However, for example, in a work environment where it is assumed that there is only one operator working in front of the equipment, if the TE contact is detected, it is obvious that the operator is contacting the equipment using the tool at that time. Therefore, it should be noted that at least by detecting the TE contact, it is possible to specify the work associated with this.

[0053] The work know-how extraction device 1 according to Embodiment 2 can utilize the extracted unwritten procedures as follows, for example: (a) presenting to workers, etc. that there are unwritten procedures as an alert; (b) verbalizing the procedures using AI or the like generated from the video of the corresponding time period and adding them to the procedure manual; (c) attaching the video of the corresponding time period to the procedure manual.

[0054] The work know-how extraction device 1 according to Embodiment 2 can utilize the extracted unwritten tools as follows, for example: (a) presenting to workers, etc. that there are unwritten tools as an alert; (b) attaching a photo of the corresponding time to the procedure manual.

[0055] <Others> The functions of this embodiment can also be realized by a software program code. In this case, a storage medium recording the program code is provided to a system or device, and a computer (or CPU or MPU) of the system or device reads out the program code stored in the storage medium. In this case, the program code itself read from the storage medium realizes the functions of the above-described embodiment, and the program code itself and the storage medium storing it constitute the present disclosure. As a storage medium for supplying such a program code, for example, a flexible disk, CD-ROM, DVD-ROM, hard disk, optical disk, magneto-optical disk, CD-R, magnetic tape, non-volatile memory card, ROM, etc. are used.

[0056] Also, based on the instructions of the program code, an OS (operating system) running on a computer, etc. may perform part or all of the actual processing so that the functions of the above-described embodiment are realized by the processing. Further, after the program code read from the storage medium is written into the memory on the computer, based on the instructions of the program code, a CPU of the computer, etc. may perform part or all of the actual processing so that the functions of the above-described embodiment are realized by the processing.

[0057] Furthermore, by distributing the program code of the software that realizes the functions of the embodiment via a network, it can be stored in a storage means such as a hard disk or memory of a system or device, or a storage medium such as a CD-RW or CD-R, and when in use, a computer (or CPU or MPU) of the system or device reads and executes the program code stored in the storage means or the storage medium.

[0058] The processes and techniques described herein are not inherently related to any particular device and can also be implemented by a combination of each component. Also, various types of general-purpose devices can be added. To execute the functions of this embodiment, a dedicated device may be constructed. Also, by appropriately combining a plurality of components disclosed in this embodiment, various functions can be formed. For example, some components may be deleted from all the components shown in the embodiment, or components in different forms may be appropriately combined.

[0059] In this disclosure, specific examples are described, but these are for explanation (understanding of the technology of this disclosure) rather than limitation in all aspects. Those of ordinary skill in the art will understand that there are numerous combinations of hardware, software, and firmware suitable for implementing the technology of this disclosure. For example, the described software can be implemented in a wide range of programs or scripting languages such as assembler, C / C++, perl, Shell, PHP, Java (registered trademark), etc.

[0060] Furthermore, in the above-described embodiment, control lines and information lines are shown as those considered necessary for explanation, and not all control lines and information lines are necessarily shown on the product. All components may be interconnected.

[0061] In addition, those with ordinary knowledge in the technical field can clarify other implementations of the present disclosure from the considerations of this embodiment. The specification and specific examples are merely typical, and the scope and spirit of the technology of the present disclosure are shown in the subsequent claims.

Explanation of Reference Numerals

[0062] 1 Work know-how extraction device 10 Computer system 21 Equipment contact data file input 22 Procedure execution time zone data file input 101 Control device 102 Input unit 103 Storage device 104 Output unit 105 Communication device 1011 Equipment contact data acquisition unit 1012 Procedure execution time zone data acquisition unit 1013 Procedure-linked contact operation extraction unit 1014 Unlisted procedure contact operation extraction unit 1015 Unlisted procedure execution time zone extraction unit 1016 Extracted information output processing unit

Claims

1. A work know-how extraction system that extracts undescribed procedures that are not described in a work procedure manual as know-how from information on a series of work performed on a predetermined facility, A control device that extracts the undescribed procedure, The control device includes: acquiring a contact time and a contact coordinate between the worker and the equipment in an action in which the worker directly contacts the equipment; acquiring a contact time between the first tool and the equipment in an action in which the worker contacts the equipment with the first tool; A step of acquiring a time period during which each procedure is performed, the time period being determined based on the work procedure manual; extracting the undescribed procedure performed by the worker through direct contact with the equipment by comparing a contact time between the worker and the equipment with the implementation time period; extracting the undescribed procedure performed by the worker by contacting the equipment with the first tool by comparing a contact time between the first tool and the equipment with the implementation time period; Execute Operation know-how extraction system.

2. The control device includes: acquiring a contact time between the worker and the first tool; identifying the first tool used by the worker when the worker contacted the equipment with the first tool by correlating a contact time between the worker and the first tool with a contact time between the first tool and the equipment; Execute The operation know-how extraction system according to claim 1.

3. The control device includes: acquiring a contact time between the worker and a second tool; identifying the second tool used by the worker when directly contacting the equipment by correlating a contact time between the worker and the second tool with a contact time between the worker and the equipment; Execute The operation know-how extraction system according to claim 1.

4. The control device includes: In a case where the work procedure manual does not describe the work of contacting the equipment with the first tool, by comparing the contact time between the first tool and the equipment with the implementation time period, extracting the first tool used when the worker contacted the equipment as an undescribed tool not described in the work procedure manual; Execute The operation know-how extraction system according to claim 1.

5. The control device includes: When the work procedure manual does not describe a task using the second tool, extracting the second tool as an undescribed tool not described in the work procedure manual by comparing a contact time between the second tool and the worker with the execution time period; Execute The operation know-how extraction system according to claim 3.

6. In claim 1, the control device compares information on the contact times corresponding to each of the plurality of contact actions with information on a time period during which each of the procedures is performed, and extracts contact actions other than the final contact action of each of the procedures as contact actions corresponding to the undescribed procedure.

7. In claim 6, The control device determines whether or not a contact coordinate in the specified equipment caused by a contact action corresponding to the extracted undescribed procedure is away from a contact coordinate in a previous or subsequent procedure by a predetermined distance or more, and determines the contact action that is away from the predetermined distance or more as the contact action corresponding to the undescribed procedure.

8. In claim 6, The control device determines whether a contact time at the specified equipment by a contact action corresponding to the extracted undescribed procedure is separated by a specified time or more from a contact time by a contact action in an earlier or later procedure, and determines the contact action separated by the specified time or more as the contact action corresponding to the undescribed procedure.

9. In claim 1, The control device further executes a process of adding information about the undescribed procedure to the work procedure manual to generate an updated work procedure manual.

10. In claim 9, The control device adds a moving image representing the undescribed procedure to the work procedure manual to generate the updated work procedure manual.

11. In claim 9, The control device inputs information about video images representing the undescribed procedures into a generation AI to convert the information into text, and adds the converted information about the undescribed procedures to the work procedure manual to generate the updated work procedure manual.This is a work know-how extraction system.

12. In claim 9, The control device further executes a process of extracting three-dimensional coordinates representing contact points on the predetermined equipment, the three-dimensional coordinates corresponding to each of the plurality of contact actions on the predetermined equipment; The control device adds the three-dimensional coordinates to the work procedure manual in the process of generating the updated work procedure manual.

13. A program for causing a computer system to function as an undescribed procedure extraction system that extracts undescribed procedures that are not described in a work procedure manual from information on a series of operations for a specified facility, The program is provided to the computer system, acquiring a contact time and a contact coordinate between the worker and the equipment in an action in which the worker directly contacts the equipment; acquiring a contact time between the first tool and the equipment in an action in which the worker contacts the equipment with the first tool; A step of acquiring a time period during which each procedure is performed, the time period being determined based on the work procedure manual; extracting the undescribed procedure performed by the worker through direct contact with the equipment by comparing a contact time between the worker and the equipment with the implementation time period; extracting the undescribed procedure performed by the worker by contacting the equipment with the first tool by comparing a contact time between the first tool and the equipment with the implementation time period; A program to execute.

Images