Operation know-how extraction system, and program
The work know-how extraction system efficiently and cost-effectively extracts undescribed procedures by comparing worker actions with procedure manuals, addressing the high costs of AI training in social infrastructure facilities.
Patent Information
- Application Number
- JP2024025942
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2024-02-22
- Publication Date
- 2025-09-03
AI Technical Summary
Existing technologies require costly AI training data preparation for recognizing worker behavior in social infrastructure facilities, leading to high financial and human costs due to the need for facility-specific training data.
A work know-how extraction system that extracts undescribed procedures by acquiring contact time and coordinates of worker actions on equipment, comparing with procedure manual times, and inserting extracted information into the manual.
Enables efficient and cost-effective extraction of know-how by comparing worker actions with procedure manuals, reducing training costs and time.
Smart Images

Figure 2025128924000001_ABST
Abstract
Description
[Technical Field]
[0001] The present disclosure relates to an operation know-how extraction system and a program. [Background technology]
[0002] In recent years, the aging of social infrastructure such as water purification facilities and roads, as well as the 2025 problem (when the baby boomer generation becomes elderly and experienced workers retire), have become major issues. In particular, the retirement of experienced workers has made it difficult to pass on know-how from experienced workers in the operation and maintenance of various facilities, raising the issue of how to pass on this know-how to younger workers. Here, the know-how of experienced workers generally refers to procedures (unwritten procedures) that are not written in work procedures (work manuals), and is knowledge (procedures) that experienced workers have acquired through many years of experience.
[0003] In this regard, for example, Patent Document 1 discloses that the action that a person will take on an object is estimated based on skeletal information of the person detected from an image captured by an imaging device, and area information related to the person's imaging position, the target area, and the position of the object, and the person's behavior is recognized based on the distance between the person and the object and the estimated action. [Prior art documents] [Patent documents]
[0004] [Patent Document 1] Japanese Patent Publication No. 2022-189456 Summary of the Invention [Problem to be solved by the invention]
[0005] However, according to the technology disclosed in Patent Document 1, in order to recognize human behavior, it is necessary to create AI (Artificial Intelligence) to recognize the movements of workers and the operating locations of equipment. Therefore, preparing the training data to create such AI and performing the AI training process is extremely costly (financial and human). In particular, because the above-mentioned social infrastructure facilities are not generalized facilities, training data must be prepared every time they are maintained or inspected, which results in additional costs compared to general facilities. In view of such circumstances, the present disclosure proposes a technology for extracting work know-how inexpensively and efficiently (in a short time). [Means for solving the problem]
[0006] In order to solve the above problems, the present disclosure provides a work know-how extraction system that extracts undescribed procedures that are not described in a work procedure manual as know-how from information about a series of tasks performed on specified equipment, the work know-how extraction system including: a storage device that stores a program for executing a process of extracting the undescribed procedures; and a control device that reads and executes the program from the storage device, wherein the control device executes a process of acquiring, externally input, information about the contact time and contact coordinates of a worker's contact action on the specified equipment; a process of acquiring, externally input, information about the time period during which each procedure described in the work procedure manual is performed; and a process of extracting the undescribed procedures by comparing the acquired contact time information with the time period during which each procedure is performed.
[0007] Further features related to the present disclosure will become apparent from the description and accompanying drawings of this specification, and aspects of the present disclosure may be realized and realized by the elements and combinations of various elements and aspects set forth in the following detailed description and the appended claims. It should be understood that the descriptions in this specification are exemplary and illustrative only and are not intended to limit the scope or application of the claims in any way. [Effects of the Invention]
[0008] According to the technology of the present disclosure, it becomes possible to extract work know-how inexpensively and efficiently (in a short time). [Brief explanation of the drawings]
[0009] [Figure 1] 1 is a diagram illustrating a schematic configuration example of an operation know-how extraction device 1 according to an embodiment of the present disclosure. [Figure 2] 1 is a diagram (table) showing an example of the configuration of various input data used in this embodiment. [Figure 3] 1 is a flowchart for explaining an operation know-how extraction process executed by the operation know-how extraction device 1 according to the present embodiment. [Figure 4] FIG. 10 is a diagram illustrating an example of an extraction process of an undescribed procedure. [Figure 5] FIG. 10 is a diagram for explaining an example of a procedure manual (updated work procedure manual) after undescribed procedures have been extracted. DETAILED DESCRIPTION OF THE INVENTION
[0010] Hereinafter, the present embodiment will be described with reference to the accompanying drawings. In the accompanying drawings, functionally identical elements may be denoted by the same numerals, and redundant explanations will be omitted. Note that the accompanying drawings show specific embodiments and examples in accordance with the principles of the present disclosure, but these are intended to aid in understanding the present disclosure and are by no means to be used to interpret the present disclosure in a limiting manner.
[0011] Although the present embodiment has been described in sufficient detail to enable those skilled in the art to implement the present disclosure, it should be understood that other implementations and forms are possible, and that changes in configuration and structure and substitutions of various elements are possible without departing from the scope and spirit of the technical ideas of the present disclosure. Therefore, the following description should not be interpreted as being limited thereto.
[0012] <Configuration example of work know-how extraction device> FIG. 1 is a diagram illustrating an example of a schematic configuration of an operation know-how extraction device 1 according to an embodiment of the present disclosure.
[0013] The operation know-how extraction device 1 includes a computer system 10 .
[0014] The computer system 10 comprises a control device 101 consisting of a processor (such as a CPU or MPU), an input unit 102 such as a keyboard, touch panel, or USB port, a storage device 103 that stores a work know-how extraction program, various data, parameters, etc., an output unit 104 such as a display or printer, and a communication device 105 that communicates with external devices via a network.
[0015] The control device 101 reads the work know-how extraction program from the storage device 103, expands it into an internal memory (not shown), and configures an equipment contact data acquisition unit 1011, a procedure execution time zone data acquisition unit 1012, a procedure linking contact action extraction unit 1013, an undescribed procedure contact action extraction unit 1014, an undescribed procedure execution time zone extraction unit 1015, and an extracted information output processing unit 1016. Details of each process will be explained later.
[0016] <Various input data> 2 is a diagram (table) showing an example of the configuration of various input data used in this embodiment. The various input data include, for example, equipment contact data 210 including the time when a worker contacted equipment (work target) and the contact coordinates of the contact point, procedure execution time period data 220 indicating the start and end times of each procedure described in the procedure manual, and procedure content data 230 indicating the content of each procedure described in the procedure manual and the operation locations.
[0017] The equipment contact data 210 includes, as constituent items, a contact number (contact ID) 2101 that uniquely identifies contact with the equipment, a contact time 2102, and contact coordinates 2103 of the contact location. The equipment contact data 210 can generally be created by various methods, for example, the method disclosed in International Publication No. 2010 / 027015. However, the method for creating the equipment contact data 210 is not limited to the method disclosed in the publication.
[0018] The procedure execution time period data 220 includes, as constituent items, a procedure number (procedure ID) 2201 that uniquely identifies the procedure in the procedure manual, a procedure start time 2202 that indicates the time when the corresponding procedure started, and a procedure end time 2203 that indicates the time when the corresponding procedure ended. The procedure execution time period data 220 can generally be created using a variety of methods, but for example, it can be created using a mobile terminal such as a smart device. Specifically, the worker can obtain the procedure start time and procedure end time by starting a specific application on the mobile terminal and pressing the start button and end button for each procedure displayed on the GUI. (Input can also be made by voice or gesture instead of using buttons.) However, the method for creating the procedure execution time period data 220 is not limited to this method.
[0019] The procedure content data 230 is data extracted from the procedure manual, and includes as its constituent items a procedure number (procedure ID) 2301 that uniquely identifies the procedure in the procedure manual, content 2302 that describes the content of the corresponding procedure in the form of "what action (e.g., pulling)" of "a contact object (e.g., a lever)," and an operation location 2303 that indicates the location to operate in the corresponding procedure.
[0020] <Contents of work know-how extraction process> 3 is a flowchart for explaining the operation know-how extraction processing executed by the operation know-how extraction device 1 according to this embodiment. The processing of each step is performed by each processing unit (equipment contact data acquisition unit 1011, procedure execution time zone data acquisition unit 1012, procedure linking contact action extraction unit 1013, undescribed procedure contact action extraction unit 1014, undescribed procedure execution time zone extraction unit 1015, and extracted information output processing unit 1016) configured in the control device 101, but since the operation know-how extraction processing is configured by the control device (processor) 101 reading an operation know-how extraction program stored in the storage device 103, the control device (processor) 101 may also be the operating unit of each step.
[0021] (i) Step S301 The equipment contact data acquisition unit 1011 acquires the equipment contact data 210 from an external file via the input unit 102 .
[0022] (ii) Step S302 The procedure execution time period data acquisition unit 1012 acquires the procedure execution time period data 220 from an external file via the input unit 102 .
[0023] (iii) Step S303 The procedure-linked contact action extraction unit 1013 compares the contact time 2102 of the contact action acquired in step S301 with the procedure start time 2202 and procedure end time 2203 of each procedure described in the procedure manual acquired in step S302, and extracts the contact action caused by the operation of each procedure (procedure-linked contact action). Specifically, the last contact action performed during the procedure execution time period of each procedure is extracted as the procedure-linked contact action of that procedure.
[0024] (iv) Step S304 The undescribed procedure contact action extraction unit 1014 extracts contact actions that are not described in the procedure manual (undescribed procedure contact actions) from the contact actions (equipment contact data 210) acquired in step S301 other than the procedure-linked contact actions extracted in step S303 (unlinked procedure contact actions). However, only undescribed procedure contact actions that meet the following conditions are extracted.
[0025] (Condition 1) All procedures are unlinked contact actions: This is a reasonable condition assuming careful work in which the equipment is not touched outside of the procedures. (Condition 2) The contact position is at a certain distance from the operation (contact) point of the previous or next procedure: For example, this is a condition for excluding contact actions such as removing dust from the operation point of the previous or next procedure. (Condition 3) The contact time must be separated from the contact times of the previous and next steps by a certain amount of time or more. For example, if there are continuous contacts in units of one second, this is a condition for excluding the contact action, recognizing it as a simple operator error. (Condition 4) Combination of conditions 2 and 3 (OR condition)
[0026] (v) Step S305 The undescribed procedure execution time period extraction unit 1015 refers to the equipment contact data 210 and the procedure execution time period data 220, and extracts the execution time period corresponding to each of the undescribed procedure contact actions extracted in step S304 (the time period from the end time of the procedure immediately preceding the undescribed procedure contact action to the contact time of the undescribed procedure contact action).
[0027] (vi) Step S306 The extracted information output processing unit 1016 refers to the equipment contact data 210 and identifies the three-dimensional coordinates of the contact points corresponding to each of the procedure-linked contact actions extracted in step S303.
[0028] (vii) Step S307 The extracted information output processing unit 1016 inserts video data (obtained separately) corresponding to the undescribed procedure into the relevant location of an existing procedure manual (e.g., a document file) (e.g., inserts link information indicating where the video is stored), or converts the video data corresponding to the undescribed procedure into text using a generation AI and inserts it into the existing procedure manual.
[0029] In addition, in response to an instruction input by the user (for example, clicking on text corresponding to a work location in the procedure manual), the extracted information output processing unit 1016 outputs information on the three-dimensional coordinates (contact coordinates 2103) of the contact location in the procedure-linking contact action identified in step S306.
[0030] <Example of work know-how extraction processing> 4 is a diagram illustrating an example of the process of extracting an undescribed procedure. In this example, an existing procedure manual describes steps 1, 2, and 3, and an undescribed procedure X located between steps 1 and 2 is extracted.
[0031] 4(a), equipment contact data 210 and procedure implementation time period data 220 are acquired from an external file (corresponding to the processes in steps S301 and S302). In FIG. 4(a), four contact actions from Contact 1 to Contact 4 are acquired, and an example is shown in which Contact 1 was performed during the implementation time period of Procedure 1, Contact 2 and Contact 3 were performed during the implementation time period of Procedure 2, and Contact 4 was performed during the implementation time period of Procedure 3.
[0032] In FIG. 4(b), the times of the contact actions from Contact 1 to Contact 4 (contact time 2102) are compared with the start time (procedure start time 2202) and end time (procedure end time 2203) of each procedure, and the procedure-linked contact actions of each procedure (contact 1 for procedure 1, contact 3 for procedure 2, and contact 4 for procedure 3) are identified from Contact 1 to Contact 4 (corresponding to the processing in step S303). In FIG. 4(c), an undescribed procedure contact action (contact 2) is extracted (corresponding to the process in step S304).
[0033] In FIG. 4(d), the time period during which unlisted procedure X is performed is identified from the contact time of the unlisted procedure contact action (contact 2), the end time of procedure 1, and the start time of procedure 2 (corresponding to the process of step S305).
[0034] <Example of a procedure manual after work know-how has been extracted> FIG. 5 is a diagram for explaining an example of a procedure manual (updated work procedure manual) after undescribed procedures have been extracted.
[0035] As explained in FIG. 4, when undescribed procedure X (a procedure linked to contact 2) is extracted from a series of tasks 51, the content of undescribed procedure X is inserted into the procedure manual. As explained above, undescribed procedure X can be inserted by inserting a video link or by converting a video into text and inserting it. In this case, the contact number 5101, contact time 5102, and contact coordinates 5103 of each contact action extracted from the work image are associated with the procedure number 5201, content 5202 indicating the procedure content, and operation location 5203 in the updated work procedure manual. Note that operation location 5203 indicates the three-dimensional coordinates of each contact location in the three-dimensional image 52 of the equipment, and is information equivalent to contact coordinates 5103.
[0036] <Other> The functions of the present embodiment can also be realized by software program code. In this case, a storage medium on which the program code is recorded is provided to a system or device, and the computer (or CPU or MPU) of the system or device reads the program code stored in the storage medium. In this case, the program code itself read from the storage medium realizes the functions of the above-described embodiment, and the program code itself and the storage medium on which it is stored constitute the present disclosure. Examples of storage media for providing such program code include flexible disks, CD-ROMs, DVD-ROMs, hard disks, optical disks, magneto-optical disks, CD-Rs, magnetic tapes, non-volatile memory cards, and ROMs.
[0037] In addition, an operating system (OS) running on a computer may perform some or all of the actual processing based on instructions in the program code, and the functions of the above-described embodiments may be realized by this processing. Furthermore, after the program code is read from a storage medium and written to a memory on a computer, a CPU of the computer may perform some or all of the actual processing based on instructions in the program code, and the functions of the above-described embodiments may be realized by this processing.
[0038] Furthermore, the program code of the software that realizes the functions of the embodiments may be distributed via a network and stored in a storage means such as a hard disk or memory of the system or device, or in a storage medium such as a CD-RW or CD-R, so that when in use, the computer (or CPU or MPU) of the system or device reads and executes the program code stored in the storage means or storage medium.
[0039] The processes and techniques described herein are not inherently related to any specific device and can be implemented by a combination of components. Various types of general-purpose devices can also be added. A dedicated device may be constructed to perform the functions of the present embodiment. Various functions can also be formed by appropriately combining multiple components disclosed in the present embodiment. For example, some components may be omitted from all the components shown in the embodiments, or components of different types may be appropriately combined.
[0040] Although specific examples are described in this disclosure, they are intended in all respects to be illustrative and not limiting (for understanding the technology of the present disclosure). Those skilled in the art will recognize that there are numerous combinations of hardware, software, and firmware suitable for implementing the technology of the present disclosure. For example, the software described can be implemented in a wide variety of programming or scripting languages, such as assembler, C / C++, Perl, Shell, PHP, Java (registered trademark), etc.
[0041] Furthermore, in the above-described embodiment, the control lines and information lines are those that are considered necessary for the explanation, and not all control lines and information lines in the product are necessarily shown. All components may be interconnected.
[0042] In addition, other implementations of the present disclosure will be apparent to those skilled in the art from consideration of the present embodiments. The specification and examples are exemplary only, with the scope and spirit of the technology of the present disclosure being indicated by the following claims. [Explanation of symbols]
[0043] 1. Work know-how extraction device 10. Computer Systems 21 Equipment contact data file input 22 Procedure implementation time period data file input 101 Control device 102 Input section 103 Storage Devices 104 Output section 105 Communication Devices 1011 Equipment Contact Data Acquisition Unit 1012 Procedure execution time period data acquisition unit 1013 Procedure linking contact action extraction unit 1014 Unspecified procedure contact action extraction unit 1015 Unspecified procedure execution time period extraction part 1016 Extracted information output processing unit
Claims
1. A work know-how extraction system that extracts undescribed procedures that are not described in a work procedure manual as know-how from information on a series of work performed on a predetermined facility, a storage device that stores a program for executing the process of extracting the undescribed procedure; a control device that reads the program from the storage device and executes it; The control device A process of acquiring information on the contact time and the contact coordinates of the contact action of the worker with the predetermined equipment, which information is input from outside; A process of acquiring information on the time period during which each procedure described in the work procedure manual is performed, which information is input from an external device; A process of extracting the undescribed procedure by comparing the acquired information on the contact time with the acquired time period during which each procedure was performed; This is a work know-how extraction system.
2. In claim 1, the control device compares information on the contact times corresponding to each of the plurality of contact actions with information on the time periods during which each of the procedures is performed, and extracts contact actions other than the final contact action of each of the procedures as contact actions corresponding to the undescribed procedure.
3. In claim 2, The control device determines whether or not the contact coordinates of the specified equipment caused by the contact action corresponding to the extracted undescribed procedure are apart by a predetermined distance or more from the contact coordinates of the contact actions in the previous and subsequent procedures, and determines the contact action that is apart by the predetermined distance or more as the contact action corresponding to the undescribed procedure.
4. In claim 2, The control device determines whether the contact time at the specified equipment caused by the contact action corresponding to the extracted undescribed procedure is separated by a predetermined time or more from the contact time of the contact action in the previous or next procedure, and determines the contact action separated by the predetermined time or more as the contact action corresponding to the undescribed procedure.
5. In claim 1, The control device further executes a process of adding information about the undescribed procedure to the work procedure manual and generating an updated work procedure manual.
6. In claim 5, The control device generates the updated work procedure manual by adding a moving image representing the undescribed procedure to the work procedure manual.
7. In claim 5, The control device inputs information about moving images representing the undescribed procedures into a generation AI to convert them into text, and adds the converted information about the undescribed procedures to the work procedure manual to generate the updated work procedure manual. This is a work know-how extraction system.
8. In claim 5, The control device further executes a process of extracting three-dimensional coordinates representing contact points on the predetermined equipment, each of the plurality of contact actions on the predetermined equipment; The control device adds the three-dimensional coordinates to the work procedure manual in the process of generating the updated work procedure manual.
9. A program for causing a computer system to function as an undescribed procedure extraction system that extracts undescribed procedures that are not described in a work procedure manual from information on a series of operations for a predetermined facility, The program is configured to: A process of acquiring information on the contact time and the contact coordinates of the contact action of the worker with the predetermined equipment, which information is input from outside; A process of acquiring information on the time period during which each procedure described in the work procedure manual is performed, which information is input from an external device; A process of extracting the undescribed procedure from the information on the series of work by comparing the acquired information on the contact time with the acquired time period during which each procedure is performed; A program that executes.
Citation Information
Patent Citations
Action recognition program, action recognition method, and information processing apparatus
JP2022189456A