Procedure manual generation system, terminal, and procedure manual generation method

The procedure manual generation system enhances the efficiency and accuracy of manual creation by evaluating and displaying procedural information, addressing the inefficiencies of existing systems.

JP2026013689APending Publication Date: 2026-01-29PANASONIC INTELLECTUAL PROPERTY MANAGEMENT CO LTD
View PDF 1 Cites 0 Cited by

Patent Information

Application Number
JP2024114211
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Filing Date
2024-07-17
Publication Date
2026-01-29

AI Technical Summary

Technical Problem

Existing procedure manual creation support devices do not evaluate procedural information efficiently, leading to inefficiencies and inaccuracies in generating procedure manuals.

Method used

A procedure manual generation system that includes a procedure manual draft generation unit, a derivation unit for reliability and compatibility information, and a display control unit to enhance the evaluation and display of procedural information.

Benefits of technology

Improves the efficiency and accuracy of generating procedure manuals by providing reliability and compatibility information for the procedures.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 2026013689000001_ABST
    Figure 2026013689000001_ABST
Patent Text Reader

Abstract

To provide a procedure manual generation system capable of improving generation efficiency and generation accuracy of a procedure manual.SOLUTION: A procedure manual generation system that generates a procedure manual related to a plurality of procedures constituting work includes a procedure manual draft generation unit that generates a procedure manual draft including a procedure of the work, a derivation unit that derives at least one of reliability information related to reliability indicating certainty of information based on which the procedure included in the procedure manual draft is generated and suitability information related to suitability indicating a degree to which the procedure included in the procedure manual draft is suitable as the procedure of the work, and a display control unit that adds at least one of the reliability information and the suitability information to the procedure manual draft and causes a display device to display the procedure manual draft.SELECTED DRAWING: Figure 2
Need to check novelty before this filing date? Find Prior Art

Description

[Technical Field]

[0001] The present disclosure relates to a procedure manual generation system and a procedure manual generation method for generating a procedure manual including work procedures. [Background technology]

[0002] In recent years, a procedure manual creation support device that supports the creation of a procedure manual that shows work procedures has become known (see Patent Document 1). This procedure manual creation support device comprises procedure information data that manages multiple procedures as structured procedure information, an input means for inputting predetermined information from a user, a search means for searching for procedure information from the procedure information data based on the predetermined information input by the user, a structure analysis means for analyzing the structure of the procedure information data and generating dependency information data necessary to clarify the dependency relationships of the procedure information, a dependency structure construction means for constructing a dependency structure of the procedure information searched by the search means by referring to the dependency information data, and a procedure manual generation means for generating a procedure manual that sequentially shows multiple procedures desired by the user and a series of procedures required to achieve them from the constructed dependency structure. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Laid-Open No. 2002-334146 Summary of the Invention [Problem to be solved by the invention]

[0004] The procedure manual creation support device of Patent Document 1 does not evaluate the procedural information reflected in the procedure manual, which makes it difficult to complete the procedure manual efficiently and accurately, and there is room for improvement.

[0005] The present disclosure provides a procedure manual generation system, a terminal, and a procedure manual generation method that can improve the efficiency and accuracy of generating a procedure manual. [Means for solving the problem]

[0006] One aspect of the present disclosure is a procedure manual generation system that generates a procedure manual for multiple procedures that make up a task, the procedure manual generation system comprising: a procedure manual draft generation unit that generates a procedure manual draft that includes the procedures of the task; a derivation unit that derives at least one of reliability information regarding the reliability that indicates the likelihood of the information that was the basis for generating the procedures included in the procedure manual draft, and compatibility information regarding the compatibility that indicates the degree to which the procedures included in the procedure manual draft are suitable as procedures for the task; and a display control unit that adds at least one of the reliability information and the compatibility information to the procedure manual draft and displays it on a display device.

[0007] One aspect of the present disclosure is a terminal including a processor and a display device, wherein the processor acquires a draft instruction manual including procedures for the work, the draft instruction manual being generated based on information about content including multiple pieces of data arranged in chronological order, and acquires at least one of reliability information regarding the reliability indicating the likelihood of the information that was the basis for generating the procedures included in the draft instruction manual, and compatibility information regarding the compatibility indicating the degree to which the procedures are suitable for the work, and the display device displays the draft instruction manual with at least one of the reliability information and the compatibility information added.

[0008] One aspect of the present disclosure is a method for generating a procedure manual for multiple procedures that make up a task, the method comprising: generating a draft procedure manual that includes the procedures of the task; deriving at least one of reliability information regarding the reliability that indicates the likelihood of the information included in the draft procedure manual that was the basis for generating the procedures; and compatibility information regarding the compatibility that indicates the degree to which the procedures included in the draft procedure manual are suitable as procedures for the task; and adding at least one of the reliability information and the compatibility information to the draft procedure manual and displaying the draft procedure manual on a display device. [Effects of the Invention]

[0009] According to the present disclosure, the efficiency and accuracy of generating a procedure manual can be improved. [Brief explanation of the drawings]

[0010] [Figure 1] FIG. 1 is a diagram illustrating an example of the configuration of a procedure manual generation system according to a first embodiment. [Figure 2] Block diagram showing an example of the functional configuration of a procedure manual generation system [Figure 3] A diagram showing an example of a procedure manual [Figure 4] 1 is a flowchart showing a first processing example of a procedure manual generation system. [Figure 5A] An example of creating a BPMN flow diagram based on input information (part 1) [Figure 5B] Example of creating a BPMN flow diagram based on input information (part 2) [Figure 5C] A diagram showing an example of a procedure manual [Figure 5D] A diagram showing an example of procedure completion [Figure 6] FIG. 10 is a diagram showing an example of the configuration of a part of a procedure manual generation system for explaining a second processing example. [Figure 7] FIG. 10 is a diagram showing an example of procedure completion in the second processing example. [Figure 8] FIG. 10 is a diagram showing an example of the configuration of a part of a procedure manual generation system for explaining a third processing example. [Figure 9] FIG. 10 is a diagram showing an example of procedure completion in the third processing example. [Figure 10] FIG. 10 is a diagram showing an example of the configuration of a part of a procedure manual generation system for explaining a fourth processing example. [Figure 11] FIG. 13 is a diagram showing an example of procedure complementation in the fourth processing example. [Figure 12] FIG. 13 is a diagram showing an example of the configuration of a part of a procedure manual generation system for explaining a fifth processing example. [Figure 13] FIG. 13 is a diagram showing an example of procedure completion in the fifth processing example. [Figure 14] FIG. 13 is a diagram showing an example of the configuration of a part of a procedure manual generation system for explaining a sixth processing example. [Figure 15] FIG. 13 is a diagram showing an example of procedure completion in the sixth processing example. DETAILED DESCRIPTION OF THE INVENTION

[0011] Hereinafter, embodiments will be described in detail with reference to the drawings as appropriate. However, more detailed description than necessary may be omitted. For example, detailed description of well-known matters or redundant description of substantially identical configurations may be omitted. This is to avoid unnecessary redundancy in the following description and to facilitate understanding by those skilled in the art. Note that the accompanying drawings and the following description are provided to enable those skilled in the art to fully understand the present disclosure, and are not intended to limit the subject matter described in the claims.

[0012] (First embodiment) <Configuration of procedure manual generation system> Fig. 1 is a diagram showing an example of the configuration of a procedure manual generation system. The procedure manual generation system 5 shown in Fig. 1 includes a server device 10 and a terminal 20. The procedure manual generation system 5 generates a procedure manual relating to the procedures of multiple tasks. The server device 10 performs various processes related to the generation of a procedure manual including the procedures of multiple tasks. The terminal 20 acquires information necessary for the various processes related to the generation of the procedure manual and displays information obtained by the various processes related to the generation of the procedure manual.

[0013] The server device 10 may be configured as an on-premise server device or as a cloud server device on a network. The server device 10 may be configured as a single computer or may be configured as a distributed server device including multiple computers.

[0014] The server device 10 includes a processor 11, a memory 12, and a communication device 13.

[0015] The processor 11 may be configured using, for example, a central processing unit (CPU), a digital signal processor (DSP), or a graphical processing unit (GPU). The processor 11 may also be configured using various integrated circuits (for example, a large scale integration (LSI) or a field programmable gate array (FPGA)). The processor 11 realizes various functions by executing programs stored in the memory 12. The processor 11 comprehensively controls each part of the server device 10 and performs various processes.

[0016] The memory 12 includes a primary storage device (e.g., Random Access Memory (RAM) or Read Only Memory (ROM)). The memory 12 may include a secondary storage device (e.g., a Hard Disk Drive (HDD) or a Solid State Drive (SSD)) or a tertiary storage device (e.g., an optical disk or an SD card). The memory 12 may also be an external storage medium, and may be detachable from the server device 10. The memory 12 stores various data, information, programs, etc.

[0017] The memory 12 stores, for example, information on source display rules, ratio setting criteria information, history information, and the like, which will be described later.

[0018] The communication device 13 communicates various data or information according to a wired or wireless communication method. The communication method used by the communication device 13 may include, for example, a local area network (LAN), a wide area network (WAN), a mobile phone network, or a power line communication method.

[0019] The communication device 13 communicates various data and information with the terminal 20, for example.

[0020] <Device configuration> Next, the terminal 20 will be described.

[0021] The terminal 20 is a PC (Personal Computer), a smartphone, a tablet terminal, a mobile terminal, etc. The terminal 20 includes a processor 21, a memory 22, a communication device 23, an input device 24, a display device 25, etc. The terminal 20 may communicate various data and information with the server device 10, may receive notifications and instructions of various information, perform operations in accordance with the notifications and instructions, and may issue various instructions in accordance with inputs made by operating the terminal 20, etc.

[0022] The processor 21 may be configured using, for example, a CPU, a DSP, or a GPU. The processor 21 may also be configured using various integrated circuits (for example, an LSI or an FPGA). The processor 21 realizes various functions by executing programs stored in the memory 22. The processor 21 comprehensively controls each section of the terminal 20 and performs various processes.

[0023] The memory 22 includes a primary storage device (e.g., RAM or ROM). The memory 22 may include a secondary storage device (e.g., HDD or SSD) or a tertiary storage device (e.g., optical disk or SD card). The memory 22 may also be an external storage medium, and may be detachable from the terminal 20. The memory 22 stores various data, information, programs, etc.

[0024] The communication device 23 communicates various data or information according to a wired or wireless communication method. The communication method used by the communication device 23 may include, for example, a LAN, a WAN, a mobile phone network, or a power line communication method.

[0025] The input device 24 may include various buttons, keys, a mouse, a keyboard, a touch panel, a microphone, or other input devices. The input device 24 accepts input of various data or information. The input device 24 may be operated by a user. The user may be, for example, a manager who generates a procedure manual or a worker on-site (for example, a factory).

[0026] The input device 24 receives operations for making selections and arbitrary inputs related to the generation of a procedure manual, for example.

[0027] The display device 25 is, for example, a liquid crystal display or an organic EL display. The display device 25 displays various data or information. The display on the display device 25 may be confirmed by, for example, a manager or an operator.

[0028] The display device 25 displays, for example, information relating to the generation of a procedure manual, such as information for generating a procedure manual and the generated procedure manual.

[0029] <Functional configuration of the procedure manual generation system> Next, the functional configuration of the procedure manual generation system 5 will be described.

[0030] 2 is a block diagram showing an example of a functional configuration of the procedure manual generation system 5. Each function of the procedure manual generation system 5 is realized, for example, by the hardware of the procedure manual generation system 5 shown in FIG.

[0031] The procedure manual generation system 5 includes, as functional components, an information input unit 110, an AI agent unit 120, a procedure manual processing unit 130, and an output unit 140. Here, AI is an abbreviation for Artificial Intelligence.

[0032] The functions of the information input unit 110, the AI ​​agent unit 120, the procedure manual processing unit 130, and the output unit 140 are, for example, functions implemented by the processor 11 of the server device 10, but at least a part of each function may be functions implemented by the processor 21 of the terminal 20. Note that input (e.g., input by operation) by a user (e.g., a manager or worker) is performed via the input device 24 of the terminal 20. Information is displayed to the user via the display device 25 of the terminal 20.

[0033] When information processed by server device 10 is displayed by terminal 20, the information may be sent via communication device 13 and communication device 23. When information input by terminal 20 is processed by server device 10, the information may be sent via communication device 13 and communication device 23. Furthermore, information and data may be sent from server device 10 to terminal 20 at various times as needed, and conversely, information and data may be sent from terminal 20 to server device 10.

[0034] The information input unit 110 inputs various types of information. For example, the information input unit 110 inputs content information including images (video (video), still images), text data, and other data. The content information to be input includes at least a portion of information on various work procedures shown in chronological order. For example, the video may be images captured of a series of work in a warehouse (e.g., picking work, kitting work). For example, the video may show the entrance to the warehouse, shelves, etc., and each image (image frame) included in the video shows each step in a continuous line. For example, the still image may be an image captured at a predetermined timing in a series of work in a warehouse. For example, the text data may be data including keywords related to various work procedures shown in chronological order, for example, keywords listed in flow order (e.g., words related to picking work, kitting work).

[0035] The AI ​​agent unit 120 acquires information (input information) input by the information input unit 110 and generates a draft procedure manual including multiple procedures and procedure selection options for a task, arranged in chronological order, based on the input information. For example, the AI ​​agent unit 120 creates a draft procedure manual based on chronological information included in the content of the input information. The AI ​​agent unit 120 may generate a draft procedure manual at multiple times, and may repeatedly generate a draft procedure manual. Note that the generated draft procedure manual does not necessarily include the procedures for the entire task. For example, it may be a draft procedure manual for only a portion of a task, such as the first or second half of a series of tasks. Furthermore, since the draft procedure manual is displayed in a user-recognizable manner by the procedure manual processing unit 130 (described later), it does not necessarily have to be configured as human-readable text data as long as it is in a format that can be output by the procedure manual processing unit 130. For example, it may be data in which information on procedures and procedure selection options is recorded in a graph format.

[0036] The AI ​​agent unit 120 includes a procedure agent 121, a web agent 122, a reliability extraction unit 123, a compatibility extraction unit 124, and a display control unit 125. Each of these components in the AI ​​agent unit 120 has a learning model (trained model). The learning model is, for example, a learning model using natural language (e.g., a large-scale language model (LLM)) or a multimodal AI learning model. LLM is an abbreviation for Large Language Model. The learning model is stored, for example, in memory 22.

[0037] The procedure agent 121 acquires content information as input information and generates a draft procedure manual related to the content based on the acquired content information. For example, the procedure agent 121 generates auxiliary information for each procedure using a multimodal AI (trained model) based on fusion information combining information such as images, videos, and text data. The multimodal AI is a trained model that has learned the correlation between information such as images, videos, and text data and the auxiliary information, and generates and outputs auxiliary information corresponding to the input image, video, text data, etc. As the multimodal AI, for example, a model known as a VLM (Vision Language Model) can be used. The auxiliary information is information indicating the relationship between the order and branching of elements that make up a task, such as information on a BPMN flow diagram (described later). BPMN stands for Business Process Model and Notation. The procedure agent 121 inputs (acquires) information on hint words (e.g., picking work, kitting work) entered by the user via the input device 24. The hint words are text data indicating the type of task for which the procedure manual to be created is intended. The hint word may be acquired, for example, at the timing when the input information is acquired.

[0038] The procedure agent 121 then sends the auxiliary information and hint word information as prompts to the LLM (Learning Model). Based on the prompts, the LLM generates one or more procedures and information about the procedure's suitability (suitability information). The LLM generates a draft procedure manual in which text data indicating the procedures corresponding to the hint words is written according to the relationships indicated by the auxiliary information. For example, in the case of a picking operation, the LLM infers steps such as "grab" and "place" as steps that make up the "picking operation" indicated by the hint word, and creates text data explaining these steps in a flow corresponding to the auxiliary information. The procedure agent 121 also acquires each procedure generated by the LLM and its suitability (score) information. The suitability information indicates the degree to which each generated procedure is suitable as a procedure for the operation for which a procedure manual is being created. The suitability information may be, for example, a suitability score that indicates the level of suitability numerically. The procedure agent 121 ranks the generated procedures based on the suitability information provided by the LLM. The compatibility information may be acquired for each draft procedure manual, for each procedure included in the draft procedure manual, or for each selection candidate in the procedure. Note that the compatibility information acquired by the procedure agent 121 may not be confirmed compatibility information but may be provisional compatibility information.

[0039] The relevance score is derived based on a value indicating the degree of confidence that the LLM has in the inference results of the proposed procedure or the procedure included in the proposed procedure. This value is determined, for example, by how close the features of each procedure are to the features of the prompt in the feature space used by the LLM. For example, the relevance score of a procedure is derived using an evaluation index of the text matching between the text included in the prompt and the text included in the proposed procedure or the procedure.

[0040] The web agent 122 extracts information from websites that contain hint words as input information, and generates a draft procedure manual based on the extracted information. For example, the web agent 122 acquires information about hint words (e.g., picking work, kitting work, etc.) presented by the user via the input device 24. The web agent 122 searches for websites that contain procedures corresponding to the acquired hint words via a communication device, and collects text data (documents) related to the procedures from the searched websites. The documents collected here are, for example, work procedure manuals and equipment operation manuals published on websites. The web agent 122 may also collect website information via the information input unit 110.

[0041] The web agent 122 acquires reliability information indicating whether the collected text data is reliable. In this embodiment, the reliability information reflects the degree of reliability of the website from which the text data was collected. Therefore, for example, the web agent 122 may acquire reliability information of the website from which the text data was collected via the communication device 23 from an external device that accumulates information on the reliability of each website. The web agent 122 may acquire (e.g., calculate) reliability information of the procedure corresponding to the text data acquired from the website based on the reliability information of the website, for example, using one of the trained models. The reliability information may be, for example, a reliability score that indicates the level of reliability numerically. The reliability information may be acquired for each draft procedure manual, for each procedure included in the draft procedure manual, or for each selection candidate in the procedure. Note that the reliability information acquired by the web agent 122 may not be confirmed reliability information but may be provisional reliability information.

[0042] Credibility (Source) indicates the accuracy, veracity, and reliability of the source of information. Specifically, it means evaluating whether the text data extracted from a website is based on facts and does not contain false information or misinformation. For example, two weights may be set: whether it is a government or official website and the number of clicks on the website. The reliability (trust score) of a website may be derived (e.g., calculated) by combining the two weights.

[0043] The web agent 122 then sends the collected documents and hint words as prompts to the LLM (Learning Model). Based on the prompts, the LLM searches the documents for text data that is closely related to the hint words, and generates steps and their relevance scores based on the search results. At this time, if the documents contain information indicating relationships between steps, such as the order or branching, the LLM may use that information to set the order or branching of the steps. Alternatively, if the relationships between steps are not contained, the LLM may set the order or branching of the steps based on the standard work flow indicated by the hint words. The web agent 122 obtains each step generated by the LLM and its relevance information from the LLM. The AI ​​agent unit 120 sorts the generated steps based on the relevance score and the website reliability score.

[0044] Although the example in which the web agent 122 acquires information from a website has been described, the present invention is not limited to this example. The web agent 122 may acquire information from sources other than a website (for example, domain knowledge, company information).

[0045] The reliability extraction unit 123 acquires information (e.g., a draft procedure manual, provisional reliability information, and provisional conformance information) from the procedure agent 121 and the web agent 122, and adjusts the provisional reliability information. At this time, the reliability extraction unit 123 may send the acquired information to the LLM, and input and output (e.g., display) question information and answer information between the LLM and the terminal 20 in an interactive format (e.g., web chat format) via the input device 24 and the display device 25, and adjust and determine the reliability information. In other words, the reliability extraction unit 123 may exchange information related to reliability with the terminal 20, and determine the reliability information by reflecting the user's intention based on the information input via the input device 24.

[0046] The compatibility extraction unit 124 extracts compatibility based on information from the procedure agent 121 and information from the web agent 122 .

[0047] The reliability extraction unit 123 acquires information (e.g., a draft procedure manual, provisional reliability information, and provisional compatibility information) from the procedure agent 121 and the web agent 122, and adjusts the provisional compatibility information. At this time, the reliability extraction unit 123 may send the acquired information to the LLM, and input and output (e.g., display) question information and answer information interactively (e.g., in a web chat format) between the LLM and the terminal 20 via the input device 24 and the display device 25, and adjust and confirm the compatibility information. In other words, the reliability extraction unit 123 may exchange information about compatibility with the terminal 20, and may determine the compatibility information by reflecting the user's intention based on the information input via the input device 24.

[0048] The display control unit 125 controls the display on the display device 25. For example, information related to the draft procedure manual generated by the procedure agent 121 or the web agent 122 is displayed on the display device 25. The information (display information) displayed on the display device 25 includes at least some of the procedures and procedure candidates of the generated draft procedure manual, reliability information on the procedures and selection candidates, conformance information on the procedures and selection candidates, and correction information indicating that at least some of the procedures and selection candidates have been corrected. The display control unit 125 may display some of the above display information and not display other information according to a predetermined condition. For example, the display control unit 125 may display some of the above display information and not display other information based on at least one of the reliability information and conformance information.

[0049] 2, the operation manual processing unit 130 includes a processing unit 131. The operation manual processing unit 130 acquires a draft operation manual generated by the AI ​​agent unit 120. The draft operation manual includes information such as multiple work procedures and selection candidates that can be selected as at least part of the procedures. The operation manual processing unit 130 may also acquire reliability information and compatibility information derived by the AI ​​agent unit 120.

[0050] The processing unit 131 processes at least a portion of the draft procedure manual. For example, the processing unit 131 processes the draft procedure manual by selecting a selection candidate for at least a portion of the procedures included in the draft procedure manual or by modifying at least a portion of the procedures. The procedure manual processing unit 130 generates a procedure manual including procedures for multiple tasks based on the processed draft procedure manual. The procedure manual may, for example, describe the procedures for multiple tasks in text format, and the text may be listed in bullet points, i.e., it may be a procedure bullet point list. The processing unit 131 sends the data of the procedure manual to the output unit 140.

[0051] The output unit 140 outputs the generated operation manual data. In this case, the output unit 140 may display the operation manual data via the display device 25. The output unit 140 may output the operation manual data (e.g., a PDF file or a file in another format) to the memory 12 or the memory 22. The output unit 140 may transmit the operation manual data to an external device via the communication device 13 or the communication device 23.

[0052] FIG. 3 is a diagram illustrating an example of a procedure manual.

[0053] In the procedure manual PD of FIG. 3, picking and kitting are included as major procedure items. Detailed procedures related to picking are included as detailed items of the picking procedure. Detailed procedures related to kitting are included as detailed items of the kitting procedure. In the procedure manual draft, which is a stage before being finalized as the procedure manual PD, each procedure may be modifiable, and some of the multiple selection candidates related to each procedure may be selectable. The procedure manual generation system 5 generates (completes) the procedure manual PD by making selections and modifications in the procedure manual draft reflecting the user's intentions via the input device 24.

[0054] <Processing of procedure manual generation system> Next, an example of processing by the procedure manual generation system 5 will be described.

[0055] <First processing example> FIG. 4 is a flowchart showing a first processing example of the procedure manual generation system 5.

[0056] First, the information input unit 110 inputs (acquires) various content information (step S11). This input information includes, for example, information such as video, still images, or text data in which a flow is described or expressed (i.e., expressed in chronological order). The information input unit 110 may input the content information by including in the input information a BPMN flow diagram generated based on the content information.

[0057] The AI ​​agent unit 120 may also generate a BPMN flow diagram based on content information including information such as video, still images, or text data. In this case, the AI ​​agent unit 120 may handle the BPMN flow diagram as part of the input information.

[0058] The AI ​​agent unit 120 generates a draft procedure manual based on the input information using at least one of the procedure agent 121 and the web agent 122 (step S12).

[0059] When creating a draft procedure manual, the reliability extraction unit 123 derives (e.g., calculates) reliability information (e.g., reliability score) of each procedure and each selection candidate. When creating a draft procedure manual, the compatibility extraction unit 124 derives (e.g., calculates) compatibility information (e.g., compatibility score) of each procedure and each selection candidate. The AI ​​agent unit 120 performs at least one of deriving reliability information using the reliability extraction unit 123 or deriving compatibility information using the compatibility extraction unit 124 (step S13).

[0060] The display control unit 125 adds at least one of the derived reliability information and conformance information to the generated draft operation manual and displays it on the display device 25 (step S14). In this case, the display control unit 125 may add the reliability information or conformance information to at least one procedure or selection candidate included in the draft operation manual.

[0061] The procedure manual processing unit 130 selects one of multiple selectable selection candidates in the procedure from the displayed information via the input device 24, generates and complements the procedure manual PD, and completes the procedure manual (step S15). Complementing means generating (completing) a procedure manual based on the procedure manual proposal by performing processing such as selection and correction on the procedure manual proposal PR generated by the AI ​​agent unit 120. The procedure manual proposal and the procedure manual may be data including character information, that is, text data.

[0062] The output unit 140 outputs the data of the generated (completed) procedure manual (step S16).

[0063] <Creation of BPMN> FIGS. 5A and 5B are diagrams showing an example of creating a flowchart of BPMN based on input information.

[0064] In FIGS. 5A and 5B, based on a plurality of images arranged in chronological order as input information I1, a flowchart F1 (flowchart) including a plurality of procedures shown by each of the plurality of images is generated. The plurality of images arranged in chronological order may be those obtained by dividing one or more videos into images at a plurality of timings, or may be a plurality of still images captured in chronological order. The AI agent unit 120 may generate a flowchart of BPMN showing a plurality of procedures based on input information including content information according to a predetermined learned model.

[0065] In the flowchart of BPMN, each procedure can be shown in a list form, and the relationship between a plurality of procedures can be shown completely. Therefore, the AI agent unit 120 can efficiently generate a draft of a procedure manual based on the flowchart of BPMN. Note that the AI agent unit 120 may directly generate a draft of a procedure manual without using the flowchart of BPMN.

[0066] FIG. 5C is a diagram showing an example of a draft of a procedure manual.

[0067] In FIG. 5C, a draft PR of a procedure manual displayed when generating a procedure manual PD (before completion) is shown. The draft PR of a procedure manual hierarchically includes information (for example, information on procedures). In FIG. 5C, various classifications of operations (for example, picking operations) are shown as major items, and various procedures in the operations of the major items are shown as minor items. Note that there may be three or more levels of hierarchy, or the procedures of the operations may be shown in the order without a hierarchy.

[0068] FIG. 5C displays four procedures tj included in the procedure manual draft PR. One of the four procedures, procedure tj1, is displayed with information about the reliability (Source) and suitability (Score) of procedure tj1. Procedure tj1 here may be, for example, a procedure being selected via the input device 24 and not yet confirmed. Here, reliability indicates, for example, the likelihood of the information that was the basis for generating procedure tj1. While FIG. 5C displays the reliability as the name of the company that provided the information (e.g., XX Corporation), reliability may also be indicated by other information. Suitability indicates the degree to which procedure tj1 conforms to a predetermined condition as a procedure (e.g., a task indicated by a hint word). In FIG. 5C, suitability is indicated by a score (e.g., 0.8) that quantifies suitability. While FIG. 5C displays reliability information and suitability information for only one procedure, reliability information and suitability information may also be displayed for multiple procedures (e.g., all procedures).

[0069] By checking the display of the reliability information and conformance information for the procedure tj, the user can determine whether or not the procedure tj needs to be corrected.

[0070] When the user wants to confirm the content of each procedure tj included in the procedure manual draft PR, the user inputs information (confirmation information) indicating that the procedure manual draft PR will be confirmed or presses a confirm button, for example, via the input device 24. The procedure manual processing unit 130 may detect the input of the confirmation information or the pressing of the confirm button, for example, via the input device 24, and confirm the content of each procedure tj. In this way, the procedure manual processing unit 130 confirms the procedure manual draft PR and completes the procedure manual PD.

[0071] When the user wishes to modify at least a portion of the content of each procedure tj included in the procedure manual draft PR, the user inputs information for modifying the procedure tj (modification information) or presses a modification button, for example, via the input device 24. The procedure manual processing unit 130 may detect the input of modification information or the pressing of the modification button, for example, via the input device 24, and modify the content of the procedure tj. When the user decides to finalize the content of each procedure tj after modifying the procedure tj, the procedure manual processing unit 130 finalizes the procedure manual draft PR by processing similar to that described above, and completes the procedure manual PD.

[0072] Furthermore, the procedure manual processing unit 130 may generate a procedure manual draft PR by including selection candidates that can be selected as part of a procedure. When the selection candidates are confirmed based on the content of each procedure tj after selection, the procedure manual processing unit 130 confirms the procedure manual draft PR by the same processing as described above, and completes the procedure manual PD.

[0073] FIG. 5D is a diagram showing an example of procedure completion.

[0074] Similar to FIG. 5C, FIG. 5D shows a draft procedure manual PR that is displayed when generating (before completion of) the procedure manual PD. Three procedures tj included in the draft procedure manual PR are displayed in FIG. 5D. For one of the three procedures tj, procedure tj3, some of the procedure content can be selected from multiple selection candidates. Procedure tj1 here may be, for example, a procedure that is being selected via the input device 24 and has not yet been confirmed.

[0075] The display control unit 125 may add and display reliability information and suitability information for the selection candidate sc1 among the multiple selection candidates sc in step tj3. Here, the selection candidate sc1 may be, for example, a selection candidate being selected via the input device 24 and not yet confirmed. Here, reliability indicates, for example, the likelihood of the information on which the selection candidate sc1 is based. In FIG. 5D, reliability indicates the entity (e.g., LLM) that provided the information, but reliability may also be indicated by other information. Suitability indicates the degree to which the selection candidate sc1 conforms to a predetermined condition as part of the procedure (e.g., the task indicated by the hint word). In FIG. 5D, suitability is indicated by a score (e.g., 0.89) that quantifies suitability. Note that, although FIG. 5D shows reliability information and suitability information added to only one selection candidate sc, reliability information and suitability information may also be added to multiple selection candidates (e.g., all selection candidates).

[0076] By checking the display of the reliability information and conformance information for the procedure tj, the user can determine whether or not the procedure tj needs to be corrected.

[0077] The procedure manual processing unit 130 receives an operation from the user via the input device 24, for example, and detects input of information (selection information) indicating selection of the selection candidate sc1 or pressing of a selection button. As a result, the procedure manual processing unit 130 confirms the selection candidate sc1 and determines the content of the procedure tj including the selection candidate sc1.

[0078] In this way, the AI ​​agent unit 120 of the procedure manual generation system 5 generates a procedure manual draft including one or more procedures tj and selection candidates sc, and displays the generated procedure manual draft PR with added reliability information and compatibility information for the procedures tj and selection candidates sc. This enables the procedure manual generation system 5 to select the optimal candidate or determine whether or not a procedure needs to be modified, thereby improving the completeness of the procedure manual PD.

[0079] In this way, according to the first processing example, the procedure manual generation system 5 displays the criteria for selecting selection candidates (e.g., reliability information, compatibility information), thereby improving the efficiency of selecting selection candidates and improving the completeness of the procedure manual PD.

[0080] <Second processing example> Next, a second processing example will be described. In the second processing example, the description of the same processes as those in the first processing example will be omitted or simplified.

[0081] 6 is a diagram showing an example of the configuration of a part of the procedure manual generation system 5 for explaining the second processing example. In FIG. 6, the AI ​​agent unit 120 is shown.

[0082] In the second processing example, the display control unit 125 controls the display of the selection candidates sc based on the source of information used to generate the selection candidates sc for the procedure tj included in the draft procedure manual PR (information that served as the basis for generating the selection candidates sc). At this time, the display control unit 125 sets a predetermined source display rule. In this case, the display control unit 125 may determine whether or not to display the selection candidates sc based on the source display rule that is defined for each selection candidate sc.

[0083] The source is the provider of the input information, and includes, for example, a website, domain knowledge, internal company information, etc. Note that if the LLM supplements information that was not included in the input information, the source may be the LLM. The source display rule includes rule (condition) information such that, for example, if the source is a website, the selection candidates sc obtained from that source are displayed (select display); if the source is domain knowledge, the selection candidates sc obtained from that source are not displayed (select not display); and if the source is internal company information, the selection candidates sc obtained from that source are not displayed (select not display). If the selection candidates sc are not displayed, the selection candidates sc are not selectable; if the selection candidates sc are displayed, the selection candidates sc are selectable.

[0084] The information on the origin display rule may be set by the user via, for example, the input device 24. The information on the origin display rule may be acquired from an external device via, for example, the communication device 13 or the communication device 23, or may be stored in the memory 12 or the memory 22 and acquired from the memory 12 or the memory 22.

[0085] The display of the selection candidates sc based on the source display rule in the second processing example may be performed, for example, when processing the procedure draft, reliability information, conformance information, etc. in step S14 of Fig. 4. Furthermore, the timing for setting the source display rule may be the same as the timing for setting the hint word, for example.

[0086] FIG. 7 is a diagram illustrating an example of procedure complementation in the second processing example. 7, the same matters as those in FIGS. 5C, 5D, and 6 will not be described or will be simplified.

[0087] Of the three selection candidates sc1 to sc3 in procedure tj3 included in the draft procedure manual PR, selection candidate sc1 is obtained from a website, selection candidate sc2 is obtained from domain knowledge, and selection candidate sc3 is obtained from in-house information. In this case, based on the source display rule, the display control unit 125 displays selection candidate sc1 obtained from the website, does not display selection candidate sc2 obtained from domain knowledge, and does not display selection candidate sc1 obtained from in-house information.

[0088] In Fig. 7, the contents of the selection candidates sc2 and sc3 are shown with a strikethrough added, which indicates that they are not actually to be displayed. As in Fig. 7, the contents of the selection candidates sc2 and sc3 may be shown with a strikethrough added and the three selection candidates sc1 to sc3 may be displayed, explicitly indicating that the selection candidates sc2 and sc3 are not to be displayed.

[0089] In this way, according to the second processing example, the procedure manual generation system 5 can improve the selection efficiency of the selection candidates sc by limiting the selection candidates to be displayed in advance based on the information source (origin) that is the basis for the selection candidates sc, thereby improving the completeness of the procedure manual PD.

[0090] In the second processing example, the display of the selection candidates sc is determined depending on the source of the information used to generate the selection candidates sc, but this is not limiting. The display control unit 125 may determine whether to display the procedure tj depending on the source of the information used to generate the procedure tj, in the same way as in the case of the selection candidates sc.

[0091] <Third processing example> Next, a third processing example will be described. In the third processing example, the description of the same processes as those in the first or second processing example will be omitted or simplified.

[0092] 8 is a diagram showing an example of the configuration of a part of the procedure manual generation system 5 for explaining the third processing example. In FIG. 8, the AI ​​agent unit 120 is shown.

[0093] In the third processing example, the display control unit 125 controls the display of the procedure tj based on the reliability information and conformance information of the procedure tj included in the draft procedure manual PR. In this case, the display control unit 125 may determine whether to display the procedure tj based on integrated information that integrates the reliability information and conformance information. The integrated information may be, for example, an integrated score obtained by integrating the reliability score and the conformance score. For example, the integrated score may be a score obtained by multiplying the reliability score and the conformance score. As a result, if either the reliability score or the conformance score is extremely low, the integrated score also becomes low. Therefore, the procedure manual generation system 5 can control the display of the procedure tj when both the reliability score and the conformance score are high, for example, by controlling the procedure tj to be displayed when the integrated score is high and not to be displayed when the integrated score is low. Furthermore, the display control unit 125 may control the display of the procedure tj based on predetermined setting criterion information (e.g., ratio setting criterion information) and integrated information (e.g., the integrated score). The ratio setting criterion information may be expressed as a numerical value (a setting criterion value, for example, 0.2). In this case, the display control unit 125 may determine whether or not to display each procedure tj for each procedure tj. Furthermore, the integrated score does not have to reflect both the reliability score and the compatibility score. For example, the higher or lower of the reliability score and the compatibility score may be used as the integrated score. This allows the procedure tj to be displayed if either one of the scores is sufficiently high, thereby enabling the procedure manual generation system 5 to increase the number of procedure tj candidates that the user can select. In other words, the integrated score may be a score obtained by integrating the reliability score and the compatibility score based on some rule, and the details of the rule are not important.

[0094] For example, if the integrated score for procedure tj is equal to or greater than a set reference value, the display control unit 125 displays the procedure tj. On the other hand, if the integrated score for procedure tj is less than the set reference value, the display control unit 125 does not display the procedure tj.

[0095] The method for integrating the reliability and relevance in the integrated information may be included in the ratio setting reference information. For example, the display control unit 125 may perform weighted addition or weighted multiplication of the reliability score and the relevance score, or may derive the integrated information using other calculation methods.

[0096] The ratio setting reference information may be set by a user via the input device 24. The ratio setting reference information may be acquired from an external device via the communication device 13 or the communication device 23, or may be stored in the memory 12 or the memory 22 and acquired from the memory 12 or the memory 22.

[0097] The display of the procedure tj based on the integrated information in the third processing example may be performed, for example, when processing the draft procedure manual, reliability information, and compatibility information in step S14 of Fig. 4. Furthermore, the timing of setting the ratio setting reference information may be the same as the timing of setting the hint word, for example.

[0098] FIG. 9 is a diagram illustrating an example of procedure complementation in the third processing example. In FIG. 9, the same matters as those in FIGS. 5C, 5D, and 6 to 8 will not be described or will be explained simply.

[0099] The display control unit 125 acquires a reliability score and a suitability score for each of the procedures tj1 to tj4 included in the draft procedure manual PR, and calculates an overall score based on the reliability score and the suitability score. The display control unit 125 displays the procedure tj if the overall score is equal to or greater than a set reference value, and does not display the procedure tj if the overall score is less than the set reference value.

[0100] 9, the total score of procedure tj1 is 0.72, the total score of procedure tj2 is 0.56, the total score of procedure tj3 is 0.35, and the total score of procedure tj4 is 0.14. The set reference value is 0.2. In this case, the display control unit 125 displays procedures tj1 to tj3, but does not display procedure tj4.

[0101] 9, the content of procedure tj4 is shown with a strikethrough, which indicates that it is not actually to be displayed. As shown in FIG. 9, the content of procedure tj4 may be shown with a strikethrough and the four procedures tj1 to tj4 may be displayed to explicitly indicate that procedure tj4 is not to be displayed.

[0102] Thus, according to the third processing example, the procedure manual generation system 5 compares the integrated score, calculated based on the ratio between the reliability score and the compatibility score, with a preset reference value. If the comparison result shows that the integrated score is smaller than the reference value, the procedure manual generation system 5 excludes the procedure tj associated with the integrated score from the display targets. Therefore, the procedure manual generation system 5 can display and select only the procedures tj that satisfy the reference value, thereby improving the efficiency of selecting procedures tj and the completeness of the procedure manual.

[0103] In the third processing example, the determination of whether to display the procedure tj based on the total score is illustrated, but this is not limiting. The display control unit 125 may determine whether to display the selection candidates sc based on the total score in the same manner as in the case of the procedure tj.

[0104] <Fourth Processing Example> Next, a fourth processing example will be described. In the fourth processing example, the explanation of the same processes as those in the first to third processing examples will be omitted or simplified.

[0105] 10 is a diagram showing an example of the configuration of a part of the procedure manual generation system 5 for explaining the fourth processing example. In FIG. 10, an AI agent unit 120 and a procedure manual processing unit 130 are shown.

[0106] In the fourth processing example, the processing unit 131 of the operation manual processing unit 130 selects one of the selection candidates sc from among multiple selection candidates sc included in the generated operation manual draft PR. The operation manual processing unit 130 stores information about the selected selection candidate sc (selected information) in the memory 12 or the memory 22. The display control unit 125 controls the display of the procedures tj and selection candidates sc included in the generated operation manual draft PR based on the selected information, that is, based on the selected selection candidates sc. In this case, the display control unit 125 determines, based on the selected information, the procedures tj and selection candidates sc to be displayed among the procedures tj and selection candidates sc included in the operation manual draft PR, and determines the procedures tj and selection candidates sc not to be displayed. In other words, the display control unit 125 determines the display range of the procedures tj and selection candidates sc included in the operation manual draft PR based on the selected information, and displays the procedures tj and selection candidates sc within the determined display range.

[0107] 10, as the selected information, picking work is selected as a major item, and the text "Place the target equipment at the location" is selected as a detailed item in step tj3. In other words, this selected information specifies as a major item "I want the process related to the picking work to be displayed" and as a detailed item "I want only the work of the selection candidate sc specified (selected) in step tj3 to be displayed." The display control unit 125 limits the display range based on information on at least one of the selected major item and detailed item related to the selected information.

[0108] As a result, by taking into account the selected information, the procedure manual generation system 5 excludes information that the user does not intend from being displayed in advance, and displays the information that the user intends as likely information, allowing the user to quickly select the type of work (e.g., picking work) and selection candidates sc.

[0109] The limitation of the display range based on the selected information in the fourth processing example may be performed after the generation and completion of the procedure manual PD in step S15 of FIG.

[0110] FIG. 11 is a diagram illustrating an example of procedure complementation in the fourth processing example. In FIG. 11, the same matters as those in FIGS. 5C, 5D, and 6 to 10 will not be described or will be simplified.

[0111] Suppose that selection candidate sc1 is selected from three selection candidates sc1 to sc3 for procedure tj3 included in the draft procedure manual PR. In this case, the procedure manual processing unit 130 generates selected information including information on selection candidate sc1 and stores it in memory 12 or memory 22. For example, after completing the procedure manual PD based on this selection, the AI ​​agent unit 120, when generating the next draft procedure manual PR including a similar procedure tj and selection candidate sc, limits the display range of procedure tj and selection candidate sc based on the selected information. Specifically, the display control unit 125 displays, as a major item, only the selection candidate sc1, which has been selected among various tasks, and does not display procedures related to other tasks. Then, as a detailed item, the display control unit 125 displays, as a minor item, only the selection candidate sc1, which has been selected among various selection candidates sc, and does not display the other selection candidates sc2 and sc3.

[0112] 11, the contents of the selection candidates sc2 and sc3 are shown with a strikethrough added, which indicates that they are not actually to be displayed. As shown in FIG. 11, the contents of the selection candidates sc2 and sc3 may be shown with a strikethrough added and the three selection candidates sc1 to sc3 may be displayed, explicitly indicating that the selection candidates sc2 and sc3 are not to be displayed.

[0113] Thus, according to the fourth processing example, the procedure manual generation system 5 displays information about tasks and selection candidates that have been selected as display targets, and does not display information that has not been selected, i.e., information that is not intended by the user, as information that is not displayed as display targets. This reduces the number of selectable tasks, procedures tj, and selection candidates sc that are displayed, allowing the user to quickly select a task, procedure tj, or selection candidate sc. Therefore, the procedure manual generation system 5 can improve the efficiency of selecting tasks, procedures tj, and selection candidates sc, and can improve the completeness of the procedure manual PD.

[0114] <Fifth Processing Example> Next, a fifth processing example will be described. In the fifth processing example, the explanation of the same processes as those in the first to fourth processing examples will be omitted or simplified.

[0115] 12 is a diagram showing an example of the configuration of a part of a procedure manual generation system for explaining the fifth processing example, in which an AI agent unit 120 and a procedure manual processing unit 130 are shown.

[0116] In the fifth processing example, the display control unit 125 displays the generated operation manual draft PR. The operation manual draft PR may include, for example, one or more procedures tj and multiple selection candidates sc for the procedures tj. If the user wishes to modify the contents of the procedures tj or the selection candidates sc in the displayed operation manual draft PR, the user may modify the contents via the input device 24. In this case, the processing unit 131 of the operation manual processing unit 130 modifies the contents of the procedures tj and the selection candidates sc via the input device 24. For example, this modification may be performed in real time while the operation manual draft PR is being displayed. In other words, the operation manual processing unit 130 can modify the procedures tj and the selection candidates sc in the operation manual draft PR in real time when the operation manual draft PR is displayed, before the operation manual PD is completed. The display control unit 125 may display the modified operation manual draft PR based on the modified information (modification information). The modification information includes at least the information after the modification and may also include the information before the modification.

[0117] In Fig. 12, picking work is selected as a major item, and is modified as a detailed item in step tj3. For example, as shown in Fig. 13, in step tj3 of the detailed item, "predetermined" is modified to "optional" and "packing box" is modified to "shipping box."

[0118] The real-time display based on the correction information in the fifth processing example may be performed, for example, during the process of generating and completing the procedure manual PD in step S15 of FIG.

[0119] In this way, the procedure manual generation system 5 can directly and manually modify the procedures tj and selection candidates sc of the generated procedure manual draft PR via the input device 24, and modify the procedure manual draft PR based on this modification information. Therefore, the procedure manual generation system 5 can eliminate the need to input the procedures tj from scratch into the procedure manual draft PR to be modified, and can improve the efficiency of modifying the procedure manual draft PR.

[0120] FIG. 13 is a diagram illustrating an example of procedure complementation in the fifth processing example. In FIG. 13, the same matters as those in FIGS. 5C, 5D, and 6 to 12 will not be described or will be simplified.

[0121] The procedure tj3 included in the draft procedure manual PR has three selection candidates sc1 to sc3, and the selection candidates sc1 to sc3 are displayed. It is assumed that the user makes a correction to at least one of the displayed selection candidates sc1 to sc3. In this case, the processing unit 131 corrects the contents of the procedure tj and the selection candidates sc via the input device 24. Here, in the selection candidate sc1 of the procedure tj3, "predetermined" is corrected to "optional," and in the selection candidate sc3, "packaging box" is corrected to "shipping box."

[0122] The display control unit 125 displays the draft operation manual PR including the revised content (text). In this case, the display control unit 125 may display the revised operation manual draft PR in such a way that the content before the revision is also visible along with the content after the revision. For example, as shown in FIG. 13, the display control unit 125 may add a strikethrough to the revised portion of the text before the revision in the selection candidates sc2 and sc3, and display the revised text near the revised portion.

[0123] Thus, according to the fifth processing example, the procedure manual generation system 5 can modify the procedures tj and selection candidates sc of the procedure manual draft PR in real time, reducing the time required to recreate the procedure manual draft PR and, in other words, the time required to complete the procedure manual PD. Furthermore, because the procedure manual generation system 5 allows selection while visually checking the modified procedures tj and selection candidates sc, it is possible to improve selection efficiency and the completeness of the procedure manual PD.

[0124] <Sixth Processing Example> Next, a sixth processing example will be described. In the sixth processing example, the explanation of the same processes as those in the first to fifth processing examples will be omitted or simplified.

[0125] FIG. 14 is a diagram illustrating an example of the configuration of a part of a procedure manual generation system for explaining the sixth processing example.

[0126] In the procedure manual generation system 5 of the sixth processing example, the procedure manual processing unit 130 includes a processing unit 131 and a history generation unit 132. The history generation unit 132 generates history information based on at least one of the selection and the correction by the processing unit 131, and stores the history information in the memory 12 or the memory 22.

[0127] The history information includes version identification information, selection identification information, correction information, and change / non-change information. The version identification information is information that distinguishes between new and old procedures tj or selection candidates sc that have been selected and corrected. The selection identification information is information that identifies the selected procedures tj or selection candidates sc. The correction information is information that indicates the correction content of the procedure tj or selection candidates sc. The correction information includes, for example, text data before and after correction, and binary data obtained by converting the text data into binary data. The change / non-change information is information that indicates whether the content of the procedure tj or selection candidates sc has changed due to the selection or correction of the procedure tj or selection candidates sc.

[0128] When generating history information, the history generation unit 132 generates a history record by associating each piece of information with version identification information each time a procedure tj or a selection candidate sc included in the procedure manual draft PR is selected or modified. The history generation unit 132 also generates text data and its binary data based on information obtained when a procedure tj or a selection candidate sc included in the procedure manual draft PR is modified via the input device 24. The history generation unit 132 also determines whether a procedure tj or a selection candidate sc has been selected or modified based on the selection identification information or modification information, and generates change presence / absence information.

[0129] The history generation unit 132 controls the display of procedures tj and selection candidates sc included in the next generated operation manual draft PR based on the history information. In this case, the display control unit 125 determines, from the procedures tj and selection candidates sc included in the next operation manual draft PR, which procedures tj and selection candidates sc to display, and determines which procedures tj and selection candidates sc not to display. In other words, the display control unit 125 determines (limits) the display range of the procedures tj and selection candidates sc included in the operation manual draft PR based on the history information, and displays the procedures tj and selection candidates sc within the determined display range.

[0130] The display range may be limited based on the history information in the sixth processing example, for example, when the procedure manual PD is generated and completed in step S15 of FIG.

[0131] FIG. 15 is a diagram illustrating an example of procedure complementation in the sixth processing example. In FIG. 15, the same matters as those in FIGS. 5C, 5D, and 6 to 14 will not be described or will be explained simply.

[0132] In Fig. 15, "terminal" in the procedure tj1 included in the draft procedure manual PR is corrected to "terminal system." The history generation unit 132 generates history information based on this correction. An example of this history information is shown as an example of history information in Fig. 14.

[0133] In FIG. 15, in the current draft procedure manual PR, the text of procedure tj1 (e.g., "system") that has been corrected is displayed with a strikethrough, and the corrected text (e.g., "terminal system") is displayed near the corrected part. Therefore, the user can check and compare the information before and after the correction in the current draft procedure manual PR. Furthermore, in subsequent draft procedure manual PRs, the content of the corrected text (e.g., "terminal system") is inserted and displayed in the position of the text of the corrected part before the correction (e.g., "system"). Therefore, in subsequent draft procedure manual PRs, the user can automatically display a draft procedure manual PR that includes procedure tj that reflects the content of the correction record.

[0134] Thus, according to the sixth processing example, the procedure manual generation system 5 generates history information and uses it when creating subsequent procedure drafts, thereby excluding information not intended by the user from the display target in advance and enabling quick selection of a procedure tj or a selection candidate sc. Therefore, the procedure manual generation system 5 can improve the efficiency of selecting a procedure tj or a selection candidate sc, and can improve the completeness of the procedure manual PD.

[0135] Furthermore, the operation manual processing unit 130 may acquire user identification information, such as a user ID, input via the input device 24, for example, when logging in to the terminal. The operation manual processing unit 130 may generate history information including the user ID. In this case, the AI ​​agent unit 120 can generate a operation manual draft PR for each user by taking into account the user ID and applying the history information if the user is the same. Furthermore, by storing the history information in memory, the operation manual processing unit 130 can perform selection and correction from a state saved as history information.

[0136] In the above description, the procedure manual generation system 5 generates a procedure manual draft using both the procedure agent 121 and the web agent 122, but it may use only one of them.

[0137] Furthermore, in the above, the procedure manual generation system 5 displays both the reliability information and the compatibility information, but it may be configured to display only one of them.

[0138] Furthermore, instead of the process of determining whether or not to display in each of the above processing examples, the procedure manual generation system 5 may perform a process of changing the display mode, such as color or shape, while still performing the display itself. In other words, the process of determining whether or not to display in each of the above processing examples is an example of a process of changing the display mode.

[0139] Furthermore, at least two of the first to sixth processing examples may be executed in combination.

[0140] <Display by terminal> Next, the operation of the terminal 20 during display will be described.

[0141] In the terminal 20, the processor 21 acquires the above-mentioned draft operating manual PR generated by the server device 10 or the terminal 20. The processor 21 acquires at least one of the reliability information and the compatibility information derived by the server device 10 or the terminal 20. At this time, when the draft operating manual PR, the reliability information, or the compatibility information is generated by the server device 10, the necessary information is communicated from the server device 10 to the terminal 20 via the communication device.

[0142] The display device 25 displays the draft procedure manual PR with at least one of reliability information and conformance information added thereto under the control of the processor 21. As described above, the reliability information and conformance information may be added to the draft procedure manual PR, may be added for each procedure, or may be added for each selection candidate sc.

[0143] As a result, the terminal 20 can provide the user with criteria for selection, modification, or other processing of the draft procedure manual PR by displaying reliability information and conformance information related to the procedure tj in the draft procedure manual PR. The user can check the reliability information and conformance information and consider processing the draft procedure manual PR. Therefore, the terminal 20 can help improve the efficiency and accuracy of generating the draft procedure manual PD compared to generating the draft procedure manual PD without criteria.

[0144] In this way, the procedure manual generation system 5 can automatically generate work procedures tj and selection candidates sc based on input information, and select and determine appropriate wording (procedures) from the selection candidates sc, for example, to improve the production efficiency of on-site workers. This allows the procedure manual generation system 5 to reduce the time required to generate a procedure manual, automatically generate and complete a procedure manual PD that includes efficient work procedures, and improve work productivity. It also reduces human error in procedure manual generation and can derive more accurate and standardized work procedures (SOPs). SOP stands for Standard Operation Procedure.

[0145] Furthermore, when creating a procedure manual PD that defines work procedures at a manufacturing site such as a manufacturing, logistics, or distribution site, the procedure manual generation system 5 can prevent field workers from spending a lot of time understanding the work content at the site and considering the wording of the procedure manual PD. For example, the procedure manual generation system 5 can eliminate the need for field workers to think about and derive the contents of a picking list on site, thereby reducing the burden on field workers involved in generating the procedure manual PD.

[0146] Note that, in this embodiment, a case where a portion of the procedure tj in the operation manual draft PR is selectable as a selection candidate sc has been mainly exemplified, but this is not limited to this. The entire procedure tj in the operation manual draft PR may be selectable as a selection candidate sc. For example, the entire procedure tj1 in the operation manual draft PR in FIG. 5C may be set as a selection candidate sc, or the entire procedure tj3 in the operation manual draft PR in FIG. 5D may be set as a selection candidate sc. In this case, it can be said that the entire procedure tj is a selection candidate. Therefore, in this embodiment, at least a portion of the procedure tj in the operation manual draft PR may be set as a selection candidate sc.

[0147] In addition, in the present embodiment, the example has been given in which the work of the major category of the operation manual draft PR (for example, picking work) itself may also be a selection candidate. In other words, the operation manual processing unit 130 can treat the work of the major category itself as a procedure in a broad sense, and can treat it as a selection candidate for at least a part of the procedure.

[0148] (Outline of the embodiment) As a result, the present disclosure describes at least the following: Note that, in parentheses, examples of components corresponding to the above-described embodiments are given, but the present disclosure is not limited to these.

[0149] (Item 1) A procedure manual generation system (procedure manual generation system 5) that generates a procedure manual (procedure manual PD) regarding a plurality of procedures (procedures tj) that constitute a work, a procedure manual draft generation unit (AI agent unit 120, procedure agent 121, web agent 122) that generates a procedure manual draft (procedure manual draft PR) including the procedure of the work; a derivation unit (AI agent unit 120, procedure agent 121, web agent 122, reliability extraction unit 123, compatibility extraction unit 124) that derives at least one of reliability information on reliability indicating the likelihood of information that was the basis for generating the procedure contained in the draft procedure manual, and compatibility information on compatibility indicating the degree to which the procedure contained in the draft procedure manual is suitable as a procedure for the work; a display control unit (AI agent unit 120, display control unit 125) that adds at least one of the reliability information and the compatibility information to the draft procedure manual and displays it on a display device (display device 25); A procedure manual generation system comprising:

[0150] This allows the procedure manual generation system to display the reliability and suitability of the procedures in the procedure manual draft, allowing users to confirm the criteria for selecting, modifying, and otherwise processing the procedure manual draft.As a result, the procedure manual generation system can improve the efficiency and accuracy of procedure manual generation compared to when procedure manuals are generated without criteria.

[0151] (Item 2) a processing unit (processing unit 131) that processes the draft procedure manual by selecting selection candidates (selection candidates sc) of at least a part of the procedures included in the draft procedure manual or by modifying at least a part of the procedures; and a procedure manual generation unit (procedure manual processing unit 130) that generates the procedure manual based on the processed procedure manual draft. Item 1. A procedure manual generation system.

[0152] This allows the procedure manual generation system to process procedure manual drafts with reliability and compatibility in mind, improving the efficiency of processing procedure manual drafts and the completeness of the procedure manuals.It also enables the efficient and rapid generation and completion of procedure manuals that include procedures for multiple tasks.

[0153] (Item 3) The procedure included in the draft procedure manual has a plurality of selection candidates for at least a part of the procedure; the display control unit displays at least one of the reliability information and the compatibility information for each of the selection candidates; the processing unit selects one selection candidate from a plurality of selection candidates via an input device, The procedure manual generation unit generates the procedure manual based on the procedure manual draft and the selected selection candidates. Item 2. A procedure manual generation system.

[0154] This allows the procedure manual generation system to display the criteria for processing for each selection candidate for the procedure in the draft procedure manual, making it easier for the user to select a preferred selection candidate and improving the completeness of the procedure manual.

[0155] (Item 4) the display control unit changes the manner in which the selection candidates are displayed based on the source of information used to generate the selection candidates. Item 2 or 3. The procedure manual generation system.

[0156] This allows the procedure manual generation system to improve the efficiency of selecting selection candidates and the completeness of procedure manuals by, for example, making it easier to visually understand the source (website, domain knowledge, etc.) of the selection candidates to be displayed.

[0157] (Item 5) the display control unit changes a display manner of the selection candidates based on the reliability information and the compatibility information about the selection candidates. 5. The procedure manual generation system according to any one of items 2 to 4.

[0158] This allows the procedure manual generation system to not only present the reliability information and conformance information to the user, but also make it easier for the user to visually distinguish the reliability information and conformance information.

[0159] (Item 6) The display control unit controls not to display the selection candidate when integrated information (integrated score) obtained by integrating the reliability information (reliability score) and the compatibility information (reliability score) for the selection candidate does not satisfy a predetermined standard (set standard value). Item 5. A procedure manual generation system.

[0160] As a result, the procedure manual generation system can improve the efficiency of selecting selection candidates that are preferable in terms of the overall score by, for example, excluding the selection candidate from those to be displayed if the overall score is lower than a set standard value, thereby improving the completeness of the procedure manual.

[0161] (Item 7) The procedure manual draft generation unit is capable of generating the procedure manual draft at a plurality of timings, the display control unit determines, based on the selected selection candidate, a selection candidate to be displayed from among the plurality of selection candidates when a next draft procedure is generated. 7. The procedure manual generation system according to claim 3.

[0162] The selection of a selection candidate from among a plurality of selection candidates is determined by the user's intention. Therefore, the procedure manual generation system can quickly select a selection candidate by, for example, limiting the selection candidates displayed to those that have been selected once.

[0163] (Item 8) The processing unit modifies the procedure or the content of the selection candidate of the draft procedure manual displayed on the display device in real time via an input device. 8. The procedure manual generation system according to claim 2.

[0164] This allows the procedure manual generation system to revise the procedures and selection options in the draft procedure manual in real time, eliminating the need to reselect procedure selection options or add input information to recreate the draft procedure manual, thereby reducing the time required to recreate the draft procedure manual.

[0165] (Item 9) The processing unit generates history information of processing of the draft procedure manual and stores it in a memory, The procedure manual draft generation unit is capable of generating the procedure manual draft at a plurality of timings, The display control unit determines procedures or selection candidates to be displayed when generating the next draft procedure manual based on the history information. 9. The procedure manual generation system according to any one of items 2 to 8.

[0166] This allows the procedure manual generation system to use history information that records the contents of procedures and selection candidates that have been processed, such as selected or modified, for display control. Therefore, the procedure manual generation system can make it easier to process procedures or selection candidates by excluding information that the user does not intend from the display based on the history information, thereby improving the processing efficiency of procedure manual drafts and the completeness of procedure manuals.

[0167] (Item 10) A terminal (terminal 20) including a processor (processor 21) and a display device (display device 25), The processor: A draft procedure manual is generated based on information about content including multiple data items related to work and arranged in chronological order, and includes a procedure for the work. obtain at least one of reliability information relating to reliability indicating the reliability of information included in the draft procedure manual that was used as a basis for generating the procedure, and compatibility information relating to compatibility indicating the degree to which the procedure is suitable for the work; The display device is adding at least one of the reliability information and the conformance information to the draft procedure manual and displaying the same; Terminal.

[0168] This allows the terminal to display the reliability and suitability of the procedures in the draft procedure manual, thereby providing the user with criteria for selection, modification, and other processing of the draft procedure manual. The user can check the reliability and suitability and consider processing the draft procedure manual. Therefore, the terminal can help improve the efficiency and accuracy of generating procedure manuals compared to generating procedure manuals without criteria.

[0169] (Item 11) A method for generating a procedure manual for a plurality of procedures constituting a work, comprising the steps of: generating a draft procedure manual including the procedure of the work; Deriving at least one of reliability information relating to reliability indicating the likelihood of information included in the draft procedure manual that was the basis for generating the procedure, and compatibility information relating to compatibility indicating the degree to which the procedure included in the draft procedure manual is suitable as a procedure for the work; adding at least one of the reliability information and the conformance information to the draft procedure manual and displaying the resulting document on a display device; A procedure manual generation method having the steps:

[0170] As a result, the procedure manual generation method can achieve the same effect as item 1.

[0171] Although various embodiments have been described above with reference to the drawings, it goes without saying that the present disclosure is not limited to such examples. It is clear that a person skilled in the art can conceive of various modifications or alterations within the scope of the claims, and it is understood that these also naturally fall within the technical scope of the present disclosure. Furthermore, the components of the above-described embodiments may be combined in any manner without departing from the spirit of the invention.

[0172] In addition, the above embodiment may also be applicable to a program that realizes the functions of the procedure manual generation method, which is supplied to a computer (e.g., server device 10, terminal 20, or procedure manual generation system 5) via a network or various storage media, and which is read and executed by the processor of this computer, as well as to a storage medium on which this program is stored. [Industrial Applicability]

[0173] The present disclosure is useful for a procedure manual generation system, a terminal, a procedure manual generation method, etc. that can improve the efficiency and accuracy of generating procedure manuals. [Explanation of symbols]

[0174] 5 Procedure generation system 10 Server device 11 processors 12 Memory 13. Communication Devices 20 terminals 21 processors 22 Memory 23 Communication Devices 24 Input Devices 25 Display Devices 110 Information input section 120 AI Agent Department 121 Procedure Agent 122 Web Agent 123 Reliability Extraction Unit 124 Compatibility extraction part 125 Display control unit 130 Procedure Manual Processing Section 131 Processing Department 132 History Generation Unit 140 Output section

Claims

1. A procedure manual generation system for generating procedure manuals for a plurality of procedures constituting a work, a procedure manual draft generation unit that generates a procedure manual draft including the procedure of the work; a derivation unit that derives at least one of reliability information regarding reliability indicating the likelihood of information that was the basis for generating the procedure included in the draft procedure manual, and compatibility information regarding compatibility indicating the degree to which the procedure included in the draft procedure manual is suitable as a procedure for the work; a display control unit that adds at least one of the reliability information and the conformance information to the draft procedure manual and displays the resulting information on a display device; A procedure manual generation system comprising:

2. a processing unit that processes the draft procedure manual by selecting a selection candidate for at least a part of the procedure included in the draft procedure manual or by modifying at least a part of the procedure; and a procedure manual generation unit that generates the procedure manual based on the processed procedure manual draft. The procedure manual generation system according to claim 1 .

3. The procedure included in the draft procedure manual has a plurality of selection candidates for at least a part of the procedure; the display control unit displays at least one of the reliability information and the compatibility information for each of the selection candidates; the processing unit selects one selection candidate from a plurality of selection candidates via an input device, The procedure manual generation unit generates the procedure manual based on the procedure manual draft and the selected selection candidates. The procedure manual generation system according to claim 2 .

4. the display control unit changes the manner in which the selection candidates are displayed based on the source of information used to generate the selection candidates. The procedure manual generation system according to claim 2 .

5. the display control unit changes a display manner of the selection candidates based on the reliability information and the compatibility information about the selection candidates. The procedure manual generation system according to claim 2 .

6. the display control unit controls not to display the selection candidates when integrated information obtained by integrating the reliability information and the compatibility information about the selection candidates does not satisfy a predetermined standard. The procedure manual generation system according to claim 5 .

7. The procedure manual draft generation unit is capable of generating the procedure manual draft at a plurality of timings, The display control unit determines, based on the selected selection candidate, a selection candidate to be displayed from among the plurality of selection candidates when a next draft procedure is generated. The procedure manual generation system according to claim 3 .

8. The processing unit modifies the procedure or the content of the selection candidate of the draft procedure manual displayed on the display device in real time via an input device. The procedure manual generation system according to claim 2 .

9. The processing unit generates history information of processing of the draft procedure manual and stores it in a memory, The procedure manual draft generation unit is capable of generating the procedure manual draft at a plurality of timings, The display control unit determines procedures or selection candidates to be displayed when generating the next draft procedure manual based on the history information. The procedure manual generation system according to claim 2 .

10. A terminal comprising a processor and a display device, The processor: A draft procedure manual is generated based on information about content including multiple data items related to work and arranged in chronological order, and includes a procedure for the work. obtain at least one of reliability information relating to reliability indicating the reliability of information included in the draft procedure manual that was used as a basis for generating the procedure, and compatibility information relating to compatibility indicating the degree to which the procedure is suitable for the work; The display device is adding at least one of the reliability information and the conformance information to the draft procedure manual and displaying the same; Terminal.

11. A method for generating a procedure manual for a plurality of procedures constituting a work, comprising the steps of: generating a draft procedure manual including the procedure of the work; Deriving at least one of reliability information relating to reliability indicating the likelihood of information that was the basis for generating the procedure included in the draft procedure manual, and compatibility information relating to compatibility indicating the degree to which the procedure included in the draft procedure manual is suitable as a procedure for the work; adding at least one of the reliability information and the conformance information to the draft procedure manual and displaying the resulting document on a display device; A procedure manual generation method having the steps:

Citation Information

Patent Citations

  • Device and program for supporting creation of procedure manual

    JP2002334146A