Operation support system for industrial machines
The industrial equipment operation support system efficiently manages multiple devices by using a control agent and device agents to handle specific equipment inputs, addressing the need for non-expert support and reliability in AI-driven systems.
Patent Information
- Application Number
- JP2024011153
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2024-01-29
- Publication Date
- 2025-08-08
AI Technical Summary
Existing industrial equipment operation support systems are limited to single-device AI utilization, requiring skilled operators and lacking efficiency in managing multiple machines, and there is a need for systems that can provide appropriate operational support even to non-experts.
An industrial equipment operation support system with a server that accesses information from multiple devices, utilizing a control agent and device agents to generate answers, where the control agent receives partial information and the equipment agent handles specific equipment inputs, divided into multiple AI components to avoid hallucination and ensure reliability.
The system efficiently supports industrial equipment operation, enabling non-experts to provide appropriate support by clarifying dialogue procedures, avoiding hallucination, and ensuring high reliability through specialized AI components.
Smart Images

Figure 2025116630000001_ABST
Abstract
Description
[Technical Field]
[0001] The present invention relates to an operation support system for industrial equipment. [Background technology]
[0002] There is a demand for more efficient systems for supporting the operation of industrial equipment. Furthermore, in anticipation of the future retirement of skilled operators, there is a demand for systems that allow non-skilled operators to provide appropriate operational support.
[0003] Patent Document 1 discloses that a pump device is equipped with an AI function. [Prior art documents] [Patent documents]
[0004] [Patent Document 1] Japanese Patent Publication No. 2022-98903 Summary of the Invention [Problem to be solved by the invention]
[0005] The utilization of the AI function described in Patent Document 1 is limited to the use of a single device. For this reason, there has been a demand for a new operation support system that can efficiently manage the operation of multiple industrial machines.
[0006] In light of these circumstances, the present invention was developed as a result of research by the inventors into more effective operational support for industrial equipment, and provides an industrial equipment operational support system that is efficient and allows even non-experts to provide appropriate operational support by devising innovative ways of utilizing AI. [Means for solving the problem]
[0007] An example of an industrial equipment operation support system according to the present invention for solving the above-mentioned problems is as follows.
[0008] In industrial equipment operation support systems, It has a server that can access information about multiple industrial devices, the server has a control agent and device agents that generate answers to questions received through an input means; The control agent receives only a portion of the information about the plurality of industrial devices for each of the plurality of industrial devices, The equipment agent is an industrial equipment operation support system to which only information on some of the plurality of industrial equipment is input. [Effects of the Invention]
[0009] According to the present invention, it is possible to provide an industrial equipment operation support system that can efficiently support the operation of industrial equipment and that can also provide appropriate operation support even to non-experts.
[0010] Further configurations and effects of the present invention will become apparent from the entire specification below. [Brief explanation of the drawings]
[0011] [Figure 1] 1 is an example of a system configuration according to an embodiment of the present invention. [Figure 2] 1 is an example of a system configuration according to an embodiment of the present invention. [Figure 3] 1 is an example of a system configuration according to an embodiment of the present invention. [Figure 4] 1 is an example of a system configuration according to an embodiment of the present invention. [Figure 5] FIG. 10 is a flowchart illustrating an example of a processing procedure in an embodiment of the present invention. [Figure 6] FIG. 10 is a diagram showing an example of an interface screen in one embodiment of the present invention. [Figure 7] FIG. 2 is a diagram illustrating an example of a detailed configuration in an embodiment of the present invention. [Figure 8] FIG. 10 is a diagram illustrating an example of an operation on the industrial equipment side in an embodiment of the present invention. DETAILED DESCRIPTION OF THE INVENTION
[0012] Hereinafter, an embodiment of the present invention will be described with reference to the drawings as an example. [Example]
[0013] Fig. 1 shows an example of a system configuration in one embodiment of the present invention. Reference numeral 1 denotes a driving assistance system, and 2 denotes a server. A plurality of industrial devices, for example, 90A, 90B, and 90C, are connected to the server via a communication line 202. Operational data 101 is transmitted to the driving assistance system 1 via the communication line 202. Note that the server 2 may also be configured on the cloud.
[0014] The driving assistance system 1 exchanges input 102 and output 105 with input / output means 5 via a communication line 201. One of the features of the present invention is that it enables driving management in an interactive format, so 102 mainly takes the form of questions and 105 mainly takes the form of answers.
[0015] A generative AI engine 3 is used to create answers or interpret questions. This may be built into the server 2, or, as shown in Figure 1, a generative AI engine external to the server may be used. In this case, the question sentence 103 is transmitted from the server 2 to the generative AI engine 3 via a communication line 203, and the answer sentence 104 is received from the server 2.
[0016] In this case, there are three communication lines, for example, 210, 202, and 203. This does not mean that these communication lines have the same security measures. However, considering that there are differences in the content of communication, it is desirable that communication line 202, which handles communication between the industrial equipment and the server, has the highest security level.
[0017] This is because the communication line directly transmits data on the operating status of the equipment, including management data directly related to company management, such as production status and production busyness within the factory. For this reason, it is desirable to use a dedicated line that is not connected to the outside world, or to apply dedicated encryption, etc.
[0018] Of course, this does not mean that the security level of other communication lines can be low, but when considering the balance with cost, the range of security measures used for normal Internet lines is practically appropriate.
[0019] It should be noted that throughout this specification, the multiple pieces of industrial equipment do not necessarily have to be the same type of industrial equipment, such as compressors. The present invention is also applicable to a mixture of different types of industrial equipment, such as an air compressor 90A, an inkjet printer 90B, and a pump 90C. While a mixture of such multiple types of industrial equipment traditionally required skilled personnel for operational management, the present invention is characterized by and has a major advantage in that it enables even non-skilled personnel to efficiently manage operations, even in such an environment.
[0020] Therefore, the target industrial equipment is not particularly limited, but it can be applied to a wide range of industrial equipment, such as air compressors, inkjet printers, pumps, air purifying equipment, transport equipment such as hoists, power receiving and transforming equipment, etc. Furthermore, this operation support system is extremely well suited for application to remote monitoring services, maintenance services, etc.
[0021] FIG. 2 is a diagram showing a more detailed configuration example of the present invention based on FIG.
[0022] Communication between the server 2 and the input / output means 5 is shown in a bidirectional format as 110. Communication between the industrial devices 90A, 90B, 90C and the server 2 is shown in a bidirectional format as 111. However, this does not exclude the case of one-way communication from the industrial devices to the server 2.
[0023] Two-way communication 112 is established between the server 2 and the generation AI engine 3 .
[0024] 4 is a speech synthesis engine. In the present invention, the use of a speech synthesis engine is not essential, and questions and answers can also be answered by inputting and outputting text information. However, considering the convenience of the operations manager, allowing answers by voice reduces the impression that the operations manager has of monotonous work, contributing to an improvement in the working environment of operations managers and leading to increased motivation for work among inexperienced operations managers. Examples of operations managers include users of industrial machinery or employees of companies that maintain industrial machinery.
[0025] The speech synthesis engine 4 is bidirectionally connected to the server 2 via a communication line 203 and two-way communication 113. In FIG. 2, the generative AI engine 3 and speech synthesis engine 4 are shown as being located outside the server 2, i.e., on a different server or cloud. This is because it is intended to utilize the resources of external service providers that are more focused on the generative AI engine and speech synthesis engine. This makes it possible to more efficiently utilize development resources for the industrial equipment operation assistance system.
[0026] Of course, this does not preclude the possibility of these being implemented on the same server. Figure 4 shows an example in which the generation AI engine 3 and the speech synthesis engine 4 are configured on the same server 2. Alternatively, only one of them, for example, only the speech synthesis engine 4, may be configured on the same server 2.
[0027] Returning to Figure 2, we continue the explanation.
[0028] 10 is the server's CPU, which includes virtualized CPUs and computing means.
[0029] The CPU 10 executes a control agent 12 and device agents 13. A major feature of the present invention is that the agents are divided into at least two stages in this way.
[0030] The inventors of this application, who have studied the application of AI to the operation management of industrial equipment, have found that when a single agent is used to dialogue with and respond to operations managers and grasp the status of industrial equipment, the following problem occurs: The agent has to process a huge number of objects, and the questions of the operations manager are buried in the huge amount of data on operation information from the industrial equipment, making it impossible to provide an appropriate answer or response.
[0031] Absolute reliability is required when applying AI to operation assistance systems for industrial equipment. Hallucination, a phenomenon currently recognized as a major issue with generative AI (where an AI responds as if something that is not true were true), could potentially lead to a major accident if it occurs in an operation assistance system for industrial equipment.
[0032] The inventors of the present application have intensively researched methods for reliably avoiding halucation when using AI in an operation support system for industrial equipment. As a result, they have come to the realization that, in order to be able to subdivide the dialogue with the operation manager and limit the content of the dialogue, when using AI in an operation support system for industrial equipment, it is important to divide the AI into multiple parts.
[0033] Therefore, in this invention, by dividing the AI into multiple AIs, namely, a control agent and equipment agents, it is possible to avoid halcyonosis and realize a highly reliable operation support system for industrial equipment.
[0034] At the same time, this configuration also clarifies the procedure for the operation manager to ask questions to the operation support system, making it possible for even non-expert operation managers to handle the system.
[0035] An example of the configuration at this time can be expressed as follows, for example.
[0036] In industrial equipment operation support systems, It has a server that can access information about multiple industrial devices, the server has a control agent and device agents that generate answers to questions received through an input means; The control agent receives only a portion of the information about the plurality of industrial devices for each of the plurality of industrial devices, An industrial equipment operation support system, wherein the equipment agent receives input of information about only some of the plurality of industrial equipment.
[0037] Alternatively, it can be expressed as follows:
[0038] In industrial equipment operation support systems, It has a server that can access information about multiple industrial devices, the server has a control agent and device agents that generate answers to questions received through an input means; the control agent generates a response that identifies which of the plurality of industrial devices satisfies the conditions of the question; The equipment agent generates a response regarding the corresponding individual equipment.
[0039] An example of the specific dialogue between the operation manager and the industrial equipment operation support system is as follows: These may also be called prompts.
[0040] The following is an example of an operation support system that manages multiple compressors as industrial equipment. Naturally, the response text will differ depending on the connected device.
[0041] (Question 1) Who are you?
[0042] This is an example of a question for identifying the dialogue target. By identifying and confirming the dialogue target, this question serves as a fail-safe measure to avoid sending erroneous instructions or questions to another system.
[0043] (Answer 1) I am an operation support system that manages compressors.
[0044] In this case, it is desirable to give the driver assistance system a more specific name. This is because it makes it easier for the driver management to recognize the system, and it is expected that the driver management will feel a sense of familiarity with the system and become more enthusiastic about their work. For example, a name such as "Aias" (meaning "I" or "we") would be appropriate.
[0045] (Question 2) Please tell me the operating status of the compressor.
[0046] In this case, if multiple types of industrial equipment are connected, you can also use a question such as "Please tell me the operating status of the industrial equipment." Alternatively, if you want to know the status of a specific type of industrial equipment, you can use a question that includes the name of the specific industrial equipment, as in Question 2.
[0047] (Answer 2) There is a malfunction in Unit 1. There are signs of an abnormal discharge temperature in Unit 2. Unit 3 is operating normally.
[0048] In this way, the control agent is specialized in receiving and answering questions about the general situation. This eliminates ambiguous interpretations of the questions and enables accurate answers. In the above example, the units are numbered 1, 2, and 3, but to ensure that the target equipment can be identified later on-site, it may be set to specify more detail, such as compressor serial number U1234567.
[0049] (Question 3) I want to talk to Unit 2.
[0050] Here, by inputting the question, the dialogue shifts from the control agent to the appliance agent. In other words, the conversation target is handed over from the control agent to the appliance agent.
[0051] (Answer 3) I am compressor number 2.
[0052] The control agent declares that the dialogue has been transferred to the device agent.
[0053] (Question 4) What causes abnormal discharge temperature?
[0054] (Answer 4) This is caused by factors such as an increase in ambient temperature.
[0055] The equipment agent 13 examines the cause of the abnormality or the signs of such abnormality from the operation data of the equipment, etc., and responds to the operation manager. In this case, it is necessary to install an equipment diagnostic engine 14 on the server 2 or in cooperation with an external service. This equipment diagnostic engine uses operation information from industrial equipment and devices to output diagnostic information on failures, alarms, and their signs, and provides this diagnostic information to the equipment agent 13 or the control agent 12.
[0056] Furthermore, the device diagnosis engine 14 may have a predictive diagnostic engine or the like installed inside or outside it, and may perform device diagnosis in cooperation with it. Alternatively, the device diagnosis engine itself may be capable of determining failures, alarms, and their predictive signs.
[0057] (Question 5) Please tell me how to deal with rising ambient temperatures.
[0058] This is a sentence asking for a solution, so it would be better to be more direct and say, "Please tell me the solution," or "Please tell me the solution." One of the advantages of using AI is that it can handle even ambiguous expressions.
[0059] (Answer 5) Please ventilate the room so that the ambient temperature remains below 45 degrees.
[0060] This provides a specific response. At this time, the driving assistance system 1 has instruction manuals, operation manuals, etc. stored in a database 17. For example, this takes the form of a manual database 18. The equipment agent refers to this manual database, considers and presents corresponding solutions.
[0061] As described above, the process is to first grasp the general situation through dialogue with the control agent, and then to discuss the detailed situation and solutions through dialogue with the device agents.
[0062] In this way, repeated dialogue makes it possible to understand the operating status of equipment and how to respond when an abnormality occurs. Maintenance information can also be included in the scope of understanding.
[0063] Then, based on the failures and warnings and their signs judged by the equipment diagnosis engine 14, the equipment agent 13 prepares the contents of a probable cause or a countermeasure, or both, to be sent to the operation manager.
[0064] In this case, in the present invention, since the equipment agent is specialized in grasping the status of the equipment and deriving solutions, it is possible to preemptively eliminate questions and learning that are unrelated to the operation management of industrial equipment.
[0065] For example, the control agent may declare the end of the conversation by saying, "Such questions are outside the scope of this system," or the equipment agent may declare that it will not respond by saying, "This system cannot answer such questions," or "Such questions are unrelated to this industrial equipment."
[0066] This also eliminates the risk of incorrect information being learned by mistake, making it possible to ensure the reliability of the driving assistance system.
[0067] In this case, the basis for formulating the answer plan is based on pre-verified texts and descriptions in the database 17, such as the manual database 18. In addition, the supplementary learning case database 19 stores only correct case examples for the operation and management of industrial equipment, so random information can be avoided from being learned.
[0068] This makes it possible to avoid the occurrence of halcyonosis in principle, because erroneous or ambiguous information that causes halcyonosis is not accumulated in the first place.
[0069] In this way, the industrial equipment operation support system of the present invention can provide an industrial equipment operation support system that utilizes AI, is highly reliable, avoids the occurrence of halucation, is easy for operation managers to use, and does not require expertise.
[0070] Even if all industrial equipment is operating normally, by changing the question text, it is possible to grasp the lifespan of the equipment and the time until the next maintenance work through questions and answers about the total operating time, for example. Also, for industrial equipment that has consumable parts that have a finite lifespan and need to be replaced at a certain interval, questions and answers about the remaining lifespan and the time until replacement make it possible to plan maintenance and part replacement. In other words, maintenance information can also be provided.
[0071] Returning to FIG. 2 again, the explanation will be continued.
[0072] The learning case database 19 can be constructed by inputting information from an external source, or in the example of Figure 2, a machine learning engine 15 can be installed on the server 2 so that appropriate response cases can be added to the learning case database. This makes operation management easier the longer the system is operated, making it possible to prevent malfunctions before they occur.
[0073] 2 also shows a memory 16. Data being processed by the CPU 10, and various programs such as the control agent 12 and device agents 13 executed by the CPU 10 are actually loaded into this memory 16 and executed by the CPU 10.
[0074] The server 2 utilizes the generation AI engine 3 as necessary when interpreting input between the control agent 12 and the input / output means and creating output statements. Similarly, the equipment agents 13 utilize the generation AI engine 3 as necessary when interpreting input between the control agent 12 and the input / output means and creating output statements. In this case, the generation AI engine is used solely for interpreting sentences and creating natural sentences. The identification of the target model by the control agent 12, and the presentation of problems, probable causes, solutions, etc. by the equipment agents 13, which require precision, are performed solely by a dedicated system of this operation management support system.
[0075] The use of the generative AI engine 3 is strictly limited to the purpose of natural dialogue. In this way, by clearly separating the AI system and the content of use between areas that require precision and others, it is possible to prevent halucation and ensure reliability in operation assistance systems for industrial equipment.
[0076] The dialogue between the input / output means and the server 2 can also be based on character information, such as keyboard input by the operation manager and character display on the output screen.
[0077] As an example, in order to further foster motivation among driving managers and ensure a clear understanding of the situation, the example in Fig. 2 is provided with a text-to-speech engine 11. This allows, for example, a driving manager to speak into a microphone, which the text-to-speech engine 11 converts into text information, allowing a dialogue with a control agent or an equipment agent to begin. This opens the door for people with physical disabilities who have difficulty inputting text information to become driving managers, thereby promoting the respect and utilization of human resources.
[0078] Furthermore, when outputting, in addition to displaying the answer as text information on the display, it is also possible to convert it into audio information through the text-to-speech engine 11 and output the audio from the speaker in the input / output means 5. This also helps to foster motivation in the operation manager, and by changing the tone and volume of the voice depending on the content, it is also possible to add additional information such as the urgency of the response.
[0079] Furthermore, for example, when using many different types of industrial equipment, by using different tones of voice for each piece of industrial equipment, such as high or low tones, or a male or female voice, the operations manager can more intuitively grasp the target. In this case, the target equipment group can be grasped using both text information and audio information, providing the effect of a double-check function.
[0080] Of course, when a plurality of compressors are targeted, the audio may be different for each of the compressors.
[0081] The voices to be made different can be used for the control agent 12 and the device agents 13. For example, different tones can be used for the control agent 12 and the device agents 13.
[0082] The conversion of speech to text or text to speech in the text-to-speech engine can be performed by a dedicated system on the server 2. However, from the perspective of more natural speech, as shown in Figure 2, by linking with the speech synthesis engine 4 and forming the waveform of the speech output, it becomes possible to make the speech sound more like a conversation with a human, without being aware of the AI.
[0083] Part of the above explanation can be expressed in other words as follows:
[0084] <Part 1> In industrial equipment operation support systems, It has a server that can access information about multiple industrial devices, the server has a control agent and device agents that generate answers to questions received through an input means; The control agent receives only a portion of the information about the plurality of industrial devices for each of the plurality of industrial devices, The equipment agent is an industrial equipment operation support system to which only information on some of the plurality of industrial equipment is input.
[0085] <Part 2> In the operation support system for industrial equipment described in <Item 1>, An operation support system for industrial equipment, wherein input of information to one or both of the control agent and the equipment agents is a prompt.
[0086] <Part 3> In the operation support system for industrial equipment described in <Item 1>, The system for supporting operation of industrial equipment enables the server, upon receiving a request for dialogue with a specific equipment agent from the input means, to start a dialogue between the equipment agent and an operation manager.
[0087] <Part 4> In the operation support system for industrial equipment described in <Item 3>, When the server receives an inquiry from an operation manager to check the status of a specific equipment agent, it causes the equipment agent to create a response regarding the operation status of the corresponding industrial equipment and responds to the operation manager.
[0088] <Part 5> In the operation support system for industrial equipment described in <Item 4>, An operation support system for industrial equipment, wherein the operating status includes signs of failure or warning or maintenance information.
[0089] <Part 6> In the operation support system for industrial equipment described in <Item 1>, The server receives questions from an operation manager about countermeasures, and has the equipment agent create a response to the estimated cause or a response to the countermeasures, and responds to the operation manager.
[0090] <Part 7> In the operation support system for industrial equipment described in <Item 1>, the server has a device diagnostic engine; The equipment diagnostic engine uses operation information from the industrial equipment to output diagnostic information on failures, alarms, and their precursors, and inputs the diagnostic information to the control agent or the equipment agent.
[0091] <Part 8> In the operation support system for industrial equipment described in <No. 7>, The server has an instruction manual database, The equipment agent is an industrial equipment operation support system that creates a response to the operation manager regarding estimated causes or countermeasures based on the contents of the instruction manual database and the judgment of failures, alarms, and their precursors by the equipment diagnostic engine.
[0092] <No. 9> In the industrial equipment operation support system according to any one of <Item 1> to <Item 8>, The server works with an internal or external generative AI engine, An industrial equipment operation support system that interprets questions exchanged between the control agent or the equipment agent and an operation manager, and creates answers to the operation manager.
[0093] <Part 10> In the operation support system for industrial equipment described in <Item 4>, The server works with an internal or external speech synthesis engine, An industrial equipment operation support system that converts into voice responses from the control agent or the equipment agent to the operation manager.
[0094] <Part 11> In the operation support system for industrial equipment described in <No. 8>, The server is an industrial equipment operation support system that has a machine learning engine and accumulates corresponding cases in a learning case database.
[0095] <Part 12> In the operation support system for industrial equipment described in <Item 10>, The voice conversion is an industrial equipment operation support system that uses different tones for the control agent and the equipment agent.
[0096] <Part 13> In the case of the industrial equipment operation support system, An operation assistance system for industrial equipment in which the level of security of communication between the server and the industrial equipment is higher than that of communication between the server and the input means and output means, and communication between the server and the generating AI engine.
[0097] <Part 16> In the operation support system for industrial equipment described in <Item 11>, The machine learning engine is an industrial equipment operation support system that learns only about events related to industrial equipment.
[0098] <Part 17> In industrial equipment operation support systems, It has a server that can access information about multiple industrial devices, the server has a control agent and device agents that generate answers to questions received through an input means; the control agent generates a response that identifies which of the plurality of industrial devices satisfies the conditions of the question; The equipment agent generates a response regarding the corresponding individual equipment. [Example]
[0099] This embodiment is basically the same as the first embodiment and Fig. 2. The differences will be explained below with reference to Fig. 3.
[0100] In this embodiment, a maintenance terminal 50 is provided. This maintenance terminal performs two-way communication 120 with the server 2 of the driving assistance system 1 through a communication line 202. The maintenance terminal 50 is a terminal different from the input / output means 5, such as a tablet or a PC installed in a factory. The maintenance terminal 50 can also be provided integrally with the industrial equipment 90A, 90B, 90C, etc.
[0101] As a result, if the operations manager becomes aware of an abnormality or detects signs of an abnormality through dialogue between the operations manager and the control agent 12 and the equipment agent 13, he or she can instruct factory workers and maintenance personnel to carry out maintenance or repair work via the operations support system 1.
[0102] In this case, as one embodiment, a response decision engine 20 can be provided in the server 2. This is an engine that is responsible for making the final decision on the response work and issuing detailed instructions in a situation where the driving assistance system 1 is to be entrusted with the decision and instructions.
[0103] Reference numeral 51 denotes a parts supplier. In this example, the driving assistance system 1 sends an order to the parts supplier 51 via a communication line 201 to order and arrange for the parts required for the response. Note that although the figure refers to a parts supplier, this also includes cases where the parts are in stock in a factory or warehouse, or in stock at another factory.
[0104] An example of the flow of driving assistance performed by the driving assistance system of the present invention will be described below in conjunction with the first embodiment using the flowchart of FIG.
[0105] In step S01, the driving assistance system starts a dialogue between the driving manager and the driving assistance system. At this time, as described in the first embodiment, it is desirable to first accept a question input to identify the system with which the dialogue will be held, and then present the answer to the driving manager.
[0106] In S02, the driving assistance system accepts an inquiry input about the driving situation as a character input or a voice input from the input / output means 5 shown in FIG.
[0107] In S03, the driving assistance system outputs a response regarding the driving situation, either as text information on a display, as voice, or as both, via the input / output means 5 shown in Fig. 2 or 3.
[0108] In S04, the driving assistance system receives an input of an inquiry about the status of a specific machine. Here, the conversation target shifts from the control agent 12 in Fig. 2 or 3 to the device agent 13 for the specific machine that has been inquired about.
[0109] In S05, the driving assistance system outputs a response about the specific machine's situation. The output text is created mainly by the machine agent 13.
[0110] Here, an example of a display screen using a web browser, which is one form of the input / output means 5 of the present invention, will be described with reference to FIG.
[0111] 60 is a display screen, which is part of the web browser area. Of course, this does not exclude the use of a dedicated screen.
[0112] Reference numeral 61 denotes a dialogue log screen. When the driver inputs a question in the input area 62, the answer to that question is displayed in text on the log screen 61, and is added to the previous dialogue content.
[0113] A button 63 is for selecting a new conversation. Clicking this button resets the log screen 61, and a new conversation, such as a question or answer, can be started.
[0114] Reference numeral 64 denotes a selection field on the maintenance terminal side that determines whether or not to permit operation of the operation assistance system. As with the maintenance terminal 50 in Figure 3, it is desirable that on-site workers and maintenance personnel, in addition to the operation manager, can also access the operation assistance system to facilitate operation assistance and, particularly, to implement countermeasures for abnormalities and their precursors. However, if unlimited access or unlimited questions are required, there is a concern that inappropriate information may be learned, increasing the risk of halucation.
[0115] Therefore, by allowing the operation manager to select whether to avoid operations on the maintenance terminal in 64, it is possible to allow access only when actual work such as maintenance or repairs occurs and access to the operation assistance system from the site is necessary. This not only avoids halucation, but also minimizes security risks and the risk of interference with the operation assistance system that arise from unauthorized access to the maintenance terminal.
[0116] 66 is a switch for turning the audio mode on and off.
[0117] As mentioned above, there are advantages to using voice when a driver manager interacts with a driver assistance system. However, for example, if an emergency situation occurs and the surrounding area is noisy, using voice can lead to entering the wrong question, the question not being recognized correctly, or the voice response making the noise worse and hindering the situation from being resolved. In such cases, by selectively turning off the voice mode, i.e., by not using voice and responding only with text information, the driver assistance system can be used effectively even in an emergency.
[0118] 65 is the ON / OFF selection field for automatic response. In the operation support of industrial equipment, there are usually few situations in which unexpected abnormality signs are detected. Rather, it is thought that it is more common to detect and report the arrival of part replacement work due to the end of the lifespan of periodic parts, or adjustments to operating parameters or ambient temperature by operating an air conditioner. For such signs and abnormalities where the response policy has been firmly determined in advance, there are many situations in which the operation support system can automatically determine the response policy and take action, without the operation manager having to make a decision each time.
[0119] 65 is an area for selecting whether to allow the driving assistance system to respond automatically. If ON is selected here, the driving assistance system will automatically respond to abnormal signs that can be dealt with as necessary and routinely without the intervention of the driving manager.
[0120] This automatic response may be set to be always enabled when ON is selected in 65 while the driving assistance system is in operation. Also, in the flowchart of Fig. 5, the ON / OFF of the automatic countermeasure mode is determined after proceeding to S05, which is the output of the situation response of the specific machine, but the position of this determination in the flowchart is not limited to this.
[0121] Returning to the flowchart of FIG. 5, the explanation will be continued.
[0122] In S06, the driving assistance system determines whether the automatic countermeasure mode is ON. If NO, that is, if the driving manager has not authorized the driving assistance system to take automatic countermeasures, the process proceeds to S07.
[0123] In S07, the driving assistance system receives an inquiry input regarding countermeasures from the driving manager.
[0124] In S08, the driving assistance system outputs a response regarding countermeasures to the driving manager.
[0125] Furthermore, through subsequent dialogue, the operation assistance system receives instructions on how to respond to the actual abnormality signs according to the content of the dialogue, and transmits detailed responses to each location. At that time, for example, if it is necessary to order parts or replacement parts, an order can be placed with the parts supplier 51 via 121 in FIG. 3. Furthermore, if on-site work is required, instructions on the work content and adjustments can be given to the maintenance terminal 50 via 120 in FIG. 3. Furthermore, if it is necessary to adjust the operating parameters of the industrial equipment 90A, 90B, 90C, etc., it is also possible to receive instructions from the operation manager and directly control the parameters of the industrial equipment via 111.
[0126] An example in which the automatic countermeasure mode is ON will be explained in the branch from S06.
[0127] In S11, it is determined whether or not a response is necessary. If there are no signs of an abnormality, or if signs of an abnormality are detected but are not yet at a level where countermeasures are necessary, the determination in S11 will be NO, and the flow chart will loop and return to the previous response process.
[0128] In the example of FIG. 3, such a determination is made by a response determination engine 20 deployed on the server 2.
[0129] If it is determined that a response is necessary, a countermeasure is considered in S12. This is also performed by the response determination engine 20.
[0130] Next, it is determined in S13 whether additional parts are required and whether parts need to be procured. Even if a part needs to be replaced, if the part is in stock, it is determined that there is no need to procur an additional part.
[0131] If it is determined that additional parts are not required, instructions are given in S14. As explained in FIG. 3, the operation assistance system 1 displays the details of the response, work, or replacement on the maintenance terminal 50, and instructs the site on specific measures to take. Note that if the target industrial equipment is compatible with replacement or adjustment work performed by a robot or automatic work machine, instructions may be given to the robot or automatic work machine. In this case, the work details may be directly communicated without using text or voice.
[0132] If it is determined in S13 that additional parts are required, an order for the parts is placed in S15. Explained with reference to FIG. 3, this involves issuing a procurement instruction to the parts supplier 51 via 121. This may also include ordering work. In addition, if parts are in stock at another factory of the company, it may also include an instruction to source parts from there.
[0133] 3 shows the generation AI engine 3 and speech synthesis engine 4 configured outside the server 2, i.e., on a different server or a different cloud. However, the location of the generation AI engine or speech synthesis engine is not essential to the present invention. Therefore, the present invention also includes those realized by a different CPU 30 or CPU 10 on the same server 2 or the same cloud, as shown in FIG. 4.
[0134] In Example 1, an example of the technical idea of the present invention was explained from <No. 1> to <No. 14>. Based on the configuration disclosed in this example, additional technical ideas will be explained as follows.
[0135] <Part 14> In the operation support system for industrial equipment described in <Item 4>, When the automatic response mode is selected, the server determines whether any of the multiple pieces of industrial equipment requires response, and if response is required, determines whether additional parts need to be arranged, and if additional parts are not required, gives instructions to workers to respond or adjusts the operating parameters of the industrial equipment, and if additional parts are required, arranges for the parts, in an industrial equipment operation support system.
[0136] <Part 15> In the operation support system for industrial equipment described in <No. 8>, The server is an industrial equipment operation support system that can switch between issuing instructions to the control agent from a maintenance worker terminal or each piece of industrial equipment. [Example]
[0137] The basic concept of this embodiment is the same as that of the first and second embodiments. Here, the first and second embodiments are explained with a focus on the hardware configuration or the function engine realized on the hardware. In contrast, the present embodiment explains an embodiment of the technical idea of the present invention with a focus on the flow of data processing.
[0138] This will be explained using Figure 7.
[0139] Reference numeral 500 denotes a user terminal. Reference numeral 510 denotes a microphone as an input device, 511 denotes a keyboard as an input device, 512 denotes a display as a character / text output device, and 513 denotes a speaker as an audio output device.
[0140] Reference numeral 514 denotes a user interface. It accepts text input 515 from a keyboard 511. This may be a question from the operation manager. It may also accept voice input from a microphone 510 and convert this into text.
[0141] 600 is an operation support system for industrial equipment. The hardware is configured on a server or on the cloud.
[0142] 601 is a master system, which corresponds to the control agent or a part of it.
[0143] The text input 515 is input to the input reception 602 as user utterance text 800. 603 is a generation AI calling unit. In response to the input content, the user utterance text 801 is transmitted to the generation AI prompt generation process 612, and a response is made by the control agent or the device agent.
[0144] 700 is a generative AI service. Because there are already many commercial services available, using an external generative AI service is more efficient and allows for proactive dialogue when creating natural-sounding dialogue.
[0145] Reference numeral 830 denotes a prompt input to the AI generation engine 701 from the AI prompt generation process.
[0146] 831 is the generated AI utterance text sent from the generated AI engine 701 to the generated AI prompt generation process 612.
[0147] From 612, the generated AI speech text 802 is input to the generated AI calling unit 603 as a response.
[0148] When using voice, the generated AI spoken text is transmitted from 603 to the voice synthesis calling unit 604. When not using voice, 604 is skipped and the text is transmitted directly to the output management unit 605.
[0149] The speech synthesis call unit 604 passes the generated AI spoken text 806 to the speech synthesis interface 615 .
[0150] The speech synthesis interface 615 interacts with the speech synthesis engine 702 to generate synthetic speech.
[0151] The generated synthetic speech 805 is output as a speech log 616 in the form of synthetic speech 807 through speech playback processing 519 and output as speech by speaker 513 .
[0152] The output management unit 605 described above transmits the generated AI utterance text 808 as display data 517, which is displayed, for example, in a corresponding area of a web browser using the display 512.
[0153] Furthermore, the output management unit stores a conversation log as a chat log 617, which is referenced and used to display past logs when an instruction to call up the log is received from the user interface 514.
[0154] In particular, the AI prompt generation process 612 involves the equipment management agent inferring the occurrence of an abnormality or signs of an abnormality based on the input operation data 610 of each piece of industrial equipment in the specific AI inference unit 611, and transmitting the sign diagnosis judgment result 803 to the AI prompt generation process 612.
[0155] In particular, the crisis management agent evaluates the correlation with the current event, the degree of matching, etc. in the vector database 613 based on the instruction manual text and past cases 614, and passes appropriate countermeasures to the AI prompt generation process 612.
[0156] Note that 804 is RAG (Retrieval-Augmented Generation). This process retrieves facts from a database of information, knowledge, case studies, etc., and has the generation AI create an answer based on accurate information. The device agent creates an answer in cooperation with the generation AI prompt generation process, while referencing the vector database 613, instruction manual text 614, etc. At this time, cooperation with the generation AI engine 701 is also performed in order to create natural-sounding answer sentences.
[0157] In the above, the present embodiment has been described as an example of the technical concept of the present invention, focusing on the flow of data processing. However, as long as the technical concept disclosed throughout this specification is used, even if the details of the description in this embodiment differ from those in part of the configuration or the order of the configuration, it is still within the scope of the disclosure of this embodiment.
[0158] Furthermore, as long as the technical concepts detailed in the above-described embodiments are applied, modifications and slight differences in construction are also included within the scope of the present invention.
[0159] Furthermore, although this specification was written primarily with industrial equipment operation assistance systems in mind, the methodology for avoiding halucation in fields requiring high reliability in AI may also be applicable to other fields. Therefore, as long as at least a portion of the technical ideas disclosed in this specification is used, and if that technical idea is independently patentable, even if it is applied to something other than industrial equipment, it is within the scope of the present invention and may be claimed as a right.
[0160] Possible examples include operation management of railways, public transport, commercial vehicles, aircraft, etc.; maintenance management of power transmission and distribution systems; operational support for power generation systems that parallel multiple power generation sources such as solar and wind power; and production management support for production systems such as factories.
[0161] In addition, the term "driving manager" in this specification is used in a broad sense to refer to any person whose job requires him or her to ask and answer questions to the driving assistance system. [Example]
[0162] This embodiment is basically the same as the first embodiment and FIG.
[0163] This embodiment is characterized in that a function for calling a generation AI is provided to the industrial equipment described in the first and second embodiments. An example will be described below with reference to FIG.
[0164] In Fig. 8, 301 denotes industrial equipment, which corresponds to 90A, 90B, 90C, etc. in Fig. 1 and Fig. 2. All of these industrial equipment may have the configuration described below. In addition, cases where only some of 90A, 90B, 90C, etc. have the configuration described below are also included in the scope of this embodiment.
[0165] The industrial equipment 301 is characterized by having a function for calling a generated AI. Specifically, it is characterized by having a generated AI call button 302. Note that the generated AI call button 302 may be a physical button or a virtual button.
[0166] For example, the operation manager can speak a specific word that serves as a wake word, such as "tell me about the compressor," and the control unit 303 can recognize this speech to replace the generated AI call button. Also, codes containing connection destination information, such as two-dimensional or three-dimensional codes affixed to the industrial equipment 301, can be read by the operation manager's smartphone, tablet, or the like to replace the generated AI call button.
[0167] The two-dimensional or three-dimensional code may be attached nearby rather than directly to the industrial equipment 301. The industrial equipment 301 may be a crane or hoist for transportation, and in such cases may be installed at a high place. In this situation, by attaching the two-dimensional or three-dimensional code nearby rather than directly to the industrial equipment 301, the operation manager can communicate with the operation assistance system 1 without having to go to the trouble of climbing up to a high place. This has the effect of ensuring the safety of the operation manager and enabling safe communication with the operation assistance system 1.
[0168] Furthermore, when an abnormality or a sign of an abnormality occurs in the industrial equipment 301, the control unit 303 can display on the display unit 305 a suggestion to the operation manager to call the operation assistance system 1. In this case, it is desirable that the industrial equipment 301 has a display as the display unit 305, but this does not exclude the use of other means such as a lamp or audio communication means.
[0169] This allows the operation manager to issue instructions to the operation support system 1 at the necessary timing, which has the effect of reducing downtime of the industrial equipment 301 by performing appropriate maintenance of the industrial equipment 301.
[0170] Furthermore, when the industrial equipment 301 is equipped with an image recognition means such as a camera, instructions can be given by detecting the motion of the operation manager's hand signals or movements.
[0171] When the control unit 303 detects that the generation AI call button 302 has been pressed, it displays a two-dimensional or three-dimensional code on the display unit 305. The control unit 303 acquires the two-dimensional or three-dimensional code data from the server 2 via the communication unit 304. The driving manager can interact with the driving assistance system 1 by reading the two-dimensional or three-dimensional code with a smartphone, tablet device, or the like.
[0172] That is, by reading the two-dimensional or three-dimensional code, it is possible to access the web page on which the driving assistance system 1 operates.
[0173] The industrial equipment 301 may be a small air compressor, a crane or a hoist for transportation, and in such cases may be installed at foot or in a high place. In such cases, by using a smartphone or tablet device of the operation manager at hand to interact with the operation assistance system 1, it is possible to have the effect of interacting with the operation assistance system 1 in a natural posture even if the industrial equipment 301 is installed in a place that is difficult to access.
[0174] It goes without saying that the industrial equipment 301 can be provided with a keyboard so that the operation manager can use the keyboard as an input means and the display unit 305 as an output means, which together form the input / output means 5. In this way, it becomes unnecessary for the operation manager to own a smartphone, and the operation assistance system 1 can be used easily.
[0175] Furthermore, it goes without saying that a microphone and speaker provided in the industrial equipment 301 can be used as the input / output means 5. In this case, the voice picked up by the microphone is converted into text by voice recognition and input to the operation assistance system 1. By performing voice dialogue in this way, it becomes unnecessary for the operation manager to prepare a smartphone, and furthermore, it becomes unnecessary to install a keyboard on the industrial equipment 301. In this case, it becomes possible to easily use the operation assistance system 1, and there is an effect that the industrial equipment 301 can be made smaller.
[0176] It is desirable that the server 2 described in Figures 1 and 2 be controlled so that the operations manager can interact with the equipment agent 13 of the industrial equipment 301. In this way, it is possible to provide a dialogue that meets the operations manager's expectations. In addition, by configuring the dialogue so that it can be intuitively understood by the operations manager, it is possible to reduce the learning cost required for the operations manager to be able to use the operations assistance system 1.
[0177] When the driving manager issues an instruction to switch to the control agent, the driving manager becomes able to converse with the control agent 12. One example of a method of issuing an instruction is for the driving manager to input a sentence such as "I want to talk to the control agent" into a smartphone or tablet device, which is the input / output means 5 in this embodiment. Note that a similar switching instruction may also be issued by voice input or GUI.
[0178] It is desirable that the control agent 12 has shallow information about a plurality of industrial devices 301. On the other hand, it is desirable that the device agents 13 have deep information about individual industrial devices 301.
[0179] The control agent 12 limits information to shallow information, allowing the operation manager to know the operating status of each piece of equipment in short sentences. On the other hand, the equipment agent 13 has deep information, allowing the operation manager to obtain a wide range of information about the equipment.
[0180] Specifically, the knowledge that the control agent 12 should have is preferably product instruction manuals, information on alarms and malfunctions (abnormality information) of the multiple industrial devices 301, and information on the presence or absence of signs of abnormality.
[0181] On the other hand, it is desirable that the device agent 13 has the product's instruction manual, operation data for the industrial device 301 that the device agent 13 is responsible for, and information on whether or not there are any signs of anomalies. The operation data includes the presence or absence of anomalies and their types, as well as regularly transmitted data. The regularly transmitted data includes the discharge temperature, discharge pressure, and ambient temperature for a compressor, the remaining ink level and ambient temperature for an industrial inkjet printer, and the current value and ambient temperature for a water supply pump. It is desirable that this data be acquired periodically, such as every 30 minutes, and transmitted to the server 2.
[0182] Here, it is desirable to perform statistical processing on the scheduled transmission data in the generation AI prompt generation process 612 in Figure 7 before inputting it into the generation AI engine 701. Statistical processing involves averaging and determining maximum, minimum, and median values. It is also desirable to tally the compressor load factor only when the compressor is in a loaded state (when compressed air is being sent out).
[0183] By performing statistical processing, it is possible to reduce the number of characters input to the generative AI engine 701, thereby obtaining a more accurate answer. The generative AI is limited in the number of characters that can be input, and can only handle input of, for example, about 30,000 characters. This is because it is known that the accuracy of the answer decreases as the number of input characters increases.
[0184] The operations manager can grasp the operating status of the industrial equipment 301 by interacting with the equipment agent 13. Furthermore, by switching to the control agent 12 and interacting, the operations manager can grasp the operating status of multiple pieces of industrial equipment 301 managed by the operations manager in a short time. Furthermore, even if not all of the industrial equipment 301 managed by the operations manager is compatible with the operation assistance system 1, as long as at least one piece of industrial equipment is compatible, the operations manager can grasp the operating status of the other pieces of industrial equipment 301 through interaction with the control agent 12.
[0185] As described above, by providing the generated AI call button 302 on the industrial equipment 301, the operation manager can intuitively and quickly call up the operation assistance system 1 when he or she wants to interact with the operation assistance system 1, which has the effect of making it easier to receive assistance from the operation assistance system 1.
[0186] It is more desirable to be able to interact with other industrial equipment 301 in addition to the equipment agent 13 in charge of the industrial equipment 301 having the generated AI call button 302 .
[0187] Here, an example will be described in which the serial number of the industrial equipment 301 having the generation AI call button 302 is A, and the serial number of the other industrial equipment 301 is B. For example, an operations manager can enter a sentence such as "I would like to talk to the equipment agent with serial number B" into a smartphone or tablet device, thereby interacting with the other industrial equipment 301. In this way, the operations manager can obtain detailed information about the industrial equipment 301 with serial number B without having to go from in front of the industrial equipment 301 with serial number A to in front of the industrial equipment 301 with serial number B.
[0188] To reiterate, as long as the technical concepts detailed in the above-described embodiments are applied, modifications and slight differences in structure are also included within the scope of the present invention. [Explanation of symbols]
[0189] 1: Driving assistance system 2: Server 3: Generative AI engine 4: Speech synthesis engine 5: Input / output means 10:CPU 11: Text-to-speech engine 12: Supervising Agent 13: Device Agent 14: Equipment diagnostic engine 15: Machine learning engine 16: Memory 17: Database 18: Manual database 19: Learning example database 20: Response decision engine 50: Maintenance terminal 51: Parts supplier 60:Display screen 61: Log screen of conversation contents 62: Input area 63: New dialogue selection button 64: Maintenance terminal operation availability selection area 65: Automatic response selection area 66: Audio mode selection area 90A, 90B, 90C, 301: Industrial equipment 201, 202, 203: communication lines 302: Generated AI call button 303: Control unit 304: Communications Department 305: Display section
Claims
1. In industrial equipment operation support systems, It has a server that can access information about multiple industrial devices, the server has a control agent and device agents that generate answers to questions received through an input means; The control agent receives only a portion of the information about the plurality of industrial devices for each of the plurality of industrial devices, The equipment agent is an industrial equipment operation support system to which only information on some of the plurality of industrial equipment is input.
2. 2. The industrial equipment operation support system according to claim 1, An operation support system for industrial equipment, wherein input of information to one or both of the control agent and the equipment agents is a prompt.
3. 2. The industrial equipment operation support system according to claim 1, The system for supporting operation of industrial equipment enables the server, upon receiving a request for dialogue with a specific equipment agent from the input means, to start a dialogue between the equipment agent and an operation manager.
4. 4. The industrial equipment operation support system according to claim 3, When the server receives an inquiry from an operation manager to check the status of a specific equipment agent, it causes the equipment agent to create a response regarding the operation status of the corresponding industrial equipment and responds to the operation manager.
5. 5. The industrial equipment operation support system according to claim 4, An operation support system for industrial equipment, wherein the operating status includes signs of failure or warning or maintenance information.
6. 2. The industrial equipment operation support system according to claim 1, The server receives questions from an operation manager about countermeasures, and has the equipment agent create a response to the estimated cause or a response to the countermeasures, and responds to the operation manager.
7. 2. The industrial equipment operation support system according to claim 1, the server has a device diagnostic engine; The equipment diagnostic engine uses operation information from the industrial equipment to output diagnostic information on failures, alarms, and their precursors, and inputs the diagnostic information to the control agent or the equipment agent.
8. 8. The industrial equipment operation support system according to claim 7, The server has an instruction manual database, The equipment agent is an industrial equipment operation support system that creates a response to the operation manager regarding estimated causes or countermeasures based on the contents of the instruction manual database and the judgment of failures, alarms, and their precursors by the equipment diagnostic engine.
9. 9. The industrial equipment operation support system according to claim 1, The server works with an internal or external generative AI engine, An industrial equipment operation support system that interprets questions exchanged between the control agent or the equipment agent and an operation manager, and creates answers to the operation manager.
10. 5. The industrial equipment operation support system according to claim 4, The server works with an internal or external speech synthesis engine, An industrial equipment operation support system that converts into voice responses from the control agent or the equipment agent to the operation manager.
11. 9. The industrial equipment operation support system according to claim 8, The server is an industrial equipment operation support system that has a machine learning engine and accumulates corresponding cases in a learning case database.
12. 11. The industrial equipment operation support system according to claim 10, The voice conversion is an industrial equipment operation support system that uses different tones for the control agent and the equipment agent.
13. 10. The industrial equipment operation support system according to claim 9, An industrial equipment operation assistance system in which the level of security for communication between the server and the industrial equipment is higher than the level of security for communication between the server and the input means and output means, and communication between the server and the generating AI engine.
14. 5. The industrial equipment operation support system according to claim 4, When the automatic response mode is selected, the server determines whether any of the multiple pieces of industrial equipment requires response, and if response is required, determines whether additional parts need to be arranged, and if additional parts are not required, gives instructions to workers to respond or adjusts the operating parameters of the industrial equipment, and if additional parts are required, arranges for the parts, in an industrial equipment operation support system.
15. 9. The industrial equipment operation support system according to claim 8, The server is an industrial equipment operation support system that can switch between issuing instructions to the control agent from a maintenance worker terminal or each piece of industrial equipment.
16. 12. The industrial equipment operation support system according to claim 11, The machine learning engine is an industrial equipment operation support system that learns only about events related to industrial equipment.
17. In industrial equipment operation support systems, It has a server that can access information about multiple industrial devices, the server has a control agent and device agents that generate answers to questions received through an input means; the control agent generates a response that identifies which of the plurality of industrial devices satisfies the conditions of the question; The equipment agent generates a response regarding the corresponding individual equipment.
Citation Information
Patent Citations
Pump device
JP2022098903A