User assistance device, control device, user assistance method, and information processing system

Abstract

A user assistance device according to the present disclosure comprises: an information acquisition unit that acquires device information including at least one among specification information, operation information, and maintenance information pertaining to a device for inquiry; an inquiry acquisition unit that acquires inquiry information including inquiry content represented in a natural language; a prompt generation unit that generates, on the basis of the device information and the inquiry information, a prompt that can be input to an interactive response device; a transmission unit that transmits the prompt to the interactive response device; a reception unit that receives a response from the interactive response device; and an interaction unit that outputs the received response.

Description

User assistance device, control device, user assistance method, and information processing system

[0001] The present disclosure relates to a user assistance device, a control device, a user assistance method, and an information processing system.

[0002] In manufacturing sites such as factories where industrial machinery such as machine tools and robots are installed, when a malfunction occurs in the industrial machinery, it is difficult for users to identify the cause of the malfunction, and so they often inquire with the manufacturer of the industrial machinery. However, responding to all such inquiries on the manufacturer's side consumes excessive man-hours. Also, responses to inquiries may be slow. Furthermore, users tend to be hesitant to seek advice when no malfunction has occurred, making it difficult to perform efficient preventive maintenance. Given the demand for working while consulting with experts rather than investigating on their own, a solution using an interactive response device (AI assistant) that allows users to make inquiries in natural language is desired.

[0003] In manufacturing sites and the like, a function to assist users in making inquiries about equipment is desired. To use a general interactive response device, the user must input information such as the specifications and operating status of the industrial machinery using text or images. This places a heavy burden on the user. An object of the present disclosure is to provide a technology for acquiring information about the equipment to be queried and making an inquiry to the interactive response device.

[0004] The user assistance device according to the present disclosure solves the above problem by including information related to the device that is required when making a query to the interactive response device.

[0005] One aspect of the present disclosure is a user assistance device that includes an information acquisition unit that acquires device information including at least one of specification information, operation information, and maintenance information related to the device that is the subject of an inquiry; a query acquisition unit that acquires query information including query content expressed in natural language; a prompt generation unit that generates a prompt that can be input to an interactive response device based on the device information and the inquiry information; a transmission unit that transmits the prompt to the interactive response device; a reception unit that receives a response from the interactive response device; and an interaction unit that outputs the received response.

[0006] [Correction based on Rule 91 28.10.2025] Fig. 1 is a schematic hardware configuration diagram of a user assistance device according to an embodiment of the present disclosure. Fig. 2 is a block diagram showing the schematic functions of a user assistance device according to a first embodiment. Fig. 3 is a schematic diagram showing an example of a plurality of templates stored in a template storage unit. Fig. 4 is a schematic diagram showing an example of a prompt generated using a template. Fig. 5 is a screen diagram showing an example of a screen displayed by an interaction unit for accepting an evaluation of a user's response as feedback information. Fig. 6 is a screen diagram showing an example of a repeated inquiry screen displayed by an interaction unit. Fig. 7 is a block diagram showing the schematic functions of a user assistance device according to a second embodiment. Fig. 8 is a schematic diagram showing an example of a response from an interactive response device. Fig. 9 is a table diagram showing examples of operation patterns stored in an operation pattern storage unit. Fig. 10 is a screen diagram showing an example of an operation content selection screen displayed by an interaction unit. Fig. 11 is a block diagram showing the schematic functions of a user assistance device according to a third embodiment. Fig. 12 is a block diagram showing the schematic functions of a user assistance device according to a fourth embodiment. Fig. 13 is a table diagram showing examples of query conditions stored in a query condition storage unit. Fig. 14 is a block diagram showing the schematic functions of a user assistance device according to a fifth embodiment. Fig. 15 is a table diagram showing example user information stored in a user information storage unit.

[0007] [Correction based on Rule 91, 28.10.2025] The following describes embodiments of the present disclosure with reference to the drawings. [First Embodiment] FIG. 1 is a schematic hardware configuration diagram showing the main components of a user assistance device according to one embodiment of the present disclosure. The user assistance device 1 according to this embodiment can be implemented, for example, on a control device that controls industrial machinery such as machine tools and robots based on a control program. It can also be implemented on a personal computer (PC) attached to the control device, or on a computer connected to the control device via a wired or wireless network, such as a cell computer, fog computer 6, or cloud server 7. In this embodiment, an example is shown in which the user assistance device 1 is implemented on a personal computer connected via a network to a control device that controls industrial machinery 4.

[0008] The user assistance device 1 according to this embodiment constitutes an information processing system 300. The information processing system 300 may be composed of the user assistance device 1 and an interactive response device 2. Alternatively, the information processing system 300 may be composed of the user assistance device 1 and a device to be queried. Furthermore, the information processing system may be composed of the user assistance device 1, the interactive response device 2, and a device to be queried. The application of the present disclosure is not limited to manufacturing sites, and the device to be queried may be any "device" for which a user may make an inquiry. The device to be queried may be, for example, an industrial machine 4. Furthermore, the device to be queried may be, for example, any machine, not limited to the industrial machine 4, laboratory equipment, household appliances, portable devices such as laptop PCs and mobile phones, or mobile objects such as automobiles. Furthermore, the user assistance device 1 itself may be configured to accept inquiries.

[0009] The CPU 11 provided in the user assistance device 1 according to this embodiment is a processor that controls the entire user assistance device 1. The CPU 11 reads a system program stored in the ROM 12 via the bus 22 and controls the entire user assistance device 1 in accordance with the system program. The RAM 13 temporarily stores temporary calculation data, display data, and various data acquired from outside.

[0010] The nonvolatile memory 14 may be, for example, a battery-backed memory or a solid-state drive (SSD), not shown, and retains its stored state even when the user assistance device 1 is powered off. The nonvolatile memory 14 stores programs and data read from the external device 72 via the interface 15, programs and data input via the input device 71, and programs and data acquired from the industrial machinery 4 or other devices via the network 5. The stored data may include, for example, information acquired from the industrial machinery 4 regarding its specifications (e.g., model name and number of axes), information regarding the operating status of the industrial machinery 4 (e.g., motor current, voltage, torque, position, speed, and acceleration of the drive unit detected by sensors, vibrations and sounds generated in each part of the industrial machinery 4), and information regarding the maintenance of the industrial machinery 4 (e.g., information regarding past inspections and repairs). The programs and data stored in the nonvolatile memory 14 may be loaded into the RAM 13 during execution or use. The ROM 12 also contains pre-loaded various system programs, such as known analysis programs.

[0011] The interface 15 is an interface for connecting the CPU 11 of the user assistance device 1 to an external device 72 such as a USB device. For example, system programs, setting data, etc. are read from the external device 72. In addition, programs and setting data created and edited within the user assistance device 1 can be stored in external storage means via the external device 72.

[0012] The interface 20 is an interface for connecting the CPU 11 of the user assistance device 1 to a wired or wireless network 5. The network 5 may communicate using technologies such as serial communication such as RS-485, Ethernet (registered trademark), optical communication, wireless LAN, Wi-Fi (registered trademark), Bluetooth (registered trademark), etc. At least one industrial machine 4 to be controlled, at least one other industrial machine 4, an interactive response device 2 functioning as an AI assistant, a fog computer 6, a cloud server 7, etc. are connected to the network 5, and data is exchanged between the network 5 and the user assistance device 1.

[0013] The display device 70 displays various data read into the memory, data obtained as a result of executing programs, etc., output via the interface 17. An input device 71, which is comprised of a keyboard, pointing device, etc., passes instructions, data, etc. based on operations by an operator to the CPU 11 via the interface 18.

[0014] The interactive response device 2 is configured as a device that returns a response sentence in response to a predetermined sentence. The interactive response device 2 includes a large-scale language model (LLM) that has learned a response sentence for the predetermined sentence. This model can be, for example, a Transformer model. When a predetermined sentence is input, the large-scale language model learns text that is highly likely to be an appropriate response to the predetermined sentence. Then, it further learns text that is highly likely to follow that text. By repeating this learning process, the large-scale language model, when input, comes to output a text string that is highly likely to be a response to the predetermined sentence. Depending on how the response sentence to the predetermined sentence is learned in the learning process, the interactive response device 2 can be used for purposes such as dialogue, question and answer session, text summarization, text editing, text translation, text conversion, text modification, text optimization, text interpretation / detection, recognition, prediction, judgment, code generation, image generation, and comprehensive judgment.

[0015] It is assumed that the user assistance device 1 according to the present disclosure is connected via a network 5 to an interactive response device 2 that has learned responses to inquiries based on device information of an industrial machine 4. The learning of the interactive response device 2 uses inquiries and responses created by interviewing experts to learn their knowledge, as well as inquiries and responses exchanged in the past with the help desk of a machine manufacturer or a maintenance company. By narrowing down the information used for learning, it is possible to prepare an interactive response device 2 that returns responses to inquiries with a certain degree of accuracy.

[0016] 2 is a schematic block diagram showing functions of the user assistance device 1 according to the first embodiment of the present disclosure. Each function of the user assistance device 1 according to this embodiment is realized by the CPU 11 of the user assistance device 1 shown in FIG. 1 executing a system program and controlling the operation of each part of the user assistance device 1.

[0017] The user assistance device 1 of this embodiment includes an information acquisition unit 100, a query acquisition unit 110, a prompt generation unit 120, a transmission unit 130, a reception unit 140, and an interaction unit 150. The RAM 13 to the non-volatile memory 14 of the user assistance device 1 also include a template storage unit 200, which is an area in which prompt templates are stored in advance.

[0018] The information acquisition unit 100 acquires device information including at least one of specification information, operation information, and maintenance information related to the industrial machine 4 that is the subject of an inquiry. The specification information of the industrial machine 4 may include, for example, the model name of the industrial machine 4, the model number of the industrial machine 4, the version of the industrial machine 4, software information installed in the control device of the industrial machine 4, the manufacturer name of the industrial machine 4, the type of axis, the number of axis, the model name of the control device that controls the industrial machine 4, the manufacturer name of the control device, optional functions, the type of motor, the number of motors, the type of amplifier, the number of amplifiers, the type of peripheral devices, and the model number of the peripheral devices. The operation information of the industrial machine 4 may include the motor current, voltage, torque, position, speed, and acceleration of the drive unit detected during operation of the industrial machine 4, vibrations and sounds generated in each part of the industrial machine 4, information related to the operation of the peripheral devices of the industrial machine 4, and various log information (including various sensor information, internal calculation results, etc.) that can be acquired during operation. The maintenance information of the industrial machine 4 may include information related to failures that have occurred in the industrial machine 4 in the past, information related to maintenance for those failures, and part replacement history. The information acquisition unit 100 may acquire this information from a control device that controls the industrial machine 4. Alternatively, the information may be acquired through information input via the input device 71 or the external device 72. Furthermore, the information may be acquired from the fog computer 6, the cloud server 7, a database (not shown), or the like connected to the network 5. The information acquisition unit 100 may acquire this information periodically. Alternatively, the information may be acquired when an event such as an alert occurs in the industrial machine 4. The information acquisition unit 100 outputs the acquired information to the prompt generation unit 120.

[0019] The inquiry acquisition unit 110 acquires inquiry information including an inquiry written in a natural language. The inquiry acquisition unit 110 may, for example, display a user interface on the display device 70 for the user of the industrial machine 4 to input the inquiry, and acquire the inquiry input by the user from the input device 71. Alternatively, the inquiry may be acquired from a voice uttered by the user input from a voice input device such as a microphone (not shown). Furthermore, the inquiry from the user may be input using a display device and an input device (not shown) provided in the industrial machine 4. The inquiry acquisition unit 110 outputs the acquired inquiry information to the prompt generation unit 120.

[0020] The prompt generation unit 120 generates a prompt that can be input to the interactive response system 2 based on the device information acquired by the information acquisition unit 100 and the inquiry information acquired by the inquiry acquisition unit 110. The prompt generation unit 120 may assign prompt identification information that allows the generated prompt to be uniquely identified. The prompt generation unit 120 may create a prompt by, for example, applying the inquiry information and the device information to a prompt template corresponding to the inquiry information. The prompt may include content that inquires about the work procedures that the worker should perform in response to the situation and the timing to perform each work.

[0021] FIG. 3 is a schematic diagram showing an example of multiple templates stored in the template storage unit 200. In the example of FIG. 3, the template storage unit 200 stores multiple templates 1, 2, .... Each template is associated with multiple keywords. The prompt generation unit 120 searches for templates stored in the template storage unit 200 using words included in the inquiry information acquired by the inquiry acquisition unit 110 as keywords. The prompt generation unit 120 then reads out the template with the highest keyword match as the template to be used to create a prompt. The read-out template is then used to generate a prompt. The generated prompt is then transmitted to the transmission unit 130.

[0022] FIG. 4 is a schematic diagram showing an example of a template. In the example of FIG. 4, the template includes information keys for embedding predetermined information at predetermined positions in the prompt sentence. The prompt generation unit 120 generates a prompt by embedding corresponding information at each information key position. In the example of FIG. 4, inquiry information is embedded at the position of the information key "INQUIRY." Furthermore, the model name of the industrial machine 4 is embedded at the position "M_NAME," and the manufacturer name of the industrial machine 4 is embedded at the position "M_MAKER." Information keys corresponding to each of the inquiry information and the device information may be prepared. Furthermore, information keys corresponding to information calculated by performing a predetermined calculation on these pieces of information may be prepared. In the example of FIG. 4, the average rated load of the spindle motor around the time when the warning occurred is calculated and embedded at the position of the information key "W_SP_LOAD_AVE." Furthermore, the average power consumption of the spindle motor around the time when the warning occurred is calculated and embedded at the position of the information key "W_SP_POW_AVE." Furthermore, the "M_SP_TIME_HS" field is filled with the calculated number of hours before the most recent repair was performed from the time the warning was issued. Furthermore, the "M_SP_MENT_HS" field is filled with information related to the work performed during the most recent repair. Figure 5 is a schematic diagram showing an example of a prompt generated using the template of Figure 4.

[0023] Such a template is created in advance in accordance with the format of an inquiry to the interactive response apparatus 2. For example, if the interactive response apparatus 2 supports an inquiry format in natural language, it is desirable that the template be for generating a natural language prompt based on the inquiry information and device information, as exemplified in FIG. 4. The device information and information calculated from the device information may be expressed in a form that lists the information name and value of each piece of information, rather than being expressed in natural language. It is desirable that each template be created so as to include device information and information calculated from the device information that can be used as a reference when creating a response to expected inquiry information.

[0024] The transmission unit 130 transmits the prompt generated by the prompt generation unit 120 to the interactive response apparatus 2. Upon receiving the prompt from the transmission unit 130, the interactive response apparatus 2 generates a response to the prompt and transmits the generated response to the user assistance device 1.

[0025] The receiving unit 140 receives the response transmitted from the interactive response apparatus 2 and outputs the received response to the interaction unit 150.

[0026] The interaction unit 150 outputs the response received from the receiving unit 140 to the display device 70 for display.

[0027] [Correction based on Rule 91, 28.10.2025] The user assistance device 1 according to this embodiment, configured as described above, can automatically include device information, including at least one of specification information, operation information, and maintenance information, of the industrial machine 4, in response to a user's inquiry to the interactive response device 2. To use a typical interactive response device, the user must input the industrial machine's specification information and operation status, etc., using text or images. This places a significant burden on the user. In manufacturing sites, there is a demand for technology that automatically obtains device information related to the machine being queried and then queries the interactive response device. The user assistance device 1 according to this embodiment is expected to reduce the user's burden when making an inquiry while obtaining an appropriate response from the interactive response device 2.

[0028] The inquiries include inquiries about abnormality detection and preventive maintenance of industrial machinery, inquiries about how to operate the screen of industrial machinery, inquiries about parameter setting values ​​and whether maintenance is necessary, etc. By utilizing the responses of the interactive response device 2 to these inquiries, it is expected that it will contribute to operation assistance and teaching, selection of appropriate machining conditions, tuning for each workpiece, maintenance support for machine tools, etc.

[0029] As a modified example of the user assistance device 1 according to this embodiment, the interaction unit 150 may receive feedback information from the user regarding the response when the response is displayed on the display device 70. FIG. 6 is a screen diagram showing an example of receiving a user's evaluation of the response as feedback information. As shown in FIG. 6, when the response is displayed, the interaction unit 150 prompts the user to input an evaluation indicating whether the situation has been resolved or not as feedback information. When the user inputs the evaluation, the interaction unit 150 transmits the prompt used in the inquiry, the response to the prompt, and the feedback information to the interactive response device 2. The interactive response device 2 can perform learning processing based on this information and attempt to improve the accuracy of responses to inquiries.

[0030] As another variation of the user assistance device 1 according to this embodiment, the interaction unit 150 may accept a further query from the user when a response is displayed on the display device 70. FIG. 7 is a screen diagram illustrating an example of repeated queries. As illustrated in FIG. 7 , the interaction unit 150 prompts the user to enter a further query when a response is displayed. When the user enters a further query, the interaction unit 150 outputs the entered query to the query acquisition unit 110. At this time, the interaction unit 150 may add prompt identification information of the prompt used in the previous query to the additional query, thereby enabling the interactive response device 2 to refer to the content of the series of queries. This configuration allows subsequent queries to be made from the first query, enabling interactions with the interactive response device 2 that provide a more detailed understanding of the situation, thereby improving the accuracy of responses to queries.

[0031] As another modification of the user assistance device 1 according to this embodiment, the user assistance device 1 may be configured to make inquiries regarding multiple industrial machines 4. In this configuration, the information acquisition unit 100 acquires device information related to multiple industrial machines 4 and manages the information for each industrial machine 4. The inquiry acquisition unit 110 then prompts the user to select an industrial machine 4 to be queried from among the multiple industrial machines 4. The prompt generation unit 120 then generates a prompt using the device information related to the industrial machine 4 selected by the user, and outputs the prompt to the transmission unit 130. In a manufacturing site, one user may be responsible for multiple industrial machines 4. In such a case, the user assistance device 1 according to this modification operates appropriately.

[0032] Second Embodiment A user assistance device 1 according to a second embodiment will be described below. The user assistance device 1 according to this embodiment performs an operation related to an industrial machine 4 based on a response from an interactive response device 2.

[0033] 8 is a schematic block diagram showing functions of the user assistance device 1 according to the second embodiment of the present disclosure. Each function of the user assistance device 1 according to this embodiment is realized by the CPU 11 of the user assistance device 1 shown in FIG. 1 executing a system program and controlling the operation of each part of the user assistance device 1.

[0034] The user assistance device 1 of this embodiment includes an information acquisition unit 100, a query acquisition unit 110, a prompt generation unit 120, a transmission unit 130, a reception unit 140, and an interaction unit 150, as well as an operation unit 160. The RAM 13 to the non-volatile memory 14 of the user assistance device 1 also include a template storage unit 200, which is an area that pre-stores templates related to prompts, and an operation pattern storage unit 210, which is an area that pre-stores operation patterns that associate operation character strings with operation contents.

[0035] The information acquisition unit 100, inquiry acquisition unit 110, prompt generation unit 120, transmission unit 130, and reception unit 140 according to this embodiment have the same functions as the information acquisition unit 100, inquiry acquisition unit 110, prompt generation unit 120, transmission unit 130, and reception unit 140 according to the first embodiment.

[0036] The operation unit 160 generates a predetermined operation for the industrial machine 4 based on the response from the interactive response device 2 received by the receiving unit 140. Then, the operation unit 160 operates the industrial machine 4 in accordance with the generated operation. For example, the operation unit 160 extracts a character string related to the predetermined operation from the response of the interactive response device 2, and generates the predetermined operation from the extracted character string related to the operation. The operation unit 160 outputs the generated operation to the interaction unit 150.

[0037] Fig. 9 is a schematic diagram showing an example of a response from the interactive response system 2. The response from the interactive response system 2 may include a character string related to a predetermined operation for dealing with the situation of the industrial machine 4. In the example of Fig. 9, an operation to stop the rotation of the main shaft, an operation to open the machine door, etc. are included. The operation unit 160 extracts the character string related to the operation included in such a response.

[0038] FIG. 10 is a table diagram showing examples of operation patterns stored in the operation pattern storage unit 210. An operation pattern associates an operation string with an operation content. The operation string included in the operation pattern may be a simple string, or may be a string in a format such as a regular expression. In the latter case, a substring included in the matched string may be used in the operation content. In FIG. 10 , for example, if the response contains an operation string "stop spindle rotation," an operation pattern indicating the generation of an operation content "execute M05 command" is stored in the operation pattern storage unit 210. The operation unit 160 searches the response for an operation string related to each operation pattern, and if a match is found, identifies the operation content corresponding to the operation string as the operation to be executed. Then, the operation unit 160 generates, as an operation for the industrial machine 4, the identified operations arranged in the order in which the operation strings appear in the response.

[0039] The interaction unit 150 according to this embodiment displays and outputs the response input from the receiving unit 140 to the display device 70. The interaction unit 150 also displays and outputs the operation for the industrial machine 4 generated by the operation unit 160 to the display device 70, and confirms with the user whether or not to execute the operation. Thereafter, when an instruction to execute the displayed operation is given, the interaction unit 150 commands the operation unit 160 to execute the generated operation. Then, the operation unit 160 executes the generated operation in response to the instruction from the interaction unit 150.

[0040] FIG. 11 is a screen diagram showing an example of operation content displayed by the interaction unit 150. In the example of FIG. 11, the screen shows that an operation "Execute M05" and an operation "Execute Mxx" have been generated based on the operation string extracted from the response. To execute these operations, the user presses the execute button displayed on the screen. On the other hand, if the user does not want to execute these operations, the user presses the cancel button displayed on the screen. An interface may be provided that allows only some of the displayed operations to be executed. In the example of FIG. 11, an operation can be excluded from execution by unchecking the check button displayed before the operation. Furthermore, an interface may be provided that allows the order of the operations to be changed.

[0041] The user assistance device 1 according to this embodiment having the above configuration generates an operation to be executed on the industrial machine 4 from the response of the interactive response device 2. Then, the operation is executed in response to an instruction from the user. Therefore, it is expected that an appropriate operation can be executed on the industrial machine 4 while reducing the burden on the user.

[0042] Third Embodiment A user assistance device 1 according to a third embodiment will be described below. The user assistance device 1 according to this embodiment includes a maintenance information storage unit that stores information related to maintenance performed on the industrial machine 4 in the past.

[0043] 12 is a schematic block diagram showing functions of the user assistance device 1 according to the third embodiment of the present disclosure. Each function of the user assistance device 1 according to this embodiment is realized by the CPU 11 of the user assistance device 1 shown in FIG. 1 executing a system program and controlling the operation of each part of the user assistance device 1.

[0044] The user assistance device 1 of this embodiment includes an information acquisition unit 100, a query acquisition unit 110, a prompt generation unit 120, a transmission unit 130, a reception unit 140, and an interaction unit 150. The RAM 13 to the non-volatile memory 14 of the user assistance device 1 also include a template storage unit 200, which is an area for pre-storing prompt templates, and a maintenance information storage unit 220, which is an area for storing information related to maintenance performed on the industrial machine 4 in the past.

[0045] The query acquisition unit 110, prompt generation unit 120, transmission unit 130, reception unit 140, and interaction unit 150 of this embodiment have the same functions as the query acquisition unit 110, prompt generation unit 120, transmission unit 130, reception unit 140, and interaction unit 150 of the first embodiment.

[0046] The information acquisition unit 100 according to this embodiment acquires machine information including at least one of specification information, operation information, and maintenance information related to the industrial machine 4 that is the subject of an inquiry. The information acquisition unit 100 also acquires, as device information, from the maintenance information storage unit 220, maintenance information related to maintenance events that have occurred in the industrial machine 4 in the past, such as part replacement, tool replacement, failure history, alarm occurrence history, operating time, and power-off during holidays. The information acquisition unit 100 additionally stores the maintenance information acquired from the industrial machine 4 in the maintenance information storage unit 220. The information acquisition unit 100 then outputs the acquired device information to the prompt generation unit 120.

[0047] The user assistance device 1 according to this embodiment having the above configuration stores the history of maintenance information related to the industrial machine 4 in the maintenance information storage unit 220 within the user assistance device, and uses this information for inquiries to the interactive response device 2. Therefore, it is expected that prompts with appropriate inquiry content can be created even for industrial machines 4 that do not have a history of maintenance information.

[0048] Fourth Embodiment A user assistance device 1 according to a fourth embodiment will be described below. The user assistance device 1 according to this embodiment performs an operation related to an industrial machine 4 based on a response from an interactive response device 2.

[0049] 13 is a schematic block diagram showing functions of the user assistance device 1 according to the fourth embodiment of the present disclosure. Each function of the user assistance device 1 according to this embodiment is realized by the CPU 11 of the user assistance device 1 shown in FIG. 1 executing a system program and controlling the operation of each part of the user assistance device 1.

[0050] The user assistance device 1 of this embodiment includes an information acquisition unit 100, a query acquisition unit 110, a prompt generation unit 120, a transmission unit 130, a reception unit 140, and an interaction unit 150, as well as a trigger generation unit 170 and a query generation unit 180. The RAM 13 to the non-volatile memory 14 of the user assistance device 1 also include a template storage unit 200, which is an area for pre-storing templates related to prompts, and a query condition storage unit 230, which is an area for storing query conditions indicating the conditions for making a query.

[0051] The information acquisition unit 100, inquiry acquisition unit 110, prompt generation unit 120, transmission unit 130, reception unit 140, and interaction unit 150 of this embodiment have the same functions as the information acquisition unit 100, inquiry acquisition unit 110, prompt generation unit 120, transmission unit 130, reception unit 140, and interaction unit 150 of the first embodiment.

[0052] The trigger generation unit 170 determines whether to execute a query based on the device information acquired by the information acquisition unit 100. The trigger generation unit 170 refers to the query conditions stored in the query condition storage unit 230, and if the query conditions are satisfied in the device information acquired by the information acquisition unit 100, the trigger generation unit 170 instructs the query generation unit 180 to generate query information related to the query conditions.

[0053] The query generation unit 180 generates a query when the trigger generation unit 170 decides to execute a query. When the trigger generation unit 170 decides to execute a query, the query generation unit 180 references the query conditions stored in the query condition storage unit 230 and generates query information related to the satisfied conditions. The query generation unit 180 outputs the generated query information to the prompt generation unit 120.

[0054] FIG. 14 is a table diagram showing examples of query conditions stored in the query condition storage unit 230. The query conditions associate conditions for device information to be queried with query information at that time. In the example of FIG. 14 , a query condition is set such that, when an "alert [xxxx] has occurred," a query condition is generated to generate query information such as "A xxxx warning has occurred. Please tell me the cause of the abnormality." By setting such query conditions, when a predetermined warning occurs in the industrial machine 4, the interactive response device 2 can be automatically inquired about the cause of the abnormality and how to deal with it. In addition, a query condition is set such that, when a "predetermined period of S seconds has elapsed during operation," a query condition is set such that a query condition is generated to generate query information such as "Is there any abnormality in the current industrial machine?" by setting such query conditions such that, while the industrial machine 4 is operating, the interactive response device 2 can be made to periodically determine the state of the industrial machine 4 at S-second intervals.

[0055] The user assistance device 1 according to this embodiment having the above configuration can make an inquiry to the interactive response device 2 without bothering the user when a predetermined inquiry condition is met in the state of the industrial machine 4. This makes it possible to understand the state of the industrial machine 4 without placing a burden on the user.

[0056] Fifth Embodiment A user assistance device 1 according to a fifth embodiment will be described below. The user assistance device 1 according to this embodiment performs an operation related to an industrial machine 4 based on a response from an interactive response device 2.

[0057] 15 is a schematic block diagram showing functions of the user assistance device 1 according to the fifth embodiment of the present disclosure. Each function of the user assistance device 1 according to this embodiment is realized by the CPU 11 of the user assistance device 1 shown in FIG. 1 executing a system program and controlling the operation of each part of the user assistance device 1.

[0058] The user assistance device 1 of this embodiment includes an information acquisition unit 100, a query acquisition unit 110, a prompt generation unit 120, a transmission unit 130, a reception unit 140, and an interaction unit 150, as well as a user information acquisition unit 190. The RAM 13 to the non-volatile memory 14 of the user assistance device 1 also include a template storage unit 200, which is an area for pre-storing templates related to prompts, and a user information storage unit 240, which is an area for pre-storing user information including user attributes.

[0059] The query acquisition unit 110, the transmission unit 130, the reception unit 140, and the interaction unit 150 according to this embodiment have the same functions as the query acquisition unit 110, the transmission unit 130, the reception unit 140, and the interaction unit 150 according to the first embodiment.

[0060] The user information acquisition unit 190 acquires user information related to the user who operates the industrial machine 4. The user information acquisition unit 190 acquires a user ID input from the input device 71 of the industrial machine 4. The user information acquisition unit 190 may acquire a user ID read by the industrial machine 4 from an ID card or the like owned by the user. This user ID may be any information that uniquely identifies the user. Then, the user information acquisition unit 190 refers to the user information storage unit 240 and identifies the user information corresponding to the acquired user ID.

[0061] FIG. 16 is a table diagram showing an example of user information stored in the user information storage unit 240. In the example of FIG. 16, the user information storage unit 240 stores user information whose user ID is "User_A" and whose attribute is "beginner." It also stores user information whose user ID is "User_B" and whose attribute is "expert." The user information acquisition unit 190 reads out the user information of the user who operates the industrial machine 4 from the user information storage unit 240, based on the user ID of the user. Then, it outputs the read user information to the information acquisition unit 100.

[0062] The information acquisition unit 100 according to this embodiment acquires device information including at least one of specification information, operation information, and maintenance information related to the industrial machine 4 that is the subject of an inquiry. The information acquisition unit 100 also acquires the user information acquired by the user information acquisition unit 190 as additional device information. The information acquisition unit 100 then outputs the acquired device information to the prompt generation unit 120.

[0063] When generating a prompt, the prompt generation unit 120 according to this embodiment includes a sentence containing the user's attributes in the prompt based on the user information included in the device information. For example, if the user's attributes are a beginner, the prompt generation unit 120 generates a prompt containing a sentence such as "I'm a beginner, so please explain using simple terms."

[0064] The user assistance device 1 according to the present embodiment having the above configuration can generate a prompt including attributes related to the user of the industrial machine 4. Therefore, it is expected that a response tailored to the attributes of the user can be obtained from the interactive response device 2.

[0065] The user assistance device 1 or the interactive response device 2 in the above-described embodiments may be configured as an information processing device including one or more memories and one or more processors. Here, the processor may be an electronic circuit (processing circuit, processing circuitry, CPU, GPU, FPGA, ASIC, etc.) that performs at least one of device control and calculation. The processor may be a general-purpose processor, a dedicated processing circuit designed to perform a specific calculation, or a semiconductor device including both a general-purpose processor and a dedicated processing circuit. The processor may also include an optical circuit or a calculation function based on quantum computing.

[0066] Although the embodiments of the present disclosure have been described in detail above, the present disclosure is not limited to the individual embodiments described above. Various additions, substitutions, modifications, partial deletions, etc. are possible in these embodiments without departing from the gist of the invention or the idea and intent of the present disclosure derived from the content described in the claims and their equivalents. For example, in the above-described embodiments, the order of each operation and the order of each process are shown as examples and are not limited to these. The same applies when numerical values ​​or mathematical expressions are used in the description of the above-described embodiments.

[0067] The following are supplementary notes related to embodiments of the present disclosure. (Supplementary Note 1) A user assistance device (1) according to one aspect of the present disclosure includes an information acquisition unit (100) that acquires device information including at least one of specification information, operation information, and maintenance information related to a device to be queried, a query acquisition unit (110) that acquires query information including query content expressed in natural language, a prompt generation unit (120) that generates a prompt that can be input to an interactive response device (2) based on the device information and the query information, a transmission unit (130) that transmits the prompt to the interactive response device (2), a reception unit (140) that receives a response from the interactive response device (2), and an interaction unit (150) that outputs the received response.

[0068] (Supplementary Note 2) A user assistance device (1) according to another aspect of the present disclosure further includes an operation unit (160) that generates a predetermined operation for the device based on the received response and operates the device in accordance with the generated operation. (Supplementary Note 3) The interaction unit (150) included in the user assistance device (1) according to another aspect of the present disclosure receives feedback information indicating whether the situation has been resolved by the response, and transmits the prompt, the response, and the feedback information to the interactive response device (2). (Supplementary Note 4) A user assistance device (1) according to another aspect of the present disclosure further includes a maintenance information storage unit (220) that stores maintenance information related to events that have occurred in the device in the past, and the information acquisition unit (100) acquires maintenance information related to the query content from the maintenance information storage unit (220) based on the query content.

[0069] (Supplementary Note 5) The query acquisition unit (110) included in a user assistance device (1) according to another aspect of the present disclosure acquires the query information by at least one of character input and voice input. (Supplementary Note 6) A user assistance device (1) according to another aspect of the present disclosure further includes a trigger generation unit (170) that decides to make a query based on the device information acquired by the information acquisition unit (100), and a query generation unit (180) that generates a query based on the device information when the trigger generation unit (170) decides to make a query, and automatically performs the query based on the query generated by the query generation unit (180). (Supplementary Note 7) The trigger generation unit (170) included in a user assistance device (1) according to another aspect of the present disclosure decides to make a query when it detects that an abnormality has occurred in the device based on the device information.

[0070] (Supplementary Note 8) A user assistance device (1) according to another aspect of the present disclosure further includes a user information acquisition unit (190) that acquires user information related to a user operating the device, and the prompt generation unit (120) includes the user information in the generated prompt. (Supplementary Note 9) The interaction unit (150) included in the user assistance device (1) according to another aspect of the present disclosure accepts input of a repeat query in response to the output response, and instructs the prompt generation unit (120) to generate a prompt based on the accepted repeat query. (Supplementary Note 10) The information acquisition unit (100) included in the user assistance device (1) according to another aspect of the present disclosure acquires information related to multiple devices, and the query acquisition unit (110) selects a device to be queried from the multiple devices.

[0071] (Supplementary Note 11) A control device according to one aspect of the present disclosure has the functions of the user assistance device (1). (Supplementary Note 12) A user assistance method according to one aspect of the present disclosure includes the steps of: acquiring device information including at least one of specification information, operation information, and maintenance information related to a device to be queried; acquiring query information including query content expressed in natural language; generating a prompt that can be input to an interactive response device (2) based on the device information and the query information; transmitting the prompt to the interactive response device (2); receiving a response from the interactive response device (2); and outputting the received response.

[0072] (Supplementary Note 13) An information processing system (300) according to one aspect of the present disclosure includes the user assistance device (1) and the interactive response device (2). (Supplementary Note 14) The interactive response device (2) included in an information processing system (300) according to another aspect of the present disclosure generates the response by inputting the prompt into a language model. (Supplementary Note 15) An information processing system (300) according to another aspect of the present disclosure includes the user assistance device (1) and the device to be queried.

[0073] REFERENCE SIGNS LIST 1 User assistance device 2 Interactive response device 4 Industrial machine 5 Network 6 Fog computer 7 Cloud server 11 CPU 12 ROM 13 RAM 14 Non-volatile memory 15, 17, 18, 20 Interface 22 Bus 70 Display device 71 Input device 72 External device 100 Information acquisition unit 110 Query acquisition unit 120 Prompt generation unit 130 Transmission unit 140 Reception unit 150 Interaction unit 160 Operation unit 170 Trigger generation unit 180 Query generation unit 190 User information acquisition unit 200 Template storage unit 210 Operation pattern storage unit 220 Maintenance information storage unit 230 Query condition storage unit 240 User information storage unit 300 Information processing system

Claims

1. A user assistance device comprising: an information acquisition unit that acquires device information including at least one of specification information, operation information, and maintenance information related to a device that is the subject of an inquiry; a query acquisition unit that acquires query information including query content expressed in natural language; a prompt generation unit that generates a prompt that can be input to an interactive response device based on the device information and the query information; a transmission unit that transmits the prompt to the interactive response device; a reception unit that receives a response from the interactive response device; and an interaction unit that outputs the received response.

2. The user assistance device according to claim 1, further comprising an operation unit that generates a predetermined operation for the device based on the received response and operates the device in accordance with the generated operation.

3. The user assistance device according to claim 1, wherein the interaction unit receives feedback information indicating whether the situation has been resolved by the response, and transmits the prompt, the response, and the feedback information to the interactive response device.

4. A user assistance device as described in claim 1, further comprising a maintenance information storage unit that stores maintenance information relating to events that have occurred in the device in the past, and wherein the information acquisition unit acquires maintenance information related to the inquiry content from the maintenance information storage unit based on the inquiry content.

5. The user assistance device according to claim 1, wherein the query acquisition unit acquires the query information by at least one of text input and voice input.

6. The user assistance device according to claim 1, further comprising: a trigger generation unit that decides to make a query based on the device information acquired by the information acquisition unit; and a query generation unit that generates a query based on the device information when the trigger generation unit decides to make a query; and the user assistance device automatically makes a query based on the query generated by the query generation unit.

7. The user assistance device according to claim 6, wherein the trigger generation unit determines to execute a query when it detects that an abnormality has occurred in the device based on the device information.

8. The user assistance device according to claim 1, further comprising a user information acquisition unit that acquires user information relating to a user who operates the device, and wherein the prompt generation unit includes the user information in the generated prompt.

9. The user assistance device according to claim 1, wherein the interaction unit receives an input of a repeat query in response to the output response, and instructs the prompt generation unit to generate a prompt based on the received repeat query.

10. The user assistance device according to claim 1, wherein the information acquisition unit acquires information relating to a plurality of devices, and the inquiry acquisition unit selects a device to be queried from among the plurality of devices.

11. A control device for a user assistance device according to claim 1, having the functionality of said device.

12. A user assistance method in which a computer executes the steps of: acquiring device information including at least one of specification information, operation information, and maintenance information related to a device to be queried; acquiring query information including a query expressed in natural language; generating a prompt that can be input to an interactive response device based on the device information and the query information; transmitting the prompt to the interactive response device; receiving a response from the interactive response device; and outputting the received response.

13. An information processing system comprising: a user assistance device according to any one of claims 1 to 10; and the interactive response device.

14. The information processing system according to claim 13, wherein the interactive response device generates the response by inputting the prompt into a language model.

15. An information processing system comprising: a user assistance device according to any one of claims 1 to 10; and the device to be queried.

Images