User assistance device, control device, user assistance method, and information processing system

Abstract

This user assistance device is provided with: an information acquisition unit that acquires device information including at least one of specification information, operation information, and maintenance information relating to a device to be queried; a query acquisition unit that acquires query information including query content expressed in a natural language; a cue generation unit that generates a cue that can be input to the dialogue-type response device on the basis of the device information and the query information; a transmission unit that transmits the presentation to the dialogue-type response device; a reception unit that receives a response from the dialogue-type response device; and an interaction unit that outputs the received response.

Description

Technical Field

[0001] This disclosure relates to user assistance devices, control devices, user assistance methods, and information processing systems. Background Technology

[0002] In manufacturing sites such as factories where machine tools and robots are installed, users often struggle to determine the cause of malfunctions when these machines fail, frequently resorting to inquiries with the manufacturer. However, handling all such inquiries solely with the manufacturer is excessively time-consuming. Furthermore, response times can be slow. Moreover, users are often hesitant to consult with experts when no malfunction has occurred, hindering efficient preventative maintenance. There is a desire to consult with experts while performing tasks, rather than conducting the investigation themselves; this can be addressed through conversational AI assistants that allow users to query using natural language. Summary of the Invention

[0003] The problem that the invention aims to solve

[0004] In manufacturing environments and elsewhere, there is a need for functions that assist users in querying information related to equipment. To use typical interactive response devices, users need to input specifications or operating status of industrial machinery via characters or images. This poses a significant burden for users. The objective of this disclosure is to provide a technique for obtaining equipment information that is the subject of a query and for querying it using an interactive response device.

[0005] Methods for solving problems

[0006] The user assistance device disclosed herein includes information related to the device required for the query when querying a conversational response device, thereby solving the aforementioned problem.

[0007] Furthermore, one aspect of this disclosure is a user assistance device comprising: an information acquisition unit that acquires device information including at least one of specification information, operation information, and maintenance information related to the device being queried; a query acquisition unit that acquires query information including query content expressed in natural language; a prompt generation unit that generates a prompt that can be input to a conversational response device based on the device information and the query information; a sending unit that sends the prompt to the conversational response device; a receiving unit that receives a response from the conversational response device; and an interaction unit that outputs the received response. Attached Figure Description

[0008] Figure 1 This is a schematic hardware structure diagram of a user assistance device according to one embodiment of the present disclosure.

[0009] Figure 2This is a block diagram illustrating the general functions of the user assistance device in the first embodiment.

[0010] Figure 3 This is a schematic diagram illustrating an example of multiple templates stored in the template storage section.

[0011] Figure 4 This is a diagram illustrating an example of a template.

[0012] Figure 5 This is a diagram illustrating an example of a prompt generated using a template.

[0013] Figure 6 This is an example of a screen displayed by the interaction department that receives feedback information as evaluations of the user's responses.

[0014] Figure 7 This is an example of a screen displaying a repeated query in the interactive section.

[0015] Figure 8 This is a block diagram illustrating the general functions of the user assistance device in the second embodiment.

[0016] Figure 9 This is a schematic diagram illustrating an example of a dialogue-type response device.

[0017] Figure 10 This is a table representing examples of operating modes stored in the operating mode storage section.

[0018] Figure 11 This is an example of a screen showing the selection of operation content displayed in the interactive section.

[0019] Figure 12 This is a block diagram illustrating the general functions of the user assistance device in the third embodiment.

[0020] Figure 13 This is a block diagram illustrating the general functions of the user assistance device in the fourth embodiment.

[0021] Figure 14 This is a table that represents examples of query conditions stored in the query condition storage section.

[0022] Figure 15 This is a block diagram illustrating the general functions of the user assistance device in the fifth embodiment.

[0023] Figure 16 This is a table representing examples of user information stored in the user information storage department. Detailed Implementation

[0024] The following is related to the appendix. Figure 1 This will describe the implementation of the present disclosure.

[0025] [First Implementation Method]

[0026] Figure 1 This is a schematic hardware structure diagram showing the main parts of a user assistance device according to one embodiment of the present disclosure. The user assistance device 1 of this embodiment can be installed, for example, on a control device that controls industrial machinery such as machine tools and robots based on a control program. Alternatively, it can be installed on a personal computer located alongside the control device, a personal computer connected to the control device via a wired / wireless network, a unit computer, a fog computer 6, a cloud server 7, or other computers. In this embodiment, an example is shown where the user assistance device 1 is installed on a personal computer connected to the control device that controls the industrial machinery 4 via a network.

[0027] In this embodiment, the user assistance device 1 constitutes the information processing system 300. The information processing system 300 may also consist of the user assistance device 1 and the conversational response device 2. Alternatively, the information processing system 300 may consist of the user assistance device 1 and a device that becomes the subject of a query. Furthermore, the information processing system may consist of the user assistance device 1, the conversational response device 2, and the device that becomes the subject of a query. The application of this disclosure is not limited to manufacturing sites; any device that becomes the subject of a query can be a "device" capable of generating a query from a user. For example, the device that becomes the subject of a query can be industrial machinery 4. Additionally, the device that becomes the subject of a query can be any machinery not limited to industrial machinery 4, experimental equipment, home appliances, laptops, portable devices such as mobile phones, automobiles, etc. Furthermore, queries regarding the user assistance device 1 itself can be processed.

[0028] The CPU 11 of the user assistance device 1 in this embodiment is a processor that controls the user assistance device 1 as a whole. The CPU 11 reads the system program stored in the ROM 12 via the bus 22 and controls the entire user assistance device 1 according to the system program. Temporary calculation data, display data, and various data obtained from external sources are temporarily stored in the RAM 13.

[0029] The non-volatile memory 14 is composed of, for example, a memory backed up by a battery (not shown), an SSD (Solid State Drive), etc., and maintains its storage state even when the power to the user auxiliary device 1 is disconnected. The non-volatile memory 14 stores programs or data read from the external device 72 via the interface 15, programs or data input via the input device 71, programs or data obtained from the industrial machine 4 or other devices via the network 5, etc. The stored data may include, for example, information related to the specifications of the industrial machine 4 (model name, number of shafts, etc.), information related to the operating status of the industrial machine 4 (motor current, voltage, torque, position, speed, acceleration, vibration, sound, etc. generated in various parts of the industrial machine 4 as detected by sensors), and information related to the maintenance of the industrial machine 4 (information related to past inspections and repairs, etc.). The programs and data stored in the non-volatile memory 14 can also be expanded in RAM 13 during execution / use. In addition, various system programs, such as known parsing programs, are pre-written into ROM12.

[0030] Interface 15 is used to connect the CPU 11 of the user assistance device 1 to an external device 72 such as a USB device. For example, system programs and setting data can be read from the external device 72. Furthermore, programs and setting data created / edited in the user assistance device 1 can be stored in an external storage unit via the external device 72.

[0031] Interface 20 is used to connect the CPU 11 of the user assistance device 1 to a wired or wireless network 5. Network 5 can communicate using technologies such as RS-485 serial communication, Ethernet communication, optical communication, wireless LAN, Wi-Fi, and Bluetooth. Connected to network 5 are industrial machines 4 that become at least one controlled object, at least one other industrial machine 4, a conversational response device 2 functioning as an AI assistant, a fog computer 6, a cloud server 7, etc., which exchange data with the user assistance device 1.

[0032] In the display device 70, data read into the memory and data obtained as a result of executing programs are output and displayed via the interface 17. In addition, the input device 71, which consists of a keyboard, pointer devices, etc., transmits instructions and data based on the operator's operation to the CPU 11 via the interface 18.

[0033] The conversational response device 2 is configured to return a response text to a predetermined text. The conversational response device 2 possesses a large-scale language model (LLM) that has learned response texts to the predetermined text. This model can be, for example, a Transformer model. When a predetermined text is input, the large-scale language model learns texts with high probabilities of being appropriate responses to that text. Then, it further learns texts with high probabilities following that text. Through repeated learning, the large-scale language model outputs a text string with high probabilities as responses to the predetermined text when it is input. During learning, depending on how the texts that become responses to the predetermined text are learned, the conversational response device 2 can be used for purposes such as dialogue, question answering, text summarization, text editing, text translation, text conversion, text modification, text optimization, text explanation / detection, recognition, prediction, judgment, code generation, image generation, and comprehensive judgment.

[0034] Assuming that the user assistance device 1 of this disclosure queries information about equipment based on industrial machinery 4, it connects via network 5 to a conversational response device 2 that has learned responses to such queries. The conversational response device 2 learns by using queries and responses prepared based on the knowledge of skilled users, as well as queries and responses from past interactions with help desks of machinery manufacturers and maintenance operators. By filtering the information used for learning, the conversational response device 2 can prepare responses to queries that maintain a certain level of accuracy.

[0035] Figure 2 This is a functional block diagram illustrating the functions of the user assistance device 1 according to the first embodiment of this disclosure. The functions of the user assistance device 1 according to this embodiment are described through... Figure 1 The user assistance device 1 shown is implemented by having a CPU 11 that executes system programs and controls the actions of various parts of the user assistance device 1.

[0036] The user assistance device 1 of this embodiment includes an information acquisition unit 100, a query acquisition unit 110, a prompt generation unit 120, a sending unit 130, a receiving unit 140, and an interaction unit 150. Furthermore, a template storage unit 200 is prepared in the RAM 13 or non-volatile memory 14 of the user assistance device 1; this is an area for pre-storing templates related to prompts.

[0037] The information acquisition unit 100 acquires device information including at least one of the following: specification information, operation information, and maintenance information of the industrial machine 4, which is the object of the query. The specification information of the industrial machine 4 may include, for example, the model name, version, software information of the control device installed on the industrial machine 4, the manufacturer's name, the type and number of axes, the model name and manufacturer's name of the control device controlling the industrial machine 4, optional functions, the type and number of motors, the type and number of amplifiers, the type and model of peripheral equipment, etc. The operation information of the industrial machine 4 may also include the motor current, voltage, torque, position, speed, and acceleration of the drive unit detected during the operation of the industrial machine 4, vibrations and sounds generated in various parts of the industrial machine 4, information related to the operation of peripheral equipment of the industrial machine 4, and various log information obtainable during operation (including various sensor information, internal calculation results, etc.). The maintenance information of the industrial machine 4 may also include information related to past faults in the industrial machine 4, information related to the maintenance of those faults, and the history of component replacement, etc. The information acquisition unit 100 can also acquire this information from the control device that controls the industrial machinery 4. Additionally, it can acquire information input via the input device 71 or external device 72. Furthermore, it can acquire information from a fog computer 6 connected to the network 5, a cloud server 7, a database (not shown), etc. The information acquisition unit 100 can also acquire this information periodically. Additionally, it can acquire information periodically when events such as alarms occur in the industrial machinery 4. The information acquisition unit 100 outputs the acquired information to the prompt generation unit 120.

[0038] The query acquisition unit 110 acquires query information containing query content written in natural language. For example, the query acquisition unit 110 may display a user interface for inputting query content for the industrial machine 4 on the display device 70, and acquire the query content input by the user from the input device 71. Alternatively, the query content can be acquired based on the user's voice input via a voice input device such as a microphone (not shown). Furthermore, the query content from the user can also be input using a display device (not shown) and an input device provided with the industrial machine 4. The query acquisition unit 110 outputs the acquired query information to the prompt generation unit 120.

[0039] The prompt generation unit 120 generates a prompt that can be input into the dialog-type response device 2 based on device information obtained by the information acquisition unit 100 and query information obtained by the query acquisition unit 110. The prompt generation unit 120 can assign prompt identification information to the prompt, enabling it to uniquely identify the generated prompt. The prompt generation unit 120 can create the prompt, for example, by applying the query information and device information to a prompt template corresponding to the query information. The prompt may also include information such as the work steps that the query operator should take in response to the situation and the timing of performing each task.

[0040] Figure 3 This is a schematic diagram illustrating an example of multiple templates stored in the template storage unit 200. Figure 3 In this example, the template storage unit 200 stores multiple templates 1, 2, ... Additionally, multiple keywords are associated with each template. The prompt generation unit 120 uses words contained in the query information obtained by the query retrieval unit 110 as keywords to search the templates stored in the template storage unit 200. Then, it reads out the template with the highest keyword consistency as the template for creating the prompt. Then, it generates a prompt using the read-out template. Finally, the generated prompt is sent to the sending unit 130.

[0041] Figure 4 This is a diagram illustrating an example of a template. In Figure 4 In the example, the template includes information keys for embedding predetermined information at predetermined locations in the prompt text. The prompt generation unit 120 generates the prompt by embedding corresponding information at the locations of each information key. Figure 4 In the example, query information is embedded at the location of the information key "INQUIRY". Additionally, the model name of industrial machine 4 is embedded at the location of "M_NAME", and the manufacturer name of industrial machine 4 is embedded at the location of "M_MAKER". Information keys corresponding to query information and device information can also be prepared separately. Furthermore, information keys corresponding to information calculated by performing predetermined calculations based on this information can also be prepared. Figure 4 In the example, at the location of the information key such as "W_SP_LOAD_AVE", the average rated load of the spindle motor near the time the warning was generated is calculated and embedded. Additionally, at the location of "W_SP_POW_AVE", the average power consumption of the spindle motor near the time the warning was generated is calculated and embedded. Furthermore, at the location of "M_SP_TIME_HS", the most recent repair performed several hours ago since the warning was generated is calculated and embedded. Finally, at the location of "M_SP_MENT_HS", information related to the work performed during the most recent repair is embedded. Figure 5 It shows the use Figure 4This is an example illustration of a prompt generated from a template.

[0042] Such templates are pre-made based on the form of queries for the dialogic response device 2. For example, in the case where the dialogic response device 2 corresponds to a natural language-based query, such as... Figure 4 The example provided preferably uses a template for generating natural language prompts based on query information and device information. The device information and the information calculated based on the device information may also be presented as a list of information names and values, rather than expressed in natural language. Each template is preferably designed to include the referenced device information and the information calculated based on the device information when generating an answer to a given query.

[0043] The sending unit 130 sends a prompt generated by the prompt generation unit 120 to the conversational response device 2. Upon receiving the prompt from the sending unit 130, the conversational response device 2 generates a response to the prompt. Then, it sends the generated response to the user assistance device 1.

[0044] The receiving unit 140 receives the response sent from the conversational response device 2. Then, it outputs the received response to the interaction unit 150.

[0045] The interaction unit 150 displays the response input from the receiving unit 140 to the display device 70.

[0046] The user assistance device 1 of this embodiment, equipped with the above-described structure, can automatically include device information, including at least one of the following: specification information, operation information, and maintenance information of the industrial machinery 4, when a user queries the dialog-type response device 2. To use a typical dialog-type response device, the user needs to input the specification information and operating status of the industrial machinery using characters or images. This is a significant burden for the user. In manufacturing settings, there is a need for a technique that automatically obtains device information related to the machinery being queried and queries the dialog-type response device. It is anticipated that the user assistance device 1 of this embodiment can obtain an appropriate response from the dialog-type response device 2, while simultaneously reducing the burden on the user during queries.

[0047] Examples of query content include queries regarding the identification or preventative maintenance of industrial machinery, queries related to the on-screen operation methods of industrial machinery, parameter settings, and whether maintenance is required. By effectively utilizing the responses of the dialog-type response device 2, it is expected that these queries will assist in operation, provide teaching, select appropriate processing conditions, adjust each workpiece, and provide maintenance support for the machine tool.

[0048] As a variation of the user assistance device 1 in this embodiment, the interaction unit 150 can receive feedback information from the user regarding the response when the response is displayed on the display device 70. Figure 6 This is an example of a screen displaying feedback information, showing the evaluation of a user's response. For example... Figure 6 As shown, when a response is displayed, the interaction unit 150 prompts the user to input an evaluation indicating whether the situation is resolved or not, as feedback information. Then, when the user inputs an evaluation, the interaction unit 150 sends a prompt for the query, a response to the prompt, and feedback information to the conversational response device 2. The conversational response device 2 can perform learning processing based on this information to try to improve the accuracy of the response to the query.

[0049] As another variation of the user assistance device 1 in this embodiment, when the response is displayed on the display device 70, the interaction unit 150 can accept further inquiries from the user. Figure 7 This is a screenshot illustrating an example of repeated queries. For example... Figure 7 As illustrated in the example, when a response is displayed, the interaction unit 150 prompts the user to enter further queries if any exist. Then, when the user enters further queries, the interaction unit 150 outputs the entered queries to the query retrieval unit 110. At this time, the interaction unit 150 can add the prompt recognition information used for the previous query to the additional query, thereby allowing the dialogic response device 2 to refer to a series of queries. With this structure, continuous queries can be performed from the initial query, a more detailed understanding of the situation can be achieved through interaction with the dialogic response device 2, and the accuracy of responses to queries can be improved.

[0050] As another variation of the user assistance device 1 in this embodiment, the user assistance device 1 can also perform queries related to multiple industrial machines 4. In this configuration, the information acquisition unit 100 acquires device information related to the multiple industrial machines 4 and manages it for each industrial machine 4. Then, the query acquisition unit 110 prompts the user to input information to select the industrial machine 4 to be queried from the multiple industrial machines 4. Then, the prompt generation unit 120 generates a prompt using the device information related to the industrial machine 4 selected by the user and outputs it to the sending unit 130. In a manufacturing site, sometimes one user is responsible for multiple industrial machines 4. In this case, the user assistance device 1 of this variation operates well.

[0051] [Second Implementation]

[0052] The user assistance device 1 of the second embodiment will now be described. In this embodiment, the user assistance device 1 performs operations related to the industrial machinery 4 based on responses from the conversational response device 2.

[0053] Figure 8This is a schematic block diagram illustrating the functions of the user assistance device 1 according to the second embodiment of this disclosure. The functions of the user assistance device 1 according to this embodiment are described below. Figure 1 The user assistance device 1 shown is implemented by having a CPU 11 that executes system programs and controls the actions of various parts of the user assistance device 1.

[0054] In addition to the information acquisition unit 100, query acquisition unit 110, prompt generation unit 120, sending unit 130, receiving unit 140, and interaction unit 150, the user assistance device 1 of this embodiment also includes an operation unit 160. Furthermore, in the RAM 13 or non-volatile memory 14 of the user assistance device 1, a template storage unit 200 is provided as a region for pre-storing templates related to prompts, and an operation mode storage unit 210 is provided as a region for pre-storing operation modes that associate operation strings with operation content.

[0055] The information acquisition unit 100, query acquisition unit 110, prompt generation unit 120, sending unit 130, and receiving unit 140 of this embodiment have the same functions as the information acquisition unit 100, query acquisition unit 110, prompt generation unit 120, sending unit 130, and receiving unit 140 of the first embodiment.

[0056] The operation unit 160 generates a predetermined operation for the industrial machine 4 based on the response received from the conversational response device 2 by the receiving unit 140. Then, it operates the industrial machine 4 according to the generated operation. For example, the operation unit 160 extracts a string related to the predetermined operation from the response of the conversational response device 2, and generates the predetermined operation based on the extracted string. The operation unit 160 outputs the generated operation to the interaction unit 150.

[0057] Figure 9 This is a schematic diagram illustrating an example of the response from the conversational response device 2. The response from the conversational response device 2 sometimes includes strings related to predetermined operations for responding to the condition of the industrial machinery 4. Figure 9 Examples include operations such as stopping the spindle rotation and opening a mechanical door. The operation unit 160 extracts the string related to the operation contained in such a response.

[0058] Figure 10 This is a diagram illustrating examples of operation patterns stored in the operation pattern storage unit 210. An operation pattern is a pattern that associates an operation string with operation content. The operation string included in the operation pattern can be a simple string, or it can be a string in the form of, for example, a regular expression. In the latter case, it also allows the use of a portion of the string contained in the matched string within the operation content. Figure 10For example, if the response contains an operation string such as "stop spindle rotation", the operation mode storage unit 210 stores operation modes that indicate the generation of operation content such as "execute M05 command". The operation unit 160 searches the response for operation strings related to each operation mode, and if they match, determines the operation content corresponding to that operation string as the operation to be executed. Then, it generates an operation that arranges the determined operations in the order in which the operation strings appear in the response as an operation for the industrial machine 4.

[0059] In this embodiment, the interaction unit 150 displays the response input from the receiving unit 140 to the display device 70. Additionally, the interaction unit 150 displays an operation for the industrial machinery 4 generated by the operation unit 160 to the display device 70, requesting confirmation from the user whether to perform the operation. Then, if the user is instructed to perform the displayed operation, the operation unit 160 is instructed to perform the generated operation. Finally, the operation unit 160 performs the generated operation according to the instructions from the interaction unit 150.

[0060] Figure 11 This is a screenshot showing an example of the operation content displayed by the interaction unit 150. Figure 11 In the example, based on the operation string extracted from the response, the screen displays generated operations such as "Execute M05" and "Execute Mxx". The user executes these operations by pressing the execute button displayed on the screen. Conversely, if the user does not wish to execute these operations, they press the cancel button displayed on the screen. An interface that allows only a portion of the displayed operations to be executed can also be provided. Figure 11 In the example, by unchecking the checkboxes displayed before each operation, the operation can be set to be excluded from the execution object. Additionally, an interface that allows changing the order of the operations can also be provided.

[0061] The user assistance device 1 of this embodiment, equipped with the above-described structure, generates an operation that should be performed by the industrial machinery 4 based on the response of the conversational response device 2. Then, the operation is performed according to the instructions from the user. Therefore, it is expected to reduce the user's burden and enable appropriate operation of the industrial machinery 4.

[0062] [Third Implementation Method]

[0063] The user assistance device 1 according to the third embodiment will now be described. The user assistance device 1 of this embodiment includes a maintenance information storage unit that stores information related to past maintenance of the industrial machinery 4.

[0064] Figure 12This is a schematic block diagram illustrating the functions of the user assistance device 1 according to the third embodiment of this disclosure. The functions of the user assistance device 1 according to this embodiment are... Figure 1 The CPU 11 of the user assistance device 1 shown executes the system program and controls the operation of each part of the user assistance device 1 to achieve this.

[0065] The user assistance device 1 of this embodiment includes an information acquisition unit 100, a query acquisition unit 110, a prompt generation unit 120, a sending unit 130, a receiving unit 140, and an interaction unit 150. Furthermore, the user assistance device 1's RAM 13 or non-volatile memory 14 includes a template storage unit 200, which serves as a region for pre-storing templates related to prompts, and a maintenance information storage unit 220, which serves as a region for storing information related to past maintenance performed on the industrial machinery 4.

[0066] The query acquisition unit 110, prompt generation unit 120, sending unit 130, receiving unit 140 and interaction unit 150 of this embodiment have the same functions as the query acquisition unit 110, prompt generation unit 120, sending unit 130, receiving unit 140 and interaction unit 150 of the first embodiment.

[0067] In this embodiment, the information acquisition unit 100 acquires machine information including at least one of the following: specification information, operation information, and maintenance information related to the industrial machine 4 that is the target of the query. Additionally, the information acquisition unit 100 acquires maintenance information related to past maintenance events occurring in the industrial machine 4, such as component replacements, tool replacements, fault histories, alarm occurrence histories, operating times, and power-on / off during consecutive shutdowns, from the maintenance information storage unit 220 as device information. The information acquisition unit 100 appends the maintenance information acquired from the industrial machine 4 to the maintenance information storage unit 220. Then, the information acquisition unit 100 outputs the acquired device information to the prompt generation unit 120.

[0068] The user assistance device 1 of this embodiment, which has the above-described structure, stores historical information related to the maintenance of the industrial machinery 4 in the maintenance information storage unit 220 within the user assistance device for use in queries to the dialog-type response device 2. Therefore, it is expected that even in industrial machinery 4 without a history of maintenance information, appropriate prompts can be generated based on the query content.

[0069] [Fourth Implementation Method]

[0070] The user assistance device 1 of the fourth embodiment will now be described. In this embodiment, the user assistance device 1 performs operations related to the industrial machinery 4 based on responses from the conversational response device 2.

[0071] Figure 13This is a schematic block diagram illustrating the functions of the user assistance device 1 according to the fourth embodiment of this disclosure. The functions of the user assistance device 1 according to this embodiment are... Figure 1 The user assistance device 1 shown is implemented by having a CPU 11 that executes system programs and controls the actions of various parts of the user assistance device 1.

[0072] In addition to the information acquisition unit 100, query acquisition unit 110, prompt generation unit 120, sending unit 130, receiving unit 140, and interaction unit 150, the user assistance device 1 of this embodiment also includes a trigger generation unit 170 and a query generation unit 180. Furthermore, the RAM 13 or non-volatile memory 14 of the user assistance device 1 includes a template storage unit 200, which serves as a region for pre-storing templates related to prompts, and a query condition storage unit 230, which serves as a region for storing query conditions indicating the conditions for performing a query.

[0073] The information acquisition unit 100, query acquisition unit 110, prompt generation unit 120, sending unit 130, receiving unit 140, and interaction unit 150 of this embodiment have the same functions as those of the information acquisition unit 100, query acquisition unit 110, prompt generation unit 120, sending unit 130, receiving unit 140, and interaction unit 150 of the first embodiment.

[0074] The trigger generation unit 170 determines to perform a query based on the device information obtained by the information acquisition unit 100. The trigger generation unit 170 refers to the query conditions stored in the query condition storage unit 230, and if the device information obtained by the information acquisition unit 100 meets the query conditions, instructs the query generation unit 180 to generate query information related to the query conditions.

[0075] When the triggering generation unit 170 decides to perform a query, the query generation unit 180 generates a query. When the triggering generation unit 170 decides to perform a query, the query generation unit 180 refers to the query conditions stored in the query condition storage unit 230 and generates query information related to the conditions that are met. The query generation unit 180 outputs the generated query information to the prompt generation unit 120.

[0076] Figure 14 This is a table representing examples of query conditions stored in the query condition storage unit 230. Query conditions are conditions that associate the device information to be queried with the current query information. Figure 14In the example, a query condition is set to generate the message "A warning [xxxx] has occurred. Please inform us of the cause of the abnormality" based on the condition "A warning [xxxx] has occurred." By setting such a query condition, when a predetermined warning is generated in industrial machinery 4, the dialog-type response device 2 can be automatically queried for the cause of the abnormality and the corresponding solution. Additionally, a query condition is set to generate the message "Is there currently no abnormality in the industrial machinery?" based on the condition "A predetermined period of S seconds has elapsed during operation." By pre-setting such a query condition, the dialog-type response device 2 can periodically determine the status of industrial machinery 4 at S-second intervals during the continuous operation of industrial machinery 4.

[0077] When predetermined query conditions are met in the state of the industrial machinery 4, the user assistance device 1 of this embodiment, equipped with the above structure, can query the dialog-type response device 2 without the user having to do so. Therefore, the state of the industrial machinery 4 can be grasped without burdening the user.

[0078] [Fifth Implementation Method]

[0079] The user assistance device 1 of the fifth embodiment will now be described. In this embodiment, the user assistance device 1 performs operations related to the industrial machinery 4 based on responses from the conversational response device 2.

[0080] Figure 15 This is a schematic block diagram illustrating the functions of the user assistance device 1 according to the fifth embodiment of this disclosure. The functions of the user assistance device 1 according to this embodiment are described below. Figure 1 The user assistance device 1 shown is implemented by having a CPU 11 that executes system programs and controls the actions of various parts of the user assistance device 1.

[0081] In addition to the information acquisition unit 100, query acquisition unit 110, prompt generation unit 120, sending unit 130, receiving unit 140, and interaction unit 150, the user assistance device 1 of this embodiment also includes a user information acquisition unit 190. Furthermore, the RAM 13 or non-volatile memory 14 of the user assistance device 1 includes a template storage unit 200, which serves as a region for pre-storing templates related to prompts, and a user information storage unit 240, which serves as a region for pre-storing user information containing user attributes.

[0082] The query acquisition unit 110, sending unit 130, receiving unit 140 and interaction unit 150 of this embodiment have the same functions as the query acquisition unit 110, sending unit 130, receiving unit 140 and interaction unit 150 of the first embodiment.

[0083] The user information acquisition unit 190 acquires user information, which is related to the user operating the industrial machinery 4. The user information acquisition unit 190 acquires the user ID input from the input device 71 of the industrial machinery 4. The user information acquisition unit 190 may also acquire the user ID read by the industrial machinery 4 from an ID card owned by the user. This user ID can be any information as long as it uniquely identifies the user. Then, the user information acquisition unit 190 refers to the user information storage unit 240 to determine the user information corresponding to the acquired user ID.

[0084] Figure 16 This is a table showing an example of user information stored in the user information storage unit 240. Figure 16 In this example, the user information storage unit 240 stores user information for user ID "User_A" with the attribute "Beginner". Additionally, it stores user information for user ID "User_B" with the attribute "Expert". The user information acquisition unit 190 reads the user information of the user operating the industrial machinery 4 from the user information storage unit 240 based on the user ID of that user. Then, it outputs the read user information to the information acquisition unit 100.

[0085] In this embodiment, the information acquisition unit 100 acquires device information including at least one of specification information, operation information, and maintenance information related to the industrial machinery 4 that is the target of the query. Additionally, user information acquired by the user information acquisition unit 190 is acquired as supplementary device information. Then, the information acquisition unit 100 outputs the acquired device information to the prompt generation unit 120.

[0086] Furthermore, when generating a prompt, the prompt generation unit 120 of this embodiment includes text containing the user's attributes in the prompt based on the user information included in the device information. For example, if the user's attribute is "beginner," the prompt generation unit 120 generates a prompt containing text such as "Also, I am a beginner, so please use simple language to explain."

[0087] The user assistance device 1 of this embodiment, equipped with the above-described structure, is capable of generating prompts containing attributes related to the user of the industrial machinery 4. Therefore, it is expected that responses matching the user attributes can be obtained from the conversational response device 2.

[0088] Furthermore, the user assistance device 1 or conversational response device 2 in the above embodiments may also be composed of an information processing device having one or more memories and one or more processors. Here, the processor may be an electronic circuit (processing loop, processing circuitry, CPU, GPU, FPGA, ASIC, etc.) that performs at least one of the following: device control or computation. Alternatively, the processor may be a general-purpose processor, a dedicated processing circuit designed to perform specific computations, or a semiconductor device comprising both a general-purpose processor and a dedicated processing circuit. Additionally, the processor may include an optical loop or quantum computing-based computational functions.

[0089] The embodiments of this disclosure have been described in detail above, but this disclosure is not limited to the various embodiments described above. Various additions, substitutions, modifications, and partial deletions can be made to these embodiments without departing from the spirit of the invention, or without departing from the idea and spirit of this disclosure derived from the content described in the claimed scope and its equivalents. For example, in the embodiments described above, the order of each action and the order of each process are shown as an example and are not limited thereto. The same applies to the use of numerical values ​​or mathematical formulas in the description of the embodiments described above.

[0090] The following are notes regarding embodiments of this disclosure.

[0091] (Note 1)

[0092] One aspect of the user assistance device (1) disclosed herein includes: an information acquisition unit (100) that acquires device information including at least one of specification information, operation information, and maintenance information related to the device being queried; a query acquisition unit (110) that acquires query information including query content expressed in natural language; a prompt generation unit (120) that generates a prompt that can be input to a conversational response device (2) based on the device information and the query information; a sending unit (130) that sends the prompt to the conversational response device (2); a receiving unit (140) that receives a response from the conversational response device (2); and an interaction unit (150) that outputs the received response.

[0093] (Note 2)

[0094] The user assistance device (1) of other embodiments of the present disclosure further includes: an operation unit (160) which generates a predetermined operation for the device based on the received response and operates the device according to the generated operation.

[0095] (Note 3)

[0096] The interaction unit (150) of the user assistance device (1) of other embodiments of the present disclosure receives feedback information indicating whether the situation has been resolved through the response, and sends the prompt, the response and the feedback information to the conversational response device (2).

[0097] (Note 4)

[0098] The user assistance device (1) of other embodiments of the present disclosure also includes a maintenance information storage unit (220) that stores maintenance information related to past events of the device, and the information acquisition unit (100) acquires maintenance information associated with the query content from the maintenance information storage unit (220) based on the query content.

[0099] (Note 5)

[0100] The query acquisition unit (110) of the user assistance device (1) of other embodiments of the present disclosure acquires the query information by at least one of character input and voice input.

[0101] (Note 6)

[0102] The user assistance device (1) of other embodiments of the present disclosure further includes: a trigger generation unit (170) that decides to perform a query based on the device information obtained by the information acquisition unit (100); and a query generation unit (180) that generates a query based on the device information when the trigger generation unit (170) decides to perform a query, and automatically performs a query based on the query generated by the query generation unit (180).

[0103] (Note 7)

[0104] The trigger generation unit (170) of the user assistance device (1) of other embodiments of the present disclosure determines to perform a query when it detects an abnormality in the device based on the device information.

[0105] (Postscript 8)

[0106] The user assistance device (1) of the other embodiments of the present disclosure further includes: a user information acquisition unit (190) that acquires information related to the user operating the device, i.e., user information, and the prompt generation unit (120) includes the user information in a prompt to be generated.

[0107] (Note 9)

[0108] The interaction unit (150) of the user assistance device (1) of the other manner disclosed herein accepts input of repeated queries for the output response and instructs the prompt generation unit (120) to generate a prompt based on the accepted repeated query.

[0109] (Postscript 10)

[0110] The information acquisition unit (100) of the user assistance device (1) of other embodiments of the present disclosure acquires information related to multiple devices, and the query acquisition unit (110) selects a device for querying from the multiple devices.

[0111] (Postscript 11)

[0112] One aspect of the control device disclosed herein has the functions of the user assistance device (1).

[0113] (Postscript 12)

[0114] One aspect of this disclosure is a user-assisted method that enables a computer to perform the following steps: obtaining device information containing at least one of specification information, operation information, and maintenance information related to a device for query; obtaining query information containing query content expressed in natural language; generating a prompt that can be input to a conversational response device (2) based on the device information and the query information; sending the prompt to the conversational response device (2); receiving a response from the conversational response device (2); and outputting the received response.

[0115] (Postscript 13)

[0116] One aspect of the information processing system (300) disclosed herein includes the user assistance device (1) and the conversational response device (2).

[0117] (Postscript 14)

[0118] The dialogic response device (2) of the information processing system (300) of other embodiments of this disclosure generates the response by inputting the prompt into a language model.

[0119] (Postscript 15)

[0120] The information processing system (300) of other embodiments of this disclosure includes the user assistance device (1) and the device that becomes the object of the query.

[0121] Symbol Explanation

[0122] 1 User Assistance Device

[0123] 2. Dialogue-type response device

[0124] 4 Industrial Machinery

[0125] 5 Networks

[0126] 6 Fog Computer

[0127] 7 cloud servers

[0128] 11 CPU

[0129] 12 ROM

[0130] 13 RAM

[0131] 14 Non-volatile memory

[0132] Interfaces 15, 17, 18, and 20

[0133] 22 bus

[0134] 70 display devices

[0135] 71 Input Device

[0136] 72 External Devices

[0137] 100 Information Acquisition Department

[0138] 110 inquiry department

[0139] 120 prompt generation department

[0140] 130 Sending Department

[0141] 140 Receiving Department

[0142] 150 Interaction Department

[0143] 160 Operations Department

[0144] 170 Trigger Generation Department

[0145] 180 Query Generation Department

[0146] 190 User Information Acquisition Department

[0147] 200 Template Storage Department

[0148] 210 Operation Mode Storage Unit

[0149] 220 Maintenance Information Storage Department

[0150] 230 Query Condition Storage Department

[0151] 240 User Information Storage Department

[0152] 300 Information Processing System.

Claims

1. A user assistance device, characterized in that, have: The information acquisition department acquires device information that includes at least one of the following: specification information, operation information, and maintenance information related to the device being queried. The query retrieval department retrieves query information containing query content expressed in natural language; The prompt generation unit generates a prompt that can be input to the conversational response device based on the device information and the query information. The sending unit sends the prompt to the conversational response device; The receiving unit receives responses from the dialog-type response device; as well as The interaction unit outputs the received response.

2. The user assistance device according to claim 1, characterized in that, The user assistance device further includes an operation unit that generates a predetermined operation for the device based on the received response, and operates the device according to the generated operation.

3. The user assistance device according to claim 1, characterized in that, The interaction unit receives feedback information indicating whether the situation has been resolved through the response, and sends the prompt, the response, and the feedback information to the conversational response device.

4. The user assistance device according to claim 1, characterized in that, The user assistance device also includes a maintenance information storage unit that stores maintenance information related to past events occurring with the device. The information acquisition unit retrieves maintenance information associated with the query content from the maintenance information storage unit based on the query content.

5. The user assistance device according to claim 1, characterized in that, The query retrieval unit obtains the query information through at least one of character input and voice input.

6. The user assistance device according to claim 1, characterized in that, The user assistance device also includes: The trigger generation unit, based on the device information obtained by the information acquisition unit, decides to perform a query; and The query generation unit generates a query based on the device information when the trigger generation unit decides to perform a query. The query is performed automatically based on the query generated by the query generation unit.

7. The user assistance device according to claim 6, characterized in that, When an anomaly is detected in the device based on the device information, the trigger generation unit decides to perform a query.

8. The user assistance device according to claim 1, characterized in that, The user assistance device also includes: The user information acquisition unit acquires user information, which is related to the user operating the device. The prompt generation unit includes the user information in the prompt to be generated.

9. The user assistance device according to claim 1, characterized in that, The interaction unit accepts input for repeated queries in response to the output response and instructs the prompt generation unit to generate prompts based on the accepted repeated queries.

10. The user assistance device according to claim 1, characterized in that, The information acquisition unit acquires information related to multiple devices. The query acquisition unit selects the query object from among the multiple devices.

11. A control device for an apparatus, characterized in that, The device has the functions of the user assistance device as described in claim 1.

12. A user assistance method, characterized in that, Have the computer perform the following steps: Obtain device information that includes at least one of the following: specification information, operation information, and maintenance information related to the device being queried; Retrieve query information that includes query content expressed in natural language; Based on the device information and the query information, a prompt that can be input to the conversational response device is generated; Send the prompt to the conversational response device; Receive a response from the conversational response device; as well as Output the received response.

13. An information processing system, characterized in that, have: The user assistance device according to any one of claims 1 to 10; and The dialog-type response device.

14. The information processing system according to claim 13, characterized in that, The conversational response device generates the response by inputting the prompt into a language model.

15. An information processing system, characterized in that, have: The user assistance device according to any one of claims 1 to 10; and The device that becomes the object of the query.

Images