Speech processing device and computer-readable recording medium

Abstract

A speech processing device according to the present disclosure comprises: an operation content acquisition unit which acquires, on the basis of a speech content which is uttered by an operator and speech commands in which speech contents and operation contents are associated with each other, an operation content associated with the speech content; a machine state acquisition unit which acquires a state of an industrial machine to be instructed to perform the operation content; a first determination unit which determines whether or not a first operation condition for performing the operation content by using the industrial machine is satisfied; a notification unit which, when it is determined that the first operation condition is not satisfied, notifies the operator as such; a second determination unit which determines whether or not a second operation condition has been satisfied at a prescribed timing after the notification unit notifies the operator that the first operation condition for performing the operation content by using the industrial machine is not satisfied; and an operation content instruction unit which, when it is determined that the first operation condition is satisfied or it is determined that the second operation condition has been satisfied, instructs the industrial machine to perform the operation content.

Description

Voice processing device and computer-readable recording medium

[0001] The present disclosure relates to a voice processing device and a computer-readable recording medium.

[0002] In a manufacturing site where industrial machines such as machine tools and robots are installed, the operation of the industrial machine may be controlled based on the voice content spoken by the user (for example, Patent Document 1, etc.). When a voice command linking the voice content and the operation content of the industrial machine is executed, the recognized voice content is called back and confirmed.

[0003] Japanese Patent Application Laid-Open No. 2020-042420

[0004] There may be a problem if the operation content is executed without the operator noticing whether there is a problem in the execution of the operation content of the voice command. In the field, a mechanism that can confirm the operation content of the voice command for the situation is desired.

[0005] The voice processing device according to the present disclosure solves the above problems by determining whether notification to the operator is necessary before executing the operation content of the voice command and notifying.

[0006] Furthermore, one aspect of the present disclosure is a voice processing device comprising: an action content acquisition unit that acquires an action content linked to voice content based on a voice command linking voice content and action content, and voice content spoken by an operator; a machine state acquisition unit that acquires the machine state of an industrial machine that is the target of the instruction to perform the action content; a first determination unit that determines from the action content and the machine state whether a first operation condition for performing the action content in the industrial machine is met; a notification unit that notifies the operator if the first determination unit determines that the first operation condition is not met; a second determination unit that determines at a predetermined timing whether a second operation condition is met after the notification unit has notified the operator that the first operation condition for performing the action content in the industrial machine is not met; and an action content command unit that commands the industrial machine to perform the action content if the first determination unit determines that the first operation condition is met, or if the second determination unit determines that the second operation condition is met.

[0007] This is a schematic hardware configuration diagram of a voice processing device according to one embodiment of the present disclosure. This is a block diagram showing the schematic functions of the voice processing device according to the first embodiment. This is a table diagram showing examples of voice commands stored in the voice command storage unit. This is a table diagram showing examples of operating conditions stored in the operating condition storage unit. This is a block diagram showing the schematic functions of the voice processing device according to the second embodiment. This is a block diagram showing the schematic functions of the voice processing device according to the third embodiment. This is a block diagram showing the schematic functions of the voice processing device according to the fourth embodiment. This is a table diagram showing other examples of operating conditions stored in the operating condition storage unit.

[0008] Embodiments of this disclosure will be described below with reference to the drawings. In the following description, components having the same or similar functions will be denoted by the same reference numerals. Duplication of these components may be omitted.

[0009] In this application, "based on XX" means "based on at least XX," and includes cases where it is based on another element in addition to XX. Furthermore, "based on XX" is not limited to cases where XX is used directly, but also includes cases where it is based on something that has been calculated or processed. "XX" is any element (for example, any information).

[0010] [First Embodiment] Figure 1 is a schematic hardware configuration diagram showing the main parts of an audio processing device according to the first embodiment of the present disclosure. The audio processing device 1 according to this embodiment can be implemented, for example, on a control device that controls industrial machinery. The audio processing device 1 can also be implemented on a computer such as a personal computer attached to the control device, or a personal computer, cell computer, fog computer 6, or cloud server 7 connected to the control device via a wired / wireless network. In this embodiment, an example is shown in which the audio processing device 1 is implemented on a computer connected to a control device that controls industrial machinery via a network.

[0011] The CPU 11 in the audio processing device 1 according to this embodiment is a processor that controls the audio processing device 1 as a whole. The CPU 11 reads the system program stored in the ROM 12 via the bus 22 and controls the entire audio processing device 1 according to the system program. The RAM 13 temporarily stores temporary calculation data, display data, and various data acquired from external sources.

[0012] The non-volatile memory 14 is composed of, for example, a memory backed up by a battery (not shown) or an SSD (Solid State Drive), and its stored state is maintained even when the power to the audio processing device 1 is turned off. The non-volatile memory 14 stores programs and data read from external devices 72 via the interface 15, programs and data input via the input device 71, and programs and data acquired from the control device 3 that controls the industrial machine 4 or other devices via the network 5. The programs and data stored in the non-volatile memory 14 may be expanded into the RAM 13 when executed or used. In addition, various system programs, such as known analysis programs, are pre-written in the ROM 12.

[0013] Interface 15 is an interface for connecting the CPU 11 of the audio processing device 1 to an external device 72 such as a USB device. System programs, configuration data, etc., can be read from the external device 72. Furthermore, programs and configuration data created or edited within the audio processing device 1 can be stored in external storage means via the external device 72.

[0014] Interface 20 is an interface for connecting the CPU 11 of the voice processing device 1 to a wired or wireless network 5. The network 5 may communicate using technologies such as serial communication (RS-485, for example), Ethernet® communication, optical communication, wireless LAN, Wi-Fi®, Bluetooth®, etc. A control device 3 that controls at least one industrial machine 4, a fog computer 6, a cloud server 7, a terminal 8, etc. are connected to the network 5 and exchange data with the voice processing device 1.

[0015] The display device 70 displays data obtained as a result of the execution of various data, programs, etc., loaded into memory, via the interface 17. In addition, the input device 71, which consists of at least one input device such as a keyboard, pointing device, voice input device, and imaging device, passes commands, data, etc., based on user operations to the CPU 11 via the interface 18.

[0016] Terminal 8 is a computer, such as a personal computer or mobile terminal, operated by the operator. In this embodiment, terminal 8 is connected to the voice processing device 1 via the network 5 for communication, but for example, terminal 8 may be a pendant connected to a predetermined interface of the voice processing device 1. Terminal 8 has the function of acquiring the voice spoken by the operator and recognizing the content of that voice. Terminal 8 converts the recognized voice content into data, for example, a string of characters representing the voice content. Terminal 8 outputs the recognized voice content to the voice processing device 1. Furthermore, terminal 8 is configured to display notifications received from the voice processing device 1 and to transmit commands from the operator to the voice processing device 1 via an input device (not shown) provided in terminal 8.

[0017] Figure 2 is a schematic block diagram showing the functions of the voice processing device 1 according to the first embodiment of this disclosure. Each function of the voice processing device 1 according to this embodiment is realized by the CPU 11 of the voice processing device 1 shown in Figure 1 executing a system program and controlling the operation of each part of the voice processing device 1.

[0018] The voice processing device 1 of this embodiment includes an operation content acquisition unit 110, a machine state acquisition unit 120, a first determination unit 130, a notification unit 140, a second determination unit 150, and an operation content command unit 160. Furthermore, the RAM 13 to non-volatile memory 14 of the voice processing device 1 is provided with a voice command storage unit 200, which is an area for storing multiple voice commands in advance, and an operation condition storage unit 210, which is an area for storing multiple first operation conditions that define the relationship between operation content and machine state in advance.

[0019] The operation content acquisition unit 110 acquires operation content associated with voice content based on voice commands stored in the voice command storage unit 200 and voice content spoken by the operator. The voice content spoken by the operator is received from the terminal 8. Voice commands are those that link voice content to operation content. Figure 3 is a table diagram showing an example of voice commands stored in the voice command storage unit 200. As illustrated in Figure 3, the voice command storage unit 200 stores multiple voice commands that can be processed by the voice processing device 1. For example, when the voice content "cycle start" is received from the terminal 8, the operation content acquisition unit 110 refers to the voice command storage unit 200 and acquires operation content "automatic operation start" associated with the voice content "cycle start". Note that in Figure 3, operation content is shown in general natural language for clarity, but operation content may be a command to the control device 3 that controls the industrial machine 4. The operation content acquisition unit 110 outputs the acquired operation content to the machine state acquisition unit 120 and the first determination unit 130.

[0020] [Correction based on Rule 91 17.04.2026] The machine state acquisition unit 120 acquires the machine state of the industrial machine 4 from the industrial machine 4 that is the target of the instruction to perform the operation content acquired by the operation content acquisition unit 110. The machine state acquisition unit 120 acquires the machine state of the industrial machine 4 from the control device 3 that controls the industrial machine 4 via the network 5. The machine state includes, for example, the operating mode of the industrial machine 4 (manual operation mode, MDI operation mode, automatic operation mode, etc.), operating status (stopped, running, etc.), setting values ​​of each parameter, status of each signal, operating status of each motor, modal value, status of each peripheral device, detection values ​​of each attached sensor, etc. The machine state acquisition unit 120 may acquire only the machine state related to the operation content acquired by the operation content acquisition unit 110. In this case, the machine state acquisition unit 120 identifies the machine state related to the acquired operation content by, for example, referring to the operation condition storage unit 210. Then, it acquires the identified machine state from the control device 3 related to the industrial machine 4. The machine status acquisition unit 120 outputs the acquired machine status to the first determination unit 130.

[0021] The first determination unit 130 determines whether the first operating conditions for performing the operation in the industrial machine 4 are met, based on the operation content acquired by the operation content acquisition unit 110 and the machine state acquired by the machine state acquisition unit 120. The first determination unit 130 determines whether the first operating conditions for performing the operation in the industrial machine 4 are met by, for example, referring to the operation condition storage unit 210 and determining whether the machine state of the industrial machine 4 satisfies the conditions for performing the operation. If the first determination unit 130 determines that the first operating conditions are not met, it outputs the determination result to the notification unit 140. If the first determination unit 130 determines that the first operating conditions are met, it outputs the determination result to the operation content command unit 160.

[0022] Figure 4 is a table diagram showing an example of a first operating condition stored in the operating condition storage unit 210. The first operating condition stored in the operating condition storage unit 210 associates an operation with the conditions related to the mechanical state required to perform that operation. The first operating condition may include multiple conditions. It may also be a condition in which multiple conditions are associated with a logical operator. In the example in Figure 4, for example, in order to start automatic driving, the first operating condition is that the safety door is closed and the override is set to 100%, etc., all of which must be met simultaneously. The first operating condition may be stored in the form of a table, as illustrated in Figure 4, or it may be implemented in the form of logic such as program code or logic circuits.

[0023] The notification unit 140 notifies the operator if the first determination unit 130 determines that the first operating conditions related to the operation have not been met. It also notifies the second determination unit 150 that it has notified the operator. The notification unit 140 may also notify the operator by sending a message to the terminal 8 via the network 5 stating that the first operating conditions necessary to perform the operation have not been met. At this time, the terminal 8 may display on a display device (not shown) that the first operating conditions necessary to perform the operation have not been met. Alternatively, it may output a voice message from an audio output device (not shown) stating that the first operating conditions necessary to perform the operation have not been met. For example, suppose the operating conditions illustrated in Figure 4 are set, and the operator says "cycle start". At this time, suppose the safety door is closed in the machine state, but the override is not 100%. In such a case, the notification unit 140 notifies the terminal 8 with the message "Override is not 100%". Upon seeing this notification, the operator can take action, such as operating the control panel of industrial machine 4 to set the override to 100%.

[0024] The second determination unit 150 determines whether the second operating condition has been met at a predetermined timing after the notification unit 140 has notified the operator that the first operating condition for performing the operation in the industrial machine 4 has not been met. This predetermined timing may be at predetermined intervals, or it may be at the timing when any external command, message, or instruction is received. The second operating condition may be, for example, confirmation that the first operating condition has been met after notification by the notification unit 140. Alternatively, it may be, for example, a state that can be considered to have been met after notification. Furthermore, it may be, for example, confirmation that a state has been reached after notification where some or all of the first operating condition can be ignored. If the second determination unit 150 determines that the second operating condition has been met, it outputs the determination result to the operation content command unit 160.

[0025] The operation command unit 160 commands the industrial machine 4 to perform the operation acquired by the operation acquisition unit 110 when the first determination unit 130 determines that the first operation condition has been met, or when the second determination unit 150 determines that the second operation condition has been met. The operation command unit 160 also commands the control device 3, which controls the industrial machine 4, for example via the network 5, to perform the operation. Upon receiving this command, the control device 3 controls the industrial machine 4 to perform the commanded operation.

[0026] The voice processing device 1 according to this embodiment, with the above configuration, allows the operator to notice if there is a problem in executing the action of the voice command when operating the industrial machine 4 by voice command. Furthermore, since the execution of the action of the voice command is suspended until the conditions for execution of the action are met, safety is improved.

[0027] [Second Embodiment] The following describes a second embodiment of the audio processing device according to the present disclosure. The audio processing device 1 according to this embodiment has the same hardware configuration as the audio processing device 1 according to the first embodiment.

[0028] Figure 5 is a schematic block diagram showing the functions of the voice processing device 1 according to the second embodiment of this disclosure. Each function of the voice processing device 1 according to this embodiment is realized by the CPU 11 of the voice processing device 1 shown in Figure 1 executing a system program and controlling the operation of each part of the voice processing device 1.

[0029] The voice processing device 1 of this embodiment, like the voice processing device 1 of the first embodiment, includes an operation content acquisition unit 110, a machine state acquisition unit 120, a first determination unit 130, a notification unit 140, a second determination unit 150, and an operation content command unit 160. Furthermore, the RAM 13 to non-volatile memory 14 of the voice processing device 1 is provided with a voice command storage unit 200, which is an area for storing multiple voice commands in advance, and an operation condition storage unit 210, which is an area for storing multiple first operation conditions that define the relationship between operation content and machine state in advance.

[0030] The operation content acquisition unit 110, the first determination unit 130, and the operation content command unit 160 of the voice processing device 1 according to this embodiment are the same as the functions of the first embodiment.

[0031] In this embodiment, the notification unit 140 notifies the operator if the first determination unit 130 determines that the first operating condition related to the operation content has not been met. It also notifies the second determination unit 150 and the machine status acquisition unit 120 that it has notified the operator.

[0032] In this embodiment, the machine status acquisition unit 120, upon receiving a notification from the notification unit 140, repeatedly acquires the machine status of the industrial machine 4 at a predetermined interval. It then outputs the acquired machine status of the industrial machine 4 to the second determination unit 150. This predetermined interval may be set by parameters or the like. Furthermore, the interval may differ depending on the type of machine status to be acquired.

[0033] In this embodiment, the second determination unit 150 determines whether a second operating condition has been met at a predetermined timing after the notification unit 140 has notified the operator that the first operating condition for performing the operation on the industrial machine 4 has not been met. In this embodiment, the predetermined timing is the timing when the machine state acquisition unit 120 newly acquires the machine state. The second operating condition is that it has been confirmed that the first operating condition for performing the operation on the industrial machine 4 has been met. With this configuration, the voice processing device 1 continues to monitor the machine state of the industrial machine 4 after notifying the operator that the first operating condition for performing the operation on the industrial machine 4 has not been met. When it determines that the industrial machine 4 can perform the operation, it commands the control device 3 of the industrial machine 4 to perform the operation.

[0034] The voice processing device 1 according to this embodiment, with the above configuration, allows the operator to notice if there is a problem in executing the voice command when operating the industrial machine 4 by voice command. Then, when the operator changes the problematic settings by operating the control device 3 or the industrial machine 4 and the machine becomes in a state where the operation can be performed, the operation is automatically executed, thus achieving both safety and convenience.

[0035] [Third Embodiment] The following describes a third embodiment of the present disclosure of an audio processing device. The audio processing device 1 according to this embodiment has the same hardware configuration as the audio processing device 1 according to the first embodiment.

[0036] Figure 6 is a schematic block diagram showing the functions of the voice processing device 1 according to the third embodiment of this disclosure. Each function of the voice processing device 1 according to this embodiment is realized by the CPU 11 of the voice processing device 1 shown in Figure 1 executing a system program and controlling the operation of each part of the voice processing device 1.

[0037] The voice processing device 1 of this embodiment includes an operation content acquisition unit 110, a machine state acquisition unit 120, a first determination unit 130, a notification unit 140, a second determination unit 150, and an operation content command unit 160, as well as a recognition unit 170. Furthermore, the RAM 13 to non-volatile memory 14 of the voice processing device 1 is provided with a voice command storage unit 200, which is an area for storing multiple voice commands in advance, and an operation condition storage unit 210, which is an area for storing multiple first operation conditions that define the relationship between operation content and machine state in advance.

[0038] The voice processing device 1 according to this embodiment includes the same functions as those of the first embodiment, including the operation content acquisition unit 110, the machine state acquisition unit 120, the first determination unit 130, the notification unit 140, and the operation content command unit 160.

[0039] The recognition unit 170 receives a command from the operator. This command is transmitted from the terminal 8 to the voice processing device 1 via the network 5, for example, based on the operator's operation of the terminal 8. This command includes information indicating, for example, that the machine status of the industrial machine 4 has changed. When the recognition unit 170 receives a command from the operator, it outputs a message to the second determination unit 150 indicating that it has received the command.

[0040] In this embodiment, the second determination unit 150 determines whether the second operation condition has been met at a predetermined timing after the notification unit 140 has notified the operator that the first operation condition for performing the operation on the industrial machine 4 has not been met. In this embodiment, the predetermined timing is the timing when the recognition unit 170 receives a command from the operator. The second operation condition is that the received command indicates that the machine state of the industrial machine 4 has changed. With this configuration, the voice processing device 1 notifies the operator that the first operation condition for performing the operation on the industrial machine 4 has not been met, and then, when the operator gives a command indicating that the machine state has been changed, it instructs the control device 3 of the industrial machine 4 to perform the operation.

[0041] Furthermore, the second determination unit 150 may, once it has confirmed that the command received by the recognition unit 170 indicates a change in the machine state of the industrial machine 4, further check the machine state of the industrial machine 4. In this case, the second determination unit 150 instructs the machine state acquisition unit 120 to acquire the machine state of the industrial machine 4 again. Based on the acquired machine state, it then determines whether the industrial machine 4 can perform the operation, and if there is no problem, it outputs to the operation content command unit 160 that the second operation condition has been met.

[0042] The voice processing device 1 according to this embodiment, with the above configuration, allows the operator to notice if there is a problem with the execution of the voice command when operating the industrial machine 4 by voice command. When the operator changes the problematic settings by operating the control device 3 or the industrial machine 4 and notifies the voice processing device of the change, the operation is automatically executed, thus achieving both safety and convenience.

[0043] [Fourth Embodiment] Hereinafter, a voice processing apparatus according to the fourth embodiment of the present disclosure will be described. The voice processing apparatus 1 according to the present embodiment has the same hardware configuration as the voice processing apparatus 1 according to the first embodiment.

[0044] FIG. 7 shows a schematic block diagram of the functions of the voice processing apparatus 1 according to the fourth embodiment of the present disclosure. Each function of the voice processing apparatus 1 according to the present embodiment is realized by the CPU 11 included in the voice processing apparatus 1 shown in FIG. 1 executing a system program and controlling the operations of each part of the voice processing apparatus 1.

[0045] The voice processing apparatus 1 of the present embodiment includes an operation content acquisition unit 110, a machine state acquisition unit 120, a first determination unit 130, a notification unit 140, a second determination unit 150, an operation content command unit 160, and a recognition unit 170, similar to the voice processing apparatus according to the third embodiment. Further, in the RAM 13 to the non-volatile memory 14 of the voice processing apparatus 1, a voice command storage unit 200, which is an area for storing a plurality of voice commands in advance, and an operation condition storage unit 210, which is an area for storing a plurality of first operation conditions for defining the relationship between the operation content and the machine state in advance, are prepared.

[0046] The operation content acquisition unit 110, the machine state acquisition unit 120, the first determination unit 130, the notification unit 140, and the operation content command unit 160 included in the voice processing apparatus 1 according to the present embodiment have the same functions as those in the second embodiment.

[0047] The recognition unit 170 according to the present embodiment receives a command from the operator. This command is transmitted from the terminal 8 to the voice processing apparatus 1 via the network 5, for example, based on an operation of the terminal 8 by the operator. This command includes information for forcing, for example, the implementation of the operation content. The recognition unit 170 outputs to the second determination unit 150 that it has received a command from the operator.

[0048] After the notification unit 140 notifies the operator that the first operating condition for the operation content to be performed by the industrial machine 4 is not satisfied, the second determination unit 150 according to this embodiment determines whether the second operating condition is satisfied at a predetermined timing. In this embodiment, the predetermined timing is the timing when the recognition unit 170 receives a command from the operator. Further, the second operating condition is such that the received command forces the implementation of the operation content, and even if the first operating condition that is not satisfied at the current time is not satisfied, the implementation of the operation content can be forced.

[0049] FIG. 8 is a table diagram showing another example of the first operating condition stored in the operating condition storage unit 210. The first operating conditions illustrated in FIG. 8 are added with information indicating whether each condition is "essential" or "recommended" for performing the operation content. When the command received by the recognition unit 170 forces the implementation of the operation content, the second determination unit 150 checks whether the first operating condition that is not satisfied at the current time is "recommended". Then, if the conditions that are not satisfied are "recommended", it is determined that the implementation of the operation content can be forced even if those conditions are not satisfied. Then, the second determination unit 150 outputs to the operation content command unit 160 that the second operating condition is satisfied, regarding the first operating condition that is not satisfied as ignorable.

[0050] With the above configuration, the voice processing apparatus 1 according to this embodiment can enable the operator to notice whether there is a problem in the implementation of the operation content of the voice command when operating the industrial machine 4 by voice command. And when the problem can be ignored, the operator can force the voice processing apparatus 1 to implement the operation content. Therefore, it is possible to achieve both safety and convenience and to perform flexible operation according to the situation.

[0051] While embodiments of this disclosure have been described in detail above, this disclosure is not limited to the individual embodiments described above. These embodiments can be added, replaced, modified, partially deleted, etc., in any way that does not depart from the spirit of the invention or from the idea and intent of this disclosure derived from the claims and their equivalents. For example, the order of operations and processes in the embodiments described above are shown as examples only and are not limited thereto. The same applies when numerical values ​​or mathematical formulas are used in the description of the embodiments described above.

[0052] The following are additional notes regarding embodiments of the present disclosure. (Addendum 1) An audio processing device (1) according to one aspect of the present disclosure includes an action content acquisition unit (110) that acquires an action content associated with the voice content based on an audio command that associates voice content and action content and voice content spoken by an operator, The system includes: a machine state acquisition unit (120) that acquires the machine state of the industrial machine (4) that is the target of the instruction to perform the aforementioned operation; a first determination unit (130) that determines whether a first operating condition for performing the operation in the industrial machine (4) is met based on the operation content and the machine state; a notification unit (140) that notifies the operator if the first determination unit (130) determines that the first operating condition is not met; a second determination unit (150) that determines whether a second operating condition is met at a predetermined timing after the notification unit (140) has notified the operator that the first operating condition for performing the operation in the industrial machine (4) is not met; and an operation content command unit (160) that commands the industrial machine (4) to perform the operation if the first determination unit (130) determines that the first operating condition is met, or if the second determination unit (150) determines that the second operating condition is met.

[0053] (Note 2) The machine state acquisition unit (120) of the voice processing device (1) in another aspect of the present disclosure continues to acquire the machine state of the industrial machine (4) at a predetermined interval when the first determination unit (130) determines that the first operating condition has not been met, the predetermined timing being the timing when the machine state acquisition unit (120) newly acquires the machine state of the industrial machine (4), and the second operating condition being that the first operating condition has been met, based on the operation content and the machine state, so that the industrial machine (4) can perform the operation content.

[0054] (Note 3) A voice processing device (1) according to another aspect of the present disclosure further comprises a recognition unit (170) that receives a command from the operator, wherein the predetermined timing is the timing at which the recognition unit (170) receives the command from the operator, and the second operating condition is that the received command indicates that the mechanical state of the industrial machine (4) has changed.

[0055] (Note 4) The second determination unit (150) of the audio processing device (1) according to another embodiment of the present disclosure, when the second operating condition is met, instructs the machine state acquisition unit (120) to acquire the machine state of the industrial machine (4) and confirms whether the first operating condition has been met, before outputting a statement to the operation content command unit (160) indicating that the condition has been met.

[0056] (Note 5) A voice processing device (1) according to another aspect of the present disclosure further comprises a recognition unit (170) that receives a command from the operator, wherein the predetermined timing is the timing at which the recognition unit (170) receives the command from the operator, and the second operating condition is that the received command compels the execution of the operation, and the operation can be executed even if the first operating condition is not met.

[0057] (Note 6) A computer-readable recording medium according to one aspect of the present disclosure includes: an operation content acquisition unit (110) that acquires operation content associated with voice content based on a voice command that links voice content and operation content and voice content spoken by an operator; a machine state acquisition unit (120) that acquires the machine state of an industrial machine (4) that is the target of the instruction to perform the operation content; a first determination unit (130) that determines from the operation content and the machine state whether a first operation condition for performing the operation content in the industrial machine (4) is met; and when the first determination unit (130) determines that the first operation condition is not met, The system records a program that operates as follows: a notification unit (140) that notifies the operator of this fact; a second determination unit (150) that, after the notification unit (140) notifies the operator that the first operating condition for the industrial machine (4) to perform the operation has not been met, determines at a predetermined timing whether the second operating condition has been met; and an operation content command unit (160) that commands the industrial machine (4) to perform the operation if the first determination unit (130) determines that the first operating condition has been met, or if the second determination unit (150) determines that the second operating condition has been met.

[0058] 1. Voice processing device 3. Control device 4. Industrial machine 5. Network 6. Fog computer 7. Cloud server 8. Terminal 11. CPU 12. ROM 13. RAM 14. Non-volatile memory 15, 17, 18, 20. Interface 22. Bus 70. Display device 71. Input device 72. External device 110. Operation content acquisition unit 120. Machine status acquisition unit 130. First judgment unit 140. Notification unit 150. Second judgment unit 160. Operation content command unit 170. Recognition unit 200. Voice command storage unit 210. Operation condition storage unit

Claims

1. A voice processing device comprising: an action content acquisition unit that acquires action content associated with voice content based on a voice command linking voice content and action content and voice content spoken by an operator; a machine state acquisition unit that acquires the machine state of an industrial machine that is the target of the instruction to perform the action content; a first determination unit that determines from the action content and the machine state whether a first action condition for performing the action content in the industrial machine is met; a notification unit that notifies the operator if the first determination unit determines that the first action condition is not met; a second determination unit that determines at a predetermined timing whether a second action condition is met after the notification unit has notified the operator that the first action condition for performing the action content in the industrial machine is not met; and an action content command unit that commands the industrial machine to perform the action content if the first determination unit determines that the first action condition is met, or if the second determination unit determines that the second action condition is met.

2. The machine state acquisition unit continues to acquire the machine state of the industrial machine at a predetermined interval when the first determination unit determines that the first operating condition is not met, the predetermined timing being the timing when the machine state acquisition unit newly acquires the machine state of the industrial machine, and the second operating condition being that the first operating condition is met, based on the operating content and the machine state, so that the industrial machine can perform the operating content. The voice processing device according to claim 1.

3. The voice processing device according to claim 1, further comprising a recognition unit for receiving commands from the operator, wherein the predetermined timing is the timing at which the recognition unit receives the operator's command, and the second operating condition is that the received command indicates a change in the mechanical state of the industrial machine.

4. The audio processing device according to claim 3, wherein, when the second determination unit is found to be found, before outputting a statement to the operation content command unit indicating that the second operating condition is found, it commands the machine state acquisition unit to acquire the machine state of the industrial machine and confirms whether or not the first operating condition has been found.

5. The voice processing device according to claim 1, further comprising a recognition unit for receiving commands from the operator, wherein the predetermined timing is the timing at which the recognition unit receives the operator's command, and the second operating condition is that the received command compels the execution of the operation, and the operation can be executed even if the first operating condition is not met.

6. A computer-readable recording medium that records a program causing a computer to operate as follows: an action content acquisition unit that acquires action content associated with voice content based on voice commands linking voice content and action content and voice content spoken by an operator; a machine state acquisition unit that acquires the machine state of an industrial machine that is the target of the instruction to perform the action content; a first determination unit that determines whether a first operation condition for performing the action content in the industrial machine is met based on the action content and the machine state; a notification unit that notifies the operator if the first determination unit determines that the first operation condition is not met; a second determination unit that determines whether a second operation condition is met at a predetermined timing after the notification unit has notified the operator that the first operation condition for performing the action content in the industrial machine is not met; and an action content command unit that commands the industrial machine to perform the action content if the first determination unit determines that the first operation condition is met, or if the second determination unit determines that the second operation condition is met.

Images