Speech processing device and computer-readable recording medium

Abstract

A speech processing device according to the present disclosure comprises: an operation content acquisition unit which acquires, on the basis of a speech content which is uttered by an operator and speech commands in which speech contents and operation contents are associated with each other, an operation content associated with the speech content; a machine state acquisition unit which acquires a state of an industrial machine to be instructed to perform the operation content; a first determination unit which determines whether or not a first operation condition for performing the operation content by using the industrial machine is satisfied; a notification unit which, when it is determined that the first operation condition is not satisfied, notifies the operator as such; a second determination unit which determines whether or not a second operation condition has been satisfied at a prescribed timing after the notification unit notifies the operator that the first operation condition for performing the operation content by using the industrial machine is not satisfied; and an operation content instruction unit which, when it is determined that the first operation condition is satisfied or it is determined that the second operation condition has been satisfied, instructs the industrial machine to perform the operation content.

Description

Audio processing device and computer-readable recording medium

[0001] The present disclosure relates to an audio processing device and a computer-readable recording medium.

[0002] At manufacturing sites where industrial machines such as machine tools and robots are installed, the operation of the industrial machines may be controlled based on the content of voice spoken by a user (see, for example, Patent Document 1).When a voice command linking the voice content with the operation content of the industrial machine is executed, the voice content recognized by the voice recognition is called back and confirmed.

[0003] Japanese Patent Application Laid-Open No. 2020-042420

[0004] Problems may arise if an operator executes an operation command without realizing whether there is a problem with the execution of the operation command. Therefore, a system that allows the operator to check the operation command in relation to the situation is desired on-site.

[0005] The voice processing device according to the present disclosure solves the above problem by determining whether or not a notification is necessary for the operator before carrying out the operation content of the voice command, and notifying the operator accordingly.

[0006] One aspect of the present disclosure is a voice processing device including: an operation content acquisition unit that acquires operation content linked to voice content based on a voice command linking the voice content and the operation content and the voice content uttered by an operator; a machine state acquisition unit that acquires a machine state of an industrial machine that is to be instructed to perform the operation content; a first determination unit that determines whether a first operation condition for performing the operation content on the industrial machine is satisfied based on the operation content and the machine state; a notification unit that notifies the operator, if the first determination unit determines that the first operation condition is not satisfied, of this fact; a second determination unit that determines, at a predetermined timing after the notification unit notifies the operator that the first operation condition for performing the operation content on the industrial machine is not satisfied; and an operation content command unit that commands the industrial machine to perform the operation content, if the first determination unit determines that the first operation condition is satisfied or if the second determination unit determines that the second operation condition is satisfied.

[0007] FIG. 1 is a schematic hardware configuration diagram of a voice processing device according to an embodiment of the present disclosure; FIG. 2 is a block diagram showing schematic functions of a voice processing device according to a first embodiment; FIG. 3 is a table diagram showing examples of voice commands stored in a voice command storage unit; FIG. 4 is a table diagram showing examples of operating conditions stored in an operating condition storage unit; FIG. 5 is a block diagram showing schematic functions of a voice processing device according to a second embodiment; FIG. 6 is a block diagram showing schematic functions of a voice processing device according to a third embodiment; FIG. 7 is a block diagram showing schematic functions of a voice processing device according to a fourth embodiment; and FIG. 8 is a table diagram showing other examples of operating conditions stored in an operating condition storage unit.

[0008] Hereinafter, embodiments of the present disclosure will be described with reference to the drawings. In the following description, components having the same or similar functions will be denoted by the same reference numerals. Duplicate descriptions of those components may be omitted.

[0009] In this application, "based on XX" means "based on at least XX," and includes cases where it is based on other elements in addition to XX. Furthermore, "based on XX" is not limited to cases where XX is used directly, but also includes cases where it is based on XX that has been calculated or processed. "XX" is any element (for example, any information).

[0010] [First Embodiment] Fig. 1 is a schematic hardware configuration diagram showing the main parts of a voice processing device according to a first embodiment of the present disclosure. The voice processing device 1 according to this embodiment can be implemented, for example, on a control device that controls industrial machinery. The voice processing device 1 can also be implemented, for example, on a personal computer attached to the control device, or on a computer such as a personal computer, a cell computer, a fog computer 6, or a cloud server 7 connected to the control device via a wired or wireless network. This embodiment shows an example in which the voice processing device 1 is implemented on a computer connected to the control device that controls industrial machinery via a network.

[0011] The CPU 11 included in the voice processing device 1 according to this embodiment is a processor that controls the entire voice processing device 1. The CPU 11 reads a system program stored in the ROM 12 via the bus 22 and controls the entire voice processing device 1 in accordance with the system program. The RAM 13 temporarily stores temporary calculation data, display data, various data acquired from the outside, and the like.

[0012] The non-volatile memory 14 is composed of, for example, a battery-backed memory (not shown) or an SSD (Solid State Drive), and retains its stored state even when the power to the voice processing device 1 is turned off. The non-volatile memory 14 stores programs and data read from an external device 72 via the interface 15, programs and data input via the input device 71, and programs and data acquired from the control device 3 that controls the industrial machine 4 or other devices via the network 5. The programs and data stored in the non-volatile memory 14 may be expanded into the RAM 13 when executed / used. In addition, various system programs such as known analysis programs are written in the ROM 12 in advance.

[0013] The interface 15 is an interface for connecting the CPU 11 of the audio processing device 1 to an external device 72 such as a USB device. For example, system programs, setting data, etc. are read from the external device 72. In addition, programs and setting data created or edited within the audio processing device 1 can be stored in external storage means via the external device 72.

[0014] The interface 20 is an interface for connecting the CPU 11 of the voice processing device 1 to a wired or wireless network 5. The network 5 may communicate using technologies such as serial communication such as RS-485, Ethernet (registered trademark), optical communication, wireless LAN, Wi-Fi (registered trademark), Bluetooth (registered trademark), etc. The network 5 is connected to a control device 3 that controls at least one industrial machine 4, a fog computer 6, a cloud server 7, a terminal 8, etc., and exchanges data with the voice processing device 1.

[0015] The display device 70 displays data and the like obtained as a result of executing various data and programs loaded into the memory, output via the interface 17. An input device 71, which is composed of at least one input device such as a keyboard, a pointing device, a voice input device, an imaging device, etc., passes commands, data, etc. based on user operations to the CPU 11 via the interface 18.

[0016] The terminal 8 is a computer such as a personal computer or a mobile terminal operated by an operator. The terminal 8 according to this embodiment is communicably connected to the voice processing device 1 via the network 5, but may also be, for example, a pendant connected to a predetermined interface of the voice processing device 1. The terminal 8 has a function of acquiring voice spoken by the operator and recognizing the content of the voice. The terminal 8 converts the recognized voice content into, for example, character string data representing the voice content. The terminal 8 outputs the recognized voice content to the voice processing device 1. The terminal 8 is also configured to display notifications received from the voice processing device 1 and transmit to the voice processing device 1 instructions from the operator input via an input device (not shown) provided in the terminal 8.

[0017] 2 is a schematic block diagram illustrating functions of the voice processing device 1 according to the first embodiment of the present disclosure. Each function of the voice processing device 1 according to this embodiment is realized by the CPU 11 included in the voice processing device 1 shown in FIG. 1 executing a system program and controlling the operation of each unit of the voice processing device 1.

[0018] The voice processing device 1 of this embodiment includes an operation content acquisition unit 110, a machine state acquisition unit 120, a first determination unit 130, a notification unit 140, a second determination unit 150, and an operation content command unit 160. The RAM 13 to the nonvolatile memory 14 of the voice processing device 1 are provided with a voice command storage unit 200, which is an area storing a plurality of voice commands in advance, and an operation condition storage unit 210, which is an area storing a plurality of first operation conditions that define the relationship between the operation content and the machine state in advance.

[0019] The operation content acquisition unit 110 acquires operation content associated with the voice content based on the voice command stored in the voice command storage unit 200 and the voice content uttered by the operator. The voice content uttered by the operator is received from the terminal 8. The voice command associates the voice content with the operation content. FIG. 3 is a table diagram showing examples of voice commands stored in the voice command storage unit 200. As illustrated in FIG. 3, the voice command storage unit 200 stores multiple voice commands that can be processed by the voice processing device 1. For example, when the voice content "cycle start" is received from the terminal 8, the operation content acquisition unit 110 refers to the voice command storage unit 200 and acquires the operation content "automatic operation start" associated with the voice content "cycle start." Note that, while FIG. 3 shows the operation content in the form of general natural language for ease of understanding, the operation content may be a command to the control device 3 that controls the industrial machine 4. The operation content acquisition unit 110 outputs the acquired operation content to the machine state acquisition unit 120 and the first determination unit 130.

[0020] The machine state acquisition unit 120 acquires the machine state of the industrial machine 4 from the industrial machine 4 that is the target of an instruction to perform the operation content acquired by the operation content acquisition unit 110. The machine state acquisition unit 120 acquires the machine state of the industrial machine 4 via the network 5 from the control device 3 that controls the industrial machine 4. The machine state includes, for example, the operation mode of the industrial machine 4 (manual operation mode, MDI operation mode, automatic operation mode, etc.), the operation state (stopped, operating, etc.), the setting values ​​of each parameter, the state of each signal, the operation state of each motor, modal values, the state of each peripheral device, and the detected values ​​of each attached sensor. The machine state acquisition unit 120 may acquire only the machine state related to the operation content acquired by the operation content acquisition unit 110. In this case, the machine state acquisition unit 120 identifies the machine state related to the acquired operation content by referring to, for example, the operating condition storage unit 210. Then, the identified machine state is acquired from the control device 3 related to the industrial machine 4. The machine state acquisition unit 120 outputs the acquired machine state to the first determination unit 130.

[0021] The first determination unit 130 determines whether a first operating condition for performing the operation content on the industrial machine 4 is satisfied, based on the operation content acquired by the operation content acquisition unit 110 and the machine state acquired by the machine state acquisition unit 120. The first determination unit 130 determines whether the first operating condition for performing the operation content on the industrial machine 4 is satisfied, for example, by referring to the operation condition storage unit 210 and determining whether the machine state of the industrial machine 4 satisfies the condition for performing the operation content. If the first determination unit 130 determines that the first operating condition is not satisfied, it outputs the determination result to the notification unit 140. If the first determination unit 130 determines that the first operating condition is satisfied, it outputs the determination result to the operation content command unit 160.

[0022] FIG. 4 is a table diagram showing an example of the first operating conditions stored in the operating condition storage unit 210. The first operating conditions stored in the operating condition storage unit 210 associate an operation content with a condition related to a machine state required to perform the operation content. The first operating condition may include multiple conditions. Furthermore, the first operating condition may be a condition in which multiple conditions are associated with each other using a logical operator. In the example of FIG. 4 , for example, to start automatic operation, the first operating condition is that the safety door is closed and the override is set to 100%. The first operating condition may be stored in the form of a table, as shown in FIG. 4 , or may be implemented in the form of logic, such as program code or a logic circuit.

[0023] When the first determination unit 130 determines that the first operating condition related to the operation content is not satisfied, the notification unit 140 notifies the operator of this. The notification unit 140 also notifies the second determination unit 150 of the notification to the operator. The notification unit 140 may notify the operator by, for example, transmitting a message to the terminal 8 via the network 5 indicating that the first operating condition required to execute the operation content is not satisfied. At this time, the terminal 8 may display on a display device (not shown) that the first operating condition required to execute the operation content is not satisfied. Alternatively, the terminal 8 may output a voice message indicating that the first operating condition required to execute the operation content is not satisfied from a voice output device (not shown). For example, when the operating conditions illustrated in FIG. 4 are set, assume that the operator utters "cycle start." At this time, assume that the safety door is closed in the machine status but the override is not 100%. In this case, the notification unit 140 notifies the terminal 8 of the message "override is not 100%." An operator who sees this notification can take action by operating the control panel of the industrial machine 4, such as setting the override to 100%.

[0024] The second determination unit 150 determines whether the second operation condition is satisfied at a predetermined timing after the notification unit 140 notifies the operator that the first operation condition for performing the operation content in the industrial machine 4 is not satisfied. This predetermined timing may be at a predetermined cycle, or may be the timing when an external command, message, or instruction is received. The second operation condition may be, for example, confirmation that the first operation condition is satisfied after the notification by the notification unit 140. Alternatively, for example, it may be confirmation that a state in which the first operation condition can be considered to be satisfied has been reached after the notification. Furthermore, for example, it may be confirmation that a state in which the first operation condition can be ignored in part or in whole has been reached after the notification. When the second determination unit 150 determines that the second operation condition is satisfied, it outputs the determination result to the operation content command unit 160.

[0025] When the first determination unit 130 determines that the first operating condition is met, or when the second determination unit 150 determines that the second operating condition is met, the operation content command unit 160 commands the industrial machine 4 to perform the operation content acquired by the operation content acquisition unit 110. The operation content command unit 160 commands the control device 3 that controls the industrial machine 4, for example, via the network 5, to perform the operation content. Upon receiving this command, the control device 3 controls the industrial machine 4 to perform the commanded operation content.

[0026] The voice processing device 1 according to this embodiment having the above configuration allows the operator to notice whether there is a problem with the execution of the operation content of the voice command when operating the industrial machine 4 using a voice command. Furthermore, the execution of the operation content of the voice command is suspended until the conditions for executing the operation content are met, thereby improving safety.

[0027] Second Embodiment A voice processing device according to a second embodiment of the present disclosure will be described below. The voice processing device 1 according to this embodiment has the same hardware configuration as the voice processing device 1 according to the first embodiment.

[0028] 5 is a schematic block diagram illustrating functions of the voice processing device 1 according to the second embodiment of the present disclosure. Each function of the voice processing device 1 according to this embodiment is realized by the CPU 11 of the voice processing device 1 shown in FIG. 1 executing a system program and controlling the operation of each unit of the voice processing device 1.

[0029] Similar to the voice processing device 1 according to the first embodiment, the voice processing device 1 according to this embodiment includes an operation content acquisition unit 110, a machine state acquisition unit 120, a first determination unit 130, a notification unit 140, a second determination unit 150, and an operation content command unit 160. The RAM 13 to the nonvolatile memory 14 of the voice processing device 1 are provided with a voice command storage unit 200, which is an area storing a plurality of voice commands in advance, and an operation condition storage unit 210, which is an area storing a plurality of first operation conditions that define the relationship between the operation content and the machine state in advance.

[0030] The operation details acquisition unit 110, the first determination unit 130, and the operation details command unit 160 included in the voice processing device 1 according to this embodiment have the same functions as those in the first embodiment.

[0031] When the first determination unit 130 determines that the first operating condition related to the operation content is not satisfied, the notification unit 140 according to this embodiment notifies the operator to that effect. The notification unit 140 also notifies the second determination unit 150 and the machine state acquisition unit 120 that the operator has been notified.

[0032] When the machine state acquisition unit 120 according to this embodiment receives a notification from the notification unit 140, it repeatedly acquires the machine state of the industrial machine 4 at a predetermined cycle. Then, it outputs the acquired machine state of the industrial machine 4 to the second determination unit 150. This predetermined cycle may be set by a parameter or the like. Furthermore, the cycle may differ depending on the type of machine state to be acquired.

[0033] The second determination unit 150 according to this embodiment determines whether the second operation condition is satisfied at a predetermined timing after the notification unit 140 notifies the operator that the first operation condition for performing the operation content on the industrial machine 4 is not satisfied. In this embodiment, the predetermined timing is the timing when the machine state acquisition unit 120 newly acquires the machine state. The second operation condition is when it is confirmed that the first operation condition for performing the operation content on the industrial machine 4 is satisfied. With this configuration, the voice processing device 1 continues to monitor the machine state of the industrial machine 4 after notifying the operator that the first operation condition for performing the operation content on the industrial machine 4 is not satisfied. Then, when it is determined that the operation content can be performed on the industrial machine 4, it commands the control device 3 of the industrial machine 4 to perform the operation content.

[0034] The voice processing device 1 according to this embodiment having the above configuration allows the operator to notice whether there is a problem with the execution of the operation content of the voice command when operating the industrial machine 4 using a voice command. Then, when the operator operates the control device 3 or the industrial machine 4 to change the problematic settings and return the machine to a state where the operation content can be executed, the operation content is automatically executed, thereby achieving both safety and convenience.

[0035] Third Embodiment A voice processing device according to a third embodiment of the present disclosure will be described below. The voice processing device 1 according to this embodiment has the same hardware configuration as the voice processing device 1 according to the first embodiment.

[0036] 6 is a schematic block diagram illustrating functions of the voice processing device 1 according to the third embodiment of the present disclosure. Each function of the voice processing device 1 according to this embodiment is realized by the CPU 11 of the voice processing device 1 shown in FIG. 1 executing a system program and controlling the operation of each unit of the voice processing device 1.

[0037] The voice processing device 1 of this embodiment includes an operation content acquisition unit 110, a machine state acquisition unit 120, a first determination unit 130, a notification unit 140, a second determination unit 150, and an operation content command unit 160, as well as a recognition unit 170. The RAM 13 to the nonvolatile memory 14 of the voice processing device 1 are provided with a voice command storage unit 200, which is an area storing a plurality of voice commands in advance, and an operation condition storage unit 210, which is an area storing a plurality of first operation conditions that define the relationship between operation content and machine state in advance.

[0038] The operation details acquisition unit 110, machine state acquisition unit 120, first determination unit 130, notification unit 140, and operation details command unit 160 provided in the voice processing device 1 according to this embodiment have the same functions as those in the first embodiment.

[0039] The recognition unit 170 receives a command from an operator. This command is transmitted from the terminal 8 to the voice processing device 1 via the network 5 based on, for example, an operation of the terminal 8 by the operator. This command includes, for example, information indicating that the machine state of the industrial machine 4 has changed. Upon receiving a command from the operator, the recognition unit 170 outputs to the second determination unit 150 a message indicating that the command has been received.

[0040] The second determination unit 150 according to this embodiment determines whether the second operation condition is satisfied at a predetermined timing after the notification unit 140 notifies the operator that the first operation condition for performing the operation content on the industrial machine 4 is not satisfied. In this embodiment, the predetermined timing is the timing when the recognition unit 170 receives a command from the operator. The second operation condition is that the received command indicates that the machine state of the industrial machine 4 has changed. With this configuration, the voice processing device 1 notifies the operator that the first operation condition for performing the operation content on the industrial machine 4 is not satisfied, and then commands the control device 3 of the industrial machine 4 to perform the operation content at the time when the operator receives a command to the effect that the machine state has changed.

[0041] Note that the second determination unit 150 may further check the machine state of the industrial machine 4 when it is confirmed that the command received by the recognition unit 170 indicates that the machine state of the industrial machine 4 has changed. In this case, the second determination unit 150 commands the machine state acquisition unit 120 to acquire the machine state of the industrial machine 4 again. Then, based on the acquired machine state, it determines whether the operation content can be performed by the industrial machine 4, and if there is no problem, outputs to the operation content command unit 160 that the second operation condition is met.

[0042] The voice processing device 1 according to this embodiment having the above configuration allows the operator to notice whether there is a problem with the execution of the operation content of the voice command when operating the industrial machine 4 using a voice command. Then, when the operator operates the control device 3 or the industrial machine 4 to change the problematic setting, etc., and notifies the voice processing device that the change has been made, the operation content is automatically executed, thereby achieving both safety and convenience.

[0043] Fourth Embodiment A speech processing device according to a fourth embodiment of the present disclosure will be described below. The speech processing device 1 according to this embodiment has the same hardware configuration as the speech processing device 1 according to the first embodiment.

[0044] 7 is a schematic block diagram illustrating functions of the voice processing device 1 according to the fourth embodiment of the present disclosure. Each function of the voice processing device 1 according to this embodiment is realized by the CPU 11 of the voice processing device 1 shown in FIG. 1 executing a system program and controlling the operation of each unit of the voice processing device 1.

[0045] Like the voice processing device according to the third embodiment, the voice processing device 1 of this embodiment includes an operation content acquisition unit 110, a machine state acquisition unit 120, a first determination unit 130, a notification unit 140, a second determination unit 150, an operation content command unit 160, and a recognition unit 170. The RAM 13 to the nonvolatile memory 14 of the voice processing device 1 are provided with a voice command storage unit 200, which is an area storing a plurality of voice commands in advance, and an operation condition storage unit 210, which is an area storing a plurality of first operation conditions that define the relationship between operation content and machine state in advance.

[0046] The operation details acquisition unit 110, machine state acquisition unit 120, first judgment unit 130, notification unit 140, and operation details command unit 160 provided in the voice processing device 1 according to this embodiment have the same functions as those of the second embodiment.

[0047] The recognition unit 170 according to this embodiment receives a command from an operator. This command is transmitted from the terminal 8 to the speech processing device 1 via the network 5, for example, based on an operation of the terminal 8 by the operator. This command includes, for example, information forcing the execution of an operation. Upon receiving a command from the operator, the recognition unit 170 outputs to the second determination unit 150 a message indicating that the command has been received.

[0048] The second determination unit 150 according to this embodiment determines whether the second operation condition is satisfied at a predetermined timing after the notification unit 140 notifies the operator that the first operation condition for performing the operation content in the industrial machine 4 is not satisfied. In this embodiment, the predetermined timing is the timing when the recognition unit 170 receives a command from the operator. Furthermore, the second operation condition is a command that forces the performance of the operation content, and is capable of forcing the performance of the operation content even if the first operation condition, which is not currently satisfied, is not satisfied.

[0049] FIG. 8 is a table diagram showing another example of first operating conditions stored in the operating condition storage unit 210. The first operating conditions shown in FIG. 8 are accompanied by information indicating whether each condition is "required" or "recommended" for executing the operation content. When the command received by the recognition unit 170 is forcing the execution of the operation content, the second determination unit 150 checks whether the currently unsatisfied first operating conditions are "recommended." If the unsatisfied conditions are "recommended," the second determination unit 150 determines that the execution of the operation content can be forced even if those conditions are not met. The second determination unit 150 then determines that the unsatisfied first operating conditions can be ignored and outputs to the operation content command unit 160 that the second operating conditions are met.

[0050] The voice processing device 1 according to this embodiment having the above configuration allows an operator to notice whether there is a problem with the execution of the operation content of a voice command when operating an industrial machine 4 using a voice command. If the problem is negligible, the operator can force the voice processing device 1 to execute the operation content. This makes it possible to achieve both safety and convenience while allowing flexible operation according to the situation.

[0051] Although the embodiments of the present disclosure have been described in detail above, the present disclosure is not limited to the individual embodiments described above. Various additions, substitutions, modifications, partial deletions, etc. are possible in these embodiments without departing from the gist of the invention or the idea and intent of the present disclosure derived from the content described in the claims and their equivalents. For example, in the above-described embodiments, the order of each operation and the order of each process are shown as examples and are not limited to these. The same applies when numerical values ​​or mathematical expressions are used in the description of the above-described embodiments.

[0052] The following are supplementary notes related to embodiments of the present disclosure. (Supplementary Note 1) A voice processing device (1) according to one aspect of the present disclosure includes an operation content acquisition unit (110) that acquires operation content linked to a voice command linking the voice content and the operation content and the voice content uttered by an operator; The system includes a machine state acquisition unit (120) that acquires a machine state of an industrial machine (4) that is the target of an instruction to perform the operation content; a first determination unit (130) that determines whether or not a first operation condition for performing the operation content on the industrial machine (4) is satisfied based on the operation content and the machine state; a notification unit (140) that notifies an operator of the first determination unit (130) that the first operation condition is not satisfied; a second determination unit (150) that determines whether or not a second operation condition is satisfied at a predetermined timing after the notification unit (140) notifies the operator that the first operation condition for performing the operation content on the industrial machine (4) is not satisfied; and an operation content command unit (160) that commands the industrial machine (4) to perform the operation content when the first determination unit (130) determines that the first operation condition is satisfied or when the second determination unit (150) determines that the second operation condition is satisfied.

[0053] (Supplementary Note 2) When the first determination unit (130) determines that the first operating condition is not established, the machine state acquisition unit (120) provided in the voice processing device (1) according to another aspect of the present disclosure continues to acquire the machine state of the industrial machine (4) at a predetermined cycle, the predetermined timing being the timing at which the machine state acquisition unit (120) newly acquires the machine state of the industrial machine (4), and the second operating condition being that the first operating condition for the industrial machine (4) to perform the operation content is established based on the operation content and the machine state.

[0054] (Supplementary Note 3) The voice processing device (1) according to another aspect of the present disclosure further includes a recognition unit (170) that receives a command from the operator, the predetermined timing is a timing at which the recognition unit (170) receives a command from the operator, and the second operating condition is that the received command indicates that a machine state of the industrial machine (4) has changed.

[0055] (Supplementary Note 4) When the second operating condition is established, the second determination unit (150) provided in the voice processing device (1) according to another aspect of the present disclosure commands the machine status acquisition unit (120) to acquire the machine status of the industrial machine (4) and checks whether the first operating condition is established or not, before outputting a notice to that effect to the operation content command unit (160).

[0056] (Supplementary Note 5) The voice processing device (1) according to another aspect of the present disclosure further includes a recognition unit (170) that receives an instruction from the operator, the predetermined timing is the timing at which the recognition unit (170) receives an instruction from the operator, the second operating condition is one in which the received instruction forces the execution of the operation content, and the operation content can be executed even if the first operating condition is not satisfied.

[0057] (Supplementary Note 6) A computer-readable recording medium according to one aspect of the present disclosure includes a computer including an operation content acquisition unit (110) that acquires operation content linked to voice content based on a voice command linking the voice content and the operation content and the voice content spoken by an operator, a machine state acquisition unit (120) that acquires a machine state of an industrial machine (4) that is the target of an instruction to perform the operation content, a first determination unit (130) that determines whether a first operation condition for performing the operation content on the industrial machine (4) is met based on the operation content and the machine state, and when the first determination unit (130) determines that the first operation condition is not met, A program is recorded to operate as a notification unit (140) that notifies an operator of this fact, a second judgment unit (150) that judges whether or not a second operation condition is met at a predetermined timing after the notification unit (140) notifies the operator that a first operation condition for performing the operation content in the industrial machine (4) is not met, and an operation content command unit (160) that commands the industrial machine (4) to perform the operation content when the first judgment unit (130) judges that the first operation condition is met or when the second judgment unit (150) judges that the second operation condition is met.

[0058] REFERENCE SIGNS LIST 1 Voice processing device 3 Control device 4 Industrial machine 5 Network 6 Fog computer 7 Cloud server 8 Terminal 11 CPU 12 ROM 13 RAM 14 Non-volatile memory 15, 17, 18, 20 Interface 22 Bus 70 Display device 71 Input device 72 External device 110 Operation content acquisition unit 120 Machine state acquisition unit 130 First determination unit 140 Notification unit 150 Second determination unit 160 Operation content command unit 170 Recognition unit 200 Voice command storage unit 210 Operation condition storage unit

Claims

1. A voice processing device comprising: an operation content acquisition unit that acquires operation content linked to voice content based on a voice command linking the voice content and the operation content and the voice content uttered by an operator; a machine state acquisition unit that acquires the machine state of an industrial machine that is to be instructed to perform the operation content; a first determination unit that determines whether a first operation condition for performing the operation content on the industrial machine is met based on the operation content and the machine state; a notification unit that notifies an operator if the first determination unit determines that the first operation condition is not met; a second determination unit that determines whether a second operation condition is met at a predetermined timing after the notification unit notifies the operator that the first operation condition for performing the operation content on the industrial machine is not met; and an operation content command unit that commands the industrial machine to perform the operation content if the first determination unit determines that the first operation condition is met or if the second determination unit determines that the second operation condition is met.

2. The voice processing device according to claim 1, wherein when the first judgment unit judges that the first operating condition is not satisfied, the machine state acquisition unit continues to acquire the machine state of the industrial machinery at a predetermined cycle, the predetermined timing being the timing when the machine state acquisition unit newly acquires the machine state of the industrial machinery, and the second operating condition is that the first operating condition for performing the operation content on the industrial machinery is satisfied based on the operation content and the machine state.

3. The voice processing device according to claim 1, further comprising a recognition unit that receives commands from the operator, wherein the predetermined timing is the timing at which the recognition unit receives a command from the operator, and wherein the second operating condition is that the received command indicates that the mechanical state of the industrial machine has changed.

4. The voice processing device described in claim 3, wherein, when the second operating condition is met, the second judgment unit instructs the machine status acquisition unit to acquire the machine status of the industrial machine before outputting that fact to the operation content command unit, and confirms whether the first operating condition is met.

5. The voice processing device according to claim 1, further comprising a recognition unit that receives instructions from the operator, wherein the predetermined timing is the timing at which the recognition unit receives an instruction from the operator, and wherein the second operating condition is such that the received instruction forces the execution of the operation content, and the operation content can be executed even if the first operating condition is not satisfied.

6. A computer-readable recording medium having recorded thereon a program that causes a computer to operate as: an operation content acquisition unit that acquires operation content linked to voice content based on a voice command linking the voice content and the operation content and the voice content spoken by an operator; a machine state acquisition unit that acquires the machine state of the industrial machine that is to be instructed to carry out the operation content; a first determination unit that determines whether a first operation condition for carrying out the operation content on the industrial machine is met based on the operation content and the machine state; a notification unit that notifies the operator if the first determination unit determines that the first operation condition is not met; a second determination unit that determines whether a second operation condition is met at a predetermined timing after the notification unit notifies the operator that the first operation condition for carrying out the operation content on the industrial machine is not met; and an operation content command unit that commands the industrial machine to carry out the operation content if the first determination unit determines that the first operation condition is met or if the second determination unit determines that the second operation condition is met.

Images