Control device for controlling voice interface and thermal device equipped with such control device

Abstract

To provide a technique related to a voice interface (I / F) control for operating a thermal appliance by voice.SOLUTION: A control device that controls a voice I / F includes an input I / F that receives an input signal from the outside, a computing unit that determines, when the input signal is a voice signal, whether or not the voice signal represents a prepared operation word, and an output I / F that outputs the control signal to the outside. The computing unit receives a voice input signal from the input I / F, and outputs, through the output I / F, a control signal requesting confirmation of execution of the voice command corresponding to a predetermined operation word when the computing unit determines that the signal represents a predetermined operation word. After transmission of the control signal, a second input signal is received via the input I / F, and when it is determined that the second input signal is an acknowledgment signal confirming the execution of the voice command, the computing unit outputs the control signal to instruct the execution of the voice command through the output I / F.SELECTED DRAWING: Figure 9

Description

[Technical Field]

[0001] The present disclosure relates to a control device for controlling a voice interface, and a thermal device equipped with such a control device. [Background technology]

[0002] In recent years, advances in speech recognition and semantic analysis technologies have led to a dramatic increase in the number of terminals, devices, and robots equipped with speech interfaces, as well as services that utilize speech interfaces. A speech interface is a user interface in which a user gives instructions (speech commands) to a device, which then operates the device according to the content of the voice commands and obtains output from the device. Therefore, speech interfaces are superior in terms of operability and convenience compared to conventional user interfaces, such as GUIs (Graphical User Interfaces).

[0003] Patent Document 1 discloses a cooking device that recognizes voice and enables operation based on the character string of the recognition result. The technology disclosed in Patent Document 1 recognizes the voice spoken by the user and, based on the result, switches to the next screen and displays it, or changes the control of the device. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Japanese Patent Application Laid-Open No. 2003-108183 Summary of the Invention [Problem to be solved by the invention]

[0005] When a cooking appliance that uses heat can be operated by voice, it is necessary to prevent unintended operation by the user. More specifically, it is necessary to control the voice interface so that the heating state is not changed by a voice accidentally uttered by the user from a position where the cooking appliance is not visible. Here, changing the heating state means, for example, changing the heating power, such as starting heating, changing the heating power, or stopping heating.

[0006] The present disclosure provides a technique for controlling a voice interface for operating a heating appliance such as a cooking appliance by voice. [Means for solving the problem]

[0007] A control device according to one aspect of the present disclosure controls a voice interface for operating a thermal device by voice. The control device includes an input interface that receives an input signal from an external device, a calculation unit that, when the input signal is a voice signal, determines whether the voice signal represents one of a plurality of pre-prepared operation words, and an output interface that outputs a control signal to the external device. The calculation unit receives the voice signal as a first input signal from the input interface, and, if it determines that the voice signal represents a predetermined operation word among the plurality of operation words, outputs a first control signal via the output interface that requests confirmation of execution of a voice command corresponding to the predetermined operation word. The calculation unit receives a second input signal via the input interface after transmitting the first control signal, and, if it determines that the second input signal is an acknowledgment response signal that confirms execution of the voice command, outputs a second control signal via the output interface that instructs execution of the voice command.

[0008] A thermal appliance according to one aspect of the present disclosure includes the above-described control device, one or more heating units that generate heat, a control unit that controls the heat power of the heating units, a microphone, and one or more sensors that detect user operations and / or behaviors. In the cooking appliance, the input interface of the control device receives output signals from the microphone and one or more sensors as input signals, the output interface of the control device outputs a control signal to the control unit, and the control unit controls the operation of the one or more heating units in response to the control signal.

[0009] A computer program according to one aspect of the present disclosure is executed by a computer of a control device that controls a voice interface for voice-operating a cooking appliance. The control device includes an input interface that receives an input signal from an external device, a calculation unit that is a computer that, when the input signal is a voice signal, determines whether the voice signal represents one of a plurality of pre-prepared operation words, and an output interface that outputs a control signal to the external device. The computer program causes the calculation unit of the control device to perform the following processes: receive the voice signal from the input interface as a first input signal; output, if it is determined that the voice signal represents a predetermined operation word among the plurality of operation words, a first control signal via the output interface that requests confirmation of execution of a voice command corresponding to the predetermined operation word; receive a second input signal via the input interface after transmitting the first control signal; and output, if it is determined that the second input signal is an acknowledgment response signal confirming execution of the voice command, a second control signal via the output interface that instructs execution of the voice command. [Effects of the Invention]

[0010] According to the present disclosure, a technique for controlling a voice interface for operating a cooking appliance by voice is provided. [Brief explanation of the drawings]

[0011] [Figure 1A] A top view of a kitchen facility in which a cooking device 1 incorporating a control device 100 is installed. [Figure 1B] A diagram showing a scene in which a user 200 utters an operation word. [Figure 1C] FIG. 2 shows a user 200 instructing execution by pressing a push button sensor 52 in response to the requested execution confirmation. [Figure 1D] FIG. 10 shows how the heating coil 8 on the right side of the cooking appliance 1 is ignited by executing a voice command. [Figure 2] A diagram showing a user who is in an area where the cooking appliance cannot be seen. [Figure 3A] FIG. 1 is a diagram showing a cooking device incorporating a control device according to the present disclosure. [Figure 3B] FIG. 10 is a diagram showing a configuration example in which a control device and a cooking appliance are housed in separate housings and connected to each other via a communication line. [Figure 3C] FIG. 10 is a diagram showing a configuration example in which a control device is installed in a server device. [Figure 4] Control device hardware configuration diagram [Figure 5] 1 is a perspective view of an induction cooking device according to an exemplary embodiment; [Figure 6] 1 is a block diagram showing a control system of an induction heating cooker according to an exemplary embodiment; [Figure 7] Schematic diagram of the induction cooker configuration [Figure 8] Partial schematic diagram of the operation unit and display unit [Figure 9] 1 is a flowchart showing the procedure of processing executed by the calculation unit of the control device. [Figure 10] 1 is a flowchart showing the procedure of processing executed by the calculation unit of the control device. [Figure 11] A diagram showing an example of an image displayed on the display unit when the heating coil 8 is used at medium heat level 5. [Figure 12] FIG. 10 is a diagram showing an example of a display on the display unit for requesting a user to confirm execution of a voice command. [Figure 13] A diagram showing a display unit that displays a text image indicating that the heat level has been adjusted to 4 in accordance with the voice command as a result of the voice command being executed. [Figure 14]FIG. 10 is a diagram showing another example of a method for requesting execution confirmation. [Figure 15] FIG. 10 is a diagram illustrating an example of confirming a user's execution request using a lamp that can be lit in any color. [Figure 16] FIG. 1 shows a cooking device 1 equipped with a proximity sensor. [Figure 17A] Graph showing an example of the waveform of an acknowledgment signal using a proximity sensor [Figure 17B] Graph showing an example of a waveform of a signal that does not correspond to an acknowledgement signal [Figure 18] A diagram showing a set of two gestures that correspond to the execution and cancellation of a voice command, respectively. DETAILED DESCRIPTION OF THE INVENTION

[0012] (Findings of the inventors of the present application) There are many advantages to users operating devices with voice commands. For example, it allows hands-free operation, eliminating the need to touch the device directly. Users can operate the device from a distance without having to check the device's screen. Also, because voice control is quick, users can respond immediately when an emergency operation is required from a distance. Furthermore, even setting items located deep within a hierarchy can be easily called up and entered by voice, enabling a variety of operations in addition to those performed while looking at the device's screen, reducing the amount of input required by the user.

[0013] When operating a device using such voice commands, a user conventionally first utters a predetermined sound called a wake-up word, followed by an operation word corresponding to the desired operation. The device constantly receives audio signals from a microphone and determines whether the wake-up word is present in the speech. When the device recognizes the wake-up word, it starts up its system, waits for the subsequent operation word to be spoken, and, if it recognizes the operation word, executes the action corresponding to that operation word.

[0014] After being activated by a wake-up word, the device may, for some reason, recognize an operation command corresponding to an operation different from the operation intended by the user. Alternatively, even though the user is not speaking, the device may mistake audio noise for the user's voice and recognize the audio noise as an operation command not intended by the user. In particular, in the latter case, the recognition of the wake-up word itself may occur without the user's intention. In other words, the device may be activated and executed regardless of the user's intention. For example, if the device is a lighting fixture and the operation is to turn on the light, the impact of the user's lack of involvement is minor. On the other hand, if the device is a cooking appliance with a heating function, the impact of the user's lack of involvement may be significant.

[0015] The inventors of the present application considered it preferable to impose specific activation conditions on a cooking appliance when operating the appliance with a voice command. Specifically, they considered it preferable for a user within visual range of the cooking appliance to allow or confirm the execution of a voice command corresponding to an operation word before causing the cooking appliance to perform that operation. By operating the cooking appliance in this manner, it is possible to prevent the cooking appliance from starting to operate unconditionally even if the cooking appliance recognizes an operation command that is not intended by the user. The "visible range of the cooking appliance" may be, for example, a range close enough for the user to directly touch the cooking appliance to operate it. The above concept is not limited to cooking appliances, but also applies to stoves, for example. In other words, the above concept can be applied to "thermal equipment," which is equipment that uses heat or heat. Thermal equipment has a heating element, such as a coil, heating wire, or combustion tube, that generates heat in itself or in another object.

[0016] Hereinafter, embodiments will be described in detail with reference to the drawings as appropriate. However, more detailed description than necessary may be omitted. For example, detailed description of well-known matters or redundant description of substantially identical configurations may be omitted. This is to avoid unnecessary redundancy in the following description and to facilitate understanding by those skilled in the art. Note that the inventors provide the accompanying drawings and the following description to enable those skilled in the art to fully understand the present disclosure, and the subject matter described in the claims is not limited by them.

[0017] (Embodiment 1) (1) Overview Below, an overview of a control device and a thermal device according to an embodiment of the present disclosure will be described with reference to FIGS. 1A to 2. In the following description of the embodiment, a cooking heater will be given as an example of a thermal device. The control device is used to control a voice interface for operating the cooking heater by voice. The cooking heater is, for example, an induction heating (IH) cooking heater that uses electricity to inductively heat a cooking container, a gas cooker that heats a cooking container by burning gas, or an electric stove that uses a heating wire with a relatively high electrical resistance, such as a nichrome wire, as a heat source. In the following description, the cooking heater will be an IH cooking heater as an example.

[0018] FIG. 1A is a top view of kitchen equipment in which a cooking appliance 1 incorporating a control device 100 is installed. A user 200 is relatively close to the cooking appliance 1 and can see the cooking appliance 1. Consider an example in which the user 200 operates the cooking appliance 1 by voice from this position. The cooking appliance 1 is in a standby state awaiting voice input.

[0019] 1B shows a scene in which user 200 utters an operation word. User 200 wishes to use heating coil 8 on the right side of heating coils 7 to 9 which are IH heaters of cooking appliance 1.

[0020] After the user 200 utters a predetermined wake-up word, the user 200 sequentially utters the operation words "Right IH" and "Light it up." The voice uttered by the user 200 is picked up by the microphone 50 of the cooking appliance 1 and sent to the control device 100. In this embodiment, when the cooking appliance 1 receives the voice and sends the voice signal to the control device 100, the control device 100 recognizes the wake-up word and the operation word from the voice signal using a voice recognition function. Instead of the control device 100, the cooking appliance 1 may have a voice recognition function.

[0021] Here, the "wake-up word" is a word that triggers the cooking appliance 1 and the control device 100 to start up their systems and wait for the following voice. The "operation word" is a word or phrase expressed by voice uttered by the user 200 to operate the cooking appliance 1. An internal command for operating the cooking appliance 1 is associated with the operation word in advance, making it possible to operate the cooking appliance 1 based on the operation word. When causing the cooking appliance 1 to perform various operations by voice, there are multiple types of operation words, and there are also multiple types of internal commands corresponding to each operation word. Considering that various internal commands can be issued in the cooking appliance 1 even when the user 200 directly operates the cooking appliance 1 without using voice, hereinafter, an internal command associated with a voice-based operation word will be referred to as a "voice command."

[0022] When the voice of the user 200 is detected after the wake-up word is recognized, the control device 100 recognizes the operation word using a voice recognition function and determines whether or not there is a voice command corresponding to the operation word. Specifically, the control device 100 determines the voice command by referring to a data file based on the recognized operation word. The data file stores a table in which various operation words are previously associated with various voice commands. If a corresponding voice command is found, the control device 100 asks the user 200 to confirm whether or not the voice command can be executed (execution confirmation).

[0023] 1C shows user 200 instructing execution by pressing sensor 52, which is a push button, in response to the requested confirmation of execution. Control device 100 requests user 200 to confirm execution by voice from cooking appliance 1 as shown in the figure, or by letters, numbers, symbols, figures, colors, and / or lights, as described below. By detecting the pressing of sensor 52, control device 100 determines that confirmation of execution of the voice command has been obtained from user 200, and transmits to cooking appliance 1 a voice command indicating that heating coil 8 corresponding to "right IH" of cooking appliance 1 is to be ignited. This allows user 200 to perform a desired operation on cooking appliance 1 using the voice command.

[0024] 1D shows how the heating coil 8 on the right side of the cooking appliance 1 is ignited by executing a voice command. For convenience, the illustration of a pot or the like that should be placed on the cooking appliance 1 is omitted.

[0025] As described above, according to this embodiment, before an operation word is recognized and a corresponding voice command is executed, the user 200 is asked to confirm execution. For example, the execution confirmation can be made only by the user 200 who is within a range where the cooking appliance 1 is visible, such as by pressing a push button provided on the cooking appliance 1.

[0026] On the other hand, if the operation word is erroneously recognized due to voice noise or the like, no confirmation of execution is obtained from user 200, and therefore execution of a voice command unintended by user 200 can be avoided. For example, FIG. 2 shows user 200 in a range where cooker 1 is not visible. Even if cooker 1 requests confirmation of execution from user 200, user 200 cannot provide the confirmation. By determining in advance a period (length of time) for accepting confirmation of execution, control device 100 does not output a voice command to cooker 1 once that period has elapsed, and therefore execution of a voice command unintended by user 200 can be avoided.

[0027] 3A shows a cooking appliance 1 incorporating a control device 100 of the present disclosure. The configuration shown in FIG. 3A is the same as the configuration in FIG. 1B. In addition to the control device 100 and heating coils 7 to 9, the cooking appliance 1 has a sensor 52 that detects execution confirmation by the user 200 and a microphone 50 that acquires the voice of the user 200 for voice recognition.

[0028] The sensor 52 may be, for example, one or more switches, proximity sensors, or gesture sensors capable of accepting selection of letters, numbers, symbols, graphics, and / or colors. Although only one sensor 52 is illustrated in the figure, multiple sensors 52 may be used. For example, a sensor 52 may be provided for each of the heating coils 7-9 to be operated, and the control device 100 may output a voice command to operate that heating coil only when the sensor 52 corresponding to the heating coil to be operated detects confirmation of operation. Note that if the sensor 52 that accepts confirmation of operation is hardware itself that requires user contact, such as a push button, or a sensor attached to such hardware, it is preferable that the sensor 52 be common to each of the heating coils 7-9. Furthermore, it is more preferable that the number of sensors 52 be one. This reduces the number of contact points with hands soiled during cooking.

[0029] In Fig. 3A, the control device 100 is built into the cooking appliance 1, but other configuration examples are also possible. Fig. 3B shows a configuration example in which the control device 100 and the cooking appliance 1 are housed in separate housings and connected to each other via a communication line 140. The control device 100 receives an output signal that is the detection result of the sensor 52 and an audio signal from the microphone 50 via the communication line 140. The control device 100 determines whether or not to send an audio command to the cooking appliance 1 based on the output signal of the sensor 52.

[0030] FIG. 3C shows a configuration example in which the control device 100 is mounted on a server device 150. In other words, the server device 150 has the functions of the control device 100 described above. The server device 150 can receive sensor output signals and audio signals from the microphone 50 via a communication network 160. The communication network 160 may be a wired LAN or wireless LAN communication network installed in a home, or may be a public communication network such as the Internet. In the former case, the server device 150 is, for example, a controller for a home energy management system (HEMS). In the latter case, the server device 150 is, for example, a server device provided on the Internet by a manufacturer of the cooking appliance 1 or the like.

[0031] The above-described operation can be realized with any of the above configurations. Note that the voice recognition process and the process of requesting execution confirmation from the user 200 do not have to be performed within a single control device 100. For example, instead of the control device 100 in FIG. 3A performing the voice recognition process, an external server device may perform the voice recognition process, and the control device 100 may receive the voice recognition result. The control device 100 may determine a voice command according to the recognition result of the server device, and request execution confirmation from the user 200. Furthermore, even in the configuration of FIG. 3C, at least a part of the communication between the cooking appliance 1 and the communication network 160 may be performed wirelessly.

[0032] The above-mentioned wired communication and wireless communication may be performed in accordance with known communication standards. For example, wired communication may be performed in accordance with the Ethernet (registered trademark) standard, the USB (registered trademark) standard, etc. Wireless communication may be performed in accordance with the IEEE 802.11 standard for LANs (Local Area Networks) and the fourth / fifth generation mobile communication systems, so-called 4G / 5G, for mobile communications.

[0033] (2)Details Hereinafter, the configurations of the control device 100 and the cooking appliance 1 will be described with reference to Figs. 4 to 8. Then, the operation of the control device 100 will be described with reference to Figs. 9 to 18. The following explanation will be based on the configuration example shown in Fig. 3A. As an example, it is assumed that the control device 100 recognizes a wake-up word and an operation word, and issues a voice command.

[0034] Control device FIG. 4 is a diagram showing the hardware configuration of the control device 100. As shown in FIG. The control device 100 includes a calculation unit 102, a storage unit 104, an input interface (I / F) 106, and an output interface (I / F) .

[0035] The calculation unit 102 is a calculation circuit that executes the processing described below, and includes a signal processing circuit such as a CPU, a microcontroller (microcomputer), and the like.

[0036] The storage unit 104 is one or more storage devices to and from which data can be written and read. Examples of such storage devices include a ROM, a RAM, a flash memory, a hard disk drive, and an SSD. In this embodiment, the storage unit 104 includes a RAM 104a and a flash memory 104b.

[0037] The input I / F 106 and the output I / F 108 are connected to an internal bus (not shown) of the cooking appliance 1. The input I / F 106 receives a sensor output signal and an audio signal output from the microphone 50 of the cooking appliance 1. The output I / F 108 outputs a control signal to a control unit of the cooking appliance 1, which will be described later.

[0038] The storage unit 104 will be described in more detail below. The RAM 104a stores computer programs executed by the calculation unit 102. In this embodiment, the RAM 104a stores a voice recognition engine 110 and a control program 112. The flash memory 104b stores various data, specifically, wake-up word data 120, operation word group data 122, and a data file 124. The wake-up word data 120 is data that specifies a wake-up word. The wake-up word may be a fixed word or may be changeable by the user 200. The operation word group data 122 is a collection of a plurality of operation words that can be used in the cooking appliance 1. For example, the operation word group data 122 stores operation words such as "left IH," "right IH," "center IH," "heat level 7," "low heat," "stop," "up," and "down." The data file 124 is a table that associates a plurality of operation words with a plurality of voice commands. The control unit 31 of the cooking appliance 1, which will be described later, executes the operation specified by the voice command. Table 1 shows an example of the data file 124. [Table 1]

[0039] By executing the control program 112 and receiving the results of the voice signal recognition by the voice recognition engine 110 while referring to the flash memory 104b, the calculation unit 102 can recognize various words including the wake-up word.

[0040] By executing the speech recognition engine 110, the calculation unit 102 can recognize words uttered by the user 200 that are included in the speech signal received via the input I / F 106. Any existing speech recognition technology can be used for the recognition process by the speech recognition engine 110. A detailed description of the speech recognition technology will be omitted.

[0041] The calculation unit 102 determines whether the recognized word is a wake-up word by referring to the wake-up word data 120. The calculation unit 102 also determines whether the recognized word is an operation word by referring to the operation word group data 122. If the recognized word is an operation word and if execution confirmation from the user 200 is obtained, the calculation unit 102 further refers to the data file 124, reads out a voice command for executing an operation corresponding to the operation word, and transmits the voice command to the cooking appliance 1.

[0042] 《Heating cooker》 Hereinafter, an induction heating cooker according to an embodiment of the present disclosure will be described with reference to FIGS.

[0043] Fig. 5 is a perspective view of an induction heating cooker 1 according to an exemplary embodiment. Fig. 6 is a block diagram showing a control system of the induction heating cooker 1 according to the embodiment. Fig. 7 is a diagram schematically showing the configuration of the induction heating cooker 1.

[0044] Some of the drawings related to the present disclosure indicate an X-axis, a Y-axis, and / or a Z-axis. When a user faces the induction cooking appliance during use, the X-axis direction indicates the width direction (longitudinal direction) of the cooking appliance, the Y-axis direction indicates the depth direction (short-side direction), and the Z-axis direction indicates the height direction. The positive direction of the X-axis is the right direction, and the negative direction is the left direction. The positive direction of the Y-axis is the rearward direction, and the negative direction is the forward direction.

[0045] 《Induction heating cooker》 First, the general configuration of an induction heating cooker 1 according to the present disclosure will be described.

[0046] 5, the induction heating cooker 1 has a main body 3 and a top plate 5 on which a container is placed on the top surface of the main body 3. The container contains an object to be heated, such as food ingredients to be cooked, such as stew.

[0047] Heating coils 7, 8, and 9 are arranged inside the main body 3 of the induction cooking device 1, more specifically, at a position below (-Z side) of the container placement area on the top plate 5 of the induction cooking device 1. The heating coils 7 to 9 generate an induction magnetic field to inductively heat the container. Note that the cooking device 1 includes three heating coils 7 to 9, but may include one, two, or four or more heating coils. In this specification, one or more heating coils may be collectively referred to as a "heating unit."

[0048] In the induction heating cooker 1, for example, operating units 19, 20, and 21 that can be physically operated to operate the heating coils 7, 8, and 9, respectively, are provided. In other words, each of the heating coils 7, 8, and 9 "corresponds" to each of the operating units 19, 20, and 21. In this specification, the components provided for each of the heating coils 7, 8, and 9 are referred to as components "corresponding" to the heating coil.

[0049] As will be described later, the operation units 19, 20, and 21 are actually a set of multiple switches, each of which functions as the above-mentioned sensor 52. Therefore, in Fig. 5, the reference numerals of the operation units 19, 20, and 21 are indicated together with the reference numeral "52" indicating the sensor.

[0050] Electrical wiring is provided so that output signals from operation units 19, 20, 21 functioning as sensor 52 are transmitted to input I / F 106 of control device 100. Alternatively, a data communication path is formed so that data indicating that each switch of operation units 19, 20, 21 has been pressed is transmitted to input I / F 106 via control unit 31 of cooking appliance 1, which will be described later. Similarly, electrical wiring is provided or a data communication path is formed so that an output signal from microphone 50 of cooking appliance 1, i.e., an audio signal, is transmitted to input I / F 106 of control device 100.

[0051] As shown in FIG. 5, ring-shaped markers 11, 12, and 13 indicating the container placement areas are printed on the top plate 5 above the heating coils 7-9 (+Z side) in "correspondence" with the heating coils 7, 8, and 9, respectively.

[0052] In top view, ring-shaped light-emitting units 15 and 16 that emit light are arranged on the outer sides of the heating coils 7 and 8 on the top plate 5. In addition, an arc-shaped light-emitting unit 17 is arranged on the front side (-Y side) of the heating coil 9 on the top plate 5. The light-emitting units 15 to 17 emit light, for example, when a current flows through the corresponding heating coils 7 to 9. Each of the light-emitting units 15 to 17 has, for example, an LED light-emitting substrate (not shown).

[0053] Additionally, a temperature sensor 18 is disposed below the top plate 5, inside the markers 11 to 13. The detected value detected by the temperature sensor 18 is sent to the control unit 31. The control unit 31 adjusts the amount of current flowing through the heating coils 7 to 9 while referring to the detected temperature value, and determines the timing for providing assistance guidance on cooking methods.

[0054] Operation units 19, 20, and 21 are arranged on the front side (-Y side) of the top plate 5 of the induction cooking appliance 1. Operation units 19, 20, and 21 are used by a user 200 to operate each of the heating coils 7 to 9. Operation unit 19 is provided to operate heating coil 7, operation unit 20 is provided to operate heating coil 8, and operation unit 21 is provided to operate heating coil 9. In this specification, operation unit 19 corresponds to heating coil 7, operation unit 20 corresponds to heating coil 8, and operation unit 21 corresponds to heating coil 9.

[0055] Display units 23, 24, and 25 are disposed on the front side of the top plate 5 of the induction cooking appliance 1, between the heating coils 7-9 and the operation units 19-21. The display units 23, 24, and 25 respectively display the status of the objects operated by the operation units 19-21. The operation of the display units 23-25 ​​is controlled by a control unit 31, which will be described later.

[0056] Each of the display units 23 to 25 includes, for example, a matrix dot liquid crystal display device. The matrix dot liquid crystal display device is, for example, a full-dot liquid crystal display panel having a strip shape extending in the width direction of the top plate 5.

[0057] Display units 23 to 25 each display, as an image object, the state of the operation target, the details of the operation of heating coils 7 to 9, etc. For example, display unit 23 displays the details of the operation of heating coil 7, display unit 24 displays the details of the operation of heating coil 8, and display unit 25 displays the details of the operation of heating coil 9.

[0058] The image object is a character and / or an image. For example, the image object is the character "heating." In this case, it is indicated that the induction heating cooker 1 is capable of heating using the heating coils 7-9 corresponding to the display units 23-25. Furthermore, the display units 23-25 ​​may display an image object of the character "start" indicating the start of heating together with the character "heating." After heating starts, the display units 23-25 ​​may display an image object such as a number or icon indicating the amount of heating (heating power) of the heating coils 7-9.

[0059] The display units 23 to 25 may be liquid crystal display devices with segment display. Characters and / or images displayed using one or more segments fall within the category of the image object described above.

[0060] The main body 3 includes a speaker 27 that outputs audio information relating to the heating of the heating coils 7 to 9. The speaker 27 is disposed on the front side of the induction heating cooker 1, and outputs audio guidance to the user 200.

[0061] As shown in Fig. 6, the induction heating cooker 1 includes a control unit 31 and a storage unit 33 inside the main body 3. The control unit 31 includes a signal processing circuit such as a CPU or a microcontroller (microcomputer). The storage unit 33 is a storage device such as a ROM, RAM, hard disk drive, or SSD. The storage unit 33 stores a computer program for operating the induction heating cooker 1. The control unit 31 is configured to perform various functions described below by executing the computer program.

[0062] Control unit 31 executing the computer program functions as coil control unit 35, which controls the amount of current flowing through heating coils 7-9, guidance information control unit 37, which controls the display area of ​​display units 23-25, guidance information control unit 45, which controls the display output of guidance information, and cooking guidance control unit 47, which controls the output of cooking guidance information. However, some or all of coil control unit 35, guidance information control unit 37, and cooking guidance control unit 47 do not have to be realized by software, and may instead be composed of one or more CPUs, microprocessors, and FPGAs.

[0063] The output signals of the operation units 19 to 21 are input to the control unit 31. The control unit 31 sets the heating amount of the heating coils 7 to 9 in response to the operation. The control unit 31, functioning as the coil control unit 35, controls the start or stop of heating by the heating coil 7 in response to the operation instruction of the operation unit 19. The coil control unit 35 supplies high-frequency current to the heating coils 7 to 9 to heat the container placed on the top plate 5. The coil control unit 35 also controls the amount of heat from the heating coils 7 to 9 by controlling the amount of current flowing through the heating coils 7 to 9. Furthermore, since the output signals of the operation units 19 to 21 are input to the control unit 31, they are also used to control the operation of the control unit 31, which functions as the guidance information control unit 37 and the cooking guidance control unit 39.

[0064] The cooking guidance control unit 39 sends cooking guidance information to the guidance information control unit 37 when appropriate conditions are met according to a predetermined heating sequence or cooking sequence. The appropriate conditions include whether the temperature detected by the temperature sensor 18 meets predetermined temperature conditions, or whether a predetermined time has passed since the detected temperature reached a predetermined temperature. These conditions are set for each assist menu for which cooking guidance is provided. When the cooking guidance control unit 39 determines that these conditions are met, it instructs the guidance information control unit 37 to display cooking guidance corresponding to those conditions on the display units 23 to 25. These heating sequences, cooking sequences, and cooking guidance are stored in the memory unit 33.

[0065] When the control unit 31 receives the control signal, it analyzes the control command included in the control signal. When the control device 100 recognizes the wake-up word and then the operation word, the control device 100 uses the control command to specify the heating coil to be operated and the operation content.

[0066] Display and operation section Next, the display units 23-25 ​​and the operation units 19-21 will be described with reference to FIG. 8. The operation units 19-21 each include a first operation unit 51, a second operation unit 53, a third operation unit 55, and a fourth operation unit 57. The first operation unit 51-4 operation unit 57 may be, for example, touch switches including capacitance switches or push-button switches. The first operation unit 51-4 operation unit 57 set the heating operation of the corresponding heating coils 7-9. The first operation unit 51 has a clock pattern printed on it and is mainly used to select timer settings. The second operation unit 53 and the third operation unit 55 each have arrow patterns, such as "<" and ">", printed on them and are mainly used to select menus and set the heat level and timer time. The fourth operation unit 57 has a pattern printed on it indicating the heating area corresponding to the operation unit and functions as a multi-function switch to which different functions can be assigned depending on the situation. The power switch 22 has the function of turning on the induction heating cooker 1. The power switch 22 may further have a function of cutting off the power supply to the induction cooking appliance 1. In addition to the power switch 22, a switch for cutting off the power supply may be provided.

[0067] <<Operation of the control device>> 9 is a flowchart showing the basic processing steps executed by the calculation unit 102 of the control device 100. In this embodiment, this flowchart is executed after the wake-up word is recognized. Since the wake-up word recognition process does not necessarily have to be executed by the calculation unit 102, the wake-up word recognition process is shown in parentheses in FIG. 9 as an optional process.

[0068] In step S10, the calculation unit 102 acquires an input signal via the input I / F 106.

[0069] In step S12, if the input signal is a voice signal from the microphone 50 of the cooking appliance 1 and the voice recognition result determines that the voice signal includes an operation word, the calculation unit 102 outputs a control signal via the output I / F 108. Specifically, the control signal is a signal that requests confirmation of execution of the voice command corresponding to the operation word.

[0070] After transmitting the control signal in step S14, the calculation unit 102 again acquires an input signal via the input I / F 106 in step S14.

[0071] In step S16, if it is determined that the input signal is the detection result of the sensor 52 of the cooking appliance 1 and is an acknowledgment response signal confirming the execution of the voice command, the calculation unit 102 outputs a control signal instructing the execution of the voice command.

[0072] When the second control output signal is transmitted to the cooking appliance 1 via the output I / F 108, the cooking appliance 1 executes the instructed voice command, thereby realizing an operation corresponding to the operation word input by voice by the user 200.

[0073] 10 is a flowchart showing the procedure of applied processing executed by the calculation unit 102 of the control device 100. This example also includes a wake-up word recognition process.

[0074] In step S20, the calculation unit 102 waits in a sleep state or a standby state until an audio signal is input to the input I / F 106. When an audio signal is input, the process proceeds to step S22.

[0075] In step S22, the calculation unit 102 executes a speech recognition process to determine whether the speech signal contains a wake-up word. If the speech signal does not contain a wake-up word, the process returns to step S20. If the speech signal contains a wake-up word, the process proceeds to step S24.

[0076] In step S24, the calculation unit 102 starts up the system including other components so that the calculation unit 102 and the control device 100 can operate, and waits for the next audio signal to be input.

[0077] In step S26, if the predetermined waiting time has elapsed before an audio signal is input, the process returns to step S20 and waits in a sleep state until a new audio signal is input again. If an audio signal is input to input I / F 106 before the predetermined time has elapsed, the process proceeds to step S28.

[0078] In step S28, the calculation unit 102 executes a voice recognition process to extract words, and determines whether or not the voice signal contains an operation word by referring to the operation word group data 122. If the operation word is contained, the process proceeds to step S30, and if not, the process returns to step S26.

[0079] In step S30, the calculation unit 102 transmits a control signal requesting execution confirmation from the output I / F 108. The control unit 31 of the cooking appliance 1 that has received the control signal requesting execution confirmation asks the user 200 for execution confirmation by at least one of various methods described below. When the user 200 performs an operation or action for execution confirmation, the control unit 31 of the cooking appliance 1 inputs a signal indicating the confirmation result to the input I / F 106.

[0080] In step S32, the calculation unit 102 determines the type of the input signal received by the input I / F 106, and executes one of a plurality of processes depending on the result of the determination.

[0081] First, if the input signal is an acknowledgment response signal indicating that the execution of the voice command has been confirmed, the calculation unit 102 issues a voice command corresponding to the operation word that the user 200 wishes to execute, and transmits the voice command from the input I / F 106 to the control unit 31 of the cooking appliance 1. As a result, the cooking appliance 1 is operated by voice. Alternatively, if the input signal received by the input I / F 106 is a retry request signal indicating that the user wishes to re-input the operation word, the process returns to step S26. The calculation unit 102 waits for a certain period of time, waiting for the re-input of a voice signal including the operation word. On the other hand, if the calculation unit 102 determines that the input signal received by the input I / F 106 is different from either the acknowledgment response signal or the retry request signal, or if the input signal is a release signal indicating that the voice operation is to be released, the calculation unit 102 cancels the process up to that point and returns to the process of step S20.

[0082] Of the above-described processes, in this embodiment, a new process is provided in which the user 200 is asked to confirm the execution of a voice command corresponding to an operation word, and when the user 200 instructs the execution of the voice command, the cooking appliance 1 is caused to execute the voice command. Hereinafter, a method for confirming the execution will be described with a number of specific examples. Note that although the example in which the display unit 24 (FIGS. 5 to 8) is used is given, the display unit 23 and / or the display unit 25 may also be used. In that case, the operation unit 19 and / or the display unit 21 may be used instead of the operation unit 20 to confirm the execution.

[0083] FIG. 11 shows an example of an image displayed on the display unit 24 when the heating coil 8 is being used at medium heat 5. The words "Timer," "Adjust Heat," and "Off" are displayed at the bottom of the display unit 24. The user 200 uses the operation unit 20 to request confirmation of execution. For example, if the user 200 wants to use the "Timer" function, he or she presses the first operation unit 51. If the user 200 wants to use the "Adjust Heat" function to increase or decrease the heat, he or she presses the second operation unit 53 or the third operation unit 55, and if the user wants to end heating, he or she presses the fourth operation unit 57.

[0084] Under these circumstances, suppose that the user 200 utters an operation word requesting that the heating power of the heating coil 8 of the cooking appliance 1 be adjusted to 4. Examples of such operation words are "right IH" and "change the heating power to 4." A control signal for requesting execution confirmation, which is required in step S12 of FIG. 9 and step S30 of FIG. 10, is transmitted from the calculation unit 102 to the control unit 31 via the output I / F 108.

[0085] FIG. 12 shows an example of a display on the display unit 24 for requesting the user 200 to confirm execution of a voice command. The control unit 31 requests the user 200 to confirm execution by displaying a message on the display unit 24 saying, "Do you want to change the heating power from 5 to 4?" At this time, the control unit 31 also switches the display at the bottom of the display unit 24 to display the character "CANCEL" 24a requesting cancellation of the voice operation, the character "RE-INPUT VOICE" 24b requesting re-input of the operation word, and the character "EXECUTE" 24c instructing execution of the voice command corresponding to the operation word. The user 200 can select "CANCEL," "RE-INPUT VOICE," or "EXECUTE" by pressing any of the first operation unit 51, the second operation unit 53, the third operation unit 55, and the fourth operation unit 57. An output signal (detection signal) of any of the sensors 52 that detects pressing of each operation unit is transmitted to the control device 100. From the perspective of whether execution confirmation is required, in this example, only the fourth operation unit 57 is associated with the character "EXECUTE" 24c instructing execution of the voice command. The first operation unit 51, the second operation unit 53, and the third operation unit 55 are associated with the characters 24a and 24b other than the character 24c for "execute," and cannot be used to confirm the execution of a voice command.

[0086] FIG. 13 shows the display unit 24 displaying, in a text image, the fact that the heating power has been adjusted to 4 in accordance with the voice command as a result of the voice command being instructed to be executed.

[0087] FIG. 14 illustrates another example of a method for requesting confirmation of execution. The calculation unit 102 transmits a control signal to the control unit 31 of the cooking appliance 1, causing an image including the text "To execute the result, say 'confirm'," to be displayed, thereby requesting confirmation from the user 200. At this time, the user 200 does not use the operation unit 20, but instead utters "confirm" and has the microphone 50 detect it, thereby instructing execution of the voice command. In this case, the microphone 50 can also function as the sensor 52. If the utterance of "confirm" is not detected for a certain period of time, it is determined that the user 200 has not instructed execution of the voice command to change the heat level to 4, and the processing up to that point is canceled. In other words, in FIG. 10, the process returns from step S32 to step S20. The word "confirm" mentioned above is an example. The word to be uttered may be a predetermined or random combination of letters, numbers, symbols, graphic shapes, etc. Furthermore, the time for detecting the utterance does not need to be constant, but may be randomly selected from multiple time values ​​prepared in advance.

[0088] Because the words to be uttered change from time to time, the user must confirm the words to be uttered each time before uttering them. In other words, if the user is not nearby, the calculation unit 102 does not accept the user's confirmation of execution, and therefore the command is not executed. This prevents the heating state from being changed by the voice interface without the user being aware of the voice operation. In addition, by randomly selecting the time for detecting utterances, the user can be made more aware that voice operation is not possible unless the user is near the cooking appliance 1. Note that candidate words to be presented may be prepared in advance and stored in the storage unit 33.

[0089] Next, a method for confirming the execution request of the user 200 using the lamp will be described. FIG. 15 is a diagram illustrating an example of confirming an execution request from a user 200 using a lamp 61 that can be lit in any color. The calculation unit 102 transmits to the control unit 31 of the cooking appliance 1 a control signal for lighting the lamp 61 in a predetermined color and a control signal for transmitting a message to be displayed on the display unit 24 ("To execute the result, please pronounce the color of the confirmation lamp"). The predetermined color to be lit may be randomly determined by the calculation unit 102. For example, the calculation unit 102 randomly selects one color from three colors: red, blue, and yellow, and transmits color data, such as an RGB value, specifying the selected color to the cooking appliance 1.

[0090] The calculation unit 102 stores the color data. If the voice signal received by the output I / F 108 after the lighting instruction includes a word indicating a color, the RGB value of that color is calculated, or the RGB value of that color is extracted by referring to a conversion table prepared in advance, and compared with the stored color data. If the two match, the signal received by the output I / F 108 is determined to be an acknowledgment signal. This causes the calculation unit 102 to send a voice command to the control unit 31 of the cooking appliance 1 to change the heat level to 4. Note that instead of inputting the color name by voice, one of multiple switches, each associated with a color, may be pressed.

[0091] Next, a method for confirming an execution request from the user 200 using a proximity sensor will be described. FIG. 16 shows a cooking appliance 1 equipped with a proximity sensor 63. The proximity sensor 63 is, for example, an ultrasonic sensor that emits ultrasonic waves and detects the reflected waves to detect the distance to an object to be detected in a non-contact manner. The proximity sensor 63 is an example of the sensor 52 (FIGS. 1B to 1D, 3A to 3C). In this embodiment, the object to be detected is the hand of the user 200. The proximity sensor 63 may be installed on a wall surface above the cooking appliance 1, and does not need to be embedded in the cooking appliance 1.

[0092] FIG. 17A is a graph showing an example waveform of an acknowledgement signal using the proximity sensor 63. The horizontal axis of the graph in FIG. 17A represents time, and the vertical axis represents the distance to the object (hand) to be detected. The inventors determine that the user 200 has intentionally placed their hand over the proximity sensor 63 when, in the waveform of the proximity sensor 63, the hand approaches to within a reference distance (Td) and the proximity state continues for a reference period (Tt) or more. On the other hand, FIG. 17B is a graph showing an example waveform of a signal that does not correspond to an acknowledgement signal. Although the hand approaches to within the reference distance (Td), the proximity state does not continue for a reference period (Tt) or more, so it cannot be said that the user intentionally placed their hand over the proximity sensor 63. For example, a pot may momentarily pass over the proximity sensor 63.

[0093] When the proximity sensor 63 is used, the calculation unit 102 may transmit to the cooking appliance 1 a control signal for causing the display unit 24 to display an image (including text) instructing the cooking appliance 1 to bring a hand close to the proximity sensor 63, and then transmit a control signal for causing the proximity sensor 63 to start a detection operation. The calculation unit 102 may determine the presence or absence of an acknowledgment signal based on whether the proximity sensor 63 detects the above-mentioned gesture within a predetermined time from the display of the image. The ultrasonic proximity sensor 63 is just an example. Any proximity sensor that can detect the approach of a human body, such as an infrared type, a capacitance type, or an electromagnetic wave type, may be used.

[0094] Another possible method for confirming the execution request of user 200 is to use a gesture sensor. A gesture sensor is a sensor that uses, for example, an infrared camera to capture the shape and movement of a hand and acquire the series of movements, i.e., gestures. By predetermining gestures corresponding to the execution of a voice command and gestures corresponding to the cancellation of the execution of a voice command, it is possible to determine whether a gesture by user 200 indicates an execution request. Note that an example of the installation of the gesture sensor can be considered to be similar to the installation example of proximity sensor 63 in FIG. 16, and therefore illustrations are omitted and, for convenience, the description will be made using reference numeral "73" shown in FIG. 16. The installation position of gesture sensor 73 may be on a wall surface above cooking appliance 1, and does not need to be embedded in cooking appliance 1.

[0095] FIG. 18 shows a set of two types of gestures corresponding to the execution and cancellation of a voice command, respectively. FIG. 18(a) shows an example in which a gesture of moving the hand from left to right is associated with "executing a voice command," and a gesture of moving the hand from left to right is associated with "canceling a voice command." FIG. 18(b) shows an example in which a gesture of moving the hand from top to bottom is associated with "executing a voice command," and a gesture of moving the hand from bottom to top is associated with "canceling a voice command." FIG. 18(c) shows an example in which a gesture of drawing a clockwise circle is associated with "executing a voice command," and a gesture of drawing a counterclockwise circle is associated with "canceling a voice command." By previously associating gestures with their meanings in this way, it is possible to determine, based on the detection results of the gesture sensor 73, whether or not an acknowledgment response signal confirming the execution of a voice command has been received.

[0096] When the gesture sensor 73 is used, the calculation unit 102 may transmit to the cooking appliance 1 a control signal for causing the display unit 24 to display an image (including text) instructing the cooking appliance 1 to perform a predetermined movement near the gesture sensor 73, and then transmit a control signal for causing the gesture sensor 73 to start a detection operation. The calculation unit 102 may determine whether or not an acknowledgment signal has been sent based on whether or not the gesture sensor 73 has detected the above-mentioned gesture within a predetermined time from the display of the image.

[0097] In the above-described embodiment, an example of displaying an image on a display unit to request confirmation of execution and an example of lighting a lamp to request confirmation of execution using a different color of light were given. Both of these can be said to be modes of requesting confirmation of execution using a stimulus to the human visual sense, and in this sense, the display unit and the lamp can be collectively referred to as a "presentation unit that presents a visual stimulus." The "visual stimulus" can be a letter, a number, a symbol, a figure, a color, and / or light.

[0098] Modifications will be described below.

[0099] 11, an example in which execution confirmation is performed using a display unit and an operation unit associated with the display on that display unit has been described, but regardless of which display unit is used, a common operation unit may be used to allow the user to input whether or not execution confirmation is required. Such a common operation unit may be all or part of operation units 19 to 21, or may be one or more independent switches separate from operation units 19 to 21. It is sufficient that output signals (detection signals) of one or more sensors provided in each operation unit are transmitted to control device 100.

[0100] Furthermore, multiple lamps 61 (FIG. 15) may be provided and lit in the same color. This makes it easier for the user to see. In addition, in FIG. 16, the proximity sensor 63 is provided in the lower right corner of the top plate of the cooking appliance 1, but it may also be provided in the lower left corner of the top plate, or in both the lower right and left corners, or in more positions. Even when multiple proximity sensors 63 are provided, it is sufficient that the output signal (detection signal) of each proximity sensor 63 is transmitted to the control device 100. Providing the proximity sensors 63 at least in the lower right and left corners makes it easier for the user 200 to input whether or not execution confirmation is required, regardless of whether the user 200 is right-handed or left-handed, improving user convenience.

[0101] The above has described an embodiment of the induction cooking appliance 1 according to the present disclosure. The processing according to the flowchart described above is realized as the operation of the calculation unit 102 by a computer program. Note that an implementation in which the cooking appliance 1 and the control device 100 cannot be clearly distinguished from each other and the cooking appliance 1 and the control device 100 are integrated may also be considered. In such a case, it may be considered that the control unit 31 executes all of the operations of the calculation unit 102, for example. In this case, transmission and reception of signals between the control device 100 and the cooking appliance 1 is no longer necessary, and to that extent, the operations performed by the control unit 31 and the calculation unit 102 can be omitted.

[0102] (3) Mode As is clear from the above-described embodiments and modifications, the present disclosure includes the following aspects. In the following, reference numerals are given in parentheses only to clarify the correspondence with the above-described embodiments.

[0103] A first aspect is a control device (100) that controls an audio interface for operating a thermal device by voice. The control device includes an input interface (106) that receives an input signal from an external device, a calculation unit (102) that, when the input signal is an audio signal, determines whether the audio signal represents one of a plurality of pre-prepared operation words, and an output interface (108) that outputs a control signal to the external device. The calculation unit receives the audio signal from the input interface as a first input signal (S10), and if it determines that the audio signal represents a predetermined operation word among the plurality of operation words, it outputs a first control signal via the output interface that requests confirmation of execution of a voice command corresponding to the predetermined operation word (S12). After transmitting the first control signal, the calculation unit receives a second input signal via the input interface (S14), and if it determines that the second input signal is an acknowledgment signal that confirms execution of the voice command, it outputs a second control signal that instructs execution of the voice command via the output interface (S16). The second aspect is a control device (100) based on the first aspect. In the second aspect, when the calculation unit (102) determines that the second input signal is a retry request signal requesting re-input of the operation word, the calculation unit (102) does not output the second control signal and transitions to a standby state in which it waits for input of the operation word. The third aspect is a control device (100) based on the second aspect. In the third aspect, when the calculation unit (102) determines that the second input signal is different from both the acknowledgement signal and the retry request signal, the calculation unit (102) does not output the second control signal. A fourth aspect is a control device (100) based on any one of the first to third aspects. In the fourth aspect, when a calculation unit (102) receives a second input signal via the input interface within a predetermined time after transmitting a first control signal, the calculation unit (102) determines that the second input signal is an acknowledgment response signal that confirms the execution of a voice command, and when a second input signal is not received via the input interface within a predetermined time after transmitting the first control signal, the calculation unit (102) transitions to a standby state in which it waits for input of a new first input signal. A fifth aspect is a control device (100) based on the first aspect. In the fifth aspect, the predetermined operation word is associated with a voice command for adjusting the heating power of the heating appliance. A sixth aspect is a control device (100) based on any one of the first to fifth aspects. In the sixth aspect, the control device (100) further includes a storage unit that stores a data file in which each of a plurality of operation words is associated with each of a plurality of voice commands. A seventh aspect is a thermal device (1). In the seventh aspect, the thermal device (1) includes a control device (100) based on the sixth aspect, one or more heating units (7, 8, 9) that generate heat, a control unit (31) that controls the heat power of the heating units, a microphone (50), and one or more sensors (52, 51, 53, 55, 57, 63, 73) that detect user operations and / or movements. An input interface (106) of the control device (100) receives output signals from the microphone and one or more sensors as input signals. An output interface (108) outputs a control signal to the control unit (31). The control unit (31) controls the operation of the one or more heating units in response to the control signal. An eighth aspect is a thermal device (1) based on the seventh aspect. In the eighth aspect, when a predetermined activation word is input into the microphone in a sleep state in which the voice interface is not enabled, the control device transitions to a standby mode in which it waits for input of an operation word. A ninth aspect is a thermal device (1) based on the seventh or eighth aspect. In the ninth aspect, the thermal device (1) further includes a presentation unit (23, 24, 25, 61) that presents a visual stimulus. In response to receiving a first control signal, the control unit (31) causes the presentation unit to present a visual stimulus including letters, numbers, symbols, figures, colors, and / or lights, requesting the user to confirm execution of the voice command. The calculation unit of the control device determines whether or not an acknowledgment signal is present, based on the detection results of one or more sensors and the presented visual stimulus. A tenth aspect is a thermal device (1) based on the ninth aspect. In the tenth aspect, the presentation unit (23, 24, 25, 61) is a display device (23, 24, 25). The control unit (31) causes the display device to display an image including one or more of letters, numbers, symbols, figures, and / or colors as a visual stimulus. One or more sensors (52, 51, 53, 55, 57, 63, 73) accept a selection of the letters, numbers, symbols, figures, and / or colors and output the result of the selection as a detection result. An eleventh aspect is a thermal device (1) based on the tenth aspect. In the eleventh aspect, the control unit (31) randomly determines the letters, numbers, symbols, figures and / or colors included in the image. A twelfth aspect is a thermal device (1) based on either the tenth or eleventh aspect. In the twelfth aspect, the one or more sensors (52, 51, 53, 55, 57, 63, 73) are a plurality of switches (51, 53, 55, 57). The plurality of switches include a switch associated with the displayed image and one or more switches not associated with the image, and a signal identifying a switch operated by the user among the plurality of switches is output as a detection result. The control unit (31) determines the presence or absence of an acknowledgement signal based on the displayed image and whether the switch is associated with the image. A thirteenth aspect is a heating device (1) based on the tenth aspect. In the thirteenth aspect, the heating device (1) further includes a storage device that pre-stores a plurality of candidate words for presentation (33). The control unit (31) randomly selects one of the plurality of candidate words for presentation and causes the display device (23, 24, 25) to display the selected candidate word for presentation as a visual stimulus. A fourteenth aspect is a thermal device (1) based on the ninth aspect. In the fourteenth aspect, the presenting unit (23, 24, 25, 61) is a lamp (61) that can emit light in a color selected from a plurality of colors. The control unit (31) causes the lamp to emit light in one color randomly selected from the plurality of colors as a visual stimulus. One or more sensors (52, 51, 53, 55, 57, 63, 73) accept the selection of a color and output the result of the selection as a detection result. A fifteenth aspect is a thermal device (1) based on the thirteenth aspect. In the fifteenth aspect, the one or more sensors (52, 51, 53, 55, 57, 63, 73) are a plurality of switches (51, 53, 55, 57). Each of the plurality of switches is associated with a plurality of colors that change, and a signal identifying a switch operated by a user among the plurality of switches is output as a detection result. A control unit (31) determines the presence or absence of an acknowledgment signal based on the color corresponding to the switch operated by the user and the color of the lit lamp. A sixteenth aspect is a thermal device (1) based on the ninth aspect. In the sixteenth aspect, each of the one or more sensors (52, 51, 53, 55, 57, 63, 73) is a proximity sensor (63). The presentation unit (23, 24, 25, 61) is a display device (23, 24, 25). A calculation unit (102) of the control device (100) causes the display device to display an image, as a visual stimulus, instructing the user to bring their hand close to the proximity sensor, and determines whether or not an acknowledgement signal has been sent based on whether or not the proximity sensor has detected the approach of an object within a predetermined time from the display of the image. A seventeenth aspect is a thermal device (1) based on the ninth aspect. In the seventeenth aspect, each of the one or more sensors (52, 51, 53, 55, 57, 63, 73) is a gesture sensor (73). The presentation units (23, 24, 25, 61) are display devices (23, 24, 25). A calculation unit (102) of the control device (100) causes the display device to display, as a visual stimulus, an image instructing the user to perform a predetermined movement on the gesture sensor, and determines whether or not an acknowledgement signal has been received based on whether or not the gesture sensor has detected the predetermined movement within a predetermined time from the display of the image. An eighteenth aspect is a thermal device (1) based on any one of the seventh to seventeenth aspects. In the eighteenth aspect, the one or more heating units (7, 8, 9) are a plurality of heating units. When the calculation unit (102) of the control device (100) controls the operation of any one of the plurality of heating units, the input interface (106) receives output signals from the microphone (50) and one or more sensors (52, 51, 53, 55, 57, 63, 73) as input signals. A nineteenth aspect is a thermal device (1) based on any one of the eighth aspects. In the nineteenth aspect, if the calculation unit (102) of the control device (100) does not receive a second input signal via the input interface (106) within a predetermined time after transmitting the first control signal, the calculation unit (102) clears the operation word and the voice command and transitions to a sleep state. A twentieth aspect is a computer program (112) executed by a computer of a control device (100) that controls a voice interface for operating a thermal device (1) by voice. In the twentieth aspect, the control device includes an input interface (106) that receives an input signal from an external device, a calculation unit (102) that is a computer that, when the input signal is a voice signal, determines whether the voice signal represents one of a plurality of pre-prepared operation words, and an output interface (108) that outputs a control signal to the external device. The computer program (112) causes the calculation unit (102) to execute the following processes: receive the voice signal as a first input signal from the input interface; when it is determined that the voice signal represents a predetermined operation word among the plurality of operation words, output a first control signal via the output interface that requests confirmation of execution of a voice command corresponding to the predetermined operation word; receive a second input signal via the input interface after transmitting the first control signal; and when it is determined that the second input signal is an acknowledgment response signal that confirms execution of the voice command, output a second control signal via the output interface that instructs execution of the voice command. [Industrial Applicability]

[0104] The exemplary control device of the present disclosure is applicable to applications in which a cooking appliance is operated by voice commands. [Explanation of symbols]

[0105] 1 Cooker 3 Main unit 5 Top Plate 7, 8, 9 Heating coils 11, 12, 13 markers 15, 16, 17 Light-emitting part 18 Temperature Sensor 19, 20, 21 Operation input section 22 Power switch 23, 24, 25 Display section 27 Speaker 31 Control Unit 33 Storage section 50. Mike 52 Sensors 100 control device 102 Arithmetic section 104 Storage section 106 Input Interface (Input I / F) 108 Output Interface (Output I / F) 150 Server device 160 Communication Network

Claims

1. A control device for controlling a voice interface for operating a thermal device by voice, an input interface for receiving an input signal from an external device; a calculation unit that, when the input signal is a voice signal, determines whether the voice signal represents any one of a plurality of operation words prepared in advance; an output interface for outputting a control signal to the outside; Equipped with The calculation unit receiving an audio signal as a first input signal from the input interface; When it is determined that the voice signal represents a predetermined operation word among the plurality of operation words, a first control signal requesting confirmation of execution of a voice command corresponding to the predetermined operation word is output via the output interface; receiving a second input signal via the input interface after transmitting the first control signal; a control device that, when determining that the second input signal is an acknowledgment signal for acknowledging execution of the voice command, outputs a second control signal for instructing execution of the voice command via the output interface, The case where the calculation unit determines that the second input signal is the confirmation response signal is when the user who uttered the predetermined operation word approaches the thermal device at a position where the request for execution confirmation can be visually confirmed, and the calculation unit receives the second input signal by the user confirming the execution via the input interface in response to the request for execution confirmation. Control device.

2. A control device for controlling a voice interface for operating a thermal device by voice, an input interface for receiving an input signal from an external device; a calculation unit that, when the input signal is a voice signal, determines whether the voice signal represents any one of a plurality of operation words prepared in advance; an output interface for outputting a control signal to the outside; Equipped with The calculation unit receiving an audio signal as a first input signal from the input interface; When it is determined that the voice signal represents a predetermined operation word among the plurality of operation words, a first control signal requesting confirmation of execution of a voice command corresponding to the predetermined operation word is output via the output interface; receiving a second input signal via the input interface after transmitting the first control signal; When the calculation unit determines that the second input signal is a retry request signal requesting re-input of the operation word, the calculation unit does not output a second control signal instructing execution of the voice command, and transitions to a standby state in which it waits for input of the operation word.

3. The control device according to claim 2 , wherein the calculation unit does not output the second control signal when it determines that the second input signal is different from both the acknowledgement signal and the retry request signal.

4. The calculation unit if the second input signal is received via the input interface within a predetermined time after the transmission of the first control signal, the second input signal is determined to be an acknowledgment signal acknowledging execution of the voice command; 4. The control device according to claim 1, wherein if the second input signal is not received via the input interface within the predetermined time after transmitting the first control signal, the control device transitions to a standby state in which it waits for input of a new first input signal.

5. The control device according to claim 1 or 2, wherein the predetermined operation word is associated with a voice command for adjusting the heating power of the heating device.

6. The control device according to claim 1 , further comprising a storage unit that stores a data file in which each of the plurality of operation words is associated with each of a plurality of voice commands.

7. The control device according to claim 6 ; one or more heating elements that generate heat; a control unit for controlling the heating power of the heating unit; With a microphone, one or more sensors for detecting user manipulation and / or motion; A thermal device having the input interface of the control device receives the output signals of the microphone and the one or more sensors as the input signals; the output interface of the control device outputs the control signal to the control unit; The control unit controls the operation of the one or more heating units in response to the control signal. thermal equipment.

8. The thermal device according to claim 7, wherein when a predetermined activation word is input to the microphone in a sleep state in which the voice interface is not enabled, the control device transitions to a standby mode in which it waits for input of the operation word.

9. Further comprising a presentation unit that presents a visual stimulus, In response to receiving the first control signal, the control unit causes the presentation unit to present the visual stimulus, including letters, numbers, symbols, figures, colors, and / or lights, to request the user to confirm execution of the voice command; The thermal device according to claim 7 or 8, wherein the calculation unit of the control device determines whether or not the confirmation response signal is present based on the detection results of the one or more sensors and the presented visual stimulus.

10. the presentation unit is a display device, the control unit causes the display device to display, as the visual stimulus, an image including one or more of letters, numbers, symbols, figures, and / or colors; The thermal device according to claim 9 , wherein the one or more sensors accept a selection of a letter, a number, a symbol, a graphic, and / or a color, and output a result of the selection as the detection result.

11. The thermal device according to claim 10 , wherein the control unit randomly determines the letters, numbers, symbols, figures, and / or colors included in the image.

12. the one or more sensors are a plurality of switches; the plurality of switches include a switch associated with the displayed image and one or more switches not associated with the image, outputting a signal specifying the switch operated by the user among the plurality of switches as the detection result; The thermal device according to claim 10 , wherein the control unit determines whether or not the confirmation response signal is present based on the displayed image and whether or not the image is a switch associated with the image.

13. Further, a storage device is provided which stores a plurality of candidate words to be presented in advance, The thermal device according to claim 10 , wherein the control unit randomly selects one of the plurality of presentation candidate words and causes the display device to display the selected presentation candidate word as the visual stimulus.

14. the indicator is a lamp that can emit light in a color selected from a plurality of colors, the control unit causes the lamp to emit light in one color randomly selected from a plurality of colors as the visual stimulus; The thermal device according to claim 9 , wherein the one or more sensors accept a selection of a color and output a result of the selection as the detection result.

15. The indicator is a lamp that can emit light in a color selected from a plurality of colors, the one or more sensors are a plurality of switches; each of the plurality of switches is associated with a plurality of changing colors, outputting a signal specifying the switch operated by the user among the plurality of switches as the detection result; The thermal device according to claim 13 , wherein the control unit determines whether or not the confirmation response signal is present based on a color corresponding to the switch operated by the user and a color indicating the lighted lamp.

16. each of the one or more sensors is a proximity sensor; the presentation unit is a display device, The calculation unit of the control device displaying, on the display device, an image instructing the user to bring their hand closer to the proximity sensor as the visual stimulus; The thermal device according to claim 9 , wherein the presence or absence of the confirmation response signal is determined based on whether or not the proximity sensor detects the approach of an object within a predetermined time from the display of the image.

17. each of the one or more sensors is a gesture sensor; the presentation unit is a display device, The calculation unit of the control device displaying, on the display device, an image instructing the user to perform a predetermined movement on the gesture sensor as the visual stimulus; The thermal device according to claim 9 , wherein the presence or absence of the confirmation response signal is determined based on whether or not the gesture sensor detects the predetermined movement within a predetermined time from the display of the image.

18. the one or more heating units are a plurality of heating units, The thermal device according to any one of claims 7 to 17, wherein the input interface receives the output signals of the microphone and the one or more sensors as the input signals regardless of whether the calculation unit of the control device controls the operation of any of the plurality of heating units.

19. 9. The control device according to claim 8, wherein the calculation unit of the control device clears the operation word and the voice command and transitions to the sleep state if the calculation unit does not receive the second input signal via the input interface within a predetermined time after transmitting the first control signal.

20. A computer program executed by a computer of a control device that controls a voice interface for operating a thermal device by voice, The control device an input interface for receiving an input signal from an external device; a calculation unit that is a computer that, when the input signal is a voice signal, determines whether the voice signal represents any one of a plurality of operation words prepared in advance; an output interface for outputting a control signal to the outside; Equipped with The computer program is receiving an audio signal as a first input signal from the input interface; a process of outputting, when it is determined that the voice signal represents a predetermined operation word among the plurality of operation words, a first control signal requesting confirmation of execution of a voice command corresponding to the predetermined operation word via the output interface; receiving a second input signal via the input interface after transmitting the first control signal; a process of outputting a second control signal instructing execution of the voice command via the output interface when it is determined that the second input signal is an acknowledgment response signal for acknowledging execution of the voice command; Run A computer program in which the calculation unit determines that the second input signal is the confirmation response signal when the user who uttered the specified operation word is approaching the thermal equipment in a position where the request for execution confirmation can be visually confirmed, and in response to the request for execution confirmation, the user causes the calculation unit to receive the second input signal by confirming execution via the input interface.

21. A computer program executed by a computer of a control device that controls a voice interface for operating a thermal device by voice, comprising: The control device an input interface for receiving an input signal from an external device; a calculation unit that is a computer that, when the input signal is a voice signal, determines whether the voice signal represents any one of a plurality of operation words prepared in advance; an output interface for outputting a control signal to the outside; Equipped with The computer program is receiving an audio signal as a first input signal from the input interface; a process of outputting, when it is determined that the voice signal represents a predetermined operation word among the plurality of operation words, a first control signal requesting confirmation of execution of a voice command corresponding to the predetermined operation word via the output interface; receiving a second input signal via the input interface after transmitting the first control signal; a process of not outputting a second control signal instructing execution of the voice command, and transitioning to a standby state in which input of the operation word is awaited, when the second input signal is determined to be a retry request signal requesting re-input of the operation word; A computer program that executes

Images