Cooking auxiliary device and cooking system

Abstract

To obtain a cooking auxiliary device and a cooking system capable of improving convenience of a user's cooking work.SOLUTION: A cooking auxiliary device is installed above a cooking appliance that heats an object to be heated from below, and comprises a voice input unit, a voice output unit, an upper temperature sensor whose field of view includes an upper part of the cooking appliance, and a communication unit that communicates with a server that transmits a control signal to the cooking appliance. The communication unit transmits voice information indicating voice input to the voice input unit and temperature information regarding a temperature detected by the upper temperature sensor to the server.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The present disclosure relates to a cooking assistance device that assists cooking using a cooking appliance and a cooking system equipped with the cooking assistance device. [Background technology]

[0002] Conventionally, an audio device control system that controls a cooking appliance by a user's voice has been proposed (see, for example, Patent Document 1). The audio device control system of Patent Document 1 includes an audio input / output device, a cooking appliance, and a cloud server that analyzes the voice input to the audio input / output device and generates a control signal for the cooking appliance and an audio signal to be output from the audio input / output device based on the analysis result. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Laid-Open No. 2015-050766 Summary of the Invention [Problem to be solved by the invention]

[0004] In the system of Patent Document 1, when cooking a menu with multiple steps, the user needs to determine the cooking status of the heated food and input a transition instruction to the next step into the voice input device by operation or voice. Because the transition to the next step is triggered by the user's speech, the user needs to frequently check the cooking status of the heated food. For this reason, even though the system of Patent Document 1 is equipped with a voice input means that allows instructions to be input without necessarily being near the cooking appliance, the user still needs to be near the cooking appliance to check the cooking status during cooking operations.

[0005] The present disclosure has been made in consideration of the above-mentioned problems, and provides a cooking assistance device and a cooking system that can improve the convenience of cooking operations. [Means for solving the problem]

[0006] The cooking assistance device of the present disclosure is a cooking assistance device that is installed above a heating cooker that heats heated objects from below, and is equipped with an audio input unit, an audio output unit, an upper temperature sensor that has a field of view that includes the upper part of the heating cooker, and a communication unit that communicates with a server that transmits control signals to the heating cooker, and the communication unit transmits audio information indicating the audio input to the audio input unit and temperature information regarding the temperature detected by the upper temperature sensor to the server.

[0007] The cooking system of the present disclosure comprises the cooking assistance device, the server, and the heating cooker that communicates with the server, and the server sends control instructions to the heating cooker based on the voice information and temperature information sent from the cooking assistance device, and the heating cooker operates in an automatic cooking mode that heats the heated object based on the control instructions. [Effects of the Invention]

[0008] According to the present disclosure, a cooking assistance device having an audio input unit and an audio output unit is equipped with a temperature sensor, and the input audio and temperature information are transmitted to a server, thereby improving the convenience of the user's cooking work. [Brief explanation of the drawings]

[0009] [Figure 1] 1 is a diagram illustrating an example of a system configuration of a cooking system 100 according to an embodiment. [Figure 2] 1 is a front view showing a configuration example of a cooking assist device 10 according to an embodiment. [Figure 3] 1 is a side view showing a configuration example of a cooking assist device 10 according to an embodiment. [Figure 4] 2 is a diagram illustrating an example of a functional configuration of a cooking device 20 according to an embodiment. FIG. [Figure 5] FIG. 2 is a diagram illustrating an example of a configuration of a server 30 according to an embodiment. [Figure 6]1 is a diagram illustrating a visual field F in the left-right direction for temperature detection of the cooking assist device 10 according to the embodiment. FIG. [Figure 7] 1 is a diagram illustrating a viewing area F in the front-rear direction for temperature detection of the cooking assist device 10 according to the embodiment. [Figure 8] 1 is a diagram illustrating a viewing area F in a plan view of temperature detection in the cooking assist device 10 according to the embodiment. FIG. [Figure 9] 1 is a diagram illustrating the temperature detection function of the upper temperature sensor 12 of the cooking assist device 10 according to the embodiment. FIG. [Figure 10] 1 is a diagram showing changes over time in the temperature detected by the upper temperature sensor 12 of the cooking assist device 10 according to the embodiment and the input power to the heating coil 23 of the cooking appliance 20. FIG. [Figure 11] 1 is a timing chart showing the operation of the cooking system 100 according to the embodiment from when the cooking appliance 20 is turned on until heating starts. [Figure 12] 4 is a timing chart showing the operation of the cooking system 100 according to the embodiment from the start of heating to the end of heating in the cooking appliance 20. [Figure 13] 10 is a flowchart showing an example of operation of the installation guide mode of the cooking system 100 according to the embodiment. [Figure 14] 3 is a diagram illustrating the configuration of a viewing area of ​​an upper temperature sensor 12 according to the embodiment. FIG. DETAILED DESCRIPTION OF THE INVENTION

[0010] Hereinafter, embodiments of a cooking assistance device and a cooking system according to the present disclosure will be described with reference to the drawings. Note that the present disclosure is not limited to the form of the drawings shown below. In addition, in the following description, terms indicating directions (e.g., "up," "down," "right," "left," "front," "rear," etc.) are used as appropriate to facilitate understanding, but these terms are for explanatory purposes and do not limit the present disclosure. In addition, the same components are assigned the same reference numerals in each drawing.

[0011] Embodiment (Cooking System 100) FIG. 1 is a diagram showing an example of the system configuration of a cooking system 100 according to an embodiment. The cooking system 100 includes a cooking assistance device 10, a cooking appliance 20, and a server 30, and is a system that assists a user in cooking using the cooking appliance 20. The cooking assistance device 10 and the server 30, and the cooking appliance 20 and the server 30, are each connected via a communication network. The cooking assistance device 10 is installed in a range hood 201 or on a wall 202 above the cooking appliance 20 to which it is attached. The cooking assistance device 10 receives cooking instructions via voice input from the user, detects the temperature above the cooking appliance 20, and transmits voice information and temperature information to the server 30. The cooking assistance device 10 also outputs voice information to the user. The cooking appliance 20 can operate based on a control signal from the server 30.

[0012] (Cooking aid device 10) Fig. 2 is a front view showing an example of the configuration of a cooking assistance device 10 according to an embodiment. Fig. 3 is a side view showing an example of the configuration of a cooking assistance device 10 according to an embodiment. The cooking assistance device 10 includes an audio module 11, an upper temperature sensor 12, a communication unit 13, a control unit 14, a power supply unit 15, a case 16, sound-absorbing material 17, and a power line 18.

[0013] The audio module 11 is a device in which an audio input unit 11a and an audio output unit 11b are integrated. The audio input unit 11a has a microphone and an audio processing circuit, acquires the user's voice, generates an analog audio signal, and converts the generated audio signal into digital data. The digital data of the audio signal generated by the audio input unit 11a is input to the control unit 14 via a bus. The audio output unit 11b has a speaker and an audio processing circuit, converts the digital audio data input from the control unit 14 into an analog audio signal, and outputs the converted analog audio signal. The audio module 11 is arranged so that it has directivity toward the front. Note that, in this embodiment, the audio module 11 in which the audio input unit 11a and the audio output unit 11b are integrated is shown, but the audio input unit 11a and the audio output unit 11b may also be separate devices.

[0014] The upper temperature sensor 12 detects the temperature of the upper part of the cooking appliance 20 (see FIG. 1). The upper temperature sensor 12 is an infrared temperature sensor with multiple infrared detection elements arranged in a matrix. As shown in FIG. 3, the upper temperature sensor 12 is installed in the case 16 so that the viewing area F, which is the area where the temperature is detected, is located below the cooking assist device 10. In FIG. 3, the viewing area F is shown as an area surrounded by a dashed line, and the front-rear viewing center FC1, which is the center of the viewing area F in the front-rear direction, is shown by a dashed-dotted line. In the following description, the viewing area F of the upper temperature sensor 12 of the cooking assist device 10 may be referred to as the "viewing area F of the cooking assist device 10."

[0015] The communication unit 13 is a circuit that communicates with the server 30 via a communication network. The communication unit 13 transmits and receives signals in accordance with a predetermined communication standard.

[0016] Control unit 14 acquires signals output from audio module 11, upper temperature sensor 12, and communication unit 13, and controls the operations of these units. Control unit 14 may be configured with a CPU (Central Processing Unit) and memory, or may be configured with dedicated hardware that realizes some or all of its functions. Control unit 14 detects the temperature of the object to be heated at heating port 22 of cooking appliance 20 based on the temperature detected by upper temperature sensor 12. Control unit 14 in this embodiment also functions as a human detection unit that detects a human based on the temperature detected by upper temperature sensor 12.

[0017] The power supply unit 15 receives power from a commercial power source and supplies power to the audio module 11 and the upper temperature sensor 12. In this embodiment, the communication unit 13, the control unit 14, and the power supply unit 15 are mounted on a single circuit board, and this circuit board is connected to the commercial power source by a power line 18.

[0018] Case 16 is made of synthetic resin or the like and houses audio module 11, upper temperature sensor 12, communication unit 13, control unit 14, and power supply unit 15. As shown in Fig. 3, a portion of case 16 faces upper temperature sensor 12, and the portion facing upper temperature sensor 12 is made of a material that does not prevent infrared light from passing through. In addition, the portion of case 16 facing audio module 11 is preferably provided with an opening through which vibrations caused by audio can propagate. The rear surface of case 16 is preferably provided with an attachment member such as a hook or adhesive tape that can be attached to wall 202.

[0019] A sound-absorbing material 17 is provided on the upper surface of the case 16. The sound-absorbing material 17 is made of glass wool, urethane sponge, felt, or the like. By providing the sound-absorbing material 17 on the upper surface of the case 16, it is possible to prevent the sound of the ventilation fan of the range hood 201 installed above the cooking assist device 10 from being input to the voice input unit 11a.

[0020] (heating cooker 20) Cooking device 20 is a device equipped with a heat source that heats an object to be heated from below. In this embodiment, cooking device 20 is an induction cooking device that is incorporated into kitchen counter 200 for use. As shown in Fig. 1, cooking device 20 is equipped with top plate 21 on which an object to be heated, such as a pot, is placed, heating port 22, and heating coil 23.

[0021] Top plate 21 is made of, for example, a heat-resistant glass plate, and is placed on kitchen counter 200. Heating ports 22 indicating the placement positions of the objects to be heated are provided on top plate 21 by printing, engraving, or the like. In this embodiment, heating ports 22 are provided on the left, right, and center of top plate 21, but the positions and arrangement of heating ports 22 are not limited to this, and it is sufficient that one or more heating ports 22 are provided.

[0022] A heating coil 23, which serves as a heating source, is provided below the top plate 21, facing the heating port 22. A high-frequency magnetic flux generated by passing a high-frequency current through the heating coil 23 induces eddy currents in the heated object, such as a pot, and the Joule heat generated thereby heats the heated object, such as the pot, and the ingredients in the pot. Note that an electric heater or a gas stove may be provided as the heating source.

[0023] 4 is a diagram showing an example of the functional configuration of cooking device 20 according to the embodiment. As shown in FIGS. 1 and 4, cooking device 20 has control unit 24, operation display unit 25, communication unit 26, lower temperature sensor 27, inverter circuit 28, and cooking data 29.

[0024] Control unit 24 exchanges control signals with operation display unit 25 and communication unit 26. Control unit 24 also acquires temperature information detected by lower temperature sensor 27. Control unit 24 also controls inverter circuit 28, which supplies high-frequency current to heating coil 23, based on cooking data 29. Control unit 24 may be composed of a CPU and memory having a timer function, or may be composed of dedicated hardware that realizes some or all of its functions.

[0025] The operation display unit 25 has an operation unit and a display unit. The operation unit accepts operations from the user such as turning the power on and off, starting and stopping heating, or setting the heat level. The operation unit may be configured with, for example, a push button, a dial switch, or a capacitive touch switch. The display unit has an LCD display or LED, etc., and visually notifies information. The display unit notifies the operating status of the cooking appliance 20, such as the heat level and timer time, options for the user to input on the operation unit, and issues warnings and alerts to the user.

[0026] The communication unit 26 is a circuit that communicates with the server 30 via a communication network. The communication unit 26 transmits and receives signals in accordance with a predetermined communication standard.

[0027] Lower temperature sensor 27 detects the temperature of the lower part of a heated object, such as a pot, placed on top plate 21. The lower part of the heated object refers to the bottom of the heated object, or the area spanning the bottom and side of the heated object, and the lower part of the side. Lower temperature sensor 27 is, for example, a contact-type temperature sensor, an infrared-type temperature sensor, or a combination of these. If lower temperature sensor 27 is a contact-type temperature sensor, lower temperature sensor 27 is provided so as to be in contact with the underside of top plate 21 and detects the temperature of the heated object via top plate 21. If lower temperature sensor 27 is an infrared-type temperature sensor, lower temperature sensor 27 is provided under top plate 21 so as to face a window provided in top plate 21 through which infrared rays pass, and detects the temperature of the heated object based on the infrared rays emitted from the pot.

[0028] Inverter circuit 28 receives a supply of DC voltage rectified by a rectifier circuit (not shown), and supplies a high-frequency current to heating coil 23 (see FIG. 1). The drive frequency of inverter circuit 28 is controlled by control unit 24.

[0029] (Server 30) 5 is a diagram illustrating an example of the configuration of the server 30 according to the embodiment. The server 30 includes a communication unit 31, a control unit 32, a voice recognition unit 33, a voice signal generation unit 34, voice data 35, recipe information 36, and a cooking data group 37.

[0030] The communication unit 31 is a circuit that communicates with the cooking assist device 10 and the cooking appliance 20 via a communication network. The communication unit 31 transmits and receives signals in accordance with a predetermined communication standard.

[0031] The control unit 32 controls the communication unit 31 to send and receive signals to and from the cooking assist device 10 and the cooking appliance 20, and also controls the voice recognition unit 33 and the voice signal generation unit 34. The control unit 32 may be composed of a CPU and memory, or may be composed of dedicated hardware that realizes some or all of its functions.

[0032] The voice recognition unit 33 receives voice signals transmitted from the cooking assist device 10 via the communication unit 31, analyzes the received voice signals, and outputs them as text information. Voice recognition is performed using, for example, deep learning. The voice recognition unit 33 is realized by dedicated hardware or a general-purpose computer device.

[0033] The audio signal generation unit 34 generates an audio signal for the audio to be output by the cooking assist device 10. The audio signal generation unit 34 searches whether the target audio signal is stored in the audio data 35, and if so, extracts the target audio signal. If the target audio signal is not stored in the audio data 35, the audio signal is generated using the stored audio signal. The generated audio signal may be newly stored in the audio data 35.

[0034] The voice data 35 is time-series data of voice signals that are the source of the voices that the cooking assist device 10 utters to the user. For example, voice signals corresponding to predetermined text information such as "Hello, what would you like to cook today?", "Continue heating," or "Cooking finished" are stored as the voice data 35. Voice signals newly generated by the voice signal generator 34 may also be stored as the voice data 35.

[0035] Recipe information 36 is data on recipes that include ingredients and cooking methods. Recipes for each cooking menu, such as "gyoza," "curry," and "boiled fish," are stored in recipe information 36. A single cooking menu may include multiple recipes with different ingredients, cooking methods, or both.

[0036] The cooking data group 37 is data of control signals used to control the cooking appliance 20. Each cooking data constituting the cooking data group 37 is associated with a recipe in the recipe information .

[0037] The communication unit 31, control unit 32, voice recognition unit 33, voice signal generation unit 34, voice data 35, recipe information 36, and cooking data group 37 that constitute the server 30 do not necessarily have to be physically implemented in a single device. The server 30 may be a cloud server. The voice data 35, recipe information 36, and cooking data group 37 are stored in memory.

[0038] (Temperature detection by cooking assistant device 10) Fig. 6 is a diagram illustrating the viewing area F in the left-right direction for temperature detection by the cooking assistant device 10 according to the embodiment. Fig. 7 is a diagram illustrating the viewing area F in the front-rear direction for temperature detection by the cooking assistant device 10 according to the embodiment. Fig. 8 is a diagram illustrating the viewing area F in a plan view for temperature detection by the cooking assistant device 10 according to the embodiment. In Figs. 6 to 8, the outer edge of the viewing area F is conceptually indicated by dashed lines, and the front-rear viewing center FC1, which is the center of the viewing area F in the front-rear direction, and the left-right viewing center FC2, which is the center in the left-right direction, are indicated by dashed lines. In addition, each diagram also shows a pot 300 and a cook 301 who is cooking.

[0039] 6 and 8, the viewing area F of the cooking assistant device 10 encompasses the top plate 21 in the left-right direction. Therefore, the pot 300 placed on the top plate 21 is also encompassed in the viewing area F in the left-right direction.

[0040] 7 and 8, the viewing area F of the cooking assistant device 10 encompasses the top plate 21 in the front-to-rear direction. Therefore, the pot 300 placed on the top plate 21 is also encompassed in the viewing area F in the front-to-rear direction.

[0041] Furthermore, in this embodiment, the field of view F of the cooking assist device 10 is the area in front of the cooker 20 in the front-to-rear direction, and includes a user area UF where the cooker 301 is present while cooking. In Figures 7 and 8, the user area UF is conceptually indicated by a two-dot chain line. The size of the user area UF is not particularly limited, but is generally an area extending approximately 30 cm to 80 cm forward from the front end of the cooker 20.

[0042] 9A and 9B are diagrams illustrating the temperature detection function of the upper temperature sensor 12 of the cooking assist device 10 according to the embodiment. FIG. 9A is a diagram showing an example of an actual image in which a pot 300 containing food 302 is placed on the heating opening 22, and FIG. 9B is a diagram showing the temperature detected by the upper temperature sensor 12. The numbers in FIG. 9B and the shading of the rectangles in the background indicate the temperatures detected by the infrared detection elements provided in the upper temperature sensor 12. When heating by the cooking appliance 20 begins, the temperatures of the pot 300 and food 302 above the heating opening 22 rise. As shown in FIG. 9B, each detection element of the upper temperature sensor 12 detects the temperature of each of the areas obtained by dividing the heating opening 22 and its surrounding area into multiple locations.

[0043] Furthermore, the cooking assist device 10 of this embodiment is set so that the user area UF is included in the field of view F of the upper temperature sensor 12 (see FIGS. 7 and 8). The multiple infrared detection elements of the upper temperature sensor 12 detect the temperature in each of the multiple areas into which the user area UF is divided. The control unit 14 determines the presence or absence of a cook 301 based on the temperature detected in the user area UF. Specifically, for example, if a temperature equivalent to a person's body temperature is detected in a predetermined user area UF (for example, an area up to 50 cm from the front end of the top plate 21), the control unit 14 determines that a person is present.

[0044] (Operation of Cooking System 100) The operation of cooking system 100 will be described using the cooking of frozen dumplings as an example. Figure 10 shows the changes over time in the temperature detected by upper temperature sensor 12 of cooking assist device 10 according to the embodiment and the input power to heating coil 23 of cooking appliance 20. The cooking process for frozen dumplings illustrated here consists of cooking process 1 and cooking process 2. In cooking process 1, with the pot 300 covered, an input power of 750 W is applied to heating coil 23 and heating is performed for 10 minutes. In cooking process 2, with the lid of pot 300 removed to allow moisture to evaporate, an input power of 1000 W is applied to heating coil 23, and heating is terminated when 5 minutes have passed and the temperature detected by upper temperature sensor 12 reaches 160°C.

[0045] A description will be given of the operation of the cooking system 100 for executing the cooking process shown in Fig. 10 in the cooking appliance 20. Fig. 11 is a timing chart showing the operation of the cooking system 100 according to the embodiment from when the cooking appliance 20 is powered on until heating starts.

[0046] In step S1, when an operation input is made to turn on the power of the cooking appliance 20, the cooking appliance 20 transmits an operation signal indicating power-on to the server 30. In step S2, the server 30, having received the power-on operation signal, transmits an instruction to collect cooking information and an instruction to output audio to the cooking assistance device 10. Note that in step S2 and the subsequent steps, the audio output instruction transmitted by the server 30 to the cooking assistance device 10 includes an audio signal to be output by the cooking assistance device 10. This audio signal is an audio signal generated by the audio signal generation unit 34 (see FIG. 5) or extracted from audio data 35.

[0047] In step S3, the cooking assist device 10 performs voice output 1 to collect cooking information. For example, the voice output unit 11b outputs a voice prompting the user to speak about the cooking contents, such as "Hello, what would you like to make today?"

[0048] In step S4, the cook 301, who has heard the voice output 1, inputs a cooking recipe by voice. For example, the cook 301 may say, "I'll fry frozen dumplings."

[0049] In step S5, the cooking assistance device 10 accepts voice input from the cook 301. Specifically, the voice input unit 11a acquires the voice uttered in step S4, generates an analog signal, and converts the analog signal into a digital voice signal. In step S6, the cooking assistance device 10 transmits the digital voice signal to the server 30.

[0050] In step S7, the server 30 acquires the voice signal from the cooking assistance device 10, performs voice recognition, and searches for a recipe based on the results of the voice recognition. Specifically, the voice recognition unit 33 analyzes the voice signal and outputs it as text information. Here, the text information "I'm going to fry some frozen dumplings" uttered in step S4 is recognized. The control unit 32 extracts "frozen dumplings," a cooking menu item, from the recognized text information and searches for information corresponding to "frozen dumplings" in the recipe information 36. In some cases, multiple recipes are registered for a specific keyword (e.g., "frozen dumplings") in the recipe information 36. In addition, there may be cases where the utterance of the cook 301 cannot be accurately acquired due to noise, etc. Therefore, in step S8, the server 30 transmits recipe candidate information and a voice output instruction to the cooking assistance device 10.

[0051] In step S9, the cooking assist device 10 performs voice output 2 based on an instruction from the server 30. For example, the voice output unit 11b outputs a voice saying, "Would you like to cook frozen dumplings in automatic cooking mode?"

[0052] Upon hearing the voice output 2, the cook 301 performs voice input to select a cooking recipe in step S10. For example, the cook 301 utters, "Yes, I'll make it."

[0053] In step S11, the cooking assistance device 10 obtains a digital audio signal based on the voice input from the cook 301. Subsequently, in step S12, the cooking assistance device 10 transmits the audio signal to the server 30.

[0054] In step S13, the server 30 acquires the voice signal transmitted from the cooking assist device 10, performs voice recognition, and confirms the recipe based on the results of the voice recognition. Here, the text information "Yes, I'll make it" uttered in step S10 is recognized, and from this text information, the control unit 32 determines that the recipe has been approved, and confirms the recipe transmitted as a candidate in step S8.

[0055] In step S14, the server 30 extracts cooking data corresponding to the confirmed recipe from the cooking data group 37, and transmits the extracted cooking data to the cooker 20.

[0056] In step S15, the cooking appliance 20 that has received the cooking data saves the received cooking data in cooking data 29 (see FIG. 4), activates automatic cooking mode, and transmits a signal indicating the activation to the server 30. In step S16, the server 30 transmits recipe information and voice output instructions to the cooking assistance device 10. The recipe information transmitted here is information for informing the user of the cooking steps and tasks, and the voice output instructions are voice information that explains the cooking steps.

[0057] In step S17, the cooking assist device 10 performs voice output 3. For example, the voice output unit 11b outputs a voice explaining the cooking process and work, such as "Frozen dumpling automatic cooking mode will start on the left IH. Place the frying pan and arrange the frozen dumplings."

[0058] Cook 301, having heard voice output 3, places the frying pan on left heating opening 22 and arranges the frozen dumplings in the frying pan in accordance with the voice output. Then, in step S18, cook 301 utters "Start cooking" to instruct the cooking to begin.

[0059] In step S19, the cooking assistance device 10 performs voice output 4 to indicate that it has received a cooking start instruction. For example, the voice output unit 11b outputs a voice saying, "Cooking will start with the left IH." The cooking assistance device 10 then transmits a signal to the server 30 indicating that voice output 4 has been performed. Note that while FIG. 11 omits voice recognition of the cook's utterance in step S18, voice recognition may be performed as described in steps S5, S6, S7, etc.

[0060] In step S20, the server 30 that has received the signal transmits a control signal to the cooking appliance 20 to instruct it to start heating.

[0061] In step S21, the cooking appliance 20 starts a heating operation based on the cooking data stored in step S15.

[0062] FIG. 12 is a timing chart showing the operation of the cooking system 100 according to the embodiment from the start of heating to the end of heating by the cooking appliance 20. In FIG.

[0063] In step S21, the cooking device 20 transmits a signal indicating that heating has started to the server 30. As in cooking step 1 shown in Fig. 10, the cooking device 20 inputs 750 W of power to the left heating coil 23 and starts measuring the heating time using a timer.

[0064] In step S22, the server 30 transmits to the cooking assistant device 10 an instruction to notify the status at the start of heating based on the recipe.

[0065] In step S23, the cooking assistance device 10 outputs a voice 5 containing information to be conveyed to the cook 301 before heating begins. For example, the voice output unit 11b outputs a voice saying, "Heating will begin. Please close the lid after arranging the dumplings." In this way, by outputting a voice prompting the cook 301 to perform cooking operations, the user can perform cooking operations according to the procedure.

[0066] In step S24, when the condition for ending cooking step 1, that is, the condition that 10 minutes have passed since the start of heating, is met, cooking device 20 ends cooking step 1 and transmits a signal indicating the end to server 30.

[0067] In step S25, the server 30 receives the signal indicating the end of cooking step 1 and transmits a signal to the cooking assistant device 10 instructing it to notify the status.

[0068] In step S26, the cooking assistance device 10 performs voice output 6. For example, the voice output unit 11b outputs a voice prompting the cook 301 to perform cooking operations, saying, "Ten minutes have passed since the lid was put on. Please remove the lid."

[0069] In step S27, the cook 301, who has heard the voice output 6, removes the lid from the frying pan in accordance with the voice and speaks to instruct the cook to move on to the next process. For example, the cook 301 might say, "OK, I've removed the lid, so let's move on to the next process."

[0070] In step S28, the cooking assistance device 10 obtains a digital audio signal based on the voice input from the cook 301. Subsequently, in step S29, the cooking assistance device 10 transmits the audio signal to the server 30.

[0071] In step S30, the server 30 acquires a voice signal from the cooking assistance device 10, performs voice recognition, and recognizes that the acquired voice signal is an instruction to transition to the next step. The server 30 then transmits an instruction to transition to the next step to the cooking appliance 20 and the cooking assistance device 10. Specifically, the server 30 transmits to the cooking assistance device 10 a signal instructing it to output a voice indicating that the device will transition to cooking step 2 and a signal instructing it to monitor the temperature using the upper temperature sensor 12. In step S31, the cooking assistance device 10 outputs a voice message 7 regarding cooking step 2, such as "Increase the heat and start making wings." This allows the cook 301 to recognize that the device has transitioned from cooking step 1 to cooking step 2 and to understand the progress of the cooking. Also in step S31, the cooking assistance device 10 starts monitoring the temperature of the heating opening 22 using the upper temperature sensor 12.

[0072] In addition, in step S30, server 30 transmits a control signal to cooking appliance 20 to start the next process, cooking process 2. In step S32, cooking appliance 20 transitions to the next process, cooking process 2, increases the input power to left heating coil 23 to 1000 W as shown in Fig. 10, and starts measuring the heating time using a timer.

[0073] In step S33, the cooking assistant device 10, which is monitoring the temperature of the left heating port 22 of the cooking appliance 20 with the upper temperature sensor 12, detects 160°C, which is one of the conditions for ending cooking step 2, and sends a signal indicating this detection to the server 30. The cooking assistant device 10 may use the average, median, or maximum value of the temperatures detected by the multiple infrared detection elements of the upper temperature sensor 12 to determine whether the target temperature has been detected.

[0074] In step S34, the server 30 transmits the temperature information acquired from the cooking assist device 10 to the cooker 20. In step S35, when the conditions for ending cooking step 2, that is, five minutes have elapsed since the start of cooking step 2 and the temperature detected by the upper temperature sensor 12 is 160°C, are met, the cooker 20 ends cooking step 2 and transmits a signal indicating the end to the server 30.

[0075] In step S36, the server 30 receives the signal indicating the end of cooking step 2 and transmits a signal to the cooking assistant device 10 instructing it to notify the status.

[0076] In step S37, the cooking assist device 10 outputs the voice 8. For example, the voice output unit 11b outputs a voice saying, "The specified temperature has been reached. Cooking will now end."

[0077] Cook 301, having heard voice output 8, checks the state of the frying pan. Here, it is assumed that cook 301 determines that additional heating is necessary. In step S38, cook 301 inputs a voice command to extend the heating time. For example, cook 301 utters, "Extend the heating time by another 3 minutes."

[0078] In step S39, the cooking assistance device 10 obtains a digital audio signal based on the voice input from the cook 301. Subsequently, in step S40, the cooking assistance device 10 transmits the digital audio signal to the server 30.

[0079] In step S41, the server 30 acquires a voice signal from the cooking assistance device 10, performs voice recognition, and recognizes that the acquired voice signal is an instruction to extend the heating period by three minutes. The server 30 then transmits a control signal to the cooking appliance 20 instructing it to extend the heating period by three minutes. In step S42, the cooking appliance 20, having received the control signal, continues heating and transmits a signal indicating that it will continue to heat to the server 30. In step S43, the server 30 transmits a signal to the cooking assistance device 10 instructing it to report its status.

[0080] In step S44, the cooking assist device 10 performs the voice output 9. For example, the voice output unit 10b outputs a voice saying "Continue heating," to notify that the voice input from the cook 301 in step S38 has been accepted by the cooking appliance 20.

[0081] In step S45, when the heating time (3 minutes) has elapsed, the cooking appliance 20 ends the heating and transmits a signal indicating the end to the server 30. In step S46, the server 30 transmits a signal to the cooking assistant device 10 instructing it to notify the status.

[0082] In step S47, the cooking assist device 10 outputs the audio 10. For example, the audio output unit 11b outputs a voice informing the user that cooking has finished, saying, "The specified time has elapsed, cooking will now finish."

[0083] After hearing the voice output 10, the cook 301 checks the state of the frying pan and determines that the frying pan is sufficiently heated. In step S48, the cook 301 utters, for example, "Yes" as a voice input to instruct the cook to stop heating.

[0084] In step S49, the cooking assistance device 10 obtains a digital audio signal based on the voice input from the cook 301. Subsequently, in step S50, the cooking assistance device 10 transmits the digital audio signal to the server 30.

[0085] In step S51, the server 30 acquires a voice signal from the cooking assist device 10, performs voice recognition, and recognizes that the acquired voice signal is a heating end instruction. Then, the server 30 transmits a control signal instructing the cooking device 20 to end cooking. In step S52, the cooking device 20, which has received the cooking end control signal, ends cooking.

[0086] (Installation guide mode) The cooking system 100 of this embodiment can operate in an installation guide mode. The installation guide mode is an operating mode that helps the user install the cooking assistance device 10 by making the viewing area F of the upper temperature sensor 12 include each of the one or more heating ports 22 of the cooker 20 and the user area UF. In the installation guide mode, the cooking assistance device 10, the cooker 20, and the server 30 work together. The start and end of operation of the cooking system 100 in the installation guide mode are set by the state of a switch (not shown) provided on the cooking assistance device 10 or the cooker 20.

[0087] Fig. 13 is a flowchart showing an example of operation of the installation guide mode of the cooking system 100 according to the embodiment. Fig. 14 is a diagram illustrating the configuration of the field of view of the upper temperature sensor 12 according to the embodiment. Fig. 14(a) shows the cooking appliance 20 as viewed from the front, and Fig. 14(b) shows the cooking appliance 20 as viewed from the side. The field of view F of the upper temperature sensor 12 is divided into multiple detection areas corresponding to one or more heating openings 22 and the user area UF, and each of the multiple infrared elements is assigned to one or more of the detection areas. Fig. 14 shows an example in which the field of view F is divided into a right detection area FR and a left detection area FL.

[0088] Referring to Figure 13, the operation in the installation guide mode when adjusting the positional relationship between the left heating port 22 and the cooking assist device 10 will be described. At the start of the installation guide mode, the cooking assist device 10 is assumed to be temporarily fixed to the range hood 201 or the wall 202. When the installation guide mode is started, the cooking assist device 10 outputs a voice command to place a pot on the left heating port 22 of the cooker 20 and start heating, based on a control signal from the server 30 (step S101). For example, the voice output unit 11b outputs a voice command saying, "Place a pot on the left IH and start heating."

[0089] The user who hears the voice places a pot on the left heating port 22 and performs an operation to start heating on the operation display unit 25 (step S102). In response, the cooking appliance 20 supplies 500 W of power to the heating coil 23 of the left heating port 22 and transmits a signal indicating the start of power supply to the server 30 (step S103). By supplying power to the heating coil 23, the pot is heated to a high temperature.

[0090] The server 30 determines whether a first determination time has elapsed since power supply to the heating coil 23 of the left heating port 22 started in step S103 (step S104). If the first determination time has not elapsed (step S104: NO), the server 30 waits and causes the cooking appliance 20 to continue heating, and if the first determination time has elapsed (step S104: YES), the process proceeds to step S105. Here, the first determination time is, for example, 15 seconds.

[0091] The server 30 acquires the temperature Ta_1 detected by the lower temperature sensor 27 of the cooking appliance 20 and the maximum detected temperature Tb_1, which is the maximum value of the temperatures detected by the upper temperature sensor 12 (step S105). Specifically, the server 30 sends a request to the cooking appliance 20 to send the temperature Ta_1, which is the temperature detected by the lower temperature sensor 27, i.e., the temperature at the bottom of the pot, and the cooking appliance 20 sends temperature information indicating the temperature Ta_1 to the server 30. The server 30 also sends a request to the cooking assistant device 10 to send the maximum detected temperature Tb_1, which is the maximum value of the temperatures detected by the multiple infrared detecting elements of the upper temperature sensor 12, and the cooking assistant device 10 sends temperature information indicating the maximum detected temperature Tb_1.

[0092] Next, the server 30 determines whether a second judgment time has elapsed since the start of heating in step S103 (step S106). If the second judgment time has not elapsed (step S106: NO), the server 30 waits and causes the cooking appliance 20 to continue heating, and if the second judgment time has elapsed (step S106: YES), the server 30 proceeds to step S107. Here, the second judgment time is a time longer than the first judgment time, for example, 30 seconds.

[0093] The server 30 acquires the detected temperature Ta_2 of the lower temperature sensor 27 of the cooking appliance 20 and the maximum detected temperature Tb_2, which is the maximum value of the detected temperatures of the multiple infrared detection elements of the upper temperature sensor 12, at the time when the second determination time has elapsed (step S107). Next, the server 30 detects whether the difference between the temperature Ta_2 and the temperature Ta_1 exceeds the threshold value Ta, and whether the difference between the maximum detected temperature Tb_2 and the maximum detected temperature Tb_1 exceeds the threshold value Tb (step S108). In step S108, after the heating is started in step S103, it is determined whether the two temperatures have risen beyond the threshold value between the first determination time (e.g., 15 seconds) and the second determination time (e.g., 30 seconds). If the determination result in step S108 is YES, i.e., if the two temperature change amounts exceed the threshold value Ta or the threshold value Tb, respectively, the process proceeds to step S109. If the determination result in step S108 is NO, the process proceeds to step S111.

[0094] In step S109, the server 30 determines whether the maximum value of the detected temperatures of the multiple infrared elements of the upper temperature sensor 12 corresponds to the left detection area FL, which is the detection area corresponding to the left heating opening 22. If the maximum value of the detected temperatures of the multiple infrared elements of the upper temperature sensor 12 corresponds to the left detection area FL (step S109: YES), the installation position of the cooking assist device 10 relative to the left heating opening 22 is appropriate, so the process proceeds to step S110, where power supply to the heating coil 23 corresponding to the left heating opening 22 is stopped, and guidance on the installation position of the cooking assist device 10 relative to the left heating opening 22 is terminated. On the other hand, if the maximum value of the detected temperatures of the multiple infrared elements of the upper temperature sensor 12 does not correspond to the left detection area FL (step S109: NO), the process proceeds to step S111.

[0095] In step S111, based on the control signal from the server 30, the cooking assistant device 10 outputs a sound instructing the user to change the installation position of the cooking assistant device 10. Based on the determination results of steps S108 and S109, the server 30 may calculate the direction and distance of the positional deviation between the left detection area FL of the cooking assistant device 10 and the area of ​​the left heating opening 22, and may notify the user of the direction and distance to change the installation position of the cooking assistant device 10 based on the calculation results. The user adjusts the installation position of the cooking assistant device 10 based on the sound output in step S111. After step S111, the cooking system 100 returns to step S101 and continues the installation guide mode.

[0096] In Figure 13, the operation of the installation guide mode was explained using an example of adjusting the installation position of the cooking assistance device 10 relative to the left heating opening 22. In the installation guide mode, the installation position of the cooking assistance device 10 is adjusted in relation to the right heating opening 22 and the right detection area FR, as in Figure 13. The installation position of the cooking assistance device 10 is also adjusted in relation to the central heating opening 22 and the user area UF, and the field of view U. When adjusting the installation position of the cooking assistance device 10 relative to the user area UF, instead of placing a pot over the heating opening 22 and heating it as in Figure 13, the cooking assistance device 10 will output audio to prompt the user to enter the user area UF, and the server 30 will determine whether the user area UF is included in the field of view F based on the person's body temperature detected by the upper temperature sensor 12.

[0097] Furthermore, instead of sequentially adjusting the positional relationship between the multiple heating ports 22 of the cooker 20 and the cooking assist device 10, the positional relationship between the multiple heating ports 22 of the cooker 20 and the cooking assist device 10 may be adjusted simultaneously. In this case, in step S101 of Fig. 13, the cooking assist device 10 outputs a voice prompting the user to place pots on all of the heating ports 22 and start heating.

[0098] The installation position of the cooking assistance device 10 varies depending on the kitchen environment, but it is preferably approximately 80 to 90 cm above the top of the kitchen counter 200. Furthermore, laws and regulations require that the distance between the bottom of the range hood 201 and the fire source be within the range of 80 to 100 cm. The cooking assistance device 10 should be installed above the center of the height from the top of the kitchen counter 200 to the bottom of the range hood 201. Installing the cooking assistance device 10 at a higher position reduces the risk of a pot or frying pan operated on the cooking appliance 20 or the kitchen counter 200 colliding with the cooking assistance device 10 and also reduces the collection of operating sounds of the cooking appliance 20 as noise in the audio input unit 11a. Furthermore, increasing the distance between the cooking assistance device 10 and the cooking appliance 20 reduces the amount of exhaust gas from the cooking appliance 20 adhering to the cooking assistance device 10. Furthermore, if the cooking assistance device 10 is installed in an upward position, the area of ​​the cooking appliance 20 and the area around the kitchen counter 200 included in the field of view F will be expanded, allowing the temperatures of multiple heating ports 22 to be detected stably.

[0099] As described above, cooking assist device 10 of this embodiment includes voice input unit 11a, voice output unit 11b, upper temperature sensor 12 whose field of view includes the upper part of cooker 20, and communication unit 13 that communicates with server 30 that transmits control signals to cooker 20. Communication unit 13 transmits to server 30 voice information indicating the voice input to voice input unit 11a and temperature information related to the temperature detected by upper temperature sensor 12.

[0100] In this way, the voice and temperature information input to the cooking assistance device 10 are transmitted to the server 30, so the server 30 can use the received information to control the cooking assistance device 10 or the cooking appliance 20. For example, the server 30 can improve the convenience of the user's cooking work by instructing the cooking assistance device 10 to output voice to assist the user in cooking based on the received information. Also, for example, the server 30 can transmit a cooking control signal to the cooking appliance 20 based on the received information, so that the cooking appliance 20 can perform cooking operations according to the state of the food to be heated.

[0101] In the cooking assistance device 10, when the control unit 14, which functions as a human detection unit that detects a person based on the temperature detected by the upper temperature sensor 12, detects a person, the audio output unit 11b may output audio prompting the user to speak cooking instructions. Specifically, in FIG. 11, the audio output 1 in step S3 is triggered by the cooking appliance 20 being turned on in step S1. However, audio output 1 may also be triggered by the detection of a person in the user area UF. This allows the cooking assistance device 10 to start cooking assistance operations without the user having to operate the power button on the cooking appliance 20, improving user convenience. Alternatively, audio output 1 may be triggered when a person is detected in the user area UF for a predetermined period of time, thereby avoiding unnecessary audio output due to the temporary passage of a user.

[0102] Furthermore, when the cooking assistance device 10 detects a person based on the temperature detected by the upper temperature sensor 12, the audio output unit 11b may vary the audio output depending on the distance between the cooking assistance device 10 and the person. Specifically, because the upper temperature sensor 12 includes multiple infrared detection elements, the distance between the cooking assistance device 10 and the person can be detected based on the position of the infrared detection element that detected the person. When the distance between the person and the cooking assistance device 10 is large, the audio output unit 11b outputs a louder audio than when the distance between the person and the person is small, thereby improving the user's ability to hear the audio. Instead of or in addition to varying the volume of the audio, the content of the audio output may be varied. For example, when the distance between the person and the cooking assistance device 10 is large, a specific sound such as a buzzer or chime may be output before the spoken audio, followed by the spoken audio. This allows the audio to be heard while the user, even if they are far from the cooking assistance device 10, is focused, thereby reducing the user's risk of missing a part of the audio.

[0103] Cooking assist device 10 of this embodiment also includes case 16, which is attached to a wall and houses voice input unit 11a, voice output unit 11b, upper temperature sensor 12, and communication unit 13, and sound absorbing material 17 provided on the top surface of case 16. Upper temperature sensor 12 is an infrared sensor that detects infrared rays, and is housed in case 16 such that, when case 16 is attached to the wall, viewing area F is diagonally below upper temperature sensor 12. Therefore, viewing area F can include a wide area above cooker 20, where an object to be heated is placed.

[0104] The audio output unit 11b of the cooking assist device 10 may output audio urging the user to clean the case 16, particularly the outer surface. Specifically, when the number of times cooking has been performed using the cooking appliance 20 exceeds a threshold, the audio output unit 11b outputs an audio urging the user to clean, such as "Please clean the front of the case." The number of times cooking has been performed using the cooking appliance 20 may be the number of times the power to the cooking appliance 20 has been turned on, or the number of times heating has been performed using any of the heating ports 22. The number of cooking times may be counted by the cooking appliance 20 or by the server 30. The case 16 is prone to becoming soiled by oil splashes or oily smoke during cooking, so by urging the user to clean, the case 16 is more likely to be kept clean, thereby preventing a decrease in the detection accuracy of the upper temperature sensor 12.

[0105] The cooking system 100 of this embodiment includes a cooking assistance device 10, a server 30, and a cooking appliance 20. The server 30 transmits control instructions to the cooking appliance 20 based on the voice information and temperature information transmitted from the cooking assistance device 10, and the cooking appliance 20 has an automatic cooking mode in which it heats an object to be heated based on the control instructions. The automatic cooking mode reduces the amount of work that the user has to do directly to operate the cooking appliance 20, thereby reducing the workload of the user and ensuring uniform cooking results.

[0106] Cooking appliance 20 also includes an operation unit that accepts operation input from the user and a communication unit that communicates with server 30. When the operation unit accepts the operation input, communication unit 13 transmits an operation signal to server 30. When server 30 receives the operation signal, it transmits a signal to cooking assistance device 10 instructing it to collect cooking information, and audio output unit 11b of cooking assistance device 10, which has received the signal instructing it to collect cooking information, outputs audio prompting the user to speak a cooking menu. In this way, when it recognizes the user's intention to start cooking by operating the operation unit, cooking assistance device 10 prompts the user to speak a cooking menu and proceeds with cooking, thereby reducing the user's workload.

[0107] Cooking appliance 20 is equipped with a lower temperature sensor 27 that detects the lower temperature, which is the temperature of the lower part of the object to be heated, and communication unit 26 transmits the lower temperature detected by lower temperature sensor 27 to the server, and server 30 transmits control instructions to cooking appliance 20 based on the voice information and temperature information transmitted from cooking assist device 10 and the lower temperature information. In this way, the lower temperature of the object to be heated detected by cooking appliance 20 is reflected in the control of cooking appliance 20 by server 30, enabling cooking appliance 20 to perform heating operations suited to the state of the object to be heated.

[0108] Furthermore, when the cooker 20 is operating in the automatic cooking mode, the communication unit 13 of the cooking assist device 10 transmits voice information input to the voice input unit 11a to the server 30. If the voice information is an operation change instruction that is an instruction to change the operation of the cooker 20, the server 30 updates the control instruction based on the operation change instruction and transmits the updated control instruction to the cooker 20. In this way, when the cooker 20 is operating in the automatic cooking mode, the control instruction for the cooker 20 is changed based on voice input from the user, making it easier to perform cooking according to the user's requests.

[0109] Furthermore, the cooking assist device 10 of this embodiment has an installation guide mode that provides guidance on the installation position of the cooking assist device 10. When operating in the installation guide mode, the audio output unit 11b outputs a guide audio instructing the heating cooker 20 to perform a heating operation, and after outputting the guide audio, outputs a sound urging the user to change the installation position of the cooking assist device 10. In this way, outputting the guide audio makes it easier for the user to install the cooking assist device 10 in an appropriate position.

[0110] Furthermore, in the cooking system 100 of this embodiment, when the cooking assistance device 10 is operating in the installation guide mode, the audio output unit 11b outputs an audio guide instructing the cooking appliance 20 to perform a heating operation. The communication unit 13 transmits temperature information in the guide mode, relating to the temperature detected by the upper temperature sensor 12 after the audio guide is output, to the server 30. Based on the temperature information after the audio guide is output, the server 30 determines whether the installation location of the cooking assistance device 10 satisfies predetermined conditions, and if the conditions are not satisfied, transmits an instruction to the cooking assistance device 10 to output an audio prompting the user to change the installation location of the cooking assistance device 10. Operation in this installation guide mode makes it easier for the user to install the cooking assistance device 10.

[0111] In the embodiment, an example has been described in which the server 30 communicates with and controls the cooking assistance device 10 and the cooking appliance 20, but the cooking assistance device 10 or the cooking appliance 20 may have the functions of the server 30.

[0112] Various aspects of the present disclosure are summarized below as appendices.

[0113] (Appendix 1) A cooking auxiliary device that is installed above a cooking appliance that heats an object to be heated from below, an audio input unit; an audio output unit; an upper temperature sensor whose viewing area includes an upper portion of the cooking appliance; a communication unit that communicates with a server that transmits a control signal to the cooking appliance; The communication unit transmits, to the server, voice information indicating the voice input to the voice input unit and temperature information regarding the temperature detected by the upper temperature sensor. Cooking aids. (Appendix 2) a human detection unit that detects a human based on the temperature detected by the upper temperature sensor; When the human detection unit detects a human, the audio output unit outputs audio that prompts the user to speak instructions regarding cooking. 10. The cooking assistance device of claim 1. (Appendix 3) The sound output by the sound output unit varies depending on the distance from the person detected by the person detection unit. 10. A cooking assistance device as described in Appendix 2. (Appendix 4) an installation guide mode for guiding the installation position of the cooking assist device; When operating in the installation guide mode, The audio output unit outputs a guide voice instructing the cooking appliance to perform a heating operation, and after outputting the guide voice, outputs a voice prompting the user to change the installation position of the cooking assist device. A cooking assistance device according to any one of Supplementary Notes 1 to 3. (Appendix 5) a case that accommodates the audio input unit, the audio output unit, the upper temperature sensor, and the communication unit; a sound-absorbing material provided on the upper surface of the case, the upper temperature sensor is an infrared sensor that detects infrared rays, The upper temperature sensor is housed in the case such that the field of view is diagonally below the upper temperature sensor when the case is attached to an attachment site. 5. A cooking assistance device according to any one of Supplementary Notes 1 to 4. (Appendix 6) The audio output unit outputs audio prompting cleaning of the case. 10. The cooking assistance device according to claim 5. (Appendix 7) A cooking assistance device according to any one of Supplementary Notes 1 to 6, the server; the cooking appliance communicating with the server; the server transmits a control instruction to the cooking appliance based on the voice information and the temperature information transmitted from the cooking assisting device; The cooking device operates in an automatic cooking mode to heat the object to be heated based on the control instruction. Cooking system. (Appendix 8) When the cooking device receives an operation input, the cooking device transmits an operation signal corresponding to the operation input to the server; The server When the operation signal is received, a signal instructing the cooking assistance device to collect cooking information is transmitted; The audio output unit of the cooking assistance device that has received the signal instructing collection of cooking information outputs audio prompting the user to speak about the cooking contents. 8. The cooking system of claim 7. (Appendix 9) The cooking device includes: A lower temperature sensor is provided to detect a lower temperature, which is the temperature of a lower portion of the heated object, the cooking appliance transmits the lower temperature detected by the lower temperature sensor to the server; The server transmits a control instruction to the cooking appliance based on the voice information and the temperature information transmitted from the cooking assisting device and the lower temperature. 9. The cooking system of claim 7 or 8. (Appendix 10) the communication unit of the cooking assist device transmits the voice information input to the voice input unit to the server when the cooking appliance is operating in the automatic cooking mode; The server If the voice information is an operation change instruction that is an instruction regarding an operation change of the cooking device, the control instruction is updated based on the operation change instruction, and the updated control instruction is transmitted to the cooking device. A cooking system according to any one of Supplementary Notes 7 to 9. (Appendix 11) A cooking assistance device according to claim 4; the server; The cooking device is provided, When the cooking assistance device is operating in the installation guide mode, the audio output unit outputs a guide audio instructing the cooking appliance to perform a heating operation; the communication unit of the cooking assist device transmits temperature information regarding the temperature detected by the upper temperature sensor after the guidance voice is output to the server; The server Based on the temperature information after the guidance voice is output, it is determined whether the installation position of the cooking assistance device satisfies a predetermined condition, and if the condition is not satisfied, an instruction to output a voice prompting the user to change the installation position of the cooking assistance device is transmitted to the cooking assistance device. Cooking system. [Explanation of symbols]

[0114] 10 cooking assistance device, 10b audio output unit, 11 audio module, 11a audio input unit, 11b audio output unit, 12 upper temperature sensor, 13 communication unit, 14 control unit, 15 power supply unit, 16 case, 17 sound absorbing material, 18 power line, 20 cooking appliance, 21 top plate, 22 heating outlet, 23 heating coil, 24 control unit, 25 operation display unit, 26 communication unit, 27 lower temperature sensor, 28 inverter circuit, 29 cooking data, 30 server, 31 communication unit, 32 control unit, 33 voice recognition unit, 34 voice signal generation unit, 35 voice data, 36 recipe information, 37 cooking data group, 100 cooking system, 200 kitchen counter, 201 range hood, 202 wall, 300 pot, 301 cooker, 302 ingredients, F field of view, FC1 Center of front and rear visual fields, FC2 center of left and right visual fields, FL left detection area, FR right detection area, UF user area.

Claims

1. A cooking auxiliary device that is installed above a cooking appliance that heats an object to be heated from below, an audio input unit; an audio output unit; an upper temperature sensor whose viewing area includes an upper portion of the cooking appliance; a communication unit that communicates with a server that transmits a control signal to the cooking appliance; The communication unit transmits, to the server, voice information indicating the voice input to the voice input unit and temperature information regarding the temperature detected by the upper temperature sensor. Cooking aids.

2. a human detection unit that detects a human based on the temperature detected by the upper temperature sensor; When the human detection unit detects a human, the audio output unit outputs audio that prompts the user to speak instructions regarding cooking. The cooking assistance device according to claim 1 .

3. The sound output by the sound output unit varies depending on the distance from the person detected by the person detection unit. The cooking assistance device according to claim 2 .

4. an installation guide mode for guiding the installation position of the cooking assist device; When operating in the installation guide mode, The audio output unit outputs a guide voice instructing the cooking appliance to perform a heating operation, and after outputting the guide voice, outputs a voice prompting the user to change the installation position of the cooking assist device. The cooking assistance device according to any one of claims 1 to 3.

5. a case that accommodates the audio input unit, the audio output unit, the upper temperature sensor, and the communication unit; a sound-absorbing material provided on the upper surface of the case, the upper temperature sensor is an infrared sensor that detects infrared rays, The upper temperature sensor is housed in the case such that the field of view is diagonally below the upper temperature sensor when the case is attached to an attachment site. The cooking assistance device according to any one of claims 1 to 3.

6. The audio output unit outputs audio prompting cleaning of the case. The cooking assistance device according to claim 5.

7. The cooking assistance device according to any one of claims 1 to 3, the server; the cooking appliance communicating with the server; the server transmits a control instruction to the cooking appliance based on the voice information and the temperature information transmitted from the cooking assisting device; The cooking device operates in an automatic cooking mode to heat the object to be heated based on the control instruction. Cooking system.

8. When the cooking device receives an operation input, the cooking device transmits an operation signal corresponding to the operation input to the server; The server When the operation signal is received, a signal instructing the cooking assistance device to collect cooking information is transmitted; The audio output unit of the cooking assistance device that has received the signal instructing collection of cooking information outputs audio prompting the user to speak about the cooking contents. The cooking system of claim 7.

9. The cooking device includes: A lower temperature sensor is provided to detect a lower temperature, which is the temperature of a lower portion of the heated object, the cooking appliance transmits the lower temperature detected by the lower temperature sensor to the server; The server transmits a control instruction to the cooking appliance based on the voice information and the temperature information transmitted from the cooking assisting device and the lower temperature. The cooking system of claim 7.

10. the communication unit of the cooking assist device transmits the voice information input to the voice input unit to the server when the cooking appliance is operating in the automatic cooking mode; The server If the voice information is an operation change instruction that is an instruction regarding an operation change of the cooking device, the control instruction is updated based on the operation change instruction, and the updated control instruction is transmitted to the cooking device. The cooking system of claim 7.

11. The cooking assist device according to claim 4; the server; The cooking device is provided, When the cooking assistance device is operating in the installation guide mode, the audio output unit outputs a guide audio instructing the cooking appliance to perform a heating operation; the communication unit of the cooking assist device transmits temperature information regarding the temperature detected by the upper temperature sensor after the guidance voice is output to the server; The server Based on the temperature information after the guidance voice is output, it is determined whether the installation position of the cooking assistance device satisfies a predetermined condition, and if the condition is not satisfied, an instruction to output a voice prompting the user to change the installation position of the cooking assistance device is transmitted to the cooking assistance device. Cooking system.

Images