Cooking equipment with camera

Abstract

The present invention relates to a cooking device, and more specifically, to a cooking device that accommodates a cooking object in a cooking space and performs cooking. According to one embodiment of the present invention, a cooking device and a control method thereof can be provided, wherein the cooking device comprises: a box; a cavity that accommodates the cooking object; a door that is rotatably arranged on the box and has a perspective window; a camera module that generates an image by photographing the cooking object accommodated in the cavity; a heating module that heats the cooking object and performs cooking; a user interface that is configured so that a user inputs a cooking command or inputs cooking parameters including a cooking temperature and a cooking time; an artificial intelligence module that inputs a change trend of the cooking parameters from the start of cooking to the present through learning, and outputs an image of the cooking object predicted after the end of cooking (cooking prediction image); and a control unit that controls the driving of the camera module, the heating module, and the artificial intelligence module based on the cooking command or the cooking parameter.

Description

Technical Field

[0001] The present invention relates to a cooking device, and more particularly to a cooking device for accommodating a cooking object in a cooking space and performing cooking. Background Art

[0002] A cooking device is a device or household appliance that cooks by applying heat to an object to be cooked. The cooking device includes a cooking device that cooks the object by directly applying heat to a container containing the object to be cooked, and a cooking device that contains the object to be cooked in a cooking space and cooks the object by heating the cooking space itself.

[0003] The cooking space or the cooking object accommodating space may be referred to as a cavity. If the door is closed, the inner space of the cavity is isolated from the outer space. If the door is opened, the inner space of the cavity is connected to the outer space.

[0004] The oven in this cooking device can be called a kind of household electrical appliance that cooks cooking objects in the internal space of the cavity.

[0005] According to the heating source in the oven, that is, the heating method, the oven can be classified into a light wave oven, an electromagnetic wave oven, a gas oven or an electric heater oven, etc. Of course, it can be further subdivided.

[0006] Since a cooking device such as an oven accommodates an object inside a certain space and cooks, it is difficult to grasp the cooking state with the naked eye. Therefore, it is difficult to grasp the appropriate cooking state. For the above reasons, many cooking devices are equipped with a transparent window on a part of the door set on the front side thereof, so that the cooking object inside the cooking space can be viewed from the outside. However, most of the transparent windows are processed with polarizing films, etc., so it is not easy to grasp the cooking state of the object with the naked eye. Therefore, in most cases, the door is opened and the cooking state of the object is repeatedly confirmed with the naked eye.

[0007] Cooking in a cooking device such as an oven takes a long time. Therefore, it is very inconvenient to repeatedly open and close the door. For the above reasons, most cooking devices provide a recipe for the cooking object. That is, each recipe has a cooking parameter that is recommended or set.

[0008] However, even when cooking according to a set recipe, most users still open the door and check the status of the cooking object before finishing cooking.

[0009] Therefore, it is necessary to provide a cooking device that can minimize the number of times the door is opened and can effectively grasp the cooking state. In addition, it is necessary to provide a cooking device that utilizes existing cooking experience to improve cooking satisfaction. Summary of the invention

[0010] Problems to be solved by the invention

[0011] The basic purpose of the present invention is to solve the above-mentioned problems of cooking devices in the prior art.

[0012] According to an embodiment of the present invention, a cooking object is identified by a camera, thereby providing a user-customized cooking device.

[0013] According to an embodiment of the present invention, a cooking device that can be easily used by voice commands is provided. In particular, a cooking device that can recognize a control command that is subjective and perceptual and can effectively reflect the control command that is subjective and perceptual is provided.

[0014] According to an embodiment of the present invention, an object is to provide a cooking device that can provide a user with an image of a cooking object predicted after cooking is finished (cooking prediction image), thereby minimizing the number of times the user can visually confirm the cooking object during cooking.

[0015] According to an embodiment of the present invention, an object is to provide a cooking apparatus which changes a cooking prediction image in response to a change in a cooking parameter, thereby enabling a user to more easily input an operation or setting of the cooking parameter.

[0016] According to an embodiment of the present invention, an object is to provide a cooking device which can input a cooking command or a cooking parameter through a cooking prediction image, thereby having a very convenient user interface.

[0017] According to an embodiment of the present invention, an object is to provide a cooking device that is evolved and intelligent by applying artificial intelligence learning, wherein the artificial intelligence learning inputs a cooking command or a cooking parameter and outputs a cooking prediction image.

[0018] According to an embodiment of the present invention, an object is to provide a cooking device that can communicate with an external server or an external terminal, so that a user interface can be extended to the external terminal.

[0019] Technical solutions to the problem

[0020] In order to achieve the above-mentioned purpose, according to one embodiment of the present invention, a cooking device and a control method thereof can be provided, wherein the cooking device includes: a box; a cavity, which is configured to accommodate a cooking object; a door, which is rotatably arranged on the box and has a perspective window; a camera module, which is configured to generate an image by photographing the cooking object accommodated in the cavity; a heating module, which heats the cooking object and cooks it; a user interface, which is configured for a user to input a cooking command, or input cooking parameters including a cooking temperature and a cooking time; an artificial intelligence module, which inputs a change trend of the cooking parameters from the start of cooking to the present through learning, and outputs an image of the cooking object predicted after the end of cooking (cooking prediction image); and a control unit, which controls the driving of the camera module, the heating module and the artificial intelligence module based on the cooking command or the cooking parameter.

[0021] Here, the cooking command may be a cooking start command for a specific recipe. If the specific recipe is determined, cooking parameters for the specific recipe may be automatically set.

[0022] The cooking parameter is a variable that determines how to cook or not. As an example, it can include cooking time or cooking temperature. More specifically, the change of cooking temperature and cooking parameters that occur according to the passage of cooking time.

[0023] As an example, the preheating temperature after the start of cooking, the temperature in the middle of cooking, and the temperature at the end of cooking may be set to different temperatures.

[0024] Preferably, the cooking device includes a memory storing an image generated by photographing the cooking object.

[0025] The memory may store images that have been generated. That is, images generated when the user directly uses the device may be stored, and multiple images generated by a cooking device vendor or manufacturer may also be stored. In addition, multiple images generated when other users use the cooking device may also be stored. That is, each image may be updated by the server.

[0026] Preferably, the memory distinguishes and stores each of the plurality of images generated for the same cooking object based on the color change of the cooking object and according to the degree of cooking. Therefore, if there are ten images for the same cooking object, they can be distinguished and stored according to the degree of cooking.

[0027] Preferably, when there is a specific image corresponding to the cooking prediction image among the images stored in the memory, the artificial intelligence module outputs the specific image as the cooking prediction image.

[0028] Of course, in the absence of a specific image, the specific image can also be downloaded via the server and output. In this case, preferably, each image is stored in a manner that matches the input factor. In addition, in the absence of a specific image, the artificial intelligence module generates a new image through a learning process and outputs the new image.

[0029] That is, the difference in the degree of cooking can be understood by the color change of the cooked object. Therefore, even if there is no specific image, a specific image can be generated by the before and after images of the degree of cooking.

[0030] Preferably, the user interface is configured to display the cooking prediction image. To this end, the cooking device may include a display or a touch display. The user utilizes the cooking prediction image to observe the cooking state of the cooking object without the need for naked eyes during cooking. Therefore, it is very convenient to use.

[0031] The user interface may include a microphone module, and the microphone module receives a cooking command or a cooking parameter through a user's voice. The user can directly select a cooking command or a cooking parameter without using hands. Therefore, it is very convenient to use.

[0032] The cooking device is characterized by comprising a voice recognition module, which distinguishes and recognizes a relative cooking degree increase or decrease command from the user's voice received by the microphone module based on the cooking prediction image.

[0033] The voice recognition module can be configured to recognize not only direct cooking parameters or setting commands, such as increasing or decreasing cooking temperature or increasing or decreasing cooking time, but also commands that are more subjective, emotional, and relative.

[0034] For example, voice commands such as "keep the current state", "cook more", and "medium rare" can be recognized as command words indicating the relative increase or decrease of the cooking degree. That is, such command words can be recognized and reflected to the cooking degree predicted by the current cooking command or cooking parameters. Therefore, the cooking parameters can be changed and set through such voice commands, thereby matching the increase or decrease of the cooking degree with the currently predicted cooking degree.

[0035] In addition, the difference in the increase or decrease of the cooking degree can also be recognized through voice commands. That is, the difference in the cooking degree between the command words "more done" and "more well done" can be recognized. Therefore, the range of change of the cooking parameters can be made larger.

[0036] The control unit may reset the current cooking parameters based on the relative cooking degree increase or decrease command recognized by the voice recognition module.

[0037] When the cooking command or cooking parameter is changed, the user interface preferably displays the changed cooking prediction image. Therefore, the user can intuitively grasp how much the cooking degree has changed based on the reset cooking command or cooking parameter. Therefore, it is very convenient to use.

[0038] Preferably, the user interface provides a cooking time that changes in response to the changed cooking prediction image.

[0039] The user selects any one of the images stored in the memory, whereby the cooking device can receive the input cooking command or cooking parameter. Therefore, the user can input the cooking command or cooking parameter by viewing the image of the finished cooking, rather than directly selecting the cooking command or cooking parameter through various input devices (for example, buttons or knobs, etc.). If the user selects the image of the finished cooking, the cooking command or cooking parameter corresponding to such image can be set. Therefore, the trouble caused by complex determination and selection of the cooking command or cooking parameter can be eliminated for the user.

[0040] A communication module may be included, and the communication module is used to send the cooking prediction image to an external terminal. Thus, the cooking device can extend the user interface to the external terminal.

[0041] Generally, most cooking devices are equipped with a display, especially a display for realizing color images or videos. On the other hand, as an example of an external terminal, in the case of a smart phone, a high-resolution touch display is usually equipped. Therefore, the user can use the external terminal as if using the user interface of the cooking device. In other words, the user interface of the cooking device can be extended to the external terminal.

[0042] The user can easily grasp the current state of the cooking device through various cooking information (cooking commands, cooking parameters, cooking prediction images, remaining cooking time, whether cooking is in progress, etc.) received from the cooking device. In addition, the cooking command or cooking parameter resetting command can be easily executed. In particular, the cooking prediction image can be used to more easily re-set the cooking command or cooking parameter.

[0043] To this end, the cooking device preferably includes a communication module, through which the cooking command or the change of the cooking parameter can be received from the external terminal.

[0044] The cooking device can communicate with the external terminal via the external server. Of course, the cooking device can also communicate directly with the external terminal.

[0045] A communication module may be included, and the communication module is used to send the learning results of the artificial intelligence module to an external server.

[0046] A communication module may be included, and the communication module is used to update the learned results from an external server.

[0047] The camera module can communicate with the control unit, and is detachably disposed outside the perspective window, or inside the perspective window.

[0048] In order to recognize the cooking object before starting cooking, the camera module may photograph the cooking object and generate an image.

[0049] In the case where there is a cooking evolution history (history) for an existing cooking object corresponding to the cooking object, a cooking prediction image is stored. Therefore, a plurality of stored cooking prediction images can be provided to the user. The user can replace the input of a cooking command or a cooking parameter by selecting a specific cooking prediction image. This is because the specific cooking prediction image matches the setting value of the specific cooking command or cooking parameter.

[0050] The user interface may include a speaker providing a voice for introducing a cooking mode to a user based on the recognized cooking object.

[0051] Preferably, the user interface is configured to display a cooking mode based on the identified cooking object to introduce the cooking mode to the user. If the cooking mode cannot be displayed, the cooking mode information can be sent to an external terminal and the cooking mode can be displayed to introduce the cooking mode on the external terminal.

[0052] A communication module for communicating with an external server may be included, and the communication module may transmit cooking information to an external terminal via the external server, and may receive a cooking command from the external terminal via the external server.

[0053] The features of the above-described embodiments may be implemented in combination in other embodiments unless they are contradictory or mutually exclusive.

[0054] Effects of the Invention

[0055] According to an embodiment of the present invention, a cooking object can be identified by a camera, thereby providing a user-customized cooking device.

[0056] According to an embodiment of the present invention, a cooking device that can be easily used by voice commands can be provided. In particular, a cooking device that can recognize a subjective and emotional control command and can effectively reflect the subjective and emotional control command can be provided.

[0057] According to an embodiment of the present invention, a cooking apparatus can be provided that can provide a user with an image of a predicted cooking object after cooking is finished (cooking prediction image), thereby minimizing the number of times the user can visually confirm the cooking object during cooking.

[0058] According to an embodiment of the present invention, a cooking apparatus can be provided which changes a cooking prediction image corresponding to a change in a cooking parameter, thereby enabling a user to more easily input an operation or setting of the cooking parameter.

[0059] According to an embodiment of the present invention, a cooking device can be provided, which can input a cooking command or a cooking parameter through a cooking prediction image, thereby having a very convenient user interface.

[0060] According to an embodiment of the present invention, a cooking device that is evolved and intelligentized by applying artificial intelligence learning, which inputs a cooking command or a cooking parameter and outputs a cooking prediction image, can be provided.

[0061] According to an embodiment of the present invention, a cooking device can be provided, which can communicate with an external server or an external terminal, thereby being able to extend a user interface to the external terminal. BRIEF DESCRIPTION OF THE DRAWINGS

[0062] Figure 1 The appearance of a cooking device according to an embodiment of the present invention is shown;

[0063] Figure 2 Shows Figure 1 The cooking device is shown with its door disassembled;

[0064] Figure 3 The control structure of the cooking device according to one embodiment of the present invention is shown;

[0065] Figure 4 The control flow of a cooking device according to an embodiment of the present invention is shown;

[0066] Figure 5An example of a cooking prediction image in which a cooking degree is displayed on a user interface and / or an external terminal of a cooking device in a rare (underdone) state;

[0067] Figure 6 An example of a cooking prediction image in which the cooking degree is in an intermediate (medium, done: half-cooked / done) state displayed on the user interface and / or external terminal of the cooking device;

[0068] Figure 7 This is an example of a cooking prediction image showing a well-done state of cooking degree on the user interface of the cooking device and / or the external terminal. DETAILED DESCRIPTION

[0069] Hereinafter, a cooking apparatus according to an embodiment of the present invention will be described in detail with reference to the accompanying drawings.

[0070] Figure 1 The present invention shows a cooking device applicable to an embodiment of the present invention. Specifically, the cooking device shows a handle 150 provided on the upper front portion of the door 100, and the door is opened and closed while rotating about the rotation center of the lower portion of the door.

[0071] The cooking device includes a box body 10 forming an outer shape, and a cavity 11 for cooking is provided inside the box body 10. Such a cavity can be called an object receiving portion. Similarly, a door 100 rotatably provided on the box body 10 is included, and the object receiving portion 11 needs to be observed through such door 100. That is, the cooking state of the cooking object inside the cavity 11 can be grasped.

[0072] The cooking device may be provided with a control panel 12 for the user to operate, and the control panel 12 may be provided with an operating unit 13. An example of such an operating unit may be a knob. The control panel may be provided with a selection device such as a knob, or a selection device such as a button. In addition, a display unit for displaying the cooking time or the cooking status may be provided.

[0073] Therefore, such a control panel 12 may be referred to as a user interface.

[0074] In the cooking device, a stovetop 17 for forming a separate cooking area may be provided on the upper portion of the housing 10. Furthermore, a rear display unit 18 may be provided as required. Here, the rear display unit 18 may also be referred to as a part of the user interface.

[0075] In the following, reference is made to Figure 2 , detailed description Figure 1The door structure of the cooking device shown in the figure. Since the temperature inside the cavity (cooking space) is very high, the door structure is preferably resistant to high temperatures and can provide the camera module with a structure that can work stably at high temperatures.

[0076] The door 100 is connected to the box body 10 to open and close the object storage part 11 for storing objects. The door 100 is provided with a handle 150, and a user opens and closes the door 100 by holding the handle 150.

[0077] The door 100 may be composed of a plurality of frames, and the door frame 205 is formed by combining the plurality of frames.

[0078] The door frame 205 may include an outer door 210 forming a front side of the door and a door liner 280 forming a back side of the door. A predetermined space may be formed between the outer door 210 and the door liner 280.

[0079] An inner frame 230 may be provided between the outer door 210 and the door lining 280. In addition, hollow portions 241 to 281 may be formed in the center of each of the plurality of frames 210, 230, and 280 so that the interior of the object storage portion can be observed. These hollow portions 241 and 281 form a perspective window 120. In addition, a heat insulation panel and a front panel 110 corresponding to these windows may be provided.

[0080] The outer door 210 may be provided with a front panel 110. The front panel 110 may be coupled to the outer door 210 at the front of the outer door 210. However, the front panel 110 is preferably coupled to the outer door 210 at the rear of the outer door 210.

[0081] The front panel 110 may be formed to be larger than the hollow parts 241 and 281 of the outer door 210. That is, it may be formed to completely cover the hollow parts 241 and 281. Such a front panel 110 may be formed of a glass material. The front panel 110 and the outer door 210 together form the front of the door 100.

[0082] The front panel 110 forms a perspective window and can also be a structure for installing a camera. Therefore, the camera module 30 can be arranged to be closely attached to the front panel 110 .

[0083] The camera module 30 may be installed in a manner of being closely attached to the front panel 110 at the rear of the front panel 110. Of course, the camera module 30 may be installed in a manner of being closely attached to the front panel 110 at the front of the front panel 110. In any of the above cases, the camera module may be installed in a position where the interior of the cavity can be photographed through the perspective window.

[0084] The camera module 30 may be detachably mounted on the door using a magnet or a separate bracket. In this case, the camera module may be configured to communicate with the control unit 90. The camera module may generate an image under the control of the control unit and send the generated image to the cooking device.

[0085] The front panel 110 may be provided together with a window panel 240. The window panel 240 is provided for heat insulation, and thus may be referred to as a heat insulation panel. Such a heat insulation panel may also be formed of multiple layers, preferably formed of glass material.

[0086] A hinge 295 may be provided inside the door 100, and the door 100 is opened and closed by using the hinge 295. The home appliance may be a pull-down type door. Therefore, the hinge 295 may include a damper.

[0087] A shielding panel 290 may be formed at a lower portion of the door 100 .

[0088] On the other hand, Figure 2 Unlike the example shown, the camera module 30 may be disposed inside the door 100. The camera module 30 may be buried inside the door 100, such as between the front panel and the insulation panel, between the insulation panels, etc., so that heat is not directly transferred to the camera module 30.

[0089] The entire transparent window 120 may be treated with a polarizing film. However, such polarizing film treatment may reduce the resolution of the image or make it difficult to generate a clear image.

[0090] Therefore, the polarizing film process may be excluded or minimized at the perspective window portion corresponding to the camera module.

[0091] In the following, reference is made to Figure 3 A control structure of a cooking device according to an embodiment of the present invention is described in detail.

[0092] The camera module 30 is provided to generate an image by photographing the cooking object. The camera module 30 is configured to photograph the cooking object contained in the cavity.

[0093] It can be considered that the environment inside the cavity is at a very high temperature. Therefore, the camera module needs to be protected from the high temperature. Therefore, the camera module 30 can be set in front of the door 100. That is, the camera module 30 can be set on the outer surface of the door, rather than the inner surface of the door that directly contacts the cavity, or can be set between the inner surface and the outer surface of the door.

[0094] In addition, the camera module 30 can be provided in a detachable form. The camera module 30 can be installed on the front of the door or removed from the front of the door as needed. In this case, the camera module 30 can be provided to communicate with the control unit 90.

[0095] In order to heat the cooking object and cook it, a heating module 40 is provided. The heating module 40 may be a heating module for heating the object such as a gas heater or an electric heater, and may be a heating module for cooking the object using microwaves. The control unit 90 controls the working time, working moment, and working conditions (temperature, output) of the heating module 40.

[0096] A UI (user interface) is provided so that the user can input cooking conditions or grasp the cooking status. The UI may include a display that can display any one or more of various images such as an image generated by the camera module 30, an image downloaded via a server, and an image stored in the memory 92. The UI may display a currently captured image or an image captured in the past.

[0097] Specifically, the UI can display the currently captured image and the image that will be predicted after the cooking is finished. Therefore, the user can intuitively grasp the current cooking degree through the currently captured image and the predicted image.

[0098] A microphone module 50 may be included, which is used to recognize a user's voice command. Therefore, the microphone module 50 may also be considered as part of the UI. Voice commands may be executed using the microphone module 50, so that the user may easily input control commands even without the operation of buttons or knobs.

[0099] In order to output the current state or reminder, etc. in the cooking device by voice, a speaker 70 may be included. Therefore, the speaker 70 may also be considered as a part of the UI. In response to the user's voice command, the speaker 70 of the cooking device may output a confirmation message in the form of voice. That is, the voice output may be performed through the speaker, and the voice output performs a voice output for confirming the voice command or is executing the received voice command.

[0100] The control unit 90 controls the operation of the cooking device based on a user command input via the UI or the microphone module 50 .

[0101] The control part 90 may include an artificial intelligence module 91. Of course, the artificial intelligence module 91 may be provided separately from the control part 90 to perform wired and wireless communication with the control part 90. The control part 90 may control the operation of the cooking device based on the output of the artificial intelligence module 91.

[0102] The control section 90 may include a memory 92. Of course, the memory 92 may be provided separately from the control section to perform wired and wireless communication with the control section.

[0103] The control unit 90 may include a voice recognition module 93. Of course, the voice recognition module 93 may be provided separately from the control unit 90 to perform wired and wireless communication with the control unit 90. In the voice recognition module 93, a function of recognizing and analyzing a user's voice command received via the microphone module 50 may be performed.

[0104] The cooking device may be connected in communication with the external server 1. To this end, the cooking device may include a communication module 60. The cooking device is connected in communication with the external server so that the image generated by the camera module 30 and related information may be sent to the external server.

[0105] For example, an image generated after cooking is finished can be matched with information about the cooking history. That is, it can be confirmed what kind of cooking process has been followed to complete the image of the cooking object. For example, information such as the type of cooking object, the name of the dish, the cooking process, the cooking temperature, and the time conditions can be matched with the cooking image. Of course, not only can an image after cooking is finished, but also an image at the beginning of cooking or an image during cooking can be generated, and similarly, each image can be matched with relevant information. Therefore, as cooking experience is accumulated through the cooking device, images and relevant information can be accumulated.

[0106] In addition, the cooking device can also download images and related information via the server. That is, it can easily receive the cooking experience of other cooking devices accumulated in the server.

[0107] Therefore, it is possible to easily receive cooking experiences and information of other users under the same cooking device, whereby the user can use the cooking device very efficiently and easily.

[0108] On the other hand, the server 1 may be a server providing voice recognition. In this case, there is no need to install the voice recognition module 93 on the cooking device. That is, the voice command received via the microphone module of the cooking device is sent to the server 1, and the voice command can be recognized and analyzed in the server.

[0109] Therefore, since the cooking device itself does not require a complex and expensive module for recognizing and analyzing speech, the cost of the cooking device can be reduced compared to performance, thereby improving user satisfaction.

[0110] The user can use various remote services such as remote control or monitoring of the cooking device through the external terminal 2. That is, the external terminal 2 that works in conjunction with the cooking device can be connected to the cooking device for communication via the server.

[0111] An application program related to the cooking device is installed on the external terminal, and the user can implement various remote services by executing such an application program. Generally, the external terminal has a high-definition display. In addition, it has a speaker and a microphone module. Therefore, the speaker, microphone module and display of the external terminal can implement the expansion of the UI of the cooking device.

[0112] In other words, the external terminal can realize: voice commands to the cooking device; display of images of cooking objects, confirmation voice output for cooking commands, or voice output for cooking implementation, etc.

[0113] When the user is away from the cooking device, he can use various remote services such as cooking status, cooking conditions, cooking estimated time, cooking prediction images, cooking commands, and changes in cooking conditions through the external terminal. As an example, the user can input cooking commands in the form of voice through the external terminal. In addition, the user can input cooking parameters including cooking temperature and cooking time in the form of voice through the external terminal. Therefore, the UI of the cooking device itself can be extended to the external terminal.

[0114] If a cooking command or cooking parameter is received via an external terminal, the control unit controls the operation of the cooking device based on the received cooking command or cooking parameter, that is, the driving of the camera module, the heating module, and the artificial intelligence module can be controlled.

[0115] On the other hand, the artificial intelligence module 91 can input a cooking command or cooking parameter received via the UI of the cooking device itself or an external terminal, and can output an image of a cooking object predicted after cooking is finished (cooking prediction image). The cooking prediction image can be any one of the images generated by the camera module and stored in the memory, or can be any one of the images that have been updated via the server.

[0116] A cooking prediction image that matches the current cooking command or cooking parameter, or that can be matched optimally, may be output, thereby allowing the user to determine whether the cooking command or cooking parameter input by the user is appropriate.

[0117] In another viewpoint, the user may input a cooking command or a cooking parameter through a cooking prediction image. That is, the cooking prediction image is matched with information such as a cooking command or a cooking parameter. Therefore, the case of selecting a specific cooking prediction image may be the same as the case of selecting information such as a specific cooking command or a cooking parameter.

[0118] For example, if an image of a well-cooked object is selected, it can be considered that information related to such cooking history is selected. Therefore, the user can easily select a cooking command or a cooking parameter without having to select a complicated and cumbersome cooking command or a cooking parameter. That is, these processes can be performed at once by selecting only one image.

[0119] In the following, reference is made to Figure 4 A method for controlling a cooking device according to an embodiment of the present invention is described in detail.

[0120] The user may perform input of a cooking command (S10) or setting of a cooking parameter (S20) through a UI, a microphone module or an external terminal. The setting of the cooking parameter is to change the cooking parameter set according to the cooking command.

[0121] Before, during, and after the process, a step for identifying a cooking object (S5) may be performed. The identification of the cooking object may be performed by generating an image by photographing the cooking object by a camera module. Of course, the identification of the cooking object may be performed during the cooking preparation process, which may be considered as a process in which a user places the cooking object into the cooking device. In addition, the cooking preparation process may also include applying power to the cooking device, etc.

[0122] If the cooking command and cooking parameters are set, a cooking prediction image may be displayed (S30). The cooking prediction image may display a specific cooking prediction image according to the current cooking command and cooking parameters. The previously learned results may be displayed, and an image stored in a memory may also be displayed. Of course, such a cooking prediction image is preferably an image corresponding to the recognized cooking object.

[0123] For example, in the case of cooking "roasted chicken", an image of the chicken before cooking can be generated to identify the cooking object. In this case, preferably, a cooking prediction image corresponding to "roasted chicken" is selected and displayed. The cooking degree can be grasped through the cooking prediction image, and this cooking degree can be changed according to the input cooking command and cooking parameters.

[0124] Therefore, the user can predict the cooking degree through the cooking prediction image. For example, if the dish is expected to be cooked more, the cooking parameters can be changed. At this time, the user can provide a command "please cook more" in the form of voice. In the cooking device, the cooking time and / or the cooking temperature can be increased by recognizing such a voice command, thereby changing the cooking degree.

[0125] On the other hand, if the user completes the selection, cooking can be performed (S40). As cooking is performed, photographing of the cooking object can be performed repeatedly or periodically (S50). Cooking history information (cooking commands, cooking parameters, change trends of cooking parameters, etc.) up to the photographing time can be obtained. Therefore, the generated image and such related information can be matched with each other and stored.

[0126] That is, by inputting the cooking conditions, a cooking prediction image can be derived through learning. Such learning results can be used in the display of the cooking prediction image (S30) described above. As an example, a cooking prediction image that is most similar to the current cooking conditions among a plurality of images of the same cooking object can be output and displayed.

[0127] As an example, the displayed cooking prediction image may be changed. This may be changed according to the user's request. In other words, if the user changes the cooking conditions during the cooking process, the cooking prediction image corresponding to the changed cooking conditions may be displayed. Of course, a cooking prediction image that better matches the current cooking conditions may also be displayed during the cooking process.

[0128] On the other hand, after the cooking object is identified, the user can select a specific cooking prediction image. As an example, after the cooking object is identified, a plurality of corresponding cooking prediction images can be displayed. They can be displayed in sequence, and the user can select any one of the plurality of cooking prediction images by operating a scroll or a button.

[0129] Selecting a specific cooking prediction image may be selecting a cooking condition. This is because the cooking condition is matched in the specific cooking prediction image. Therefore, the process of selecting a cooking command or setting a cooking parameter may be simplified by selecting a specific cooking prediction image. That is, the user does not need to identify detailed and complicated conditions (such as cooking time or cooking temperature) and select them.

[0130] If the user selects a specific cooking prediction image, the cooking conditions corresponding thereto may be displayed, and in particular, the estimated cooking time may be displayed.

[0131] Determine whether cooking is finished (S70), such as determining whether the cooking setting time has passed or determining whether cooking is forced to end, etc. If cooking is not finished, the above process can be repeated. Of course, if the cooking end condition is met, cooking can be ended.

[0132] On the other hand, a plurality of cooking prediction images can be distinguished from each other and stored according to the degree of cooking. That is, the cooking object can be distinguished from each other as a medium-rare cooking object, a well-done cooking object, and a well-done cooking object and stored. This can be considered to be for effectively responding to the user's perceptual voice command.

[0133] The cooking degree may be differentiated based on the color difference or change of the cooking object.

[0134] If there is an image corresponding to the cooking prediction image among the images stored in the memory, the artificial intelligence module can output the corresponding image as the cooking prediction image. As an example, if there are ten cooking prediction images according to the cooking degree, the seventh cooking prediction image with a higher cooking degree can be output in response to the voice command "cook it better". Then, if the user provides a voice command "continue to cook it well", the eighth cooking prediction image with a higher cooking degree can be output. When the user expects to continue to increase the cooking degree, eventually, the tenth cooking prediction image with a higher cooking degree can be output. If the user expects cooking with a higher cooking degree, the cooking prediction image corresponding to the higher cooking degree will not be output. Therefore, the image generated after the cooking is finished can be used as the eleventh new cooking prediction image with a higher cooking degree.

[0135] According to this embodiment, the user can input a relative cooking degree increase or decrease command through the microphone module based on the cooking prediction image. The control unit or the voice recognition module can distinguish and recognize such a relative cooking degree increase or decrease command. And, the cooking prediction image that changes in response to such a command can be displayed. Of course, such a cooking prediction image can be displayed by the cooking device itself or an external terminal. Therefore, an intuitive and easy-to-use cooking device can be provided.

[0136] Therefore, according to this embodiment, the expansion and diversification of the cooking prediction image can be achieved. That is, the cooking prediction image evolved based on the user's experience can be provided. Therefore, a customized cooking device can be provided, and a smart and easy-to-use cooking device can be provided.

[0137] In the following, reference is made to Figures 5 to 7 Detailed description of multiple cooking prediction images.

[0138] Figures 5 to 7 , a cooking prediction image for the same cooking object is shown. Figure 5 An example of a cooking prediction image corresponding to "medium rare" is shown. Figure 6 An example of a cooking prediction image corresponding to "well done" is shown. Figure 7 An example of a cooking prediction image corresponding to “well done” is shown.

[0139] The degree of cooking can be grasped by the color change of the cooking object. The color change varies depending on the cooking object. As an example, as the color changes to dark red or dark brown, the degree of cooking can be higher.

[0140] The cooking prediction image is Figure 6 The image shown in the figure can be displayed. The user can replace the setting of the cooking command and the cooking parameter by selecting this image.

[0141] If the user wants the dish to be more cooked before or during cooking, the cooking parameters can be changed. When the user issues a voice command "cook more cooked", the cooking prediction image can be changed to Figure 7 The image shown is displayed.

[0142] If the change of the command is confirmed in the cooking device in the form of voice or on the display, the user can provide a command to allow it through the UI or voice.

[0143] The control part may change and set the cooking parameters to match the changed cooking prediction image, and perform cooking based on the changed cooking parameters. Finally, cooking corresponding to the changed cooking prediction image is performed.

[0144] On the other hand, the output of the cooking prediction image or the provision (change) of the cooking command may be performed through an external terminal.

[0145] The user can remotely control or monitor the cooking device through the external terminal at a location separated from the cooking device. That is, the external terminal can communicate with the server, and the server can communicate with the cooking device, thereby performing the above process.

[0146] Therefore, the user can easily use the cooking apparatus even without directly operating the cooking apparatus or approaching the cooking apparatus.

[0147] Industrial Applicability

[0148] It has been described in the detailed description of the invention.

Claims

1. A cooking device, wherein: include: Box; A cavity for accommodating the cooking object; A door is rotatably arranged on the box body and has a perspective window; a camera module for generating an image by photographing a cooking object contained in the cavity; A heating module, for heating the cooking object and cooking it; A user interface configured for a user to input a cooking command, or input cooking parameters including a cooking temperature and a cooking time; The artificial intelligence module inputs the change trend of the cooking parameters from the beginning of cooking to the present through learning, and outputs an image of the cooking object predicted after the cooking is finished, i.e., a cooking prediction image. The user interface can display the currently captured image and the cooking prediction image, and the user can intuitively grasp the current cooking degree through the currently captured image and the cooking prediction image. When the user changes the cooking conditions during the cooking process, the cooking prediction image corresponding to the changed cooking conditions can be displayed, and a cooking prediction image that better meets the current cooking conditions can also be displayed during the cooking process; A control unit, which controls the driving of the camera module, the heating module and the artificial intelligence module based on the cooking command or the cooking parameter; as well as a memory storing an image generated by photographing the cooking object, When there is an image corresponding to the cooking prediction image among the images stored in the memory, the artificial intelligence module outputs the corresponding image as the cooking prediction image. When there is no corresponding image, the artificial intelligence module generates a new cooking prediction image through a learning process and outputs the new cooking prediction image.

2. The cooking device according to claim 1, characterized in that: The memory distinguishes and stores each of a plurality of images generated for the same cooking object based on a color change of the cooking object and according to a degree of cooking.

3. The cooking device according to claim 1, characterized in that: The user interface includes a microphone module, and the microphone module receives a cooking command or a cooking parameter through a user's voice.

4. The cooking device according to claim 3, characterized in that: A voice recognition module is included, which distinguishes and recognizes a relative cooking degree increase or decrease command from a user's voice received by the microphone module based on the cooking prediction image.

5. The cooking device according to claim 4, characterized in that: The control unit resets the current cooking parameters based on the relative cooking degree increase or decrease command recognized by the voice recognition module.

6. The cooking device according to claim 1, characterized in that The user interface provides a cooking time that changes in response to the changed cooking prediction image.

7. The cooking device according to claim 1, characterized in that: The cooking command or cooking parameter is received by a user selecting any one of the images stored in the memory.

8. The cooking device according to claim 1, characterized in that A communication module is included, and the communication module is used to send the cooking prediction image to an external terminal.

9. The cooking device according to claim 8, characterized in that The cooking command or the change of the cooking parameter is received from the external terminal via the communication module.

10. The cooking device according to claim 1, characterized in that A communication module is included, and the communication module is used to send the learning results of the artificial intelligence module to an external server.

11. The cooking device according to claim 1, characterized in that A communication module is included, and the communication module is used to update the learned results from an external server.

12. The cooking device according to claim 1, characterized in that The camera module can communicate with the control unit and is detachably disposed outside the perspective window or inside the perspective window.

13. The cooking device according to claim 1, characterized in that In order to recognize the cooking object before starting cooking, the camera module photographs the cooking object and generates an image.

14. The cooking device according to claim 13, characterized in that The user interface includes a speaker that provides a user with a voice for introducing a cooking mode based on the recognized cooking object.

15. The cooking device according to claim 13, characterized in that The user interface displays a cooking mode based on the recognized cooking object to introduce the cooking mode to a user.

16. The cooking device according to claim 1, characterized in that including a communication module for communicating with an external server, The communication module transmits cooking information to an external terminal via the external server, and receives a cooking command from the external terminal via the external server.

Images