Cooking apparatus and control method therefor

Abstract

A cooking apparatus is disclosed. One or more processors: by executing one or more instructions, acquire data related to cooking through a sensor while cooking is in progress after a cooking recipe is identified; compare the acquired data with cooking information corresponding to the current cooking step from among a plurality of cooking steps included in the cooking recipe and provide, through a display, first feedback according to the result of the comparison; update the cooking recipe on the basis of data acquired through the sensor after the feedback is provided; and acquire the updated cooking recipe as a personalized recipe.

Description

Cooking device and its control method

[0001] The present invention relates to a cooking device and a control method thereof, and more particularly, to a cooking device that generates and provides a personalized recipe and a control method thereof.

[0002] Recently, there has been a rise in home cooking, using existing recipes and cooking equipment. In fact, when cooking at home with family or friends, they often share recipes.

[0003] However, if users are far apart, it is difficult to share recipes and provide detailed cooking coaching to each other unless they can watch the cooking process in real time through the camera or know the detailed specifications of the other user's device.

[0004] A cooking device according to at least one embodiment of the present disclosure includes a display, a sensor, a memory storing one or more commands, and one or more processors.

[0005] The one or more processors, by executing the one or more commands, acquire data related to cooking through the sensor while cooking is in progress after a cooking recipe is identified, compare the acquired data with cooking information corresponding to a current cooking step among a plurality of cooking steps included in the cooking recipe, provide first feedback based on the comparison result through the display, update the cooking recipe based on the data acquired through the sensor after the feedback is provided, and acquire the updated cooking recipe as a personalized recipe.

[0006] According to one or more embodiments, the one or more processors, by executing the one or more commands, identify cooking information corresponding to a preset standard among a plurality of cooking information included in the personalized recipe, obtain a cooking recipe corresponding to an AI (Artificial Intelligence) mode, and provide the cooking recipe corresponding to the AI ​​mode to another cooking device through the communication interface.

[0007] According to one or more embodiments, the one or more processors, by executing the one or more commands, obtain cooking status information for a first dish based on the identified cooking recipe, obtain cooking status information for a second dish based on the personalized recipe, and compare the cooking status information for the first dish based on the identified cooking recipe and the cooking status information for the second dish to provide second feedback based on the comparison result through the display.

[0008] According to one or more embodiments, the one or more processors, by executing the one or more instructions, update the personalized recipe based on the user input when the second feedback is provided and user input for the second feedback is received.

[0009] According to one or more embodiments, the one or more processors, by executing the one or more instructions, identify an importance level of each of the plurality of cooking steps included in the cooking recipe, and provide the first feedback in a different form based on the importance level of each of the plurality of cooking steps.

[0010] According to one or more embodiments, the one or more processors, by executing the one or more commands, input information about the cooking recipe, information about the first feedback, and data acquired through the sensor before and after providing the first feedback into a learned artificial intelligence model to obtain the personalized recipe.

[0011] According to one or more embodiments, the one or more processors, by executing the one or more commands, provide the first feedback using an avatar image corresponding to the identified cooking recipe, and change and provide the display state of the avatar image according to the importance level of the first feedback.

[0012] According to one or more embodiments, the one or more processors, by executing the one or more commands, compare the device information of the cooking device and the cooking information corresponding to the identified cooking recipe to identify whether the cooking information of the identified cooking recipe needs to be updated, and if the cooking information of the identified cooking recipe needs to be updated, update and provide the cooking information included in the identified cooking recipe based on the device information of the cooking device.

[0013] According to one or more embodiments, the data related to the cooking includes at least one of the following: weight of ingredients, number of times and time of opening the door of the cooking device, cooking order, cooking status, cooking temperature, cooking time, cooking method, or model-specific characteristics of the cooking device.

[0014] According to one or more embodiments, a method for controlling a cooking device includes the steps of: acquiring data related to cooking while cooking is in progress after a cooking recipe is identified; comparing the acquired data with cooking information corresponding to a current cooking step among a plurality of cooking steps included in the cooking recipe and providing first feedback according to a comparison result; updating the cooking recipe based on the acquired data after the feedback is provided; and acquiring the updated cooking recipe as a personalized recipe.

[0015] A non-transitory computer-readable storage medium storing computer instructions that, when executed by a processor of a cooking device, cause the cooking device to perform an operation, the operation comprises: a step of acquiring data related to cooking while cooking is in progress after a cooking recipe is identified; a step of comparing the acquired data with cooking information corresponding to a current cooking step among a plurality of cooking steps included in the cooking recipe and providing first feedback according to a comparison result; a step of updating the cooking recipe based on the acquired data after the feedback is provided; and a step of acquiring the updated cooking recipe as a personalized recipe.

[0016] FIG. 1 is a drawing for explaining the operation of a cooking device according to one or more embodiments of the present disclosure.

[0017] FIG. 2A is a block diagram illustrating a configuration of a cooking device according to one or more embodiments of the present disclosure.

[0018] FIG. 2b is a block diagram showing a detailed configuration of a cooking device according to one or more embodiments of the present disclosure.

[0019] FIG. 3 is a drawing for explaining an AI mode of a cooking device according to one or more embodiments of the present disclosure.

[0020] FIG. 4 is a drawing for explaining a method for providing feedback of a cooking device according to one or more embodiments of the present disclosure.

[0021] FIG. 5 is a drawing for explaining a recipe update method of a cooking device according to one or more embodiments of the present disclosure.

[0022] FIG. 6 is a diagram illustrating a method for providing feedback according to an importance level of a cooking device according to one or more embodiments of the present disclosure.

[0023] FIG. 7 is a diagram illustrating a method for obtaining a recipe using an artificial intelligence model of a cooking device according to one or more embodiments of the present disclosure.

[0024] FIG. 8 is a diagram illustrating a method for providing feedback according to an avatar image of a cooking device according to one or more embodiments of the present disclosure.

[0025] FIG. 9 is a diagram illustrating a method for updating a cooking recipe according to the device performance of a cooking device according to one or more embodiments of the present disclosure.

[0026] FIG. 10 is a flowchart illustrating a method for controlling a cooking device according to one or more embodiments of the present disclosure.

[0027] The terms used in the various embodiments of this disclosure have been selected from widely used, current terms, taking into account the functions of this disclosure. However, these terms may vary depending on the intentions of those skilled in the art, precedents, the emergence of new technologies, etc. Furthermore, in certain cases, terms may be arbitrarily selected by the applicant, and in such cases, their meanings will be described in detail in the description of the relevant disclosure. Therefore, the terms used in this disclosure should be defined based on the meaning of the terms and the overall content of this disclosure, rather than simply their names.

[0028] In this disclosure, expressions such as “has,” “can have,” “includes,” or “may include” indicate the presence of a corresponding feature (e.g., a component such as a number, function, operation, or part), and do not exclude the presence of additional features.

[0029] The expression "at least one of A and / or B" should be understood to mean either "A" or "B" or "A and B".

[0030] The expressions “first,” “second,” “first,” or “second,” etc., used in this disclosure can describe various components, regardless of order and / or importance, and are only used to distinguish one component from another, but do not limit the components.

[0031] When it is said that a component (e.g., a first component) is “(operatively or communicatively) coupled with / to” or “connected to” another component (e.g., a second component), it should be understood that the component may be directly coupled to the other component, or may be connected through another component (e.g., a third component).

[0032] Singular expressions include plural expressions unless the context clearly dictates otherwise. In this disclosure, terms such as "comprise" or "consist of" are intended to indicate the presence of a feature, number, step, operation, component, part, or combination thereof described in the specification, but should be understood not to preclude the presence or addition of one or more other features, numbers, steps, operations, components, parts, or combinations thereof.

[0033] In the present disclosure, a "module" or "part" performs at least one function or operation and may be implemented as hardware or software, or as a combination of hardware and software. Furthermore, multiple "modules" or multiple "parts" may be integrated into at least one module and implemented as at least one processor (not shown), excluding any "modules" or "parts" that need to be implemented as specific hardware.

[0034] In this disclosure, the term user may refer to a person using an electronic device or a device used by the person.

[0035] An embodiment of the present disclosure will be described in more detail with reference to the attached drawings below.

[0036] FIG. 1 is a drawing for explaining the operation of a cooking device according to one or more embodiments of the present disclosure.

[0037] A cooking device (100) can perform various cooking processes by applying high-temperature heat generated using electricity or gas to food. The cooking device (100) may be a device for cooking food using ingredients prepared by a user. The cooking device (100) can set various cooking conditions such as temperature, time, heating method, and pressure, thereby enabling the same dish to be cooked in various ways. The cooking device (100) may correspond to an oven, induction, electric range, gas range, air fryer, etc.

[0038] The cooking device (100) may be formed in a roughly rectangular shape with a cooking chamber inside. The cooking device (100) may be configured to include a temperature control button (11) for setting a cooking temperature, a timer (12) for setting a cooking time, a cooking mode button (13) for setting a cooking method, a door (14) for putting in and taking out food, and a display (110) for providing various UIs according to a cooking recipe.

[0039] The cooking device (100) can receive a cooking recipe for a food from a server (10), a mobile device, another cooking device, etc. In one example, the cooking recipe may be a personalized recipe of another user, but is not limited thereto.

[0040] For example, the cooking device (100) may receive a cooking recipe transmitted from the server (10) to the server (10) from a mobile device or other cooking device. However, in some cases, the cooking recipe may be received directly from the mobile device or other cooking device. However, for the convenience of explanation, the following description will assume a case in which the cooking recipe is received through the server (10).

[0041] A cooked food refers to a food, such as pizza or chicken, made using ingredients or food products necessary for cooking. Cooked food is not limited to this, and may be referred to in various ways, such as cooking, food, or prepared food. However, in this disclosure, the term cooked food is used collectively.

[0042] A cooking recipe is a document that describes the cooking process for a dish in detail, step by step or item by item, including ingredient weights, cooking sequence, and cooking methods. For example, as in the recipe (20) illustrated in Fig. 1, it refers to a document that describes the cooking process for a specific dish in detail, including ingredient weights, sequence, and heating method, allowing a user to create the dish simply by looking at the document.

[0043] Referring to FIG. 1, the cooking device (100) can receive a cooking recipe for a dish from the server (10) based on a user input. For example, the cooking device (100) can receive a cooking recipe corresponding to a selected dish from the server (10) based on a user input for selecting a specific dish. For example, when a pizza dish or a chicken dish is selected by a user on a UI screen provided through an application execution screen or a web browser screen, the cooking device (100) can transmit user selection information (or a selection signal) to the server (10). In this case, the server (10) can transmit to the cooking device (100) a recipe corresponding to the selected dish based on the received information.

[0044] The cooking device (100) can provide a cooking recipe to the user via the display (110). For example, the cooking device (100) can provide a cooking recipe containing detailed information for each cooking step via the display (110). In this case, the user can sequentially cook food based on the cooking information for each step.

[0045] For example, the cooking device (100) may provide feedback on the user's cooking status by comparing the cooking recipe provided during the user's cooking process with data sensed by a plurality of sensors provided within the cooking device (100). For example, when a cooking recipe for pizza is received from the server (10), the cooking device (100) may provide feedback by comparing the weight of the dough included in the cooking recipe with the weight of the dough used during the user's cooking process. In this way, the cooking device (100) may monitor whether each cooking step is cooked according to the cooking recipe and provide feedback.

[0046] In one example, a user may not accept some of the cooking recipes provided by the cooking device (100). For example, in the step of baking a pizza among the cooking recipes provided by the cooking device (100), although the information included in the cooking recipe is "bake at 200 degrees for 20 minutes," the user may bake at 220 degrees for 25 minutes for a crispier pizza. In this case, the cooking device (100) may provide feedback on the temperature and time through the display (110). If the cooking device (100) determines that the user has ignored this and continues cooking, or if a user input is received to proceed to the next cooking step, the cooking device (100) may provide cooking information corresponding to the next cooking step. In this way, the user may accept most of the cooking recipes provided by the cooking device (100), but may not accept some of them and cook with a recipe that suits his or her preference. In this case, the result may be a dish that suits the user's preference, rather than a dish that is cooked according to a previously input cooking recipe.

[0047] For example, in the cooking recipe provided by the cooking device (100), the temperature and time for baking pizza are 210 degrees and 30 minutes, respectively, but the user may not accept this and may proceed with baking the pizza at 220 degrees and 25 minutes. In this case, the cooking device (100) may obtain a cooking recipe in which the temperature and time in the pizza baking step of the existing cooking recipe are changed to 220 degrees and 25 minutes.

[0048] As described above, the cooking device (100) can identify recipes that the user has accepted and recipes that the user has not accepted among the currently provided cooking recipes, and can create a personalized recipe (20) by adding and / or changing a user-specific recipe that the user has not accepted to the currently provided cooking recipes. Here, the personalized recipe means a cooking recipe obtained by changing some of the recipes in an existing cooking recipe based on the user's preferences.

[0049] Below, a specific embodiment in which a cooking device (100) generates and provides a personalized recipe (20) will be described.

[0050] FIG. 2A is a block diagram illustrating a configuration of a cooking device according to one or more embodiments of the present disclosure.

[0051] According to FIG. 2A, the cooking device (100) includes a display (110), a sensor (120), a memory (130), and one or more processors (140). However, the present invention is not limited thereto, and the cooking device (100) may be implemented in a form in which some components are excluded, or may be implemented in a form in which other components are further included.

[0052] The display (110) is a device for providing a user with a cooking recipe obtained by the cooking device (100) and feedback generated during the cooking process by displaying it on a screen. The display (110) may be implemented as a display including a self-luminous element or a display including a non-luminous element and a backlight. For example, the display may be implemented as various types of displays such as an LCD (Liquid Crystal Display), an OLED (Organic Light Emitting Diodes) display, an LED (Light Emitting Diodes), a micro LED, a Mini LED, a PDP (Plasma Display Panel), a QD (Quantum dot) display, a QLED (Quantum dot light-emitting diodes), etc. The display (110) may also include a driving circuit, a backlight unit, etc., which may be implemented in a form such as an a-si TFT, an LTPS (low temperature poly silicon) TFT, an OTFT (organic TFT), etc. For example, the display (110) may be implemented as a flat display, a curved display, a foldable or / and rollable flexible display, etc.

[0053] According to one embodiment, one or more processors (140) may provide a user interface (UI) including a detailed cooking recipe for each step and an image corresponding to the step through a display (110).

[0054] According to one embodiment, one or more processors (140) may provide a user interface (UI) including an expected cooking completion time of the food through a display (110).

[0055] The sensor (120) is configured to acquire data related to cooking. The sensor (120) may include various types of sensors, such as a camera, a depth camera, an AI camera, a thermal imaging camera, a temperature sensor, an illuminance sensor, a touch sensor, a proximity sensor, a humidity sensor, an infrared sensor, a biosensor, a pressure sensor, an ultraviolet sensor, and the like.

[0056] Thermal imaging cameras display different colors based on temperature, allowing us to discern that temperature with our eyes. A thermal imaging camera detects thermal radiation emitted by an object and visualizes it in various colors. Images acquired through a thermal imaging camera may include at least one of the following: a top-view image, a front-view image, or a side-view image.

[0057] The temperature sensor can measure the temperature inside the cooking device (100). One or more processors (140) can detect that cooking is complete when the cooking device (100) reaches a set temperature through the temperature sensor, or control a heating element to maintain the set temperature. The touch sensor can detect a user's touch according to user input, such as temperature, time, cooking mode, etc. The humidity sensor can maintain and measure the humidity inside the cooking chamber so that the food can retain moisture.

[0058] The cooking device (100) can monitor the progress of cooking based on data acquired through a sensor (120), convert the monitoring results into data, and provide them through a display (110).

[0059] The memory (130) can store at least one command, data, program, etc. required for the operation of the cooking device (100). For example, the memory (130) can store a cooking recipe received through a server, etc. For example, the memory (130) can obtain and store a personalized recipe.

[0060] The memory (130) may be implemented in the form of a memory embedded in the cooking device (100) or may be implemented in the form of a memory detachable from the cooking device (100) depending on the purpose of data storage. For example, data for driving the cooking device (100) may be stored in a memory embedded in the cooking device (100), and data for expanding the functions of the cooking device (100) may be stored in a memory detachable from the cooking device (100).

[0061] In the case of the memory embedded in the cooking device (100), it may be implemented as at least one of volatile memory (e.g., dynamic RAM (DRAM), static RAM (SRAM), or synchronous dynamic RAM (SDRAM)), non-volatile memory (e.g., one time programmable ROM (OTPROM), programmable ROM (PROM), erasable and programmable ROM (EPROM), electrically erasable and programmable ROM (EEPROM), mask ROM, flash ROM, flash memory (e.g., NAND flash or NOR flash), hard drive, or solid state drive (SSD)).

[0062] The memory (130) may be implemented as a single memory that stores data generated in various operations according to the present disclosure, but is not limited thereto, and the memory (130) may be implemented to include multiple memories that each store different types of data or each store data generated in different stages.

[0063] One or more processors (140) control the overall operation of the cooking device (100). Specifically, one or more processors (140) are connected to each component of the cooking device (100) to control the overall operation of the cooking device (100). For example, one or more processors (140) are electrically connected to the display (110) and the memory (130) to control the overall operation of the cooking device (100). One or more processors (140) may be configured as one or more processors.

[0064] One or more processors (140) can perform operations of the cooking device (100) according to various embodiments by executing one or more commands stored in the memory (130).

[0065] The one or more processors (140) may include one or more of a Central Processing Unit (CPU), a Graphics Processing Unit (GPU), an Accelerated Processing Unit (APU), a Many Integrated Core (MIC), a Digital Signal Processor (DSP), a Neural Processing Unit (NPU), a hardware accelerator, or a machine learning accelerator. The one or more processors (140) may control one or any combination of other components of the cooking device, and may perform operations related to communication or data processing. The one or more processors (140) may execute one or more programs or instructions stored in a memory. For example, the one or more processors may perform a method according to one or more embodiments of the present disclosure by executing one or more instructions stored in a memory.

[0066] When a method according to one or more embodiments of the present disclosure includes multiple operations, the multiple operations may be performed by one processor or by multiple processors. For example, when a first operation, a second operation, and a third operation are performed by a method according to one or more embodiments, the first operation, the second operation, and the third operation may all be performed by the first processor, or the first operation and the second operation may be performed by the first processor (e.g., a general-purpose processor) and the third operation may be performed by the second processor (e.g., an artificial intelligence-specific processor).

[0067] One or more processors (140) may be implemented as a single core processor including one core, or may be implemented as one or more multicore processors including multiple cores (e.g., homogeneous multicores or heterogeneous multicores). When one or more processors (140) are implemented as a multicore processor, each of the multiple cores included in the multicore processor may include an internal processor memory, such as a cache memory or an on-chip memory, and a common cache shared by the multiple cores may be included in the multicore processor. In addition, each of the multiple cores (or some of the multiple cores) included in the multicore processor may independently read and execute a program instruction for implementing a method according to one or more embodiments of the present disclosure, or all (or some) of the multiple cores may be linked to read and execute a program instruction for implementing a method according to one or more embodiments of the present disclosure.

[0068] When a method according to one or more embodiments of the present disclosure includes a plurality of operations, the plurality of operations may be performed by one core among the plurality of cores included in a multi-core processor, or may be performed by the plurality of cores. For example, when a first operation, a second operation, and a third operation are performed by a method according to one or more embodiments, the first operation, the second operation, and the third operation may all be performed by a first core included in the multi-core processor, or the first operation and the second operation may be performed by a first core included in the multi-core processor, and the third operation may be performed by a second core included in the multi-core processor.

[0069] In the embodiments of the present disclosure, a processor may mean a system on a chip (SoC) in which one or more processors and other electronic components are integrated, a single-core processor, a multi-core processor, or a core included in a single-core processor or a multi-core processor, wherein the core may be implemented as a CPU, a GPU, an APU, a MIC, a DSP, an NPU, a hardware accelerator, or a machine learning accelerator, but the embodiments of the present disclosure are not limited thereto. Hereinafter, for the convenience of description, one or more processors (140) will be referred to as a processor (140).

[0070] According to one embodiment, the processor (140) can obtain cooking-related data through the sensor (120) while cooking is in progress after the cooking recipe is identified.

[0071] For example, the processor (140) may display a cooking recipe received from an external device (e.g., a server (10)) through the display (110). A user may place various ingredients into the cooking device (100) based on the cooking recipe displayed on the display (110) and begin cooking.

[0072] For example, the processor (140) may acquire various cooking-related data (or user-provided variables) while cooking is in progress. For example, the cooking-related data may include at least one of the following: the weight of the ingredients, the number of times and time the door of the cooking device (100) is opened, the cooking sequence, the cooking status, the cooking temperature, the cooking time, the cooking method, or the model-specific characteristics of the cooking device. For example, the data regarding the cooking status may include at least one of the temperature of the food or the color of the food.

[0073] According to one embodiment, the processor (140) may compare cooking information corresponding to a current cooking step among multiple cooking steps included in a cooking recipe with acquired data (hereinafter, “cooking data”) and provide feedback based on the comparison result through the display (110). For example, the processor (140) may provide corresponding feedback when the cooking temperature and cooking time included in the cooking recipe are different from the cooking temperature and cooking time acquired through the sensor (120).

[0074] For example, if a cooking recipe includes cooking information for 20 minutes at 200 degrees, but the user sets the cooking time to 25 minutes at 220 degrees, feedback based on the comparison results, such as “Please lower the cooking temperature,” “Please reset the cooking time,” or “Please check the cooking temperature and cooking time,” can be provided through the display (110).

[0075] As described above, the processor (140) can compare cooking data obtained in the current cooking step among the multiple cooking steps included in the entire cooking recipe with the currently provided cooking recipe and provide feedback (hereinafter, first feedback) based on the comparison result.

[0076] In one embodiment, the processor (140) may update the cooking recipe based on data acquired through the sensor (120) after the first feedback is provided. For example, if the next step is performed without lowering the temperature despite feedback indicating that the temperature should be lowered, the processor (140) may identify the changed cooking temperature based on data acquired through the sensor (120) and update temperature-related data for the corresponding cooking step in the cooking recipe.

[0077] In one embodiment, the processor (140) can acquire an updated cooking recipe as a personalized recipe. For example, when cooking pizza at a lower temperature than the provided cooking recipe, the processor (140) can update the cooking temperature in the cooking recipe to generate a personalized recipe. A personalized recipe refers to a recipe created by modifying only the portions of an existing cooking recipe that do not receive user feedback, i.e., those portions that have been modified to suit the user's preferences. Accordingly, a cooking recipe tailored to the user's preferences can be acquired.

[0078] FIG. 2b is a block diagram showing a detailed configuration of a cooking device according to one or more embodiments of the present disclosure.

[0079] According to FIG. 2b, the cooking device (100) includes a display (110), a sensor (120), a memory (130), one or more processors (140), a communication interface (150), a user interface (160), a speaker (170), and a microphone (180). Among the configurations illustrated in FIG. 2b, a detailed description of configurations that overlap with those illustrated in FIG. 2a will be omitted.

[0080] The communication interface (150) includes a circuit and can communicate with an external device (server or user terminal). For example, the processor (140) can receive various data or information from an external device connected via the communication interface (150) and can also transmit various data or information to the external device.

[0081] The communication interface (150) may include at least one of a WiFi module, a Bluetooth module, a wireless communication module, an NFC module, and a UWB module (Ultra Wide Band). At this time, the wireless communication module may perform communication according to various communication standards such as IEEE, Zigbee, 3G (3rd Generation), 3GPP (3rd Generation Partnership Project), LTE (Long Term Evolution), 5G (5th Generation), etc.

[0082] For example, the processor (140) can receive a cooking recipe from the server (10) via a communication interface (150).

[0083] For example, the processor (140) can provide a cooking recipe corresponding to the AI ​​mode described below to another cooking device through the communication interface (150).

[0084] The user interface (160) may be implemented as a device such as a button, a touch pad, etc. on the cooking device (100), or may be implemented as a touch screen that can perform both a display function and an operation input function.

[0085] For example, the user interface (160) may receive user input for selecting a dish, user input for selecting a cooking recipe, user input for feedback, and the like.

[0086] The speaker (170) can convert and amplify a digital audio signal processed by the processor (140) into an analog audio signal and output the converted signal. For example, the speaker (170) can include at least one speaker unit, a D / A converter, an audio amplifier, etc., which can output at least one channel. For example, the speaker (170) can output various notifications, messages, information, etc. related to feedback from the processor (140).

[0087] In one example, the speaker (170) may output each cooking step according to a cooking recipe. In one example, the speaker (170) may output different forms of feedback, either through voice or notification, based on the importance level of each cooking step.

[0088] The microphone (180) is configured to receive user voice or other sounds and convert them into audio data.

[0089] For example, the microphone (180) may receive a user's voice for selecting a dish, a user's voice for selecting a cooking recipe, a user's voice for feedback, etc. However, for another example, the cooking device (100) may receive a user's voice input through an external device through the communication interface (150).

[0090] Meanwhile, the processor (140) can obtain a personalized recipe from an existing cooking recipe and automatically generate AI mode information capable of cooking based on the personalized recipe. FIG. 3 is a diagram illustrating the AI ​​mode of a cooking device according to one or more embodiments of the present disclosure.

[0091] The processor (140) can identify cooking information corresponding to preset criteria among a plurality of cooking information included in a personalized recipe and obtain a cooking recipe corresponding to an AI (Artificial Intelligence) mode.

[0092] Here, the AI ​​mode refers to a setting mode (or automatic setting mode) optimized for cooking a specific dish on the device based on a personalized recipe. For example, it refers to a mode in which preset cooking information such as temperature, time, amount of ingredients, preheating time, etc. are selected from a specific recipe, and the cooking device automatically cooks only with the selected information without user intervention to produce a final dish based on the personalized recipe. For example, the AI ​​mode may automatically change the cooking information according to the performance (or specifications or specifications) of the cooking device (100) and be set to enable optimal cooking on the device. The AI ​​mode is not limited thereto, and may be referred to in various ways such as an automated mode, an artificial intelligence mode, an automatic learning mode, a personalized recipe mode, a smart mode, etc., but will be collectively referred to as the AI ​​mode in the present disclosure.

[0093] Referring to FIG. 3, the processor (140) can obtain a personalized recipe (310) by updating an existing cooking recipe.

[0094]

[0095] *For example, the processor (140) may identify only specific items from a personalized recipe to obtain a cooking recipe corresponding to the AI ​​mode. For example, in the case of pizza, the processor (140) may identify the dough baking temperature and time, dough volume, preheating time, and dough fermentation time to obtain a cooking recipe (320) corresponding to the AI ​​mode.

[0096] For example, the cooking information to be generated in AI mode may vary depending on the type of dish, such as fish, baking, or steaming. For example, in the case of fish, temperature, time, and heating method may be important, so the processor (140) can identify only the relevant cooking information and obtain a cooking recipe corresponding to the AI ​​mode.

[0097] For example, the preset criteria for generating an AI mode may vary depending on the type of dish and may be set or changed by the user. For example, the user may change the cooking items corresponding to the AI ​​mode by adding or excluding specific items from an existing cooking recipe. According to one embodiment, the processor (140) may provide a cooking recipe corresponding to the AI ​​mode to another cooking device via the communication interface (150).

[0098] For example, assuming that the cooking device (100) is a device of user A, the processor (140) can provide a cooking recipe corresponding to the AI ​​mode to the cooking device of another user, user B, through the communication interface (150). For example, in the cooking device of user B, pizza baking can start according to the pizza baking mode (330) set to 200 degrees and 20 minutes according to the pre-stored cooking recipe. For example, a cooking recipe (320) corresponding to the AI ​​mode of user A can be provided to the cooking device of user B, and the AI ​​mode of user A can be executed in the cooking device of user B according to the selection of user B. For example, in the cooking device of user B, the avatar (360) of user A can be displayed, and an AI mode in which cooking coaching is provided through the avatar (360) of user A can be executed. For example, through the avatar (360) of user A, "User A, I will bake a pizza with a crispy outside in the pizza baking mode. Put the dough in and press the start button." A guide called can be provided. In this way, by using the avatar of user A (360), it is possible to provide an effect as if user A is coaching user B's cooking process.

[0099] As described above, when User A's AI mode is executed in User B's cooking device, the pizza baking mode (350) set to 220 degrees and 25 minutes according to User A's AI mode may be executed. Accordingly, User B can use the pizza baking mode based on User A's personalized recipe, rather than the pizza baking mode stored in his / her cooking device. For example, since User A's AI mode is executed temporarily, when User A's AI mode is terminated, User B's cooking device may be reset to the previously stored User B's pizza baking mode.

[0100] According to one embodiment, the processor (140) may receive performance information (or specification information) of the cooking device of user B through the communication interface (150) before providing information about the AI ​​mode to the cooking device of user B. According to one example, the processor (140) may change a cooking recipe corresponding to the AI ​​mode based on the received performance information. For example, if the cooking recipe corresponding to the AI ​​mode acquired by the processor (140) includes baking at 220 degrees for 20 minutes, and the maximum temperature performance of the cooking device of user B is 200 degrees, the processor (140) may change the cooking recipe to include baking at 200 degrees for 25 minutes and provide information about the AI ​​mode based on the changed recipe to the cooking device of user B.

[0101] FIG. 4 is a drawing for explaining a method for providing feedback of a cooking device according to one or more embodiments of the present disclosure.

[0102] According to one embodiment, the processor (140) may obtain cooking status information for a food (hereinafter, referred to as a first food) cooked based on a cooking recipe currently provided by the cooking device (100). For example, the cooking status information may refer to information such as an image of the food, a color value, a saturation value, a temperature, a cooking time, etc. According to one example, the processor (140) may obtain cooking status information for a first food cooked based on a cooking recipe currently provided by the cooking device (100) through an external device such as a server (10).

[0103] According to one embodiment, the processor (140) may obtain cooking status information for a dish obtained based on a personalized recipe. In one example, the processor (140) may obtain status information for a final dish (hereinafter, referred to as a second dish) generated based on a personalized recipe that suits the user's taste through the sensor (120). The processor (140) may compare the cooking status information for the first dish and the cooking status information for the second dish and provide feedback (hereinafter, referred to as second feedback) based on the comparison result through the display (110).

[0104] Referring to FIG. 4, the processor (140) may obtain cooking status information (410) including at least one of an image, color value, saturation value, volume, shape change, color change, etc. for the first dish obtained through a cooking recipe of 200 degrees Celsius, 30 minutes, 200 g of water, and 600 g of dough mix. For example, the processor (140) may obtain cooking status information (410) for the first dish from an external device (e.g., server (10)). For example, the server (10) may store status information for the final dish cooked according to the recipe for each dish. In this case, when the server (10) receives information on the type of the first dish and the cooking recipe from the cooking device (100), the server (10) may identify cooking status information (410) corresponding to the information received from the cooking device (100) from the stored information and transmit the cooking status information (410) to the cooking device (100).

[0105] In addition, the processor (140) can obtain cooking status information (420) of an image, color value, and saturation value of a second dish obtained through a personalized recipe of temperature 220 degrees, time 25 minutes, water 150 g, and dough mix 600 g through the sensor (120). For example, the processor (140) can obtain cooking status information of a second dish cooked through a personalized recipe using a sensor such as Vision AI or an RGB camera. For example, the processor (140) can obtain cooking status information of the second dish by inputting an image of the second dish into Vision AI.

[0106] For example, the processor (140) can obtain color values ​​and saturation values ​​of R 153, G 112, and B 0 from an image of the second food obtained through an RGB camera. The processor (140) can obtain information such as the degree of baking, burning, and puffiness of the second food based on the obtained color values ​​and saturation values.

[0107] According to one embodiment, the processor (140) can compare cooking status information of the first food with cooking status information of the second food.

[0108] According to FIG. 4, as a result of comparing the first and second dishes, it can be confirmed that the R, G color values ​​of the second dish are lower than those of the first dish, the B color value is 0, and the outer surface of the second dish is darker than the outer surface of the first dish. In one example, if the processor (140) identifies through the cooking state comparison that the second dish was cooked at a higher temperature for a longer time than the first dish, it can provide second feedback (430) such as “I recommend lowering the temperature to 200 degrees, please reduce the baking time” through the display (110).

[0109] In one embodiment, the processor (140) may update the personalized recipe based on user input for the second feedback.

[0110] FIG. 5 is a drawing for explaining a recipe update method of a cooking device according to one or more embodiments of the present disclosure.

[0111] In one embodiment, after the second feedback is provided, the processor (140) may update the personalized recipe based on the user input received for the second feedback. For example, the processor (140) may update the personalized recipe based on a user input for lowering the baking temperature or increasing the baking time.

[0112] Referring to FIG. 5, the processor (140) may provide second feedback (510) such as “I recommend lowering the temperature to 200 degrees,” “Please reduce the baking time,” or “Please increase the fermentation time” through the display (110). In one example, the user may accept all or part of the second feedback (510) through user input. For example, when a user input is received to lower the temperature to 200 degrees and increase the fermentation time by 30 minutes, the processor (140) may update (550) a personalized recipe by adding (530) 30 minutes to the fermentation time and lowering (540) the temperature from 220 degrees to 200 degrees in an existing cooking recipe (310) based on the received user input.

[0113] In one example, the processor (140) may provide a plurality of feedback items for receiving user input for the second feedback via the display (110). For example, the user may select at least one of the plurality of feedback items via a touchpad provided on the display (110). For example, the processor (140) may update a personalized recipe based on the user's selection of at least one of the plurality of feedback items.

[0114] In another example, the processor (140) may update the personalized recipe based on the changed cooking process, such as by increasing the fermentation time or increasing the preheating time, as determined by user input.

[0115] In one embodiment, the processor (140) may set an importance level for each of a plurality of cooking steps included in a cooking recipe and provide feedback based thereon.

[0116] FIG. 6 is a diagram illustrating a method for providing feedback according to an importance level of a cooking device according to one or more embodiments of the present disclosure.

[0117] In one embodiment, the processor (140) may identify the importance level of each of the multiple cooking steps included in the cooking recipe. For example, the processor (140) may identify cooking items, such as temperature, time, ingredient weight, heating method, number of door openings and time, and cooking order, in each step of the cooking recipe, and may identify an importance level for each identified cooking item. For example, the processor (140) may identify the importance level of each cooking item based on the degree to which each cooking item affects the completion (or quality) of the final dish.

[0118] Importance level may refer to a level classified according to the degree of influence on the final dish. For example, importance levels may be classified into levels 1, 2, and 3. Importance level 1 refers to a factor that most significantly influences the final dish, and may include, for example, temperature, time, weight of ingredients, method of applying heat, characteristics of each appliance model, and preheating time. Importance level 2 refers to a factor that influences the result according to variables according to the cooking status during the cooking process, and may include, for example, cooking order, number of times the door is opened, and time. Importance level 3 refers to a special factor corresponding to a specific dish or a specific part of a dish that changes the shape or form of the dish, and may include, for example, the fermentation time and degree of rise of cookies, bread, and cakes, and whether the volume decreases in steaming or soups. Importance levels may be referred to in various ways, such as priority level, core level, and cooking item level, but in this disclosure, they will be collectively referred to as importance levels.

[0119] Referring to FIG. 6, the processor (140) can identify each cooking item in a pizza recipe according to temperature, time, weight of ingredients, method of applying heat, number of times and time of opening the door, preheating time, and quality conditions.

[0120] For example, the processor (140) may classify identified items into importance levels 1, 2, and 3 based on the aforementioned importance levels. For example, the processor (140) may classify temperature, time, weight of ingredients, and method of applying heat as importance level 1 (610), number of door openings and time, and cooking order as importance level 2 (620), and qualitative conditions due to specific actions as importance level 3.

[0121] According to one embodiment, the processor (140) may provide the first feedback in different forms based on the importance level of each of the plurality of cooking steps. For example, in the case of feedback corresponding to importance level 1, the processor (140) may provide feedback with a message and a voice. For example, the processor may provide feedback by generating a red warning sound or a specific sound. For example, if a cooking item corresponding to importance level 1 is not satisfied, the processor may provide feedback to prevent the user from moving on to the next cooking step. For example, in the case of feedback corresponding to importance level 2, the processor (140) may provide either a message or a voice as feedback. In this way, the processor (140) may provide feedback to the user in different forms so that feedback according to importance levels can be distinguished from each other.

[0122] Referring to FIG. 6, the processor (140) may provide feedback (640) along with a message and voice, “Please increase the temperature to 220 degrees,” for a temperature corresponding to importance level 1.

[0123] The processor (140) may provide feedback (650) such as “We recommend fermenting first!” through either a message or voice for a cooking sequence corresponding to importance level 2.

[0124] The processor (140) can provide feedback (660) such as “Please sprinkle olive oil as you like” through a simple notification for a qualitative condition due to a specific action corresponding to importance level 3.

[0125] Meanwhile, the processor (140) can generate a personalized recipe using an artificial intelligence model, taking into account the user's cooking habits, etc. Details regarding this will be described below.

[0126] FIG. 7 is a diagram illustrating a method for obtaining a recipe using an artificial intelligence model of a cooking device according to one or more embodiments of the present disclosure.

[0127] According to one embodiment, the processor (140) may input information about a cooking recipe, information about the first feedback, and data acquired through sensors before and after providing the first feedback into a learned artificial intelligence model to obtain a personalized recipe.

[0128] Referring to FIG. 7, the processor (140) may input cooking recipe information (710), first feedback information (720) provided to the user during the cooking process, and cooking-related data (730) acquired through a sensor before and after the first feedback is provided into a learned artificial intelligence model (740) to obtain a personalized recipe (750) for user A. The cooking recipe information (710) may be, for example, pizza recipe (310) information illustrated in FIG. 3. The first feedback information (720) may be, for example, feedback (430) information illustrated in FIG. 4. The cooking-related data (730) may be, for example, cooking status information such as cooking order, baking, and doneness.

[0129] For example, an artificial intelligence model can be trained using cooking recipe information, first feedback information provided to the user during the cooking process, and cooking-related data acquired through sensors before and after the first feedback is provided as input data, and a personalized recipe as output data.

[0130] An artificial intelligence model can be referred to in various ways, such as an AI model, a learning model, a cooking habit model, a user cooking model, a personalized recipe model, etc., but in this disclosure, it will be referred to as an artificial intelligence model. Here, the learning of an artificial intelligence model means that a basic artificial intelligence model (e.g., an artificial intelligence model including any random parameters) is learned by a learning algorithm using a plurality of training data, thereby creating a predefined operation rule or artificial intelligence model set to perform a desired characteristic (or purpose). This learning may be performed through a separate server and / or system, but is not limited thereto, and may also be performed in a cooking device. Examples of learning algorithms include, but are not limited to, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning.

[0131] Here, the artificial intelligence model may be implemented as, for example, a Convolutional Neural Network (CNN), a Recurrent Neural Network (RNN), a Restricted Boltzmann Machine (RBM), a Deep Belief Network (DBN), a Bidirectional Recurrent Deep Neural Network (BRDNN), or a Deep Q-Network, but is not limited thereto. FIG. 8 is a diagram illustrating a method for providing feedback based on an avatar image of a cooking device according to one or more embodiments of the present disclosure.

[0132] The processor (140) can provide first feedback using an avatar image corresponding to the cooking recipe. For example, the processor (140) can provide feedback along with a notification or voice through the avatar of user A or an avatar image set by the user at each cooking step. Here, the "avatar" refers to an image used to represent a virtual character. The processor (140) can display the user's own appearance, an image of the food to be cooked, or an image of another user as an avatar image.

[0133] The processor (140) may provide different feedback depending on the importance level of the first feedback. For example, the processor (140) may change the display status of the avatar, provide additional feedback such as voice feedback, or provide feedback such as changing the progress status of each cooking step or changing options, depending on the importance level of the first feedback.

[0134] For example, when a cooking item corresponding to an importance level 1 is not followed, the processor (140) may stop the cooking process of the current step or the next step. For example, when a cooking item corresponding to an importance level 1 is not followed, the processor (140) may forcibly change optional information such as temperature and time. For example, when a cooking item corresponding to an importance level 1 is not followed, the processor (140) may display an avatar image with a preset first color (e.g., red) or an angry expression along with voice guidance.

[0135] For example, if a cooking item corresponding to an importance level 2 is not complied with, an avatar image may be displayed in a preset second color along with a voice guidance. For example, if an abnormality is detected at the corresponding stage, such as the food being burned or the door being opened too many times, the processor (140) may display an avatar image displayed in orange along with a voice guidance.

[0136] For example, when a cooking item corresponding to importance level 3 is not complied with, the processor (140) may provide the non-compliant cooking item in the form of a report after cooking is completed, or display an avatar image displayed in a preset third color, for example, yellow, along with voice guidance.

[0137] For example, the preset first color, second color, and third color may be colors whose emphasis decreases in the order of the preset first color, second color, and third color.

[0138] Referring to FIG. 8, the processor (140) may provide a cooking recipe for making a roll to the user through the display (110). At this time, the processor (140) may use the avatar image (80) of user A to provide the cooking recipe for each cooking step. The processor (140) may use the avatar image to indicate the start of the cooking step (810) with the text, "Hello! Let's make a roll together now?"

[0139] The processor (140) may provide feedback (811) to a user who has added dough that has not been fermented yet, using an avatar image, along with text (820) such as, "It seems like the bread has not been fermented enough. Let's ferment for another 30 minutes at 25-30 degrees." For example, if the fermentation time corresponds to an importance level 3, the processor (140) may provide an avatar image (81) along with a simple notification.

[0140] The processor (140) may provide feedback (812) to a user who opens the door of the cooking device for the second time, using an avatar image, along with text (830) such as, "If you open the door frequently, the temperature may drop and the bread may not rise as much. I will let you know when you need to open the door and check." For example, the number of times and time of opening the door corresponds to importance level 2, and the processor (140) may provide an avatar image (82) displayed in yellow along with a notification or message.

[0141] The processor (140) may provide feedback (813) to the user who raised the temperature using an avatar image, along with text (840) such as, "If you raise the temperature now, the bread dough may burn. I will keep the temperature at 180 degrees." For example, if the temperature corresponds to an importance level 3, the processor (140) may provide an avatar image (83) displayed in red along with a notification and text.

[0142] The processor (140) can provide feedback by changing the display status of the avatar image according to the importance level, as in the example described above. However, the present invention is not limited thereto, and feedback can be provided using avatar images according to the importance level in various ways.

[0143] According to one embodiment, the processor (140) may update cooking information of a cooking recipe based on the performance of a cooking device. FIG. 9 is a diagram illustrating a method for updating a cooking recipe based on the performance of a cooking device according to one or more embodiments of the present disclosure.

[0144] According to one embodiment, the processor (140) can compare the device information of the cooking device and the cooking information corresponding to the identified cooking recipe to identify whether the cooking information of the identified cooking recipe needs to be updated.

[0145] Referring to FIG. 9, the processor (140) may obtain device information (910) of the other cooking device when providing a personalized recipe to the other cooking device. The device information (or device-provided variables) of the other cooking device may include performance information (or specification information) of the other cooking device, such as maximum temperature, maximum time, type of heat application method, device type, etc. The processor (140) may compare the obtained device information (910) of the other cooking device with the cooking recipe (920) to identify whether the cooking information of the cooking recipe needs to be updated.

[0146] Referring to the cooking device information (910) and pizza recipe (920) of FIG. 9, the cooking recipe includes cooking information for baking at 220 degrees for 25 minutes, but the cooking device information states that the maximum output temperature may be 200 degrees. In this case, the processor (140) identifies the need for updating the cooking information of the cooking recipe and updates and provides the cooking information included in the cooking recipe based on the device information of the other cooking device.

[0147] Referring back to FIG. 9, if the processor (140) identifies that there is a need to update temperature information, the processor (140) may update the cooking recipe (940) by changing the temperature information of the cooking recipe to bake at 200 degrees for 30 minutes based on the performance of the cooking device. Accordingly, the processor (140) may update and provide the cooking recipe (930) based on the performance of the other cooking device.

[0148] FIG. 10 is a flowchart illustrating a method for controlling a cooking device according to one or more embodiments of the present disclosure.

[0149] Referring to FIG. 10, in operation 1010, the cooking device (100) can obtain data related to cooking while cooking is in progress after the cooking recipe is identified.

[0150] In operation 1020, the cooking device (100) can compare the cooking information corresponding to the current cooking step among the plurality of cooking steps included in the cooking recipe with the acquired data and provide first feedback based on the comparison result.

[0151] In operation 1030, the cooking device (100) can update the cooking recipe based on the data obtained after the feedback is provided.

[0152] In operation 1040, the cooking device (100) can obtain the updated cooking recipe as a personalized recipe.

[0153] The method of providing first feedback, the method of updating a cooking recipe, and the method of obtaining a personalized recipe have been specifically described in the various embodiments described above, so a redundant description is omitted.

[0154] The control method described in FIG. 10 can be performed by a cooking device (100) having the configuration of FIG. 2 described above, but is not necessarily limited thereto, and can also be performed by cooking devices having various configurations.

[0155] The various embodiments described above may be implemented as a single embodiment, or at least one embodiment may be combined with each other in whole or in part and implemented together in one device.

[0156] According to the various embodiments described above, users can create personalized recipes using a cooking device and share them with other users. Furthermore, an AI mode based on the personalized recipe enables automatic cooking without user intervention.

[0157] Meanwhile, the various embodiments described above may be applied to a product as an embodiment alone, but at least some of the contents may be implemented in combination with other embodiments of the present disclosure.

[0158] The various embodiments described above can be implemented as software including instructions stored in a machine-readable storage medium that can be read by a machine (e.g., a computer). The machine is a device that can call instructions stored in the storage medium and operate according to the called instructions, and may include an electronic device (e.g., a cooking device (100)) according to the disclosed embodiments. When the instructions are executed by a processor, the processor can perform a function corresponding to the instructions directly or by using other components under the control of the processor. The instructions can include code generated or executed by a compiler or an interpreter. The machine-readable storage medium can be provided in the form of a non-transitory computer-readable storage medium. Here, 'non-transitory' means that the storage medium does not contain a signal and is tangible, but does not distinguish between data being stored semi-permanently or temporarily in the storage medium.

[0159] Additionally, according to one embodiment of the present disclosure, the method according to the various embodiments described above may be provided as included in a computer program product.

[0160] Specifically, a non-transitory readable storage medium or a computer program product storing computer instructions that cause the computer to perform operations including a step of acquiring cooking-related data while cooking is in progress after a cooking recipe is identified, a step of comparing the acquired data with cooking information corresponding to a current cooking step among a plurality of cooking steps included in the cooking recipe and providing first feedback based on the comparison result, a step of updating the cooking recipe based on the acquired data after the feedback is provided, and a step of acquiring the updated cooking recipe as a personalized recipe may be provided.

[0161] The computer program product may be distributed in the form of a device-readable storage medium (e.g., compact disc read-only memory (CD-ROM)) or online through an application store (e.g., Play Store™). In the case of online distribution, at least a portion of the computer program product may be temporarily stored or temporarily created in a storage medium, such as the memory of a manufacturer's server, an application store's server, or an intermediary server.

[0162] In addition, computer instructions or programs for performing the control methods of the cooking devices according to the various embodiments described above may be stored in a non-transitory computer-readable medium. The computer instructions stored in such a non-transitory computer-readable medium, when executed by a processor of a specific device, cause the specific device to perform processing operations in the device according to the various embodiments described above. A non-transitory computer-readable medium refers to a medium that stores data semi-permanently and can be read by a device, rather than a medium that stores data for a short period of time, such as a register, cache, or memory. Specific examples of non-transitory computer-readable media may include a CD, DVD, hard disk, Blu-ray disk, USB, memory card, or ROM.

[0163] Although the preferred embodiments of the present disclosure have been illustrated and described above, the present disclosure is not limited to the specific embodiments described above, and various modifications may be made by a person skilled in the art to which the present disclosure pertains without departing from the gist of the present disclosure as claimed in the claims, and such modifications should not be understood individually from the technical idea or prospect of the present disclosure.

Claims

1. In the cooking device, display; sensor; Memory that stores one or more instructions; comprising one or more processors; The one or more processors, by executing the one or more instructions, After the cooking recipe is identified, data related to the cooking is acquired through the sensor while cooking is in progress, Comparing the cooking information corresponding to the current cooking step among the multiple cooking steps included in the above cooking recipe with the acquired data and providing first feedback based on the comparison result through the display, After the above feedback is provided, the cooking recipe is updated based on the data acquired through the sensor, A cooking device that obtains the above updated cooking recipe as a personalized recipe.

2. In paragraph 1, further comprising a communication interface; The one or more processors, by executing the one or more instructions, By identifying cooking information corresponding to preset criteria among multiple cooking information included in the personalized recipe, a cooking recipe corresponding to the AI ​​(Artificial Intelligence) mode is obtained, A cooking device that provides a cooking recipe corresponding to the above AI mode to another cooking device through the communication interface.

3. In paragraph 1, The one or more processors, by executing the one or more instructions, Obtain cooking status information for a first dish based on the above-identified cooking recipe, Obtain cooking status information for a second dish obtained based on the personalized recipe, A cooking device that compares cooking status information for the first food item and cooking status information for the second food item based on the identified cooking recipe and provides second feedback based on the comparison result through the display.

4. In paragraph 3, The one or more processors, by executing the one or more instructions, A cooking device that updates the personalized recipe based on the user input when the second feedback is provided and user input for the second feedback is received.

5. In paragraph 1, The one or more processors, by executing the one or more instructions, Identifying the importance level of each of the plurality of cooking steps included in the above cooking recipe, A cooking device that provides the first feedback in different forms based on the importance level of each of the plurality of cooking steps.

6. In paragraph 1, The one or more processors, by executing the one or more instructions, A cooking device that obtains the personalized recipe by inputting information about the cooking recipe, information about the first feedback, and data acquired through the sensor before and after providing the first feedback into a learned artificial intelligence model.

7. In paragraph 1, The one or more processors, by executing the one or more instructions, Providing the first feedback using an avatar image corresponding to the identified cooking recipe, A cooking device that provides a display status of the avatar image by changing the display status according to the importance level of the first feedback.

8. In paragraph 1, The one or more processors, by executing the one or more instructions, Compare the device information of the above cooking device and the cooking information corresponding to the identified cooking recipe to identify whether the cooking information of the identified cooking recipe needs to be updated, A cooking device that updates and provides cooking information included in the identified cooking recipe based on device information of the cooking device when cooking information of the identified cooking recipe needs to be updated.

9. In paragraph 1, The data related to the above cooking is: A cooking device comprising at least one data of the weight of ingredients, the number of times and time of opening the door of the cooking device, cooking order, cooking status, cooking temperature, cooking time, cooking method, or model-specific characteristics of the cooking device.

10. In the method of controlling the cooking device, A step of acquiring data related to cooking while cooking is in progress after a cooking recipe has been identified; A step of comparing the cooking information corresponding to the current cooking step among the plurality of cooking steps included in the above cooking recipe with the acquired data and providing first feedback according to the comparison result; A step of updating the cooking recipe based on the acquired data after the feedback is provided; and A control method comprising: a step of obtaining the updated cooking recipe as a personalized recipe; 11. In paragraph 10, A step of identifying cooking information corresponding to preset criteria among multiple cooking information included in the personalized recipe and obtaining a cooking recipe corresponding to the AI ​​(Artificial Intelligence) mode; and A control method further comprising a step of providing a cooking recipe corresponding to the above AI mode to another cooking device.

12. In paragraph 10, A step of obtaining cooking status information for a first dish based on the identified cooking recipe; A step of obtaining cooking status information for a second dish obtained based on the personalized recipe; and A control method further comprising: a step of comparing cooking status information for the first dish and cooking status information for the second dish based on the identified cooking recipe, and providing second feedback according to the comparison result.

13. In paragraph 12, A control method further comprising: a step of updating the personalized recipe based on the user input when the second feedback is provided and a user input for the second feedback is received; 14. In paragraph 10, The step of providing the first feedback is as follows: A step of identifying the importance level of each of the plurality of cooking steps included in the cooking recipe; and A control method comprising: providing the first feedback in different forms based on the importance level of each of the plurality of cooking steps.

15. A non-transitory computer-readable storage medium storing computer instructions that, when executed by a processor of a cooking device, cause the cooking device to perform an operation, wherein the operation is: A step of acquiring data related to cooking while cooking is in progress after a cooking recipe has been identified; A step of comparing the cooking information corresponding to the current cooking step among the plurality of cooking steps included in the above cooking recipe with the acquired data and providing first feedback according to the comparison result; A step of updating the cooking recipe based on the acquired data after the feedback is provided; and A non-transitory computer-readable storage medium comprising a step of obtaining the updated cooking recipe as a personalized recipe.

Images