Cooking device and control method therefor

Abstract

A cooking device for cooking food by using electromagnetic waves is disclosed. The cooking device comprises: a thermographic camera; a memory for storing one or more instructions; and one or more processors, wherein the one or more processors execute one or more instructions so as to: obtain a thermal image obtained by capturing a turntable, on which food is placed, by using the thermographic camera; segment, into a plurality of regions, at least one region included in each of a plurality of frames included in the thermographic image; correct positions of the plurality of regions in each of the plurality of frames on the basis of the rotational angle of the turntable corresponding to the point in time at which each of the plurality of frames is obtained; identify, in the plurality of frames, one region in the current frame on the basis of temperature information about the plurality of regions in which the positions are corrected; and identify representative temperature information about the food by applying a weight to the temperature information about one region identified in the current frame.

Description

Cooking device and its control method

[0001] The present disclosure relates to a cooking device and a control method thereof, and more particularly, to a cooking device that cooks food using electromagnetic waves and a control method thereof.

[0002] Advances in electronic technology have led to the development and widespread adoption of various types of electronic devices. In particular, microwave ovens, used in a variety of settings, including homes and restaurants, have seen continuous advancements in recent years.

[0003] In general, a microwave oven is a device that cooks food by heating the moisture in the food stored inside the cooking chamber using electromagnetic waves (or microwaves) generated by a magnetron.

[0004] A cooking device for cooking food using electromagnetic waves according to one or more embodiments comprises: a thermographic camera; a memory storing one or more commands; and one or more processors, wherein the one or more processors, by executing the one or more commands, acquire a thermal image of a turntable on which food is placed using the thermal imaging camera, segment at least one area included in each of a plurality of frames included in the thermal image into a plurality of areas, correct positions of the plurality of areas in each of the plurality of frames based on a rotation angle of the turntable corresponding to a time point at which each of the plurality of frames is acquired, identify an area in a current frame based on temperature information of the plurality of areas whose positions are corrected in the plurality of frames, and identify representative temperature information of the food by applying a weight to the temperature information of the identified area in the current frame.

[0005] According to one or more embodiments, the one or more processors, by executing the one or more commands, can identify representative temperature information of the food based on temperature information and weight information for each region included in the identified region when the one region is identified in the current frame.

[0006] According to one or more embodiments, the one or more processors, by executing the one or more instructions, when each of the plurality of frames is segmented into a plurality of regions, assign a first indicator to a region among the plurality of regions having a temperature value equal to or greater than a threshold value and assign a second indicator to a region among the plurality of regions having a temperature value less than the threshold value, and when positions of the plurality of regions in the plurality of frames are corrected based on a rotation angle of the turntable, identify the region in the current frame by combining the first indicator or the second indicator corresponding to the plurality of regions whose positions are corrected in the plurality of frames.

[0007] According to one or more embodiments, the one or more processors, by executing the one or more instructions, when each of the plurality of frames is segmented into a plurality of regions, assign a value of "1" to a region having a temperature value greater than or equal to a threshold value among the plurality of regions and assign a value of "0" to a region having a temperature value less than or equal to the threshold value among the plurality of regions, and when positions of the plurality of regions in the plurality of frames are corrected based on a rotation angle of the turntable, add up the "1" values ​​or "0" values ​​corresponding to the plurality of regions whose positions are corrected in the plurality of frames, and identify the region in the current frame based on the summed value corresponding to each of the plurality of regions.

[0008] According to one or more embodiments, the one or more processors, by executing the one or more commands, when the one area is identified in the current frame, identify a weight for each area according to the sum of the plurality of areas included in the one area, and apply different weights to the temperature information for each area in the current frame to identify representative temperature information of the food.

[0009] According to one or more embodiments, the one or more processors can, by executing the one or more instructions, identify a rotation angle of the turntable based on a time interval at which the plurality of frames are acquired and a rotation speed of the turntable, and rotate the plurality of frames based on a rotation angle of the turntable corresponding to each of the plurality of frames to correct positions of the plurality of areas.

[0010] According to one or more embodiments, the one or more processors can, by executing the one or more commands, input the plurality of frames and the rotation angle information of the turntable corresponding to the plurality of frames into a learned artificial intelligence model to obtain at least one of weight information or temperature information of the one area.

[0011] According to one or more embodiments, the one or more processors may, by executing the one or more commands, identify a representative temperature of the food based on a cooking type set according to a user command and a temperature for each area identified in the current frame, identify whether the representative temperature of the food reaches a target temperature, and terminate cooking if it is determined that the representative temperature of the food reaches the target temperature.

[0012] According to one or more embodiments, when the representative temperature information of the food is identified by executing the one or more commands, if an area having a difference of less than a threshold size between the representative temperature information and a threshold temperature in at least one of an internal area or an external area of ​​the identified area is identified, the one or more processors can identify the area as a contaminated area and provide guide information for the identified contaminated area.

[0013] According to one or more embodiments, the one or more processors can identify where the location of the contaminant is among the camera, the turntable, or the wall surface of the high-temperature chamber based on at least one of whether the identified contaminant area rotates and whether the temperature changes in the plurality of frames by executing the one or more commands, and provide guide information for the identified contaminant location.

[0014] A method for controlling a cooking device that cooks food using electromagnetic waves according to one or more embodiments may include the steps of: obtaining a thermal image by capturing a turntable on which food is placed using a thermal image camera; segmenting at least one area included in each of a plurality of frames included in the thermal image into a plurality of areas; correcting positions of the plurality of areas in each of the plurality of frames based on a rotation angle of the turntable corresponding to a time point at which each of the plurality of frames is obtained; identifying an area in a current frame based on temperature information of the plurality of areas whose positions are corrected in the plurality of frames; and identifying representative temperature information of the food by applying a weight to the temperature information of the identified area in the current frame.

[0015] A non-transitory computer-readable medium storing computer instructions that, when executed by a processor of a cooking device that cooks food using electromagnetic waves according to one or more embodiments, cause the cooking device to perform an operation, the operation may include: obtaining a thermal image by capturing a turntable on which food is placed using a thermal imaging camera; segmenting at least one area included in each of a plurality of frames included in the thermal image into a plurality of areas; correcting positions of the plurality of areas in each of the plurality of frames based on a rotation angle of the turntable corresponding to a time point at which each of the plurality of frames is obtained; identifying an area in a current frame based on temperature information of the plurality of areas whose positions are corrected in the plurality of frames; and identifying representative temperature information of the food by applying a weight to temperature information of the identified area in the current frame.

[0016] The above and other aspects, features and advantages of specific embodiments of the present disclosure will become more apparent from the following description taken in conjunction with the accompanying drawings.

[0017] FIGS. 1A to 1C are drawings for explaining the structure and operation of a microwave oven to help understand the present disclosure.

[0018] FIG. 2A is a block diagram showing the configuration of a cooking device according to one or more embodiments.

[0019] FIG. 2b is a block diagram showing a detailed configuration of a cooking device according to one or more embodiments.

[0020] FIG. 3 is a flowchart illustrating a method for controlling a cooking device according to one or more embodiments.

[0021] FIG. 4 is a diagram illustrating a method for obtaining representative temperature information of a food according to one or more embodiments.

[0022] FIG. 5 is a flowchart illustrating a method for controlling a cooking device according to one or more embodiments.

[0023] FIG. 6 is a diagram illustrating a method for obtaining temperature information of a cooking area according to one or more embodiments.

[0024] FIGS. 7A and 7B are drawings illustrating a method for obtaining temperature of a cooking area according to one or more embodiments.

[0025] FIG. 8 is a flowchart illustrating a method for controlling a cooking device according to one or more embodiments.

[0026] FIG. 9 is a diagram illustrating a method for detecting contaminants according to one or more embodiments.

[0027] FIGS. 10A and 10B are drawings illustrating a method for detecting contaminants according to one or more embodiments.

[0028] FIGS. 11A and 11B are drawings illustrating a method for detecting contaminants according to one or more embodiments.

[0029] The terms used in this specification will be briefly explained, and the present disclosure will be described in detail.

[0030] The terms used in the embodiments of this disclosure have been selected from widely used, current terms, taking into account the functions of this disclosure. However, these terms may vary depending on the intentions or cases of those skilled in the art, the emergence of new technologies, etc. Furthermore, in certain cases, terms may be arbitrarily selected by the applicant, and in such cases, their meanings will be described in detail in the description of the relevant disclosure. Therefore, the terms used in this disclosure should not be defined simply as names of terms, but rather based on the meanings of the terms and the overall content of this disclosure.

[0031] In this specification, expressions such as “has,” “can have,” “includes,” or “may include” indicate the presence of a feature (e.g., a number, function, operation, or component such as a part), and do not exclude the presence of additional features.

[0032] In this disclosure, expressions such as “A or B,” “at least one of A and / or B,” or “one or more of A or / and B” can include all possible combinations of the listed items. For example, “A or B,” “at least one of A and B,” or “at least one of A or B” can all refer to cases where (1) only A is included, (2) only B is included, or (3) both A and B are included.

[0033] As used herein, the expressions “first,” “second,” “first,” or “second,” etc., may describe various components, regardless of order and / or importance, and are only used to distinguish one component from another, but do not limit the components.

[0034] When it is said that a component (e.g., a first component) is “operatively or communicatively coupled with / to” or “connected to” another component (e.g., a second component), it should be understood that the component may be directly coupled to the other component, or may be connected through another component (e.g., a third component).

[0035] The expression "configured to" as used in the present disclosure may be used interchangeably with, for example, "suitable for," "having the capacity to," "designed to," "adapted to," "made to," or "capable of." The term "configured to" may not necessarily mean only "specifically designed to" in terms of hardware.

[0036] In some contexts, the phrase "a device configured to" may mean that the device, in conjunction with other devices or components, is "capable of" performing A, B, and C. For example, the phrase "a processor configured (or set) to perform A, B, and C" may refer to a dedicated processor (e.g., an embedded processor) for performing those operations, or a general-purpose processor (e.g., a CPU or application processor) that can perform those operations by executing one or more software programs stored in a memory device.

[0037] Singular expressions include plural expressions unless the context clearly dictates otherwise. In this application, terms such as "comprise" or "consist of" are intended to indicate the presence of a feature, number, step, operation, component, part, or combination thereof described in the specification, but should be understood not to preclude the presence or addition of one or more other features, numbers, steps, operations, components, parts, or combinations thereof.

[0038] In the embodiments, a "module" or "part" performs at least one function or operation and may be implemented as hardware or software, or as a combination of hardware and software. Furthermore, a plurality of "modules" or "parts" may be integrated into at least one module and implemented as at least one processor (not shown), excluding any "module" or "part" that needs to be implemented as specific hardware.

[0039] Meanwhile, the various elements and areas in the drawings are schematically drawn. Therefore, the technical concept of the present invention is not limited by the relative sizes or spacing depicted in the attached drawings.

[0040] An embodiment of the present disclosure will be described in more detail with reference to the attached drawings below.

[0041] FIGS. 1A to 1C are drawings for explaining the structure and operation of a microwave oven to help understand the present disclosure.

[0042] Referring to FIGS. 1A to 1C, the microwave oven (1) is formed in a roughly rectangular parallelepiped shape with a cooking chamber (22) inside, and the two side surfaces and the upper outer surface can be formed by a sub-case (10). The sub-case (10) is formed by bending a plate having a predetermined width and thickness, and can be combined with a rear plate (12) forming the rear outer surface of the microwave oven (1) and a lower plate (14) forming the lower outer surface. A cavity (20) forming a cooking chamber (22), which is a space for cooking food, can be provided on the upper side of the lower plate (14). The cavity (20) can be formed in a rectangular cylindrical shape with an open front having a size that can be accommodated inside the outer case (10). That is, the cavity (20) is formed in a cylindrical shape by joining the plates forming at least one side to each other, and a cooking chamber (22) can be formed in the opened interior.

[0043] A heater (40) may be provided on the ceiling of the cooking chamber (22) to heat food contained in the cooking chamber (22) by radiant heat. The heater (40) is generally a sheath heater, and various types of electric heaters such as a ceramic heater and a halogen heater may be used as needed. The heater (40) may be fixed to a top cavity (24) forming the upper surface of the cavity (20) so as to be exposed to the interior of the cooking chamber (22).

[0044] Meanwhile, a turntable (32) for supporting a container containing food may be provided on the floor of the cooking chamber (22). A turntable motor (33) may be provided on the lower side of the turntable (32). The turntable motor (33) provides driving force for the rotation of the turntable (32) when food is cooked inside the cooking chamber (22). The turntable motor (33) stops when food is kept warm inside the cooking chamber (22), so as to prevent unnecessary power consumption. A cooking chamber lamp (35) may be further provided on the side of the cooking chamber (22). The cooking chamber lamp (35) illuminates the inside of the cooking chamber (22) when food is being cooked inside the cooking chamber so that a user can know the cooking status of the food. The cooking chamber lamp (35) turns off when food is kept warm inside the cooking chamber, so as to prevent unnecessary power consumption.

[0045] In addition, a number of intake holes (28) may be perforated in the center of the back cavity (26) forming the rear of the cooking chamber (22) through which air inside the cooking chamber (22) is sucked in, and a number of discharge holes (29) may be perforated on the inside of the rim of the back cavity (26) through which heat generated by the convection heater (62) is discharged into the cooking chamber (22).

[0046] Meanwhile, a power unit (30) may be provided in the top cavity (24) and the back cavity (26). The power unit (30) is a space where power components for the operation of the microwave oven (1) are provided. The power unit (30) formed in the back cavity (26) may be provided with a magnetron (34) that generates microwaves for heating food, a high-voltage transformer and a high-voltage capacitor for supplying high-voltage current to the magnetron (34), and a convection unit (60) that convectively heats the cooking chamber (22).

[0047] The convection unit (60) may be configured to include a convection heater (62) that generates heat by electrical resistance, and a convection fan (64) that forcibly convects the heat generated by the convection heater (62) into the cooking chamber (22). When the convection function of the microwave oven (1) is performed, power is supplied to the convection heater (62) to generate heat, and the heat generated by the convection heater (62) can circulate inside the cooking chamber (22) by the rotation of the convection fan (64). That is, food stored in the cooking chamber (22) can be cooked through a convection heating process in which the heat generated by the convection heater (62) is introduced into the cooking chamber (22) through the discharge hole (29) and then discharged to the outside of the cooking chamber (22) through the suction hole (28).

[0048] Meanwhile, the electrical room (30) formed on the upper surface of the top cavity (24) may be equipped with a control unit (or processor) (50) that controls the overall operation of the heater (40) and the microwave oven (1), and a fan assembly (70) that forces air flow to cool the electrical room (30).

[0049] The control unit (50) can form a predetermined circuit by a number of circuit components such as a resistor, a capacitor, an IC (Integrated Circuit) chip, and a microcomputer (MICOM).

[0050] The fan assembly (70) sucks in external air of the microwave oven (1) by means of rotational force to cool a number of electrical components provided in the electrical compartment (30), and a portion of this air is introduced into the cooking compartment (22) through an inlet (27) formed on the front side of the top cavity (24) and circulates within the cooking compartment (22). The air circulating within the cooking compartment (22) can be discharged to the outside of the cooking compartment (22) through an intake port (28).

[0051] Meanwhile, a front plate (16) may be formed at the front of the cavity (20). The front plate (16) forms the front outer shape of the cavity (20) and may be coupled to the front end of the outer case (10). A door (80) may be rotatably coupled to the front plate (16). The door (80) is hinge-coupled to the lower end of the front plate (16) to selectively open and close the open front of the cavity (20).

[0052] A viewing window (82) may be formed in the center of the door (80) so that the user can view the cooking status of food in the cooking chamber (22) without rotating the door (80). In addition, a door handle (84) that is gripped by the user may be provided on the front of the door (80) so that the door (80) can be easily opened and closed. Meanwhile, an operation unit (90) may be provided on the upper part of the door (80) so that the user inputs an operation command to cook food or keep food warm using the microwave oven (1). The operation unit (90) may be configured to include a plurality of buttons (92) for operating the microwave oven (1) and a display (94) that indicates the operating status. The display (94) may show the status of the microwave oven (1) set by the buttons (92).

[0053] Meanwhile, microwave ovens (1) typically cook at uneven temperatures, making it difficult to determine whether food has reached the user's desired cooking temperature. Therefore, the following describes various embodiments that intelligently identify the representative temperature of food and enable cooking at the user's desired cooking temperature.

[0054] FIG. 2A is a block diagram showing the configuration of a cooking device according to one or more embodiments.

[0055]

[0056] *According to FIG. 2a, the cooking device (100) includes a thermal imaging camera (110), a memory (120), and one or more processors (130). According to one example, the cooking device (100) can be implemented as a microwave oven (1) illustrated in FIG. 1.

[0057] A thermal imaging camera (110) is a device that tracks and detects heat and displays it at a glance on a screen. While the human eye or a general camera detects visible light, a thermal imaging camera (110) detects the radiant heat emitted by a hot object to create an image. The thermal imaging camera (110) displays the temperature in different colors so that we can identify the temperature with our eyes. In other words, the thermal imaging camera (110) is a camera that detects thermal radiation emitted from an object and visualizes it in various colors. It can be installed in a location where it can photograph the inside of a cooking chamber. For example, the thermal imaging camera (110) can be installed in a location where it can photograph a turntable from the front. Accordingly, the image acquired through the thermal imaging camera (110) can be a top-view image or an image taken at an angle close to a top-view image.

[0058] The memory (120) can store data required for various embodiments. The memory (120) may be implemented in the form of a memory embedded in the cooking device (100') or may be implemented in the form of a memory detachable from the cooking device (100) depending on the purpose of data storage. For example, data for driving the cooking device (100) may be stored in a memory embedded in the cooking device (100'), and data for expanding the functions of the cooking device (100) may be stored in a memory detachable from the cooking device (100). Meanwhile, in the case of the memory embedded in the cooking device (100), it may be implemented as at least one of volatile memory (e.g., dynamic RAM (DRAM), static RAM (SRAM), or synchronous dynamic RAM (SDRAM)), non-volatile memory (e.g., one time programmable ROM (OTPROM), programmable ROM (PROM), erasable and programmable ROM (EPROM), electrically erasable and programmable ROM (EEPROM), mask ROM, flash ROM, flash memory (e.g., NAND flash or NOR flash), hard drive, or solid state drive (SSD)). In addition, in the case of the memory that can be detachably attached to the cooking device (100'), it may be implemented as at least one of memory cards (e.g., compact flash (CF), secure digital (SD), micro secure digital (Micro-SD), mini secure digital (Mini-SD), extreme digital (xD), multi-media card (MMC), etc.), external memory that can be connected to a USB port (e.g., USB memory), etc. It can be implemented in the form of.

[0059] As an example, the memory (120) may store a computer program including at least one instruction or instructions for controlling the cooking device (100).

[0060] According to another example, the memory (120) may store an image received from an external device (e.g., a source device), an external storage medium (e.g., USB), an external server (e.g., web hard), etc., i.e., an input image. Alternatively, the memory (120) may store an image acquired through a thermal imaging camera (110) provided in the cooking device (100). Here, the image may be a 2D image, but is not limited thereto.

[0061] According to one embodiment, the memory (120) may be implemented as a single memory that stores data generated from various operations according to the present disclosure. However, according to another embodiment, the memory (120) may be implemented to include multiple memories that each store different types of data or each store data generated at different stages.

[0062] In the above-described embodiment, it has been described that various data are stored in the external memory (120) of the processor (130), but at least some of the above-described data may be stored in the internal memory of the processor (130) depending on the implementation example of at least one of the cooking device (100) or the processor (130).

[0063] One or more processors (130) control the overall operation of the cooking device (100). Specifically, one or more processors (130) may be connected to each component of the cooking device (100) to control the overall operation of the cooking device (100). For example, one or more processors (130) may be electrically connected to the display (110) and the memory (120) to control the overall operation of the cooking device (100). One or more processors (130) may be configured as one or more processors.

[0064] One or more processors (130) can perform operations of the cooking device (100) according to various embodiments by executing at least one instruction stored in the memory (120).

[0065] The one or more processors (130) may include one or more of a Central Processing Unit (CPU), a Graphics Processing Unit (GPU), an Accelerated Processing Unit (APU), a Many Integrated Core (MIC), a Digital Signal Processor (DSP), a Neural Processing Unit (NPU), a hardware accelerator, or a machine learning accelerator. The one or more processors (130) may control one or any combination of other components of the cooking device, and may perform operations related to communication or data processing. The one or more processors (130) may execute one or more programs or instructions stored in a memory. For example, the one or more processors may perform a method according to one or more embodiments of the present disclosure by executing one or more instructions stored in a memory.

[0066] When a method according to one or more embodiments of the present disclosure includes multiple operations, the multiple operations may be performed by one processor or by multiple processors. For example, when a first operation, a second operation, and a third operation are performed by a method according to one or more embodiments, the first operation, the second operation, and the third operation may all be performed by the first processor, or the first operation and the second operation may be performed by the first processor (e.g., a general-purpose processor) and the third operation may be performed by the second processor (e.g., an artificial intelligence-specific processor).

[0067] One or more processors (130) may be implemented as a single core processor including one core, or may be implemented as one or more multicore processors including multiple cores (e.g., homogeneous multicores or heterogeneous multicores). When one or more processors (130) are implemented as a multicore processor, each of the multiple cores included in the multicore processor may include an internal processor memory, such as a cache memory or an on-chip memory, and a common cache shared by the multiple cores may be included in the multicore processor. In addition, each of the multiple cores (or some of the multiple cores) included in the multicore processor may independently read and execute a program instruction for implementing a method according to one or more embodiments of the present disclosure, or all (or some) of the multiple cores may be linked to read and execute a program instruction for implementing a method according to one or more embodiments of the present disclosure.

[0068] When a method according to one or more embodiments of the present disclosure includes a plurality of operations, the plurality of operations may be performed by one core among the plurality of cores included in a multi-core processor, or may be performed by the plurality of cores. For example, when a first operation, a second operation, and a third operation are performed by a method according to one or more embodiments, the first operation, the second operation, and the third operation may all be performed by a first core included in the multi-core processor, or the first operation and the second operation may be performed by a first core included in the multi-core processor, and the third operation may be performed by a second core included in the multi-core processor.

[0069] In the embodiments of the present disclosure, a processor may mean a system on a chip (SoC) in which one or more processors and other electronic components are integrated, a single-core processor, a multi-core processor, or a core included in a single-core processor or a multi-core processor, wherein the core may be implemented as a CPU, a GPU, an APU, a MIC, a DSP, an NPU, a hardware accelerator, or a machine learning accelerator, but the embodiments of the present disclosure are not limited thereto. Hereinafter, for the convenience of explanation, one or more processors (130) will be referred to as a processor (130).

[0070] According to one embodiment, the processor (130) can obtain a thermal image of a turn table on which food is placed using a thermal imaging camera (110).

[0071] According to one embodiment, the processor (130) may segment each of a plurality of frames included in a thermal image into a plurality of regions. According to one example, the processor (130) may segment at least one region of the entire frame region into a pixel region of a preset size based on temperature information included in each frame. For example, the processor (130) may segment a region in which a temperature value is equal to or greater than a preset value in each frame into a pixel region of a preset size. According to another example, the processor (130) may segment the entire frame region of each frame into a pixel region of a preset size regardless of the temperature information.

[0072] According to one embodiment, the processor (130) may correct the positions of the plurality of regions in each of the plurality of frames based on the rotation angle of the turntable corresponding to the time at which each of the plurality of frames was acquired. For example, the processor (130) may identify the rotation angle of the turntable based on the time interval at which the plurality of frames were acquired and the rotation speed of the turntable. The processor (130) may correct the positions of the plurality of regions by rotating the plurality of frames based on the rotation angle of the turntable corresponding to each of the plurality of frames.

[0073] According to one embodiment, the processor (130) can identify an area in a current frame among a plurality of frames based on temperature information of a plurality of areas whose positions are corrected in a plurality of frames.

[0074] According to one embodiment, the processor (130) may identify representative temperature information of a food item by applying a weight to the temperature information of a region identified in the current frame. For example, when a region is identified in the current frame, the processor (130) may identify representative temperature information of the food item based on the temperature information and weight information for each region included in the identified region.

[0075] According to one example, when each of a plurality of frames is segmented into a plurality of regions, the processor (130) may assign different identification information to each of the plurality of regions according to temperature information of each of the plurality of regions. For example, the processor (130) may assign a first indicator to a region among the plurality of regions whose temperature value is equal to or greater than a threshold value, and may assign a second indicator to a region among the plurality of regions whose temperature value is less than the threshold value. For example, the processor (130) may assign a value of "1" to a region among the plurality of regions whose temperature value is equal to or greater than a threshold value, and may assign a value of "0" to a region among the plurality of regions whose temperature value is less than the threshold value. However, the present invention is not limited thereto, and the first indicator and the second indicator may be determined to various values ​​that can distinguish whether the sum of the corresponding values ​​is the sum of regions whose temperature values ​​are equal to or greater than the threshold value or the sum of regions whose temperature values ​​are less than the threshold value. For example, the threshold value may be a temperature determined based on a cooking temperature (or target temperature) set during cooking. It may be determined as a preset % value based on the cooking temperature (or target temperature).

[0076] According to one example, when the positions of a plurality of areas are corrected in a plurality of frames based on the rotation angle of the turntable, the processor (130) may identify an area in the current frame based on identification information corresponding to the areas whose positions are corrected in the plurality of frames. For example, when the positions of a plurality of areas are corrected, the processor (130) may identify an area in the current frame by combining a first indicator or a second indicator corresponding to the areas whose positions are corrected in the plurality of frames. For example, when the positions of a plurality of areas are corrected, the processor (130) may add up the "1" value or the "0" value corresponding to the areas whose positions are corrected in the plurality of frames, and identify an area in the current frame based on the summed value corresponding to each of the areas. For example, an area identified in the current frame may be an area with a high probability of being a cooking area, and may be an area used to calculate a representative temperature of the cooking area.

[0077] For example, when a region is identified in the current frame, the processor (130) may identify a region to which different weights are applied based on the sum of multiple region-specific values ​​included in the identified region. Subsequently, the processor (130) may apply different weights to the region-specific temperature information in the current frame to identify representative temperature information for the food.

[0078] According to one embodiment, the processor (130) may input a plurality of frames and rotation angle information of a turntable corresponding to the plurality of frames into a learned artificial intelligence model to obtain at least one of weight information of a food area (or probability information of a food area) or temperature information of a food area.

[0079] According to one embodiment, the processor (130) may identify a representative temperature of the food based on a cooking type set according to a user command and the temperature of each area identified in the current frame, determine whether the representative temperature of the food reaches a target temperature, and terminate cooking if the representative temperature of the food reaches the target temperature. For example, the representative temperature of the food may be determined according to the cooking type based on temperature information of each area included in the food area.

[0080] For example, a cooking type may include, but is not limited to, at least one of: moist cooking (Medium rare), regular cooking (Medium), regular cooking (Well or Medium Well), or crispy cooking. Assuming that the cooking temperature (or target temperature) is set to a specific, uniform temperature, different temperatures may be used as representative temperatures depending on the cooking type.

[0081] For example, for a moist (Medium rare) cooking, the top x% value can be used as the representative temperature. This is because using the top x% value takes relatively less time to reach the target temperature.

[0082] For example, for normal cooking (Medium), the average value can be used as the representative temperature. This is because the average value is generally the average temperature value of the food being cooked, and there is a large deviation.

[0083] For example, for general cooking (Well or Medium Well), the median temperature can be used as a representative temperature, as the median is generally characterized by the time it takes to reach the target temperature.

[0084] For example, for crispy cooking, the lower x% value can be used as a representative temperature, as it takes relatively more time to reach the target temperature.

[0085] According to one embodiment, when representative temperature information of a food is identified, if an area (or particle) smaller than a critical size and having a difference greater than or equal to the representative temperature information and a critical temperature is identified in at least one of an internal area or an external area of ​​the identified area, the processor (130) may identify the area as a contaminant area and provide guide information for the identified contaminant area.

[0086] According to one embodiment, the processor (130) can identify whether the location of the contaminant is on the camera, the turntable, or the wall of the high-rise building based on at least one of whether the contaminant area identified in a plurality of frames rotates and whether the temperature changes, and can provide guide information for the identified contaminant location.

[0087] According to one embodiment, the processor (130) can distinguish between food and a container containing the food, identify the temperature of the food, and provide guidance to the user. For example, the processor (130) can distinguish between food and a container based on a temperature difference between regions and an outer shape of an object. For example, the processor (130) can provide an alarm to the user to warn them if the temperature of the container exceeds a specific temperature after cooking is completed. For example, the processor (130) can identify the food area and the container area through at least one of object recognition, object detection, object tracking, or image segmentation. For example, the cooking device (100) can identify the cooking area and the container area by using techniques such as semantic segmentation that extracts objects included in a thermal image by classifying them by type as needed, instance segmentation that recognizes objects by classifying them by object even if they are the same type, and a bounding box in the shape of a rectangle that includes the detected object when detecting an object included in an image.

[0088] FIG. 2b is a block diagram showing a detailed configuration of a cooking device according to one or more embodiments.

[0089] According to FIG. 2a, the cooking device (100') includes a thermal imaging camera (110), a memory (120), one or more processors (130), a communication interface (140), and a user interface (150). Among the configurations illustrated in FIG. 2b, a detailed description of configurations that overlap with those illustrated in FIG. 2a will be omitted.

[0090] The communication interface (140) includes a circuit and can communicate with an external device (server or user terminal). For example, the processor (130) can receive various data or information from an external device connected via the communication interface (140) and can also transmit various data or information to the external device.

[0091] The communication interface (140) may include at least one of a WiFi module, a Bluetooth module, a wireless communication module, an NFC module, and a UWB module (Ultra Wide Band). At this time, the wireless communication module may perform communication according to various communication standards such as IEEE, Zigbee, 3G (3rd Generation), 3GPP (3rd Generation Partnership Project), LTE (Long Term Evolution), 5G (5th Generation), etc.

[0092] The user interface (150) may be implemented as a device such as a button, a touch pad, etc., or as a touch screen that can also perform the above-described display function and operation input function.

[0093] The speaker (160) can convert and amplify a digital audio signal processed by the processor (130) into an analog audio signal and output it. For example, the speaker (160) can include at least one speaker unit, a D / A converter, an audio amplifier, etc., which can output at least one channel. For example, the speaker can output various notifications, messages, information, etc. related to the guide information generated by the processor (130).

[0094] In addition, the cooking device (100') may further include a microphone and a sensor.

[0095] A microphone is a component that receives user voice or other sounds and converts them into audio data. In one example, the processor (130) may use audio received through the microphone as context data for the cooking device (100). However, in another embodiment, the cooking device (100) may receive user voice input through an external device through the communication interface (140).

[0096] The sensors may include various types of sensors, such as temperature sensors, light sensors, touch sensors, proximity sensors, humidity sensors, infrared sensors, biosensors, etc.

[0097] FIG. 3 is a flowchart illustrating a method for controlling a cooking device according to one or more embodiments.

[0098] According to FIG. 3, the cooking device (100) can obtain a thermal image of a turn table on which food is placed using a thermal imaging camera (110) (S310).

[0099] Next, the cooking device (100) can segment at least one area included in each of the plurality of frames included in the thermal image into a plurality of areas (S320).

[0100] Next, the cooking device (100) can correct the positions of the plurality of regions in each of the plurality of frames based on the rotation angle of the turntable corresponding to the time at which each of the plurality of frames is acquired (S330). In one example, the cooking device (100) can identify the rotation angle of the turntable based on the time interval at which the plurality of frames are acquired and the rotation speed of the turntable, and can correct the positions of the plurality of regions by rotating the plurality of frames based on the rotation angle of the turntable corresponding to each of the plurality of frames.

[0101] Next, the cooking device (100) can identify an area in the current frame among the plurality of frames based on temperature information of the plurality of areas whose positions are corrected in the plurality of frames (S340).

[0102] Next, the cooking device (100) can identify representative temperature information of the food by applying a weight to the temperature information of an area identified in the current frame (S350).

[0103] Meanwhile, in Fig. 3, the order is mapped for all steps for convenience of explanation, but it is of course not necessarily limited to the order of steps that are not related to the order or can be performed in parallel.

[0104] FIG. 4 is a diagram illustrating a method for obtaining representative temperature information of a food according to one or more embodiments.

[0105] According to an example, the cooking device (100) can identify the rotation angle of the turntable corresponding to the plurality of frames based on the time intervals at which the plurality of frames are acquired and the rotation speed of the turntable. For example, as shown in FIG. 4, assume that the plurality of frames (411, 412, 413) are acquired at 0s, 5s, and 10s. In this case, if the angle at which the first frame (411) is acquired is a reference angle, i.e., 0°, the angles at which the second frame (412) and the third frame are acquired may be 5s * v = z° and 10s * v = b°, respectively.

[0106] For example, the cooking device (100) may rotate the second frame by a° and rotate the third frame by b° to generate an image (420) in which pixel areas overlap. The cooking device (100) may determine a weight corresponding to each pixel area based on the number of pixels overlapping the pixel area identified as the food area. For example, the cooking device (100) may determine a larger weight for the area as the number of overlapping pixels increases. In this case, the cooking device (100) may apply the determined weight to the temperature information identified in the current frame to identify the temperature of each area of ​​the food.

[0107] FIG. 5 is a flowchart illustrating a method for controlling a cooking device according to one or more embodiments.

[0108] According to one embodiment, when each of a plurality of frames is segmented into a plurality of regions, the cooking device (100) may assign a first indicator to a region among the plurality of regions whose temperature value is greater than or equal to a threshold value and may assign a second indicator to a region among the plurality of regions whose temperature value is less than or equal to the threshold value. When the positions of the plurality of regions in the plurality of frames are corrected based on the rotation angle of the turntable, the cooking device (100) may identify a region in the current frame by combining the first indicator or the second indicator corresponding to the plurality of regions whose positions are corrected in the plurality of frames. For example, the first indicator may have a value of "1" and the second indicator may have a value of "0".

[0109] According to FIG. 5, the cooking device (100) can obtain a thermal image of a turn table on which food is placed using a thermal imaging camera (110) (S510).

[0110] Next, the cooking device (100) can segment at least one area included in each of the plurality of frames included in the thermal image into a plurality of areas (S520).

[0111] Next, the cooking device (100) can assign a value of “1” to a region among the plurality of regions included in each of the plurality of frames having a temperature value greater than or equal to a threshold value, and can assign a value of “0” to a region among the plurality of regions having a temperature value less than or equal to a threshold value (S530).

[0112] Next, the cooking device (100) can correct the positions of the plurality of areas in each of the plurality of frames based on the rotation angle of the turntable corresponding to the time at which each of the plurality of frames was acquired (S540).

[0113] Next, the cooking device (100) can add up the “1” or “0” values ​​corresponding to the plurality of regions whose positions are corrected in the plurality of frames and identify a region in the current frame based on the sum value corresponding to each of the plurality of regions (S550).

[0114] Next, the cooking device (100) can identify an area to which different weights are to be applied based on the sum of the multiple area-specific values ​​included in one area (S560).

[0115] Next, the cooking device (100) can identify representative temperature information of the food by applying a weight to the temperature information of an area identified in the current frame (S570).

[0116] Meanwhile, in Fig. 5, the order is mapped for all steps for convenience of explanation, but it is of course not necessarily limited to the order of steps that are not related to the order or can be performed in parallel.

[0117] FIG. 6 is a diagram illustrating a method for obtaining temperature information of a cooking area according to one or more embodiments.

[0118] According to one example, the cooking device (100) may assign a value of "1" to a region among a plurality of regions included in each of a plurality of frames, wherein the temperature value is greater than or equal to a threshold value, and may assign a value of "0" to a region among a plurality of regions, wherein the temperature value is less than or equal to the threshold value. For example, as illustrated in FIG. 4, an indicator value according to the temperature of each region may be assigned to each of a plurality of frames (411, 412, 413).

[0119] According to an example, the cooking device (100) can identify the rotation angle of the turntable corresponding to the plurality of frames based on the time intervals at which the plurality of frames are acquired and the rotation speed of the turntable. For example, as shown in FIG. 4, assume that the plurality of frames (411, 412, 413) are acquired at 0s, 5s, and 10s. In this case, if the angle at which the first frame (411) is acquired is a reference angle, i.e., 0°, the angles at which the second frame (412) and the third frame are acquired may be 5s * v = z° and 10s * v = b°, respectively.

[0120] For example, the cooking device (100) may rotate the second frame by a° and rotate the third frame by b° to generate an image (420) in which pixel areas overlap. In this case, the cooking device (100) may determine a weight corresponding to each pixel area based on the sum of indicator values ​​corresponding to the overlapping pixels, for example, a “0” or “1” value. For example, the cooking device (100) may determine a larger weight as the sum value in the image (420) in which pixel areas overlap is larger. In this case, the cooking device (100) may identify the temperature of each area of ​​the food by applying the determined weight to the temperature information identified in the current frame.

[0121] FIGS. 7A and 7B are drawings illustrating a method for obtaining temperature of a cooking area according to one or more embodiments.

[0122] According to one example, the cooking device (100) can obtain probability information (or weight information) of a cooking area by inputting a plurality of frames (411, 412, 413) and rotation angle information of a turntable corresponding to the plurality of frames (411, 412, 413) into a learned artificial intelligence model as illustrated in FIG. 7A. For example, the cooking device (100) can label the rotation angle of the turntable in each of the plurality of frames (411, 412, 413), i.e., the rotation angle of each frame, and input the labeled information into the learned artificial intelligence model.

[0123] According to another example, the cooking device (100) can obtain temperature information of the cooking area by inputting the plurality of frames (411, 412, 413) and the rotation angle information of the turntable corresponding to the plurality of frames (411, 412, 413) into the learned artificial intelligence model as illustrated in FIG. 7b. For example, the cooking device (100) can input the rotation angle of the turntable in each of the plurality of frames (411, 412, 413), i.e., the rotation angle of each frame, into the learned artificial intelligence model. In FIG. 7b, the temperature information is illustrated as being included as a number in the output image, but of course, the output image may be in the form of a thermal image.

[0124] Here, the learning of an artificial intelligence model means that a basic artificial intelligence model (e.g., an artificial intelligence model including any random parameters) is trained using a learning algorithm using a large number of training data, thereby creating a predefined set of operation rules or an artificial intelligence model set to perform a desired characteristic (or purpose). This learning may be performed through a separate server and / or system, but is not limited thereto, and may also be performed in a cooking device. Examples of learning algorithms include, but are not limited to, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning.

[0125] Here, the artificial intelligence model can be implemented as, for example, a Convolutional Neural Network (CNN), a Recurrent Neural Network (RNN), a Restricted Boltzmann Machine (RBM), a Deep Belief Network (DBN), a Bidirectional Recurrent Deep Neural Network (BRDNN), or a Deep Q-Network, but is not limited thereto.

[0126] FIG. 8 is a flowchart illustrating a method for controlling a cooking device according to one or more embodiments.

[0127] According to FIG. 8, the cooking device (100) can obtain a thermal image of a turn table on which food is placed using a thermal imaging camera (110) (S810).

[0128] Next, the cooking device (100) can segment at least one area included in each of the plurality of frames included in the thermal image into a plurality of areas (S820).

[0129] Next, the cooking device (100) can correct the positions of the plurality of areas in each of the plurality of frames based on the rotation angle of the turntable corresponding to the time at which each of the plurality of frames was acquired (S830).

[0130] Next, the cooking device (100) can identify an area in the current frame among the plurality of frames based on temperature information of the plurality of areas whose positions are corrected in the plurality of frames (S840).

[0131] Next, the cooking device (100) can identify representative temperature information of the food by applying a weight to the temperature information of an area identified in the current frame (S850).

[0132] Next, if an area smaller than a critical size and having a difference between the representative temperature information and the critical temperature is identified in at least one of the internal or external areas of the identified area, the cooking device (100) can identify the area as a contaminated area (S860). For example, the cooking device (100) can determine objects having different result values ​​from the food to be contaminated based on the object's size, location, temperature, rotation, etc.

[0133] Next, the cooking device (100) can identify whether the location of the contaminant is on the camera, the turntable, or the inner wall based on at least one of whether the contaminant area identified in the plurality of frames rotates and whether the temperature changes (S870).

[0134] Next, the cooking device (100) can provide guide information on the location of the identified contaminant.

[0135] Meanwhile, in Fig. 8, the order is mapped for all steps for convenience of explanation, but it is of course not necessarily limited to the order of steps that are not related to the order or can be performed in parallel.

[0136] FIG. 9 is a diagram illustrating a method for detecting contaminants according to one or more embodiments.

[0137] According to one embodiment, the cooking device (100) can identify whether a contaminant has occurred through image labeling when representative temperature information for each area is identified in the current frame.

[0138] For example, according to FIG. 9, the cooking device (100) can identify objects (911, 912) larger than a certain size as food and objects (913, 914, 915) smaller than a certain size as contaminants through image labeling in the thermal image frame (910). Image labeling refers to a method of grouping pixels having the same temperature pixel value as the surroundings in the image and assigning numbers to each group. For example, the CCL (Connected Component Labeling) method can be used, but is not necessarily limited thereto.

[0139] Meanwhile, in the above-described embodiment, a method for identifying whether a contaminant has occurred based on representative temperatures using multiple frames has been described, but it is of course possible to determine whether a contaminant has occurred through image labeling based on temperature information for each area included in a single frame.

[0140] FIGS. 10A and 10B are drawings illustrating a method for detecting contaminants according to one or more embodiments.

[0141] According to one embodiment, the cooking device (100) can identify whether a contaminant has occurred through image labeling when representative temperature information for each area is identified in the current frame.

[0142] For example, according to FIG. 10a, the cooking device (100) can identify objects (1011, 1012) larger than a certain size as food through image labeling in a thermal image frame (1010), and can identify objects (1013) smaller than a certain size as contaminants.

[0143] However, as illustrated in FIG. 9, the contaminants (913, 914, 915) may be positioned separately from the main dishes (911, 912), but as illustrated in FIG. 10a, the contaminants (1013) may also be positioned overlapping the main dishes (1011, 1012). For example, the cooking device (100) may determine a contaminant if a specific region in the main dishes (1011, 1012) has a higher temperature. In this case, since the contaminant (1013) may affect the calculation of the representative temperature of the corresponding dish (1012), the contaminant (1013) may be excluded from the RoI (Region of Interest) as illustrated in FIG. 10b to calculate the representative temperature of the corresponding dish (1012).

[0144] FIGS. 11A and 11B are drawings illustrating a method for detecting contaminants according to one or more embodiments.

[0145] According to one embodiment, the cooking device (100) can identify the location of the contaminant among the camera, the turntable, or the inner wall based on at least one of whether the identified contaminant area rotates and whether the temperature changes, and can provide guide information on the identified contaminant location. For example, the cooking device (100) can identify the location of the contaminant based on a plurality of thermal image frames acquired according to the rotation of the turntable. For example, the cooking device (100) can identify the location of the contaminant by determining whether the contaminant rotates (turntable method) and whether it is heated (flatbed method).

[0146] For example, according to FIG. 11a, the cooking device (100) can identify objects (1111, 1112) larger than a certain size as food through image labeling in the first thermal image frame (1010), and can identify objects (1113, 1114, 1115) smaller than a certain size as contaminants.

[0147] According to FIG. 11b, the cooking device (100) can identify that the first contaminant (1113) is not heated and is in the same position without rotation in the second thermal image frame (1020). In this case, the cooking device (100) can identify that the first contaminant (1113) is a contaminant located in the thermal image camera (110).

[0148] According to FIG. 11b, the cooking device (100) can identify in the second thermal image frame (1020) that the second contaminant (1114) is not heated and is rotated in position. In this case, the cooking device (100) can identify that the second contaminant (1114) is a background contaminant in a rotatable position, for example, a contaminant on a turntable.

[0149] According to FIG. 11b, in the second thermal image frame (1020), the third contaminant (1115) can be identified as being heated and having the same location without rotation. In this case, the cooking device (100) can identify the third contaminant (1115) as a background contaminant in a non-rotatable location, for example, a contaminant on a heatable inner wall surface.

[0150] Meanwhile, according to one embodiment, the cooking device (100) may provide different guidance to the user depending on whether the contaminant is identified before or during cooking. For example, if the contaminant is identified before cooking, the cooking device (100) may guide the user to start cooking after removing the contaminant. If the contaminant is identified during cooking, the cooking device may forcibly terminate cooking or provide the user with corresponding guidance if the risk is determined to be high based on whether splatter occurs, the size of the contaminated area, etc.

[0151] According to one embodiment, when the cleaning mode is initiated, the cooking device (100) can identify the presence and location of contaminants within the cooking chamber and guide the user on at least one of the contaminant locations and cleaning methods. For example, the cooking device (100) can guide the user to heat a cup of water after inserting it, and provide further guidance depending on whether the contaminant has been removed. For example, if the cooking device (100) determines that the appliance is malfunctioning, it can guide the user on the relevant information and prompt them to make a service reservation.

[0152] According to the various embodiments described above, despite the uneven cooking characteristics of microwave ovens, a representative temperature value for food can be intelligently set, offering users a choice to customize their cooking experience. Furthermore, a microwave oven contaminant guide can help maintain internal cleanliness, and service reservations can be easily made in the event of a malfunction.

[0153] Meanwhile, the methods according to the various embodiments of the present disclosure described above can be implemented only with a software upgrade or a hardware upgrade for an existing cooking device.

[0154] Additionally, the various embodiments of the present disclosure described above can also be performed through an embedded server provided in the cooking device or an external server of the cooking device.

[0155] Meanwhile, according to a temporary example of the present disclosure, the various embodiments described above can be implemented as software including commands stored in a machine-readable storage medium that can be read by a machine (e.g., a computer). The machine is a device that can call commands stored from the storage medium and operate according to the called commands, and may include a cooking device (e.g., cooking device (A)) according to the disclosed embodiments. When a command is executed by a processor, the processor can perform a function corresponding to the command directly or by using other components under the control of the processor. The command may include code generated or executed by a compiler or interpreter. The machine-readable storage medium may be provided in the form of a non-transitory storage medium. Here, 'non-transitory' means that the storage medium does not contain a signal and is tangible, but does not distinguish between data being stored semi-permanently or temporarily in the storage medium.

[0156] Furthermore, according to one embodiment of the present disclosure, the method according to the various embodiments described above may be provided as included in a computer program product. The computer program product may be traded as a product between a seller and a buyer. The computer program product may be distributed in the form of a machine-readable storage medium (e.g., compact disc read-only memory (CD-ROM)) or online through an application store (e.g., Play Store™). In the case of online distribution, at least a portion of the computer program product may be temporarily stored or temporarily generated in a storage medium, such as the memory of a manufacturer's server, an application store's server, or a relay server.

[0157] In addition, each of the components (e.g., modules or programs) according to the various embodiments described above may be composed of a single or multiple entities, and some of the corresponding sub-components described above may be omitted, or other sub-components may be further included in various embodiments. Alternatively or additionally, some components (e.g., modules or programs) may be integrated into a single entity, which may perform the same or similar functions as those performed by each of the corresponding components prior to integration. Operations performed by modules, programs or other components according to various embodiments may be executed sequentially, in parallel, iteratively or heuristically, or at least some operations may be executed in a different order, omitted, or other operations may be added.

[0158] Although the preferred embodiments of the present disclosure have been illustrated and described above, the present disclosure is not limited to the specific embodiments described above, and various modifications may be made by a person having ordinary skill in the art to which the present disclosure pertains without departing from the gist of the present disclosure as claimed in the claims, and such modifications should not be understood individually from the technical idea or prospect of the present disclosure.

Claims

1. In a cooking device that cooks food using electromagnetic waves, thermographic camera; A memory storing one or more instructions; and comprising one or more processors; The one or more processors, by executing the one or more instructions, A thermal image of a turn table on which food is placed is obtained using the thermal imaging camera, Segmenting at least one area included in each of the plurality of frames included in the thermal image into multiple areas, Correcting the positions of the plurality of areas in each of the plurality of frames based on the rotation angle of the turntable corresponding to the time at which each of the plurality of frames was acquired, Identifying an area in the current frame based on temperature information of a plurality of areas whose positions are corrected in the plurality of frames, A cooking device that identifies representative temperature information of the food by applying weights to temperature information of the identified area in the current frame.

2. In paragraph 1, The one or more processors, by executing the one or more instructions, A cooking device that identifies representative temperature information of the food based on temperature information and weight information for each region included in the identified region when the region is identified in the current frame.

3. In paragraph 1, The one or more processors, by executing the one or more instructions, When each of the above plurality of frames is segmented into a plurality of regions, a first indicator is assigned to a region among the plurality of regions whose temperature value is greater than or equal to a threshold value, and a second indicator is assigned to a region among the plurality of regions whose temperature value is less than or equal to the threshold value. A cooking device, wherein when the positions of the plurality of areas in the plurality of frames are corrected based on the rotation angles of the turntable, the first indicator or the second indicator corresponding to the plurality of areas whose positions are corrected in the plurality of frames is combined to identify the one area in the current frame.

4. In paragraph 1, The one or more processors, by executing the one or more instructions, When each of the above multiple frames is segmented into multiple regions, a value of "1" is assigned to a region among the multiple regions whose temperature value is greater than or equal to a threshold value, and a value of "0" is assigned to a region among the multiple regions whose temperature value is less than or equal to the threshold value. A cooking device, wherein when the positions of the plurality of areas in the plurality of frames are corrected based on the rotation angles of the turntable, a “1” value or a “0” value corresponding to the plurality of areas whose positions are corrected in the plurality of frames is added, and the one area is identified in the current frame based on the added value corresponding to each of the plurality of areas.

5. In paragraph 4, The one or more processors, by executing the one or more instructions, When the above-described area is identified in the above-described current frame, the area-specific weight is identified based on the sum of the multiple areas included in the above-described area, A cooking device that identifies representative temperature information of the food by applying different weights to temperature information by region in the current frame.

6. In paragraph 1, The one or more processors, by executing the one or more instructions, Identifying the rotation angle of the turn table based on the time interval at which the plurality of frames are acquired and the rotation speed of the turn table, A cooking device that corrects the positions of the plurality of areas by rotating the plurality of frames based on the rotation angle of the turntable corresponding to each of the plurality of frames.

7. In paragraph 1, The one or more processors, by executing the one or more instructions, A cooking device that inputs the plurality of frames and the rotation angle information of the turn table corresponding to the plurality of frames into a learned artificial intelligence model to obtain at least one of weight information or temperature information of the one area.

8. In paragraph 1, The one or more processors, by executing the one or more instructions, Identify the representative temperature of the food based on the cooking type set according to the user command and the temperature of each area identified in the current frame, and identify whether the representative temperature of the food reaches the target temperature. A cooking device that ends cooking when it is identified that the representative temperature of the food has reached the target temperature.

9. In paragraph 1, The one or more processors, by executing the one or more instructions, When the representative temperature information of the above food is identified, if an area less than a critical size having a difference between the representative temperature information and a critical temperature is identified in at least one of the inside area or the outside area of ​​the identified area, the area is identified as a contaminated area, A cooking device providing guidance information for the above-mentioned identified contaminant areas.

10. In paragraph 1, The one or more processors, by executing the one or more instructions, Identifying whether the location of the contaminant is in the camera, the turntable or the wall of the high-temperature area based on at least one of whether the identified contaminant area rotates or changes in temperature in the plurality of frames, A cooking device providing guidance information for the location of the above-mentioned contaminants.

11. A method for controlling a cooking device that cooks food using electromagnetic waves, A step of obtaining a thermal image of a turn table on which food is placed using a thermal imaging camera; A step of segmenting at least one area included in each of a plurality of frames included in the thermal image into a plurality of areas; A step of correcting the positions of the plurality of areas in each of the plurality of frames based on the rotation angle of the turntable corresponding to the time at which each of the plurality of frames was acquired; A step of identifying an area in a current frame based on temperature information of a plurality of areas whose positions are corrected in the plurality of frames; and A control method comprising: a step of identifying representative temperature information of the food by applying a weight to temperature information of the identified area in the current frame; 12. In paragraph 11, The step of identifying the representative temperature information of the above food is: A control method, comprising: a step of identifying representative temperature information of the food based on temperature information and weight information for each region included in the identified region when the region is identified in the current frame.

13. In paragraph 11, The step of identifying an area in the current frame among the above multiple frames is: When each of the plurality of frames is segmented into a plurality of regions, a step of assigning a first indicator to a region among the plurality of regions whose temperature value is greater than or equal to a threshold value and assigning a second indicator to a region among the plurality of regions whose temperature value is less than or equal to the threshold value; and A control method comprising: a step of identifying an area in the current frame by combining the first indicator or the second indicator corresponding to the area whose positions are corrected in the plurality of frames based on the rotation angles of the turntable; 14. In paragraph 11, The step of identifying an area in the current frame among the above multiple frames is: When each of the plurality of frames is segmented into a plurality of regions, a step of assigning a value of "1" to a region among the plurality of regions whose temperature value is greater than or equal to a threshold value and assigning a value of "0" to a region among the plurality of regions whose temperature value is less than or equal to the threshold value; and A control method comprising: a step of adding up a "1" value or a "0" value corresponding to a plurality of regions whose positions are corrected in the plurality of frames based on a rotation angle of the turntable, and identifying a region in the current frame based on the sum value corresponding to each of the plurality of regions; 15. A non-transitory computer-readable medium storing computer commands that, when executed by a processor of a cooking device that cooks food using electromagnetic waves, cause the cooking device to perform an operation, The above actions are, A step of obtaining a thermal image of a turn table on which food is placed using a thermal imaging camera; A step of segmenting at least one area included in each of a plurality of frames included in the thermal image into a plurality of areas; A step of correcting the positions of the plurality of areas in each of the plurality of frames based on the rotation angle of the turntable corresponding to the time at which each of the plurality of frames was acquired; A step of identifying an area in a current frame based on temperature information of a plurality of areas whose positions are corrected in the plurality of frames; and A non-transitory computer-readable medium, comprising: a step of identifying representative temperature information of the food by applying a weight to temperature information of the identified area in the current frame;

Images