Cooking equipment and control method thereof

Abstract

The cooking apparatus includes: a case; a cooking chamber formed inside the case; a camera for acquiring an image of an interior of the cooking chamber through a transparent member formed in an upper wall of the case; the camera cooling fan is used for blowing air to the camera; a motor for rotating the camera cooling fan; and a control unit electrically connected to the camera and the motor. The control unit operates the camera to acquire a first image of an interior of the cooking chamber, recognizes foreign matter-related information on a lens or a transparent member of the camera from the first image, and controls an operation for controlling an operation of the motor based on a determination that there is a foreign matter at least partially blocking the lens or the transparent member such that a cleaning mode is performed, in the cleaning mode, the camera cooling fan is rotated at a first rotational speed for a first rotational time.

Description

Technical Field

[0001] The present disclosure relates to a cooking apparatus including a camera configured to image the interior of a cooking chamber and a control method thereof. Background Art

[0002] Generally, a cooking device includes a cooking chamber and a heating device configured to heat the cooking chamber to cook food. The cooking device may include an oven using an electric heater or gas as the heating device and a microwave oven using a magnetron configured to generate microwaves as the heating device.

[0003] The cooking device can be equipped with a camera to image the interior of the cooking chamber. The type, state, etc. of the food can be identified using the installed camera, and the cooking device can be controlled accordingly.

[0004] The interior of the cooking chamber may be heated to a high temperature, and the camera may be susceptible to the heat. Therefore, a structure for properly cooling the camera is required to prevent the camera from being damaged or malfunctioning due to the high temperature heat. Summary of the invention

[0005] Technical issues

[0006] The present disclosure provides a cooking apparatus including a structure in which a camera is disposed above a cooking chamber to clearly image the inside of the cooking chamber, the structure being capable of cooling the camera to prevent a temperature increase of the camera caused by heat generated in the cooking chamber.

[0007] The present disclosure also provides a cooking apparatus capable of preventing foreign matter such as water and oil from entering through a suction duct for cooling a camera.

[0008] The present disclosure also provides a cooking apparatus including a cooling structure at a lower portion of a cooking chamber capable of effectively cooling a camera.

[0009] The present disclosure also provides a cooking apparatus including an electronics compartment cooling structure for cooling an entire electronics compartment formed outside a cooking compartment and a camera cooling structure for centrally cooling a camera.

[0010] The present disclosure also provides a cooking apparatus capable of effectively cooling electronic components such as a circuit board disposed in an electronic compartment.

[0011] The present disclosure also provides a cooking device capable of preventing an air flow for cooling a camera from interfering with an air flow for cooling an entire electronic compartment.

[0012] The present disclosure also provides a cooking apparatus capable of increasing a viewing angle of a camera by installing the camera as maximally close to a transparent member of a cooking chamber.

[0013] The present disclosure also provides a cooking apparatus and a control method thereof that can recognize foreign matter such as dust attached around a camera and remove the foreign matter.

[0014] The technical problems to be solved herein are not limited to those mentioned above, and other technical problems not mentioned will be apparent to those of ordinary skill in the art from the following description.

[0015] Technical Solution

[0016] According to an embodiment of the present disclosure, a cooking device may include: a shell; a cooking chamber formed inside the shell; a camera configured to acquire an image of the interior of the cooking chamber, the camera having a lens; a transparent member disposed in front of the lens of the camera so that the camera acquires an image of the interior of the cooking chamber through the transparent member; a camera cooling fan configured to blow air toward the camera; a motor configured to rotate the camera cooling fan; and a controller electrically connected to the camera and the motor.

[0017] The controller can also be configured to: operate the camera to acquire a first image of the interior of the cooking chamber; identify foreign matter-related information of the lens or transparent member of the camera based on the acquired first image; and control the operation of the motor to execute a cleaning mode based on determining that there is foreign matter to at least partially block the lens or transparent member, in which the camera cooling fan rotates at a first rotation speed for a first rotation time.

[0018] According to another embodiment of the present disclosure, a cooking device may include: a shell; a cooking chamber formed inside the shell; a door configured to open or close the cooking chamber; a door sensor configured to detect the opening or closing of the door; a camera configured to acquire an image of the interior of the cooking chamber; a camera cooling fan configured to blow air toward the camera; a motor configured to rotate the camera cooling fan; and a controller configured to be electrically connected to the door sensor and the motor.

[0019] The controller may be configured to control operation of the motor to rotate the camera cooling fan based on detection of opening of the door or closing of the door by the sensor.

[0020] According to another embodiment of the present disclosure, a control method of a cooking device may include: operating a camera to acquire a first image of the interior of a cooking chamber; identifying foreign matter-related information of a lens of a camera or a transparent component of a cooking chamber based on the first image by using a learning model acquired from a memory or a server; determining whether there is foreign matter to at least partially block the lens of the camera or a transparent component disposed in front of the lens of the camera; and based on determining the presence of foreign matter, controlling the operation of a motor to execute a cleaning mode, in which a camera cooling fan rotates at a first rotation speed for a first rotation time to remove the foreign matter. BRIEF DESCRIPTION OF THE DRAWINGS

[0021] Figure 1 is a diagram showing the appearance of a cooking device according to an embodiment of the present disclosure;

[0022] Figure 2 is an exploded view showing a housing of a cooking device according to an embodiment of the present disclosure;

[0023] Figure 3 is a longitudinal cross-sectional view of a cooking device according to an embodiment of the present disclosure;

[0024] Figure 4 is a cross-sectional view showing a front upper portion of a cooking device according to an embodiment of the present disclosure;

[0025] Figure 5 is a diagram showing a state in which an upper plate of a cooking apparatus according to an embodiment of the present disclosure is removed;

[0026] Figure 6 is an exploded view showing the major components of a camera cooling duct according to an embodiment of the present disclosure;

[0027] Figure 7 is a diagram showing an electronic compartment cooling fan and an electronic compartment cooling duct according to an embodiment of the present disclosure;

[0028] Figure 8 is a diagram showing a housing of a camera cooling duct according to an embodiment of the present disclosure;

[0029] Fig. 9 is an exploded view of a housing showing a camera cooling duct according to an embodiment of the present disclosure;

[0030] Fig.10 is a perspective view showing a lower surface of an upper shell of a shell according to an embodiment of the present disclosure;

[0031] Fig.11 is a perspective view showing a lower surface of a lower case of a case according to an embodiment of the present disclosure;

[0032] Fig.12 is a cross-sectional view showing the vicinity of a camera of a cooking apparatus according to an embodiment of the present disclosure, specifically, a cross-sectional view taken along a front-rear direction of a main body;

[0033] Fig.13 is a cross-sectional view showing the vicinity of a camera of a cooking apparatus according to an embodiment of the present disclosure, specifically, a cross-sectional view taken along the left-right direction of a main body;

[0034] Fig.14 is a control block diagram of a cooking device, a server, and a user device according to an embodiment of the present disclosure;

[0035] Fig.15is a control block diagram of a cooking device according to an embodiment of the present disclosure;

[0036] Fig.16 is a flowchart illustrating a control method of a cooking device according to an embodiment of the present disclosure;

[0037] Fig.17 is an example of a first image acquired by a camera according to an embodiment of the present disclosure;

[0038] Fig.18 is an example of a first image acquired by a camera according to an embodiment of the present disclosure.

[0039] Fig.19 is an example of a first image acquired by a camera according to an embodiment of the present disclosure;

[0040] Fig. 20 is a flow chart showing steps for acquiring a clean cooking chamber image according to an embodiment of the present disclosure;

[0041] Fig.21 is a flow chart illustrating the interaction between a cooking device and a server according to an embodiment of the present disclosure;

[0042] Fig. 22 is a flow chart illustrating the interaction between a cooking device and a server according to an embodiment of the present disclosure;

[0043] Fig.23 is a diagram showing a state in which foreign matter-related information is displayed on a display according to an embodiment of the present disclosure;

[0044] Fig.24 is a diagram showing a state in which foreign object related information is displayed on a user device according to an embodiment of the present disclosure;

[0045] Fig.25 is a flow chart illustrating the interaction between a cooking apparatus, a server, and a user device according to an embodiment of the present disclosure;

[0046] Fig.26 is a flow chart illustrating the interaction between a cooking apparatus, a server, and a user device according to an embodiment of the present disclosure;

[0047] Fig. 27 is a diagram showing a state in which information recommending pyrolytic cleaning is displayed on a display according to an embodiment of the present disclosure;

[0048] Fig.28 is a diagram showing a state in which information recommending pyrolytic cleaning is displayed on a user device according to an embodiment of the present disclosure; and

[0049] Fig.29is a flowchart illustrating a method of controlling a cooking apparatus according to an embodiment of the present disclosure. DETAILED DESCRIPTION

[0050] The various embodiments and the terms used therein are not intended to limit the technology disclosed herein to a specific form, and the present disclosure should be construed as including various modifications, equivalents, and / or substitutes of the corresponding embodiments.

[0051] In describing the drawings, like reference numerals may be used to denote like constituent elements.

[0052] A singular expression may include a plural expression unless they are clearly different in context.

[0053] The expressions "A or B", "at least one of A or / and B", or "one or more of A or / and B", "A, B or C", "at least one of A, B or / and C" or "one or more of A, B or / and C" etc. used in this document may include any and all combinations of one or more of the relevant listed items.

[0054] The term "and / or" includes plural combinations of related items among a plurality of related items or any one item among a plurality of related items.

[0055] Herein, expressions “a first,” “a second,” “the first,” “the second,” etc. may be used simply to distinguish an element from other elements, but do not limit other aspects (importance or order) of the elements.

[0056] When an element (e.g., a first element) is referred to as being "(functionally or communicatively) coupled" or "connected" to another element (e.g., a second element), the first element may be connected to the second element directly (e.g., by wire), wirelessly, or through a third element.

[0057] In the present disclosure, the terms “including”, “having” and the like are used to specify features, quantities, steps, operations, components, elements or a combination thereof, but do not exclude the existence or addition of one or more features, quantities, steps, operations, components, elements or a combination thereof.

[0058] When an element is referred to as being “connected,” “coupled,” “supported” or “in contact with” another element, this includes not only the case where the elements are directly connected, coupled, supported or in contact with each other, but also the case where the elements are indirectly connected, coupled, supported or in contact with each other via a third element.

[0059] Throughout the description, when an element is 'on' another element, this includes not only a case where the element is in contact with another element but also a case where other elements are present between the two elements.

[0060] Reference will now be made in detail to embodiments of the present disclosure, examples of which are illustrated in the accompanying drawings.

[0061] Figure 1 is a diagram showing an appearance of a cooking apparatus according to an embodiment of the present disclosure. Figure 2 is an exploded view showing a housing of a cooking apparatus according to an embodiment of the present disclosure. Figure 3 is a longitudinal cross-sectional view of a cooking apparatus according to an embodiment of the present disclosure. Figure 4 is a cross-sectional view illustrating a front upper portion of a cooking apparatus according to an embodiment of the present disclosure.

[0062] like Figures 1 to 4 As shown in FIG. 1 , the cooking apparatus 1 may include a body 10 having an inner case 11 , a cooking chamber 40 formed inside the inner case 11 , and an electronic compartment 50 formed outside the inner case 11 .

[0063] The inner housing 11 may define a cooking chamber 40 and an electronic compartment 50. The inner housing 11 may have a substantially box shape. The inner housing 11 may include an upper wall 12, a lower wall 13, a left wall 14, a right wall 15, and a rear wall 16.

[0064] The cooking chamber 40 may cook food at a high temperature. The cooking chamber 40 may be formed in such a manner that the front side is opened to put in and take out food. The heating devices 5 and 8 may be provided in the cooking chamber 40 to heat the cooking chamber 40. The heating devices 5 and 8 may include an electric heater including a heating element and configured to generate heat when power is supplied. However, the heating devices 5 and 8 are not limited thereto and may include a gas burner configured to generate heat using gas or a magnetron configured to generate microwaves.

[0065] The heating devices 5 and 8 may include an upper heating device 5 and a fan heating device 8. The upper heating device 5 may be disposed in an upper portion of the cooking chamber 40 to heat the food from an upper side of the food. The fan heating device 8 may be disposed around a convection fan 6 configured to allow convection of air within the cooking chamber 40.

[0066] According to an embodiment, the cooking apparatus 1 may include at least one of the upper heating device 5 and the fan heating device 8. In addition, the cooking apparatus 1 may further include a lower heating device disposed in a lower portion of the cooking chamber 40.

[0067] A convection fan 6 for convection of air inside the cooking chamber 40 may be provided in the cooking chamber 40. The convection fan 6 may be provided at the rear of the cooking chamber 40. The convection fan 6 may be covered and protected by a fan cover 9. The fan cover 9 may be coupled to the rear wall 16 of the inner case 11. A through hole may be formed in the fan cover 9 to allow air to flow. The convection fan 6 may be driven by a convection fan motor 7. The convection fan motor 7 may be supported on a support plate 29 provided between the rear wall 16 of the inner case 11 and the rear plate 25 of the outer case.

[0068] A rack 190 on which food to be cooked is placed may be provided in the cooking chamber 40 .

[0069] Various electronic components such as the circuit board 3 configured to control the operation of the cooking device 1 may be arranged in the electronic compartment 50. According to an embodiment, a steam generator (not shown) configured to generate steam may be provided in the electronic compartment 50. According to an embodiment, an automatic opening and closing device (not shown) configured to automatically open and close the door 2 may be provided in the electronic compartment 50.

[0070] The electronic compartment 50 may be formed to surround the cooking chamber 40. The electronic compartment 50 may be insulated between the cooking chamber 40 and the outer shell of the main body 10 to prevent the heat in the cooking chamber 40 from being discharged to the outside of the main body 10 as it is. Air may flow in the electronic compartment 50 for insulation. A separate insulating material (not shown) may be provided in the electronic compartment 50 to surround the inner shell 11 for insulation. The insulating material may be formed of glass fiber, asbestos, etc.

[0071] The body 10 may include an outer shell forming the exterior of the cooking device 1. The inner shell 11 may be accommodated inside the outer shell. The electronic compartment 50 may be formed between the inner shell 11 and the outer shell. The outer shell may include an upper plate 21, a lower plate 2, a left plate 23, a right plate 24, a rear plate 25, and a front plate 26. A through hole 19 through which air flows into the electronic compartment 50 may be formed in the left plate 23, the right plate 24, the rear plate 25, etc. According to an embodiment, the through hole 19 may also be formed in the upper plate 21 or the lower plate 22.

[0072] The cooking device 1 may include a control panel 27. The control panel 27 may include a display configured to display various operation information of the cooking device 1 and an input device through which a user may input an operation command. The input device may include a touch panel. The input device may include a button or a knob.

[0073] The control panel 27 may be disposed on the upper front portion of the cooking device 1. The control panel 27 may be mounted on a panel bracket 28 coupled to the main body 10. The control panel 27 may be mounted on the front surface of the panel bracket 28. The panel bracket 28 may include a bracket opening 28a to allow at least a portion of the rear surface of the control panel 27 to be cooled by the electronic compartment cooling fan 60. The bottom member 28b of the panel bracket 28 may be located in front of the electronic compartment duct 70 at a height corresponding to the upper surface of the electronic compartment duct 70. The bottom member 28b of the panel bracket 28 may guide the air discharged toward the front of the main body 10 through the discharge port 72 of the electronic compartment duct 70.

[0074] The cooking apparatus 1 may include a door 2 provided on the front surface of the body 10 to open and close the cooking chamber 40. The door 2 may be rotatably provided on the front surface of the body 10. The door 2 may be provided to open and close while rotating in an up-and-down direction relative to a lower end.

[0075] A locking device 4 configured to lock the door 2 while the door 2 is closed may be provided in the electronic compartment 50 .

[0076] The cooking device 1 may include a base plate 30 disposed in the electronic compartment 50 to allow installation of various components of the electronic compartment 50. The base plate 30 may be disposed above the inner shell 11 to be spaced apart from the inner shell 11 by a predetermined distance. An insulating material (not shown) may be provided, or an air insulation layer may be formed between the base plate 30 and the upper wall 12 of the inner shell 11.

[0077] The electronic compartment duct 70 may be coupled to the upper surface of the base plate 30. The electronic compartment duct 70 may divide the electronic compartment 50 into an electronic component space 51 and an exhaust space 52. The exhaust space 52 may be formed between the electronic compartment duct 70 and the base plate 30. The base plate 30 may include a board opening 31 formed to allow the camera 80 to image the cooking chamber 40. The board opening 31 may be formed at a position corresponding to the transparent member 17 provided on the upper wall 12 of the inner shell 11.

[0078] The electronic compartment duct 70 may include a suction port 71 through which air is sucked from the electronic component space 51 to the exhaust space 52. The electronic compartment duct 70 may include a discharge port 72 configured to discharge the air in the exhaust space 52 to the outside of the electronic compartment duct 70. The air in the electronic compartment 50 may be discharged to the outside of the main body 10 through the electronic compartment duct 70. The discharge port 72 may be formed in front of the electronic compartment duct 70. Therefore, the air in the electronic compartment 50 may be discharged to the front of the main body 10.

[0079] The electronics compartment duct 70 may include a housing duct opening 73 through which the housing 110 of the camera cooling duct 100 passes, and an illumination duct opening 74 through which the illumination device 160 passes.

[0080] The cooking device 1 may include an electronics compartment cooling fan 60 configured to cool the electronics compartment 50. The electronics compartment cooling fan 60 may be driven by an electronics compartment cooling fan motor 61. The electronics compartment cooling fan motor 61 may be mounted on a motor mount 75 coupled to the electronics compartment duct 70. The electronics compartment cooling fan 60 may cool the electronics compartment 50 by moving air within the electronics compartment 50.

[0081] The electronic compartment cooling fan 60 may be disposed in the electronic compartment 50. The electronic compartment cooling fan 60 may be disposed adjacent to the suction port 71 of the electronic compartment duct 70. The electronic compartment cooling fan 60 may include a centrifugal fan configured to suck air in an axial direction and discharge air in a radial direction.

[0082] The electronic compartment cooling fan 60 can draw air from the outside of the body 10 into the electronic compartment 50 through the through holes 19 formed in the left plate 23, the right plate 24 and the rear plate 25. The electronic compartment cooling fan 60 can cool the entire electronic compartment 50 by forming an air flow throughout the electronic compartment 50.

[0083] When the electronic compartment cooling fan 60 operates, air outside the main body 10 may be sucked into the electronic compartment space 51 of the electronic compartment 50, and the air in the electronic compartment space 51 may be sucked into the exhaust space 52 formed by the electronic compartment duct 70. The air in the exhaust space 52 may be discharged toward the front of the main body 10.

[0084] The cooking device 1 may include a camera 80 configured to image the interior of the cooking chamber 40. The camera 80 may be disposed in the electronic compartment 50. The camera 80 may image the interior of the cooking chamber 40 through the upper wall 12 of the inner housing 11. To this end, the upper wall 12 of the inner housing 11 may include a transparent member 17 through which the camera 80 looks. The camera 80 may be disposed above the transparent member 17 and may image the interior of the cooking chamber 40 through the transparent member 17.

[0085] The cooking apparatus 1 may include an illumination device 160 to brightly illuminate the cooking chamber 40 when the camera 80 images the cooking chamber 40. The illumination device 160 may be disposed in front of the camera 80. The illumination device 160 may be installed to penetrate the electronic compartment duct 70 and the base plate 30. The illumination device 160 may include a light source such as a light emitting diode (LED) and a light guide plate disposed to guide light emitted from the light source.

[0086] The cooking device 1 may include a camera cooling fan 90 (see Figure 8 ), the camera cooling fan 90 is configured to cool the camera 80 centrally.

[0087] The cooking apparatus 1 may include a camera cooling duct 100 configured to allow air outside the body 10 to be sucked in to cool the camera 80 and discharged to the electronic component space 51 of the electronic compartment 50 when the camera cooling fan 90 is driven.

[0088] Figure 5 is a diagram illustrating a state in which an upper plate of the cooking apparatus according to an embodiment of the present disclosure is removed. Figure 6 is an exploded view showing the major components of a camera cooling duct according to an embodiment of the present disclosure. Figure 7 is a diagram illustrating an electronic compartment cooling fan and an electronic compartment cooling duct according to an embodiment of the present disclosure. Figure 8 is a diagram showing a housing of a camera cooling duct according to an embodiment of the present disclosure. Fig. 9 is an exploded view of a housing showing a camera cooling duct according to an embodiment of the present disclosure. Fig.10 is a perspective view showing a lower surface of an upper case of a case according to an embodiment of the present disclosure. Fig.11 is a perspective view showing a lower surface of a lower case of a case according to an embodiment of the present disclosure. Fig.12 is a cross-sectional view showing the vicinity of a camera of the cooking apparatus according to an embodiment of the present disclosure, specifically, a cross-sectional view taken along a front-rear direction of a main body. Fig.13 is a cross-sectional view showing the vicinity of a camera of the cooking apparatus according to an embodiment of the present disclosure, and specifically, a cross-sectional view taken along the left-right direction of the main body.

[0089] like Figures 5 to 13 As shown in , the camera cooling duct 100 may include a housing 110, a suction duct 130 coupled to one side of the housing 110, and a discharge duct 140 coupled to the other side of the housing 110. According to an embodiment, the housing 110, the suction duct 130, and the discharge duct 140 may be formed separately and assembled to each other. According to an embodiment, the housing 110, the suction duct 130, and the discharge duct 140 may be formed integrally with each other.

[0090] The housing 110 may include a camera receiving space 124 configured to accommodate the camera 80 and a cooling fan receiving space 114 configured to accommodate the camera cooling fan 90. The suction duct 130 may be coupled to the housing 110 to suction air outside the main body 10 and guide the air to the camera receiving space 124. The exhaust duct 140 may be coupled to the housing 110 to exhaust air from the camera receiving space 124 of the housing 110 to the electronic component space 51 of the electronic compartment 50.

[0091] However, according to an embodiment, the exhaust duct 140 may be omitted. In this case, the air in the camera receiving space 124 of the housing 110 may be directly exhausted from the housing 110 to the electronic component space 51 .

[0092] The housing 110 may be coupled to the upper surface of the electronic compartment duct 70. An inlet 115 through which air flows into the housing 110 and an outlet 116 through which air flows out from the interior of the housing 110 may be formed on the upper surface of the housing 110. An outlet 137 (see FIG. 1 ) of the suction duct 130 may be formed on the upper surface of the housing 110. Fig.14 ) can be connected to the inlet 115. The inlet 144 of the discharge conduit 140 (see Fig.15 ) can be connected to outlet 116.

[0093] The housing 110 may be formed by combining an upper housing 111 and a lower housing 121. The upper housing 111 may include an upper housing base 112, and the lower housing 121 may include a lower housing base 122 coupled to the upper housing base 112. A coupling protrusion 121b of the lower housing base 122 may be inserted into the upper housing base 112 to allow the upper housing 111 and the lower housing 121 to be coupled to each other. However, the coupling method is not limited thereto, and the upper housing 111 and the lower housing 121 may be coupled to each other by various other coupling methods.

[0094] However, unlike the embodiment, the housing 110 may be integrally formed.

[0095] The above-mentioned inlet 115 and outlet 116 may be formed in the upper housing 111. The upper housing 111 may include a cooling fan receiving member 113, which protrudes upward from the upper housing base 112 to form a cooling fan receiving space 114. The cooling fan receiving space 114 may be formed in the cooling fan receiving member 113. That is, the cooling fan receiving member 113 may be formed to surround the cooling fan receiving space 114.

[0096] The camera cooling fan 90, the camera cooling fan motor 91 configured to drive the camera cooling fan 90, and the fan housing 92 in which the camera cooling fan 90 is installed can be accommodated in the cooling fan receiving space 114. The camera cooling fan 90 may include a centrifugal fan configured to suck air in an axial direction and discharge air in a radial direction. The cooling fan receiving space 114 may be located below the inlet 115.

[0097] The suction duct 130 may be coupled to the upper housing 111. To this end, a suction duct coupler 111a may be formed in the upper housing 111. The discharge duct 140 may be coupled to the upper housing 111. To this end, a discharge duct coupler 111b may be formed in the upper housing 111.

[0098] The lower housing 121 may include a camera receiving member 123 that protrudes downward from the lower housing base 122 to form a camera receiving space 124. The camera receiving member 123 may pass through the housing duct opening 73 of the electronic compartment duct 70. The camera receiving member 123 may pass through the housing duct opening 73 of the electronic compartment duct 70 and be disposed in the exhaust space 52 within the electronic compartment duct 70.

[0099] The camera receiving space 124 may be formed inside the camera receiving member 123. That is, the camera receiving member 123 may be formed to surround the camera receiving space 124.

[0100] The lower housing base 122 may be located on the upper surface of the electronic compartment duct 70, and the camera receiving member 123 may protrude downward toward the exhaust space 52 of the electronic compartment duct 70. Therefore, the camera receiving space 124 formed in the camera receiving member 123 may be located at a height corresponding to the exhaust space 52. The camera receiving space 124 may be located below the outlet 116.

[0101] The camera 80 may be coupled to the lower case 121 to be disposed in the camera receiving space 124. The camera 80 may be coupled to the lower case base 122. To this end, a coupling hole 121a may be formed in the lower case base 122.

[0102] The camera 80 may include a camera substrate 82 including an image sensor, a lens barrel 83 extending downward from the camera substrate 82 and having a cylindrical shape, a lens 85 disposed at an end of the lens barrel 83 , and a camera bracket 81 configured to mount the camera 80 to the housing 110 .

[0103] The camera bracket 81 may be coupled to the lower housing 121. The camera bracket 81 may include a camera coupler 81a protruding laterally toward the lower housing base 122 and a camera coupling hole 82b formed in the camera coupler 81a. The camera coupling hole 82b of the camera 80 and the coupling hole 121a of the lower housing base 122 may be coupled by a separate fastening member such as a screw, a pin, a bolt, or a rivet.

[0104] The camera receiving space 124 may be located downstream of the cooling fan receiving space 114 in the direction of air flow. That is, the air introduced into the housing 110 through the inlet 115 may flow into the camera receiving space 124 via the cooling fan receiving space 114. The air introduced into the camera receiving space 124 may cool the camera 80 and exit through the outlet 116.

[0105] A connection flow path 118 configured to guide air of the cooling fan receiving space 114 to the camera receiving space 124 may be formed in the upper housing 111 .

[0106] The camera receiving space 124 and the cooling fan receiving space 114 may be spaced apart from each other horizontally and vertically. That is, the cooling fan receiving space 114 may be disposed above the camera receiving space 124. As described above, the camera receiving space 124 may be formed at a height corresponding to the exhaust space 52, and the cooling fan receiving space 114 may be formed at a position higher than the exhaust space 52.

[0107] The camera receiving space 124 and the cooling fan receiving space 114 may be arranged along the left and right direction of the body 10. In this embodiment, the camera receiving space 124 may be provided on the left side of the cooling fan receiving space 114, but according to an embodiment, the camera receiving space 124 may be provided on the right side of the cooling fan receiving space 114.

[0108] Since the camera receiving space 124 and the cooling fan receiving space 114 are horizontally and vertically spaced apart from each other, the connection flow path 118 connecting the camera receiving space 124 and the cooling fan receiving space 114 may be formed to be inclined. The upper housing 111 may include an inclined surface 117 to allow the connection flow path 118 to be inclined therein.

[0109] The lower housing 121 may include an upper opening 125 formed in an upper portion of the camera receiving space 124. Air may flow into the camera receiving space 124 through the upper opening 125, and air may flow out of the camera receiving space 124 through the upper opening 125. That is, the camera receiving space 124 may include an upper suction and discharge structure.

[0110] The upper housing 111 may include a guide rib 119 configured to divide the upper opening 125 into an area 125a (see Fig.13 ) and another region 125b (see Fig.13 The guide rib 119 may protrude downward from the upper inner surface of the upper case 111 toward the upper opening 125 . The guide rib 119 may be formed between the connection flow path 118 and the upper opening 125 .

[0111] Through the guide ribs 119 , air in the cooling fan receiving space 114 may be introduced into the camera receiving space 124 through a region 125 a of the upper opening 125 , and air in the camera receiving space 124 may flow out of the camera receiving space 124 through another region 125 b of the upper opening 125 .

[0112] In addition, the guide ribs 119 may guide the air introduced into the camera receiving space 124 to the lower side of the camera 80. That is, the air introduced into the camera receiving space 124 may be guided to the lateral side or lower side of the camera 80 by the guide ribs 119, and thus the camera 80 may be uniformly cooled as a whole. Alternatively, the camera 80 may be sequentially cooled from the bottom to the top, that is, sequentially cooled in the direction from the lens 85 to the camera substrate 82.

[0113] As described above, the lower portion of the camera 80 , which is close to the cooking chamber 40 and thus receives the most heat, may be cooled first, and thus the cooling efficiency of the camera 80 may be improved.

[0114] The lower housing 121 may include a lower opening 126 formed in a lower portion of the camera receiving space 124. The lower opening 126 may be formed in a lower portion of the camera receiving member 123. The camera 80 accommodated in the camera receiving space 124 may image the interior of the cooking chamber 40 through the lower opening 126.

[0115] The lower opening 126 may be open to allow air flow. That is, a blocking member such as glass may not be provided in the lower opening 126. Because a blocking member such as glass is not provided in the lower opening 126, the camera 80 may be installed closer to the cooking chamber 40. According to this embodiment, the lens 85 of the camera 80 may be provided at a height corresponding to the lower opening 126. According to an embodiment, the lens 85 of the camera 80 may be provided below the lower opening 126. In addition, according to an embodiment, a blocking member (not shown) may be provided in the lower opening 126 to block the lower opening 126. The blocking member may be formed of a transparent material.

[0116] A lower cooling flow path 129 may be formed between the lower opening 126 and a transparent member 17 provided on the upper wall 12 of the inner case 11 .

[0117] The air sucked from the outside of the body 10 by the camera cooling fan 90 can be supplied to the upper surface of the transparent member 17 through the lower cooling flow path 129, and thus the transparent member 17 can be cooled. Therefore, it is possible to obtain an effect of blocking the heat that would be transmitted from the transparent member 17 to the camera 80. In addition, the lens 85 at the bottom of the camera 80 can be more effectively cooled by the airflow that descends to the transparent member 17 and then rises again.

[0118] Furthermore, foreign matter attached to the surface of the lens 85 can be effectively removed from the lens 85 by the U-shaped airflow descending and ascending around the lens 85 .

[0119] The transparent member 17 may include at least one glass 18 installed in the opening of the upper wall 12. The at least one glass may be formed of heat-resistant tempered glass or borosilicate glass. An air insulation layer may be formed between the at least one glass. However, the transparent member 17 may be formed of a transparent and heat-resistant material other than glass.

[0120] The cooking apparatus 1 may include a sealing member 150, which is provided to seal the lower cooling flow path 129 to prevent the air in the lower cooling flow path 129 from leaking into the electronic compartment 50. When the air of the camera cooling duct 100 leaks into the exhaust space 52 of the electronic compartment 50 through the lower cooling flow path 129, a pressure loss may occur in the camera cooling duct 100, and the air may block the air flow discharged to the outside of the main body 10 through the exhaust space 52. That is, when the airflow through the camera cooling fan 90 and the camera cooling duct 100 is not separated from the airflow through the electronic compartment cooling fan 60 and the electronic compartment duct 70, the respective cooling efficiencies may be reduced.

[0121] The sealing member 150 may seal the lower cooling flow path 129 to prevent the air in the lower cooling flow path 129 from leaking into the electronic compartment 50. The sealing member 150 may be formed of an elastic material such as rubber, and may be adhered between the lower surface of the housing 110 and the upper surface of the upper wall 12. In particular, the upper surface of the sealing member 150 may be in close contact with the lower surface of the camera receiving member 123 of the housing 110, and the lower surface of the sealing member 150 may be in close contact with the upper surface of the glass 18 forming the upper wall 12 or the transparent member 17.

[0122] The sealing member 150 may have a ring shape including a hollow portion 151, and the camera 80 may image the inside of the cooking chamber 40 through the hollow portion 151. The sealing member 150 may be installed in the opening 31 of the base plate 30.

[0123] The suction duct 130 may be coupled to the housing 110 to suck air from outside the body 10 and guide the air to the housing 110. The suction duct 130 may suck air from outside the body 10 at a relatively lower temperature than that of the electronic compartment 50.

[0124] Therefore, the camera 80 can be cooled more effectively than other electronic components. The suction duct 130 can suck external air from the rear of the main body 10. To this end, the suction duct 130 can be coupled to the rear plate 25 forming the rear surface of the main body 10. The external air inlet 25a (see Fig.16) may be formed in the rear plate 25 to allow the air outside the body 10 to be sucked in. The external air inlet 25a may be formed to be more recessed than the periphery of the external air inlet 25a to allow the external air to be effectively sucked in. The external air inlet 25a may be formed to be recessed by 3 mm or more than the periphery of the external air inlet 25a.

[0125] As described above, since the suction duct 130 sucks air from the rear of the main body 10 , foreign matter such as water or oil may be prevented from entering the camera 80 or the camera cooling fan 90 .

[0126] The exhaust duct 140 may be connected to the housing 110 to exhaust air for cooling the camera 80 from the housing 110. The exhaust duct 140 may exhaust air into the electronic component space 51 of the electronic compartment 50. When the exhaust duct 140 exhausts air into the electronic component space 51, the air exhausted from the exhaust duct 140 may not collide or merge with the air exhausted to the front side along the exhaust space 52 of the electronic compartment duct 70 by the blowing force of the electronic compartment cooling fan 60. Therefore, a reduction in the cooling efficiency of the electronic compartment performed by the electronic compartment cooling fan 60 and the electronic compartment duct 70 may be prevented.

[0127] In particular, the exhaust duct 140 can exhaust air toward the circuit board 3 provided in the electronic component space 51. The circuit board 3 is an electronic component that is relatively susceptible to heat. As described above, since the air flowing through the camera cooling fan 90 is directly sucked from the outside of the main body 10, the air can have a relatively lower temperature than the air flowing through the electronic compartment cooling fan 60. Since the low-temperature air moved by the camera cooling fan 90 is supplied toward the circuit board 3, the circuit board 3 that is susceptible to heat can be effectively cooled.

[0128] However, according to an embodiment, the exhaust duct 140 may be omitted from the camera cooling duct 100. When the exhaust duct 140 is omitted, air may be exhausted into the electronic component space 51 through the outlet 116 of the housing 110.

[0129] Fig.14 is a control block diagram of a cooking apparatus, a server, and a user device according to an embodiment of the present disclosure.

[0130] like Fig.14 As shown in FIG. 2 , the communication system according to the embodiment may include the cooking apparatus 1 and the server 270. The communication system according to the embodiment may further include a user device 280.

[0131] The server 270 may include a communication circuit 274 configured to communicate with other servers, the cooking device 1, or the user device 280. The server 270 may include a controller 271. The controller 271 may include at least one processor 272 configured to process data received from other servers, the cooking device 1, or the user device 280, and at least one memory 273 configured to store a program for processing data or processed data.

[0132] The server 270 may be implemented with various computing devices such as a workstation, a cloud, a data drive, and a data station. The server 270 may be implemented as one or more servers physically or logically divided based on functions, detailed configurations of functions, or data. The server 270 may transmit and receive data through communication between each server, and may process the transmitted and received data.

[0133] The server 270 may perform functions such as managing a user account, registering the cooking device 1 by linking the cooking device 1 to the user account, and managing or controlling the registered cooking device 1. For example, a user may access the server 270 through the user device 280 and create a user account. The user account may be identified by an identification (ID) and a password set by the user. The server 270 may register the cooking device 1 in the user account according to a predetermined procedure. For example, the server 270 may register, manage, and control the cooking device 1 by connecting the identification information (e.g., a serial number or a MAC address) of the cooking device 1 to the user account.

[0134] The user device 280 may include a communication device 284 configured to communicate with the cooking device 1 or the server 270 and a user interface configured to receive user input or configured to output information to the user. The user interface may include an inputter 285 and an outputter 286. The user device 280 may include a controller 281. The controller 281 may include at least one processor 282 configured to control the operation of the user device 280 and at least one memory 283 configured to store a program for controlling the operation of the user device 280.

[0135] The user device 280 may be carried by the user or placed in the user's home or office. The user device 280 may include a personal computer, a terminal, a portable phone, a smart phone, a handheld device, a wearable device, etc., but is not limited thereto.

[0136] A program (ie, application) for controlling the cooking apparatus 1 may be stored in the memory 283 of the user device 280. The application may be sold in a state of being installed on the user device 280, or may be downloaded and installed from an external server.

[0137] The user may access the server 270 and create a user account by executing an application installed on the user device 280 , and the user may register the cooking apparatus 1 by communicating with the server 270 based on the logged-in user account.

[0138] For example, when the user manipulates the cooking device 1 according to steps guided by an application installed on the user device 280 to allow the cooking device 1 to access the server 270, the cooking device 1 can be registered to the user account by registering the identification (e.g., serial number or MAC address) of the cooking device 1 to the corresponding user account in the server 270.

[0139] The user may control the cooking device 1 using the application installed on the user device 280. For example, when the user logs in to the user account using the application installed on the user device 280, the cooking device 1 registered in the user account may appear, and when a control command for the cooking device 1 is input, the control command may be transmitted to the cooking device 1 through the server 270.

[0140] A network may include both a wired network and a wireless network. A wired network may include a cable network or a telephone network, and a wireless network may include any network that transmits and receives signals via radio waves. A wired network and a wireless network may be connected to each other.

[0141] The network may include a wide area network (WAN) such as the Internet, a local area network (LAN) formed around an access point (AP), and / or a short-range wireless network that does not pass through an access point (AP). Short-range wireless networks may include Bluetooth TM (IEEE802.15.1), Zigbee (IEEE 802.15.4), Wi-Fi Direct, Near Field Communication (NFC), Z-wave, etc., but not limited to these.

[0142] The access point (AP) may connect the cooking apparatus 1 or the user device 280 to a wide area network (WAN) to which the server 270 is connected. The cooking apparatus 1 or the user device 280 may be connected to the server 270 through the wide area network (WAN).

[0143] Access points (APs) can be connected through Wi-Fi TM (IEEE 802.11), Bluetooth TM The cooking apparatus 1 or the user device 280 may be communicated with by wireless communication of (IEEE 802.15.1) and Zigbee (IEEE 802.15.4), and a wide area network (WAN) may be accessed by wired communication, but is not limited thereto.

[0144] According to various embodiments, the cooking apparatus 1 may be directly connected to the user device 280 or the server 270 without passing through an access point (AP).

[0145] The cooking apparatus 1 may be connected to the user device 280 or the server 270 through a long-range wireless network or a short-range wireless network.

[0146] For example, the cooking apparatus 1 may be connected to the user device 280 via a short-range wireless network (eg, Wi-Fi Direct).

[0147] As another example, the cooking apparatus 1 may be connected to the user device 280 or the server 270 through a wide area network (WAN) using a long-range wireless network (eg, a cellular communication module).

[0148] As another example, the cooking apparatus 1 may access a wide area network (WAN) using wired communication, and be connected to the user device 280 or the server 270 through the wide area network (WAN).

[0149] When the cooking device 1 is allowed to access a wide area network (WAN) using wired communication, the cooking device 1 may also operate as an access point. Therefore, the cooking device 1 may connect other home appliances to the wide area network (WAN) to which the server 270 is connected. In addition, other home appliances may connect the cooking device 1 to the wide area network (WAN) to which the server 270 is connected.

[0150] The cooking device 1 may transmit information related to operation or status to other home appliances, the user device 280, or the server 270 through the network. For example, when a request is received from the server 270, or when a specific event occurs in the cooking device 1, the cooking device 1 may transmit information related to operation or status to other home appliances, the user device 280, or the server 270. In addition, the cooking device 1 may transmit information related to operation or status to other home appliances, the user device 280, or the server 270 periodically or in real time. When the server 270 receives information related to the operation or status of the cooking device 1, the server 270 may update the stored information related to the operation or status of the cooking device 1, and transmit the updated information related to the operation or status of the cooking device 1 to the user device 280 through the network. Updating information may include various operations for changing existing information, such as adding new information to existing information and replacing existing information with new information.

[0151] The cooking device 1 may acquire various information from other home appliances, the user device 280 or the server 270, and provide the acquired information to the user. For example, the cooking device 1 may acquire information related to the function of the cooking device 1 (e.g., recipes) and various environmental information (e.g., weather, temperature, humidity, etc.) from the server 270, and output the acquired information through the user interface.

[0152] The cooking device 1 may operate according to a control command received from another home appliance, the user device 280, or the server 270. For example, when the cooking device 1 obtains previous permission from the user to operate according to a control command of the server 270 (even without user input), the cooking device 1 may operate according to the control command received from the server 270. The control command received from the server 270 may include a control command input by the user through the user device 280 or a control command based on a preset condition, but is not limited thereto.

[0153] The user device 280 may transmit information about the user to the cooking apparatus 1 or the server 270 through the communication module. For example, the user device 280 may transmit information about the user's location, the user's health condition, the user's taste, and the user's schedule to the server 270. The user device 280 may transmit information about the user to the server 270 according to the user's previous permission.

[0154] The cooking device 1, the user device 280, or the server 270 may determine the control command using a technique such as artificial intelligence. For example, the server 270 may receive information related to the operation or state of the cooking device 1 or information related to the user of the user device 280, process the received information using a technique such as artificial intelligence, and transmit the processing result or the control command to the cooking device 1 or the user device 280 based on the processing result.

[0155] Fig.15 is a control block diagram of a cooking device according to an embodiment of the present disclosure.

[0156] like Fig.15 As shown in, the cooking device 1 may include user interfaces 200, 240 and 250, a temperature sensor 210, a door opening and closing sensor 220, a camera 80, as well as heating devices 5 and 8, a lighting device 160, a convection fan 6, a convection fan motor 7, an electronic compartment cooling fan 60, an electronic compartment cooling fan motor 61, a camera cooling fan 90, a camera cooling fan motor 91, a communication device 234 and a controller 231.

[0157] The user interface may include an inputter 200 configured to obtain a user input and a display 240 configured to display various types of information related to the operation and status of the cooking apparatus 1. The user interface may also include a speaker 250.

[0158] The inputter 200 and the display 240 may be provided in various positions of the main body 10. For example, the inputter 200 and the display 240 may be provided on the upper front surface of the main body 10. The inputter 200 and the display 240 may be provided on the control panel 27 provided on the upper front surface of the main body 10.

[0159] The input device 200 may acquire user input. The user input may include various commands. The input device 200 may transmit an electrical signal (voltage or current) corresponding to the user input to the controller 231.

[0160] The input 200 may include various buttons and / or dials. For example, the input 200 may include: a power button 201 configured to receive a command for turning on or off the power; a start / stop button 202 configured to receive a command for starting or stopping cooking; a menu button 203 configured to receive a command for selecting a cooking process; a temperature button 204 configured to receive a command for adjusting a heating level of a heater; a time button 205 configured to receive a command for adjusting a cooking time; and a camera cooling fan button 206 configured to receive a command for operating the camera cooling fan 90. The various buttons may be set as physical buttons or touch buttons.

[0161] The display 240 may display information related to the state and operation of the cooking device 1. The display 240 may display information input by a user or information provided to a user on various screens. The display 240 may display information related to the operation of the cooking device 1 as at least one of an image and text. In addition, the display 240 may display a graphical user interface (GUI) for controlling the cooking device 1. That is, the display 240 may display a user interface element (UI) such as an icon.

[0162] The display 240 may be provided with various types of display panels. For example, the display 240 may include a liquid crystal display panel (LCD panel), a light emitting diode panel (LED panel), an organic light emitting diode panel (OLED panel), or a micro LED panel. The display 240 may also be used as an input device by including a touch screen.

[0163] The temperature sensor 210 may detect the temperature in the cooking chamber 40. The temperature sensor 210 may be installed in various positions in the cooking chamber 40. The temperature sensor 210 may transmit an electrical signal corresponding to the detected temperature to the controller 231. The controller 231 may control at least one of the heating devices 5 and 8 and the convection fan 6 to allow the temperature in the cooking chamber 40 to be maintained at a cooking temperature determined according to the type, amount, size and / or cooking process of the food.

[0164] The door opening and closing sensor 220 can detect whether the door 2 is in an open state or a closed state. The door opening and closing sensor 220 can transmit an electric signal to the controller 231 according to the state of the door 2.

[0165] The heating devices 5 and 8 may supply heat to the inside of the cooking chamber 40. Food may be cooked by the heat generated by the heating devices 5 and 8. The heating level and heating time of the heating devices 5 and 8 may be adjusted by the controller 231. The output and heating time of the heating devices 5 and 8 may be adjusted differently according to the type, quantity and / or size of food. That is, the operation of the heating devices 5 and 8 may be controlled differently according to the cooking process.

[0166] The lighting device 160 may emit light into the cooking chamber 40. The interior of the cooking chamber 40 may be brightened by the light emitted from the lighting device 160. The controller 231 may control the lighting device 160 to emit light when the cooking apparatus 1 is powered on. The controller 231 may control the lighting device 160 to emit light until cooking is completed or until the power of the cooking apparatus 1 is turned off.

[0167] The convection fan 6 may circulate air within the cooking chamber 40. The convection fan 6 may be driven by a convection fan motor 7. The convection fan motor 7 may be electrically connected to the controller 231.

[0168] The electronics compartment cooling fan 60 may circulate air within the electronics compartment 50. The electronics compartment fan 60 may be driven by an electronics compartment fan motor 61. The electronics compartment fan motor 61 may be electrically connected to the controller 231.

[0169] The camera 80 may acquire an image of the interior of the cooking chamber 40. Food-related information such as the type, quantity, size, and cooking status of the food disposed inside the cooking chamber 40 may be identified based on the image acquired by the camera 80. The controller 231 may perform cooking based on the food-related information. In addition, the image acquired by the camera 80 may be displayed on the display 240 or transmitted to the user device 280 to allow the user to check the status of the interior of the cooking chamber 40 without opening the door 2.

[0170] The camera cooling fan 90 may blow air toward the camera 80 to cool the camera 80. Meanwhile, when the camera cooling fan 90 rotates and the air flows around the camera 80, foreign matters such as dust attached to the lens 85 and the transparent member 17 of the camera 80 may be removed. That is, when the camera cooling fan 90 operates, the camera 80 may be cooled, and at the same time, foreign matters attached to the lens 85 or the transparent member 17 of the camera 80 may be removed.

[0171] The camera cooling fan 90 may be operated mainly for cooling the camera 80 or mainly for removing foreign matter attached to the lens 85 or the transparent member 17 of the camera 80 .

[0172] The camera cooling fan 90 mainly operates to cool the camera 80 may refer to the camera cooling fan 90 performing a cooling mode, and the camera cooling fan 90 mainly operates to remove foreign matter attached to the lens 85 or the transparent member 17 of the camera 80 may refer to the camera cooling fan 90 performing a cleaning mode.

[0173] The cooling mode may be performed during cooking when the internal temperature of the cooking chamber 40 is high. Conversely, the cleaning mode may be performed when cooking is not being performed. For example, the cleaning mode may be performed before identifying food using the camera 80 to select a cooking process. This is because in order to accurately identify food with the camera 80, it is appropriate to remove foreign matter attached to the lens 85 of the camera 80 or the transparent member 17. The cleaning mode may be performed based on determining that foreign matter is present in the lens 85 of the camera 80 or the transparent member 17.

[0174] Alternatively, the cleaning mode may be periodically performed regardless of whether foreign matter is present in the lens 85 of the camera 80 or the transparent member 17 .

[0175] The controller 231 may be electrically connected to the components of the cooking apparatus 1 and control the components of the cooking apparatus 1. The controller 231 may control the operation of the cooking apparatus 1 by processing a command received through at least one of the inputter 200 and the user device 280.

[0176] The controller 231 may include a processor 232 and a memory 233. The processor 232 is hardware and may include a logic circuit and an operation circuit. The processor 232 may control the electrically connected components of the cooking device 1 by using a program, instruction and / or data for the operation of the cooking device 1 stored in the memory 233. The controller 231 may be implemented as a control circuit including circuit elements such as capacitors, inductors and resistance elements. The processor 232 and the memory 233 may be implemented as separate chips or a single chip. In addition, the controller 231 may include multiple processors and multiple memories.

[0177] The memory 233 may store programs, applications and / or data for the operation of the cooking device 1, and may store data generated by the processor 232. The memory 233 may include non-volatile memory such as a read-only memory (ROM) and a flash memory for long-term storage of data. The memory 233 may include volatile memory such as a static random access memory (S-RAM) and a dynamic random access memory (D-RAM) for temporary storage of data.

[0178] The controller 231 may recognize food included in the image acquired by the camera 80. The controller 231 may recognize food from the image by using a learning model acquired from the storage 233 or the server 270.

[0179] The controller 231 may identify foreign matter other than food from the image acquired by the camera 80. Based on the image acquired by the camera 80, the controller 231 may identify foreign matter attached to the lens 85 of the camera 80 or to the transparent member 17 located below the lens 85.

[0180] When foreign matter such as dust is attached to the lens 85 or the transparent member 17 of the camera 80, the camera 80 may not acquire a normal image inside the cooking chamber 40. Therefore, when foreign matter exists, it is necessary to remove the foreign matter to allow the camera 80 to perform normal functions.

[0181] The controller 231 may operate the camera 80 to acquire an image of the interior of the cooking chamber 40. Based on the image acquired by the camera 80, the controller 231 may identify information related to foreign matter present in the lens 85 or the transparent member 17 of the camera 80. The controller 231 may control the camera cooling fan motor 91 to perform a cleaning mode in which the camera cooling fan 90 rotates based on the foreign matter-related information.

[0182] The foreign matter-related information may include at least one of the presence or absence of foreign matter, the number of foreign matter, or a ratio of an area occupied by foreign matter to the entire area of ​​an image acquired by the camera 80 .

[0183] The controller 231 may identify foreign matter related information from the image using a learning model acquired from the storage 233 or the server 270. When the image acquired by the camera 80 is input to the learning model, the learning model may output whether there are foreign matter, the number of foreign matter, and the ratio of the area occupied by the foreign matter.

[0184] The learning model may refer to an artificial intelligence model. The learning model may be created by machine learning and / or deep learning. The learning model may be generated by the server 270 and may be stored in the memory 220 of the cooking device 1. The learning algorithm may include supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, and is not limited thereto.

[0185] The learning model may include multiple artificial neural network layers. The artificial neural network may include a deep neural network (DNN), a convolutional neural network (CNN), a recurrent neural network (RNN), a restricted Boltzmann machine (RBM), a deep belief network (DBN), a bidirectional recurrent deep neural network (BRDNN) and / or a deep Q network, but is not limited thereto. In addition to the hardware structure, the artificial intelligence model may additionally or alternatively include a software structure.

[0186] The learning model can identify foreign matter-related information based on the focus information of the image. Foreign matter attached to the lens 85 of the camera 80 or the transparent member 17 may be out of focus compared to the food, and thus the learning model can identify foreign matter-related information based on the focus information of the image acquired by the camera 80. The focus information of the image may include information such as the distance between the object and the lens 85, depth, and pixel dispersion.

[0187] In addition, the learning model 231 can identify foreign matter-related information included in the target image based on the result of comparing the clean cooking chamber image with the target image. The clean cooking chamber image can be an image of the cooking chamber 40 imaged in a clean state where food is not set inside the cooking chamber 40 and foreign matter does not exist inside the cooking chamber 40.

[0188] The clean cooking chamber image may be stored in the server 270. The controller 231 may transmit an image of the interior of the cooking chamber 40 acquired by the camera 80 when the cooking apparatus 1 starts to be used for the first time to the server 270 through the communication device 234. The server 270 may compare the transmitted image with the clean cooking chamber image stored in the server 270, thereby updating the clean cooking chamber image.

[0189] The communication device 234 may perform connection with at least one of the user device 280 or the server 270 through a network. For example, the communication device 234 may receive a remote control signal from the user device 280. The controller 231 may acquire various information and / or data from the server 270 through the communication device 234. The controller 231 may acquire a learning model from the server 270 through the communication device 234.

[0190] The communication device 234 may include various communication modules. The communication device 234 may include a wireless communication module and / or a wired communication module. Wireless local area network (LAN), home radio frequency (RF), infrared communication, ultra-wideband (UWB) communication, Wi-Fi, Bluetooth, Zigbee, etc. may be applied as wireless communication technologies.

[0191] The cooking device 1 may further include an infrared sensor 290 configured to detect whether a foreign object is attached to the camera 80. The infrared sensor 290 may detect a physical quantity or a chemical quantity such as temperature, pressure, or radiation intensity using infrared rays, and convert the detected physical quantity or chemical quantity into an electrical signal. The infrared sensor 290 may be disposed adjacent to the camera 80 and emit infrared rays toward the camera 80. The infrared sensor 290 may include a light emitter configured to generate infrared rays and a light receiver configured to detect infrared rays. The infrared sensor 290 may transmit an electrical signal corresponding to the detected information to the controller 231. The controller 231 may control the camera cooling fan motor 91 to allow the camera cooling fan 90 to perform a cleaning mode based on the information detected by the infrared sensor 290.

[0192] The components of the cooking apparatus 1 are not limited to those described above. The cooking apparatus 1 may include various components in addition to the above components, and some of the above components may be omitted.

[0193] Fig.16 is a flowchart illustrating a control method of a cooking apparatus according to an embodiment of the present disclosure. Fig.17 is an example of a first image acquired by a camera according to an embodiment of the present disclosure. Fig.18 is an example of a first image acquired by a camera according to an embodiment of the present disclosure. Fig.19 is an example of a first image acquired by a camera according to an embodiment of the present disclosure.

[0194] like Figures 16 to 19 As shown in FIG. 3 , the controller 231 may operate the camera 80 to acquire a first image (301) of the interior of the cooking chamber 40. The controller 231 may acquire the first image by periodically operating the camera 80. For example, the controller 231 may operate the camera 80 based on whether the door 2 is opened or closed.

[0195] The controller 231 may recognize foreign matter related information (301, 302, and 305) of the lens 85 of the camera 80 or the transparent member 17 from the first image. The controller 231 may recognize foreign matter related information from the first image by using a learning model.

[0196] The foreign matter related information may include at least one of the presence or absence of the foreign matter, the number of the foreign matter, or a ratio of an area occupied by the foreign matter to the entire area of ​​the first image. Identifying the foreign matter related information may include determining whether the foreign matter exists.

[0197] Based on the foreign matter related information, the controller 231 may control the operation of the camera cooling fan motor 91 to allow the camera cooling fan 90 to perform a cleaning mode.

[0198] Based on the foreign matter related information, the controller 231 may control the operation of the camera cooling fan motor 91 to perform a cleaning mode in which the camera cooling fan 90 rotates at a first rotation speed for a first rotation time.

[0199] The controller 231 may determine a first rotation speed and a first rotation time based on the foreign matter related information ( 303 , 306 , and 308 ).

[0200] For example, the controller 231 may determine the first rotation speed as a rotation speed corresponding to a pulse width modulation (PWM) of 60% (302 and 303) in response to the number of foreign objects F included in the first image I1 being less than 2 and in response to the ratio of the area occupied by the foreign objects to the entire area of ​​the first image being 0% to 5%.

[0201] The controller 231 may determine the first rotation speed as a rotation speed corresponding to PWM80% in response to the number of foreign objects F included in the first image I2 being less than 3 and in response to a ratio of an area occupied by the foreign objects to the entire area of ​​the first image being 5% to 10% (305 and 306).

[0202] The controller 231 may determine the first rotation speed as a rotation speed corresponding to PWM 100% in response to the number of foreign objects F included in the first image I3 not satisfying the conditions of the above operations 302 and 305, and in response to the ratio of the area occupied by the foreign objects to the entire area of ​​the first image not satisfying the conditions of the above operations 302 and 305 (308).

[0203] By differently controlling the speed of the camera cooling fan 90 according to foreign matter-related information, unnecessary energy consumption and noise generation can be reduced, and foreign matter can be removed more effectively.

[0204] After executing the cleaning mode, the controller 231 may determine whether foreign substances attached to the lens 85 of the camera 80 or the transparent member 17 are removed ( 304 , 307 , and 309 ).

[0205] The controller 231 may operate the camera 80 to acquire a second image of the interior of the cooking chamber 40 to determine whether the foreign matter is removed.

[0206] The controller 231 may identify foreign matter-related information of the lens 85 of the camera 80 or the transparent member 17 from the second image acquired by the camera 80. The controller 231 may identify the foreign matter-related information by using a learning model.

[0207] Based on the foreign matter related information recognized from the second image, the controller 231 may determine whether the foreign matter is removed by executing the cleaning mode ( 304 , 307 , and 309 ).

[0208] The controller 231 may control the operation of the motor 91 to additionally perform the cleaning mode based on determining that the foreign matter is not removed by the cleaning mode.

[0209] The controller 231 may determine a second rotation speed and a second rotation time of the camera cooling fan 90 in the additional cleaning mode. The controller 231 may determine the second rotation speed to be faster than the first rotation speed. The controller 231 may determine the second rotation time to be the same as or different from the first rotation time.

[0210] As described above, the controller 231 may determine whether the foreign matter is removed after executing the cleaning mode, and when the foreign matter is not removed, the controller 231 may increase the rotation speed of the camera cooling fan 90 to repeatedly execute the cleaning mode several times. After executing the last cleaning mode in which the rotation speed of the camera cooling fan 90 is maximized, the cleaning mode may no longer be executed.

[0211] Fig. 20 is a flow chart illustrating steps for acquiring a clean cooking chamber image according to an embodiment of the present disclosure.

[0212] As described above, the clean cooking chamber image may be an image of the cooking chamber 40 acquired in a clean state where food is not set in the cooking chamber 40 and foreign matter is not present in the cooking chamber 40 , and the clean cooking chamber image may be stored in the server 270 .

[0213] like Fig. 20 As shown in , the cooking device 1 and the server 270 may be connected via the communication means 234 ( 401 ).

[0214] When the cooking apparatus 1 and the server 270 are connected, the controller 231 may receive a clean cooking chamber image from the server 270 .

[0215] The controller 231 may determine whether the interior of the cooking chamber 40 is empty by comparing the clean cooking chamber image received from the server 270 with an image acquired through the camera 80 ( 402 ).

[0216] The controller 231 may display a message guiding emptying of the cooking chamber on the display 240 or the user device 280 based on determining that the inside of the cooking chamber 40 is not empty.

[0217] The controller 231 may operate the camera 80 based on determining that the interior of the cooking chamber 40 is empty, and may transmit the image acquired by the camera 80 to the server 270 (404). The server 270 may update the clean cooking chamber image by comparing the received image with the clean cooking chamber image stored in the server 270.

[0218] Fig.21is a flow chart illustrating the interaction between a cooking device and a server according to an embodiment of the present disclosure.

[0219] refer to Fig.21 , the cooking device 1 may acquire a learning model for identifying foreign matter related information from the server 270 ( 501 ). The learning model transmitted from the server 270 may be stored in the memory 233 of the cooking device 1 .

[0220] The cooking apparatus 1 may acquire a first image of the interior of the cooking chamber 40 using the camera 80 ( 502 ).

[0221] The cooking device 1 may identify foreign matter related information in the first image by using the learning model ( 503 ). Identifying foreign matter related information may include determining whether there is foreign matter to at least partially block the lens 85 or the transparent member 17 .

[0222] The cooking apparatus 1 may perform a cleaning mode based on the determination that the foreign matter exists to remove the foreign matter from blocking the lens 85 or the transparent member 17 (504).

[0223] After executing the cleaning mode, the cooking apparatus 1 may acquire a second image of the interior of the cooking chamber 40 using the camera 80 (505).

[0224] Based on the second image, the cooking apparatus 1 may determine whether foreign matter is removed by executing the cleaning mode.

[0225] Furthermore, based on the second image, the cooking apparatus 1 may determine whether at least one foreign object is moved by the cleaning mode (506). By comparing the first image before the cleaning mode with the second image after the cleaning mode, the cooking apparatus 1 may determine whether the foreign object is moved by the cleaning mode.

[0226] The cooking device 1 may determine that there is an error in foreign object recognition based on determining that the foreign object has not moved, and may generate foreign object recognition error information (507). That is, the cooking device 1 may determine that the recognized foreign object is not a foreign object attached to the lens 85 of the camera 80 or the transparent member 17, but the cooking device 1 may determine that the recognized foreign object is a foreign object inside the cooking chamber 40 or food to be cooked.

[0227] The cooking device 1 may transmit foreign object recognition error information to the server 270 (508).

[0228] The server 270 may update the learning model using the received foreign object recognition error information ( 509 ).

[0229] Fig. 22 is a flow chart illustrating the interaction between a cooking device and a server according to an embodiment of the present disclosure.

[0230] refer to Fig. 22 , the cooking apparatus 1 may acquire a first image of the interior of the cooking chamber 40 using the camera 80 ( 601 ).

[0231] The cooking apparatus 1 may transmit the first image to the server 270 ( 602 ).

[0232] The server 270 may identify foreign matter related information from the first image by using a learning model (603). Identifying foreign matter related information may include determining whether there is foreign matter to at least partially block the lens 85 or the transparent member 17.

[0233] The server 270 may transmit the identified foreign object related information to the cooking device 1 (604).

[0234] Based on the determination that foreign matter exists, the cooking apparatus 1 may perform a cleaning mode to remove the foreign matter from blocking the lens 85 or the transparent member 17 (605).

[0235] After executing the cleaning mode, the cooking apparatus 1 may acquire a second image of the interior of the cooking chamber 40 using the camera 80 ( 606 ).

[0236] Based on the second image, the cooking apparatus 1 may determine whether foreign matter is removed by executing the cleaning mode.

[0237] Furthermore, based on the second image, the cooking apparatus 1 may determine whether at least one foreign object is moved by the cleaning mode (607). The cooking apparatus 1 may determine whether the foreign object is moved by the cleaning mode by comparing the first image before the cleaning mode with the second image after the cleaning mode.

[0238] The cooking device 1 may determine that there is an error in foreign object recognition based on determining that the foreign object has not moved, and may generate foreign object recognition error information (608). That is, the cooking device 1 may determine that the recognized foreign object is not a foreign object attached to the lens 85 of the camera 80 or the transparent member 17, but the cooking device 1 may determine that the recognized foreign object is a foreign object inside the cooking chamber 40 or food to be cooked.

[0239] The cooking device 1 may transmit foreign object recognition error information to the server 270 (609).

[0240] The server 270 may update the learning model using the received foreign object recognition error information ( 610 ).

[0241] Fig.23 is a diagram illustrating a state in which foreign matter-related information is displayed on a display according to an embodiment of the present disclosure. Fig.24 is a diagram illustrating a state in which foreign object-related information is displayed on a user device according to an embodiment of the present disclosure. Fig.25is a flow chart illustrating the interaction between a cooking apparatus, a server, and a user device according to an embodiment of the present disclosure. Fig.26 is a flow chart illustrating the interaction between a cooking apparatus, a server, and a user device according to an embodiment of the present disclosure.

[0242] The cooking apparatus 1 may control the operation of the camera cooling fan motor 91 based on the user input acquired through the inputter 200 to perform the cleaning mode.

[0243] refer to Fig.25 , the cooking device 1 may acquire a learning model for identifying foreign matter related information from the server 270 ( 701 ). The learning model transmitted from the server 270 may be stored in the memory 233 of the cooking device 1 .

[0244] The cooking apparatus 1 may acquire a first image of the interior of the cooking chamber 40 using the camera 80 ( 702 ).

[0245] The cooking device 1 may identify foreign matter related information from the first image by using a learning model (703). Identifying foreign matter related information may include determining whether there is foreign matter to at least partially block the lens 85 or the transparent member 17. The cooking device 1 may determine whether there is foreign matter in the lens 85 or the transparent member 17 of the camera 80 based on the first image.

[0246] The cooking device 1 may display foreign matter related information on the display 240 (705). Fig.23 As shown in , the display 240 may display a message such as “There is a foreign object in the camera. The foreign object may be removed by operating the camera fan.”

[0247] The cooking device 1 may obtain user input (706) through the input device 200. The input device 200 may include a camera cooling fan button 206 configured to receive a command for operating the camera cooling fan 90. The input device 200 may also include a wind speed control button 207 configured to adjust the rotation speed of the camera cooling fan 90.

[0248] The cooking apparatus 1 may execute a cleaning mode based on a user input through the inputter 200 ( 710 ).

[0249] The cooking apparatus 1 may transmit foreign object related information to the user device 280 ( 704 ).

[0250] User device 280 may display foreign object related information (707). For example, Fig.24 As shown in , a message EM1 such as “There is a foreign object in the camera. The foreign object can be removed by operating the camera fan” may be displayed on the user device 280 .

[0251] The user device 280 may acquire a user input (708). The user device 280 may display an interface element EM2 for receiving a user command for operating the camera cooling fan 90. In addition, the user device 280 may display an interface element EM3 for receiving a user command for adjusting the rotation speed of the camera cooling fan 90. When the user presses the interface element EM2 and the interface element EM3, the user device 280 may generate user input information and transmit the user input information to the cooking device 1 (709). The cooking device 1 may execute a cleaning mode according to the user input information (710).

[0252] After executing the cleaning mode, the cooking apparatus 1 may acquire a second image of the interior of the cooking chamber 40 using the camera 80 ( 711 ).

[0253] Based on the second image, the cooking apparatus 1 may determine whether foreign matter is removed by executing the cleaning mode.

[0254] In addition, based on the second image, the cooking apparatus 1 may determine whether at least one foreign object is moved by the cleaning mode (712). The cooking apparatus 1 may determine whether the foreign object is moved by the cleaning mode by comparing the first image before the cleaning mode with the second image after the cleaning mode.

[0255] Based on the determination that the foreign object has not moved, the cooking device 1 may determine that there is an error in foreign object recognition, and may generate foreign object recognition error information (713). That is, the cooking device 1 may determine that the recognized foreign object is not a foreign object attached to the lens 85 of the camera 80 or the transparent member 17, but the cooking device 1 may determine that the recognized foreign object is a foreign object inside the cooking chamber 40 or food to be cooked.

[0256] The cooking device 1 may transmit foreign object recognition error information to the server 270 ( 714 ).

[0257] The server 270 may update the learning model using the received foreign object recognition error information ( 715 ).

[0258] refer to Fig.26 , the cooking apparatus 1 may acquire a first image of the interior of the cooking chamber 40 using the camera 80 ( 801 ).

[0259] The cooking apparatus 1 may transmit the first image to the server 270 ( 802 ).

[0260] The server 270 may identify foreign matter related information from the first image by using a learning model (803). Identifying foreign matter related information may include determining whether there is foreign matter to at least partially block the lens 85 or the transparent member 17.

[0261] The server 270 may transmit the identified foreign object related information to the cooking device 1 (804).

[0262] The cooking device 1 may display foreign matter related information on the display 240 (806). Fig.23 As shown in , the display 240 may display a message such as “There is a foreign object in the camera. The foreign object may be removed by operating the camera fan.”

[0263] The cooking device 1 may obtain user input (807) through the input device 200. The input device 200 may include a camera cooling fan button 206 configured to receive a command for operating the camera cooling fan 90. The input device 200 may also include a wind speed control button 207 configured to adjust the rotation speed of the camera cooling fan 90.

[0264] The cooking apparatus 1 may execute a cleaning mode based on a user input through the inputter 200 ( 811 ).

[0265] The server 270 may transmit the identified foreign object related information to the user device 280 (805).

[0266] User device 280 may display foreign object related information (808). For example, Fig.24 As shown in , a message EM1 such as “There is a foreign object in the camera. The foreign object can be removed by operating the camera fan” may be displayed on the user device 280 .

[0267] The user device 280 may acquire a user input (809). The user device 280 may display an interface element EM2 for receiving a user command for operating the camera cooling fan 90. In addition, the user device 280 may display an interface element EM3 for receiving a user command for adjusting the rotation speed of the camera cooling fan 90. When the user presses the interface element EM2 and the interface element EM3, the user device 280 may generate user input information and transmit the user input information to the cooking device 1 (810). The cooking device 1 may execute a cleaning mode according to the user input information (811).

[0268] After executing the cleaning mode, the cooking apparatus 1 may acquire a second image of the interior of the cooking chamber 40 using the camera 80 ( 812 ).

[0269] Based on the second image, the cooking apparatus 1 may determine whether foreign matter is removed by executing the cleaning mode.

[0270] In addition, based on the second image, the cooking device 1 may determine whether at least one foreign object is moved by the cleaning mode (813). The cooking device 1 may determine whether the foreign object is moved by the cleaning mode by comparing the first image before the cleaning mode with the second image after the cleaning mode.

[0271] The cooking device 1 may determine that there is an error in foreign object recognition based on determining that the foreign object has not moved, and may generate foreign object recognition error information (814). That is, the cooking device 1 may determine that the recognized foreign object is not a foreign object attached to the lens 85 of the camera 80 or the transparent member 17, but the cooking device 1 may determine that the recognized foreign object is a foreign object inside the cooking chamber 40 or food to be cooked.

[0272] The cooking device 1 may transmit foreign object recognition error information to the server 270 (815).

[0273] The server 270 may update the learning model using the received foreign object recognition error information ( 816 ).

[0274] Fig. 27 is a diagram illustrating a state in which information recommending pyrolytic cleaning is displayed on a display according to an embodiment of the present disclosure. Fig.28 is a diagram illustrating a state in which information recommending pyrolytic cleaning is displayed on a user device according to an embodiment of the present disclosure.

[0275] The controller 231 may determine whether the foreign matter is removed after the last cleaning mode is performed, and when it is determined that the foreign matter is not removed, the controller 231 may determine whether the identified foreign matter is a foreign matter inside the cooking chamber 40 .

[0276] That is, the controller 231 may determine whether the identified foreign matter is not foreign matter attached to the lens 85 of the camera 80 or the transparent member 17 , but foreign matter such as oil attached to the lower wall 13 of the cooking chamber 40 .

[0277] In response to determining that the identified foreign matter is a foreign matter in the cooking chamber 40, and in response to the ratio of the area occupied by the foreign matter to the entire area of ​​the image exceeding a predetermined ratio, the controller 231 may display visual information recommending pyrolytic cleaning on the display 240, such as Fig. 27 as shown in .

[0278] In addition, the controller 231 may allow visual information recommending pyrolytic cleaning to be displayed on the user device 280. For example, Fig.24 As shown in , a message EM4 such as “Foreign matter is present in the cooking chamber. Pyrolytic cleaning recommended” may be displayed.

[0279] The user device 280 may display an interface element EM5 for receiving a user command for performing a pyrolysis cleaning operation. When the user presses the interface element EM5, the user device 280 may generate user input information and transmit the user input information to the cooking device 1. The cooking device 1 may perform a pyrolysis cleaning operation through the heating devices 5 and 8 according to the user input information.

[0280] Fig.29 is a flowchart illustrating a method of controlling a cooking apparatus according to an embodiment of the present disclosure.

[0281] Regardless of whether there is foreign matter in the lens 85 of the camera 80 or the transparent member 17, the cleaning mode can be periodically performed. For example, the cleaning mode can be periodically performed before or after cooking. The cleaning mode can be performed in conjunction with the opening and closing operations of the door 2. That is, the cleaning mode can be performed whenever the door 2 is opened, or the cleaning mode can be performed whenever the door 2 is closed.

[0282] Fig.29 An embodiment is shown in which the cleaning mode is periodically performed every time the door 2 is opened.

[0283] The controller 231 may determine whether the door 2 is opened based on a detection signal of the door opening and closing sensor 220 ( 911 ).

[0284] Based on the determination that the door 2 is opened, the controller 231 may control the camera cooling fan motor 91 to perform a cleaning mode by rotating the camera cooling fan 90 ( 912 ).

[0285] The controller 231 may perform cooking after completing the cleaning mode (913).

[0286] After cooking is completed, the controller 231 may determine whether the door 2 is opened based on a detection signal from the door opening and closing sensor 220 (914).

[0287] Based on the determination that the door 2 is opened, the controller 231 may control the camera cooling fan motor 91 to perform a cleaning mode by rotating the camera cooling fan 90 ( 915 ).

[0288] Through the periodic foreign matter cleaning mode, the function of the camera 80 can be stably maintained for a long time.

[0289] According to an embodiment, the cooking device 1 includes: a shell 11; a cooking chamber 40 formed inside the shell 11; a camera 80 configured to acquire an image of the interior of the cooking chamber, the camera having a lens; a transparent member 17 disposed in front of the lens of the camera so that the camera acquires an image of the interior of the cooking chamber through the transparent member; a camera cooling fan 90 configured to blow air toward the camera 80; a motor 91 configured to rotate the camera cooling fan 90; and a controller configured to control the camera and the motor.

[0290] The controller 231 can operate the camera 80 to acquire a first image of the interior of the cooking chamber 40, identify foreign matter-related information of the lens 85 or the transparent member 17 of the camera 80 based on the acquired first image, and based on determining that there is foreign matter to at least partially block the lens or the transparent member, control the operation of the motor 91 to execute a cleaning mode, in which the camera cooling fan 90 rotates at a first rotation speed for a first rotation time.

[0291] The controller 231 may determine the first rotation speed and the first rotation time based on the determination that the foreign matter exists.

[0292] The controller 231 may operate the camera to acquire a second image of the interior of the cooking chamber 40 after executing the cleaning mode.

[0293] The controller 231 may determine whether foreign substances are removed by the execution of the cleaning mode based on the acquired second image.

[0294] The controller 231 may control the operation of the motor 91 to perform an additional cleaning mode in which the camera cooling fan 90 rotates at a second rotation speed for a second rotation time based on the determination that the foreign matter is not removed.

[0295] The second rotational speed may be greater than the first rotational speed.

[0296] The controller 231 may operate the camera 80 to acquire a second image of the interior of the cooking chamber 40 after executing the cleaning mode.

[0297] The controller 231 may determine whether foreign matter has been removed by the execution of the cleaning mode based on the acquired second image.

[0298] The controller 231 may generate recognition error information based on determining that the foreign matter is not removed.

[0299] The controller 231 may include a memory 233 configured to store a learning model for identifying foreign object related information.

[0300] The stored learning model may output foreign matter related information based on inputting the acquired first image to the learning model by the controller 231 .

[0301] The cooking device may further include a communication device 234 configured to communicate with a server 270 .

[0302] The controller 231 may obtain a learning model for identifying foreign object related information from the server 270 through the communication device 234 .

[0303] The controller 231 may control the communication device 234 to transmit the recognition error information to the server 270 .

[0304] The foreign matter-related information includes at least one of the presence or absence of the foreign matter, the number of the foreign matter, and the ratio of the area occupied by the foreign matter to the entire area of ​​the acquired first image.

[0305] The controller 231 may identify foreign matter-related information based on the acquired focus information of the first image.

[0306] The controller 231 may identify foreign matter-related information based on a result of comparing the first image with the clean cooking chamber image.

[0307] The cooking apparatus may further include a display 240, and the controller 231 may control the display 240 to display foreign matter related information.

[0308] The cooking apparatus may further include an inputter 200 configured to acquire a user input, and the controller 231 may control the operation of the motor 91 based on the user input acquired through the inputter 200 to perform the cleaning mode.

[0309] The cooking apparatus may further include a communication device 234 configured to communicate with the server 270. The controller 231 may control the communication device 234 to transmit display information of foreign object related information to be displayed on the external user device 280 to the server 270.

[0310] The controller 231 may determine whether foreign matter exists based on the acquired first image, and the controller 231 may control the display to display visual information to recommend pyrolytic cleaning based on the determination that the foreign matter exists.

[0311] According to an embodiment, the cooking apparatus includes: a shell 11; a cooking chamber 40 formed inside the shell 11; a door 2 configured to open or close the cooking chamber 40; a door sensor 220 configured to detect the opening or closing of the door 2; a camera 80 configured to acquire an image of the interior of the cooking chamber 40; a camera cooling fan 90 configured to blow air toward the camera 80; a motor 91 configured to rotate the camera cooling fan 90; and a controller 23 configured to be electrically connected to the door sensor 220 and the motor 91.

[0312] The controller 231 may control the operation of the motor 91 to rotate the camera cooling fan 90 based on the detection of the opening of the door or the closing of the door by the sensor 220 .

[0313] According to an embodiment, a control method of a cooking device includes: operating a camera 80 to acquire a first image of the interior of a cooking chamber 40; recognizing foreign matter-related information of a lens 85 of the camera 80 or a transparent member 17 of the cooking chamber 40 based on the first image by using a learning model acquired from a memory 233 or a server 270; and based on determining that there is foreign matter to at least partially block the lens 85 or the transparent member 17, controlling the operation of a motor 91 to execute a cleaning mode, in which a camera cooling fan 90 rotates at a first rotation speed for a first rotation time for removal.

[0314] The control method may also include: after executing the cleaning mode, operating the camera 80 to obtain a second image of the interior of the cooking chamber 40; determining whether foreign matter has been removed by executing the cleaning mode based on the acquired second image by using a learning model; and based on determining that the foreign matter has not been removed, controlling the operation of the motor 91 to execute an additional cleaning mode, in which the camera cooling fan 90 rotates at a second rotation speed for a second rotation time.

[0315] The control method may also include: after executing the cleaning mode, operating the camera 80 to obtain a second image of the interior of the cooking chamber 40; determining whether the foreign matter has been moved by the execution of the cleaning mode based on the acquired second image by using a learning model; generating recognition error information based on determining that the foreign matter has not moved; and controlling the communication device 234 to transmit the recognition error information to the server 270.

[0316] The control method may further include: controlling the communication device 234 to transmit display information of the foreign object related information to be displayed on the external user device 280 to the server 270 .

[0317] The operation of the camera 80 for acquiring the first image and recognizing the foreign object-related information may be performed based on the opening or closing of the door configured to open or close the cooking chamber.

[0318] As is apparent from the above description, the cooking apparatus may include a camera cooling structure configured to prevent a temperature increase of a camera caused by heat generated in a cooking chamber.

[0319] Furthermore, foreign matter such as water and oil can be prevented from entering through the suction duct for cooling the camera.

[0320] In addition, the bottom of the camera can be cooled effectively.

[0321] Furthermore, a camera cooling structure for centrally cooling the camera can be separated from a cooling structure for cooling the entire electronic compartment, and thus the efficiency of the cooling structure for the electronic compartment is not reduced.

[0322] Furthermore, electronic components such as circuit boards and cameras can be effectively cooled.

[0323] Additionally, the cooking device's camera can image the entire rack, regardless of the height at which the rack is installed.

[0324] Furthermore, the camera cooling structure can provide a uniform and strong air flow to the bottom of the camera, and thus can prevent foreign matter from being attached to the camera, or can remove foreign matter attached to the camera.

[0325] Furthermore, the cooking apparatus may recognize that foreign matter such as dust is attached around the camera and remove the foreign matter by using a camera cooling fan.

[0326] Additionally, cooking equipment may allow the camera to function properly by periodically removing foreign matter from around the camera.

[0327] Furthermore, foreign object recognition errors can be reduced by updating the learning model used to recognize foreign object-related information.

[0328] The effects of the present disclosure are not limited to those described above, and other effects that are not mentioned will be apparent to those of ordinary skill in the art to which the present disclosure pertains from the following description.

[0329] Although several embodiments of the present disclosure have been shown and described, it will be appreciated by those skilled in the art that changes may be made to these embodiments without departing from the principles and spirit of the disclosure, the scope of which is defined in the claims and their equivalents.

Claims

1. A cooking device, comprising: shell; a cooking chamber formed inside the shell; a camera configured to acquire an image of the interior of the cooking chamber, the camera having a lens; a transparent member disposed in front of the lens of the camera so that the camera acquires the image of the interior of the cooking chamber through the transparent member; a camera cooling fan configured to blow air toward the camera; a motor configured to rotate the camera cooling fan; as well as a controller configured to control the camera and the motor, Wherein, the controller is further configured as: operating the camera to acquire a first image of an interior of the cooking chamber; Based on the acquired first image, identifying foreign matter-related information of the lens or the transparent member of the camera; as well as Based on determining that a foreign object exists to at least partially block the lens or the transparent member, operation of the motor is controlled to perform a cleaning mode in which the camera cooling fan rotates at a first rotation speed for a first rotation time.

2. The cooking device according to claim 1, wherein: The controller is configured to determine the first rotation speed and the first rotation time based on determining that the foreign object exists.

3. The cooking device according to claim 1, wherein: The controller is configured as follows: operating the camera to acquire a second image of the interior of the cooking chamber after executing the cleaning mode; determining, based on the acquired second image, whether the foreign matter is removed by execution of the cleaning mode; as well as Based on a determination that the foreign matter is not removed, the operation of the motor is controlled to perform an additional cleaning mode in which the camera cooling fan rotates at a second rotation speed for a second rotation time.

4. The cooking device according to claim 3, wherein: The second rotation speed is greater than the first rotation speed.

5. The cooking device according to claim 1, wherein: The controller is also configured to: operating the camera to acquire a second image of the interior of the cooking chamber after executing the cleaning mode; determining, based on the acquired second image, whether the foreign matter has been removed by execution of the cleaning mode; and Based on a determination that the foreign matter has not been removed, recognition error information is generated.

6. The cooking device according to claim 5, wherein: The controller includes a memory configured to store a learning model for identifying the foreign object related information, and The stored learning model outputs the foreign object related information based on the controller inputting the acquired first image into the learning model.

7. The cooking device according to claim 5, further comprising: a communication device configured to communicate with a server, Wherein, the controller is further configured as: Acquiring a learning model for identifying the foreign object related information from the server through the communication device; and The communication device is controlled to transmit the identification error information to the server.

8. The cooking device according to claim 1, wherein: The foreign matter-related information includes at least one of the presence or absence of foreign matter, the number of foreign matter, and a ratio of an area occupied by the foreign matter to the entire area of ​​the acquired first image.

9. The cooking device according to claim 1, wherein: The controller is configured to identify the foreign matter-related information based on focus information of the acquired first image.

10. The cooking device according to claim 1, wherein The controller is configured to identify the foreign matter-related information based on a result of comparing the first image with a clean cooking chamber image.

11. The cooking device according to claim 1, further comprising: monitor, Wherein, the controller is configured to control the display to display the foreign object related information.

12. The cooking device according to claim 1, further comprising: An inputter, configured to obtain user input, The controller is configured to control the operation of the motor to execute the cleaning mode based on the user input acquired through the input device.

13. The cooking device according to claim 1, further comprising: a communication device configured to communicate with a server, Wherein, the controller is configured to control the communication device to transmit display information of the foreign object related information to be displayed on the external user device to the server.

14. The cooking device of claim 1, further comprising: monitor, Wherein, the controller is configured as follows: determining whether the foreign matter exists based on the acquired first image; and Based on determining that the foreign matter is present, the display is controlled to display a visual message to recommend pyrolytic cleaning.

15. A cooking device comprising: shell; a cooking chamber formed inside the shell; a door configured to open or close the cooking chamber; a door sensor configured to detect opening or closing of the door; a camera configured to capture an image of the interior of the cooking chamber; a camera cooling fan configured to blow air toward the camera; a motor configured to rotate the camera cooling fan; as well as a controller configured to be electrically connected to the door sensor and the motor, The controller is configured to control the operation of the motor to rotate the camera cooling fan based on the opening of the door or the closing of the door detected by the sensor.

Images