Control method, control device, readable storage medium, and cooking appliance

Abstract

The present invention relates to a control method, a control device, a readable storage medium, and a cooking appliance, and is applicable to a cooking appliance in the technical field. The control method is applied to a cooking appliance (100) which includes a cooking chamber (1022) and is equipped with an image sensor (104) in the cooking chamber (1022), and includes the steps of: collecting image data in the cooking chamber (1022) by the image sensor (104); and transmitting the image data to a target server, the target server performing image processing on the image data and obtaining a target image after processing, and the target server performing data interaction with a target terminal to obtain and display the target image on the target terminal. The cooking appliance according to the embodiment of the present invention can actively upload image data during cooking, which helps the user to remotely understand the progress of cooking of the food being cooked, eliminating the need for the user to frequently check the cooking status in front of the cooking appliance, and improving cooking efficiency.

Description

Technical Field

[0001] This application claims the priority of a Chinese patent application with the application number "202310540239.7" and the application title "Control Method, Control Device, Readable Storage Medium, and Cooking Appliance", which was filed with the Chinese Patent Office on May 15, 2023. The entire content of the said application is incorporated herein by reference.

[0002] This application relates to the technical field of cooking appliances, specifically to a control method, a control device, a readable storage medium, and a cooking appliance.

Background Art

[0003] In related technologies, cooking appliances such as ovens have a long cooking time, and there are many factors that affect the cooking effect during the cooking process. Therefore, the failure rate of cooking is high. In order to prevent overcooking or burning, users need to go to the front of the oven at any time, open the door, and check the cooking status of the food, resulting in a decrease in cooking efficiency.

Summary of the Invention

Problems to be Solved by the Invention

[0004] This application aims to solve one of the technical problems in the existing technology or related technologies.

Means for Solving the Problems

[0005] For this purpose, the first aspect of this application provides a control method.

[0006] The second aspect of this application provides a control method.

[0007] The third aspect of this application provides a control device.

[0008] The fourth aspect of this application provides a control device.

[0009] The fifth aspect of this application provides a control device.

[0010] A sixth aspect of the present application provides a readable storage medium.

[0011] A seventh aspect of this application provides a cooking utensil.

[0012] The eighth aspect of this application provides a cooking utensil.

[0013] The ninth aspect of this application provides a cooking utensil.

[0014] In view of this, a first aspect of the present invention provides a control method applicable to a cooking appliance that includes a cooking room and is equipped with an image sensor in the cooking room, the control method comprising the steps of collecting image data in the cooking room by the image sensor and transmitting the image data to a target server, the target server performing image processing on the image data and obtaining a target image after processing, and the target server performing data interaction with a target terminal to cause the target terminal to obtain and display the target image.

[0015] In this proposed technology, the cooking appliance specifically includes an oven, a steam oven, etc., and the cooking appliance is equipped with an image sensor, which specifically includes a camera module, and the image sensor is installed in the cooking chamber and used to capture image data of the food being cooked while the cooking appliance is in operation.

[0016] For example, when a cooking appliance is in operation, the image sensor collects image data of the food being cooked in the kitchen in real time, and the image data may be video stream data or photographic frame data.

[0017] After capturing image data, the cooking appliance synchronously transmits the image data to the target server via a wireless network connection.

[0018] After the target server receives the image data, it performs the corresponding image processing on the image data. For example, if the image data is video stream data, the target server performs the corresponding compression processing on the video stream data. If the image data is photo frame data, the target server performs processing such as masking, beautification, and filtering on the photo frame data and obtains the processed target image.

[0019] Users can establish a relationship with cooking appliances by logging into an account bound to the appliance via a device such as a mobile phone, or by scanning an identification code attached to the appliance. By accessing a target server through an application installed on the device used to log into the account or establish the relationship, the system can obtain target images of the ingredients being cooked uploaded by the appliance during the cooking process, thereby monitoring the cooking progress of the appliance in real time.

[0020] As can be understood, users can remotely control cooking appliances by sending control commands to the appliances in real time via an application to adjust cooking parameters while observing the cooking progress of the appliances via a device such as a mobile phone.

[0021] The cooking appliance according to the embodiment of the present invention can actively upload image data during cooking, which helps the user to remotely monitor the cooking progress of the ingredients being cooked, eliminating the need for the user to frequently check the cooking status in front of the appliance and improving cooking efficiency.

[0022] Furthermore, the control method in the above-mentioned proposed technology relating to this application may also have the following additional technical features.

[0023] In the proposed technology described above, the image data includes video stream data, and the target image includes the video stream data and a first video corresponding to the video stream data.

[0024] In this technical solution, the image data collected by the image sensor in the cooking chamber specifically includes video stream data, and the video stream data is specifically video data that is continuously and persistently transmitted via a network. When the target server receives the video stream data, continuous solidification processing and storage processing are performed on these video stream data to form a first video.

[0025] When a user accesses the target server via a terminal such as a mobile phone, the user can directly select to play and view the video stream data. The video stream data reflects the real-time video in the cooking chamber, and the user can grasp the real-time cooking progress status of the food to be cooked based on the video stream data.

[0026] The user can also select to play the first video. The first video includes all video images from the time when the cooking appliance started cooking to the present. The user can observe the images of the food to be cooked at each time point after the start of cooking by means such as double-speed playback and dragging the progress bar, which helps the user to judge the cooking effect.

[0027] The cooking appliance according to the embodiment of the present application can directly transmit the video stream to the target server. By accessing the target server, the user can observe the cooking status at each time point in the cooking chamber in real time, observe the real-time image in the current cooking chamber at any time, and also grasp the cooking progress remotely, improving the cooking efficiency.

[0028] In any of the above technical solutions, the image data includes photo data, and the control method further includes the steps of receiving an adjustment command determined based on the image data by the target server, and adjusting the cooking parameters of the cooking appliance based on the adjustment command.

[0029] In this technical solution, the cooking appliance can periodically take pictures of the interior of the cooking chamber according to a set time interval and form them as photo data, and the cooking appliance uploads this photo data to a target server.

[0030] When taking the photo data, since the photo data is taken in the form of a single-frame image, the requirement for network bandwidth is low, and it is possible to take a higher-resolution image.

[0031] When the target server receives the photo data, it performs image content identification on the high-resolution image, and thereby can intelligently determine the real-time cooking state in the cooking chamber. When identifying a change in the state of the ingredients, such as the occurrence of smoke in the cooking chamber or the blackening and "burning" of the ingredients being cooked, an adjustment command for reducing the output of the cooking appliance is automatically generated. Furthermore, for example, after the cooking time reaches a predetermined time, the cooking completion state of the ingredients to be cooked is determined based on the photo data. If the cooking completion state of the ingredients to be cooked has not reached the expected state, an adjustment command for improving the output of the cooking appliance is automatically generated.

[0032] After generating the adjustment command, the target server sends the adjustment command to the cooking appliance. After receiving the adjustment command, the cooking appliance adjusts its own cooking parameters, such as heating output, etc., based on the adjustment command, and realizes the automated control of the cooking process.

[0033] The cooking appliance according to the embodiment of the present application can take a high-resolution image of the interior of the cooking chamber and upload it to the server, and the target server determines the cooking state of the cooking ingredients using image identification technology. When a change occurs in the cooking state of the ingredients, a corresponding adjustment command is generated to ensure the cooking effect and improve the success rate of cooking in cooking appliances such as ovens.

[0034] In any of the above proposed technologies, the control method further includes the step of controlling the image sensor to stop collecting image data when it receives an input to stop collection or detects a cooking completion signal from a cooking appliance.

[0035] In this proposed technology, users can input a command to stop data collection through an application on a terminal device such as a mobile phone. In this case, the terminal device directly sends a control signal to the target server or cooking appliance to stop collecting image data. Upon receiving the control signal, the image sensor in the cooking room stops collecting and uploading image data.

[0036] To make it clear, users can also initiate the collection stop operation via a control panel or switch button provided on the cooking appliance.

[0037] After the cooking appliance completes the cooking program set by the user, the appliance's main control system generates a cooking completion signal. Upon detecting the cooking completion signal, the image sensor also stops collecting image data.

[0038] The embodiment of this invention allows for free control of the image data acquisition process using cooking equipment, thereby improving the flexibility of the cooking equipment.

[0039] A second aspect of the present invention provides a control method applicable to a target server that performs data interaction with a target terminal, the control method comprising the steps of receiving image data transmitted from a cooking appliance, performing image processing on the image data to obtain a target image after processing, and, upon receiving a viewing request for the target image from the target terminal, transmitting the target image to the target terminal to display the target image on the target terminal.

[0040] In this proposed technology, the target server may be a cloud server and interact with the cooking appliance via a wireless network connection. Alternatively, the target server may be a smart gateway or local server installed in the user's home and interact with the cooking appliance via a local area network.

[0041] Cooking appliances specifically include ovens, steam ovens, etc. The cooking appliances are equipped with image sensors, which specifically include camera modules, and the image sensors are installed in the cooking chamber and used to capture image data of the food being cooked while the cooking appliance is in operation.

[0042] For example, when a cooking appliance is in operation, the image sensor collects image data of the food being cooked in the kitchen in real time, and the image data may be video stream data or photographic frame data.

[0043] After capturing image data, the cooking appliance synchronously transmits the image data to the target server via a wireless network connection.

[0044] After the target server receives the image data, it performs the corresponding image processing on the image data. For example, if the image data is video stream data, the target server performs the corresponding compression processing on the video stream data. If the image data is photo frame data, the target server performs processing such as masking, beautification, and filtering on the photo frame data and obtains the processed target image.

[0045] Users can establish a relationship with cooking appliances by logging into an account bound to the appliance via a device such as a mobile phone, or by scanning an identification code attached to the appliance. By accessing a target server through an application installed on the device used to log into the account or establish the relationship, the system can obtain target images of the ingredients being cooked uploaded by the appliance during the cooking process, thereby monitoring the cooking progress of the appliance in real time.

[0046] As can be understood, users can remotely control cooking appliances by sending control commands to the appliances in real time via an application to adjust cooking parameters while observing the cooking progress of the appliances via a device such as a mobile phone.

[0047] The cooking appliance according to the embodiment of the present invention can actively upload image data during cooking, which helps the user to remotely monitor the cooking progress of the ingredients being cooked, eliminating the need for the user to frequently check the cooking status in front of the appliance and improving cooking efficiency.

[0048] In the proposed technology described above, the image data includes video stream data, and the target image includes a first video corresponding to the video stream data.

[0049] In this proposed technology, the image data collected by the image sensor in the cooking room specifically includes video stream data, which is specifically video data transmitted continuously and persistently over a network. When the target server receives the video stream data, it continuously performs solidification and storage processing on this video stream data to form a first video.

[0050] When a user accesses the target server via a device such as a mobile phone, they can directly choose to play and view video stream data. The video stream data reflects real-time footage from the kitchen, allowing the user to understand the real-time cooking progress of the ingredients being prepared.

[0051] Users can also choose to play the first video, which contains all video footage from the moment the cooking appliance started cooking until the present. Users can observe images of the ingredients being cooked at each point in time after cooking began, using methods such as fast-forwarding and dragging the progress bar, which helps users judge the cooking effect.

[0052] The cooking appliance according to the embodiment of the present invention can transmit a video stream directly to a target server, and by accessing the target server, the user can observe the cooking status in the kitchen at each point in time in real time. They can also observe real-time images of the current kitchen and grasp the progress of cooking remotely, thereby improving cooking efficiency.

[0053] In any of the above proposed technologies, after performing image processing on image data and obtaining a target image after processing, the control method further includes the steps of generating a corresponding adjustment command based on the target image and transmitting the adjustment command to the cooking appliance so that the cooking appliance adjusts the cooking parameters based on the adjustment command.

[0054] In this proposed technology, the image data may be video stream data or photographic data. When the video stream data is photographic data, the cooking appliance can periodically take photographs of the kitchen interior according to a set time interval and form them as photographic data, and the cooking appliance uploads this photographic data to a target server.

[0055] After the target server receives image data, it performs the appropriate processing on the image data and obtains the processed target image. After obtaining the target image, it performs image content recognition on the target image, thereby intelligently determining the real-time cooking status in the kitchen. If it detects a change in the state of the ingredients, such as smoke being generated in the kitchen or ingredients turning black and "burning" during cooking, it automatically generates an adjustment command to reduce the output of the cooking appliances. Furthermore, for example, after a predetermined cooking time has been reached, it determines the cooking completion status of the ingredients being cooked based on the target image. If the cooking completion status of the ingredients being cooked has not reached the expected state, it automatically generates an adjustment command to increase the output of the cooking appliances.

[0056] After generating the adjustment command, the target server sends the command to the cooking appliance. Upon receiving the adjustment command, the cooking appliance adjusts its cooking parameters, such as heating output, based on the command, thereby achieving automated control of the cooking process.

[0057] The cooking appliance according to the embodiment of the present invention can capture image data of the cooking room and upload it to a server, and the target server uses image recognition technology to determine the cooking state of the food. If a change occurs in the cooking state of the food, it generates a corresponding adjustment command to ensure the cooking effect and increase the success rate of cooking in cooking appliances such as ovens.

[0058] In any of the above proposed technologies, the image data includes multiple photographic data, and the target image includes a second video. The steps of performing image processing on the image data and obtaining the processed target image include: determining the first photograph as the target frame when the first photograph among the multiple photographic data does not contain a predetermined target; performing algorithmic processing on the second photograph among the multiple photographic data when the second photograph among the multiple photographic data contains a predetermined target, and determining the processed second photograph as the target frame, provided that the processed second photograph does not contain the predetermined target; sorting the multiple target frames according to the order in which the multiple photographic data corresponding to the multiple target frames are received to obtain a frame sequence; and generating a second video based on the frame sequence.

[0059] In this proposed technology, the image data uploaded by the cooking appliance includes multiple photographic data, where the multiple photographic data may be photographs taken periodically by the cooking appliance at set time intervals within the kitchen.

[0060] When the target server receives multiple photo data files, it optimizes the captured photos by performing algorithmic processing on the received photo data.

[0061] For example, the target server first performs target identification on the photo data and then determines whether or not the photo data contains a predetermined target.

[0062] Here, the designated target may be an area of ​​image distortion caused by water droplets, a bright spot caused by strong light from outside, or a reflection formed inside the cooking area by light irradiation from an object outside the cooking appliance. These factors affect the final image effect.

[0063] Therefore, if it is determined that the received photographic data contains the predetermined target described above, the photographic data containing the predetermined target can be processed using a predetermined processing method. For example, the photographic data can be processed using the optical flow method.

[0064] For example, if the photographic data contains areas of image distortion caused by water droplets, the system can search for an adjacent photographic frame that does not contain such distortion and whose shooting time is closest to that of the current photographic data. By extracting the portion of the same image area within that frame that does not contain the water droplet image and replacing the distortion area in the current photographic data with this extracted portion, the effects of image distortion caused by water droplets can be eliminated.

[0065] For example, if photographic data includes reflections from external objects, the system identifies the reflection areas using optical flow changes and applies a segmentation process to these areas to ensure that the final target image is unaffected by the reflections.

[0066] When a single photo data is received, if the current photo data, i.e., the first photo, does not contain the predetermined target described above, the photo frame of the photo data is directly set as the target frame.

[0067] If the current photographic data, i.e., the second photograph, contains a predetermined target, the algorithm removes the predetermined target from the second photograph, and then sets the processed second photograph as the target frame.

[0068] After obtaining multiple target frames, these target frames are sorted according to the time order in which the original image data corresponding to these target frames was received, a sorted frame sequence is obtained, and a synthesis process is performed on this frame sequence to generate the final second video.

[0069] Each video frame in the second video is either unaffected by external influences or has been processed by an algorithm. Therefore, the video effects in the second video are superior. Users can download the second video via a mobile phone application, save it as a cooking record, edit it using predefined templates (such as color adjustments and adding subtitles), and share the edited video with a single click.

[0070] The embodiment of this invention enhances the enjoyment of cooking and enriches the effectiveness of using cooking appliances by performing algorithmic optimization processing on image data uploaded by cooking appliances, and generating a video from the optimized image frames for storage or sharing.

[0071] In any of the above proposed technologies, the step of performing image processing on image data and obtaining a target image after processing includes the step of obtaining predetermined color gamut calibration information and the step of performing color gamut calibration on the image data based on the color gamut calibration information and obtaining a calibrated target image.

[0072] In this proposed technology, when the target server receives image data, it acquires corresponding color gamut calibration information, where the color gamut calibration information may be a calibration matrix corresponding to different color gamuts set based on prior knowledge.

[0073] Based on color gamut calibration information, a color gamut calibration process is performed on the received image data, thereby enhancing the color reproduction effect of the final target image and optimizing the imaging quality of the target image. This allows the target image to more accurately reproduce the actual appearance of the food being cooked, making it easier for users to view or share.

[0074] The embodiment of this invention can improve the color reproduction of the generated target image and optimize the imaging quality of the target image by calibrating the image data.

[0075] In any of the above proposed technologies, the cooking appliance includes a door body, and after receiving image data transmitted from the cooking appliance, the control method further includes the steps of performing object identification on the image data and, if it identifies that a target image frame in the image data includes a door body and that the door body is in an open state, deleting the target image frame.

[0076] In the embodiment of this invention, when the cooking appliance is in operation, an image sensor collects image data of the cooking area in real time. If the user opens the door of the cooking appliance, the user may be captured in the image data collected by the image sensor.

[0077] When the target server receives image data and identifies that the door of a cooking appliance is open, it deletes all image frames that identify the open door. This prevents image frames containing the user from being uploaded to the server, thereby protecting the user's privacy.

[0078] A third aspect of the present invention provides a control device applicable to a cooking appliance that includes a cooking room and is equipped with an image sensor in the cooking room, the control device including an acquisition module for collecting image data in the cooking room by the image sensor and a first transmission module for transmitting the image data to a target server, the target server performing image processing on the image data and acquiring a target image after processing, and the target server performing data interaction with a target terminal to acquire and display the target image on the target terminal.

[0079] In the embodiments of the present invention, the cooking appliance specifically includes an oven, a steam oven, etc., and the cooking appliance is provided with an image sensor, which specifically includes a camera module, and the image sensor is provided in the cooking chamber and is used to capture image data of the food being cooked while the cooking appliance is in operation.

[0080] For example, when a cooking appliance is in operation, the image sensor collects image data of the food being cooked in the kitchen in real time, and the image data may be video stream data or photographic frame data.

[0081] After capturing image data, the cooking appliance synchronously transmits the image data to the target server via a wireless network connection.

[0082] After the target server receives the image data, it performs the corresponding image processing on the image data. For example, if the image data is video stream data, the target server performs the corresponding compression processing on the video stream data. If the image data is photo frame data, the target server performs processing such as masking, beautification, and filtering on the photo frame data and obtains the processed target image.

[0083] Users can establish a relationship with cooking appliances by logging into an account bound to the appliance via a device such as a mobile phone, or by scanning an identification code attached to the appliance. By accessing a target server through an application installed on the device used to log into the account or establish the relationship, the system can obtain target images of the ingredients being cooked uploaded by the appliance during the cooking process, thereby monitoring the cooking progress of the appliance in real time.

[0084] As can be understood, users can remotely control cooking appliances by sending control commands to the appliances in real time via an application to adjust cooking parameters while observing the cooking progress of the appliances via a device such as a mobile phone.

[0085] The cooking appliance according to the embodiment of the present invention can actively upload image data during cooking, which helps the user to remotely monitor the cooking progress of the ingredients being cooked, eliminating the need for the user to frequently check the cooking status in front of the appliance and improving cooking efficiency.

[0086] Based on any of the above embodiments, the image data includes video stream data, and the target image includes video stream data and a first video corresponding to the video stream data.

[0087] In the embodiments of the present invention, the image data collected by the image sensor in the cooking room specifically includes video stream data, which is specifically video data transmitted continuously and persistently over a network, and when the target server receives the video stream data, it continuously performs solidification and storage processing on this video stream data to form a first video.

[0088] A fourth aspect of the present invention provides a control device applicable to a target server that performs data interaction with a target terminal, the control device including a receiving module for receiving image data transmitted from a cooking appliance, a processing module for performing image processing on the image data and obtaining a target image after processing, and a second transmitting module for displaying the target image on the target terminal by transmitting the target image to the target terminal when a viewing request for the target image is received from the target terminal.

[0089] In this proposed technology, the target server may be a cloud server and interact with the cooking appliance via a wireless network connection. Alternatively, the target server may be a smart gateway or local server installed in the user's home and interact with the cooking appliance via a local area network.

[0090] Cooking appliances specifically include ovens, steam ovens, etc. The cooking appliances are equipped with image sensors, which specifically include camera modules, and the image sensors are installed in the cooking chamber and used to capture image data of the food being cooked while the cooking appliance is in operation.

[0091] For example, when a cooking appliance is in operation, the image sensor collects image data of the food being cooked in the kitchen in real time, and the image data may be video stream data or photographic frame data.

[0092] After capturing image data, the cooking appliance synchronously transmits the image data to the target server via a wireless network connection.

[0093] After the target server receives the image data, it performs the corresponding image processing on the image data. For example, if the image data is video stream data, the target server performs the corresponding compression processing on the video stream data. If the image data is photo frame data, the target server performs processing such as masking, beautification, and filtering on the photo frame data and obtains the processed target image.

[0094] Users can establish a relationship with cooking appliances by logging into an account bound to the appliance via a device such as a mobile phone, or by scanning an identification code attached to the appliance. By accessing a target server through an application installed on the device used to log into the account or establish the relationship, the system can obtain target images of the ingredients being cooked uploaded by the appliance during the cooking process, thereby monitoring the cooking progress of the appliance in real time.

[0095] As can be understood, users can remotely control cooking appliances by sending control commands to the appliances in real time via an application to adjust cooking parameters while observing the cooking progress of the appliances via a device such as a mobile phone.

[0096] The cooking appliance according to the embodiment of the present invention can actively upload image data during cooking, which helps the user to remotely monitor the cooking progress of the ingredients being cooked, eliminating the need for the user to frequently check the cooking status in front of the appliance and improving cooking efficiency.

[0097] A fifth aspect of the present application provides a control device comprising a memory for storing a program or instruction and a processor for implementing steps of the control method in any of the above-described technical proposals when executing the program or instruction, and thus encompassing all the beneficial effects of the control method in any of the above-described technical proposals. To avoid duplication, these will not be described again here.

[0098] A sixth aspect of the present application provides a readable storage medium in which a program or instruction is stored, and when the program or instruction is executed by a processor, it realizes the steps of the control method in any of the above-described technical proposals, and thus includes all the beneficial effects of the control method in any of the above-described technical proposals. To avoid duplication, these will not be described again here.

[0099] A seventh aspect of this application provides a cooking appliance and includes a control device relating to any of the above-described technical solutions, and therefore includes all the beneficial effects of the control device relating to any of the above-described technical solutions. To avoid duplication, these will not be described again here.

[0100] The eighth aspect of this application provides a cooking utensil and includes a readable storage medium relating to any of the above-described technical solutions, and therefore includes all the beneficial effects of the readable storage medium relating to any of the above-described technical solutions. To avoid duplication, these will not be described again here.

[0101] A ninth aspect of the present application provides a cooking appliance and includes a control device relating to any of the above-described technical proposals and a readable storage medium relating to any of the above-described technical proposals, and therefore includes all the beneficial effects of the control device relating to any of the above-described technical proposals and the readable storage medium relating to any of the above-described technical proposals. To avoid duplication, these will not be described again here.

[0102] In the above proposed technology, the cooking appliance further includes a main body including a cooking chamber, and an image sensor installed in the cooking chamber for collecting image data of the cooking chamber.

[0103] In this proposed technology, the cooking appliance is an oven or a steam oven, the oven body is equipped with a cooking chamber, and an image sensor is installed inside the cooking chamber. While the cooking appliance is in operation, the image sensor can capture image data of the food being cooked inside the cooking chamber in real time. [Brief explanation of the drawing]

[0104] The above and / or additional aspects and advantages of the present application will become clear and easily understood from the description of the embodiments with reference to the following drawings.

[0105] [Figure 1] Figure 1 shows a schematic diagram of the structure of a cooking utensil according to an embodiment of the present invention. [Figure 2] Figure 2 shows a flowchart of the control method according to an embodiment of the present invention. [Figure 3] Figure 3 shows a flowchart of the control method according to an embodiment of the present invention. [Figure 4] Figure 4 shows a schematic diagram of the interaction between a cooking appliance and a target server according to an embodiment of the present invention. [Figure 5] Figure 5 shows a structural block diagram of the control device according to an embodiment of the present invention. [Figure 6] Figure 6 shows a structural block diagram of the control device according to an embodiment of the present invention. [Figure 7] Figure 7 shows a structural block diagram of the control device according to an embodiment of the present invention. [Modes for carrying out the invention]

[0106] To better understand the above-mentioned objectives, features, and advantages of this application, the application will be described in further detail below with reference to the drawings and specific embodiments. Where there are no conflicts, the embodiments and features of this application can be combined with each other.

[0107] Many specific details are provided in the following description to ensure a full understanding of the present application. However, since the present application can be implemented in ways other than those described, the scope of protection is not limited to the specific embodiments disclosed below.

[0108] Hereinafter, with reference to Figures 1 to 7, control methods, control devices, readable storage media, and cooking appliances relating to several embodiments of the present application will be described.

[0109] In some embodiments of the present application, a control method applicable to a cooking appliance is provided, and Figure 1 is a schematic diagram of the structure of a cooking appliance according to an embodiment of the present application. As shown in Figure 1, the cooking appliance 100 includes a main body 102, the main body 102 includes a cooking chamber 1022, and the cooking chamber 1022 is provided with an image sensor 104.

[0110] Figure 2 shows a flowchart of the control method according to an embodiment of the present application. As shown in Figure 2, the control method is: Step 202 involves collecting image data from inside the cooking room using an image sensor, The process includes step 204, which involves sending image data to a target server, the target server performing image processing on the image data, obtaining the processed target image, the target server interacting with a target terminal, and the target terminal obtaining and displaying the target image.

[0111] In the embodiments of the present invention, the cooking appliance specifically includes an oven, a steam oven, etc., and the cooking appliance is provided with an image sensor, which specifically includes a camera module, and the image sensor is provided in the cooking chamber and is used to capture image data of the food being cooked while the cooking appliance is in operation.

[0112] For example, when a cooking appliance is in operation, the image sensor collects image data of the food being cooked in the kitchen in real time, and the image data may be video stream data or photographic frame data.

[0113] After capturing image data, the cooking appliance synchronously transmits the image data to the target server via a wireless network connection.

[0114] After the target server receives the image data, it performs the corresponding image processing on the image data. For example, if the image data is video stream data, the target server performs the corresponding compression processing on the video stream data. If the image data is photo frame data, the target server performs processing such as masking, beautification, and filtering on the photo frame data and obtains the processed target image.

[0115] Users can establish a relationship with cooking appliances by logging into an account bound to the appliance via a device such as a mobile phone, or by scanning an identification code attached to the appliance. By accessing a target server through an application installed on the device used to log into the account or establish the relationship, the system can obtain target images of the ingredients being cooked uploaded by the appliance during the cooking process, thereby monitoring the cooking progress of the appliance in real time.

[0116] As can be understood, users can remotely control cooking appliances by sending control commands to the appliances in real time via an application to adjust cooking parameters while observing the cooking progress of the appliances via a device such as a mobile phone.

[0117] The cooking appliance according to the embodiment of the present invention can actively upload image data during cooking, which helps the user to remotely monitor the cooking progress of the ingredients being cooked, eliminating the need for the user to frequently check the cooking status in front of the appliance and improving cooking efficiency.

[0118] Based on any of the above embodiments, the image data includes video stream data, and the target image includes video stream data and a first video corresponding to the video stream data.

[0119] In the embodiments of the present invention, the image data collected by the image sensor in the cooking room specifically includes video stream data, which is specifically video data transmitted continuously and persistently over a network, and when the target server receives the video stream data, it continuously performs solidification and storage processing on this video stream data to form a first video.

[0120] When a user accesses the target server via a device such as a mobile phone, they can directly choose to play and view video stream data. The video stream data reflects real-time footage from the kitchen, allowing the user to understand the real-time cooking status of the ingredients being prepared.

[0121] Users can also choose to play the first video, which contains all video footage from the moment the cooking appliance started cooking until the present. Users can observe images of the ingredients being cooked at each point in time after cooking began, using methods such as fast-forwarding and dragging the progress bar, which helps users judge the cooking effect.

[0122] The cooking appliance according to the embodiment of the present invention can transmit a video stream directly to a target server, and by accessing the target server, the user can observe the cooking status in the kitchen at each point in time in real time. They can also observe real-time images of the current kitchen and grasp the progress of cooking remotely, thereby improving cooking efficiency.

[0123] Based on any of the embodiments described above, the image data includes photographic data, and the control method further includes the steps of receiving an adjustment command determined by the target server based on the image data, and adjusting the cooking parameters of the cooking appliance based on the adjustment command.

[0124] In the embodiment of the present invention, the cooking appliance can periodically take photographs of the kitchen interior according to a set time interval and form them as photographic data, and the cooking appliance uploads these photographic data to a target server.

[0125] When capturing photographic data, the data is captured in the form of a single-frame image, which reduces the network bandwidth requirement and makes it possible to capture higher-resolution images.

[0126] When the target server receives photographic data, it performs image content recognition on the high-resolution images, thereby intelligently determining the real-time cooking status inside the kitchen. If it detects changes in the state of the ingredients, such as smoke being generated in the kitchen or ingredients turning black and "burning" during cooking, it automatically generates an adjustment command to reduce the output of the cooking appliances. Furthermore, for example, after a predetermined cooking time has been reached, it determines the completion state of the ingredients being cooked based on the photographic data. If the ingredients being cooked have not reached the expected completion state, it automatically generates an adjustment command to increase the output of the cooking appliances.

[0127] After generating the adjustment command, the target server sends the command to the cooking appliance. Upon receiving the adjustment command, the cooking appliance adjusts its cooking parameters, such as heating output, based on the command, thereby achieving automated control of the cooking process.

[0128] The cooking appliance according to the embodiment of the present invention can capture high-resolution images of the cooking chamber and upload them to a server, and the target server uses image recognition technology to determine the cooking state of the food. If a change occurs in the cooking state of the food, it generates corresponding adjustment commands to ensure the cooking effect and increase the success rate of cooking in cooking appliances such as ovens.

[0129] Based on any of the embodiments described above, the control method further includes the step of controlling the image sensor to stop collecting image data when it receives an input to stop collection or detects a cooking completion signal from a cooking appliance.

[0130] In the embodiments of this invention, a user can input a stop-collection command through an application on a terminal device such as a mobile phone. In this case, the terminal device directly transmits a control signal to the target server or cooking appliance to stop collecting image data. Upon receiving the control signal, the image sensor in the cooking room stops collecting and uploading image data.

[0131] To make it clear, the user can initiate the collection stop operation via a control panel or switch button provided on the cooking appliance.

[0132] After the cooking appliance completes the cooking program set by the user, the appliance's main control system generates a cooking completion signal. Upon detecting the cooking completion signal, the image sensor also stops collecting image data.

[0133] The embodiment of this invention allows for free control of the image data acquisition process using cooking equipment, thereby improving the flexibility of the cooking equipment.

[0134] In some embodiments of the present application, a control method is provided that is applied to a target server, the target server interacts with a target terminal, and Figure 3 shows a flowchart of the control method according to an embodiment of the present application. As shown in Figure 3, the control method includes the steps of: receiving image data transmitted from a cooking appliance 302; performing image processing on the image data and obtaining a target image after processing 304; and, when a viewing request for the target image is received from the target terminal, sending the target image to the target terminal and thereby causing the target image to be displayed on the target terminal.

[0135] In the embodiments of this invention, the target server may be a cloud server and interact with the cooking appliance via a wireless network connection. The target server may also be a smart gateway or local server installed in the user's home and interact with the cooking appliance via a local area network.

[0136] Cooking appliances specifically include ovens, steam ovens, etc. The cooking appliances are equipped with image sensors, which specifically include camera modules, and the image sensors are installed in the cooking chamber and used to capture image data of the food being cooked while the cooking appliance is in operation.

[0137] For example, when a cooking appliance is in operation, the image sensor collects image data of the food being cooked in the kitchen in real time, and the image data may be video stream data or photographic frame data.

[0138] After capturing image data, the cooking appliance synchronously transmits the image data to the target server via a wireless network connection.

[0139] After the target server receives the image data, it performs the corresponding image processing on the image data. For example, if the image data is video stream data, the target server performs the corresponding compression processing on the video stream data. If the image data is photo frame data, the target server performs processing such as masking, beautification, and filtering on the photo frame data and obtains the processed target image.

[0140] Users can establish a relationship with cooking appliances by logging into an account bound to the appliance via a device such as a mobile phone, or by scanning an identification code attached to the appliance. By accessing a target server through an application installed on the device used to log into the account or establish the relationship, the system can obtain target images of the ingredients being cooked uploaded by the appliance during the cooking process, thereby monitoring the cooking progress of the appliance in real time.

[0141] As can be understood, users can remotely control cooking appliances by sending control commands to the appliances in real time via an application to adjust cooking parameters while observing the cooking progress of the appliances via a device such as a mobile phone.

[0142] The cooking appliance according to the embodiment of the present invention can actively upload image data during cooking, which helps the user to remotely monitor the cooking progress of the ingredients being cooked, eliminating the need for the user to frequently check the cooking status in front of the appliance and improving cooking efficiency.

[0143] Based on any of the embodiments described above, the image data includes video stream data, and the target image includes a first video corresponding to the video stream data.

[0144] In the embodiments of the present invention, the image data collected by the image sensor in the cooking room specifically includes video stream data, which is specifically video data transmitted continuously and persistently over a network, and when the target server receives the video stream data, it continuously performs solidification and storage processing on this video stream data to form a first video.

[0145] When a user accesses the target server via a device such as a mobile phone, they can directly choose to play and view video stream data. The video stream data reflects real-time footage from the kitchen, allowing the user to understand the real-time cooking status of the ingredients being prepared.

[0146] Users can also choose to play the first video, which contains all video footage from the moment the cooking appliance started cooking until the present. Users can observe images of the ingredients being cooked at each point in time after cooking began, using methods such as fast-forwarding and dragging the progress bar, which helps users judge the cooking effect.

[0147] The cooking appliance according to the embodiment of the present invention can transmit a video stream directly to a target server, and by accessing the target server, the user can observe the cooking status in the kitchen at each point in time in real time. They can also observe real-time images of the current kitchen and grasp the progress of cooking remotely, thereby improving cooking efficiency.

[0148] Based on any of the above embodiments, after performing image processing on image data and obtaining a target image after processing, the control method further includes the steps of generating a corresponding adjustment command based on the target image and sending the adjustment command to a cooking appliance so that the cooking appliance adjusts cooking parameters based on the adjustment command.

[0149] In the embodiments of the present invention, the image data may be video stream data or photographic data. Here, if the video stream data is photographic data, the cooking appliance can periodically take photographs of the kitchen interior according to a set time interval and form them as photographic data, and the cooking appliance uploads these photographic data to a target server.

[0150] After the target server receives image data, it performs the appropriate processing on the image data and obtains the processed target image. After obtaining the target image, it performs image content recognition on the target image, thereby intelligently determining the real-time cooking status in the kitchen. If it detects a change in the state of the ingredients, such as smoke being generated in the kitchen or ingredients turning black and "burning" during cooking, it automatically generates an adjustment command to reduce the output of the cooking appliances. Furthermore, for example, after a predetermined cooking time has been reached, it determines the cooking completion status of the ingredients being cooked based on the target image. If the cooking completion status of the ingredients being cooked has not reached the expected state, it automatically generates an adjustment command to increase the output of the cooking appliances.

[0151] After generating the adjustment command, the target server sends the command to the cooking appliance. Upon receiving the adjustment command, the cooking appliance adjusts its cooking parameters, such as heating output, based on the command, thereby achieving automated control of the cooking process.

[0152] The cooking appliance according to the embodiment of the present invention can capture image data of the cooking room and upload it to a server, and the target server uses image recognition technology to determine the cooking state of the food. If a change occurs in the cooking state of the food, it generates a corresponding adjustment command to ensure the cooking effect and increase the success rate of cooking in cooking appliances such as ovens.

[0153] Based on any of the embodiments described above, the image data includes multiple photographic data, and the target image includes a second video. The steps of performing image processing on the image data and obtaining the processed target image include: determining the first photograph as the target frame if the first photograph among the multiple photographic data does not contain a predetermined target; performing algorithmic processing on the second photograph among the multiple photographic data if the second photograph among the multiple photographic data contains a predetermined target, and determining the processed second photograph as the target frame (where the processed second photograph does not contain a predetermined target); sorting the multiple target frames according to the order in which the multiple photographic data corresponding to the multiple target frames were received to obtain a frame sequence; and generating a second video based on the frame sequence.

[0154] In the embodiments of the present invention, the image data uploaded by the cooking appliance includes multiple photographic data, where the multiple photographic data may be photographs taken periodically by the cooking appliance at set time intervals within the cooking room.

[0155] When the target server receives multiple photo data files, it optimizes the captured photos by performing algorithmic processing on the received photo data.

[0156] For example, the target server first performs target identification on the photo data and then determines whether or not the photo data contains a predetermined target.

[0157] Here, the designated target may be an area of ​​image distortion caused by water droplets, a bright spot caused by strong light from outside, or a reflection formed inside the cooking area by light irradiation from an object outside the cooking appliance. These factors affect the final image effect.

[0158] Therefore, if it is determined that the received photographic data contains the predetermined target described above, the photographic data containing the predetermined target can be processed using a predetermined processing method. For example, the photographic data can be processed using the optical flow method.

[0159] For example, if the photographic data contains areas of image distortion caused by water droplets, the system can search for an adjacent photographic frame that does not contain such distortion and whose shooting time is closest to that of the current photographic data. By extracting the portion of the same image area within that frame that does not contain the water droplet image and replacing the distortion area in the current photographic data with this extracted portion, the effects of image distortion caused by water droplets can be eliminated.

[0160] For example, if photographic data includes reflections from external objects, the system identifies the reflection areas using optical flow changes and applies a segmentation process to these areas to ensure that the final target image is unaffected by the reflections.

[0161] When a single photo data is received, if the current photo data, i.e., the first photo, does not contain the predetermined target described above, the photo frame of the photo data is directly set as the target frame.

[0162] If the current photographic data, i.e., the second photograph, contains a predetermined target, the algorithm removes the predetermined target from the second photograph, and then sets the processed second photograph as the target frame.

[0163] After obtaining multiple target frames, these target frames are sorted according to the time order in which the original image data corresponding to these target frames was received, a sorted frame sequence is obtained, and a synthesis process is performed on this frame sequence to generate the final second video.

[0164] Each video frame in the second video is either unaffected by external influences or has been processed by an algorithm. Therefore, the video effects in the second video are superior. Users can download the second video via a mobile phone application, save it as a cooking record, edit it using predefined templates (such as color adjustments and adding subtitles), and share the edited video with a single click.

[0165] The embodiment of this invention enhances the enjoyment of cooking and enriches the effectiveness of using cooking appliances by performing algorithmic optimization processing on image data uploaded by cooking appliances, and generating a video from the optimized image frames for storage or sharing.

[0166] Based on any of the above embodiments, the step of performing image processing on image data and obtaining a target image after processing includes the step of obtaining predetermined color gamut calibration information, and the step of performing color gamut calibration on the image data based on the color gamut calibration information and obtaining a calibrated target image.

[0167] In the embodiments of the present invention, when the target server receives image data, it acquires corresponding color gamut calibration information, where the color gamut calibration information may be a calibration matrix corresponding to different color gamuts set based on prior knowledge.

[0168] Based on color gamut calibration information, a color gamut calibration process is performed on the received image data, thereby enhancing the color reproduction effect of the final target image and optimizing the imaging quality of the target image. This allows the target image to more accurately reproduce the actual appearance of the food being cooked, making it easier for users to view or share.

[0169] The embodiment of this invention can improve the color reproduction of the generated target image and optimize the imaging quality of the target image by calibrating the image data.

[0170] Based on any of the embodiments described above, the cooking appliance includes a door body, and after receiving image data transmitted from the cooking appliance, the control method includes the steps of performing object identification on the image data and, if the target image frame in the image data includes a door body and the door body is in an open state, deleting the target image frame.

[0171] In the embodiment of this invention, when the cooking appliance is in operation, an image sensor collects image data of the cooking area in real time. If the user opens the door of the cooking appliance, the user may be captured in the image data collected by the image sensor.

[0172] When the target server receives image data and identifies that the door of a cooking appliance is open, it deletes all image frames that identify the open door. This prevents image frames containing the user from being uploaded to the server, thereby protecting the user's privacy.

[0173] In some embodiments of the present invention, Figure 4 shows a schematic diagram of the interaction between a cooking appliance and a target server according to an embodiment of the present invention. As shown in Figure 4, the cooking appliance can upload video stream data and photo data to the target server. The target server's video cloud service pushes the video stream data to the user's mobile phone, allowing the user to view it in real time. The target server's algorithmic cloud service performs algorithmic processing on the photo data, obtains the processed target image, and can perform sharing processing on the target image.

[0174] As an example, if we consider the cooking appliance as an oven and the image sensor as a camera, the camera collects video and images of the food being cooked in real time. Here, the video stream is transmitted to a video cloud, which establishes a connection with the user's mobile phone and observes the video remotely. The images are transmitted to an algorithm cloud, which performs optimization processing on the images, integrates all the photos of the cooking process, and generates and shares a short video of the cooking process.

[0175] Here, the algorithm cloud completes real-time monitoring of the cooking process, determines the cooking completion status of the food being cooked, and adjusts the cooking parameters with feedback to increase the success rate of cooking.

[0176] The algorithmic cloud-based image optimization process includes detecting oven door opening and closing, removing water droplet noise from images, removing reflections of external objects from the oven, and beautifying the image effects. Each photograph is saved after undergoing the above processing and used to generate short cooking videos.

[0177] Regarding oven door open / close detection, the camera continues to take pictures even if the user opens the oven door. To protect user privacy and avoid interference with the cooking process, a comparison algorithm determines whether the current picture is a normal cooking image inside the oven. If it is not a normal cooking image, for example, if the oven door is open, the picture is deleted directly.

[0178] Regarding the image water droplet noise reduction algorithm, during oven cooking, moisture in food evaporates, forming water droplets on the oven's inner wall. These water droplets in front of the camera significantly affect the imaging effect. An optical flow change detection algorithm between images detects the location of the water droplets and replaces the images containing the water droplets with images that do not contain them.

[0179] Regarding the algorithm for removing reflections from external objects in the oven, when external light is strong, reflections of external objects occur inside the oven, affecting the imaging effect. By identifying areas with reflections through optical flow changes and applying segmentation processing to these areas, the shared image is free from interference caused by reflections.

[0180] Regarding the beautification of imaging effects, based on prior knowledge, it is possible to optimize imaging quality and improve the appearance of food by setting calibration matrices for different color gamuts.

[0181] The photos collected by the oven are uploaded to the server in high resolution at regular intervals.

[0182] The video cloud stores uploaded video streams, which users can view later. Video stream collection automatically starts uploading when cooking begins and stops automatically when cooking is complete, or users can actively start and stop retrieval.

[0183] In some embodiments of the present application, a control device is provided that is applied to a cooking appliance, the cooking appliance including a cooking chamber, an image sensor provided in the cooking chamber, Figure 5 shows a structural block diagram of the control device according to an embodiment of the present application, as shown in Figure 5, the control device 500 includes a collection module 502 for collecting image data from the cooking chamber by the image sensor, and a first transmission module 504 for transmitting the image data to a target server, the target server performs image processing on the image data and obtains a target image after processing, the target server interacts with a target terminal, the target terminal obtains and displays the target image.

[0184] In the embodiments of the present invention, the cooking appliance specifically includes an oven, a steam oven, etc., and the cooking appliance is provided with an image sensor, which specifically includes a camera module, and the image sensor is provided in the cooking chamber and is used to capture image data of the food being cooked while the cooking appliance is in operation.

[0185] For example, when a cooking appliance is in operation, the image sensor collects image data of the food being cooked in the kitchen in real time, and the image data may be video stream data or photographic frame data.

[0186] After capturing image data, the cooking appliance synchronously transmits the image data to the target server via a wireless network connection.

[0187] After the target server receives the image data, it performs the corresponding image processing on the image data. For example, if the image data is video stream data, the target server performs the corresponding compression processing on the video stream data. If the image data is photo frame data, the target server performs processing such as masking, beautification, and filtering on the photo frame data and obtains the processed target image.

[0188] Users can establish a relationship with cooking appliances by logging into an account bound to the appliance via a device such as a mobile phone, or by scanning an identification code attached to the appliance. By accessing a target server through an application installed on the device used to log into the account or establish the relationship, the system can obtain target images of the ingredients being cooked uploaded by the appliance during the cooking process, thereby monitoring the cooking progress of the appliance in real time.

[0189] As can be understood, users can remotely control cooking appliances by sending control commands to the appliances in real time via an application to adjust cooking parameters while observing the cooking progress of the appliances via a device such as a mobile phone.

[0190] The cooking appliance according to the embodiment of the present invention can actively upload image data during cooking, which helps the user to remotely monitor the cooking progress of the ingredients being cooked, eliminating the need for the user to frequently check the cooking status in front of the appliance and improving cooking efficiency.

[0191] Based on any of the above embodiments, the image data includes video stream data, and the target image includes video stream data and a first video corresponding to the video stream data.

[0192] In the embodiments of the present invention, the image data collected by the image sensor in the cooking room specifically includes video stream data, which is specifically video data transmitted continuously and persistently over a network, and when the target server receives the video stream data, it continuously performs solidification and storage processing on this video stream data to form a first video.

[0193] When a user accesses the target server via a device such as a mobile phone, they can directly choose to play and view video stream data. The video stream data reflects real-time footage from the kitchen, allowing the user to understand the real-time cooking status of the ingredients being prepared.

[0194] Users can also choose to play the first video, which contains all video footage from the moment the cooking appliance started cooking until the present. Users can observe images of the ingredients being cooked at each point in time after cooking began, using methods such as fast-forwarding and dragging the progress bar, which helps users judge the cooking effect.

[0195] The cooking appliance according to the embodiment of the present invention can transmit a video stream directly to a target server, and by accessing the target server, the user can observe the cooking status in the kitchen at each point in time in real time. They can also observe real-time images of the current kitchen and grasp the progress of cooking remotely, thereby improving cooking efficiency.

[0196] Based on any of the embodiments described above, the image data includes photographic data, and the control method further includes the steps of receiving an adjustment command determined by the target server based on the image data, and adjusting the cooking parameters of the cooking appliance based on the adjustment command.

[0197] In the embodiment of the present invention, the cooking appliance can periodically take photographs of the kitchen interior according to a set time interval and form them as photographic data, and the cooking appliance uploads these photographic data to a target server.

[0198] When capturing photographic data, the data is captured in the form of a single-frame image, which reduces the network bandwidth requirement and makes it possible to capture higher-resolution images.

[0199] When the target server receives photographic data, it performs image content recognition on the high-resolution images, thereby intelligently determining the real-time cooking status inside the kitchen. If it detects changes in the state of the ingredients, such as smoke being generated in the kitchen or ingredients turning black and "burning" during cooking, it automatically generates an adjustment command to reduce the output of the cooking appliances. Furthermore, for example, after a predetermined cooking time has been reached, it determines the completion state of the ingredients being cooked based on the photographic data. If the ingredients being cooked have not reached the expected completion state, it automatically generates an adjustment command to increase the output of the cooking appliances.

[0200] After generating the adjustment command, the target server sends the command to the cooking appliance. Upon receiving the adjustment command, the cooking appliance adjusts its cooking parameters, such as heating output, based on the command, thereby achieving automated control of the cooking process.

[0201] The cooking appliance according to the embodiment of the present invention can capture high-resolution images of the cooking chamber and upload them to a server, and the target server uses image recognition technology to determine the cooking state of the food. If a change occurs in the cooking state of the food, it generates corresponding adjustment commands to ensure the cooking effect and increase the success rate of cooking in cooking appliances such as ovens.

[0202] Based on any of the embodiments described above, the control method further includes the step of controlling the image sensor to stop collecting image data when it receives an input to stop collection or detects a cooking completion signal from a cooking appliance.

[0203] In the embodiments of this invention, a user can input a stop-collection command through an application on a terminal device such as a mobile phone. In this case, the terminal device directly transmits a control signal to the target server or cooking appliance to stop collecting image data. Upon receiving the control signal, the image sensor in the cooking room stops collecting and uploading image data.

[0204] To make it clear, the user can initiate the collection stop operation via a control panel or switch button provided on the cooking appliance.

[0205] After the cooking appliance completes the cooking program set by the user, the appliance's main control system generates a cooking completion signal. Upon detecting the cooking completion signal, the image sensor also stops collecting image data.

[0206] The embodiment of this invention allows for free control of the image data acquisition process using cooking equipment, thereby improving the flexibility of the cooking equipment.

[0207] In some embodiments of the present application, a control method applied to a target server is provided, the target server performs data interaction with a target terminal, and Figure 6 shows a structural block diagram of a control device according to an embodiment of the present application, and as shown in Figure 6, the control device 600 is A receiving module 602 that receives image data transmitted from cooking appliances, A processing module 604 performs image processing on image data and obtains the target image after processing, The system includes a second transmission module 606 that, upon receiving a viewing request for a target image from a target terminal, sends the target image to the target terminal, thereby causing the target terminal to display the target image.

[0208] In the embodiments of this invention, the target server may be a cloud server and interact with the cooking appliance via a wireless network connection. The target server may also be a smart gateway or local server installed in the user's home and interact with the cooking appliance via a local area network.

[0209] Cooking appliances specifically include ovens, steam ovens, etc. The cooking appliances are equipped with image sensors, which specifically include camera modules, and the image sensors are installed in the cooking chamber and used to capture image data of the food being cooked while the cooking appliance is in operation.

[0210] For example, when a cooking appliance is in operation, the image sensor collects image data of the food being cooked in the kitchen in real time, and the image data may be video stream data or photographic frame data.

[0211] After capturing image data, the cooking appliance synchronously transmits the image data to the target server via a wireless network connection.

[0212] After the target server receives the image data, it performs the corresponding image processing on the image data. For example, if the image data is video stream data, the target server performs the corresponding compression processing on the video stream data. If the image data is photo frame data, the target server performs processing such as masking, beautification, and filtering on the photo frame data and obtains the processed target image.

[0213] Users can establish a relationship with cooking appliances by logging into an account bound to the appliance via a device such as a mobile phone, or by scanning an identification code attached to the appliance. By accessing a target server through an application installed on the device used to log into the account or establish the relationship, the system can obtain target images of the ingredients being cooked uploaded by the appliance during the cooking process, thereby monitoring the cooking progress of the appliance in real time.

[0214] As can be understood, users can remotely control cooking appliances by sending control commands to the appliances in real time via an application to adjust cooking parameters while observing the cooking progress of the appliances via a device such as a mobile phone.

[0215] The cooking appliance according to the embodiment of the present invention can actively upload image data during cooking, which helps the user to remotely monitor the cooking progress of the ingredients being cooked, eliminating the need for the user to frequently check the cooking status in front of the appliance and improving cooking efficiency.

[0216] Based on any of the embodiments described above, the image data includes video stream data, and the target image includes a first video corresponding to the video stream data.

[0217] In the embodiments of the present invention, the image data collected by the image sensor in the cooking room specifically includes video stream data, which is specifically video data transmitted continuously and persistently over a network, and when the target server receives the video stream data, it continuously performs solidification and storage processing on this video stream data to form a first video.

[0218] When a user accesses the target server via a device such as a mobile phone, they can directly choose to play and view video stream data. The video stream data reflects real-time footage from the kitchen, allowing the user to understand the real-time cooking status of the ingredients being prepared.

[0219] Users can also choose to play the first video, which contains all video footage from the moment the cooking appliance started cooking until the present. Users can observe images of the ingredients being cooked at each point in time after cooking began, using methods such as fast-forwarding and dragging the progress bar, which helps users judge the cooking effect.

[0220] The cooking appliance according to the embodiment of the present invention can transmit a video stream directly to a target server, and by accessing the target server, the user can observe the cooking status in the kitchen at each point in time in real time. They can also observe real-time images of the current kitchen and grasp the progress of cooking remotely, thereby improving cooking efficiency.

[0221] Based on any of the above embodiments, the control device further includes a generation module for generating a corresponding adjustment command based on a target image, and a second transmission module for transmitting the adjustment command to a cooking appliance, which then adjusts the cooking parameters based on the adjustment command.

[0222] In the embodiments of the present invention, the image data may be video stream data or photographic data. Here, if the video stream data is photographic data, the cooking appliance can periodically take photographs of the kitchen interior according to a set time interval and form them as photographic data, and the cooking appliance uploads these photographic data to a target server.

[0223] After the target server receives image data, it performs the appropriate processing on the image data and obtains the processed target image. After obtaining the target image, it performs image content recognition on the target image, thereby intelligently determining the real-time cooking status in the kitchen. If it detects a change in the state of the ingredients, such as smoke being generated in the kitchen or ingredients turning black and "burning" during cooking, it automatically generates an adjustment command to reduce the output of the cooking appliances. Furthermore, for example, after a predetermined cooking time has been reached, it determines the cooking completion status of the ingredients being cooked based on the target image. If the cooking completion status of the ingredients being cooked has not reached the expected state, it automatically generates an adjustment command to increase the output of the cooking appliances.

[0224] After generating the adjustment command, the target server sends the command to the cooking appliance. Upon receiving the adjustment command, the cooking appliance adjusts its cooking parameters, such as heating output, based on the command, thereby achieving automated control of the cooking process.

[0225] The cooking appliance according to the embodiment of the present invention can capture image data of the cooking room and upload it to a server, and the target server uses image recognition technology to determine the cooking state of the food. If a change occurs in the cooking state of the food, it generates a corresponding adjustment command to ensure the cooking effect and increase the success rate of cooking in cooking appliances such as ovens.

[0226] Based on any of the embodiments described above, the image data includes multiple photographic data, and the target image includes a second video. The control device includes a determination module for determining the first photograph as the target frame if the first photograph among the multiple photographic data does not contain a predetermined target, a processing module for performing algorithmic processing on the second photograph among the multiple photographic data if the second photograph among the multiple photographic data contains a predetermined target, and determining the processed second photograph as the target frame (where the processed second photograph does not contain the predetermined target), a sorting module for sorting the multiple target frames according to the reception order of the multiple photographic data corresponding to the multiple target frames to obtain a frame sequence, and a generation module for generating a second video based on the frame sequence.

[0227] In the embodiments of the present invention, the image data uploaded by the cooking appliance includes multiple photographic data, where the multiple photographic data may be photographs taken periodically by the cooking appliance at set time intervals within the cooking room.

[0228] When the target server receives multiple photo data files, it optimizes the captured photos by performing algorithmic processing on the received photo data.

[0229] For example, the target server first performs target identification on the photo data and then determines whether or not the photo data contains a predetermined target.

[0230] Here, the designated target may be an area of ​​image distortion caused by water droplets, a bright spot caused by strong light from outside, or a reflection formed inside the cooking area by light irradiation from an object outside the cooking appliance. These factors affect the final image effect.

[0231] Therefore, if it is determined that the received photographic data contains the predetermined target described above, the photographic data containing the predetermined target can be processed using a predetermined processing method. For example, the photographic data can be processed using the optical flow method.

[0232] For example, if the photographic data contains areas of image distortion caused by water droplets, the system can search for an adjacent photographic frame that does not contain such distortion and whose shooting time is closest to that of the current photographic data. By extracting the portion of the same image area within that frame that does not contain the water droplet image and replacing the distortion area in the current photographic data with this extracted portion, the effects of image distortion caused by water droplets can be eliminated.

[0233] For example, if photographic data includes reflections from external objects, the system identifies the reflection areas using optical flow changes and applies a segmentation process to these areas to ensure that the final target image is unaffected by the reflections.

[0234] When a single photo data is received, if the current photo data, i.e., the first photo, does not contain the predetermined target described above, the photo frame of the photo data is directly set as the target frame.

[0235] If the current photographic data, i.e., the second photograph, contains a predetermined target, the algorithm removes the predetermined target from the second photograph, and then sets the processed second photograph as the target frame.

[0236] After obtaining multiple target frames, these target frames are sorted according to the time order in which the original image data corresponding to these target frames was received, a sorted frame sequence is obtained, and a synthesis process is performed on this frame sequence to generate the final second video.

[0237] Each video frame in the second video is either unaffected by external influences or has been processed by an algorithm. Therefore, the video effects in the second video are superior. Users can download the second video via a mobile phone application, save it as a cooking record, edit it using predefined templates (such as color adjustments and adding subtitles), and share the edited video with a single click.

[0238] The embodiment of this invention enhances the enjoyment of cooking and enriches the effectiveness of using cooking appliances by performing algorithmic optimization processing on image data uploaded by cooking appliances, and generating a video from the optimized image frames for storage or sharing.

[0239] Based on any of the above embodiments, the control device further includes an acquisition module for acquiring predetermined color gamut calibration information, and a processing module for performing color gamut calibration on image data based on the color gamut calibration information and acquiring a calibrated target image.

[0240] In the embodiments of the present invention, when the target server receives image data, it acquires corresponding color gamut calibration information, where the color gamut calibration information may be a calibration matrix corresponding to different color gamuts set based on prior knowledge.

[0241] Based on color gamut calibration information, a color gamut calibration process is performed on the received image data, thereby enhancing the color reproduction effect of the final target image and optimizing the imaging quality of the target image. This allows the target image to more accurately reproduce the actual appearance of the food being cooked, making it easier for users to view or share.

[0242] The embodiment of this invention can improve the color reproduction of the generated target image and optimize the imaging quality of the target image by calibrating the image data.

[0243] Based on any of the above embodiments, the cooking appliance includes a door body, and after receiving image data transmitted from the cooking appliance, the control device further includes an identification module for performing object identification on the image data, and a deletion module for deleting the target image frame if the target image frame in the identified image data includes a door body and the door body is in an open state.

[0244] In the embodiment of this invention, when the cooking appliance is in operation, an image sensor collects image data of the cooking area in real time. If the user opens the door of the cooking appliance, the user may be captured in the image data collected by the image sensor.

[0245] When the target server receives image data and identifies that the door of a cooking appliance is open, it deletes all image frames that identify the open door. This prevents image frames containing the user from being uploaded to the server, thereby protecting the user's privacy.

[0246] In some embodiments of the present application, a control device is provided, and Figure 7 shows a structural block diagram of a control device according to an embodiment of the present application, and as shown in Figure 7, the control device 700 includes a memory 702 for storing a program or instruction, and a processor 704 for executing the program or instruction to realize the steps of the control method in any of the above embodiments, and therefore also includes all the beneficial effects of the control method in any of the above embodiments. To avoid duplication, these will not be described again here.

[0247] In some embodiments of the present application, a readable storage medium is provided on which a program or instruction is stored, and when the program or instruction is executed by a processor, the steps of the control method in any of the above embodiments are realized, and thus all the beneficial effects of the control method in any of the above embodiments are also included. To avoid duplication, these will not be described again here.

[0248] Some embodiments of the present application provide another cooking appliance that includes a control device according to any of the embodiments described above, and therefore includes all the beneficial effects of the control device according to any of the embodiments described above. To avoid duplication, these will not be described again here.

[0249] The eighth aspect of the present application provides a cooking appliance including a readable storage medium according to any of the above embodiments, and therefore includes all the beneficial effects of the readable storage medium according to any of the above embodiments. To avoid duplication, these will not be described again here.

[0250] A ninth aspect of the present application provides a cooking appliance including a control device according to any of the above embodiments and a readable storage medium according to any of the above embodiments, and therefore includes all the beneficial effects of the control device according to any of the above embodiments and the readable storage medium according to any of the above embodiments. To avoid duplication, these will not be described again here.

[0251] Based on any of the above embodiments, as shown in Figure 1, the cooking appliance 100 further includes a main body 102 including a cooking chamber 1022, and an image sensor 104 provided in the cooking chamber 1022 for collecting image data within the cooking chamber 1022.

[0252] In the embodiment of the present invention, the cooking appliance 100 is specifically an oven or a steam oven, and the oven body 102 is provided with a cooking chamber 1022, and the image sensor 104 is provided inside the cooking chamber, and while the cooking appliance 100 is in operation, the image sensor 104 can capture image data in real time of the food being cooked inside the cooking chamber 1022.

[0253] In this description, the term “multiple” refers to two or more. Unless otherwise explicitly stated, terms such as “up,” “down” indicate orientation or positional relationships based on the orientation or positional relationships shown in the drawings, and are used solely for the convenience and simplification of this description, and do not imply or suggest that the devices or elements referred to must have a particular orientation or must be configured and operated in a particular orientation. Therefore, they should not be construed as limiting this application. The terms “connect,” “attach,” and “fix” should be understood broadly, for example, “connection” may be a fixed connection, a detachable connection, or an integral connection, and may be a direct connection or an indirect connection via an intermediate medium. A person skilled in the art will be able to understand the specific meaning of the above terms in this application in accordance with the specific context.

[0254] In this description, terms such as “one embodiment,” “several embodiments,” and “specific embodiments” mean that the specific features, structures, materials, or properties described in combination with the embodiments or examples are included in at least one embodiment or example of this application. In this specification, the exemplary expressions of the above terms do not necessarily refer to the same embodiment or example. Furthermore, the specific features, structures, materials, or properties described may be combined in any suitable manner in any one or more embodiments or examples.

[0255] While preferred embodiments of the present application have been described above, the present application may have various modifications and changes for those skilled in the art without limiting it. Any modifications, equivalent substitutions, improvements, etc., within the spirit and principles of the present application should all fall within the scope of protection. [Explanation of Symbols]

[0256] 100 Cooking Utensils 102 Main Unit 1022 Galley 104 Image Sensor

Claims

1. A control method applied to a cooking appliance that includes a cooking room, and in the cooking room an image sensor is provided, The steps include: collecting image data from the cooking room using the image sensor; The step includes sending the aforementioned image data to a target server, The target server performs image processing on the image data, obtains the processed target image, and interacts with the target terminal to obtain and display the target image on the target terminal. A control method characterized by the following:

2. The image data includes video stream data, and the target image includes the video stream data and a first video corresponding to the video stream data. The control method according to feature 1.

3. The aforementioned image data includes photographic data. The control method described above is The steps include receiving an adjustment command determined by the target server based on the image data, The further step includes adjusting the cooking parameters of the cooking appliance based on the adjustment command, The control method according to feature 1.

4. The further step includes controlling the image sensor to stop collecting the image data when it receives an input to stop collection or detects a cooking completion signal from the cooking appliance, The control method according to any one of claims 1 to 3.

5. A control method applied to a target server that performs data interaction with a target terminal, The steps include receiving image data transmitted from a cooking appliance, The steps include: performing image processing on the aforementioned image data and obtaining the processed target image; The process includes the step of receiving a viewing request for the target image from the target terminal, and then transmitting the target image to the target terminal to display the target image on the target terminal. A control method characterized by the following:

6. The image data includes video stream data, and the target image includes a first video corresponding to the video stream data. The control method according to feature 5.

7. After the step of performing image processing on the image data and obtaining the processed target image, the control method: The steps include generating a corresponding adjustment command based on the target image, The further step includes transmitting the adjustment command to the cooking appliance so that the cooking appliance adjusts the cooking parameters based on the adjustment command, The control method according to feature 5.

8. The aforementioned image data includes multiple photographic data, and the aforementioned target image includes a second video. The step of performing image processing on the aforementioned image data and obtaining the processed target image is: The steps include determining the first photograph as the target frame when the first photograph among the multiple photographic data does not contain a predetermined target, If the second photograph among the multiple photographic data contains the predetermined target, the process involves performing algorithmic processing on the second photograph to determine the processed second photograph as the target frame, wherein the processed second photograph does not contain the predetermined target. The steps include sorting the multiple target frames according to the order in which the multiple photographic data corresponding to the multiple target frames were received, and obtaining a frame sequence, The step of generating the second video based on the frame sequence is included, The control method according to feature 5.

9. The step of performing image processing on the aforementioned image data and obtaining the processed target image is: A step to acquire predetermined color gamut calibration information, The process includes the steps of performing color gamut calibration on the image data based on the color gamut calibration information and obtaining the calibrated target image. The control method according to feature 5.

10. The cooking appliance includes a door body, and after the step of receiving image data transmitted from the cooking appliance, the control method The steps include: performing object identification on the aforementioned image data, The further step includes, if it is identified that the target image frame in the image data includes the door body and that the door body is in an open state, deleting the target image frame. The control method according to any one of claims 5 to 9.

11. A control device applied to a cooking appliance, which includes a cooking room, and the cooking room is equipped with an image sensor, A collection module for collecting image data from the cooking room using the aforementioned image sensor, It includes a first transmission module for transmitting the aforementioned image data to a target server, The target server performs image processing on the image data, obtains the processed target image, and interacts with the target terminal to obtain and display the target image on the target terminal. A control device characterized by the following features.

12. A control device applied to a target server that performs data interaction with a target terminal, A receiving module for receiving image data transmitted from cooking appliances, A processing module for performing image processing on the aforementioned image data and obtaining the processed target image, A second transmission module, which, upon receiving a viewing request for the target image from the target terminal, transmits the target image to the target terminal to cause the target terminal to display the target image, is included. A control device characterized by the following features.

13. Memory for storing programs or instructions, When executing the program or instruction, the processor includes a processor for realizing the steps of the control method described in any one of claims 1 to 10. A control device characterized by the following features.

14. A readable storage medium in which a program or instruction is stored, When the program or instruction is executed by the processor, the steps of the control method described in any one of claims 1 to 10 are realized. A readable storage medium characterized by the following features.

15. A control device according to any one of claims 11 to 13, A cooking utensil characterized by the following features.

16. A readable storage medium as described in claim 14, A cooking utensil characterized by the following features.

17. A control device according to any one of claims 11 to 13, A readable storage medium according to claim 14, A cooking utensil characterized by the following features.

18. The main body, including the kitchen, The cooking chamber further includes an image sensor provided in the cooking chamber for collecting image data of the cooking chamber, A cooking utensil according to any one of claims 15 to 17, characterized by the features described herein.

Images