Automatic cooking system based on image recognition and intelligent cooking equipment

Abstract

The utility model provides an automatic cooking system and intelligent cooking equipment based on image recognition. The automatic cooking system comprises an image acquisition device, an image processing device, a recognition device and a display device, the image acquisition device, the image processing device, the recognition device and the display device are connected in sequence; the image acquisition device is used for acquiring video images in the process of relative movement with food materials; the image processing device is used for receiving the video image sent by the image acquisition device and performing picture conversion on the video image to obtain a processed image; the recognition device is used for comparing the processed image with a food material image pre-stored in a database, recognizing the type of the food material and sending the type of the food material to the display device; the display device is used for receiving the types of the food materials sent by the recognition device and displaying the types of the food materials and the corresponding cooking information in the database; the types of the food materials can be automatically recognized through the image recognition technology, and automatic cooking is conducted according to the types of the food materials and the corresponding cooking information in the database.

Description

Technical Field

[0001] The utility model relates to the technical field of automatic cooking, in particular to an automatic cooking system and intelligent cooking equipment based on image recognition. Background Art

[0002] In the traditional cooking process, the cook needs to have the corresponding cooking skills and experience to correctly grasp the key factors such as cooking time and temperature. However, even the most experienced cooks may make cooking mistakes due to fatigue, negligence and other reasons.

[0003] Moreover, the cooking process can be complicated and difficult for beginners or those who do not have specific skills. Utility Model Content

[0004] In view of this, the purpose of the present invention is to provide an automatic cooking system and intelligent cooking equipment based on image recognition, which can automatically identify the type of ingredients through image recognition technology, and automatically cook according to the type of ingredients and the corresponding cooking information in the database.

[0005] In a first aspect, an embodiment of the utility model provides an automatic cooking system based on image recognition, the system comprising: an image acquisition device, an image processing device, a recognition device and a display device; the image acquisition device, the image processing device, the recognition device and the display device are connected in sequence;

[0006] The image acquisition device is used to acquire video images during the relative movement between the food and the food, and send the video images to the image processing device;

[0007] The image processing device is used to receive the video image sent by the image acquisition device, perform picture conversion on the video image to obtain a processed image, and send the processed image to the recognition device;

[0008] The recognition device is used to compare the processed image with the food image pre-stored in the database, identify the type of the food, and send the type of the food to the display device;

[0009] The display device is used to receive the type of the food sent by the identification device, and display the type of the food and the corresponding cooking information in the database.

[0010] Further, the image acquisition device includes a camera;

[0011] The camera is used to capture the video image while adjusting the angle;

[0012] or,

[0013] The video images are captured as the food moves.

[0014] Furthermore, the system further comprises a rotating grill device, the image acquisition device is mounted on the rotating grill device, and the rotating grill device is provided with a rotating motor;

[0015] The rotary motor is used to rotate the baking tray on which the food is placed in an all-round manner.

[0016] Furthermore, the system further comprises a pan-tilt platform, and the image acquisition device is arranged on the pan-tilt platform;

[0017] By rotating the pan up and down and left and right, the image acquisition device can acquire video images of the food in all directions.

[0018] Further, the system also includes a cooking device;

[0019] The cooking device is used to cook the ingredients according to the cooking information displayed by the display device.

[0020] Further, the system also includes a modification device;

[0021] The modification device is used to obtain modification information input by the user and modify the cooking process according to the modification information;

[0022] The modified information includes the modified heating time and the modified heating temperature.

[0023] Furthermore, the cooking device is also used to cook the ingredients according to the modified heating time and the modified heating temperature.

[0024] In a second aspect, an embodiment of the utility model provides an intelligent cooking device, including the automatic cooking system based on image recognition as described above.

[0025] Furthermore, the intelligent cooking device includes a box body, a cooking cavity is arranged in the box body, and a heating device for heating food is arranged in the cooking cavity.

[0026] Furthermore, the box body is also provided with a fan system for achieving air circulation between the cooking cavity and the external environment.

[0027] The embodiment of the utility model provides an automatic cooking system and intelligent cooking equipment based on image recognition, comprising: an image acquisition device, an image processing device, an identification device and a display device; the image acquisition device, the image processing device, the identification device and the display device are connected in sequence; the image acquisition device is used to acquire video images during relative movement with the food, and send the video images to the image processing device; the image processing device is used to receive the video images sent by the image acquisition device, convert the video images into pictures, obtain processed images, and send the processed images to the identification device; the identification device is used to compare the processed images with the food images pre-stored in the database, identify the types of the food, and send the types of the food to the display device; the display device is used to receive the types of the food sent by the identification device, and display the types of the food and the corresponding cooking information in the database; the types of the food can be automatically identified through image recognition technology, and automatic cooking can be performed according to the types of the food and the corresponding cooking information in the database.

[0028] Other features and advantages of the utility model will be described in the following description, and partly become apparent from the description, or understood by practicing the utility model. The purpose and other advantages of the utility model are realized and obtained by the structures specifically pointed out in the description, claims and drawings.

[0029] In order to make the above-mentioned objects, features and advantages of the present invention more obvious and easy to understand, preferred embodiments are given below and described in detail with reference to the accompanying drawings. BRIEF DESCRIPTION OF THE DRAWINGS

[0030] In order to more clearly illustrate the specific implementation methods of the utility model or the technical solutions in the prior art, the drawings required for use in the specific implementation methods or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are some implementation methods of the utility model. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0031] Figure 1 A schematic diagram of an automatic cooking system based on image recognition provided in Embodiment 1 of the present utility model;

[0032] Figure 2 This is a schematic diagram of the structure of the intelligent cooking device provided in Example 2 of the present utility model.

[0033] icon:

[0034] 1-image acquisition device; 2-image processing device; 3-recognition device; 4-display device; 5-box; 6-cooking cavity; 7-button. DETAILED DESCRIPTION

[0035] In order to make the purpose, technical solution and advantages of the embodiments of the utility model clearer, the technical solution of the utility model will be clearly and completely described below in conjunction with the accompanying drawings. Obviously, the described embodiments are part of the embodiments of the utility model, not all of the embodiments. Based on the embodiments of the utility model, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the utility model.

[0036] To facilitate understanding of this embodiment, the embodiment of the utility model is described in detail below.

[0037] Embodiment 1:

[0038] Figure 1 This is a schematic diagram of an automatic cooking system based on image recognition provided in Example 1 of the utility model.

[0039] Reference Figure 1 The system comprises: an image acquisition device 1, an image processing device 2, a recognition device 3 and a display device 4; the image acquisition device 1, the image processing device 2, the recognition device 3 and the display device 4 are connected in sequence;

[0040] The image acquisition device 1 is used to acquire video images during the relative movement between the food and the food, and send the video images to the image processing device 2;

[0041] The image processing device 2 is used to receive the video image sent by the image acquisition device 1, convert the video image into a picture, obtain a processed image, and send the processed image to the recognition device 3;

[0042] The recognition device 3 is used to compare the processed image with the food image pre-stored in the database, recognize the type of food, and send the type of food to the display device 4;

[0043] The display device 4 is used to receive the type of food sent by the identification device 3, and display the type of food and the corresponding cooking information in the database.

[0044] Specifically, the image processing device 2 converts the video image into a picture to obtain a processed image. The implementation process is as follows: 1) Video decoding: First, the recorded video image needs to be decoded. The video stream is usually encoded in a compression format (such as MPEG, AVC, HEVC, etc.), which can reduce the size of the video file for easy storage and transmission. Decoding the video stream requires a decoder to convert these compressed data into original image data. 2) Frame extraction: On the basis of decoding, extract individual frames, that is, static images; each frame represents a frame in the video. 3) Select the images to be spliced, which should have some correlation and similarity to facilitate splicing. For example, they may be a set of images with continuous viewing angles, or images of the same scene from different angles. 4) Image preprocessing: Preprocess each image to prepare for splicing. Preprocessing may include image enhancement, noise reduction, image registration, etc. The purpose of this step is to make all images have consistent scale and contrast before splicing. 5) Feature extraction: Feature extraction is performed on each image to identify key points in the image. These key points can be edges, corners, spots, etc. Feature extraction can be achieved using various algorithms, such as SIFT, SURF, ORB, etc. 6) Keypoint matching: Find matching key points in each image. This can be done by calculating the similarity between key points. Once the matching key points are found, they can be connected to form a global correspondence table. 7) Geometric transformation: Based on the matching results of the key points, each image is geometrically transformed to align them. This may include rotation, translation, scaling, etc. Geometric transformation can be achieved using various algorithms, such as homography transformation, projection transformation, etc. 8) Image fusion: The geometrically transformed images are fused into a larger image. This can be done using various image fusion techniques, such as pixel-based fusion, region-based fusion, multi-scale fusion, etc. 9) Post-processing: The fused image is post-processed to optimize the quality of the image. This may include color adjustment, contrast enhancement, sharpening, etc. 10) Image output: The synthesized image can be output in a specified format, such as saving to a local file or uploading to a server.

[0045] Furthermore, the image acquisition device 1 includes a camera;

[0046] A camera, used to capture video images while adjusting the angle;

[0047] or,

[0048] Capture video images as food moves.

[0049] Specifically, when the camera adjusts its angle to capture video images, the camera is moving; when the camera captures video images as the food moves, both the camera and the food are moving.

[0050] Furthermore, the system also includes a rotating grill device, the image acquisition device is installed on the rotating grill device, and a rotating motor is provided on the rotating grill device;

[0051] The rotary motor is used to rotate the baking tray on which the ingredients are placed in all directions.

[0052] Specifically, the image acquisition device 1 is installed on the rotating grill device. When the rotating motor of the rotating grill device starts to rotate 360 ​​degrees, the image acquisition device acquires the video image of the food. During the rotation process, the image acquisition device records the video image of the food in all directions. The image acquisition device can be a camera.

[0053] Furthermore, the system also includes a pan-tilt platform, and the image acquisition device 1 is arranged on the pan-tilt platform;

[0054] By rotating the pan-tilt platform up, down, left, and right, the image acquisition device can capture video images of the food in all directions.

[0055] Specifically, the image acquisition device 1 is installed at the position farthest from the center of the baking pan, so that the widest angle video image can be captured. The pan / tilt head is controlled to rotate up, down, left, and right, so that the image acquisition device can capture the video image on the entire baking pan.

[0056] Further, the system includes a cooking device;

[0057] The cooking device is used for cooking food according to the cooking information displayed by the display device.

[0058] Further, the system also includes a modification device;

[0059] A modification device, used to obtain modification information input by a user and modify the cooking process according to the modification information;

[0060] The modified information includes the modified heating time and the modified heating temperature.

[0061] Furthermore, the cooking device is also used to cook the ingredients according to the modified heating time and the modified heating temperature.

[0062] The present application uses image recognition technology to automatically identify the type of food and automatically cook according to the type of food and the corresponding cooking information in the database. In addition, the user can also modify the cooking process as needed. Therefore, the automatic cooking system of the present application can not only improve the efficiency and accuracy of cooking, but also is suitable for people without specific cooking skills.

[0063] Embodiment 2:

[0064] Figure 2 This is a schematic diagram of the structure of the intelligent cooking device provided in Example 2 of the present utility model.

[0065] Reference Figure 2 , intelligent cooking device, including the automatic cooking system based on image recognition as described above.

[0066] The intelligent cooking device comprises a box body 5 , a cooking cavity 6 is arranged in the box body 5 , a heating device for heating food is arranged in the cooking cavity 6 , and a button 7 is also included.

[0067] A fan system for achieving air circulation between the cooking cavity 6 and the external environment is also provided in the box 5. The intelligent cooking device is an oven or a steam-bake all-in-one machine.

[0068] The embodiment of the utility model provides an automatic cooking system and intelligent cooking equipment based on image recognition, comprising: an image acquisition device, an image processing device, an identification device and a display device; the image acquisition device, the image processing device, the identification device and the display device are connected in sequence; the image acquisition device is used to acquire video images during relative movement with the food, and send the video images to the image processing device; the image processing device is used to receive the video images sent by the image acquisition device, convert the video images into pictures, obtain processed images, and send the processed images to the identification device; the identification device is used to compare the processed images with the food images pre-stored in the database, identify the types of the food, and send the types of the food to the display device; the display device is used to receive the types of the food sent by the identification device, and display the types of the food and the corresponding cooking information in the database; the types of the food can be automatically identified through image recognition technology, and automatic cooking can be performed according to the types of the food and the corresponding cooking information in the database.

[0069] Those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working process of the system and device described above can refer to the corresponding process in the aforementioned method embodiment, and will not be repeated here.

[0070] In addition, in the description of the embodiments of the present invention, unless otherwise clearly specified and limited, the terms "installed", "connected", and "connected" should be understood in a broad sense, for example, it can be a fixed connection, a detachable connection, or an integral connection; it can be a mechanical connection or an electrical connection; it can be a direct connection, or it can be indirectly connected through an intermediate medium, or it can be the internal communication of two components. For ordinary technicians in this field, the specific meanings of the above terms in the present invention can be understood according to specific circumstances.

[0071] If the functions are implemented in the form of software functional units and sold or used as independent products, they can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the utility model can be essentially or partly embodied in the form of a software product that contributes to the prior art. The computer software product is stored in a storage medium and includes several instructions for a computer device (which can be a personal computer, a server, or a network device, etc.) to perform all or part of the steps of the method described in each embodiment of the utility model. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), disk or optical disk, etc., which can store program codes.

[0072] In the description of the present invention, it should be noted that the terms "center", "upper", "lower", "left", "right", "vertical", "horizontal", "inner", "outer", etc., indicating the orientation or positional relationship, are based on the orientation or positional relationship shown in the drawings, and are only for the convenience of describing the present invention and simplifying the description, rather than indicating or implying that the device or element referred to must have a specific orientation, be constructed and operated in a specific orientation, and therefore cannot be understood as limiting the present invention. In addition, the terms "first", "second", and "third" are used for descriptive purposes only, and cannot be understood as indicating or implying relative importance.

[0073] Finally, it should be noted that the above-described embodiments are only specific implementation methods of the utility model, which are used to illustrate the technical solution of the utility model, rather than to limit it. The protection scope of the utility model is not limited thereto. Although the utility model is described in detail with reference to the above-mentioned embodiments, ordinary technicians in this field should understand that any technician familiar with the technical field can still modify the technical solution recorded in the above-mentioned embodiments within the technical scope disclosed by the utility model, or can easily think of changes, or make equivalent replacements for some of the technical features therein; and these modifications, changes or replacements do not make the essence of the corresponding technical solution deviate from the spirit and scope of the technical solution of the embodiment of the utility model, and should be included in the protection scope of the utility model. Therefore, the protection scope of the utility model shall be based on the protection scope of the claims.

Claims

1. An automatic cooking system based on image recognition, characterized in that: The system comprises: an image acquisition device, an image processing device, a recognition device and a display device; the image acquisition device, the image processing device, the recognition device and the display device are connected in sequence; The image acquisition device is used to acquire video images during the relative movement between the food and the food, and send the video images to the image processing device; The image processing device is used to receive the video image sent by the image acquisition device, perform picture conversion on the video image to obtain a processed image, and send the processed image to the recognition device; The recognition device is used to compare the processed image with the food image pre-stored in the database, identify the type of the food, and send the type of the food to the display device; The display device is used to receive the type of the food sent by the identification device, and display the type of the food and the corresponding cooking information in the database; The image acquisition device includes a camera; The camera is used to capture the video image while adjusting the angle; or, collecting the video image as the food moves; The system further comprises a rotating grill device, the image acquisition device is mounted on the rotating grill device, and a rotating motor is provided on the rotating grill device; The rotary motor is used to rotate the baking tray on which the food is placed in an all-round manner.

2. The automatic cooking system based on image recognition according to claim 1, characterized in that: The system further comprises a pan-tilt platform, and the image acquisition device is arranged on the pan-tilt platform; By rotating the pan up and down and left and right, the image acquisition device can acquire video images of the food in all directions.

3. The automatic cooking system based on image recognition according to claim 1, characterized in that: The system also includes a cooking device; The cooking device is used to cook the ingredients according to the cooking information displayed by the display device.

4. The automatic cooking system based on image recognition according to claim 1, characterized in that: The system further comprises a modification device; The modification device is used to obtain modification information input by the user and modify the cooking process according to the modification information; The modified information includes the modified heating time and the modified heating temperature.

5. The automatic cooking system based on image recognition according to claim 4, characterized in that: The cooking device is also used to cook the food according to the modified heating time and the modified heating temperature.

6. An intelligent cooking device, characterized in that: An automatic cooking system based on image recognition comprising any one of claims 1 to 5.

7. The intelligent cooking device according to claim 6, characterized in that: The intelligent cooking device comprises a box body, a cooking cavity is arranged in the box body, and a heating device for heating food is arranged in the cooking cavity.

8. The intelligent cooking device according to claim 7, characterized in that: The box body is also provided with a fan system for achieving air circulation between the cooking cavity and the external environment.

Images