Dual-light module for cooking scene, data processing method and device

Abstract

The invention discloses a dual-light module for a cooking scene, and a data processing method and device. The dual-light module comprises an RGB camera used for acquiring an RGB image of detected food; the IR camera is used for acquiring an IR image of the detected food; the processor is used for determining the temperature distribution of the food materials according to the RGB image and the IR image; the circuit board is electrically connected with the RGB camera, the IR camera and the processor; the shell comprises a shell body, the shell body is provided with a containing cavity, the circuit board, the processor, the RGB camera and the infrared camera are arranged in the containing cavity, and the shell body is provided with a first lens hole matched with the RGB camera and a second lens hole matched with a lens of the infrared camera. The combination of the RGB camera and the IR camera is adopted, so that the RGB image and the IR image in the cooking process can be obtained, the temperature of food materials in the cooking process is obtained, the temperature is the most important physical quantity in the cooking process, and the cooking process can be more accurately quantified and accurately monitored by obtaining the temperature.

Description

Technical Field

[0001] The present application relates to the field of cooking technology, and in particular to a dual-light module, a data processing method and a device for cooking scenes. Background Art

[0002] For chain restaurant brands, it is very difficult to ensure uniform quality between stores. Restaurant brands will formulate strict SOPs (Standard Operating Procedures) for each dish. However, it is difficult to find appropriate quantitative standards for specific steps, such as the temperature of ingredients during cooking, and there is a lack of efficient and feasible monitoring methods. Summary of the invention

[0003] The present application provides a dual-light module, a data processing method and a device for a cooking scene.

[0004] According to a first aspect of the present application, the present application provides a dual-light module for a cooking scene, comprising:

[0005] An RGB camera is used to photograph the food to be tested placed in the measuring area and obtain an RGB image of the food to be tested;

[0006] An IR camera is used to photograph the food to be tested placed in the measuring area to obtain an IR image of the food to be tested;

[0007] a processor, configured to determine a temperature distribution of food according to the RGB image and the IR image;

[0008] A circuit board, electrically connected to the RGB camera, the IR camera and the processor respectively;

[0009] The shell comprises a shell and a base plate, wherein the shell is provided with a accommodating cavity and an opening at one end, the base plate is arranged on the opening, the circuit board, the processor, the RGB camera and the infrared camera are arranged in the accommodating cavity, and the shell is provided with a first lens hole respectively cooperating with the RGB camera and a second lens hole cooperating with the lens of the infrared camera.

[0010] The above-mentioned dual-light module also includes a first fill light that cooperates with the RGB camera.

[0011] The above-mentioned dual-light module also includes a second fill light that cooperates with the infrared camera.

[0012] The dual-optical module further comprises a plurality of interfaces recessed in the housing.

[0013] The above-mentioned dual-optical module, the interface includes a power interface, and / or a TYPE-C interface, and / or an HDMI interface, and / or a memory card interface, and / or a network port.

[0014] The above dual-optical module, the HDMI interface is used to connect to a display screen.

[0015] The above-mentioned dual-light module, the shell also includes a first hollow cylindrical bracket respectively matched with the first fill light and a second hollow cylindrical bracket matched with the second fill light.

[0016] According to a second aspect of the present application, the present application provides a dual-light module data processing method for a cooking scene, comprising:

[0017] The RGB camera shoots the food to be tested placed in the measuring area to obtain an RGB image of the food to be tested;

[0018] The IR camera photographs the food to be tested placed in the measuring area to obtain an IR image of the food to be tested;

[0019] The processor determines the temperature distribution of the food according to the RGB image and the IR image.

[0020] In the above dual-light module data processing method, the processor processes the image data and the temperature data to determine the temperature distribution of the food, including:

[0021] Selecting the RGB image and the IR image within the same time period;

[0022] Establishing a correspondence between the RGB image and the IR image according to the timestamp;

[0023] aligning the RGB image and the IR image according to the corresponding relationship;

[0024] Segment the RGB image to find the area where the food is located;

[0025] Acquire the temperature of the area where the food is located according to the IR image corresponding to the RGB image;

[0026] The temperature distribution of the food is determined according to a plurality of temperatures of the area where the food is located with the same time interval.

[0027] According to a third aspect of the present application, the present application provides a dual-light module data processing device for a cooking scene, comprising:

[0028] An RGB camera module is used to photograph the food to be tested placed in the measuring area and obtain an RGB image of the food to be tested;

[0029] An IR camera module is used to photograph the food to be tested placed in the measuring area to obtain an IR image of the food to be tested;

[0030] A processor is used to determine the temperature distribution of food according to the RGB image and the IR image.

[0031] Due to the adoption of the above technical solution, the beneficial effects of this application are:

[0032] The dual-light module for cooking scenes provided in the embodiment of the present application includes: an RGB camera for obtaining an RGB image of the food under test; an IR camera for obtaining an IR image of the food under test; a processor for determining the temperature distribution of the food according to the RGB image and the IR image; a circuit board, electrically connected to the RGB camera, the IR camera and the processor respectively; and a housing, including a shell, the shell having a receiving cavity, the circuit board, the processor, the RGB camera and the infrared camera being arranged in the receiving cavity, and the shell having a first lens hole respectively cooperating with the RGB camera and a second lens hole cooperating with the lens of the infrared camera. Since the embodiment of the present application adopts a combination of an RGB camera and an IR camera, the RGB image and the IR image of the cooking process can be obtained, thereby obtaining the temperature of the food during the cooking process. Temperature is the most important physical quantity in the cooking process. The acquisition of temperature allows us to quantify the cooking process more accurately and monitor it precisely. BRIEF DESCRIPTION OF THE DRAWINGS

[0033] Figure 1 This is a schematic diagram of the structure of a dual-light module in an embodiment of the present application in one implementation manner;

[0034] Figure 2 It is a structural schematic diagram of another implementation of the dual-light module in the embodiment of the present application;

[0035] Figure 3 This is a schematic structural diagram of a dual-light module in another embodiment of the present application;

[0036] Figure 4 This is a schematic diagram of the structure of the dual-light module in the embodiment of the present application when no bottom plate is provided;

[0037] Figure 5 This is a schematic structural diagram of a housing in an embodiment of the present application in one implementation manner;

[0038] Figure 6 A flowchart of a dual-optical module data processing method in an embodiment of the present application in one implementation manner;

[0039] Figure 7 This is a flow chart of another implementation of the dual-light module data processing method in an embodiment of the present application;

[0040] Figure 8 Schematic diagram of a program module of a dual-light module data processing device in an embodiment of the present application in one implementation manner. DETAILED DESCRIPTION

[0041] The present invention is further described in detail below by specific embodiments in conjunction with the accompanying drawings. Wherein similar elements in different embodiments adopt associated similar element numbers. In the following embodiments, many detailed descriptions are for making the present application better understood. However, those skilled in the art can easily recognize that some features can be omitted in different situations, or can be replaced by other elements, materials, methods. In some cases, some operations related to the present application are not shown or described in the specification, this is to avoid the core part of the present application being overwhelmed by too much description, and for those skilled in the art, it is not necessary to describe these related operations in detail, and they can fully understand the related operations according to the description in the specification and the general technical knowledge in the art.

[0042] In addition, the features, operations or characteristics described in the specification can be combined in any appropriate manner to form various implementations. At the same time, the steps or actions in the method description can also be interchanged or adjusted in a manner that is obvious to those skilled in the art. Therefore, the various sequences in the specification and the drawings are only for the purpose of clearly describing a certain embodiment and are not meant to be a required sequence, unless otherwise specified that a certain sequence must be followed.

[0043] The serial numbers assigned to the components in this article, such as "first", "second", etc., are only used to distinguish the objects described and do not have any order or technical meaning.

[0044] In addition, the technical features and technical solutions described herein may be combined in any suitable manner in one or more embodiments. It is easy for a person skilled in the art to understand that the steps or operation sequence of the methods related to the embodiments provided herein may also be changed. Therefore, any sequence in the drawings and embodiments is only for illustrative purposes and does not imply a requirement to follow a certain sequence unless it is explicitly stated that a certain sequence is required.

[0045] like Figures 1 to 5 As shown, the dual-light module for cooking scenes provided in the embodiment of the present application can be placed on the fan in the kitchen to shoot the cooking process from top to bottom all the time. Before us, there was no monitoring equipment dedicated to the cooking process on the market. One implementation method thereof includes an RGB camera 110, an IR camera 210, a circuit board 300, a processor 400 and a housing.

[0046] The RGB camera 110 is used to photograph the food to be tested placed in the measuring area and obtain an RGB image of the food to be tested;

[0047] The IR camera 210 is used to photograph the food to be tested placed in the measuring area and obtain an IR image of the food to be tested;

[0048] The processor 400 is disposed on the circuit board 300 and is used to process the RGB image and the IR image to determine the temperature distribution of the food;

[0049] The circuit board 300 is electrically connected to the RGB camera 110, the IR camera 210 and the processor 400 respectively;

[0050] The housing includes a shell 510 and a bottom plate 520. The shell 510 is provided with a receiving cavity 518, and one end of the shell 510 is provided with an opening, and the bottom plate 520 is arranged on the opening. The circuit board 300, the processor 400, the RGB camera 110 and the infrared camera 210 are arranged in the receiving cavity 518, and the shell 510 is provided with a first lens hole 111 respectively matched with the RGB camera 110 and a second lens hole 211 matched with the lens of the infrared camera 210. That is, a first lens hole 111 matched with the lens of the RGB camera 110 can be provided on the shell 510, and a second lens hole 211 matched with the lens of the infrared camera 210 can be provided on the shell 510. In one embodiment, the lens of the RGB camera 110 and the lens of the infrared camera 210 can be respectively embedded in the shell 510.

[0051] Since the embodiment of the present application adopts a combination of an RGB camera and an IR camera, images and temperatures of the cooking process can be obtained. Temperature is the most important physical quantity in the cooking process. Obtaining temperature can make the cooking process more accurately quantified and precisely monitored.

[0052] The dual light module provided in the embodiment of the present application may further include a first fill light 120, which cooperates with the RGB camera 110. The first fill light 120 is arranged around the RGB camera 110, and is used to perform light compensation on the food being tested photographed by the RGB camera 110. The use of the first fill light 120 can make the photographed RGB image clearer. In one embodiment, the first fill light 120 is arranged outside the RGB camera 110.

[0053] The dual light module provided in the embodiment of the present application may further include a second fill light 220, which cooperates with the IR camera 210. The second fill light 220 is arranged around the IR camera 210, and is used to compensate for the light of the food being tested photographed by the IR camera 210. The use of the second fill light 220 can make the photographed IR image clearer. In one embodiment, the second fill light 220 is arranged outside the IR camera 210.

[0054] In one implementation, the dual-optical module provided in the embodiment of the present application may further include a plurality of interfaces, which are recessed in the housing 510. The use of interfaces recessed in the housing 510 can prevent the external connector from being touched, thereby protecting the external connector and preventing the external connector from being accidentally knocked off.

[0055] The interface may include a power interface 511, and / or a TYPE-C interface 512, and / or an HDMI interface 513, and / or a memory card interface 514, and / or an Internet port 515. The TYPE-C interface 512 may be used to debug the dual-light module, and the HDMI interface 513 may be used to connect a display screen to facilitate full monitoring of the cooking process.

[0056] The shell 510 may also include a first hollow cylindrical bracket 516 and a second hollow cylindrical bracket 517. The first hollow cylindrical bracket 516 cooperates with the first fill light 120, that is, the first fill light 120 is fixed to the shell 510 through the first hollow cylindrical bracket 516, and the second hollow cylindrical bracket 517 cooperates with the second fill light 220, that is, the second fill light 220 is fixed to the shell 510 through the second hollow cylindrical bracket 517.

[0057] The housing 510 may further include a power interface bracket 5111 that cooperates with the power interface 511, a TYPE-C interface bracket 5121 that cooperates with the TYPE-C interface 512, an HDMI interface bracket 5131 that cooperates with the HDMI interface 513, a memory card interface bracket 5141 that cooperates with the memory card interface 514, and a network port bracket 5151 that cooperates with the network port 515. In one embodiment, the power interface bracket 5111, the TYPE-C interface bracket 5121, the memory card interface bracket 5141, the network port bracket 5151, the first hollow cylindrical bracket 516, and the second hollow cylindrical bracket 517 are an integrated structure with the housing 510. The housing 510, the interface bracket, and the fill light bracket are an integrated structure, which can simplify the assembly of the dual light module and improve the assembly efficiency.

[0058] like Figure 6 As shown, the embodiment of the present application also provides a dual-light module data processing method for a cooking scene, and one implementation method thereof includes the following steps:

[0059] Step 101: an RGB camera photographs the food to be tested placed in a measuring area to obtain an RGB image of the food to be tested;

[0060] Step 102: The IR camera photographs the food to be tested placed in the measuring area to obtain an IR image of the food to be tested;

[0061] Step 103: The processor processes the RGB image and the IR image to determine the temperature distribution of the food.

[0062] like Figure 7 As shown, step 103 may specifically include the following steps:

[0063] Step 301: Select an RGB image and an IR image within the same time period, and establish a corresponding relationship between the RGB image and the IR image according to a timestamp.

[0064] The RGB image and the IR image are synchronized, that is, the RGB image and the IR image with the closest temporal distance are found at the timestamp.

[0065] Step 302: Align the RGB image and the IR image according to the corresponding relationship. Calibrate the camera and align the RGB image and the IR image from the pixel.

[0066] Step 303: Segment the RGB image to find the area where the food is located. Segment and detect the RGB image. The purpose of segmentation is to find the area where the food is located.

[0067] Step 304: Acquire the temperature of the area where the food is located according to the IR image corresponding to the RGB image.

[0068] Step 305: Determine the temperature distribution of the food according to the temperatures of the areas where the food is located at the same time interval.

[0069] like Figure 8 As shown, the embodiment of the present application also provides a dual-light module data processing device for a cooking scene, one implementation of which includes:

[0070] RGB camera module 610, used to photograph the food to be tested placed in the measuring area and obtain an RGB image of the food to be tested;

[0071] The IR camera module 620 is used to photograph the food to be tested placed in the measuring area and obtain an IR image of the food to be tested;

[0072] The processor 630 is used to determine the temperature distribution of the food according to the RGB image and the IR image.

[0073] Those skilled in the art will appreciate that all or part of the steps of the various methods in the above embodiments may be completed by instructing related hardware through a program, and the program may be stored in a computer-readable storage medium, which may include: a read-only memory, a random access memory, a disk or an optical disk, etc.

[0074] The above contents are further detailed descriptions of the present application in combination with specific implementation methods, and it cannot be determined that the specific implementation of the present application is limited to these descriptions. For ordinary technicians in the technical field to which the present application belongs, several simple deductions or substitutions can be made without departing from the concept of the present application.

Claims

1. A dual-light module for cooking scenes, characterized in that: include: An RGB camera is used to photograph the food to be tested placed in the measuring area and obtain an RGB image of the food to be tested; An IR camera is used to photograph the food to be tested placed in the measuring area to obtain an IR image of the food to be tested; a processor, configured to determine a temperature distribution of food according to the RGB image and the IR image; A circuit board, electrically connected to the RGB camera, the IR camera and the processor respectively; The shell comprises a shell and a base plate, wherein the shell is provided with a accommodating cavity and an opening at one end, the base plate is arranged on the opening, the circuit board, the processor, the RGB camera and the infrared camera are arranged in the accommodating cavity, and the shell is provided with a first lens hole respectively cooperating with the RGB camera and a second lens hole cooperating with the lens of the infrared camera.

2. The dual-light module according to claim 1, characterized in that: It also includes a first fill light that cooperates with the RGB camera.

3. The dual-light module according to claim 1 or 2, characterized in that: It also includes a second fill light that cooperates with the infrared camera.

4. The dual-light module according to claim 3, characterized in that: It also includes a plurality of interfaces recessed in the shell.

5. The dual-light module as claimed in claim 4, characterized in that: The interface includes a power interface, and / or a TYPE-C interface, and / or an HDMI interface, and / or a memory card interface, and / or a network port.

6. The dual-light module as claimed in claim 5, characterized in that: The HDMI interface is used to connect to a display screen.

7. The dual-light module as claimed in claim 4, characterized in that: The housing further comprises a first hollow cylindrical bracket respectively matched with the first fill light and a second hollow cylindrical bracket matched with the second fill light.

8. A dual-light module data processing method for a cooking scene, characterized in that: include: The RGB camera shoots the food to be tested placed in the measuring area to obtain an RGB image of the food to be tested; The IR camera photographs the food to be tested placed in the measuring area to obtain an IR image of the food to be tested; The processor determines the temperature distribution of the food according to the RGB image and the IR image.

9. The dual-optical module data processing method according to claim 8, characterized in that: The processor determines the temperature distribution of the food according to the image data and the temperature data, including: Selecting the RGB image and the IR image within the same time period; Establishing a correspondence between the RGB image and the IR image according to the timestamp; aligning the RGB image and the IR image according to the corresponding relationship; Segment the RGB image to find the area where the food is located; Acquire the temperature of the area where the food is located according to the IR image corresponding to the RGB image; The temperature distribution of the food is determined according to a plurality of temperatures of the area where the food is located with the same time interval.

10. A dual-light module data processing device for cooking scenes, characterized in that: include: An RGB camera module is used to photograph the food to be tested placed in the measuring area and obtain an RGB image of the food to be tested; An IR camera module is used to photograph the food to be tested placed in the measuring area to obtain an IR image of the food to be tested; A processor is used to determine the temperature distribution of food according to the RGB image and the IR image.

Images