Imaging method of drawer, exposure automatic control method and device of imaging

Abstract

The application discloses an imaging method of a drawer, an exposure automatic control method and device, and the exposure automatic control method comprises the following steps: judging whether a highlight area in a current image exceeds a highlight preset value; if yes: reducing the illumination intensity of light by a preset first amplitude; obtaining a next image; and repeating until the highlight preset value is not exceeded; if no: increasing the illumination intensity of light by a preset second amplitude; obtaining a next image; and repeating until the highlight preset value is exceeded; and fusing the current image and a plurality of next images. The exposure automatic control method can automatically adjust exposure parameters according to the situation of the food materials, and then fuse the images to obtain clear images, thereby solving the problem of overexposure or underexposure when multiple different food materials are photographed at the same time, and then the clearer images obtained can be subjected to image recognition, the accuracy of the recognition is improved, the intelligent degree of the smart home is improved, and the use experience of consumers is improved.

Description

Technical Field

[0001] The present invention relates to an automatic exposure control method for imaging, and in particular to a device using the automatic exposure control method for imaging;

[0002] The present invention also relates to a method for imaging a drawer, including using the above-mentioned automatic exposure control method for imaging during imaging, and also relates to a device using the method. Background Art

[0003] With the development of smart homes, there are some solutions that can take pictures of the inside of the refrigerator and then visually identify the food inside. However, in the process of developing this invention, the following problems were discovered:

[0004] Different ingredients reflect light differently. For example, eggplants and tomatoes have smooth surfaces, so they'll be overexposed if the light is too strong. Kiwis, on the other hand, have a rough surface, so they'll appear dark if the light is too weak. Especially when mixing multiple ingredients, it's difficult to find a balanced lighting intensity that doesn't overexpose smooth ingredients while avoiding underexposure of rougher ones. Therefore, it's impossible to capture all images with a single, consistent lighting source.

[0005] However, the prior art has not recognized this problem and has no suitable solution to solve it. Summary of the Invention

[0006] In order to solve the problem of being unable to select appropriate exposure parameters in the above-mentioned prior art problems, the purpose of the present invention is to provide a drawer imaging method, an imaging exposure automatic control method and device that can generate a properly exposed image.

[0007] To achieve the above-mentioned object of the invention, one embodiment of the present invention provides an automatic exposure control method for imaging, comprising the following steps:

[0008] Determine whether the highlight area in the current image exceeds the preset highlight value;

[0009] if:

[0010] Reduce the light intensity of the light according to a preset first amplitude;

[0011] Get the next image;

[0012] Repeat the steps of "reducing the light intensity of the light according to the preset first amplitude" and "acquiring the next image" until the highlight area in the next image does not exceed the preset highlight value;

[0013] If not:

[0014] Increase the light intensity by the preset second amplitude;

[0015] Get the next image;

[0016] The steps of "increasing the light intensity of the light according to the preset second amplitude" and "acquiring the next image" are repeated until the highlight area in the next image exceeds the preset highlight value;

[0017] The current image is fused with a plurality of the next images to generate a fused image.

[0018] As a further improvement of the present invention, the step of “fusing the current image with a plurality of next images to generate a fused image” includes:

[0019] Convert the illumination intensity corresponding to each next image and the current image when they are taken into a weighting coefficient;

[0020] Each next image and the current image are multiplied by their respective weighting coefficients, and all multiplication results are summed to obtain the fused image.

[0021] As a further improvement of the present invention, the first amplitude and the second amplitude are always constant values.

[0022] To achieve one of the above-mentioned objectives of the invention, an embodiment of the present invention provides a method for imaging a drawer, comprising the steps of:

[0023] Detecting the distance the drawer is pulled out;

[0024] When the distance is within a preset distance range, the image of the drawer is acquired as the current image, and the above-mentioned automatic exposure control method for imaging is executed to obtain a fused image corresponding to the drawer.

[0025] To achieve one of the above-mentioned objectives of the invention, an embodiment of the present invention provides a method for imaging a drawer, comprising the steps of:

[0026] Detecting the distance the drawer is pulled out;

[0027] When the distance is outside the preset distance range, the following steps are executed:

[0028] Turning on the high beam and turning off the low beam, acquiring the first image, and retaining only the long-distance image outside the preset distance range;

[0029] Turn off the high beam, turn on the low beam, acquire a second image, and retain only the close-range image within the preset distance range;

[0030] During the process of acquiring the long-distance image and / or the short-distance image, executing the above-mentioned automatic exposure control method for imaging;

[0031] The long-distance image and the short-distance image are stitched together to generate a complete image.

[0032] As a further improvement of the present invention, the step of "acquiring a first image and retaining only long-distance images outside the preset distance range" includes:

[0033] acquiring a first image;

[0034] Only the image outside the preset distance range in the first image is retained as the current image, and the above-mentioned automatic exposure control method for imaging is run on this image to obtain a fused image as the long-distance image.

[0035] As a further improvement of the present invention, the step of "acquiring a second image and retaining only close-range images within the preset distance range" includes:

[0036] acquiring a second image;

[0037] Only the image in the second image that is within the preset distance range is retained as the current image, and the above-mentioned automatic exposure control method for imaging is run here, and the obtained fused image is used as the close-range image.

[0038] To achieve one of the above-mentioned objectives, an embodiment of the present invention provides an automatic exposure control device for imaging, comprising:

[0039] A judgment module is used to judge whether the highlight area in the current image exceeds the highlight preset value;

[0040] a brightness adjustment module, configured to reduce the light intensity of the light by a preset first amplitude when the judgment module determines that the condition is correct, or to increase the light intensity of the light by a preset second amplitude when the judgment module determines that the condition is correct;

[0041] An image acquisition module, configured to acquire the current image and the next image;

[0042] a loop module, configured to, when the judgment module determines that the result is yes, loop the steps of "reducing the light intensity of the light by a preset first amplitude" and "acquiring the next image" until the highlight area in the next image does not exceed the preset highlight value, or, when the judgment module determines that the result is no, loop the steps of "increasing the light intensity of the light by a preset second amplitude" and "acquiring the next image" until the highlight area in the next image exceeds the preset highlight value;

[0043] The fusion module is used to fuse the current image with several next images to generate a fused image.

[0044] To achieve one of the above-mentioned objectives, an embodiment of the present invention provides an imaging device for a drawer, comprising:

[0045] A distance measuring module, used to detect the distance the drawer is pulled out;

[0046] The first processing module is configured to obtain the image of the drawer as the current image when the distance is within a preset distance range, and to execute the above-mentioned automatic exposure control method for imaging to obtain a fused image corresponding to the drawer.

[0047] To achieve one of the above-mentioned objectives, an embodiment of the present invention provides an imaging device for a drawer, comprising:

[0048] A distance measuring module, used to detect the distance the drawer is pulled out;

[0049] The second processing module is configured to execute the following steps when the distance is outside a preset distance range:

[0050] Turning on the high beam and turning off the low beam, acquiring the first image, and retaining only the long-distance image outside the preset distance range;

[0051] Turn off the high beam, turn on the low beam, acquire a second image, and retain only the close-range image within the preset distance range;

[0052] During the process of acquiring the long-distance image and / or the short-distance image, executing the above-mentioned automatic exposure control method for imaging;

[0053] The long-distance image and the short-distance image are stitched together to generate a complete image.

[0054] To achieve one of the above-mentioned objectives, an embodiment of the present invention provides an electronic device, including:

[0055] a storage module storing a computer program;

[0056] The processing module can implement the steps of the above-mentioned imaging exposure automatic control method and / or the steps of the above-mentioned drawer imaging method when executing the computer program.

[0057] In order to achieve one of the above-mentioned purposes of the invention, an embodiment of the present invention provides a readable storage medium, which stores a computer program. When the computer program is executed by the processing module, it can implement the steps in the above-mentioned imaging automatic exposure control method and / or the steps in the above-mentioned drawer imaging method.

[0058] Compared with the existing technology, the present invention has the following beneficial effects: the automatic exposure control method of imaging can automatically adjust the exposure parameters according to the situation of the photographed food, and then fuse a clear image, solving the problem of overexposure or underexposure when photographing multiple different foods at the same time. The clearer image obtained can then be used for image recognition, thereby improving the recognition accuracy, increasing the intelligence level of smart homes, and improving the consumer experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0059] Figure 1 This is a structural schematic diagram of a refrigeration compartment when the door of a refrigeration device according to an embodiment of the present invention is opened;

[0060] Figure 2 is a flow chart of an automatic exposure control method for imaging according to an embodiment of the present invention;

[0061] Figure 3 is a flow chart of a method for imaging a drawer according to an embodiment of the present invention;

[0062] Figure 4 is a top view of a drawer according to an embodiment of the present invention, wherein the drawer is pulled out within a preset distance range;

[0063] Figure 5 is a top view of a drawer according to an embodiment of the present invention, wherein the drawer is pulled out to a distance outside a preset distance range;

[0064] Figure 6 is a schematic diagram of a module of an imaging device according to an embodiment of the present invention;

[0065] Among them, 100, refrigeration equipment; 200, imaging device; 10, refrigeration compartment; 20, drawer; 30, camera module; 31, camera; 40, lighting module; 41, low beam; 42, high beam; 50, ranging module; 51, distance sensing device; 60, storage module; 70, first processing module; 80, second processing module; 90, communication bus. DETAILED DESCRIPTION

[0066] The present invention will be described in detail below with reference to the specific embodiments shown in the accompanying drawings. However, these embodiments do not limit the present invention, and any structural, methodological, or functional changes made by those skilled in the art based on these embodiments are all within the scope of protection of the present invention.

[0067] An embodiment of the present invention provides a drawer imaging method capable of generating a properly exposed image, and an automatic exposure control method and device for imaging.

[0068] The imaging method of the drawer and the automatic exposure control method of the imaging can be operated in the refrigeration device 100 or outside the refrigeration device 100, for example, in an external computer, mobile phone, cloud device, etc. In this embodiment, the operation in the refrigeration device 100 is introduced as an example.

[0069] Refrigeration equipment 100

[0070] First, the carrier of the imaging method of the operating drawer and the exposure automatic control method of the imaging, the refrigeration device 100, is introduced. The refrigeration device 100 of this embodiment can be a refrigerator, a freezer, a vertical refrigerator, a wine cabinet, etc. The following embodiments can be described by taking a refrigerator as an example. The refrigerator includes a box body, an inner container arranged in the box body, a refrigeration compartment 10 surrounded by the inner container, and a door body covering the opening of the inner container. The refrigeration device 100 also includes a drawer 20 arranged in the refrigeration compartment 10, such as Figure 1 As shown, the drawer 20 may be an MSA oxygen-controlled fresh-keeping drawer 20 .

[0071] In order to clearly express the position and direction described in this embodiment, in this embodiment, the direction of reference gravity is defined as downward, the opposite direction is defined as upward, the direction in which the door is opened is defined as front, the opposite direction is defined as rear, and in front of the door, the two sides facing the refrigeration compartment 10 are defined as left and right sides respectively.

[0072] Still Figure 1 As shown, a camera 31 and a light for illuminating the drawer 20 can be respectively set above the drawer 20. Since the drawer 20 can be set wider and longer, a high beam 42 and a low beam 41 are respectively set, and the high beam 42 and the low beam 41 are arranged in multiple groups at intervals. The high beam 42 is used to illuminate the food in the distance, and the low beam 41 is used to illuminate the food in the near. The high beam 42 and the low beam 41 respectively adopt two different illumination angles. The high beam 42 has a small inclination angle and illuminates the far end of the drawer 20, while the low beam 41 has a large inclination angle and illuminates the near end of the drawer 20. As shown Figure 1 、 4 As shown in , 5 , the circle in the figure can represent the high beam 42 , and the square can represent the low beam 41 .

[0073] After the drawer 20 is pulled out, the camera 31 provided above the drawer 20 can take a picture of the drawer 20. If the drawer 20 is pulled out less, less content can be photographed; if the drawer 20 is pulled out more, more content can be photographed.

[0074] In addition, if Figure 4 、 5 As shown, a distance sensing device 51 can be provided at the rear of the drawer 20 to provide distance information for the algorithm to adjust the lighting.

[0075] As described in the background art, different foods reflect light to varying degrees. With the same exposure intensity, some foods may be overexposed, while others may appear too dark. To address this issue, the automatic exposure control method for imaging in this embodiment can control the exposure intensity when photographing the drawer 20, resulting in a clear image.

[0076] Automatic exposure control method for imaging

[0077] The following combination Figure 2 , a method for automatically controlling exposure for imaging is described in detail. Although this application provides method operation steps as shown in the following embodiments or flowcharts, based on routine or no creative effort, the execution order of steps in the method that do not logically have a necessary causal relationship is not limited to the execution order provided in the embodiments of this application.

[0078] Specifically, the steps include:

[0079] Step S10: Acquire the current image.

[0080] The current image may be an image captured by turning on the low beam headlight 41 and then turning on the camera 31 after the distance sensing device 51 detects that the drawer 20 is opened a certain distance.

[0081] Step S20: determining whether the highlight area in the current image exceeds a preset highlight value.

[0082] Some fruits and vegetables with smooth surfaces, such as eggplants and tomatoes, will have a highlighted area appear at the corresponding position in the captured image when the light intensity is high. In this embodiment, the preset highlight value can be a threshold value of the highlighted area being larger than 10% of the area of ​​the drawer 20 that can be captured.

[0083] When the judgment result of step S20 is yes, the following steps S30 to S50 are executed.

[0084] Step S30: reducing the light intensity of the light according to a preset first amplitude.

[0085] Step S40: Acquire the next image.

[0086] Step S50: determining whether the highlight area in the next image does not exceed the preset highlight value.

[0087] If not, the steps of “reducing the illumination intensity of the light according to the preset first amplitude” and “acquiring the next image” are looped, and the judgment of step S50 is performed again.

[0088] If yes, execute step S60.

[0089] In steps S30 to S50 , for scenes where the highlight area exceeds the preset highlight value, the light intensity is reduced, and the next image is captured, and then the highlight area detection is performed again until there is no highlight area.

[0090] Preferably, the first amplitude is always a constant value, for example, the initial illumination intensity is reduced by 10% each time.

[0091] When the judgment result of step S20 is no, the following steps S30 ′ to S50 ′ are executed.

[0092] Step S30 ′: increasing the light intensity of the light according to a preset second amplitude.

[0093] Step S40 ′: Acquire the next image.

[0094] Step S50 ′: determining whether the highlight area in the next image exceeds the preset highlight value.

[0095] If not, the steps of “increasing the illumination intensity of the light according to the preset second amplitude” and “acquiring the next image” are looped, and the judgment of step S50 ′ is performed again.

[0096] If yes, execute step S60.

[0097] In steps S30 ′ to S50 ′, for scenes where the highlight area does not exceed the preset highlight value, the light intensity is increased, and the next image is captured, and then the highlight area detection is performed again until a highlight area exists.

[0098] Preferably, the second amplitude is always a constant value, for example, the initial illumination intensity is increased by 100% each time.

[0099] The aforementioned steps S30 to S50, and S30' to S50', all involve a dynamic lighting system that dynamically adjusts the light intensity, using whether the highlighted area in the image exceeds a preset highlight value as a detection criterion. This allows smooth-surfaced fruits and vegetables to gradually reduce the light intensity from an overexposed state until it is no longer overexposed, while rough-surfaced fruits and vegetables gradually switch from an insufficiently bright state to a sufficiently bright state.

[0100] Step S60: Fusing the current image with several next images to generate a fused image.

[0101] Specifically, in step S60, the following steps are also included:

[0102] Step S61: converting the illumination intensity corresponding to each next image and the current image when they are captured into a weighting coefficient;

[0103] Step S62: multiply each next image and the current image by their respective weighting coefficients, and sum all the multiplication results to obtain the fused image.

[0104] Assuming that in the scenario where the highlight area in the current image exceeds the highlight preset value, the initial illumination value is 100, and the score is reduced by 10 each time the illumination is reduced until the highlight area in the next image does not exceed the highlight preset value, and the illumination value at this time is 50, then the current image and 5 next images are obtained, corresponding to illumination values ​​100, 90, 80, 70, 60, and 50 respectively. Then, according to the softmax function, the 6 numbers 100, 90, 80, 70, 60, and 50 can be substituted into the softmax function to obtain 6 weights between (0, 1), and the sum of the 6 weights is 1. Then, the current image and the 5 next images are multiplied by their respective weights, and the pixels at the same position are summed to finally obtain a new fused image.

[0105] Assuming that the highlight area in the current image does not exceed the highlight preset value, the initial illumination value is 10. Each time the illumination is improved, the score is increased by 10 until the highlight area in the next image does not exceed the highlight preset value. At this time, the illumination value is 50. The current image and the four next images are obtained, corresponding to illumination values ​​10, 20, 30, 40, and 50 respectively. Then, according to the softmax function, the five numbers 10, 20, 30, 40, and 50 can be substituted into the softmax function to obtain five weights between (0, 1), and the sum of the five weights is 1. Then, the current image and the four next images are multiplied by their respective weights, and the pixels at the same position are summed to finally obtain a new fused image.

[0106] Compared with the prior art, this embodiment has the following beneficial effects:

[0107] This automatic exposure control method for imaging automatically adjusts exposure parameters based on the ingredients being photographed, then fuses them into a clear image. This allows for evenly lit, clear images to be captured evenly across a variety of fruit and vegetable scenes with varying reflectivity. This solves the problem of overexposure or underexposure when photographing multiple ingredients simultaneously. This clearer image can then be used for image recognition, improving recognition accuracy, enhancing the intelligence of smart homes, and enhancing the consumer experience.

[0108] The following introduces the automatic exposure control method for when imaging is performed, that is, the method involved in the entire imaging process - the imaging method.

[0109] Drawer imaging method

[0110] Example 1

[0111] This embodiment can be understood as an imaging method when the distance between the drawers 20 is within a preset distance range, such as Figure 3 and 4As shown, the specific steps may include:

[0112] Detecting the distance the drawer 20 is pulled out;

[0113] When the distance is within the preset distance range, the image of the drawer 20 is acquired as the current image, and the above-mentioned automatic exposure control method for imaging is executed to obtain a fused image corresponding to the drawer 20 .

[0114] The preset distance range of Example 1 can be that the drawer 20 is pulled open a distance not exceeding half of the total length of the drawer 20. At this time, only the low beam 41 is turned on, the high beam 42 is not turned on, and the camera 31 is started to capture the current image and the next subsequent image.

[0115] The execution process of the specific embodiment 1 may refer to the specific steps in the above-mentioned imaging exposure automatic control method, and the fused image is the final image obtained in the embodiment 1.

[0116] Example 2

[0117] This embodiment can be understood as an imaging method when the distance of the drawer 20 is pulled out is outside the preset distance range. The preset distance range can be defined as half of the total length of the drawer 20. When the drawer 20 is pulled out to a distance exceeding half of the total length, the distance is outside the preset distance range, and the high and low lights work together. Since the light intensity of the high beam 42 is much greater than that of the low beam 41, while illuminating the fruits and vegetables in the distance, it will overexpose the nearby ones. Therefore, the following method is used to shoot in steps, and then the captured images are spliced, such as Figure 3 and 5 As shown, the specific steps may include:

[0118] Step S100: Detecting the distance the drawer 20 is pulled out;

[0119] Step S200: When the distance is outside the preset distance range, execute the following steps:

[0120] Step S300: Turn on the high beam 42, turn off the low beam 41, acquire a first image, and retain only the long-distance image outside the preset distance range;

[0121] When executing step S300, the above-mentioned automatic exposure control method for imaging may be executed, specifically:

[0122] acquiring a first image;

[0123] Only the image outside the preset distance range in the first image is retained as the current image, and the above-mentioned automatic exposure control method for imaging is run on this image to obtain a fused image as the long-distance image.

[0124] In step S300, the above-mentioned automatic exposure control method for imaging is applied only to the portion of the area outside the preset distance range of the drawer 20, and the obtained fused image is also only the image of the area outside the preset distance range of the drawer 20. The specific implementation process of step S300 can refer to the specific steps in the above-mentioned automatic exposure control method for imaging.

[0125] Step S400: Turn off the high beam 42, turn on the low beam 41, acquire a second image, and retain only the close-range image within the preset distance range;

[0126] When executing step S400, the above-mentioned automatic exposure control method for imaging may be executed, specifically:

[0127] acquiring a second image;

[0128] Only the image in the second image that is within the preset distance range is retained as the current image, and the above-mentioned automatic exposure control method for imaging is run here, and the obtained fused image is used as the close-range image.

[0129] In step S400, the above-mentioned automatic exposure control method for imaging is only applied to a portion of the area within the preset distance range of the drawer 20, and the obtained fused image is also only an image of the area within the preset distance range of the drawer 20. The specific implementation process of step S400 can refer to the specific steps in the above-mentioned automatic exposure control method for imaging.

[0130] Step S500: stitching the long-distance image and the short-distance image to generate a complete image.

[0131] In step S500, the long-distance image obtained in step S300 and the close-range image obtained in step S400 are spliced ​​together, and the middle spliced ​​area is mean-blurred to form a final complete image for fruit and vegetable recognition.

[0132] Automatic exposure control device for imaging

[0133] In one embodiment, an automatic exposure control device for imaging is provided. The automatic exposure control device for imaging may include modules, and the specific functions of each module are as follows:

[0134] A judgment module is used to judge whether the highlight area in the current image exceeds the highlight preset value;

[0135] a brightness adjustment module, configured to reduce the light intensity of the light by a preset first amplitude when the judgment module determines that the condition is correct, or to increase the light intensity of the light by a preset second amplitude when the judgment module determines that the condition is correct;

[0136] An image acquisition module, configured to acquire the current image and the next image;

[0137] a loop module, configured to, when the judgment module determines that the result is yes, loop the steps of "reducing the light intensity of the light by a preset first amplitude" and "acquiring the next image" until the highlight area in the next image does not exceed the preset highlight value, or, when the judgment module determines that the result is no, loop the steps of "increasing the light intensity of the light by a preset second amplitude" and "acquiring the next image" until the highlight area in the next image exceeds the preset highlight value;

[0138] The fusion module is used to fuse the current image with several next images to generate a fused image.

[0139] In one embodiment, the fusion module is further configured to convert the illumination intensity corresponding to each next image and the current image when they are captured into a weighting coefficient;

[0140] The fusion module is further configured to multiply each next image and the current image by their respective weighting coefficients, and sum all multiplication results to obtain the fused image.

[0141] It should be noted that for details not disclosed in the automatic exposure control device for imaging according to an embodiment of the present invention, please refer to the details disclosed in the automatic exposure control method for imaging according to an embodiment of the present invention.

[0142] Drawer imaging device 200

[0143] In one embodiment, a drawer imaging device 200 is provided, such as Figure 6 The imaging device 200 of the drawer may include modules, and the specific functions of each module are as follows:

[0144] The distance measuring module 50 is used to receive the signal of the distance sensing device 51 and detect the distance the drawer 20 is pulled out;

[0145] The first processing module 70 is configured to obtain the image of the drawer 20 as the current image when the distance is within a preset distance range, and execute the above-mentioned automatic exposure control method for imaging to obtain a fused image corresponding to the drawer 20 .

[0146] In one embodiment, the imaging device 200 of the drawer may include:

[0147] The second processing module 80 is configured to execute the following steps when the distance is outside a preset distance range:

[0148] Turning on the high beam 42 and turning off the low beam 41, acquiring a first image, and retaining only long-distance images outside the preset distance range;

[0149] Turn off the high beam 42, turn on the low beam 41, acquire a second image, and retain only the close-range image within the preset distance range;

[0150] During the process of acquiring the long-distance image and / or the short-distance image, executing the above-mentioned automatic exposure control method for imaging;

[0151] The long-distance image and the short-distance image are stitched together to generate a complete image.

[0152] It should be noted that for details not disclosed in the imaging device 200 for a drawer according to the embodiment of the present invention, please refer to the details disclosed in the imaging method for a drawer according to the embodiment of the present invention.

[0153] The automatic exposure control device for imaging and the imaging device 200 may also include computing devices such as computers, notebooks, PDAs, and cloud servers, as well as other processing modules, a storage module 60, and a computer program stored in the storage module 60 and executable on the processing module, such as the program for the automatic exposure control method for imaging and the imaging method for drawers described above. When the processing module executes the computer program, the steps of the various embodiments of the automatic exposure control method for imaging and the imaging method for drawers described above are implemented, such as Figure 2 and 3 Steps shown.

[0154] The imaging device 200 may further include an illumination module 40, a camera module 30, and a communication bus 90. The illumination module 40 is used to control the on and off of the low beam 41 and the high beam 42, the camera module 30 is used to control the shooting of the camera 31, and the communication bus 90 is used to establish connections between the ranging module 50, the illumination module 40, the camera module 30, the first processing module 70, the second processing module 80, and the storage module 60. The communication bus 90 may include a path for transmitting information between the ranging module 50, the illumination module 40, the camera module 30, the first processing module 70, the second processing module 80, and the storage module 60.

[0155] In addition, the present invention also proposes an electronic device, which includes a storage module and a processing module. When the processing module executes the computer program, it can implement the steps in the above-mentioned automatic exposure control method for imaging and / or the steps in the above-mentioned imaging method for the drawer, that is, implement the steps in the above-mentioned automatic exposure control method for imaging and / or the steps in any one of the technical solutions in the above-mentioned imaging method for the drawer.

[0156] The electronic device may be a part integrated into the refrigeration device 100 , or a local terminal device, or a part of a cloud server.

[0157] The first processing module 70 and / or the second processing module 80 can be the same processing module, which can be a central processing unit (CPU), other general-purpose processors, digital signal processors (DSP), application-specific integrated circuits (ASIC), field-programmable gate arrays (FPGA), other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. The general-purpose processor can be a microprocessor or any conventional processor. The processing module is the control center of the refrigeration equipment 100 and connects various components of the entire refrigeration equipment 100 using various interfaces and lines.

[0158] The storage module 60 can be used to store the computer programs and / or modules. The processing module implements the various functions of the refrigeration device 100 by running or executing the computer programs and / or modules stored in the storage module 60 and accessing the data stored in the storage module 60. The storage module 60 may primarily include a program storage area and a data storage area. The program storage area may store an operating system, at least one application required for a function, and the like. Furthermore, the storage module 60 may include high-speed random access memory (RAM) and non-volatile memory, such as a hard disk, internal memory, a plug-in hard disk, a SmartMedia Card (SMC), a Secure Digital (SD) card, a flash memory card, at least one disk storage device, a flash memory device, or other volatile solid-state memory device.

[0159] For example, the computer program may be divided into one or more modules / units, which are stored in the storage module 60 and executed by the processing module to implement the present invention. The one or more modules / units may be a series of computer program instruction segments capable of performing specific functions, and the instruction segments are used to describe the execution process of the computer program in the refrigeration equipment 100.

[0160] Furthermore, an embodiment of the present invention provides a readable storage medium storing a computer program, which, when executed by a processing module, can implement the steps in the above-mentioned automatic exposure control method for imaging and / or the steps in the above-mentioned imaging method for the drawer, that is, implement the steps in the above-mentioned automatic exposure control method for imaging and / or the steps in any one of the technical solutions in the above-mentioned imaging method for the drawer.

[0161] If the steps in the automatic exposure control method for imaging and / or the integrated module of the aforementioned drawer imaging method are implemented as software functional units and sold or used as independent products, they can be stored in a computer-readable storage medium. Based on this understanding, the present invention can also implement all or part of the processes in the above-mentioned method embodiments by instructing the relevant hardware through a computer program. The computer program can be stored in a computer-readable storage medium. When executed by a processing module, the computer program can implement the steps of each of the above-mentioned method embodiments.

[0162] The computer program includes computer program code, which may be in source code form, object code form, executable file, or some intermediate form. The computer-readable medium may include any entity or device capable of carrying the computer program code, a recording medium, a disk, a mobile hard disk, a magnetic disk, an optical disk, a computer memory, a read-only memory (ROM), a random access memory (RAM), an electric carrier signal, a telecommunication signal, and a software distribution medium. It should be noted that the content of the computer-readable medium may be appropriately increased or decreased according to the requirements of legislation and patent practice in the jurisdiction. For example, in some jurisdictions, according to legislation and patent practice, computer-readable media do not include electric carrier signals and telecommunication signals.

[0163] It should be understood that although this specification is described in terms of implementation methods, not every implementation method contains only one independent technical solution. This narrative method of the specification is only for the sake of clarity. Those skilled in the art should regard the specification as a whole. The technical solutions in each implementation method can also be appropriately combined to form other implementation methods that can be understood by those skilled in the art.

[0164] The series of detailed descriptions listed above are only specific descriptions of feasible implementation methods of the present invention. They are not intended to limit the scope of protection of the present invention. Any equivalent implementation methods or changes that do not deviate from the technical spirit of the present invention should be included in the scope of protection of the present invention.

Claims

1. A method for automatic exposure control of imaging, characterized in that: The steps include: Determining whether a highlight area in the current image exceeds a preset highlight value, wherein the highlight area is determined to exceed the preset highlight value when the area of ​​the highlight area accounts for more than 10% of the total area of ​​the shooting area; if: Reduce the light intensity of the light according to a preset first amplitude; Get the next image; Repeat the steps of "reducing the light intensity of the light according to the preset first amplitude" and "acquiring the next image" until the highlight area in the next image does not exceed the preset highlight value; If not: Increase the light intensity by the preset second amplitude; Get the next image; The steps of "increasing the light intensity of the light according to the preset second amplitude" and "acquiring the next image" are repeated until the highlight area in the next image exceeds the preset highlight value; The current image is fused with a plurality of the next images to generate a fused image.

2. The automatic exposure control method for imaging according to claim 1, characterized in that: The step of "fusing the current image with a plurality of next images to generate a fused image" includes: Convert the illumination intensity corresponding to each next image and the current image when they are taken into a weighting coefficient; Each next image and the current image are multiplied by their respective weighting coefficients, and all multiplication results are summed to obtain the fused image.

3. The automatic exposure control method for imaging according to claim 1, wherein: The first amplitude and the second amplitude are always constant values.

4. A method for imaging a drawer, characterized in that: Including steps: Detecting the distance the drawer is pulled out; When the distance is within a preset distance range, an image of the drawer is acquired as a current image, and the automatic exposure control method for imaging according to any one of claims 1 to 3 is executed to obtain a fused image corresponding to the drawer.

5. A method for imaging a drawer, characterized in that: Including steps: Detecting the distance the drawer is pulled out; When the distance is outside the preset distance range, the following steps are executed: Turning on the high beam and turning off the low beam, acquiring the first image, and retaining only the long-distance image outside the preset distance range; Turn off the high beam, turn on the low beam, acquire a second image, and retain only the close-range image within the preset distance range; During the process of acquiring the long-distance image and / or the short-distance image, executing the automatic exposure control method for imaging according to any one of claims 1 to 3; The long-distance image and the short-distance image are stitched together to generate a complete image.

6. The method for imaging a drawer according to claim 5, characterized in that: The step of "acquiring a first image and retaining only long-distance images outside the preset distance range" includes: acquiring a first image; Only the image outside the preset distance range in the first image is retained as the current image, and the automatic exposure control method for imaging according to any one of claims 1 to 3 is run here to obtain a fused image as the long-distance image.

7. The method for imaging a drawer according to claim 5, characterized in that: The step of "acquiring a second image and retaining only close-range images within the preset distance range" includes: acquiring a second image; Only the image within the preset distance range in the second image is retained as the current image, and the automatic exposure control method for imaging according to any one of claims 1 to 3 is run here to obtain a fused image as the close-range image.

8. An automatic exposure control device for imaging, characterized in that: include: a determination module, configured to determine whether a highlight region in the current image exceeds a preset highlight value, wherein the highlight region is determined to exceed the preset highlight value when the area of ​​the highlight region accounts for more than 10% of the total area of ​​the shooting region; a brightness adjustment module, configured to reduce the light intensity of the light by a preset first amplitude when the judgment module determines that the condition is correct, or to increase the light intensity of the light by a preset second amplitude when the judgment module determines that the condition is correct; An image acquisition module, configured to acquire the current image and the next image; a loop module, configured to, when the judgment module determines that the result is yes, repeat the steps of "reducing the light intensity of the light by a preset first amplitude" and "acquiring the next image" until the highlight area in the next image does not exceed the preset highlight value, or, when the judgment module determines that the result is no, repeat the steps of "reducing the light intensity of the light by a preset second amplitude" and "acquiring the next image" until the highlight area in the next image exceeds the preset highlight value; The fusion module is used to fuse the current image with several next images to generate a fused image.

9. An imaging device for a drawer, characterized in that: include: A distance measuring module, used to detect the distance the drawer is pulled out; The first processing module is configured to obtain an image of the drawer as a current image when the distance is within a preset distance range, and to execute the automatic exposure control method for imaging according to any one of claims 1 to 3 to obtain a fused image corresponding to the drawer.

10. An imaging device for a drawer, characterized in that: include: A distance measuring module, used to detect the distance the drawer is pulled out; The second processing module is configured to execute the following steps when the distance is outside a preset distance range: Turning on the high beam and turning off the low beam, acquiring the first image, and retaining only the long-distance image outside the preset distance range; Turn off the high beam, turn on the low beam, acquire a second image, and retain only the close-range image within the preset distance range; During the process of acquiring the long-distance image and / or the short-distance image, executing the automatic exposure control method for imaging according to any one of claims 1 to 3; The long-distance image and the short-distance image are stitched together to generate a complete image.

11. An electronic device, characterized in that: include: a storage module storing a computer program; The processing module can implement the steps of the automatic exposure control method for imaging described in any one of claims 1 to 3 and / or the steps of the imaging method for a drawer described in any one of claims 4 to 7 when executing the computer program.

12. A readable storage medium storing a computer program, characterized in that: When the computer program is executed by the processing module, the steps of the automatic exposure control method for imaging described in any one of claims 1 to 3 and / or the steps of the imaging method for a drawer described in any one of claims 4 to 7 can be implemented.

Images