Image acquisition method and refrigerator

Abstract

The embodiment of the invention belongs to the technical field of household appliances, and provides an image acquisition method and a refrigerator, the image acquisition method is applied to the refrigerator, a target storage chamber of the refrigerator is provided with a plurality of image acquisition devices, and the acquisition view angles of different image acquisition devices are different. Controlling a first image acquisition device in the plurality of image acquisition devices to acquire a first image of the target storage room; based on the first image, detecting whether the collection windows of the plurality of image collection devices have water mist; and under the condition that the collection windows of the multiple image collection devices have no water mist, at least one second image collection device in the multiple image collection devices is controlled to collect a second image of the target storage chamber. Thus, a heating device does not need to be arranged, the cost can be saved, image collection is carried out when no water mist exists, the definition of the image viewed by a user is high, and the user experience can be improved.

Description

Technical Field

[0001] The embodiments of the present application relate to the field of home appliance technology, and more specifically, to an image acquisition method and a refrigerator. Background Art

[0002] The refrigerator's storage compartment is typically equipped with an image capture device that captures images of the interior. These captured images can be viewed by the user, allowing them to understand the food stored in the refrigerator's storage compartment. When the refrigerator door is opened, the cold air inside the refrigerator comes into contact with the warm air outside, potentially creating mist on the surface of the image capture device, reducing the clarity of the images captured by the device.

[0003] Currently, a heating device is usually provided on the image acquisition device to heat the surface of the image acquisition device to remove water mist on the surface of the image acquisition device, so as to increase the clarity of the image captured by the image acquisition device.

[0004] However, removing mist from the image acquisition device by using a heating device may increase the cost of the refrigerator, and the operation of the heating device consumes a certain amount of electricity. Summary of the Invention

[0005] The embodiments of the present application provide an image acquisition method and a refrigerator, which can capture clearer images without providing a heating device.

[0006] In a first aspect, an embodiment of the present application provides an image acquisition method, which is applied to a refrigerator, wherein a target storage compartment of the refrigerator is provided with multiple image acquisition devices, and each image acquisition device has a different acquisition perspective. The method includes:

[0007] When the door of the refrigerator is switched from an open state to a closed state, controlling a first image acquisition device among the plurality of image acquisition devices to acquire a first image of the target storage compartment;

[0008] Based on the first image, detecting whether there is water mist on the acquisition windows of the multiple image acquisition devices;

[0009] When there is no water mist on the acquisition windows of the multiple image acquisition devices, at least one second image acquisition device among the multiple image acquisition devices is controlled to acquire a second image of the target storage compartment.

[0010] In this application, the presence of mist on the capture windows of multiple image capture devices is determined based on images captured by a first image capture device. Only when the capture windows of multiple image capture devices are free of mist are the other image capture devices controlled to capture images. This eliminates the need for heating devices around the image capture devices, saving costs. Furthermore, image capture is performed when there is no mist, resulting in higher clarity for the user, improving the user experience.

[0011] In some embodiments of the present application, detecting whether there is water mist on the acquisition windows of the multiple image acquisition devices based on the first image includes:

[0012] identifying a gradient value of the first image;

[0013] Based on the gradient value of the first image, it is determined whether there is water mist on the acquisition windows of the multiple image acquisition devices.

[0014] In the present application, whether there is water mist on the acquisition windows of multiple image acquisition devices is determined by identifying the gradient value of the first image, so that the conclusion of whether there is water mist is more accurate.

[0015] In some embodiments of the present application, identifying the gradient value of the first image includes:

[0016] Determine an image of a target area not blocked by food in the first image;

[0017] Based on the image of the target area, a gradient value of the first image is calculated.

[0018] In the present application, since the food in the target storage room may change due to the user's taking and storing, if the gradient value of the first image is determined by the gradient value of the area including the food, the accuracy of the determined gradient value may be low due to the change of the food. The present application determines the gradient value of the image of the area not blocked by the food as the gradient value of the first image, so that the clarity of the first image can be determined by the gradient value later, making the result of determining whether there is water mist in the acquisition window more accurate.

[0019] In some embodiments of the present application, determining whether there is water mist on the acquisition windows of the multiple image acquisition devices based on the gradient value of the first image includes:

[0020] Determining a preset gradient value corresponding to the target area in a pre-stored correspondence relationship, wherein the correspondence relationship is a correspondence relationship between the area and the gradient value;

[0021] When the gradient value of the first image is greater than or equal to a preset gradient value, it is determined that the acquisition windows of the multiple image acquisition devices are free of water mist.

[0022] In the present application, by comparing the gradient value of the target area in the captured image with the gradient value of the target area when there is no water mist, it can be more accurately determined whether there is water mist in the image capture device.

[0023] In some embodiments of the present application, when the gradient value of the first image is greater than or equal to a preset gradient value, determining that the acquisition windows of the multiple image acquisition devices are free of water mist includes:

[0024] When the gradient value of the first image is greater than or equal to a preset gradient value, after a preset time interval, controlling the first image acquisition device to acquire a second image of the target storage room;

[0025] Calculating a gradient value of the second image based on an image of the target area not blocked by food in the second image;

[0026] When the gradient value of the second image is less than or equal to the gradient value of the first image, it is determined that the acquisition windows of the multiple image acquisition devices are free of water mist.

[0027] In the present application, after determining that the acquisition windows of multiple image acquisition devices are free of water mist through a preset gradient value, the gradient values ​​of the two images can be further compared. Only when the gradient value of the image acquired for the second time is less than or equal to the gradient value of the image acquired for the first time, can it be determined that the acquisition windows of the multiple image acquisition devices are free of water mist. This can further improve the accuracy of the conclusion that the acquisition windows of the multiple image acquisition devices are free of water mist.

[0028] In some embodiments of the present application, the method further includes:

[0029] When the gradient value of the second image is greater than the gradient value of the first image, after the preset time interval, the first image acquisition device continues to be controlled to acquire images of the target storage room until the gradient value of the newly acquired image based on the target image is less than or equal to the gradient value of the previous image based on the target image.

[0030] In the present application, when it is determined that there is water mist in the acquisition windows of multiple image acquisition devices, an image is acquired once every preset time period, and the gradient value of the newly acquired image is compared with the gradient value of the previously acquired image until the gradient value no longer increases. Only then is it determined that there is no water mist in the acquisition windows of the multiple image acquisition devices.

[0031] In some embodiments of the present application, determining whether there is water mist on the acquisition windows of the multiple image acquisition devices based on the gradient value of the first image includes:

[0032] After a preset time interval, controlling the first image acquisition device to acquire a third image of the target storage room;

[0033] calculating a gradient value of the third image based on an image of the target area not blocked by food in the third image;

[0034] When the gradient value of the third image is less than or equal to the gradient value of the first image, it is determined that the acquisition windows of the multiple image acquisition devices are free of water mist.

[0035] In the present application, by comparing the gradient values ​​of the two images, it is determined that there is no water mist in the acquisition windows of the multiple image acquisition devices only when the gradient value of the second acquired image is less than or equal to the gradient value of the first acquired image, so that the conclusion that there is no water mist in the acquisition windows of the multiple image acquisition devices is more accurate.

[0036] In some embodiments of the present application, the method further includes:

[0037] The images captured by the multiple image capture devices are sent to a cloud device so that a user can view the images on the cloud device through a terminal device.

[0038] In the present application, by sending the image captured by the image acquisition device when there is no water mist on the acquisition window to the cloud device, the image sent to the cloud device has higher clarity, which makes it convenient for users to understand the situation of the food in the target storage room by viewing the image on the cloud device.

[0039] In a second aspect, the present application provides a refrigerator, comprising:

[0040] The box body is configured with a target storage room;

[0041] a door body connected to the box body;

[0042] Multiple image acquisition devices are provided on the door body for acquiring images of the target storage room; different image acquisition devices have different acquisition viewing angles;

[0043] The controller is disposed in the box and is configured to:

[0044] When the door of the refrigerator is switched from an open state to a closed state, controlling a first image acquisition device among the plurality of image acquisition devices to acquire a first image of the target storage compartment;

[0045] Based on the first image, detecting whether there is water mist on the acquisition windows of the multiple image acquisition devices;

[0046] When there is no water mist on the acquisition windows of the multiple image acquisition devices, at least one second image acquisition device among the multiple image acquisition devices is controlled to acquire a second image of the target storage compartment.

[0047] In some embodiments of the present application, the refrigerator further includes:

[0048] A vertical partition is provided on the door body;

[0049] The plurality of image acquisition devices are evenly arranged on the vertical partitions.

[0050] In a third aspect, the present application provides a computer-readable storage medium, wherein the computer-readable storage medium stores computer-executable instructions, and when the computer-executable instructions are executed by a computer, they are used to implement the method described in the second aspect.

[0051] The computer-readable storage medium provided in the embodiment of the present application can execute the technical solutions in the above method embodiments, and its beneficial effects are similar and will not be repeated here.

[0052] In a fourth aspect, the present application provides a computer program product, comprising a computer program, which is used to implement the method described in the second aspect when executed by a computer.

[0053] The computer program product provided in the embodiment of the present application can execute the technical solutions in the above method embodiments, and its beneficial effects are similar, which will not be described in detail here.

[0054] An embodiment of the present application provides an image acquisition method and a refrigerator. The image acquisition method is applied to a refrigerator, wherein a target storage compartment of the refrigerator is provided with multiple image acquisition devices, each of which has a different acquisition perspective. The method includes: when the refrigerator door switches from an open state to a closed state, controlling a first image acquisition device among the multiple image acquisition devices to acquire a first image of the target storage compartment; based on the first image, detecting whether the acquisition windows of the multiple image acquisition devices are misted; and when the acquisition windows of the multiple image acquisition devices are free of mist, controlling at least one second image acquisition device among the multiple image acquisition devices to acquire a second image of the target storage compartment. This eliminates the need for a heating device around the image acquisition devices, saving costs, and enables image acquisition when there is no mist, resulting in higher clarity of images viewed by the user and improving the user experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0055] In order to more clearly illustrate the implementation methods in the embodiments of the present application or related technologies, the following is a brief introduction to the drawings required for use in the embodiments or related technology descriptions. Obviously, the drawings described below are some embodiments of the present application. For ordinary technicians in this field, other drawings can also be obtained based on these drawings.

[0056] Figure 1 is a schematic diagram of a refrigerator according to some embodiments;

[0057] Figure 2 is a schematic structural diagram of a vertical partition according to some embodiments;

[0058] Figure 3 is a flowchart of an image acquisition method according to some embodiments;

[0059] Figure 4 is a schematic diagram of a camera lens with water fog according to some embodiments;

[0060] Figure 5 is a schematic diagram of interaction between modules of an image acquisition method according to some embodiments;

[0061] Figure 6 is a schematic diagram of a process for detecting whether there is water mist on acquisition windows of multiple image acquisition devices according to some embodiments;

[0062] Figure 7 is a schematic diagram of an image captured by a first image capturing device according to some embodiments;

[0063] Figure 8 A flowchart of a method for determining whether there is water mist on acquisition windows of multiple image acquisition devices according to some embodiments is shown;

[0064] Figure 9 is a flowchart of another image acquisition method according to some embodiments;

[0065] Figure 10 1 is a flow chart of another method for determining whether there is water mist on the acquisition windows of multiple image acquisition devices according to some embodiments. DETAILED DESCRIPTION

[0066] In order to make the purpose, implementation mode and advantages of the present application clearer, the exemplary implementation mode of the present application will be clearly and completely described below in conjunction with the drawings in the exemplary embodiments of the present application. Obviously, the described exemplary embodiments are only part of the embodiments of the present application, not all of the embodiments.

[0067] It should be noted that the brief descriptions of terms in this application are only for the purpose of facilitating the understanding of the embodiments described below, and are not intended to limit the embodiments of this application. Unless otherwise specified, these terms should be understood according to their ordinary and usual meanings.

[0068] In addition, the terms "comprises" and "comprising" and any variations thereof are intended to cover but not exclude inclusion, for example, a product or device comprising a list of components is not necessarily limited to those components expressly listed but may include other components not expressly listed or inherent to such product or device.

[0069] At present, as refrigerators become more intelligent, an image acquisition device is usually set up in the refrigerator to capture images of the refrigerator storage compartment. The images can be viewed by users so that users can understand the food stored in the refrigerator storage compartment.

[0070] Because the temperature inside a refrigerator is typically lower than the ambient temperature outside, when the refrigerator door is opened, hot, humid air from outside rapidly rushes in. Upon encountering the cooler surface of the image acquisition device (which is at a temperature close to the temperature inside the refrigerator), the water vapor in the air cools and liquefies, forming small water droplets that adhere to the surface of the image acquisition device, forming a mist on the surface of the image acquisition device. This mist can also form on the acquisition window of the image acquisition device used for image capture, such as the lens of the image acquisition device.

[0071] Considering that users may open the refrigerator to take out food, the image capture device generally captures images after the refrigerator door is opened and closed. However, due to the fog on the capture window of the image capture device, the clarity of the image captured by the image capture device is low. Users may not be able to clearly see the food inside the refrigerator by viewing the low-definition image.

[0072] In some implementations, a heating device is provided on the image acquisition device, and the heating device is used to heat the surface of the image acquisition device to remove water mist on the surface of the image acquisition device, so as to increase the clarity of the image captured by the image acquisition device.

[0073] However, removing mist from the image acquisition device by using a heating device may increase the cost of the refrigerator, and the operation of the heating device consumes a certain amount of electricity.

[0074] Based on this, the present application provides an image acquisition method. After the refrigerator door is closed, the method uses images captured by one of multiple image acquisition devices to determine whether there is mist on the acquisition window of the image acquisition device. When the acquisition window of the image acquisition device is free of mist, the method controls the other image acquisition devices to acquire images. This eliminates the need for a heating device around the image acquisition device, saving costs. Furthermore, the method enables image acquisition when there is no mist, resulting in higher clarity for the user, improving the user experience.

[0075] The technical solution of the present application is described in detail below in conjunction with specific embodiments. The following specific embodiments can be combined with each other or exist independently. For the same or similar concepts or processes, some embodiments may not be described in detail. The embodiments of the present application will be described below in conjunction with the accompanying drawings.

[0076] First, the structure of the refrigerator provided in some embodiments of the present application is described.

[0077] In one possible implementation, Figure 1 is a schematic diagram of a refrigerator according to some embodiments, such as Figure 1 As shown, the refrigerator 10 includes a cabinet 101 .

[0078] The refrigerator 10 further includes a door 102 , which is connected to the housing 101 .

[0079] The refrigerator 10 further includes at least one storage chamber, which is disposed in the housing 101 .

[0080] In the present application, the at least one storage chamber includes a target storage chamber.

[0081] In a possible implementation, the storage chamber includes a refrigeration chamber and a freezer chamber, and / or a temperature-changing chamber, etc.

[0082] In a possible implementation, the refrigerator 10 further includes a controller. The controller is disposed in the housing 101 .

[0083] In the embodiment of the present application, the controller may be a microcontroller unit (MCU) or other types of controllers. The embodiment of the present application does not specifically limit the controller.

[0084] like Figure 1 As shown, the refrigerator 10 further includes a vertical partition 103 , which is disposed on the door body 102 .

[0085] In this application, multiple image acquisition devices may be provided on the vertical partition 103. Figure 1 As shown, when the refrigerator door is closed, the image acquisition device provided on the vertical partition 103 faces the interior of the storage compartment as the vertical partition 103 is positioned. The image acquisition device is used to capture images of the storage compartment, and different image acquisition devices have different capture viewing angles.

[0086] Exemplarily, the image acquisition device may be a camera, etc., and the embodiment of the present application does not specifically limit the type of image acquisition.

[0087] There can be 2 or 3 image acquisition devices, and the specific number can be set according to the actual situation in the storage room. The embodiment of the present application does not limit the number of image acquisition devices.

[0088] Exemplarily, the storage room may include a plurality of partitions, which divide the storage room into a plurality of levels. An image acquisition device may be used to capture images of corresponding levels.

[0089] Figure 2 Schematic diagram of the structure of a vertical partition according to some embodiments.

[0090] like Figure 2 As shown, three image acquisition devices are provided on the vertical partition 103, and the three cameras are evenly arranged on the vertical partition.

[0091] In the present application, the image acquisition device can capture images of the corresponding storage room so that the user can determine the condition of the food stored in the storage room by viewing the image.

[0092] In combination with the above content, the following describes a method for image acquisition during the operation of a refrigerator. The image acquisition method is applied to the controller of the refrigerator. For details, see Figure 3 shown. Figure 3 A flowchart of an image acquisition method according to some embodiments is shown.

[0093] Figure 3 As shown, the image acquisition method may include the following steps:

[0094] S301: When a door of a refrigerator is switched from an open state to a closed state, a first image acquisition device among a plurality of image acquisition devices is controlled to acquire a first image of a target storage compartment.

[0095] When a user wants to take food out of the refrigerator or put food into the refrigerator, he needs to open the door of the refrigerator. The controller can detect that the door is opened and determine that the door is in an open state.

[0096] When the user finishes taking out the food or putting the food in, the refrigerator door is closed and the controller can detect that the door is switched from the open state to the closed state.

[0097] Therefore, when the refrigerator door switches from an open state to a closed state, the user may be taking out or putting food into the storage room. Therefore, it is necessary to capture images of the storage room so that the image viewed by the user is the latest image of the storage room.

[0098] In the present application, the target storage room may be a refrigeration room, a temperature-changing room, or a freezer room, and the embodiments of the present application do not limit this.

[0099] The first image acquisition device may be a pre-set image acquisition device among multiple image acquisition devices, or any image acquisition device. For example, it may be the image acquisition device located at the top of the vertical partition. This embodiment of the present application is not limited to this.

[0100] For example, the controller may send a control signal for performing image acquisition to the first image acquisition device, so that the first image acquisition device acquires an image of the target storage chamber.

[0101] S302: Based on the first image, detect whether there is water mist on the acquisition windows of multiple image acquisition devices.

[0102] The acquisition window is an optical element used for image acquisition, such as a camera lens or a glass cover, etc. The embodiment of the present application does not specifically limit the acquisition window.

[0103] Exemplarily, the controller can detect whether there is water mist on the acquisition window of the first image acquisition device based on the first image. Since the temperatures of multiple image acquisition devices are close, the water mist state of the acquisition window of the first image acquisition device can be used to characterize the water mist state of the acquisition window of any image acquisition device.

[0104] When the capture window of the first image capture device is fogged, the clarity of the first image is low. When the capture window of the first image capture device is free of fog, the clarity of the first image is high. Therefore, whether the capture window of the first image capture device is fogged can be determined based on the clarity of the first image.

[0105] Therefore, when it is detected based on the first image that there is water mist on the acquisition window of the first image acquisition device, it can be determined that there is water mist on the acquisition windows of multiple image acquisition devices; when it is detected based on the first image that there is no water mist on the acquisition window of the first image acquisition device, it can be determined that there is no water mist on the acquisition windows of multiple image acquisition devices.

[0106] For example, the image acquisition device is a camera, and the acquisition window is the lens of the camera. Figure 4 FIG1 is a schematic diagram of a camera lens with water mist according to some embodiments.

[0107] S303: When there is no water mist on the acquisition windows of the multiple image acquisition devices, control at least one second image acquisition device among the multiple image acquisition devices to acquire a second image of the target storage compartment.

[0108] The second image acquisition device is an image acquisition device other than the first image acquisition device among the multiple image acquisition devices.

[0109] When there is no water mist on the acquisition windows of the multiple image acquisition devices, the clarity of the images acquired by the image acquisition devices is high. Therefore, at least one second image acquisition device among the multiple image acquisition devices can be controlled to acquire a second image of the target storage compartment.

[0110] For example, the first acquisition device is Figure 2 The uppermost image acquisition device on the middle vertical partition can control other image acquisition devices on the vertical partition to acquire images when it is determined that there is no water mist on the acquisition windows of multiple image acquisition devices.

[0111] In this way, after the refrigerator door is closed, the image captured by one of the multiple image capture devices is used to determine whether there is mist on the capture window of the image capture device. When the capture window of the image capture device is free of mist, the other image capture devices are controlled to capture images. This eliminates the need for heating devices around the image capture devices, saving costs. Furthermore, image capture is performed when there is no mist, resulting in higher clarity for the user, improving the user experience.

[0112] In the present application, after controlling the second image acquisition device to capture images, the images captured by multiple image acquisition devices can be sent to a cloud device so that the user can view the images on the cloud device through the terminal device.

[0113] In this way, by sending the image captured by the image acquisition device when there is no water mist on the acquisition window to the cloud device, the image sent to the cloud device has higher clarity, which makes it easier for users to understand the situation of the food in the target storage room by viewing the image on the cloud device.

[0114] In the present application, the clarity of the first image captured by the first image capture device can be detected by a clarity detection module to detect whether there is water mist on the capture window of the first image capture device.

[0115] Figure 5 A schematic diagram of the interaction between modules of an image acquisition method according to some embodiments.

[0116] like Figure 5 As shown, the controller can detect the open and close status of the door body and can interact with the camera set on the vertical partition to control the camera to collect images. The clarity detection module can also detect the clarity of the image collected by the camera to detect whether the camera lens is fogged.

[0117] It should be noted that the clarity detection module can be integrated into the controller. In order to more clearly illustrate the clarity detection, the embodiment of the present application lists the clarity detection module separately.

[0118] Figure 5 This is only an exemplary description and does not constitute any limitation.

[0119] In this application, the clarity of an image can be represented by the gradient value of the image.

[0120] Figure 6 The figure is a flow chart of detecting whether there is water mist on the acquisition windows of multiple image acquisition devices according to some embodiments.

[0121] like Figure 6As shown, detecting whether there is water mist on the acquisition windows of multiple image acquisition devices may include the following steps:

[0122] S601: Identify the gradient value of a first image.

[0123] For example, the gradient value of the first image may be calculated using a basic difference method, a Sobel operator, a Laplace operator, or the like. The embodiment of the present application does not specifically limit the method for calculating the gradient value of the first image.

[0124] In the present application, identifying the gradient value of the first image may include: determining an image of a target area in the first image that is not blocked by food; and calculating the gradient value of the first image based on the image of the target area.

[0125] For example, the target area not obstructed by food can be a pre-defined area, such as the upper portion or one side of a refrigerator, which will not be obstructed even if the target storage compartment is filled with food. Alternatively, the target area not obstructed by food can be determined by analyzing the first image.

[0126] After acquiring the first image, food identification may be performed on the first image to determine a target area in the first image that is not blocked by the food.

[0127] After determining the image of the target area that is not blocked by the food, the gradient value of the image of the target area may be calculated, and the calculated gradient value may be determined as the gradient value of the first image.

[0128] In this way, since the food in the target storage room may change due to the user's taking and storing, if the gradient value of the first image is determined by the gradient value of the area including the food, the accuracy of the determined gradient value may be low due to the change of the food. The present application determines the gradient value of the image of the area not blocked by the food as the gradient value of the first image, so that the clarity of the first image can be determined based on the gradient value, thereby making the result of determining whether there is water mist in the acquisition window more accurate.

[0129] S602: Determine whether there is water mist on the acquisition windows of multiple image acquisition devices based on the gradient value of the first image.

[0130] Illustratively, after determining the gradient value of the first image, the gradient value can be compared with a pre-stored gradient value to determine whether there is water mist on the acquisition window of the first image acquisition device, that is, to determine whether there is water mist on the acquisition windows of multiple image acquisition devices.

[0131] In this way, whether there is water mist on the acquisition windows of the plurality of image acquisition devices is determined by identifying the gradient value of the first image, so that the conclusion of whether there is water mist is more accurate.

[0132] Based on the above embodiment, the image captured by the first image capture device when there is water mist on the capture window, and the image captured after the water mist disappears can be seen in Figure 7 shown. Figure 7 A schematic diagram of an image captured by a first image capture device according to some embodiments.

[0133] Depend on Figure 7 It can be seen that the clarity of the image collected when there is water mist is lower than the clarity of the image collected when there is no water mist, and the clarity can be determined by the gradient value. Therefore, the method of the present application for judging whether there is water mist in the acquisition window of the image acquisition device by the gradient value has a higher accuracy.

[0134] In the present application, determining whether there is water mist in the acquisition windows of multiple image acquisition devices based on the gradient value of the first image may include the following two possible implementations:

[0135] A possible implementation, Figure 8 A flowchart of a method for determining whether there is water mist on acquisition windows of multiple image acquisition devices according to some embodiments is provided.

[0136] like Figure 8 As shown, the method for determining whether there is water mist on the acquisition windows of multiple image acquisition devices may include:

[0137] S801: Determine a gradient value of a target area in a first image.

[0138] For determining the gradient value of the target area in the first image, reference may be made to the above embodiments, which will not be described in detail here.

[0139] S802: Determine a preset gradient value corresponding to the target area in a pre-stored correspondence relationship, where the correspondence relationship is a correspondence relationship between the area and the gradient value.

[0140] Exemplarily, the controller may pre-store a plurality of correspondences between regions and gradient values. Thus, after determining the target region, the preset gradient value corresponding to the target region may be determined from the pre-stored correspondences.

[0141] It should be noted that the pre-gradient value is the gradient value of the target area in the captured image when there is no water mist in the capture window of the image capture device.

[0142] S803: When the gradient value of the first image is greater than or equal to a preset gradient value, determine that the acquisition windows of the multiple image acquisition devices are free of water mist.

[0143] Since the size of the gradient value is proportional to the clarity of the image, when the gradient value of the first image is greater than or equal to the preset gradient value, it means that the clarity of the current first image is equal to or equal to the clarity of the image captured when there is no water fog. Therefore, it can be determined that there is no water fog in the capture window of the first image capture device, that is, it can be determined that there is no water fog in the capture windows of multiple image capture devices.

[0144] S804: When the gradient value of the first image is less than a preset gradient value, determine that there is water mist on the acquisition windows of the multiple image acquisition devices.

[0145] In this way, by comparing the gradient value of the target area in the captured image with the gradient value of the target area when there is no water mist, it can be determined more accurately whether there is water mist in the image capture device.

[0146] In the present application, when the gradient value of the first image is greater than or equal to a preset gradient value, the first image acquisition device is controlled to acquire a second image of the target storage room after a preset time interval; based on the image of the target area not blocked by food in the second image, the gradient value of the second image is calculated; when the gradient value of the second image is less than or equal to the gradient value of the first image, it is determined that there is no water mist on the acquisition windows of multiple image acquisition devices.

[0147] The preset duration can be 1 minute or 2 minutes. The embodiment of the present application does not specifically limit the preset duration.

[0148] The method for calculating the gradient value of the second image is similar to the method for calculating the gradient value of the first image in the above embodiment. Please refer to the above embodiment and will not be repeated here.

[0149] Since the gradient value is proportional to the clarity of the image, when the gradient value of the second image is greater than the gradient value of the first image, it means that the clarity of the second image is greater than the clarity of the first image, that is, the clarity of the image becomes greater after the preset time period. Since the water mist in the acquisition window will disappear over time, it can be determined that there is water mist in the acquisition windows of multiple image acquisition devices.

[0150] When the gradient value of the second image is less than or equal to the gradient value of the first image, it indicates that the clarity of the second image is less than or equal to the clarity of the first image. Therefore, it can be determined that the acquisition windows of the multiple image acquisition devices are free of water mist.

[0151] In this way, after determining that there is no water mist on the acquisition windows of multiple image acquisition devices through a preset gradient value, the gradient values ​​of the two images can be further compared. Only when the gradient value of the image acquired for the second time is less than or equal to the gradient value of the image acquired for the first time, it is determined that there is no water mist on the acquisition windows of the multiple image acquisition devices. This can further improve the accuracy of the conclusion that there is no water mist on the acquisition windows of the multiple image acquisition devices.

[0152] Furthermore, when the gradient value of the second image is greater than the gradient value of the first image, after a preset time interval, the first image acquisition device continues to be controlled to acquire images of the target storage room until the gradient value of the newly acquired image based on the target image is less than or equal to the gradient value of the previous image based on the target image.

[0153] It should be noted that the method for determining the gradient value of the newly acquired image can be referred to the above embodiment and will not be described in detail here.

[0154] When the gradient value of the newly acquired image based on the target image is less than or equal to the gradient value of the previous image based on the target image, it can be determined that the acquisition windows of the multiple image acquisition devices are free of water mist.

[0155] In this way, when it is determined that there is water mist in the acquisition windows of multiple image acquisition devices, an image is acquired once every preset time period, and the gradient value of the newly acquired image is compared with the gradient value of the previously acquired image until the gradient value no longer increases. Only then is it determined that there is no water mist in the acquisition windows of the multiple image acquisition devices.

[0156] In this application, if the above Figure 8 In step S804, when the gradient value of the first image is less than a preset gradient value, it is determined that there is water mist in the capture windows of the multiple image capture devices. Alternatively, the first image capture device may be controlled to continue capturing images after a preset time interval, and whether the water mist in the capture windows of the multiple image capture devices has disappeared is determined based on the gradient value of the newly captured image and the gradient value of the first image.

[0157] If the water mist in the acquisition windows of the multiple image acquisition devices has not disappeared, new images continue to be acquired until the gradient value of the newly acquired image based on the target image is less than or equal to the gradient value of the previous image based on the target image.

[0158] For details, please refer to Figure 9 shown. Figure 9 4 is a flow chart of another image acquisition method according to some embodiments.

[0159] like Figure 9 As shown, the image acquisition method may include:

[0160] S901: The user closes the refrigerator door.

[0161] For example, the user may close the refrigerator door after taking out food or storing food. The embodiment of the present application does not limit the specific circumstances in which the user closes the refrigerator door.

[0162] As mentioned above Figure 5 As shown, after the user closes the refrigerator door, the control can detect that the refrigerator door is switched from an open state to a closed state.

[0163] S902: Control the first image acquisition device to acquire an image and calculate the gradient value of the image.

[0164] For example, when the refrigerator door is closed, the first image acquisition device is controlled to take a first photo, and the gradient value of the selected image area, that is, the target area, is calculated. The selected area can be an area in the photo that is not blocked by food, the center of the photo, the edge, or a pre-set specific area that is not blocked by food. The embodiment of the present application does not specifically limit the target area.

[0165] Calculate the gradient value of the target area The method can be found in the above embodiment and will not be described again here.

[0166] S903: Determine whether the gradient value of the image is greater than or equal to a preset gradient value.

[0167] The preset gradient value may be a pre-stored gradient value of a selected area when there is no water mist.

[0168] For example, the gradient value of the selected area is

[0169] When the gradient value of the image is greater than or equal to the preset gradient value, that is, When the photo is relatively clear, it can be determined that there is no water mist on the acquisition windows of the multiple image acquisition devices, and step S906 can be executed.

[0170] When the gradient value of the image is less than the preset gradient value, that is, When the photo is blurry, it can be determined that there is water mist on the capture windows of the multiple image capture devices, and step S904 can be executed.

[0171] S904: After the preset time period, control the first image acquisition device to acquire a new image and calculate the gradient value of the new image.

[0172] The calculation of the gradient value of the new image can be referred to the above embodiment, which will not be repeated here.

[0173] S905: Determine whether the gradient value of the new image is greater than the gradient value of the last acquired image.

[0174] When the gradient value of the new image is greater than the gradient value of the last captured image, it can be determined that there is water mist in the capture windows of the multiple image capture devices, and step S902 can be executed.

[0175] For example, step S902 may be performed after a preset time interval to provide a certain amount of time for the water mist in the capture window of the first image capture device to dissipate.

[0176] When the gradient value of the new image is less than or equal to the gradient value of the last captured image, it can be determined that the capture windows of the multiple image capture devices are free of water mist, and step S906 can be executed.

[0177] S906. Upload the image to the cloud device.

[0178] In the present application, when it is determined that there is no water mist on the acquisition windows of multiple image acquisition devices, the multiple image acquisition devices can be controlled to acquire images and upload the acquired images to a cloud device.

[0179] In another possible implementation, Figure 10 1 is a flow chart of another method for determining whether there is water mist on the acquisition windows of multiple image acquisition devices according to some embodiments.

[0180] like Figure 10 As shown, the method for determining whether there is water mist on the acquisition windows of multiple image acquisition devices may include:

[0181] S1001: Determine a gradient value of a target area in a first image.

[0182] S1002: After a preset time interval, control the first image acquisition device to acquire a third image of the target storage room.

[0183] After a preset time period, a control signal may be sent to the first image acquisition device to control the first image acquisition device to acquire a third image of the target storage room.

[0184] S1003: Calculate a gradient value of the third image based on an image of the target area not blocked by food in the third image.

[0185] The method for calculating the gradient value of the third image is similar to the method for calculating the gradient value of the first image in the above embodiment. Please refer to the above embodiment and will not be repeated here.

[0186] S1004: When the gradient value of the third image is less than or equal to the gradient value of the first image, determine that the acquisition windows of the multiple image acquisition devices are free of water mist.

[0187] Since the gradient value is proportional to the clarity of the image, when the gradient value of the third image is greater than the gradient value of the first image, it means that the clarity of the third image is greater than the clarity of the first image, that is, the clarity of the image becomes greater after the preset time period. Since the water mist in the acquisition window will disappear over time, it can be determined that there is water mist in the acquisition windows of multiple image acquisition devices.

[0188] When the gradient value of the third image is less than or equal to the gradient value of the first image, it indicates that the clarity of the third image is less than or equal to the clarity of the first image. Therefore, it can be determined that the acquisition windows of the multiple image acquisition devices are free of water mist.

[0189] In this way, by comparing the gradient values ​​of the two images, only when the gradient value of the image acquired for the second time is less than or equal to the gradient value of the image acquired for the first time, it is determined that there is no water mist in the acquisition windows of the multiple image acquisition devices, which can further improve the accuracy of the conclusion that there is no water mist in the acquisition windows of the multiple image acquisition devices.

[0190] S1005. When the gradient value of the third image is greater than the gradient value of the first image, the first image acquisition device is controlled to continue acquiring images of the target storage room after a preset time interval until the gradient value of the newly acquired image based on the target image is less than or equal to the gradient value of the previous image based on the target image.

[0191] In summary, this application eliminates the need for heating wires around the image acquisition device, saving costs. Furthermore, the application utilizes natural defogging, taking advantage of the low timeliness requirements of refrigerators, while also employing software algorithm control logic to achieve clear photography. This saves costs while ensuring excellent photography results.

[0192] The present application also provides a computer-readable storage medium, which may include: a USB flash drive, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a disk or an optical disk, and other media that can store program codes. Specifically, the computer-readable storage medium stores computer execution instructions, which, when executed by a computer, are used to implement the technical solution shown in the above method embodiment.

[0193] The present application also provides a program product, which includes execution instructions stored in a readable storage medium. When the computer program is executed by a computer, the technical solution shown in the above method embodiment is executed. The specific implementation method and technical effect are similar and will not be repeated here.

[0194] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present application, rather than to limit them. Although the present application has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or make equivalent replacements for some or all of the technical features therein. These modifications or replacements do not deviate the essence of the corresponding technical solutions from the scope of the technical solutions of the embodiments of the present application.

[0195] For ease of explanation, the above description has been presented in conjunction with specific embodiments. However, the above exemplary discussion is not intended to be exhaustive or to limit the embodiments to the specific forms disclosed above. Based on the above teachings, various modifications and variations are possible. The above embodiments have been selected and described to better explain the principles and practical applications, thereby enabling those skilled in the art to better utilize the embodiments and various variations of the embodiments suitable for specific use considerations.

[0196] In this application, "and / or" is simply a description of the relationship between related objects, indicating that three relationships can exist. For example, A and / or B can represent: A exists alone, A and B exist simultaneously, and B exists alone. In addition, the character " / " in this document indicates that the related objects are in an "or" relationship.

[0197] "At least one of the following" or similar expressions refers to any combination of these items, including any combination of single or plural items. For example, at least one of a, b, or c can mean: a, b, c, a and b, a and c, b and c, or a, b, and c, where each of a, b, and c can be an element itself or a set containing one or more elements.

[0198] In this application, "at least one" means one or more. "Multiple" means two or more. The first, second, etc. descriptions that appear in the embodiments of this application are only for illustration and to distinguish the described objects. There is no order, nor does it represent a special limitation on the number of devices in the embodiments of this application, and cannot constitute any limitation on the embodiments of this application. For example, the first threshold and the second threshold are only for distinguishing different thresholds, and do not indicate the difference in size, priority, or importance of the two thresholds.

[0199] Throughout this application, the terms "exemplary," "in some embodiments," and "in other embodiments" are used to indicate examples, illustrations, or descriptions. Any embodiment or design described in this application as "exemplary" should not be construed as preferred or advantageous over other embodiments or designs. Rather, the use of the word "exemplary" is intended to present concepts in a concrete manner.

[0200] In this application, the terms "of," "corresponding," "relevant," "corresponding," and "associated" may sometimes be used interchangeably. It should be noted that, when the distinction is not emphasized, the meanings they convey are consistent. In the embodiments of this application, the terms "communication" and "transmission" may sometimes be used interchangeably. It should be noted that, when the distinction is not emphasized, the meanings they convey are consistent. For example, "transmission" may include "sending" and / or "receiving," and may be either a noun or a verb.

[0201] In this application, "equal to" can be used in conjunction with "less than" or "greater than", but not with both "less than" and "greater than". When "equal to" is used in conjunction with "less than", the technical solution used for "less than" applies. When "equal to" is used in conjunction with "greater than", the technical solution used for "greater than" applies.

Claims

1. An image acquisition method, characterized in that: Applied to a refrigerator, wherein a target storage compartment of the refrigerator is provided with a plurality of image acquisition devices, and different image acquisition devices have different acquisition viewing angles, the method includes: When the door of the refrigerator is switched from an open state to a closed state, controlling a first image acquisition device among the plurality of image acquisition devices to acquire a first image of the target storage compartment; Based on the first image, detecting whether there is water mist on the acquisition windows of the multiple image acquisition devices; When there is no water mist on the acquisition windows of the multiple image acquisition devices, at least one second image acquisition device among the multiple image acquisition devices is controlled to acquire a second image of the target storage compartment.

2. The method according to claim 1, characterized in that The detecting, based on the first image, whether there is water mist on the acquisition windows of the plurality of image acquisition devices includes: identifying a gradient value of the first image; Based on the gradient value of the first image, it is determined whether there is water mist on the acquisition windows of the multiple image acquisition devices.

3. The method according to claim 2, characterized in that The identifying the gradient value of the first image includes: Determine an image of a target area not blocked by food in the first image; Based on the image of the target area, a gradient value of the first image is calculated.

4. The method according to claim 3, characterized in that The determining, based on the gradient value of the first image, whether there is water mist on the acquisition windows of the plurality of image acquisition devices comprises: Determining a preset gradient value corresponding to the target area in a pre-stored correspondence relationship, wherein the correspondence relationship is a correspondence relationship between the area and the gradient value; When the gradient value of the first image is greater than or equal to a preset gradient value, it is determined that the acquisition windows of the multiple image acquisition devices are free of water mist.

5. The method according to claim 4, characterized in that When the gradient value of the first image is greater than or equal to a preset gradient value, determining that the acquisition windows of the plurality of image acquisition devices are free of water mist comprises: When the gradient value of the first image is greater than or equal to a preset gradient value, after a preset time interval, controlling the first image acquisition device to acquire a second image of the target storage room; Calculating a gradient value of the second image based on an image of the target area not blocked by food in the second image; When the gradient value of the second image is less than or equal to the gradient value of the first image, it is determined that the acquisition windows of the multiple image acquisition devices are free of water mist.

6. The method according to claim 5, characterized in that The method further comprises: When the gradient value of the second image is greater than the gradient value of the first image, after the preset time interval, the first image acquisition device continues to be controlled to acquire images of the target storage room until the gradient value of the newly acquired image based on the target image is less than or equal to the gradient value of the previous image based on the target image.

7. The method according to claim 3, characterized in that The determining, based on the gradient value of the first image, whether there is water mist on the acquisition windows of the plurality of image acquisition devices comprises: After a preset time interval, controlling the first image acquisition device to acquire a third image of the target storage room; calculating a gradient value of the third image based on an image of the target area not blocked by food in the third image; When the gradient value of the third image is less than or equal to the gradient value of the first image, it is determined that the acquisition windows of the multiple image acquisition devices are free of water mist.

8. The method according to any one of claims 1 to 7, characterized in that The method further comprises: The images captured by the multiple image capture devices are sent to a cloud device so that a user can view the images on the cloud device through a terminal device.

9. A refrigerator, characterized in that: The refrigerator comprises: The box body is constructed with a target storage room; a door body connected to the box body; Multiple image acquisition devices are provided on the door body for acquiring images of the target storage room; different image acquisition devices have different acquisition viewing angles; The controller is disposed in the box and is configured to: When the door of the refrigerator is switched from an open state to a closed state, controlling a first image acquisition device among the plurality of image acquisition devices to acquire a first image of the target storage compartment; Based on the first image, detecting whether there is water mist on the acquisition windows of the multiple image acquisition devices; When there is no water mist on the acquisition windows of the multiple image acquisition devices, at least one second image acquisition device among the multiple image acquisition devices is controlled to acquire a second image of the target storage compartment.

10. The refrigerator according to claim 9, characterized in that The refrigerator further comprises: A vertical partition is provided on the door body; The plurality of image acquisition devices are evenly arranged on the vertical partitions.

Images