Shooting control method, device, intelligent container, equipment, and medium of an intelligent container

Abstract

The present disclosure provides a shooting control method, device, smart container, equipment, and medium for a smart container, which belong to the technical field of smart devices. The method includes: using a camera provided on a door of the smart container to obtain a target image of the cabinet body of the smart container; when an identification mark provided on the cabinet body exists in the target image, calculating the door opening angle of the cabinet door based on the target image; when the door opening angle is greater than an angle threshold, determining whether the clarity of the target image is greater than a clarity threshold; when the clarity is greater than the clarity threshold, storing the cargo image obtained by photographing the interior of the cabinet body.

Description

Technical Field

[0001] The present disclosure belongs to the technical field of smart devices, and in particular relates to a method and apparatus for controlling the shooting of a smart container, a smart container, a device, and a medium. Background Art

[0002] Currently, the use of smart containers and unmanned containers is very common. Smart containers usually need to keep statistics on the changes in the goods inside to prevent goods that do not belong in the container from being placed in the container or the goods in the container from being lost.

[0003] Usually, the goods in the container are photographed and counted after the door is opened and closed. However, sometimes users open and close the container frequently, or open it slightly but do not use it. This will cause the smart container to have frequent alarms, false alarms, and missed alarms during use, causing unnecessary trouble to relevant staff and poor use results. Summary of the Invention

[0004] The present disclosure provides a method, apparatus, device, equipment, and medium for controlling the shooting of a smart container.

[0005] Some embodiments of the present disclosure provide a method for controlling shooting of a smart container, the method comprising:

[0006] Obtaining a target image of the cabinet body of the smart container using a camera disposed on a cabinet door of the smart container;

[0007] When an identification mark provided on the cabinet body exists in the target image, calculating the door opening angle of the cabinet door based on the target image;

[0008] When the door opening angle is greater than an angle threshold, determining whether the clarity of the target image is greater than a clarity threshold;

[0009] When the clarity is greater than a clarity threshold, the cargo image obtained by photographing the interior of the cabinet is stored.

[0010] Optionally, calculating the door opening angle based on the target image includes:

[0011] Calculating the distance between the camera and the identification mark according to the size of the target image and the focal length of the camera;

[0012] Angle conversion is performed according to the distance and the size of the smart container to obtain the door opening angle of the cabinet door.

[0013] Optionally, determining whether the clarity of the target image is greater than a clarity threshold includes:

[0014] Comparing the target image with a static image to obtain the clarity of the target image;

[0015] When the clarity of the target image is less than a clarity threshold, confirming that the door opening speed is greater than a speed threshold;

[0016] When the clarity of the target image is greater than or equal to a clarity threshold, it is confirmed that the door opening speed of the cabinet door is less than or equal to a speed threshold.

[0017] Optionally, after storing the cargo image obtained by photographing the interior of the cabinet, the method further includes:

[0018] Acquire multiple target cargo images with the highest resolution captured during the door opening process;

[0019] identifying foreign objects other than the original goods in the target goods image;

[0020] When the number of times the same target foreign object is identified in the target cargo image is greater than a number threshold, it is determined that the smart container is invaded by the target foreign object.

[0021] Optionally, after obtaining a target image of the cabinet body of the smart container using a camera provided on the door of the smart container, the method further includes:

[0022] When the identification mark does not exist in the target image, determining whether the smart container is in a closed state;

[0023] When the smart container is in a closed state and it is the first time for the smart container to be closed, an image of the goods taken inside the smart container is stored.

[0024] Optionally, determining whether the smart container is in a door-closed state includes:

[0025] When the target image is a completely black image, confirming that the smart container is in a closed state;

[0026] When the target image is not a completely black image, it is determined that the smart container is in an open state.

[0027] Some embodiments of the present disclosure provide a smart container, comprising: a cabinet body, a cabinet door, and a processor;

[0028] The cabinet body and the cabinet door are rotatably connected;

[0029] Identification marks are provided on opposite side edges of the connection between the cabinet body and the cabinet door;

[0030] Cameras are provided on the opposite side edges of the connection between the cabinet door and the cabinet body;

[0031] The processor is used to execute the steps of the above-mentioned smart container shooting control method.

[0032] Some embodiments of the present disclosure provide a shooting control device for a smart container, the device comprising:

[0033] a shooting module configured to obtain a target image of the cabinet body of the smart container using a camera provided on the cabinet door of the smart container;

[0034] a processing module configured to calculate the door opening angle of the cabinet door based on the target image when an identification mark provided on the cabinet body is present in the target image;

[0035] When the door opening angle is greater than an angle threshold, determining whether the clarity of the target image is greater than a clarity threshold;

[0036] The shooting module is further configured to store the cargo image obtained by shooting the interior of the cabinet when the clarity is greater than a clarity threshold.

[0037] Optionally, the processing module is further configured to:

[0038] Calculating the distance between the camera and the identification mark according to the size of the target image and the focal length of the camera;

[0039] Angle conversion is performed according to the distance and the size of the smart container to obtain the opening angle of the cabinet door.

[0040] Optionally, the processing module is further configured to:

[0041] Comparing the target image with a static image to obtain the clarity of the target image;

[0042] When the clarity of the target image is greater than a clarity threshold, confirming that the door opening speed is greater than a speed threshold;

[0043] When the clarity of the target image is greater than or equal to a clarity threshold, it is confirmed that the door opening speed of the cabinet door is less than or equal to a speed threshold.

[0044] Optionally, the processing module is further configured to:

[0045] Acquire multiple target cargo images with the highest resolution captured during the door opening process;

[0046] identifying foreign objects other than the original goods in the target goods image;

[0047] When the number of times the same target foreign object is identified in the target cargo image is greater than a number threshold, it is determined that the smart container is invaded by the target foreign object.

[0048] Optionally, the processing module is further configured to:

[0049] When the identification mark does not exist in the target image, determining whether the smart container is in a closed state;

[0050] When the smart container is in a closed state and it is the first time for the smart container to be closed, an image of the goods taken inside the smart container is stored.

[0051] Optionally, the processing module is further configured to:

[0052] When the target image is a completely black image, confirming that the smart container is in a closed state;

[0053] When the target image is not a completely black image, it is determined that the smart container is in an open state.

[0054] Some embodiments of the present disclosure provide a computing processing device, including:

[0055] a memory having computer readable code stored therein;

[0056] One or more processors, when the computer-readable code is executed by the one or more processors, the computing processing device executes the shooting control method of the smart container as described above.

[0057] Some embodiments of the present disclosure provide a computer program including a computer-readable code. When the computer-readable code is executed on a computing and processing device, the computing and processing device is caused to execute the above-mentioned shooting control method for the smart container.

[0058] Some embodiments of the present disclosure provide a non-transitory computer-readable medium storing the above-mentioned shooting control method of the smart container.

[0059] Some embodiments of the present disclosure provide a shooting control method, device, smart container, equipment, and medium for a smart container. The method uses a camera provided on the cabinet door to shoot the cabinet body, and determines whether the cabinet door is open based on whether there is an identification mark in the captured image. When the cabinet door is open, it further determines whether the cabinet door opening angle and the cabinet door opening speed reach a threshold value. When both reach the threshold value, it is confirmed that the smart container is opened and used and the use is completed. Only then is the cargo space inside the smart container photographed to ensure that the smart container is actually opened and used before the goods are photographed, thereby avoiding the situation where invalid photos of the goods are taken before the smart container is used or before the use is completed due to improper use by the user, and reducing the occurrence of false alarms of the smart container.

[0060] The above description is only an overview of the technical solution of the present disclosure. In order to more clearly understand the technical means of the present disclosure, it can be implemented in accordance with the contents of the specification. In order to make the above and other purposes, features and advantages of the present disclosure more obvious and easy to understand, the specific implementation methods of the present disclosure are listed below. BRIEF DESCRIPTION OF THE DRAWINGS

[0061] In order to more clearly illustrate the embodiments of the present disclosure or the technical solutions in the prior art, a brief introduction will be given below to the drawings required for use in the embodiments or the description of the prior art. Obviously, the drawings described below are some embodiments of the present disclosure. For ordinary technicians in this field, other drawings can be obtained based on these drawings without any creative work.

[0062] Figure 1 The following schematically illustrates a flow chart of a method for controlling the shooting of a smart container provided by some embodiments of the present disclosure;

[0063] Figure 2 Schematically illustrates one of the flow charts of another method for controlling the shooting of a smart container provided in some embodiments of the present disclosure;

[0064] Figure 3 The second flowchart of another method for controlling the shooting of a smart container provided in some embodiments of the present disclosure is schematically shown;

[0065] Figure 4 The third flowchart schematically illustrates another method for controlling the shooting of a smart container provided in some embodiments of the present disclosure;

[0066] Figure 5 Schematically illustrates a fourth flow chart of another method for controlling the shooting of a smart container provided in some embodiments of the present disclosure;

[0067] Figure 6The following schematically illustrates a logic diagram of a shooting control method for a smart container provided by some embodiments of the present disclosure;

[0068] Figure 7 The following schematically shows a structural diagram of a smart container provided by some embodiments of the present disclosure;

[0069] Figure 8 The following schematically illustrates a structural diagram of a shooting control device for a smart container provided in some embodiments of the present disclosure;

[0070] Figure 9 Schematically shows a block diagram of a computing processing device for executing the method according to some embodiments of the present disclosure;

[0071] Figure 10 The figure schematically shows a storage unit for holding or carrying program codes for implementing methods according to some embodiments of the present disclosure. DETAILED DESCRIPTION

[0072] To make the objectives, technical solutions, and advantages of the embodiments of the present disclosure more clear, the technical solutions in the embodiments of the present disclosure will be clearly and completely described below in conjunction with the accompanying drawings. Obviously, the described embodiments are only part of the embodiments of the present disclosure, not all of the embodiments. All other embodiments obtained by ordinary technicians in this field based on the embodiments of the present disclosure without making any creative efforts shall fall within the scope of protection of the present disclosure.

[0073] Figure 1 The following schematically illustrates a flow chart of a method for controlling the shooting of a smart container provided by the present disclosure, wherein the method comprises:

[0074] Step 101: Obtain a target image of the cabinet body of the smart container using a camera provided on the door of the smart container.

[0075] It should be noted that a smart vending machine refers to an automated vending machine. Users can use an application or mini-program to obtain access permissions, unlock the cabinet lock, open the cabinet door, take the required goods from the cabinet, and close the door to complete the automatic settlement of the goods. No salesperson needs to intervene, and users can also purchase goods conveniently through the smart cabinet.

[0076] The door of the smart container may be provided with a camera facing the container body, for taking pictures of the container body and the goods in the container body.

[0077] In the disclosed embodiment, the camera of the smart container periodically takes pictures of the cabinet it is facing at time intervals of 2 seconds, 5 seconds, 10 seconds, etc., and transmits the captured target image to the internal processor connected to the smart container, or uploads it to an external server via the network, so that the system can subsequently confirm whether the smart container is turned on and used.

[0078] Step 102 : When an identification mark provided on the cabinet body exists in the target image, the opening angle of the cabinet door is calculated based on the target image.

[0079] In the embodiment of the present disclosure, the identification mark can be a QR code or a specific marking graphic set on the cabinet. After the system obtains the target image captured by the camera, it will perform content detection on the target image, specifically identifying whether the identification mark exists in the target image. It can be understood that although the camera is facing the cabinet and the identification mark is also set on the cabinet, the position of the cabinet captured by the camera is different due to the different opening and closing degrees of the cabinet door, so the part of the cabinet that can be captured is also different. In some cases, the camera may not be able to capture the identification mark on the cabinet. For example, when the cabinet door is slightly open, since the camera is very close to the cabinet at this time, only a small part of the cabinet can be captured, so there will be no identification mark in the captured target image; further, when the cabinet door is opened to a greater extent, the cabinet area that can be captured by the camera will increase accordingly, and at this time the camera is likely to capture the identification mark on the cabinet. It can be seen that the system can determine whether the cabinet door is open by determining whether the identification mark exists in the target image.

[0080] Specifically, when the system determines that there is an identification mark in the target image, in order to further confirm the degree of opening of the cabinet door, the system can determine the distance between the camera and the identification mark by comparing the size or dimensions of the identification mark in the target image. It can be understood that since the camera is set on the cabinet door, the greater the degree of opening of the cabinet door, the greater the distance between the camera and the cabinet body will be. Therefore, the image area occupied by the identification mark in the captured target image will decrease as the distance increases. Since the cabinet door size and the position of the identification mark set on the cabinet body are known, the cabinet door opening angle can be calculated by using trigonometric functions. The larger the door opening angle, the greater the degree of opening of the cabinet door.

[0081] Step 103: When the door opening angle is greater than the angle threshold, determine whether the clarity of the target image is greater than the clarity threshold.

[0082] In the embodiment of the present disclosure, considering that if the door opening angle is too small, the camera on the cabinet door is too close to the cabinet body, making it difficult for the camera to fully capture the goods inside the cabinet, and this image cannot be used for subsequent image comparison to obtain changes in the goods. Therefore, the embodiment of the present disclosure sets an angle threshold to characterize the minimum door opening angle at which the camera can fully capture the goods inside the cabinet. The angle threshold can be pre-set based on the specifications of the smart cabinet and the size of the goods placed therein. For example, the larger the size of the goods, the larger the angle threshold can be set. The specific setting can be based on actual needs and is not limited here.

[0083] Furthermore, after the system determines that the door opening angle is greater than the angle threshold, it confirms that the camera can fully capture the goods inside the cabinet. However, there may still be situations where the user pulls the cabinet door back and forth. If the camera is controlled to capture the goods to determine whether the goods have changed only when the door opening angle is greater than the angle threshold, the system will make multiple judgments on the same consumption due to the user frequently opening and closing the cabinet door during a single consumption, which will obviously waste processing resources. Therefore, after determining that the cabinet door can be opened to take out and put in goods based on the door opening angle, the present disclosure further calculates the door opening speed of the smart cabinet based on the clarity of the captured target image. It can be understood that when the user closes the cabinet door, he will push the cabinet door hard. At this time, the door opening speed is faster than the speed when the user pulls the cabinet door open and close. Therefore, the door opening speed can be used to determine whether the user has finished using the smart cabinet.

[0084] Specifically, since the shutter time of the photosensitive sensor in the camera is fixed, if the cabinet door opens too quickly or causes the photosensitive sensor to obtain multiple overlapping object images during the shutter time, the captured target image will be distorted. Therefore, the cabinet door opening speed can be determined based on the degree of distortion of the target image, that is, the higher the degree of distortion, the faster the opening speed, and conversely, the smaller the degree of distortion, the slower the opening speed.

[0085] Step 104 : When the clarity is greater than a clarity threshold, the cargo image obtained by photographing the interior of the cabinet is stored.

[0086] In the disclosed embodiments, referring to the above description, when the cabinet door opens too quickly, it indicates that the user has pushed the door closed, meaning that they have finished using the smart container. The minimum door opening speed for closing the cabinet door can be determined by observing the smart container's closing process, i.e., the speed threshold. Therefore, the system can determine that the user has finished using the smart container when the door opening speed exceeds the speed threshold. The system then uses the camera to capture images of the goods in the container, obtaining and storing images of the goods for subsequent recording and determination of whether the goods have been intruded. The camera capturing the goods and the camera on the cabinet door can be the same camera or two independent cameras. The specific configuration can be based on actual needs and is not limited here. It is worth noting that the camera captures the cabinet continuously during the door opening process. In the disclosed embodiments, the door opening angle and door opening speed conditions are set to select and store from all captured images those goods images that meet the subsequent processing requirements. The camera is not controlled to capture images only when the door opening angle and door opening speed conditions are met. Instead, the camera captures images throughout the door opening process, but only stores the cargo images captured when the smart container meets the door opening angle and door opening speed conditions.

[0087] The disclosed embodiment utilizes a camera provided on a cabinet door to photograph the cabinet body, and determines whether the cabinet door is open based on whether there is an identification mark in the photographed image. When the cabinet door is opened, it further determines whether the cabinet door opening angle and the cabinet door opening speed reach a threshold value. When both reach the threshold value, it is confirmed that the smart cabinet is opened and used and the use is completed, and then the cargo space inside the smart cabinet is photographed to ensure that the smart cabinet is actually opened and used before the goods are photographed, thereby avoiding the situation where invalid photos of the goods are taken before the smart cabinet is used or before the use is completed due to improper use by the user, and reducing the occurrence of false alarms of the smart cabinet.

[0088] Optionally, refer to Figure 2 , the step 102 includes:

[0089] Step 1021 : Calculate the distance between the camera and the identification mark according to the size of the target image and the focal length of the camera.

[0090] Step 1022: Perform angle conversion based on the distance and the size of the smart container to obtain the door opening angle.

[0091] In the embodiment of the present disclosure, the system pre-records the size of the identification mark and the focal length of the camera, so that the distance between the camera and the identification mark can be calculated by the following formula (1):

[0092] D=(W x F) / P (1)

[0093] Where P is the pixel distance, W is the size of the target image, and F is the camera focal length.

[0094] After calculating the distance, the vertical distance between the camera and the connecting axis of the cabinet door and the cabinet body is further identified and marked. When the lengths of the three sides are known, the opening angle of the cabinet door, that is, the angle between the cabinet door and the cabinet body, is calculated through trigonometric functions.

[0095] The embodiment of the present disclosure calculates the door opening angle of the smart container based on the target image, thereby efficiently calculating the door opening angle of the smart container.

[0096] Optionally, refer to Figure 3 , the step 103 includes:

[0097] Step 1031 : Compare the target image with a static image to obtain the clarity of the target image.

[0098] Step 1032: When the clarity of the target image is greater than a clarity threshold, confirm that the door opening speed is greater than a speed threshold.

[0099] Step 1033: When the clarity of the target image is greater than or equal to the clarity threshold, confirm that the door opening speed is less than or equal to the speed threshold.

[0100] In the disclosed embodiment, a static image is an image captured by a camera while the cabinet door is stationary relative to the cabinet body. Since the cabinet door remains stationary, the clarity of the static image, corresponding to the door opening speed, approaches zero. As the door opening speed increases, the clarity of the target image captured by the camera will experience varying degrees of distortion due to the superposition of objects and images. Generally, a higher degree of distortion corresponds to a higher door opening speed. Therefore, the clarity of the cargo image at the speed threshold can be determined by comparing a sample image captured by the camera of the cabinet body at a door opening speed reaching a door opening speed threshold with the static image. In actual application, the system can compare the clarity of the cargo image with the clarity corresponding to the speed threshold. If the clarity of the target image is less than the clarity corresponding to the speed threshold, it can be determined that the door opening speed corresponding to the target image is greater than the speed threshold. Conversely, if the clarity of the target image is greater than or less than the clarity corresponding to the speed threshold, it can be determined that the door opening speed corresponding to the target image is less than or equal to the speed threshold.

[0101] The embodiment of the present disclosure uses a static image to compare with a target image taken of the cabinet to obtain the clarity of the target image, so that it can efficiently determine whether the opening speed of the cabinet door exceeds the speed threshold based on whether the clarity exceeds the clarity threshold.

[0102] Optionally, refer to Figure 4 After step 104, the method further includes:

[0103] Step S1, obtaining multiple target cargo images with the highest definition captured during the door opening process.

[0104] Step S2: identifying foreign objects other than the original goods in the target goods image.

[0105] Step S3: When the number of times the same target foreign object is identified in the target cargo image exceeds a threshold, it is determined that the smart container is invaded by the target foreign object.

[0106] In the disclosed embodiment, after confirming that the cabinet door has completed the opening process from opening to closing, the system selects a target number of target cargo images with the highest clarity from the stored cargo images. This is because, although the stored cargo images can fully encompass the cargo in the cabinet, the clarity of the cargo images varies due to varying door opening speeds. Low clarity of cargo images will affect the accuracy of the system's identification of the objects contained therein. Therefore, the disclosed embodiment improves cargo identification accuracy by selecting a target number of target cargo images with the highest clarity. This target number can be one or more, and can be set based on actual needs, which is not limited here.

[0107] During the recognition process, the system first analyzes the pixels of each target cargo image and identifies the boundaries of each object to determine the objects contained in each target cargo image. It then compares all object images with pre-stored images of original cargo for similarity. When the similarity is greater than a similarity threshold, the object is confirmed to be the original cargo, while objects with a similarity less than or equal to the similarity threshold are confirmed to be foreign objects.

[0108] Furthermore, when there is only one target cargo image, the number threshold can be set to 1. Thus, if a foreign object is present in the target cargo image, it can be determined that a foreign object has invaded the smart container. When there are multiple target cargo images, the number threshold can be set to a positive integer greater than 1 and less than the target number. Thus, if a target foreign object is identified in the target cargo image more than the number threshold, it can be determined that the smart container has been invaded by the target foreign object.

[0109] The embodiment of the present disclosure selects the target cargo image with the highest definition to identify foreign objects contained in the container, thereby accurately determining whether there is foreign object intrusion in the smart cargo.

[0110] Optionally, refer to Figure 5 After step 101, the method further includes:

[0111] Step 201: When the identification mark does not exist in the target image, it is determined whether the smart container is in a closed state.

[0112] In step 202 , when the smart container is in a closed state and it is the first time for the smart container to be closed, an image of the goods taken inside the smart container is stored.

[0113] In the disclosed embodiment, if the system fails to identify the identification mark in the target image, it will confirm whether the smart container is open, ensuring that the door is not closed when not in use. Because statistics on changes in the goods in the smart container will be needed later, the image of the goods captured by the camera when the door is first closed after the smart container is started is stored to initialize the set of goods images used for subsequent image processing and comparison and statistical analysis.

[0114] Optionally, step 201 includes:

[0115] S1: When the target image is a completely black image, confirm that the smart container is in a closed state.

[0116] S2: When the target image is not a completely black image, confirm that the smart container is in an open state.

[0117] In the disclosed embodiments, a completely black image refers to a target image in which the grayscale value of each pixel approaches 255, that is, it appears black. A non-completely black image refers to a target image in which the grayscale value of each pixel is not 255. It is understood that since the camera is located on the inside of the cabinet door, when the cabinet door is closed, the camera will be in close contact with the cabinet body. At this time, the target image obtained by the camera will appear completely black due to the lack of visible light. In this case, it can be determined that the smart cabinet is in the closed state. Otherwise, or the image is not completely black, it indicates that the cabinet door is open.

[0118] The embodiment of the present disclosure determines whether the cabinet door is open based on whether the captured target image is a completely black image, thereby accurately determining the open / closed state of the cabinet door.

[0119] Reference Figure 6 Upon startup, the system first detects the QR code on the cabinet by photographing it. If no QR code is present, the system then determines whether the captured target image is completely black. If not, the smart cabinet is determined to be closed. It then determines whether this is the first time the cabinet has been closed since startup. If so, it takes a photo of the goods in the cabinet and saves it. If not, the smart cabinet is determined to be open and continues to photograph and detect the QR code.

[0120] Furthermore, if a QR code exists in the target image, the distance dis between the smart container and the camera is first calculated based on the coordinates of the QR code. When the distance dis is greater than the minimum distance min dis and less than the maximum distance max dis, the clarity of the target image is obtained by comparing the captured target image with a pre-captured static image. If the clarity is greater than the clarity threshold thr, the goods in the smart container are photographed and stored.

[0121] Figure 7 The structure diagram of a smart container provided by the present disclosure is schematically shown, including: a cabinet body 301, a cabinet door 302, and a processor 303;

[0122] The cabinet body and the cabinet door are rotatably connected;

[0123] An identification mark 3011 is provided on the opposite side edges of the connection between the cabinet body and the cabinet door;

[0124] Cameras 3021 are provided on the opposite side edges of the connection between the cabinet door and the cabinet body;

[0125] The processor is used to execute the steps of the above-mentioned smart container shooting control method.

[0126] In the disclosed embodiment, the camera is positioned on the opposite side of the cabinet door from the cabinet body, and the identification mark is also positioned on the opposite side of the cabinet door from the cabinet body, thereby ensuring that the camera can capture the identification mark on the cabinet body. A detailed description of the smart container can be found in the above description and will not be repeated here.

[0127] The disclosed embodiment utilizes a camera provided on a cabinet door to photograph the cabinet body, and determines whether the cabinet door is open based on whether there is an identification mark in the photographed image. When the cabinet door is opened, it further determines whether the cabinet door opening angle and the cabinet door opening speed reach a threshold value. When both reach the threshold value, it is confirmed that the smart cabinet is opened and used and the use is completed, and then the cargo space inside the smart cabinet is photographed to ensure that the smart cabinet is actually opened and used before the goods are photographed, thereby avoiding the situation where invalid photos of the goods are taken before the smart cabinet is used or before the use is completed due to improper use by the user, and reducing the occurrence of false alarms of the smart cabinet.

[0128] Figure 8 The following schematically illustrates a structural diagram of a shooting control device 40 for a smart container provided by the present disclosure, which is applied to a parallel chain node in a blockchain system. The device includes:

[0129] The shooting module 401 is configured to obtain a target image of the cabinet body of the smart container using a camera provided on the cabinet door of the smart container;

[0130] The processing module 402 is configured to calculate the door opening angle of the cabinet door based on the target image when an identification mark provided on the cabinet body is present in the target image;

[0131] When the door opening angle is greater than an angle threshold, determining whether the clarity of the target image is greater than a clarity threshold;

[0132] The shooting module 401 is further configured to store the cargo image obtained by shooting the interior of the cabinet when the clarity is greater than a clarity threshold.

[0133] Optionally, the processing module 402 is further configured to:

[0134] Calculating the distance between the camera and the identification mark according to the size of the target image and the focal length of the camera;

[0135] Angle conversion is performed according to the distance and the size of the smart container to obtain the door opening angle of the cabinet door.

[0136] Optionally, the processing module 402 is further configured to:

[0137] Comparing the target image with a static image to obtain the clarity of the target image;

[0138] The door opening speed corresponding to the clarity is searched based on a linear relationship table between the door opening speed and the clarity.

[0139] Optionally, the processing module 402 is further configured to:

[0140] Acquire multiple target cargo images with the highest resolution captured during the door opening process;

[0141] identifying foreign objects other than the original goods in the target goods image;

[0142] When the number of times the same target foreign object is identified in the target cargo image is greater than a number threshold, it is determined that the smart container is invaded by the target foreign object.

[0143] Optionally, the processing module 402 is further configured to:

[0144] When the identification mark does not exist in the target image, determining whether the smart container is in a closed state;

[0145] When the smart container is in a closed state and it is the first time for the smart container to be closed, an image of the goods taken inside the smart container is stored.

[0146] Optionally, the processing module 402 is further configured to:

[0147] When the target image is a completely black image, confirming that the smart container is in a closed state;

[0148] When the target image is not a completely black image, it is determined that the smart container is in an open state.

[0149] The disclosed embodiment utilizes a camera provided on a cabinet door to photograph the cabinet body, and determines whether the cabinet door is open based on whether there is an identification mark in the photographed image. When the cabinet door is opened, it further determines whether the cabinet door opening angle and the cabinet door opening speed reach a threshold value. When both reach the threshold value, it is confirmed that the smart cabinet is opened and used and the use is completed, and then the cargo space inside the smart cabinet is photographed to ensure that the smart cabinet is actually opened and used before the goods are photographed, thereby avoiding the situation where invalid photos of the goods are taken before the smart cabinet is used or before the use is completed due to improper use by the user, and reducing the occurrence of false alarms of the smart cabinet.

[0150] The various component embodiments of the present disclosure can be implemented in hardware, or in software modules running on one or more processors, or in a combination thereof. It should be understood by those skilled in the art that a microprocessor or digital signal processor (DSP) can be used in practice to implement some or all of the functions of some or all of the components in the computing processing equipment according to the embodiments of the present disclosure. The present disclosure can also be implemented as a device or apparatus program (e.g., computer program and computer program product) for executing a part or all of the methods described herein. Such a program implementing the present disclosure can be stored on a non-transient computer-readable medium, or can have the form of one or more signals. Such a signal can be downloaded from an Internet website, or provided on a carrier signal, or provided in any other form.

[0151] For example, Figure 9A computing processing device that can implement the method according to the present disclosure is shown. The computing processing device conventionally includes a processor 510 and a computer program product or non-transitory computer-readable medium in the form of a memory 520. The memory 520 can be an electronic memory such as a flash memory, an EEPROM (electrically erasable programmable read-only memory), an EPROM, a hard disk or a ROM. The memory 520 has a storage space 530 for program code 531 for executing any method step in the above method. For example, the storage space 530 for program code can include individual program codes 531 for implementing various steps in the above method respectively. These program codes can be read from or written to one or more computer program products. These computer program products include program code carriers such as a hard disk, a compact disk (CD), a memory card or a floppy disk. Such a computer program product is typically as described in reference to Figure 10 The portable or fixed storage unit. The storage unit may have Figure 9 The memory 520 in the computing and processing device may be a memory segment, storage space, or the like arranged similarly. The program code may be compressed, for example, in a suitable form. Typically, the storage unit includes computer-readable code 531′, i.e., code that can be read by a processor such as 510, and when executed by the computing and processing device, causes the computing and processing device to perform the steps of the method described above.

[0152] It should be understood that although the steps in the flowcharts of the accompanying drawings are shown in sequence as indicated by the arrows, these steps are not necessarily executed in the order indicated by the arrows. Unless otherwise specified herein, there is no strict order restriction on the execution of these steps, and they can be executed in other orders. Moreover, at least some of the steps in the flowcharts of the accompanying drawings may include multiple sub-steps or multiple stages, and these sub-steps or stages are not necessarily executed at the same time, but can be executed at different times, and their execution order is not necessarily sequential, but can be executed in turn or alternately with other steps or at least a portion of the sub-steps or stages of other steps.

[0153] References herein to "one embodiment," "an embodiment," or "one or more embodiments" mean that a particular feature, structure, or characteristic described in connection with the embodiment is included in at least one embodiment of the present disclosure. Furthermore, please note that instances of the phrase "in one embodiment" do not necessarily all refer to the same embodiment.

[0154] In the description provided herein, numerous specific details are described. However, it is understood that embodiments of the present disclosure may be practiced without these specific details. In some instances, well-known methods, structures, and techniques are not shown in detail so as not to obscure the understanding of this description.

[0155] In the claims, any reference signs placed between parentheses shall not be construed as limiting the claim. The word "comprising" does not exclude the presence of elements or steps not listed in the claim. The word "a" or "an" preceding an element does not exclude the presence of a plurality of such elements. The present disclosure may be implemented by means of hardware comprising several different elements and by means of a suitably programmed computer. In a unit claim enumerating several means, several of these means may be embodied by the same item of hardware. The use of the words first, second, and third etc. does not indicate any order. These words may be interpreted as names.

[0156] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present disclosure, rather than to limit them. Although the present disclosure has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or make equivalent replacements for some of the technical features therein. However, these modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the various embodiments of the present disclosure.

Claims

1. A method for controlling the shooting of a smart container, characterized in that: The method comprises: Obtaining a target image of the cabinet body of the smart container using a camera disposed on a cabinet door of the smart container; When an identification mark provided on the cabinet body exists in the target image, calculating the door opening angle of the cabinet door based on the target image; When the door opening angle is greater than an angle threshold, determining whether the clarity of the target image is greater than a clarity threshold; When the clarity is greater than the clarity threshold, the cargo image obtained by photographing the interior of the cabinet is stored; After storing the cargo image obtained by photographing the interior of the cabinet, the method further includes: Acquire multiple images of target cargo with the highest resolution captured during the door opening process; identifying foreign objects other than the original goods in the target goods image; When the number of times the same target foreign object is identified in the target cargo image exceeds a threshold, it is determined that the smart container is invaded by the target foreign object; The identifying foreign objects other than the original goods in the target goods image includes: Determining objects contained in each of the target goods images by analyzing pixels of each of the target goods images; Comparing the object image with pre-stored images of the original goods for similarity; When the similarity is less than or equal to the similarity threshold, the object is determined to be a foreign object.

2. The method according to claim 1, characterized in that The calculating the door opening angle based on the target image includes: Calculating the distance between the camera and the identification mark according to the size of the target image and the focal length of the camera; Angle conversion is performed according to the distance and the size of the smart container to obtain the opening angle of the cabinet door.

3. The method according to claim 1, characterized in that The determining whether the clarity of the target image is greater than a clarity threshold includes: Comparing the target image with a static image to obtain the clarity of the target image; When the clarity of the target image is less than a clarity threshold, confirming that the door opening speed is greater than a speed threshold; When the clarity of the target image is greater than or equal to a clarity threshold, it is confirmed that the door opening speed of the cabinet door is less than or equal to a speed threshold.

4. The method according to claim 1, wherein After obtaining a target image of the cabinet body of the smart container by using a camera disposed on the cabinet door of the smart container, the method further includes: When the identification mark does not exist in the target image, determining whether the smart container is in a closed state; When the smart container is in a closed state and it is the first time for the smart container to be closed, an image of the goods taken inside the smart container is stored.

5. The method according to claim 4, characterized in that The determining whether the smart container is in a closed state includes: When the target image is a completely black image, confirming that the smart container is in a closed state; When the target image is not a completely black image, it is determined that the smart container is in an open state.

6. A smart container, characterized in that: include: Cabinet, cabinet door, processor; The cabinet body and the cabinet door are rotatably connected; Identification marks are provided on opposite side edges of the connection between the cabinet body and the cabinet door; Cameras are provided on the opposite side edges of the connection between the cabinet door and the cabinet body; The processor is used to execute the steps of the shooting control method of the smart container as described in any one of claims 1 to 5.

7. A shooting control device for a smart container, characterized in that: The device comprises: a shooting module configured to obtain a target image of the cabinet body of the smart container using a camera provided on the cabinet door of the smart container; a processing module configured to calculate the door opening angle of the cabinet door based on the target image when an identification mark provided on the cabinet body is present in the target image; When the door opening angle is greater than an angle threshold, determining whether the clarity of the target image is greater than a clarity threshold; The shooting module is further configured to store the cargo image obtained by shooting the interior of the cabinet when the clarity is greater than a clarity threshold; The device is further configured to: obtain multiple images of target cargo with the highest definition captured during the door opening process; identify foreign objects other than the original cargo in the target cargo images; and confirm that the smart container has been invaded by the target foreign object when the number of times the same target foreign object is identified in the target cargo image exceeds a threshold number; The identifying of foreign objects other than the original goods in the target goods image includes: determining the objects contained in each target goods image by analyzing pixels of each target goods image; comparing the object images with pre-stored images of the original goods for similarity; and confirming that the object is a foreign object if the similarity is less than or equal to a similarity threshold.

8. A computing and processing device, characterized in that: include: a memory having computer readable code stored therein; One or more processors, when the computer-readable code is executed by the one or more processors, the computing processing device executes the shooting control method of the smart container according to any one of claims 1 to 5.

9. A non-transitory computer-readable medium, characterized in that A computer program for the shooting control method of the smart container according to any one of claims 1 to 5 is stored therein.

Images