Storage equipment sales volume determination method and device and storage equipment

Abstract

The invention discloses a storage equipment sales volume determination method and device and storage equipment, and belongs to the technical field of storage equipment. The storage equipment comprises an image sensor and at least two groups of correlation type photoelectric sensors, and the method comprises the following steps: determining at least two image acquisition time periods based on state information of each group of correlation type photoelectric sensors; controlling the image sensor to acquire images in each image acquisition period to obtain at least two frames of image information; and based on the at least two frames of image information, determining the sales condition of the product in the storage equipment. According to the method for determining the sales volume of the storage equipment, the whole purchase process does not need to be recorded, the memory occupied by the shot content is reduced, the requirement for the computing power of a server is greatly reduced, the hardware resource consumption is reduced, and the accuracy of determining the product sales condition can be improved.

Description

Technical Field

[0001] The present application belongs to the technical field of storage equipment, and in particular, relates to a method and device for determining sales volume of storage equipment, and storage equipment. Background Art

[0002] Different products may be placed in the storage device, and the sales of the products in the storage device need to be counted. In the related art, a camera is installed in the storage device to record the user's shopping process, and the user's purchase situation is obtained by algorithm recognition of the recorded video to perform sales statistics, or a photo of the user before and after opening and closing the door is taken to perform sales statistics. However, the above statistical method has low accuracy, requires a large amount of storage space, requires high computing power of the server, and consumes a large amount of hardware resources. Summary of the invention

[0003] The present application aims to solve at least one of the technical problems existing in the related art. To this end, the present application proposes a method, device and storage device for determining the sales volume of storage equipment, which does not require recording the entire purchase process, reduces the memory occupied by the filmed content, greatly reduces the requirements for server computing power, reduces hardware resource consumption, and can improve the accuracy of determining product sales.

[0004] In a first aspect, the present application provides a method for determining sales volume of a storage device, wherein the storage device comprises an image sensor and at least two groups of through-beam photoelectric sensors, each group of the through-beam photoelectric sensors comprises a plurality of transmitting ends and a plurality of receiving ends, and each of the transmitting ends is arranged in one-to-one correspondence with each of the receiving ends; the plurality of transmitting ends are arranged on a target side of an inner wall of the storage device, and the plurality of receiving ends are arranged on the other side of the storage device opposite to the target side; the distance between the plane formed by the plurality of transmitting ends and the plurality of receiving ends of each group of the through-beam photoelectric sensors and the cabinet opening of the storage device is different; the method comprises:

[0005] Determining at least two image acquisition time periods based on the status information of each group of through-beam photoelectric sensors;

[0006] Controlling the image sensor to capture images in each of the image capture time periods to obtain at least two frames of image information;

[0007] Based on the at least two frames of image information, the sales status of the products in the storage device is determined.

[0008] According to the sales volume determination method of the storage device of the present application, by setting multiple groups of through-beam photoelectric sensors in the storage device, multiple image shooting time periods are determined based on the status information of the multiple groups of through-beam photoelectric sensors, and the product sales status is determined based on the image information shot in each shooting time period. There is no need to record the entire purchase process, which reduces the memory occupied by the shot content, greatly reduces the requirements for server computing power, reduces hardware resource consumption, and can improve the accuracy of determining product sales status.

[0009] According to the method for determining sales volume of storage equipment of the present application, the step of determining at least two image acquisition time periods based on the status information of each group of the through-beam photoelectric sensors includes:

[0010] The time period between when the state information of the first group of through-beam photoelectric sensors among the at least two groups of through-beam photoelectric sensors changes from normal to disconnected and when the state information of the second group of through-beam photoelectric sensors among the at least two groups of through-beam photoelectric sensors changes from normal to disconnected is determined as the first image acquisition period; the distance between the first group of through-beam photoelectric sensors and the cabinet opening of the storage device is smaller than the distance between the second group of through-beam photoelectric sensors and the cabinet opening of the storage device;

[0011] The time period between when the status information of the second group of through-beam photoelectric sensors in the at least two groups of through-beam photoelectric sensors changes from disconnected to normal and when the status information of the first group of through-beam photoelectric sensors in the at least two groups of through-beam photoelectric sensors changes from disconnected to normal is determined as the second image acquisition period.

[0012] According to the method for determining the sales volume of a storage device of the present application, determining the sales volume of products in the storage device based on the at least two frames of image information includes:

[0013] Extracting target features from the at least two frames of image information respectively to obtain a first target feature and a second target feature; the target feature is a feature used to characterize the features related to picking and placing products;

[0014] Based on the first target feature and the second target feature, the product sales situation is determined.

[0015] According to the method for determining sales volume of storage equipment of the present application, determining the sales situation of the product based on the first target feature and the second target feature includes:

[0016] Determining a time sequence of the first target feature and the second target feature based on an image acquisition period corresponding to the first target feature and an image acquisition period corresponding to the second target feature;

[0017] Determining a change in the target feature based on the time sequence and difference information between the first target feature and the second target feature;

[0018] Based on the changes, the sales status of the product is determined.

[0019] According to the method for determining the sales volume of storage equipment of the present application, determining the sales volume of the product based on the change includes:

[0020] Based on the changes, determine the product category corresponding to the target product;

[0021] In a case where the change is an increase in the first target quantity of products of the target category, the first target quantity is increased based on the sales data corresponding to the products of the target category;

[0022] In a case where the change is a reduction in the first target quantity of products in the target category, the first target quantity is reduced based on sales data corresponding to the products in the target category.

[0023] According to the method for determining sales volume of a storage device of the present application, the controlling the image sensor to collect images in each of the image collection time periods to obtain at least two frames of image information includes:

[0024] Extract target features of multiple frames of image information to obtain confidence levels corresponding to the target features; the target features are features used to characterize product placement;

[0025] Based on the confidence level, the multiple frames of image information in each of the image acquisition time periods are screened respectively to obtain at least one frame of image information corresponding to each of the image acquisition time periods.

[0026] According to the method for determining the sales volume of a storage device of the present application, the status information of each group of the through-beam photoelectric sensors is determined based on the following method:

[0027] In the case that more than a second target number of receiving ends among the plurality of receiving ends receive optical signals transmitted by a transmitting end corresponding to the receiving end, the state information is normal;

[0028] In the case that receiving ends not exceeding a second target number among the multiple receiving ends receive optical signals transmitted by the transmitting end corresponding to the receiving end, the state information is disconnected.

[0029] In a second aspect, the present application provides a device for determining sales volume of a storage device, wherein the storage device comprises an image sensor and at least two groups of through-beam photoelectric sensors, each group of the through-beam photoelectric sensors comprises a plurality of transmitting ends and a plurality of receiving ends, and each of the transmitting ends is arranged in a one-to-one correspondence with each of the receiving ends; the plurality of transmitting ends are arranged on a target side of an inner wall of the storage device, and the plurality of receiving ends are arranged on the other side of the storage device opposite to the target side; the distance between the plane formed by the plurality of transmitting ends and the plurality of receiving ends of each group of the through-beam photoelectric sensors and the cabinet opening of the storage device is different; the device comprises:

[0030] A first processing module, configured to determine at least two image acquisition time periods based on the status information of each group of the through-beam photoelectric sensors;

[0031] A second processing module, configured to control the image sensor to collect at least two frames of image information based on the at least two image collection time periods;

[0032] The third processing module is used to determine the sales status of products in the storage device based on the at least two frames of image information.

[0033] According to the sales volume determination device of the storage device of the present application, a plurality of groups of through-beam type photoelectric sensors are arranged in the storage device, and a plurality of image shooting time periods are determined through the status information of the plurality of groups of through-beam type photoelectric sensors. The product sales status is determined based on the image information shot in each shooting time period. There is no need to record the entire purchase process, which reduces the memory occupied by the shot content, greatly reduces the requirements for server computing power, reduces hardware resource consumption, and can improve the accuracy of determining the product sales status.

[0034] In a third aspect, the present application provides a storage device, comprising:

[0035] Cabinet;

[0036] At least two groups of through-beam photoelectric sensors, each group of the through-beam photoelectric sensors includes a plurality of transmitting ends and a plurality of receiving ends, and each of the transmitting ends is arranged in a one-to-one correspondence with each of the receiving ends; the plurality of transmitting ends are arranged on a target side of an inner wall of the cabinet of the storage device, and the plurality of receiving ends are arranged on the other side of the storage device opposite to the target side; the distance between the plane formed by the plurality of transmitting ends and the plurality of receiving ends and the cabinet opening of the storage device of each group of the through-beam photoelectric sensors is different;

[0037] Image sensor;

[0038] Based on the sales volume determination device of the storage device as described in the second aspect, the sales volume determination device of the storage device is electrically connected to the image sensor and the at least two groups of through-beam photoelectric sensors, respectively.

[0039] In a fourth aspect, the present application provides a non-transitory computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, implements the method for determining sales volume of a storage device as described in the first aspect above.

[0040] In a fifth aspect, the present application provides a computer program product, including a computer program, which, when executed by a processor, implements the method for determining sales volume of a storage device as described in the first aspect above.

[0041] The above one or more technical solutions in the embodiments of the present application have at least one of the following technical effects:

[0042] By setting up multiple groups of through-beam photoelectric sensors in the storage device, multiple image shooting time periods are determined through the status information of the multiple groups of through-beam photoelectric sensors. The product sales situation is determined based on the image information taken in each shooting time period. There is no need to record the entire purchase process, which reduces the memory occupied by the shot content, greatly reduces the requirements for server computing power, reduces hardware resource consumption, and can improve the accuracy of product sales situation determination.

[0043] Furthermore, by judging whether a user's hand or other object has entered or exited the storage device through the changes in each group of through-type photoelectric sensors, two groups of through-type photoelectric sensors are selected from each group of through-type photoelectric sensors, and the image shooting period is determined based on the time interval of the change in status information of the two groups of through-type photoelectric sensors, thereby effectively determining the important time period for image sensor shooting, reducing the shooting time, and improving the shooting efficiency.

[0044] Furthermore, by extracting target features from multi-frame image information, multiple features of purchasing behavior during the purchasing process are obtained, that is, the first target feature and the second target feature are obtained, so that the product sales situation is determined based on the difference between the more important first target feature and the second target feature in the purchasing process, thereby improving the accuracy of the determined product sales situation.

[0045] Furthermore, by extracting the target features of each frame of image information and obtaining the confidence of each target feature, high-quality final image information is screened out based on the confidence, which effectively improves the accuracy of subsequent determination of product sales based on the final image information and enhances the user experience.

[0046] Additional aspects and advantages of the present application will be given in part in the description below, and in part will become apparent from the description below, or will be learned through the practice of the present application. BRIEF DESCRIPTION OF THE DRAWINGS

[0047] The above and / or additional aspects and advantages of the present application will become apparent and easily understood from the description of the embodiments in conjunction with the following drawings, in which:

[0048] Figure 1 is a flow chart of a method for determining sales volume of a storage device provided in an embodiment of the present application;

[0049] Figure 2 This is one of the principle schematic diagrams of the method for determining the sales volume of storage devices provided in the embodiment of the present application;

[0050] Figure 3 It is one of the structural schematic diagrams of the storage device provided in the embodiment of the present application;

[0051] Figure 4 This is the second structural schematic diagram of the storage device provided in the embodiment of the present application;

[0052] Figure 5 This is the third structural schematic diagram of the storage device provided in the embodiment of the present application;

[0053] Figure 6 This is the second principle schematic diagram of the method for determining the sales volume of storage equipment provided in the embodiment of the present application;

[0054] Figure 7 This is the third principle schematic diagram of the method for determining the sales volume of storage equipment provided in the embodiment of the present application;

[0055] Figure 8 is a schematic diagram of the structure of a device for determining sales volume of a storage device provided in an embodiment of the present application;

[0056] Fig. 9 This is the fourth principle schematic diagram of the method for determining the sales volume of storage equipment provided in the embodiment of the present application;

[0057] Fig.10 This is the fifth principle schematic diagram of the method for determining the sales volume of storage equipment provided in the embodiment of the present application;

[0058] Fig.11 It is a schematic diagram of the structure of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0059] The following will be combined with the drawings in the embodiments of the present application to clearly describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, rather than all the embodiments. All other embodiments obtained by ordinary technicians in this field based on the embodiments in the present application belong to the scope of protection of this application.

[0060] The terms "first", "second", etc. in the specification and claims of the present application are used to distinguish similar objects, and are not used to describe a specific order or sequence. It should be understood that the data used in this way can be interchangeable under appropriate circumstances, so that the embodiments of the present application can be implemented in an order other than those illustrated or described here, and the objects distinguished by "first", "second", etc. are generally of one type, and the number of objects is not limited. For example, the first object can be one or more. In addition, "and / or" in the specification and claims represents at least one of the connected objects, and the character " / " generally indicates that the objects associated with each other are in an "or" relationship.

[0061] In combination with the accompanying drawings, the sales volume determination method of storage equipment, the sales volume determination device of storage equipment, the refrigeration equipment and the readable storage medium provided in the embodiments of the present application are described in detail through specific embodiments and their application scenarios.

[0062] The method for determining the sales volume of storage equipment may be applied to a terminal, and may be specifically executed by hardware or software in the terminal.

[0063] The terminal includes but is not limited to portable communication devices such as mobile phones or tablet computers. It should also be understood that in some embodiments, the terminal may not be a portable communication device, but a desktop computer.

[0064] The terminal may include one or more other physical user interface devices such as a physical keyboard, mouse, and joystick.

[0065] The sales volume determination method for storage devices provided in an embodiment of the present application may be executed by a storage device, or a sales volume determination device for the storage device disposed on the storage device, or may also be a server electrically connected to the storage device, or may also be a user terminal communicatively connected to the storage device, including but not limited to a mobile terminal and a non-mobile terminal.

[0066] like Figure 1 As shown, the method for determining the sales volume of the storage device includes: step 110, step 120 and step 130.

[0067] The storage device can be understood as a refrigeration storage device in a broad sense, including but not limited to refrigerators, freezers, display cabinets, ice cream cabinets, wine cabinets, fresh-keeping cabinets, refrigerated vending machines and other refrigeration storage equipment. The storage equipment has various structural forms and a wide range of applications.

[0068] The storage device comprises an image sensor and at least two groups of opposite-beam photoelectric sensors.

[0069] like Figure 2 As shown, each group of through-beam photoelectric sensors may include multiple transmitting ends and multiple receiving ends.

[0070] Each transmitting end is arranged in one-to-one correspondence with each receiving end.

[0071] A plurality of transmitting ends are arranged on a target side of an inner wall of the storage device, and a plurality of receiving ends are arranged on the other side of the storage device opposite to the target side.

[0072] like Figure 3 As shown, in the case where the storage device is a horizontal storage device, multiple transmitting ends can be set on the left side (ie, the target side is the left side), and multiple receiving ends can be set on the right side (ie, the other side is the right side).

[0073] It is also possible to arrange multiple transmitting ends on the right side (ie, the target side is the right side) and arrange multiple receiving ends on the left side (ie, the other side is the left side).

[0074] like Figure 4 As shown, in the case where the storage device is a vertical storage device, multiple transmitting ends can be arranged at the top (that is, the target side is at the top), and multiple receiving ends can be arranged at the bottom (that is, the other side is at the bottom).

[0075] It is also possible to arrange multiple transmitting ends at the bottom (ie, the target side is at the bottom) and multiple receiving ends at the top (ie, the other side is at the top).

[0076] The image sensor may be disposed on a target side, another side, or a door of the storage device.

[0077] Of course, the image sensor can also be set at any position, and this application does not limit this.

[0078] Each group of through-beam photoelectric sensors may be based on different planes formed by a plurality of transmitting ends and a plurality of receiving ends.

[0079] The inclination angles of the planes relative to the plane where the bottom of the storage device is located can be the same or different.

[0080] In the case where the inclination angles of the planes relative to the plane where the bottom of the storage device is located are different, the planes formed by the multiple transmitting ends and the multiple receiving ends of each group of through-beam photoelectric sensors may be non-parallel.

[0081] like Figure 5 As shown, when the inclination angles of each plane relative to the plane where the bottom of the storage device is located are the same, each group of through-beam photoelectric sensors can be arranged in parallel based on a plane formed by multiple transmitting ends and multiple receiving ends.

[0082] The distances between each plane and the cabinet opening of the storage device are different.

[0083] The following description will be given by taking the storage device as a horizontal storage device as an example.

[0084] Step 110, determining at least two image acquisition time periods based on the status information of each group of through-beam photoelectric sensors;

[0085] In this step, the state information is the transmission status of the optical signal between the transmitting end and the receiving end of each group of through-beam photoelectric sensors.

[0086] Status information includes: normal and disconnected.

[0087] When the user's hand or other objects enter the storage device, the state information of the through-beam photoelectric sensor may be disconnected; when the user's hand or other objects do not enter the storage device, the state information of the through-beam photoelectric sensor may be normal.

[0088] The image acquisition period is the period between the moment when the image sensor starts acquiring images and the moment when the image sensor stops acquiring images.

[0089] The two image acquisition time periods respectively represent the time period when the image sensor acquires images when the user's hand or other objects enter the storage device and the time period when the image sensor acquires images when the user's hand or other objects exit the storage device.

[0090] During the actual implementation process, the status information of each group of through-beam photoelectric sensors may be different at different times. The status information can represent whether other objects have entered the storage device. If other objects have entered the storage device, there may be sales activities in the storage device. Therefore, the time period for collecting images by the image sensor can be determined based on the status information of each group of through-beam photoelectric sensors.

[0091] Based on the status information of the through-beam photoelectric sensor, combined with Figure 5 The arrangement of the through-beam photoelectric sensors shown is that two groups of through-beam photoelectric sensors are arranged in the storage device, and multiple transmitting ends of each group are arranged on the left side of the storage device, and multiple receiving ends of each group are arranged on the right side.

[0092] Through the actual situation that the status information of each group of through-beam photoelectric sensors changes from normal to disconnected, or from disconnected to normal during a sales process, the large image acquisition period corresponding to the entire sales process is further divided into two image acquisition periods when the user's hands or other objects enter the storage device and when the user's hands or other objects exit the storage device, thereby obtaining two image acquisition periods.

[0093] In some embodiments, the status information of each group of through-beam photoelectric sensors may be determined based on the following method:

[0094] In the case that more than a second target number of receiving ends among the plurality of receiving ends receive optical signals transmitted by the transmitting end corresponding to the receiving end, the state information is normal;

[0095] When receiving ends not exceeding the second target number among the multiple receiving ends receive optical signals transmitted by the transmitting end corresponding to the receiving end, the state information is disconnected.

[0096] In this embodiment, the second target number is a preset value for determining the state of the through-beam photoelectric sensor.

[0097] The specific value of the second target quantity can be determined based on user customization or actual conditions. For example, the second target quantity can be the number corresponding to multiple receiving ends, or 5 or 10 less than the number corresponding to multiple receiving ends. This application does not limit this.

[0098] like Figure 6 As shown, multiple transmitting ends and multiple receiving ends constitute a group of through-beam photoelectric sensors.

[0099] When there are no other objects between multiple transmitting ends and multiple receiving ends, receiving ends exceeding the second target number can receive the optical signals sent by the transmitting ends, or all receiving ends can receive the optical signals sent by the transmitting ends, or the status information of the group of through-beam photoelectric sensors is normal.

[0100] In the case where there are one or more objects between multiple transmitting ends and multiple receiving ends, the one or more objects will cut off the optical signals sent by some of the multiple transmitting ends, and some of the multiple receiving ends will be unable to receive the optical signals sent by the transmitting ends, so that the number of receiving ends that receive the optical signals sent by the transmitting ends does not exceed the second target number. At this time, the status information of the through-beam photoelectric sensor is disconnected.

[0101] According to the sales volume determination method of the storage device provided in the embodiment of the present application, the status information of the through-beam photoelectric sensor can be determined by receiving the signal emitted by the transmitting end through the receiving end. When the receiving ends of the second target number among the multiple receiving ends receive the light signals emitted by the transmitting ends corresponding to the multiple receiving ends, the status information is normal, indicating that no object has passed through the plane where the through-beam photoelectric sensor is located. When the receiving ends of the second target number among the multiple receiving ends do not receive the light signals emitted by the transmitting ends corresponding to the second target number of receiving ends, the status information is disconnected, indicating that an object has passed through the plane where the through-beam photoelectric sensor is located, which may result in a purchasing behavior, thereby effectively determining the changes in the storage device, and the judgment logic is simple and easy to operate.

[0102] In this embodiment, step 110 may further include:

[0103] Determine a time period between when the state information of a first group of through-beam photoelectric sensors in at least two groups of through-beam photoelectric sensors changes from normal to disconnected and when the state information of a second group of through-beam photoelectric sensors in at least two groups of through-beam photoelectric sensors changes from normal to disconnected as a first image acquisition period;

[0104] The time period between when the status information of the second group of through-beam photoelectric sensors in at least two groups of through-beam photoelectric sensors changes from disconnected to normal and when the status information of the first group of through-beam photoelectric sensors in at least two groups of through-beam photoelectric sensors changes from disconnected to normal is determined as the second image acquisition period.

[0105] In this step, the first group of through-beam type photoelectric sensors is any one group of through-beam type photoelectric sensors among at least two groups of through-beam type photoelectric sensors.

[0106] The second group of through-beam type photoelectric sensors is a group of through-beam type photoelectric sensors different from the first group of through-beam type photoelectric sensors.

[0107] The distance between the first group of through-beam photoelectric sensors and the cabinet opening of the storage device is smaller than the distance between the second group of through-beam photoelectric sensors and the cabinet opening of the storage device.

[0108] The first image acquisition period is an image acquisition period corresponding to the user's hand or other objects entering the storage device.

[0109] The second image acquisition period is an image acquisition period corresponding to the user's hand or other objects exiting the storage device.

[0110] In the actual implementation process, when the user's hand or other objects enter the storage device, as the distance between the user's hand and other objects and the bottom of the storage device continues to decrease, the status information of each group of through-beam photoelectric sensors set in the storage device will also change.

[0111] like Figure 6 As shown, taking the user's hand about to enter the storage device as an example, when the user has not opened the storage device door, the status information of each group of through-beam type photoelectric sensors is normal. When the user opens the door and the user's hand enters the storage device, as the user's hand continues to enter, the status of each group of through-beam type photoelectric sensors will change from normal to disconnected in sequence.

[0112] The moment when the first group of through-beam type photoelectric sensors changes from normal to disconnected can be determined as the start time of the image sensor shooting, and the moment when the second group of through-beam type photoelectric sensors changes from normal to disconnected can be determined as the end time of the image sensor shooting.

[0113] The first image acquisition period is determined based on the start shooting time corresponding to the user's hand entering the storage device and the end shooting time corresponding to the user's hand entering the storage device.

[0114] like Figure 7 As shown, after the user puts down the product to be returned, or picks up the product to be purchased from the storage device, the user's hand needs to be withdrawn from the storage device. At this time, as the user's hand continues to be withdrawn, each group of opposing photoelectric sensors will change from disconnected to normal in sequence.

[0115] The moment when the second group of through-beam photoelectric sensors changes from disconnected to normal can be determined as the start time of the image sensor shooting, and the moment when the first group of through-beam photoelectric sensors changes from disconnected to normal can be determined as the end time of the image sensor shooting.

[0116] The second collection time period is determined based on the start shooting time corresponding to when the user's hand exits the storage device and the end shooting time corresponding to when the user's hand exits the storage device.

[0117] According to the sales volume determination method of storage equipment provided in the embodiment of the present application, whether a user's hand or other object has entered or exited the storage device is determined by the changes in each group of through-type photoelectric sensors, and two groups of through-type photoelectric sensors are selected from each group of through-type photoelectric sensors. The image shooting time period is determined based on the time interval of changes in status information of the two groups of through-type photoelectric sensors, thereby effectively determining the important time period for image sensor shooting, reducing the shooting time, and improving the shooting efficiency.

[0118] Step 120, controlling the image sensor to collect images in each image collection period to obtain at least two frames of image information;

[0119] In this step, the image information includes: features corresponding to the user's hands taking and placing products in the storage device, features corresponding to other objects taking and placing products in the storage device, and internal environment features of the storage device.

[0120] The internal environment characteristics of the storage device may include the division of the space within the storage device and the storage conditions of the items in each space.

[0121] In the actual execution process, the image sensor starts taking pictures at the start time of the first image acquisition period, and ends taking pictures at the end time of the first image acquisition period.

[0122] The image sensor can capture multiple frames of images during the first image acquisition period.

[0123] Likewise, the image sensor starts taking pictures at the start time of the second image acquisition period, and ends taking pictures at the end time of the second image acquisition period.

[0124] The image sensor may capture multiple frames of images during the second image acquisition period.

[0125] The specific amount of image information collected by the image sensor in the first image collection period and the second image collection period can be determined based on actual conditions and is not limited in this application.

[0126] Step 130: Determine the sales status of products in the storage device based on at least two frames of image information.

[0127] In this step, the product sales situation refers to the sales situation of various products in the storage device.

[0128] In the actual implementation process, the specific circumstances of the sales behavior can be determined by comparing the changes in multiple frames of image information.

[0129] Taking the example of a user entering a storage device empty-handed to take out merchandise, at least two frames of image information should include an image of the user entering the storage device empty-handed and information of the user exiting the storage device with one or more products in their hands. At this time, based on the actual number of products held by the user, the sales volume of the product can be increased by a value corresponding to the actual number.

[0130] Taking the return of purchased goods as an example, at least two frames of image information should include images of the user holding one or more products entering the storage device and information of the user exiting the storage device empty-handed. At this time, based on the actual number of products held by the user, the sales volume of the product can be reduced by a value corresponding to the actual number.

[0131] During the research and development process, the inventor discovered that in the related technology, the purchase quantity and type generated at this time are obtained mainly by recording the user's shopping process and performing video recognition on the recorded process; however, this method requires a large amount of storage space, has high requirements on the server's computing power, and consumes a lot of hardware resources.

[0132] In addition, in the related art, an image is taken before and after the door is opened in the storage device, and the change in product quantity is determined by comparing the image differences to calculate the sales volume; however, the same products may be stacked behind or below the products, and the difference between the two pictures taken is small, so the sales volume determined is less accurate.

[0133] The present application sets multiple groups of through-beam photoelectric sensors in the storage device, senses whether there is purchasing behavior in the storage device based on the status information of the through-beam photoelectric sensors, and determines multiple image acquisition time periods based on the status information of each group of through-beam photoelectric sensors, captures images in each image acquisition time period, and does not need to record the video of the entire purchasing period, effectively reducing the shooting time and thus reducing the memory occupied by the shot content; and determines the sales situation in the storage device by identifying multiple image information. The sales situation can be determined through the image information, and there is no need to identify the recorded video frames frame by frame, which greatly reduces the requirements for server computing power and reduces hardware resource consumption.

[0134] In addition, the present application can effectively reflect the user's purchasing situation by capturing important image information in the user's purchasing behavior, rather than capturing images of storage devices with small differences before and after the storage devices are purchased, thereby improving the accuracy of sales calculations.

[0135] According to the method for determining sales volume of storage devices provided in the embodiments of the present application, multiple groups of through-beam photoelectric sensors are arranged in the storage devices, and multiple image shooting time periods are determined based on the status information of the multiple groups of through-beam photoelectric sensors. The product sales status is determined based on the image information shot in each shooting time period. There is no need to record the entire purchase process, which reduces the memory occupied by the shot content, greatly reduces the requirements for server computing power, reduces hardware resource consumption, and can improve the accuracy of determining product sales status.

[0136] In some embodiments, step 130 may further include:

[0137] Extracting target features from at least two frames of image information respectively to obtain a first target feature and a second target feature;

[0138] Based on the first target feature and the second target feature, product sales are determined.

[0139] In this embodiment, the target feature is a feature used to characterize the product placement. The target feature may include user hand features, such as the product category and quantity of the product being taken out or returned, and other features such as the product category and quantity of the product being taken out or returned by other objects.

[0140] The first target feature is a feature corresponding to the target frame image information in at least two frames of image information.

[0141] The second target feature is a feature corresponding to other frame image information except the target frame image information in at least two frames of image information.

[0142] The target frame image information is image information acquired in the first image acquisition period or image information acquired in the second image acquisition period.

[0143] The other frame image information is image information collected in other collection time periods that are different from the image collection time periods corresponding to the target frame image information.

[0144] For example, in a case where the target frame image information is an image acquired in a first image acquisition period, the other frame image information is an image acquired in a second image acquisition period.

[0145] For another example, when the target frame image information is an image acquired during the second image acquisition period, the other frame image information is an image acquired during the first image acquisition period.

[0146] It should be noted that the image acquisition period corresponding to the target frame image information is different from the image acquisition period corresponding to other frame image information.

[0147] During the actual execution process, the target features in the multi-frame image information can be extracted through an artificial intelligence model or a neural network model to obtain the first target feature and the second target feature.

[0148] For example, the target features in each frame image information can be extracted through the YOLO (You Only Look Once) model.

[0149] Of course, in the actual implementation process, target features in multi-frame image information can be extracted by any other feasible method, and this application does not limit this.

[0150] In the actual implementation process, after obtaining the first target feature and the second target feature, the difference between the first target feature and the second target feature can be compared, and the product sales situation can be determined based on the difference.

[0151] In some embodiments, when three image acquisition time periods are determined, image information can be acquired in the three image acquisition time periods respectively to obtain at least three pieces of image information. By extracting target features from the at least three pieces of image information respectively, the first target feature, the second target feature and the third target feature are obtained, and the product sales situation is determined based on the first target feature, the second target feature and the third target feature.

[0152] Similarly, when the determined image acquisition time periods are greater than three, the product sales situation can be determined by the above method, which will not be described here to avoid repetition.

[0153] According to the sales volume determination method of storage equipment provided in the embodiment of the present application, by extracting target features in multi-frame image information, multiple features of purchasing behavior in the purchasing process are obtained, that is, the first target feature and the second target feature are obtained, so as to determine the product sales situation based on the difference between the more important first target feature and the second target feature in the purchasing process, thereby improving the accuracy of the determined product sales situation.

[0154] In some embodiments, determining the sales situation of products in the storage device based on the first target feature and the second target feature may include:

[0155] Determining a time sequence of the first target feature and the second target feature based on an image acquisition period corresponding to the first target feature and an image acquisition period corresponding to the second target feature;

[0156] Determine a change in the target feature based on the time sequence and the difference information between the first target feature and the second target feature;

[0157] Based on the changes, determine product sales.

[0158] In this embodiment, the image acquisition period corresponding to the first target feature may be the first image acquisition period or the second image acquisition period.

[0159] The acquisition period corresponding to the second target feature is another image acquisition period different from the image acquisition period corresponding to the first target feature.

[0160] The difference information includes information such as the difference in product categories and the difference in product quantities of the products that the user picks up and places.

[0161] For example, when the image acquisition period corresponding to the first target feature is the first image acquisition period, the image acquisition period corresponding to the second target feature is the second image acquisition period.

[0162] For another example, when the image acquisition period corresponding to the first target feature is the second image acquisition period, the image acquisition period corresponding to the second target feature is the first image acquisition period.

[0163] Taking the image acquisition period corresponding to the first target feature as the first image acquisition period, and the image acquisition period corresponding to the second target feature as the second image acquisition period as an example, the action corresponding to the first target feature occurs before the action corresponding to the second target feature.

[0164] The first target feature is an image feature corresponding to a user's hand or other object entering the storage device. At this time, the image feature may show that the user has no product in his hand, or is holding one or more products.

[0165] The second target feature is an image feature corresponding to the user's hand or other object exiting the storage device. At this time, the image feature may show that the user has no product in his hand, or is holding one or more products.

[0166] For example, if a user needs to buy a bottle of brand A ice cream from a storage device, the first target feature may show that the user has no product in his hand, and the second target feature shows that the user has a bottle of brand A ice cream in his hand. Based on the changes before and after, the sales volume of brand A ice cream can be updated.

[0167] For example, if a user needs to return a bottle of brand B ice cream, the first target feature may show that the user is holding a brand B ice cream, and the second target feature may show that the user does not have the product in his hand. The sales volume of brand B ice cream can be updated based on the changes before and after.

[0168] It is understandable that the changes between the first target feature and the second target feature will be different due to different user needs, and the product sales situation can be updated based on the actual changes.

[0169] According to the sales volume determination method of storage equipment provided in the embodiment of the present application, by determining the image acquisition period corresponding to the first target feature and the image acquisition period corresponding to the second target feature, the order of occurrence of the first target feature and the second target feature can be determined, and then based on the order, the order of changes in the user's purchase process can be determined, so as to accurately update the product sales situation based on the changes, thereby improving the accuracy of the determined product sales volume, and the judgment logic is simple and easy to operate.

[0170] In some embodiments, determining product sales based on the change may include:

[0171] Based on the changes, determine the product category corresponding to the target product;

[0172] In the case where the change is to increase the first target quantity of products of the target category, the first target quantity is increased based on the sales volume data corresponding to the products of the target category;

[0173] In the case where the change is a reduction in the first target quantity of products in the target category, the first target quantity is reduced based on the sales volume data corresponding to the products in the target category.

[0174] In this embodiment,

[0175] Product categories are used to distinguish different products in storage devices.

[0176] The product category can be determined based on the brand of the product placed in the storage device or the type of the product, or based on both the brand and type of the product, and this application is not limited thereto.

[0177] For example, product categories may include: Brand A, Brand B, and Brand C, etc.

[0178] For example, product categories may also include: Type X ice cream, Type Y ice cream, Type X ice cream, etc.

[0179] For another example, product categories may also include: brand A’s type X ice cream, brand B’s type X ice cream, and brand C’s type Y ice cream, etc.

[0180] The first target quantity is the quantity of products purchased or returned by the user.

[0181] The specific value of the first target quantity is determined based on actual conditions. For example, the first target quantity may be 1, 2, or 10, etc., and this application does not limit it.

[0182] The target product is the product purchased or returned by the user. The sales data is the latest sales data of storage equipment recorded before the current sales behavior.

[0183] In the actual implementation process, taking the purchase of brand A ice cream by a user as an example, by comparing the first target feature and the second target feature, when it is determined that the user has added products in his hand, image recognition technology can be used to determine that one brand A ice cream is added or one brand A X type ice cream is added.

[0184] The latest sales data of brand A’s ice cream of category X recorded before the current sales behavior is obtained, and based on the latest sales data of brand A’s ice cream of category X, the sales data is increased by 1.

[0185] Taking the purchase of brand B ice cream by a user as an example, by comparing the first target feature and the second target feature, if it is determined that the user has fewer products in his hand, image recognition technology can be used to determine that one brand B ice cream is reduced or one brand B type X ice cream is reduced.

[0186] The latest sales data of Class X ice cream of Brand B recorded before the current sales behavior is obtained, and based on the latest sales data of Class X ice cream of Brand B, the sales data is reduced by 1.

[0187] When the user enters the storage device empty-handed and exits the storage device empty-handed, it indicates that the user has not purchased or returned any product. At this time, the sales data of various target products in the storage device remain unchanged.

[0188] According to the sales volume determination method of the storage device provided in the embodiment of the present application, the change between the first target feature and the second target feature is used to determine whether the product category of the target product in the storage device has increased or decreased. Based on the change in the product category and the target product, the sales data of the products in this category is updated, and the sales situation in the storage device is updated in real time. The sales data generated by each purchasing process is accurately recorded without manual checking of goods, thereby improving the efficiency of sales volume determination and reducing labor costs.

[0189] In some embodiments, step 120 may further include:

[0190] Extract target features from multiple frames of image information and obtain the confidence level corresponding to each target feature;

[0191] Based on the confidence level, multiple frames of image information in each image acquisition period are screened respectively to obtain at least one frame of image information corresponding to each image acquisition period.

[0192] In this step, the confidence level corresponding to each target feature is the degree of trust that the artificial intelligence model or neural network model has in the target features of each frame of image information extracted.

[0193] It can be understood that a higher confidence level indicates a higher degree of trust in the extracted target features.

[0194] At least one frame of image information corresponding to the image acquisition period is image information used to update sales data in the storage device.

[0195] In the actual implementation process, in each of the determined multiple image acquisition time periods, the image sensor may acquire multiple frames of image information.

[0196] By extracting the target features of each frame of image information and obtaining the confidence corresponding to each target feature, the image information corresponding to the target feature with the highest confidence is screened to obtain one frame of image information, or the image information corresponding to the target feature with a confidence greater than the target confidence threshold is screened to obtain one or more frames of image information.

[0197] The specific value of the target confidence threshold can be customized by the user or determined based on actual conditions, and this application does not limit it.

[0198] It should be noted that by screening the image information of each image acquisition period, each image acquisition period will obtain one or more frames of image information with high confidence, so that the product sales situation can be determined based on one or more frames of image information in each image acquisition period in the future.

[0199] According to the method for determining storage device sales provided in the embodiment of the present application, by extracting the target features of each frame of image information and obtaining the confidence of each target feature, high-quality final image information is screened out based on the confidence, thereby effectively improving the accuracy of subsequent determination of product sales based on the final image information and enhancing the user experience.

[0200] The sales volume determination method for storage equipment provided in the embodiment of the present application can be executed by a sales volume determination device for storage equipment. The sales volume determination device for storage equipment provided in the embodiment of the present application is described by taking the sales volume determination method for storage equipment executed by the sales volume determination device for storage equipment as an example.

[0201] An embodiment of the present application also provides a device for determining sales volume of a storage device.

[0202] like Figure 8 As shown, the sales volume determination device of the storage device includes: a first processing module 810, a second processing module 820 and a third processing module 830.

[0203] The storage device comprises an image sensor and at least two groups of opposite-beam photoelectric sensors.

[0204] Each group of through-beam photoelectric sensors includes a plurality of transmitting ends and a plurality of receiving ends.

[0205] Each transmitting end is arranged in one-to-one correspondence with each receiving end.

[0206] A plurality of transmitting ends are arranged on a target side of an inner wall of the storage device, and a plurality of receiving ends are arranged on the other side of the storage device opposite to the target side.

[0207] The distances between the plane formed by the multiple transmitting ends and the multiple receiving ends and the cabinet opening of the storage device are different for each group of through-beam photoelectric sensors.

[0208] A first processing module 810 is used to determine at least two image acquisition time periods based on the status information of each group of through-beam photoelectric sensors;

[0209] The second processing module 820 is used to control the image sensor to collect images in each image collection period to obtain at least two frames of image information;

[0210] The third processing module 830 is used to determine the sales status of products in the storage device based on at least two frames of image information.

[0211] According to the sales volume determination device of the storage device provided in the embodiment of the present application, a plurality of groups of through-beam type photoelectric sensors are arranged in the storage device, and a plurality of image shooting time periods are determined based on the status information of the plurality of groups of through-beam type photoelectric sensors. The product sales status is determined based on the image information shot in each shooting time period. There is no need to record the entire purchase process, which reduces the memory occupied by the shot content, greatly reduces the requirements for server computing power, reduces hardware resource consumption, and can improve the accuracy of determining the product sales status.

[0212] In some embodiments, the first processing module 810 may also be used to:

[0213] The time period between when the state information of the first group of through-beam photoelectric sensors in at least two groups of through-beam photoelectric sensors changes from normal to disconnected and when the state information of the second group of through-beam photoelectric sensors in at least two groups of through-beam photoelectric sensors changes from normal to disconnected is determined as the first image acquisition period; the distance between the first group of through-beam photoelectric sensors and the cabinet opening of the storage device is smaller than the distance between the second group of through-beam photoelectric sensors and the cabinet opening of the storage device;

[0214] The time period between when the status information of the second group of through-beam photoelectric sensors in at least two groups of through-beam photoelectric sensors changes from disconnected to normal and when the status information of the first group of through-beam photoelectric sensors in at least two groups of through-beam photoelectric sensors changes from disconnected to normal is determined as the second image acquisition period.

[0215] In some embodiments, the third processing module 830 may also be used to:

[0216] Extract target features from at least two frames of image information respectively to obtain a first target feature and a second target feature; the target feature is a feature used to characterize the features related to picking and placing products;

[0217] Based on the first target feature and the second target feature, product sales are determined.

[0218] In some embodiments, the third processing module 830 may also be used to:

[0219] Determining a time sequence of the first target feature and the second target feature based on an image acquisition period corresponding to the first target feature and an image acquisition period corresponding to the second target feature;

[0220] Determine a change in the target feature based on the time sequence and the difference information between the first target feature and the second target feature;

[0221] Based on the changes, determine product sales.

[0222] In some embodiments, the third processing module 830 may also be used to:

[0223] Based on the changes, determine the product category corresponding to the target product;

[0224] In the case where the change is to increase the first target quantity of products of the target category, the first target quantity is increased based on the sales volume data corresponding to the products of the target category;

[0225] In the case where the change is a reduction in the first target quantity of products in the target category, the first target quantity is reduced based on the sales volume data corresponding to the products in the target category.

[0226] In some embodiments, the second processing module 820 may also be used to:

[0227] Extract target features from multiple frames of image information and obtain the confidence level corresponding to each target feature; the target feature is used to characterize features related to picking and placing products;

[0228] Based on the confidence level, multiple frames of image information in each image acquisition period are screened respectively to obtain at least one frame of image information corresponding to each image acquisition period.

[0229] In some embodiments, the apparatus may further include a fourth processing module, configured to:

[0230] In the case that more than a second target number of receiving ends among the plurality of receiving ends receive optical signals transmitted by the transmitting end corresponding to the receiving end, the state information is normal;

[0231] When receiving ends not exceeding the second target number among the multiple receiving ends receive optical signals transmitted by the transmitting end corresponding to the receiving end, the state information is disconnected.

[0232] The sales volume determination device of the storage device in the embodiment of the present application can be a storage device, or an electronic device connected to the storage device for communication, or a component in the storage device or the electronic device, such as an integrated circuit or a chip. The electronic device can be a terminal, or it can be other devices other than the terminal. Exemplarily, the electronic device can be a mobile phone, a tablet computer, a laptop computer, a PDA, a car electronic device, a mobile Internet device (Mobile Internet Device, MID), an augmented reality (augmented reality, AR) / virtual reality (virtual reality, VR) device, a robot, a wearable device, an ultra-mobile personal computer (ultra-mobile personal computer, UMPC), a netbook or a personal digital assistant (personal digital assistant, PDA), etc. It can also be a server, a network attached storage (Network Attached Storage, NAS), a personal computer (personal computer, PC), a television (television, TV), a teller machine or a self-service machine, etc., and the embodiment of the present application is not specifically limited.

[0233] The sales volume determination device of the storage device in the embodiment of the present application may be a device having an operating system. The operating system may be an Android operating system, an IOS operating system, or other possible operating systems, which are not specifically limited in the embodiment of the present application.

[0234] The sales volume determination device of the storage device provided in the embodiment of the present application can achieve Figure 1 , Figure 2 , Figure 6 , Figure 7 , Fig. 9 as well as Fig.10 To avoid repetition, the various processes implemented by the method embodiment are not described here.

[0235] The embodiment of the present application also provides a storage device.

[0236] In some embodiments, the storage device may include: a cabinet, at least two groups of through-beam photoelectric sensors, an image sensor, and a sales volume determination device based on the storage device as described in any of the above embodiments.

[0237] In this embodiment, the storage device can be understood as a refrigeration storage device in a broad sense, including but not limited to refrigerators, freezers, display cabinets, ice cream cabinets, wine cabinets, fresh-keeping cabinets, refrigerated vending machines and other refrigeration storage devices. The storage device has various structural forms and a wide range of applications.

[0238] like Figure 2 As shown, each group of through-beam photoelectric sensors may include multiple transmitting ends and multiple receiving ends.

[0239] Each transmitting end is arranged in one-to-one correspondence with each receiving end.

[0240] A plurality of transmitting ends are arranged on a target side of an inner wall of a cabinet of a storage device, and a plurality of receiving ends are arranged on the other side of the storage device opposite to the target side.

[0241] like Figure 3 As shown, in the case where the storage device is a horizontal storage device, multiple transmitting ends can be set on the left side (ie, the target side is the left side), and multiple receiving ends can be set on the right side (ie, the other side is the right side).

[0242] It is also possible to arrange multiple transmitting ends on the right side (ie, the target side is the right side) and arrange multiple receiving ends on the left side (ie, the other side is the left side).

[0243] like Figure 4 As shown, in the case where the storage device is a vertical storage device, multiple transmitting ends can be arranged at the top (that is, the target side is at the top), and multiple receiving ends can be arranged at the bottom (that is, the other side is at the bottom).

[0244] It is also possible to arrange multiple transmitting ends at the bottom (ie, the target side is at the bottom) and multiple receiving ends at the top (ie, the other side is at the top).

[0245] The image sensor may be disposed on the target side, the other side, or a cabinet door of the storage device.

[0246] Of course, the image sensor can also be set at any position, and this application does not limit this.

[0247] Each group of through-beam photoelectric sensors may be based on different planes formed by a plurality of transmitting ends and a plurality of receiving ends.

[0248] The inclination angles of the planes relative to the plane where the bottom of the storage device is located can be the same or different.

[0249] In the case where the inclination angles of the planes relative to the plane where the bottom of the storage device is located are different, the planes formed by the multiple transmitting ends and the multiple receiving ends of each group of through-beam photoelectric sensors may be non-parallel.

[0250] In some embodiments, each group of through-beam photoelectric sensors is arranged in parallel based on a plane formed by a plurality of transmitting ends and a plurality of receiving ends.

[0251] In this embodiment, if Figure 5 As shown, when the inclination angles of each plane relative to the plane where the bottom of the storage device is located are the same, each group of through-beam photoelectric sensors can be arranged in parallel based on a plane formed by multiple transmitting ends and multiple receiving ends.

[0252] According to the storage device provided in the embodiment of the present application, each group of through-beam photoelectric sensors can be arranged in parallel based on a plane formed by multiple transmitting ends and multiple receiving ends. When a user's hand or other object enters the storage device, the moment when each group of through-beam photoelectric sensors is triggered to respond is more accurate, thereby improving the accuracy of the subsequently determined image acquisition time period.

[0253] The distances between each plane and the cabinet opening of the storage device are different.

[0254] The sales volume determining device of the storage device is respectively connected to the image sensor and electrically connected to at least two groups of opposite-radiation photoelectric sensors.

[0255] like Fig. 9 and Fig.10 As shown, in some embodiments, the storage device may further include: a door opening and closing sensor.

[0256] In this embodiment, whether to open or close the door can be determined based on the state change of the door opening and closing sensor.

[0257] The door opening and closing sensor can be set on the cabinet door of the storage device or near the hinge of the refrigerator door.

[0258] The location of the door switch sensor can be determined based on actual conditions and is not limited in this application.

[0259] By setting up a door switch sensor, you can effectively detect whether the cabinet door of the storage device is open or closed, and understand the status changes of the storage device in real time.

[0260] According to the method for determining the storage device provided in the embodiment of the present application, by setting a plurality of groups of through-beam photoelectric sensors in the storage device, a plurality of image shooting time periods are determined through the status information of the plurality of groups of through-beam photoelectric sensors, and the product sales status is determined based on the image information shot in each shooting time period. There is no need to record the entire purchase process, which reduces the memory occupied by the shot content, greatly reduces the requirements for server computing power, reduces hardware resource consumption, and can improve the accuracy of determining the product sales status.

[0261] In some embodiments, Fig.11 As shown, an embodiment of the present application further provides an electronic device 1100, including a processor 1101, a memory 1102, and a computer program stored in the memory 1102 and executable on the processor 1101. When the program is executed by the processor 1101, each process of the sales volume determination method embodiment of the above-mentioned storage device is implemented, and the same technical effect can be achieved. To avoid repetition, it will not be described here.

[0262] It should be noted that the electronic devices in the embodiments of the present application include the mobile electronic devices and non-mobile electronic devices mentioned above.

[0263] An embodiment of the present application also provides a non-transitory computer-readable storage medium, on which a computer program is stored. When the computer program is executed by a processor, each process of the sales volume determination method embodiment of the above-mentioned storage device is implemented, and the same technical effect can be achieved. To avoid repetition, it will not be repeated here.

[0264] The processor is the processor in the electronic device described in the above embodiment. The readable storage medium includes a computer readable storage medium, such as a computer read-only memory ROM, a random access memory RAM, a magnetic disk or an optical disk.

[0265] An embodiment of the present application also provides a computer program product, including a computer program, which implements the sales volume determination method of the above-mentioned storage device when executed by a processor.

[0266] The processor is the processor in the electronic device described in the above embodiment. The readable storage medium includes a computer readable storage medium, such as a computer read-only memory ROM, a random access memory RAM, a magnetic disk or an optical disk.

[0267] An embodiment of the present application further provides a chip, which includes a processor and a communication interface, wherein the communication interface is coupled to the processor, and the processor is used to run programs or instructions to implement the various processes of the above-mentioned sales volume determination method embodiment of the storage device, and can achieve the same technical effect. To avoid repetition, it will not be repeated here.

[0268] It should be understood that the chip mentioned in the embodiments of the present application can also be called a system-level chip, a system chip, a chip system or a system-on-chip chip, etc.

[0269] It should be noted that, in this article, the terms "comprise", "include" or any other variant thereof are intended to cover non-exclusive inclusion, so that the process, method, article or device including a series of elements includes not only those elements, but also includes other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, the elements defined by the sentence "comprise one..." do not exclude the presence of other identical elements in the process, method, article or device including the element. In addition, it should be pointed out that the scope of the methods and devices in the embodiments of the present application is not limited to performing functions in the order shown or discussed, and may also include performing functions in a substantially simultaneous manner or in reverse order according to the functions involved, for example, the described method may be performed in an order different from that described, and various steps may also be added, omitted, or combined. In addition, the features described with reference to certain examples may be combined in other examples.

[0270] Through the description of the above implementation methods, those skilled in the art can clearly understand that the above-mentioned embodiment methods can be implemented by means of software plus a necessary general hardware platform, and of course by hardware, but in many cases the former is a better implementation method. Based on such an understanding, the technical solution of the present application, or the part that contributes to the relevant technology, can be embodied in the form of a computer software product, which is stored in a storage medium (such as ROM / RAM, a disk, or an optical disk), and includes a number of instructions for a terminal (which can be a mobile phone, a computer, a server, or a network device, etc.) to execute the methods described in each embodiment of the present application.

[0271] The embodiments of the present application are described above in conjunction with the accompanying drawings, but the present application is not limited to the above-mentioned specific implementation methods. The above-mentioned specific implementation methods are merely illustrative and not restrictive. Under the guidance of the present application, ordinary technicians in this field can also make many forms without departing from the purpose of the present application and the scope of protection of the claims, all of which are within the protection of the present application.

[0272] In the description of this specification, the description with reference to the terms "one embodiment", "some embodiments", "illustrative embodiments", "examples", "specific examples", or "some examples" means that the specific features, structures, materials, or characteristics described in conjunction with the embodiment or example are included in at least one embodiment or example of the present application. In this specification, the schematic representation of the above terms does not necessarily refer to the same embodiment or example. Moreover, the specific features, structures, materials, or characteristics described may be combined in any one or more embodiments or examples in a suitable manner.

[0273] Although the embodiments of the present application have been shown and described, those skilled in the art will appreciate that various changes, modifications, substitutions and variations may be made to the embodiments without departing from the principles and spirit of the present application, and that the scope of the present application is defined by the claims and their equivalents.

Claims

1. A method for determining the sales volume of a storage device, characterized in that: The storage device includes an image sensor and at least two groups of opposite-beam photoelectric sensors, each group of the opposite-beam photoelectric sensors includes a plurality of transmitting ends and a plurality of receiving ends, and each of the transmitting ends is arranged in a one-to-one correspondence with each of the receiving ends; the plurality of transmitting ends are arranged on a target side of an inner wall of the storage device, and the plurality of receiving ends are arranged on the other side of the storage device opposite to the target side; The distances between the plane formed by the plurality of transmitting ends and the plurality of receiving ends and the cabinet opening of the storage device in each group of the through-beam photoelectric sensors are different; the method comprises: Determining at least two image acquisition time periods based on the status information of each group of through-beam photoelectric sensors; Controlling the image sensor to capture images in each of the image capture time periods to obtain at least two frames of image information; Based on the at least two frames of image information, the sales status of the products in the storage device is determined.

2. The method for determining the sales volume of storage equipment according to claim 1, characterized in that: The determining of at least two image acquisition time periods based on the status information of each group of the through-beam photoelectric sensors comprises: The time period between when the state information of the first group of through-beam photoelectric sensors among the at least two groups of through-beam photoelectric sensors changes from normal to disconnected and when the state information of the second group of through-beam photoelectric sensors among the at least two groups of through-beam photoelectric sensors changes from normal to disconnected is determined as the first image acquisition period; the distance between the first group of through-beam photoelectric sensors and the cabinet opening of the storage device is smaller than the distance between the second group of through-beam photoelectric sensors and the cabinet opening of the storage device; The time period between when the status information of the second group of through-beam photoelectric sensors in the at least two groups of through-beam photoelectric sensors changes from disconnected to normal and when the status information of the first group of through-beam photoelectric sensors in the at least two groups of through-beam photoelectric sensors changes from disconnected to normal is determined as the second image acquisition period.

3. The method for determining the sales volume of storage equipment according to claim 1, characterized in that: The determining the sales situation of the products in the storage device based on the at least two frames of image information includes: Extracting target features from the at least two frames of image information respectively to obtain a first target feature and a second target feature; the target feature is a feature used to characterize the features related to picking and placing products; Based on the first target feature and the second target feature, the product sales situation is determined.

4. The method for determining the sales volume of storage equipment according to claim 3, characterized in that: The determining the product sales situation based on the first target feature and the second target feature includes: Determining a time sequence of the first target feature and the second target feature based on an image acquisition period corresponding to the first target feature and an image acquisition period corresponding to the second target feature; Determining a change in the target feature based on the time sequence and difference information between the first target feature and the second target feature; Based on the changes, the sales status of the product is determined.

5. The method for determining the sales volume of storage equipment according to claim 4, characterized in that: The determining of the product sales situation based on the change situation includes: Based on the changes, determine the product category corresponding to the target product; In a case where the change is an increase in the first target quantity of products of the target category, the first target quantity is increased based on the sales data corresponding to the products of the target category; In a case where the change is a reduction in the first target quantity of products in the target category, the first target quantity is reduced based on sales data corresponding to the products in the target category.

6. The method for determining the sales volume of a storage device according to any one of claims 1 to 5, characterized in that: The controlling the image sensor to collect images in each of the image collection time periods to obtain at least two frames of image information includes: Extract target features of multiple frames of image information to obtain confidence levels corresponding to the target features; the target features are features used to characterize product placement; Based on the confidence level, the multiple frames of image information in each of the image acquisition time periods are screened respectively to obtain at least one frame of image information corresponding to each of the image acquisition time periods.

7. The method for determining the sales volume of a storage device according to any one of claims 1 to 5, characterized in that: The status information of each group of through-beam photoelectric sensors is determined based on the following method: In the case that more than a second target number of receiving ends among the plurality of receiving ends receive optical signals transmitted by a transmitting end corresponding to the receiving end, the state information is normal; In the case that receiving ends not exceeding a second target number among the multiple receiving ends receive optical signals transmitted by the transmitting end corresponding to the receiving end, the state information is disconnected.

8. A device for determining sales volume of a storage device, characterized in that: The storage device includes an image sensor and at least two groups of opposite-beam photoelectric sensors, each group of the opposite-beam photoelectric sensors includes a plurality of transmitting ends and a plurality of receiving ends, and each of the transmitting ends is arranged in a one-to-one correspondence with each of the receiving ends; the plurality of transmitting ends are arranged on a target side of an inner wall of the storage device, and the plurality of receiving ends are arranged on the other side of the storage device opposite to the target side; The distances between the plane formed by the plurality of transmitting ends and the plurality of receiving ends and the cabinet opening of the storage device are different for each group of the through-beam photoelectric sensors; The device comprises: A first processing module, configured to determine at least two image acquisition time periods based on the status information of each group of the through-beam photoelectric sensors; A second processing module, configured to control the image sensor to collect at least two frames of image information based on the at least two image collection time periods; The third processing module is used to determine the sales status of products in the storage device based on the at least two frames of image information.

9. A storage device, characterized in that: include: Cabinet; At least two groups of through-beam photoelectric sensors, each group of the through-beam photoelectric sensors includes a plurality of transmitting ends and a plurality of receiving ends, and each of the transmitting ends is arranged in a one-to-one correspondence with each of the receiving ends; the plurality of transmitting ends are arranged on a target side of an inner wall of the cabinet of the storage device, and the plurality of receiving ends are arranged on the other side of the storage device opposite to the target side; the distance between the plane formed by the plurality of transmitting ends and the plurality of receiving ends and the cabinet opening of the storage device of each group of the through-beam photoelectric sensors is different; Image sensor; Based on the sales volume determination device of a storage device as claimed in claim 8, the sales volume determination device of the storage device is electrically connected to the image sensor and the at least two groups of through-beam photoelectric sensors respectively.

10. The storage device according to claim 9, characterized in that: Each group of the through-beam photoelectric sensors is arranged in parallel based on a plane formed by the multiple transmitting ends and the multiple receiving ends.

11. A non-transitory computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the sales volume determination method of the storage device as described in any one of claims 1 to 7 is implemented.

12. A computer program product, comprising a computer program, characterized in that When the computer program is executed by a processor, the method for determining sales volume of a storage device according to any one of claims 1 to 7 is implemented.

Images