A method and system for detecting storage status of products in a vending machine

Abstract

The present invention provides a method for detecting the storage status of products in a vending machine, comprising: obtaining product information of internal products through a camera preset inside the vending machine; determining storage-related information of each product according to the product information; determining the storage status of products inside the vending machine according to the storage-related information of each product and based on the environmental information inside the vending machine. The method and system for detecting the storage status of products in a vending machine provided by the present invention can automatically detect the storage status of products inside the vending machine in real time.

Description

Technical Field

[0001] The present invention relates to the field of automated detection, and in particular to a method and system for detecting storage status of products in a vending machine. Background Art

[0002] A vending machine is a machine that can automatically pay for goods according to the coins inserted. Vending machines are common equipment for commercial automation. They are not restricted by time and place, can save manpower and facilitate transactions. It is a new form of commercial retail, also known as a 24-hour mini supermarket. Common vending machines are divided into four types: beverage vending machines, food vending machines, comprehensive vending machines, and cosmetics vending machines.

[0003] With the development of Internet technology, the vending machine industry is moving towards informatization and further rationalization. For example, the online method is implemented to transmit the inventory information in the vending machine to the computer of each business point in a timely manner through the telephone line, thus ensuring the smooth delivery, replenishment and selection of goods.

[0004] However, existing vending machines still cannot realize self-detection of the storage status of internal products, and often require manual inspection to prevent the products inside the vending machine from being in abnormal conditions. Summary of the invention

[0005] The present invention provides a method and system for detecting the storage status of products in an automatic vending machine, which can automatically detect the storage status of products in the automatic vending machine in real time.

[0006] The present invention provides a method and system for detecting storage status of products in a vending machine, comprising:

[0007] Step S1, obtaining product information of internal products through a camera preset inside the vending machine;

[0008] Step S2: Determine storage-related information for each product based on product information;

[0009] Step S3: Determine the storage status of the products inside the vending machine based on the storage-related information of each product and the environmental information inside the vending machine.

[0010] Preferably, obtaining product information of internal products through a camera preset inside the vending machine includes:

[0011] Step S11, photographing the shelf position by a camera preset inside the vending machine to obtain a first type of video;

[0012] Step S12: Identify the first type of video and determine the product image corresponding to the displayed product;

[0013] Step S13: performing feature recognition on the product image to determine the product identification in the product image; wherein the product identification includes a barcode or a QR code;

[0014] Step S14: extract and decode the product identification features, and search and extract the product information corresponding to the product based on the decoded information.

[0015] Preferably, identifying the first type of video to determine the product image corresponding to the displayed product includes:

[0016] Performing frame processing on the first type of video, and determining the status of products at various locations in the vending machine based on the framed images;

[0017] Determine the result of loading and unloading actions of products according to the status of products at various positions in the vending machine;

[0018] According to the judgment result, when a loading action occurs for a product at a certain position, a frame image after the loading action is completed is acquired, and a product image corresponding to the product at the position in the frame image is intercepted.

[0019] Preferably, it also includes:

[0020] According to the judgment result, when a product at a certain position point has a loading action, a product management information set corresponding to the position point is established, and a product image corresponding to the product at the position point and an analysis result of the product image are stored together in the product management information set corresponding to the position point;

[0021] According to the judgment result, when a product at a certain location point has a product unloading action, the corresponding product management information set at the location point is deleted;

[0022] A management database of the vending machine is generated by using a plurality of product management information sets stored in the vending machine.

[0023] Preferably, determining storage-related information of each product according to the product information includes:

[0024] Analyze product information and extract key fields from product information;

[0025] Extract product information items containing key fields from product information, classify them according to the information type corresponding to each key field, and fill them into the preset product information table accordingly;

[0026] Determine the storage-related information in the product information table; wherein the storage-related information includes the production date, shelf life, and storage requirements.

[0027] Preferably, determining the storage status of the products inside the vending machine based on the storage-related information of each product and the environmental information inside the vending machine includes:

[0028] Step S31, determining the production date and shelf life of the product based on the storage-related information of the product;

[0029] Step S32: obtaining current time information, and determining the remaining storage period corresponding to the product according to the production date and shelf life corresponding to the product;

[0030] Step S33, obtaining the environmental parameters inside the vending machine, and judging whether the product is in a standard storage environment according to the environmental parameter requirements corresponding to the relevant information stored corresponding to the product, to obtain a first judgment result;

[0031] Step S34, obtaining the product status at each location point inside the vending machine;

[0032] Step S35: Determine the storage status of the product inside the vending machine using the storage-related information corresponding to the product, the remaining storage period corresponding to the product, the environmental parameters inside the vending machine, the first judgment result, and the product presence status.

[0033] Preferably, determining the storage status of the products inside the vending machine based on the storage-related information of each product and the environmental information inside the vending machine further includes:

[0034] Determine the quality variation coefficient corresponding to a product according to the storage related information corresponding to the product;

[0035] Acquiring environmental parameters inside the vending machine through sensors preset inside the vending machine; wherein the environmental parameters include light intensity, temperature and humidity;

[0036] Calculate the degree of deterioration of the product based on the corresponding quality variation coefficient and environmental parameters.

[0037] Preferably, calculating the deterioration degree of the product according to the quality variation coefficient corresponding to the product and the environmental parameters includes:

[0038] Determine the shelf time of the product from the time it is put on the vending machine to the current time point, determine the environmental parameters obtained at all time points within the shelf time and establish an environmental parameter set;

[0039] Smoothing the data of the same data type in the environmental parameter set to obtain the data change curve corresponding to the data type;

[0040] According to the product information corresponding to the product, obtain the quality change coefficient and deterioration calculation formula preset by the company corresponding to the product;

[0041] Based on a preset deterioration calculation formula corresponding to the product, the deterioration degree of the product is calculated according to a plurality of data change curves and a preset quality change coefficient corresponding to the product.

[0042] Preferably, the method further includes determining whether the storage state of the product is abnormal by comparing the storage state of the product inside the vending machine at different times, including:

[0043] Determine the product image of the vacuum-packed product after it is put on the shelf based on the product information, and use it as the initial product image;

[0044] Acquire a product image of the vacuum-packaged product in a current state in real time, and compare the product image with the initial product image to determine a first matching degree between the images;

[0045] When the first matching degree is lower than a preset matching degree threshold, determining that the product image corresponding to the vacuum-packed product is abnormal;

[0046] After determining that the product image is abnormal, feature analysis is performed on the initial product image and an image feature set is established;

[0047] Based on the image feature set, feature matching is performed on the product image in the current state to determine whether the product in the current state has bulging bag phenomenon.

[0048] Preferably, after determining that the product image is abnormal, performing feature analysis on the initial product image and establishing an image feature set includes:

[0049] Performing image grayscale processing on the initial product image to obtain a grayscale image;

[0050] The texture description of the grayscale image is performed based on the grayscale histogram characteristics, and four texture measurements of the grayscale histogram are obtained as the image feature set of the product image; among them, the texture measurements include smoothness, standard deviation, consistency and average entropy value measurement.

[0051] To achieve the above objectives, an embodiment of the present invention further discloses a product storage status detection system for a vending machine, comprising:

[0052] A product information acquisition module, used to acquire product information of internal products through a camera preset inside the vending machine;

[0053] A storage information acquisition module, used to determine the storage-related information of each product according to the product information;

[0054] The storage status analysis module is used to determine the storage status of the products inside the vending machine based on the storage-related information of each product and the environmental information inside the vending machine.

[0055] Other features and advantages of the present invention will be described in the following description, and partly become apparent from the description, or understood by practicing the present invention. The purpose and other advantages of the present invention can be realized and obtained by the structures particularly pointed out in the written description, claims, and drawings.

[0056] The technical solution of the present invention is further described in detail below through the accompanying drawings and embodiments. BRIEF DESCRIPTION OF THE DRAWINGS

[0057] The accompanying drawings are used to provide a further understanding of the present invention and constitute a part of the specification. Together with the embodiments of the present invention, they are used to explain the present invention and do not constitute a limitation of the present invention. In the accompanying drawings:

[0058] Figure 1 This is a flowchart of a method and system for detecting product storage status of a vending machine in an embodiment of the present invention;

[0059] Figure 2 A flowchart of the steps for obtaining product information in an embodiment of the present invention;

[0060] Figure 3 This is a flow chart of the steps for obtaining the storage status of a product in an embodiment of the present invention. DETAILED DESCRIPTION

[0061] The preferred embodiments of the present invention are described below in conjunction with the accompanying drawings. It should be understood that the preferred embodiments described herein are only used to illustrate and explain the present invention, and are not used to limit the present invention.

[0062] The present invention provides a method and system for detecting the storage status of products in a vending machine, such as Figure 1 ,include:

[0063] Step S1, obtaining product information of internal products through a camera preset inside the vending machine;

[0064] Step S2: Determine storage-related information for each product based on product information;

[0065] Step S3: Determine the storage status of the products inside the vending machine based on the storage-related information of each product and the environmental information inside the vending machine.

[0066] The working principle and beneficial effects of the above technical solution are as follows: the product information of the internal products is obtained by the camera preset inside the vending machine, wherein the camera can be set at multiple positions inside the vending machine to realize multi-angle viewing of the internal products, so as to ensure that the special mark image of the product can be successfully obtained, and the relevant information of the product is determined by analyzing the special mark image. For most cases, the products placed must be regular, so it is sufficient to set one camera at the front and back of the vending machine. The image obtained by the camera can also be used to determine the status of each product in place, and the manufacturer of the product, the production date of the product, the shelf life, the product ingredients, the energy content, the product specifications and the product number and other related information can be determined in the product information, and this information can be presented on the vending operation panel of the vending machine for users to selectively view, so as to enhance the customer's experience. According to the product information, the storage related information of each product is determined, including the production date, shelf life, storage environment requirements and other related information of the product. According to the storage-related information of each product and the environmental information inside the vending machine, the storage status of the products inside the vending machine is determined. For example, whether the product has expired is determined based on the storage-related information and the current time, and whether the product is in a reasonable storage environment is determined based on the storage environment requirements and the environmental information inside the vending machine (temperature, humidity and light). When the storage environment is poor, the staff is reminded to take actions to improve the storage environment. The above methods finally realize the real-time detection of the storage status of the products inside the vending machine.

[0067] In a preferred embodiment, if Figure 2 , the product information of the internal products obtained through the camera preset inside the vending machine includes:

[0068] Step S11, photographing the shelf position by a camera preset inside the vending machine to obtain a first type of video;

[0069] Step S12: Identify the first type of video and determine the product image corresponding to the displayed product;

[0070] Step S13: performing feature recognition on the product image to determine the product identification in the product image; wherein the product identification includes a barcode or a QR code;

[0071] Step S14: extract and decode the product identification features, and search and extract the product information corresponding to the product based on the decoded information.

[0072] The working principle and beneficial effects of the above technical solution are as follows: the shelf position is photographed by a camera preset inside the vending machine to obtain the first type of video; the first type of video is identified to determine the product image corresponding to the placed product; the product image is feature identified to determine the product identification in the product image; wherein the product identification includes a barcode or a QR code and other types of product identification that can be analyzed by decoding; the product identification is feature extracted and decoded, and the product information corresponding to the product is searched and extracted through the product information library preset on the Internet according to the decoding information, wherein, after the product information corresponding to the product is extracted, the product image can be reversely identified according to the image features of the product packaging preset in the product information, and further determined whether the product information corresponds to the product. Thus, the product information corresponding to the product is extracted by identifying the special code on the product image.

[0073] In a preferred embodiment, identifying the first type of video and determining the product image corresponding to the displayed product includes:

[0074] Performing frame processing on the first type of video, and determining the status of products at various locations in the vending machine based on the framed images;

[0075] Determine the result of loading and unloading actions of products according to the status of products at various positions in the vending machine;

[0076] According to the judgment result, when a loading action occurs for a product at a certain position, a frame image after the loading action is completed is acquired, and a product image corresponding to the product at the position in the frame image is intercepted.

[0077] The working principle and beneficial effects of the above technical solution are as follows: by performing frame processing on the first type of video, and determining the status of the products at each position in the vending machine based on the framed images; determining the judgment result of the loading and unloading actions of the products based on the status of the products at each position in the vending machine; based on the judgment result, when a loading action occurs on a product at a certain position, the framed images after the loading action is completed are obtained, and the product image corresponding to the product at the position in the framed images is intercepted. The above technical solution is used to obtain the product image of each densely placed product, so as to avoid the situation where the internal camera of the vending machine cannot fully cover and obtain the product images of all products. Furthermore, in general, the products on the same batch of shelves and in the same shipping channel in the vending machine are most likely to belong to the same production line and production date, and can share the same product information. Therefore, it is only necessary to obtain the product image of the outermost products after being put on the shelves.

[0078] In a preferred embodiment, it also includes:

[0079] According to the judgment result, when a product at a certain position point has a loading action, a product management information set corresponding to the position point is established, and a product image corresponding to the product at the position point and an analysis result of the product image are stored together in the product management information set corresponding to the position point;

[0080] According to the judgment result, when a product at a certain location point has a product unloading action, the corresponding product management information set at the location point is deleted;

[0081] A management database of the vending machine is generated by using a plurality of product management information sets stored in the vending machine.

[0082] The working principle and beneficial effects of the above technical solution are as follows: when a product at a certain position point undergoes a loading action, a product management information set corresponding to the position point is established, and the product image corresponding to the product at the position point and the analysis result of the product image are stored together in the product management information set corresponding to the position point; for example, when a loading action occurs at point 3 of channel A in the vending machine, the product management information corresponding to the position point is established, the position point is determined to be a product in place, and the relevant product information of the product, the storage status information of the product at the position point, etc. are recorded; according to the judgment result, when a product at a certain position point undergoes an unloading action, the product management information set corresponding to the position point is deleted, thereby returning the product in place status at the position point to empty; and a management database of the vending machine is generated using multiple product management information sets stored in the vending machine. This makes it possible to detect the presence of products at various locations inside the vending machine, and to independently manage the storage status of products at various locations, making it convenient to screen out abnormal products, while also enabling accurate statistics on each product. It can also completely prevent the existing situation where customers cannot get products after purchasing because the products are not placed at the location (existing vending machines all deliver products point by point, and when a certain location is not filled, only empty goods can be delivered).

[0083] In a preferred embodiment, determining storage-related information for each product according to product information includes:

[0084] Analyze product information and extract key fields from product information;

[0085] Extract product information items containing key fields from product information, classify them according to the information type corresponding to each key field, and fill them into the preset product information table accordingly;

[0086] Determine the storage-related information in the product information table; wherein the storage-related information includes the production date, shelf life, and storage requirements.

[0087] The working principle and beneficial effects of the above technical solution are as follows: after extracting product information, analyze the product information and extract key fields in the product information; extract product information items containing key fields in the product information, classify them according to the information type corresponding to each key field, and fill in the preset product information form accordingly; determine the storage-related information in the product information form; wherein the storage-related information includes the production date, shelf life, and storage requirements. Thus, the key information in the product information can be classified and extracted, which is convenient for identifying and using the product information.

[0088] In a preferred embodiment, if Figure 3 , according to the storage-related information of each product and based on the environmental information inside the vending machine, the storage status of the products inside the vending machine is determined, including:

[0089] Step S31, determining the production date and shelf life of the product based on the storage-related information of the product;

[0090] Step S32: obtaining current time information, and determining the remaining storage period corresponding to the product according to the production date and shelf life corresponding to the product;

[0091] Step S33, obtaining the environmental parameters inside the vending machine, and judging whether the product is in a standard storage environment according to the environmental parameter requirements corresponding to the relevant information stored corresponding to the product, to obtain a first judgment result;

[0092] Step S34, obtaining the product status at each location point inside the vending machine;

[0093] Step S35: Determine the storage status of the product inside the vending machine using the storage-related information corresponding to the product, the remaining storage period corresponding to the product, the environmental parameters inside the vending machine, the first judgment result, and the product presence status.

[0094] The working principle and beneficial effects of the above technical solution are as follows: when determining the storage status of the product inside the vending machine, the production date and shelf life corresponding to the product are determined based on the storage-related information of the product; the current time information is obtained, and the remaining storage period corresponding to the product is determined based on the production date and shelf life corresponding to the product; the environmental parameters inside the vending machine are obtained, and the product is judged whether it is in a standard storage environment based on the environmental parameter requirements corresponding to the storage-related information corresponding to the product, and a first judgment result is obtained; the product presence status at each position point inside the vending machine is obtained; the storage status of the product inside the vending machine is determined using the storage-related information corresponding to the product, the remaining storage period corresponding to the product, the environmental parameters inside the vending machine, the first judgment result, and the product presence status. Thus, the identification of the internal product presence status, the remaining storage period corresponding to the product, and the storage status of whether the storage environment is compliant is realized.

[0095] In a preferred embodiment, determining the storage status of the products inside the vending machine based on the storage-related information of each product and the environmental information inside the vending machine further includes:

[0096] Determine the quality variation coefficient corresponding to a product according to the storage related information corresponding to the product;

[0097] Acquiring environmental parameters inside the vending machine through sensors preset inside the vending machine; wherein the environmental parameters include light intensity, temperature and humidity;

[0098] Calculate the degree of deterioration of the product based on the corresponding quality variation coefficient and environmental parameters.

[0099] The working principle and beneficial effects of the above technical solution are as follows: the quality variation coefficient corresponding to a product is determined according to the stored relevant information corresponding to the product; the environmental parameters inside the vending machine are obtained through the sensor preset inside the vending machine; the environmental parameters include light intensity, temperature and humidity; the deterioration degree of the product is calculated according to the quality variation coefficient corresponding to the product and the environmental parameters. Thus, the deterioration degree of the internal product is predicted, which facilitates the replacement of products that are about to expire and deteriorate.

[0100] In a preferred embodiment, calculating the deterioration degree of the product according to the quality variation coefficient corresponding to the product and the environmental parameters includes:

[0101] Determine the shelf time of the product from the time it is put on the vending machine to the current time point, determine the environmental parameters obtained at all time points within the shelf time and establish an environmental parameter set;

[0102] Smoothing the data of the same data type in the environmental parameter set to obtain the data change curve corresponding to the data type;

[0103] According to the product information corresponding to the product, obtain the quality change coefficient and deterioration calculation formula preset by the company corresponding to the product;

[0104] Based on a preset deterioration calculation formula corresponding to the product, the deterioration degree of the product is calculated according to a plurality of data change curves and a preset quality change coefficient corresponding to the product.

[0105] The working principle and beneficial effects of the above technical solution are as follows: by determining the shelf time of the product from the time the product is put on the vending machine to the current time point, and determining the environmental parameters obtained at all time points within the shelf time and establishing an environmental parameter set; smoothing the data of the same data type in the environmental parameter set to obtain the data change curve corresponding to the data type; obtaining the quality change coefficient and deterioration calculation formula preset by the company corresponding to the product according to the product information corresponding to the product; based on the preset deterioration calculation formula corresponding to the product, according to multiple data change curves and the preset quality change coefficient corresponding to the product, the deterioration degree of the product is calculated. For food, the higher the temperature in the daily temperature environment, the faster the internal bacterial colony of the food reproduces, and the deterioration rate can be simulated by the traditional Arrhenius equation to simulate the effect of temperature on various reactions in food. One of the innovative points of the technical solution is that the degree of deterioration of the food can be obtained by performing an integral operation based on the temperature line on the number of internal bacterial colonies of the food under long-term conditions based on the Arrhenius equation. For example, a moon cake has a preset deterioration calculation formula corresponding to the moon cake:

[0106]

[0107] In the formula, B represents the deterioration rate, k ref Indicates that the food is preset at the reference temperature T ref The quality variation coefficient under food Indicates the preset activation energy of the food quality change, R is the molar gas constant equal to 8.314 J / (mol·K), and T is the measured temperature;

[0108] After obtaining the spoilage calculation formula, the degree of spoilage of the food is obtained by performing an integral operation based on the temperature data change curve:

[0109]

[0110] In the formula, C represents the degree of deterioration, T i Indicates the actual temperature measured at time i;

[0111] Among them, the degree of deterioration of the product from the production date to the shelf time can be predicted and calculated according to the temperature under the preset standard state;

[0112] The above technical solution realizes the prediction and calculation of the degree of product deterioration.

[0113] In a preferred embodiment, the method further includes determining whether the storage state of the product is abnormal by comparing the storage state of the product inside the vending machine at different times, including:

[0114] Determine the product image of the vacuum-packed product after it is put on the shelf based on the product information, and use it as the initial product image;

[0115] Acquire a product image of the vacuum-packaged product in a current state in real time, and compare the product image with the initial product image to determine a first matching degree between the images;

[0116] When the first matching degree is lower than a preset matching degree threshold, determining that the product image corresponding to the vacuum-packed product is abnormal;

[0117] After determining that the product image is abnormal, feature analysis is performed on the initial product image and an image feature set is established;

[0118] Based on the image feature set, feature matching is performed on the product image in the current state to determine whether the product in the current state has bulging bag phenomenon.

[0119] The working principle and beneficial effects of the above technical solution are as follows: by comparing the storage status of the products inside the vending machine at different times, determining whether the storage status of the product is abnormal, the specific steps include determining the product image of the vacuum-packed product after being put on the shelf according to the product information, and taking it as the initial product image; acquiring the product image of the vacuum-packed product in the current state in real time, and comparing the product image with the initial product image to determine the first matching degree between the images; when the first matching degree is lower than the preset matching degree threshold, determining that the product image corresponding to the vacuum-packed product is abnormal, thereby realizing a rapid self-check of the product storage status. It is worth noting that when the product at a certain position point is not in place, that is, when the product at the position point falls or is taken away for unloading, the product image abnormality detection of the product at the position point is not performed to avoid useless work; after determining that the product image is abnormal, feature analysis is performed on the initial product image and an image feature set is established, and the image feature set is used as the standard for the initial state feature of the product; feature matching is performed on the product image in the current state based on the image feature set to determine whether the product in the current state has a bulging bag phenomenon, and when the matching degree of the feature matching is lower than the preset second matching degree threshold, it indicates whether the product in the current state has a damaged or bulging bag phenomenon.

[0120] In a preferred embodiment, after determining that the product image is abnormal, performing feature analysis on the initial product image and establishing an image feature set includes:

[0121] Performing image grayscale processing on the initial product image to obtain a grayscale image;

[0122] The texture description of the grayscale image is performed based on the grayscale histogram characteristics, and four texture measurements of the grayscale histogram are obtained as the image feature set of the product image; among them, the texture measurements include smoothness, standard deviation, consistency and average entropy value measurement.

[0123] The working principle and beneficial effects of the above technical solution are as follows: after determining that the product image is abnormal, feature analysis is performed on the initial product image and an image feature set is established, including: feature extraction of the vacuum-packed product through texture recognition based on the grayscale co-occurrence matrix and establishing an image feature set, specifically including grayscale processing of the initial product image and establishing a statistical moment of the grayscale image, for example, let z be a random variable representing a grayscale set, and let P(z i ), i = 0, 1, 2…, H-1, is the corresponding histogram, where H is the number of distinguishable gray levels, then the nth order moment with gray mean m about z is:

[0124]

[0125] Four texture brightness based on the grayscale histogram are selected for analysis, namely smoothness, standard deviation, consistency and average entropy value measurement, so as to obtain the texture measurement corresponding to the initial product image and establish an image feature set for it. Due to the particularity of vacuum-packed products, the texture on the packaged products after vacuum extraction is more complex and has stronger characteristics, while the surface of the vacuum packaging bag after expansion or packaging damage is relatively simpler without too many lines, resulting in a large difference in the histogram and texture measurement between the two, which can be easily distinguished, and the calculation process is relatively simple, without wasting too much computing resources.

[0126] To achieve the above objectives, an embodiment of the present invention further discloses a product storage status detection system for a vending machine, comprising:

[0127] A product information acquisition module, used to acquire product information of internal products through a camera preset inside the vending machine;

[0128] A storage information acquisition module, used to determine the storage-related information of each product according to the product information;

[0129] The storage status analysis module is used to determine the storage status of the products inside the vending machine based on the storage-related information of each product and the environmental information inside the vending machine.

[0130] The working principle and beneficial effects of the above technical solution are as follows: the product information acquisition module obtains the product information of the internal products through the camera preset inside the vending machine, wherein the camera can be set at multiple positions inside the vending machine to realize multi-angle viewing of the internal products, thereby ensuring that the special mark image of the product can be successfully obtained, and the relevant information of the product can be determined by analyzing the special mark image. For most cases, the products placed must be regular, so it is sufficient to set one camera at the front and back of the vending machine. The image obtained by the camera can also be used to determine the status of each product in place, and the manufacturer of the product, the production date of the product, the shelf life, the product ingredients, the energy content, the product specifications and the product number and other related information can be determined in the product information, and this information can be presented on the vending operation panel of the vending machine for users to selectively view, thereby improving the customer's experience. The storage information acquisition module determines the storage related information of each product according to the product information, including the production date, shelf life, storage environment requirements and other related information of the product. The storage status analysis module determines the storage status of the products inside the vending machine based on the storage-related information of each product and the environmental information inside the vending machine. For example, it determines whether the product has expired based on the storage-related information and the current time, and determines whether the product is in a reasonable storage environment based on the storage environment requirements and the environmental information inside the vending machine (temperature, humidity and light). When the storage environment is poor, it reminds the staff to take actions to improve the storage environment. The above methods finally realize the real-time detection of the storage status of the products inside the vending machine.

[0131] Obviously, those skilled in the art can make various changes and modifications to the present invention without departing from the spirit and scope of the present invention. Thus, if these modifications and variations of the present invention fall within the scope of the claims of the present invention and their equivalents, the present invention is also intended to include these modifications and variations.

Claims

1. A method for detecting the storage status of products in a vending machine, characterized in that: include: Obtain product information of internal products through a camera preset inside the vending machine; Determine storage-related information for each product based on product information; Determining the storage status of the products inside the vending machine based on the storage-related information of each product and the environmental information inside the vending machine; The step of determining the storage status of the products inside the vending machine based on the storage-related information of each product and the environment information inside the vending machine further includes: Determine the quality variation coefficient corresponding to a product according to the storage related information corresponding to the product; Acquiring environmental parameters inside the vending machine through sensors preset inside the vending machine; wherein the environmental parameters include light intensity, temperature and humidity; Calculate the deterioration degree of the product according to the quality variation coefficient corresponding to the product and the environmental parameters; Calculating the deterioration degree of the product according to the quality variation coefficient corresponding to the product and the environmental parameters includes: Determine the shelf time of the product from the time it is put on the vending machine to the current time point, determine the environmental parameters obtained at all time points within the shelf time and establish an environmental parameter set; Smoothing the data of the same data type in the environmental parameter set to obtain the data change curve corresponding to the data type; Obtaining a preset quality change coefficient and a deterioration calculation formula corresponding to the product according to the product information corresponding to the product; The formula for calculating the deterioration is: In the formula, represents the rate of deterioration, Indicates that the product is preset at the reference temperature The quality variation coefficient under Indicates the activation energy of the preset quality change of the product, The molar gas constant is equal to 8.314 J / (mol·K), is the measured temperature; Based on the deterioration calculation formula corresponding to the product, according to multiple data change curves and the preset quality change coefficient corresponding to the product, the deterioration degree of the product is calculated, including: After obtaining the deterioration calculation formula, the deterioration degree of the product is obtained by performing integral calculation based on the temperature data change curve: In the formula, Indicates the degree of deterioration. Indicates the actual temperature measured at time i; The determining the storage status of the products inside the vending machine based on the storage-related information of each product and the environment information inside the vending machine includes: Determine the production date and shelf life of the product based on the storage related information of the product; Obtain current time information, and determine the remaining storage period of the product based on the production date and shelf life of the product; Obtaining the environmental parameters inside the vending machine, and judging whether the product is in a standard storage environment according to the environmental parameter requirements corresponding to the relevant information stored corresponding to the product, to obtain a first judgment result; Obtain the product status at each location inside the vending machine; The storage status of the product inside the vending machine is determined using the storage related information corresponding to the product, the remaining storage period corresponding to the product, the environmental parameters inside the vending machine, the first judgment result, and the product presence status.

2. A method for detecting storage status of products in a vending machine according to claim 1, characterized in that: The method of obtaining product information of internal products through a camera preset inside the vending machine includes: The first type of video is obtained by shooting the shelf position through a camera preset inside the vending machine; Identify the first type of video and determine the product image corresponding to the displayed product; Performing feature recognition on the product image to determine the product identification in the product image; wherein the product identification includes a barcode or a QR code; The product identification is feature extracted and decoded, and the product information corresponding to the product is searched and extracted based on the decoded information.

3. A method for detecting storage status of products in a vending machine according to claim 2, characterized in that: The identifying the first type of video to determine the product image corresponding to the displayed product includes: Performing frame processing on the first type of video, and determining the status of products at various locations in the vending machine based on the framed images; Determine the result of loading and unloading actions of products according to the status of products at various positions in the vending machine; According to the judgment result, when a loading action occurs for a product at a certain position, a frame image after the loading action is completed is acquired, and a product image corresponding to the product at the position in the frame image is intercepted.

4. A method for detecting storage status of products in a vending machine according to claim 3, characterized in that: Also includes: According to the judgment result, when a product at a certain position point is loaded with goods, a product management information set corresponding to the position point is established, and a product image corresponding to the product at the position point and an analysis result of the product image are stored together in the product management information set corresponding to the position point; According to the judgment result, when a product at a certain location point has a product unloading action, the product management information set corresponding to the location point is deleted; A management database of the vending machine is generated by using a plurality of product management information sets stored in the vending machine.

5. A method for detecting storage status of products in a vending machine according to claim 1, characterized in that: Determining storage related information of each product according to product information includes: Analyze the product information and extract key fields in the product information; Extract product information items containing key fields from product information, classify them according to the information type corresponding to each key field, and fill them into the preset product information table accordingly; Determine the storage-related information in the product information table; wherein the storage-related information includes the production date, shelf life, and storage requirements.

6. A method for detecting storage status of products in a vending machine according to claim 1, characterized in that: The method also includes determining whether the storage status of the product is abnormal by comparing the storage status of the product inside the vending machine at different times, including: Determine the product image of the vacuum-packed product after it is put on the shelf based on the product information, and use it as the initial product image; Acquire a product image of the vacuum-packaged product in a current state in real time, and compare the product image with the initial product image to determine a first matching degree between the images; When the first matching degree is lower than a preset matching degree threshold, determining that the product image corresponding to the vacuum-packed product is abnormal; After determining that the product image is abnormal, feature analysis is performed on the initial product image and an image feature set is established; Perform feature matching on the product image in the current state based on the image feature set to determine whether the product in the current state has bulging bag phenomenon; After determining that the product image is abnormal, performing feature analysis on the initial product image and establishing an image feature set includes: Performing image grayscale processing on the initial product image to obtain a grayscale image; The texture description of the grayscale image is performed based on the grayscale histogram characteristics, and four texture measurements of the grayscale histogram are obtained as the image feature set of the product image; wherein the texture measurements include smoothness, standard deviation, consistency and average entropy value measurement.

7. A vending machine product storage status detection system, characterized in that: include: A product information acquisition module, used to acquire product information of internal products through a camera preset inside the vending machine; A storage information acquisition module, used to determine the storage-related information of each product according to the product information; A storage status analysis module, used to determine the storage status of the products inside the vending machine based on the storage-related information of each product and the environmental information inside the vending machine; The storage status analysis module is used to determine the storage status of products inside the vending machine based on the storage-related information of each product and the environmental information inside the vending machine, and further includes: Determine the quality variation coefficient corresponding to a product according to the storage related information corresponding to the product; Acquiring environmental parameters inside the vending machine through sensors preset inside the vending machine; wherein the environmental parameters include light intensity, temperature and humidity; Calculate the deterioration degree of the product according to the quality variation coefficient corresponding to the product and the environmental parameters; Calculating the deterioration degree of the product according to the quality variation coefficient corresponding to the product and the environmental parameters includes: Determine the shelf time of the product from the time it is put on the vending machine to the current time point, determine the environmental parameters obtained at all time points within the shelf time and establish an environmental parameter set; Smoothing the data of the same data type in the environmental parameter set to obtain the data change curve corresponding to the data type; Obtaining a preset quality change coefficient and a deterioration calculation formula corresponding to the product according to the product information corresponding to the product; The formula for calculating the deterioration is: In the formula, represents the rate of deterioration, Indicates that the product is preset at the reference temperature The quality variation coefficient under Indicates the activation energy of the preset quality change of the product, The molar gas constant is equal to 8.314 J / (mol·K), is the measured temperature; Based on the deterioration calculation formula corresponding to the product, according to multiple data change curves and the preset quality change coefficient corresponding to the product, the deterioration degree of the product is calculated, including: After obtaining the deterioration calculation formula, the deterioration degree of the product is obtained by performing integral calculation based on the temperature data change curve: In the formula, Indicates the degree of deterioration. Indicates the actual temperature measured at time i; The determining the storage status of the products inside the vending machine based on the storage-related information of each product and the environment information inside the vending machine includes: Determine the production date and shelf life of the product based on the storage related information of the product; Obtain current time information, and determine the remaining storage period of the product based on the production date and shelf life of the product; Obtaining the environmental parameters inside the vending machine, and judging whether the product is in a standard storage environment according to the environmental parameter requirements corresponding to the relevant information stored corresponding to the product, to obtain a first judgment result; Obtain the product status at each location inside the vending machine; The storage status of the product inside the vending machine is determined using the storage related information corresponding to the product, the remaining storage period corresponding to the product, the environmental parameters inside the vending machine, the first judgment result, and the product presence status.

Images