Fresh food retail unmanned payment cashier system and method based on image recognition technology

Abstract

The invention discloses a fresh retail unmanned payment cashier system and method based on an image recognition technology, and the system employs a refrigeration control module, a cashier settlement module and a freshness judgment module for work, and the refrigeration control module is electrically connected with the cashier settlement module. The system is characterized in that the refrigeration control module is used for controlling the refrigeration effect of each piece of pork, the cashier settlement module is used for carrying out targeted cashier strategy adjustment according to the meat decay acceleration condition of the pork, and the freshness judgment module is used for judging the freshness of the pork through multispectral imaging. The refrigeration control module comprises a flow control valve, a temperature control unit and a cold air supply end, and the cashier settlement module comprises a fresh food shooting unit, a fresh food recognition module, a high temperature estimation module, a timing unit, a value evaluation module and a network payment module.

Description

Technical Field

[0001] The present invention relates to the technical field of cash register systems, and particularly to a fresh food retail unmanned payment cash register system and method based on image recognition technology. Background Art

[0002] In the freezers of fresh food supermarkets, various kinds of meats are placed for sale. Each type of food has a relatively safe storage temperature. At this temperature, the food has a long shelf life and retains the best nutrition and taste. For example, meats are most suitable at -18°C, while fish do not easily spoil at -3°C.

[0003] Many consumers like to take out fresh food and observe it carefully before putting it back into the freezer when selecting fresh food. If multiple consumers repeatedly take out the fresh food at different times, it will cause the phenomenon of accelerated spoilage, making the fresh food look unappetizing. If the previous pricing strategy is still adopted, it may result in the backlog of this fresh food.

[0004] During the storage process, fresh food gradually consumes and decomposes, generating a series of chemical substances, including ammonia, hydrogen sulfide, ketones, and aldehydes. The spectral refractive indices of these gases are different. Now, there is a technology of infrared multi-spectral imaging for detecting the spoilage of meats. However, this detection method has not been involved in the way of meat pricing. Therefore, it is necessary to design a fresh food retail unmanned payment cash register system and method with flexible pricing based on image recognition technology. Summary of the Invention

[0005] The purpose of the present invention is to provide a fresh food retail unmanned payment cash register system and method based on image recognition technology to solve the problems raised in the above background art.

[0006] To solve the above technical problems, the present invention provides the following technical solutions: A fresh food retail unmanned payment cash register system and method based on image recognition technology, which works by using a refrigeration control module, a cash register settlement module, and a freshness determination module. The refrigeration control module is electrically connected to the cash register settlement module, and is characterized in that: the refrigeration control module is used to control the refrigeration effect of each piece of pork; the cash register settlement module is used to adjust the targeted cash register strategy according to the accelerated spoilage of the pork quality; the freshness determination module is used to determine the freshness of the pork through multi-spectral imaging and give instructions for refrigeration at different cold air temperatures.

[0007] According to the above technical solution, the refrigeration control module includes a flow control valve, a temperature control unit, and a cold air supply end. The cashier settlement module includes a fresh food photographing unit, a fresh food identification module, a high-temperature estimation module, a timing unit, a value evaluation module, and an online payment module. The freshness determination module includes a multispectral imaging detection module, a detection switching module, and an air absorption tube. The flow control valve is connected to the cold air supply end. The detection switching module is installed in the air absorption tube. The timing unit is electrically connected to the high-temperature estimation module. The multispectral imaging detection module is electrically connected to the detection switching module; The cold air supply end is used to provide ejected low-temperature cold air to refrigerate the fresh food. The flow control valve is used to adjust the cold air flow ejected onto the fresh food. The temperature control unit is used to control the temperature of the cold air according to the type of pork; The fresh food photographing unit is used to photograph images of each piece of pork. The fresh food identification module is used to judge the type of pork according to the detected images of the pork. The high-temperature estimation module is used to estimate the meat spoilage situation according to the time when each piece of fresh food is taken out of the freezer. The timing unit is used to calculate the duration of the fresh food taken out of the freezer. The value evaluation module is used to adjust the purchase price of the current fresh food. The online payment module is used for customers to settle the online purchase price of the fresh food; The multispectral imaging detection module is used to perform multispectral imaging detection based on the gas emitted from the surface of the pork to judge the spoilage degree of the pork. The detection switching module is used to switch the types of fresh food to be detected. The air absorption tube is used to absorb the air on the surface of the fresh food placed in the current area.

[0008] According to the above technical solution, the operation method of the cashier system includes the following steps: S0. Establish a fresh food type recognition database, input images of various types of pork, start the fresh food photographing unit to photograph whether there is fresh food placed at the current position in the freezer, and identify the type of pork; S1. After placing new fresh food in a certain freezer, install the cold air supply end on the freezer, use the air absorption tube to absorb the gas on the surface of the fresh food at the current placement position, monitor the air on the surface of each piece of pork through the multispectral imaging detection module to calculate the spoilage degree information, and determine which piece of pork's gas to detect by adjusting the connection mode of the detection switching module, and record the gas reflectivity of the pork for recording; S2. When a piece of fresh food is taken out by a customer for viewing, calculate the duration after the fresh food is taken out of the field of view through the timing unit, record the time when the fresh food is taken out, until the fresh food is put back into the freezer, and record the time when it is put into the freezer at this time. If the customer starts to purchase without putting it back into the freezer, stop timing; S3. Calculate the high-temperature loss value B of the pork due to high temperature according to the cumulative time when the fresh produce is taken out of the freezer, and adjust the unit price of the pork. When a customer makes a purchase, after weighing, charge according to the unit price multiplied by the weight, and use the network payment module for cash register settlement. S4. Connect the cold air supply end to refrigerate the fresh produce. Query and determine the refrigeration temperature of the fresh produce during refrigeration, upload this data to the temperature control unit, adjust the cold air temperature of the cold air supply end, and determine the opening and closing conditions of the flow control valve to adjust which fresh produce is supplied with cold air of which temperature.

[0009] According to the above technical solution, the specific working process of the fresh produce photographing unit in the above step S1 includes the following steps: S1-1. After the fresh produce is placed and enters the frozen state, the fresh produce photographing unit monitors the image information of each piece of pork and uploads the image data to the fresh produce identification module to qualitatively determine the type of pork. S1-2. By controlling whether different detection switching modules work or not, perform infrared image detection on the initial surface gas reflectivity of each piece of pork, denoted as , where the reflectivity value decreases as the storage time increases. S1-3. Calculate the current surface gas reflectivity of each fresh produce at fixed time intervals, denoted as , and their respective meat quality decay acceleration values .

[0010] According to the above technical solution, in the above step S1-2, the air detection switching method of the detection switching module is specifically as follows: The detection switching module is divided into different solenoid valves . The solenoid valves are set at the ends of the air absorption pipes at the fresh produce placement positions. When it is necessary to detect the surface air of a certain piece of pork, open the other solenoid valves and start the vacuum pump at the other end of the air absorption pipe, and the air absorption pipe of the pork to be measured is connected to the multi-spectral imaging detection module. At this time, the reading of the multi-spectral imaging detection module is the gas reflectivity of the surface of the fresh produce to be measured.

[0011] According to the above technical solution, the specific working process in the above step S3 includes the following steps: B3-1. When the fresh produce starts to be taken out for viewing, use the fresh produce photographing unit to detect whether it is within the field of view, determine which fresh produce is taken out and which is not, and use the timing unit to record the total storage time of the fresh produce , as long as there is fresh produce stored in the freezer and not purchased, it is included in the total time ; B3-2. The timing module records the time when the pork is taken out by each customer to check the fresh quality, that is, the actual time when each fresh product is taken out of the freezer when the fresh product is in a high-temperature state. , ; B3-3. The high-temperature estimation module estimates the high-temperature loss value of the pork due to the use of the fresh product based on the time when each fresh product is taken out of the freezer. , specifically: ; where α is the meat quality loss speed coefficient of the pork when stored in the freezer, and β is the meat quality loss speed coefficient of the pork when taken out of the freezer for inspection.

[0012] According to the above technical solution, the unit price of the fresh product in step S3 above The specific definition method is: as the amplitude of the acceleration of meat quality decay increases, and the loss degree of the fresh product when taken out of the freezer and in a high-temperature state increases, both will cause the unit price of the pork to decrease in direct proportion, that is , where is the initial unit price of the pork, that is, the unit price of the fresh product just put into the freezer. The initial unit price of each pork is determined according to the market price of this kind of pork. is the price adjustment coefficient, which is determined according to the actual application situation.

[0013] According to the above technical solution, in step S4 above, the working method of the flow control valve is specifically as follows: B4-1. When starting to refrigerate, sort according to the calculated refrigeration temperature of the pork. The fresher products that require a lower storage temperature are refrigerated at a lower temperature. B4-2. The timing unit triggers different flow control valves at fixed time intervals and turns them on in sequence according to the priority. When the flow control valve connected to a certain fresh product is turned on, other flow control valves are closed, and refrigeration is carried out in this way repeatedly. B4-3. When the fresh product shooting unit detects that a certain type of fresh product is repeatedly taken out by customers, the higher the frequency of taking out, the lower the current refrigeration temperature of the pork. When the fresh product decay acceleration value increases, the current refrigeration temperature of the pork is also lowered, thereby reducing the decay speed of the pork.

[0014] Compared with the prior art, the beneficial effects achieved by the present invention are: The present invention takes real-time pictures of the fresh products in the freezer, judges the time when the fresh products are taken out of the freezer, estimates the high-temperature decay degree of the pork, and at the same time detects the infrared image reflectivity of the gas on the surface of the fresh product to calculate its decay degree, so as to adjust the settlement price, so that fresh products with different freshness levels can have reasonable pricing, protecting the rights and interests of consumers and promoting the sales volume of pork. BRIEF DESCRIPTION OF THE DRAWINGS

[0015] The accompanying drawings are used to provide a further understanding of the present invention and constitute a part of the specification. Together with the embodiments of the present invention, they are used to explain the present invention and do not constitute a limitation of the present invention. In the accompanying drawings: Figure 1 It is a schematic diagram of the principle of the present invention; Figure 2 It is a schematic diagram of the overall module structure of the present invention. DETAILED DESCRIPTION

[0016] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0017] See also Figure 1 and Figure 2 The present invention provides a technical solution: an unmanned payment cashier system and method for fresh food retail based on image recognition technology, which uses a refrigeration control module, a cashier settlement module and a freshness determination module to work, and the refrigeration control module is electrically connected to the cashier settlement module, and is characterized in that: the refrigeration control module is used to control the refrigeration effect of each piece of pork, the cashier settlement module is used to adjust the cashier strategy in a targeted manner according to the accelerated decay of the pork, and the freshness determination module is used to determine the freshness of the pork through multi-spectral imaging, and give instructions for refrigeration at different cold air temperatures; The refrigeration control module includes a flow control valve, a temperature control unit and a cold air supply end; the cashier settlement module includes a fresh food shooting unit, a fresh food identification module, a high temperature estimation module, a timing unit, a value assessment module, and an online payment module; the freshness determination module includes a multi-spectral imaging detection module, a detection switching module, and an air absorption tube; the flow control valve is connected to the cold air supply end, the detection switching module is installed in the air absorption tube, the timing unit is electrically connected to the high temperature estimation module, and the multi-spectral imaging detection module is electrically connected to the detection switching module; The cold air supply end is used to provide low-temperature cold air for cooling the fresh food, the flow control valve is used to adjust the flow of cold air sprayed to the fresh food, and the temperature control unit is used to control the temperature of the cold air according to the type of pork; The fresh food shooting unit is used to shoot images of each piece of pork. The fresh food recognition module is used to judge the type of pork according to the detected images of the pork. The high-temperature estimation module is used to estimate the meat spoilage situation according to the time when each fresh food is taken out of the freezer. The timing unit is used to calculate the duration that the fresh food is taken out of the freezer. The value evaluation module is used to adjust the purchase price of the current fresh food. The online payment module is used for customers to settle the online purchase price of the fresh food; The multispectral imaging detection module is used to perform multispectral imaging detection based on the gas emitted from the surface of the pork to judge the spoilage degree of the pork. The detection switching module is used to switch the types of fresh food to be detected. The air absorption tube is used to absorb the air on the surface of the fresh food placed in the current area; The operation method of this cash register system includes the following steps: S0. Establish a fresh food type recognition database, and input the images of various pork. Start the fresh food shooting unit to shoot whether there is fresh food placed at the current position in the freezer, and identify the type of pork; S1. After new fresh food is put into a certain freezer, install the cold air supply end on the freezer. Use the air absorption tube to absorb the gas on the surface of the fresh food at the current placement position. Monitor the air on the surface of each piece of pork through the multispectral imaging detection module to calculate the spoilage degree information, and determine which pork's gas to detect by adjusting the connection mode of the detection switching module. Record the gas reflectivity of the pork ; S2. When a piece of fresh food is taken out by a customer for viewing, calculate the duration after the fresh food is taken out of the field of view through the timing unit, record the time when the fresh food is taken out, until the fresh food is put back into the freezer again. At this time, record the time when it is put into the freezer. If the customer starts to buy without putting it back into the freezer, stop timing; S3. Calculate the high-temperature loss value B of the pork due to high temperature according to the cumulative time when the fresh food is taken out of the freezer, and adjust the unit price of the pork ; When a customer makes a purchase, after weighing, charge according to the unit price multiplied by the weight, and use the online payment module for cash register settlement; S4. Connect the cold air supply end to cool the fresh food. Query and determine the cooling temperature of the fresh food during cooling, and upload these data to the temperature control unit. Adjust the cold air temperature of the cold air supply end, and determine the opening and closing conditions of the flow control valve to adjust which fresh food to supply with which temperature of cold air; The specific working process of the fresh food shooting unit in the above step S1 includes the following steps: S1-1. After the fresh food is placed and enters the frozen state, the fresh food shooting unit monitors the image information of each piece of pork, and uploads the image data to the fresh food recognition module to qualitatively determine the type of pork; S1-2. Infrared image detection is carried out on the initial reflectance of the surface gas of each piece of pork by controlling whether different detection switching modules work or not, denoted as , where the reflectance value decreases as the storage time increases; S1-3. Calculate the surface gas reflectance of each piece of fresh produce at fixed time intervals, denoted as , and the respective meat decay acceleration value ; In the above step S1-2, the air detection switching method of the detection switching module is specifically as follows: The detection switching module is divided into different solenoid valves . The solenoid valves are set at the ends of the air absorption pipes at the positions where the fresh produce is placed. When it is necessary to detect the surface air of a certain piece of pork, other solenoid valves are opened, and the vacuum pump at the other end of the air absorption pipe is started. The air absorption pipe of the pork to be measured is connected to the multi-spectral imaging detection module. At this time, the reading of the multi-spectral imaging detection module is the gas reflectance of the surface of the fresh produce to be measured; The specific working process in the above step S3 includes the following steps: B3-1. When the fresh produce starts to be taken out for inspection, use the fresh produce shooting unit to detect whether it is within the field of view, determine which fresh produce is taken out and which is not, and use the timing unit to record the total storage time of the fresh produce . As long as there is fresh produce stored in the freezer and not purchased, it is included in the total time ; B3-2. The timing module records the time when each customer takes out the fresh produce to check the quality, that is, the actual time when each fresh produce is taken out of the freezer when the fresh produce is in a high-temperature state , ; B3-3. The high-temperature estimation module estimates the high-temperature loss value of the fresh produce used for the pork according to the time when each fresh produce is taken out of the freezer , specifically as follows: ; where α is the meat loss speed coefficient of the pork when stored in the freezer, and β is the meat loss speed coefficient of the pork when taken out of the freezer for inspection; The specific definition method of the unit price of the fresh produce in the above step S3 is as follows: As the amplitude of the meat decay acceleration increases and the loss degree of the fresh produce when taken out of the freezer and in a high-temperature state increases, the unit price of the pork will decrease proportionally, that is , where is the initial unit price of the pork, that is, the unit price of the fresh produce just put into the freezer. The initial unit price of each piece of pork is determined according to the market price of this kind of pork, is the price adjustment coefficient, which is determined according to the actual application situation; In the above step S4, the working method of the flow control valve is specifically as follows: B4-1. When starting refrigeration, sort the pork according to the calculated refrigeration temperature. The fresher the product that requires a lower storage temperature, the lower the temperature for refrigeration. B4-2. The timing unit triggers different flow control valves at fixed time intervals and turns them on in sequence according to the priority. When the flow control valve connected to a certain fresh product is turned on, the other flow control valves are closed, and refrigeration is carried out in this way repeatedly; B4-3. When the fresh product shooting unit detects that a certain type of fresh product is repeatedly taken out by customers, the higher the frequency of taking out, the lower the current refrigeration temperature of the pork. When the fresh product decay acceleration value increases, the current refrigeration temperature of the pork is also lowered, thereby reducing the decay speed of the pork.

[0018] It should be noted that in this article, relational terms such as first and second are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any actual relationship or order between these entities or operations. Moreover, the term "comprising", "including" or any other variant thereof is intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements not only includes those elements, but also includes other elements not expressly listed, or also includes elements inherent to such process, method, article or device.

[0019] Finally, it should be noted that the above are only the preferred embodiments of the present invention and are not used to limit the present invention. Although the present invention has been described in detail with reference to the foregoing embodiments, those skilled in the art can still modify the technical solutions described in the foregoing embodiments, or perform equivalent replacements for some of the technical features. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present invention shall be included within the protection scope of the present invention.

Claims

1. An unattended payment cashier system for fresh food retail based on image recognition technology, characterized in that: It works by using a refrigeration control module, a cash register settlement module, and a freshness determination module. The refrigeration control module is electrically connected to the cash register settlement module. The refrigeration control module is used to control the refrigeration effect of each fresh food. The cash register settlement module is used to adjust the targeted cash register strategy according to the accelerated meat spoilage situation of the fresh food. The freshness determination module is used to determine the freshness of the fresh food through multispectral imaging and give instructions for refrigeration at different cold air temperatures.

2. The fresh food retail unmanned payment cashier system based on image recognition technology according to claim 1, characterized in that: The refrigeration control module includes a flow control valve, a temperature control unit, and a cold air supply end. The cash register settlement module includes a fresh food photographing unit, a fresh food identification module, a high temperature estimation module, a timing unit, a value evaluation module, and an online payment module. The freshness determination module includes a multispectral imaging detection module, a detection switching module, and an air absorption tube. The flow control valve is connected to the cold air supply end. The detection switching module is installed in the air absorption tube. The timing unit is electrically connected to the high temperature estimation module. The multispectral imaging detection module is electrically connected to the detection switching module; The cold air supply end is used to provide the fresh food with ejected low-temperature cold air for refrigeration. The flow control valve is used to adjust the cold air flow ejected onto the fresh food. The temperature control unit is used to control the temperature of the cold air according to the type of fresh food; The fresh food photographing unit is used to photograph the images of each fresh food. The fresh food identification module is used to judge the type of fresh food according to the detected images of the fresh food. The high temperature estimation module is used to estimate the meat spoilage situation according to the time when each fresh food is taken out of the freezer. The timing unit is used to calculate the duration of the fresh food taken out of the freezer. The value evaluation module is used to adjust the purchase price of the current fresh food. The online payment module is used for customers to settle the online purchase price of the fresh food; The multispectral imaging detection module is used to perform multispectral imaging detection based on the gas emitted from the surface of the fresh food to judge the spoilage degree of the fresh food. The detection switching module is used to switch the types of fresh food to be detected. The air absorption tube is used to absorb the air on the surface of the fresh food placed in the current area.

3. The fresh food retail unmanned payment cashier system based on image recognition technology according to claim 2, characterized in that: The operation method of this cash register system includes the following steps: S0. Establish a fresh food type recognition database, input the images of various fresh foods, start the fresh food photographing unit to photograph whether there is fresh food placed at the current position in the freezer, and identify the type of fresh food; S1. After placing new fresh produce in a certain freezer, install the cold air supply end on the freezer. Use the air absorption tube to absorb the surface gas of the fresh produce at the current placement position. Calculate the degree of spoilage information by monitoring the surface air of each piece of fresh produce through the multi-spectral imaging detection module. And determine which fresh produce's gas to detect by adjusting the connection method of the detection switching module, and record the gas reflectivity of the fresh produce for recording; S2. When a fresh food is taken out by a customer for viewing, the timing unit calculates the duration after the fresh food is taken out of the field of view, records the time when the fresh food is taken out, until the fresh food is put back into the freezer, and at this time records the time when it is put into the freezer. If the customer starts to buy without putting it back into the freezer, the timing stops; S3. Calculate the high-temperature loss value B of the fresh produce due to high temperature based on the cumulative time when the fresh produce is taken out of the freezer, and adjust the unit price of the fresh produce. When a customer makes a purchase, after weighing, charge according to the unit price multiplied by the weight, and use the online payment module for cash register settlement. S4. The cold air supply end is turned on to refrigerate the fresh food, query and determine the refrigeration temperature of the fresh food during refrigeration, upload these data to the temperature control unit, adjust the cold air temperature of the cold air supply end, and determine the opening and closing conditions of the flow control valve to adjust which fresh food is supplied with which temperature of cold air.

4. The fresh food retail unmanned payment cashier system based on image recognition technology according to claim 3, characterized in that: The specific working process of the fresh food photographing unit in step S1 above includes the following steps: S1-1. After the fresh produce is placed, when the fresh produce enters the frozen state, the fresh produce imaging unit monitors the image information of each piece of fresh produce and uploads the image data to the fresh produce recognition module to identify the type of fresh produce. S1-2. Infrared image detection is carried out on the initial surface gas reflectivity of each fresh product by controlling whether different detection switching modules work or not, denoted as , where the reflectivity value decreases with the increase of storage time; S1-3. Calculate the current surface gas reflectivity of each fresh produce at fixed time intervals, denoted as , and their respective meat rot acceleration values .

5. The fresh food retail unmanned payment cashier system based on image recognition technology according to claim 4, characterized in that: In the above step S1-2, the air detection and switching method of the detection switching module is specifically as follows: The detection switching module is divided into different solenoid valves , and the solenoid valves are set at the ends of the air absorption tubes at the fresh food placement positions. When it is necessary to detect the surface air of a certain fresh food, other solenoid valves are opened, and the vacuum pump at the other end of the air absorption tube is started. The air absorption tube of the fresh food to be measured is connected to the multi-spectral imaging detection module. At this time, the reading of the multi-spectral imaging detection module is the gas reflectance on the surface of the fresh food to be measured.

6. The fresh food retail unmanned payment cashier system based on image recognition technology according to claim 5, characterized in that: The specific working process in step S3 above includes the following steps: B3-1. When fresh produce starts to be taken out for inspection, use the fresh produce imaging unit to detect whether it is within the field of view, determine which fresh produce has been taken out and which has not, and use the timing unit to record the total storage time of the fresh produce , as long as any fresh produce is stored in the freezer and not purchased, it is included in the total time ; B3-2. The timing module records the time when the fresh food is taken out by each customer to check its quality, that is, the actual time when each fresh food is taken out of the freezer when the fresh food is in a high-temperature state. , ; B3-3. The high-temperature estimation module estimates the high-temperature loss value of fresh produce due to its use based on the time when each piece of fresh produce is taken out of the freezer. , specifically: ； Among them, α is the meat loss rate coefficient of fresh produce when stored in the storage freezer, and β is the meat loss rate coefficient of fresh produce when taken out of the freezer for inspection.

7. The fresh food retail unmanned payment cashier system based on image recognition technology according to claim 6, characterized in that: The fresh food unit price in the above step S3 The specific definition method is as follows: As the rate of acceleration of meat decay increases and the loss degree of fresh food when taken out of the freezer at high temperature increases, the unit price of fresh food will decrease in direct proportion, that is ， wherein is the initial unit price of the fresh produce, that is, the unit price of the fresh produce just put into the freezer. The initial unit price of each fresh produce is determined according to the market price of this kind of fresh produce. is the price adjustment coefficient, which is determined according to the actual application situation.

8. The unmanned payment cashier system for fresh food retail based on image recognition technology according to claim 7, characterized in that: In step S4 above, the working method of the flow control valve is specifically as follows: B4-1. When starting refrigeration, sort according to the calculated refrigeration temperature of the fresh produce, and the fresh produce that requires a lower storage temperature is refrigerated at a lower temperature.

Images