Control method and system of refrigeration equipment
By installing a camera on the inside of the display refrigerator door to identify and update the prices of goods on the shelves, the problem of difficulty in dynamic identification and update of freezers in the existing technology has been solved, and the user's shopping experience has been improved.
Patent Information
- Application Number
- CN202510152143.2
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2025-02-12
- Publication Date
- 2025-05-30
- Estimated Expiration
- 2045-02-12
AI Technical Summary
In the prior art, it is difficult to realize dynamic identification and price update of goods on the shelves, resulting in poor shopping experience for users, and traditional price brands are prone to misjudgment.
By installing a camera on the inside of the refrigerator cabinet door, the image information captured by the camera when the cabinet door is opened can be used to identify the goods and signs on the shelves, and the content of the signs is dynamically updated according to the position relationship.
It realizes dynamic identification and price update of products on the shelves, optimizes users' shopping experience, and reduces the possibility of users' misjudgment.
Smart Images

Figure CN120071507A_ABST
Abstract
Description
Technical Field
[0001] This application relates to image processing and refrigeration equipment, in particular to a control method and system for a refrigeration equipment. Background Art
[0002] In the prior art, display freezers are usually designed with transparent glass cabinet doors, so that users can observe the internal goods through the glass doors, thereby improving the visual experience of users when purchasing. When these devices are applied to the unmanned retail business, a sensor recognition and settlement solution is usually adopted. For example, commonly, users are required to unlock the cabinet door of the display freezer by scanning a code and authorizing a pay-later method. Then, the process of the user's selection is photographed by, for example, a camera, so as to determine the goods selected by the user and automatically complete the deduction and settlement.
[0003] However, in the above solution, considering the equipment size and installation problems, many cabinets do not install small screens. Therefore, for users, they can only understand the price by the traditional price tags inside the cabinet or by viewing the product price on the mobile phone before purchasing. This is not convenient. Due to the nature of such cabinets, during the operation process, some users will take out the goods and then put them back, which will cause the placement position of the goods to change. The traditional price tags are likely to cause misjudgment by users and lead to customer complaints. If an electronic price adjustment tag is adopted, the problem of how to update it dynamically needs to be considered. Generally, even for vending cabinets using a vision solution, since the cameras are usually installed at the top of the equipment or at the top of each shelf layer, the key part they photograph is the position after the user takes out the items. Therefore, these devices usually have difficulty photographing the product content seen by users on the current shelf, and thus it is difficult to implement the update of the electronic price tag. Summary of the Invention
[0004] The present invention aims to solve at least one of the technical problems existing in the prior art. For this reason, the present invention provides a control method and system for a refrigeration equipment to realize the recognition of goods on the shelf.
[0005] On the one hand, an embodiment of the present application provides a control method for a refrigeration equipment. A camera is installed on the inner side of the cabinet door of the refrigeration equipment. The shooting direction of the camera is parallel to the plane where the shelf layer is located and forms an acute angle of 25° to 45° with the glass surface of the cabinet door, so that when the cabinet door is opened to a preset angle range, the camera can completely photograph the shelf area. The method includes the following steps: Obtain the picture information photographed by the camera after the equipment cabinet door is opened; Based on the picture information, identify the goods and identification signs in the refrigeration equipment; Determine the content that the identification sign needs to display according to the positional relationship between the goods and the identification sign.
[0006] In some embodiments, the following steps are further included: Obtain the opening angle of the cabinet door; The obtaining of the picture information captured by the camera after the equipment cabinet door is opened specifically includes: When the opening angle of the cabinet door belongs to a preset angle range, obtain the picture information captured by the camera.
[0007] In some embodiments, there are multiple cameras, and the multiple cameras are arranged from top to bottom along a side frame of the cabinet door away from the rotating shaft; the shooting directions of the cameras are parallel, and the picture captured by each camera corresponds to several shelf areas.
[0008] In some embodiments, the identifying of the commodities and identification signs in the commodity cabinet based on the picture information specifically includes: Obtain the configuration information of the identification signs to determine the quantity and arrangement mode of the identification signs; When the quantity and arrangement mode of the identification signs identified from the picture information are consistent with those in the configuration information, identify the commodities in the picture information; According to a preset rule, in combination with the positional relationship between the identification signs and the commodities, map the commodities corresponding to the identification signs and / or the prices corresponding to the commodities to the display content configuration table of the identification signs to update the display content of each identification sign.
[0009] In some embodiments, the preset rule defines the association rule between the commodities and the identification signs; Among them, the association rule associates the commodities with the identification signs in the following manner: When the identification sign is placed above the commodity, extend the recognition frame of the identification sign in the image downward by a certain proportion of the area, and associate the commodity and the identification sign whose intersection area between the recognition frame and the extended area meets the condition; When the identification sign is placed below the commodity, extend the recognition frame of the identification sign in the image upward by a certain proportion of the area, and associate the commodity and the identification sign whose intersection area between the recognition frame and the extended area meets the condition.
[0010] In some embodiments, the identifying of the commodities and identification signs in the refrigeration equipment based on the picture information includes: Extract several picture frames with clarity meeting the preset requirements from the picture information for the identification of the commodities and the identification signs.
[0011] In some embodiments, the identification of the identification signs and the commodities is performed from the picture information captured when the cabinet door is closed.
[0012] In some embodiments, the following steps are further included: After each update of the display content configuration table, check whether the display content configuration table has changed; When the display content configuration table changes, update the content of the signboard that has changed.
[0013] On the other hand, an embodiment of the present application provides a control system for a refrigeration device, including: A camera, the camera is installed inside the cabinet door of the refrigeration device, the shooting direction of the camera is parallel to the plane where the shelf layer is located, and forms an acute angle of 25° to 45° with the glass surface of the cabinet door, so that when the cabinet door is opened to a preset angle range, the camera can completely shoot the shelf area; A signboard, used to display product and / or price information, there are multiple signboards, which are arranged on one or more shelves; An angle sensor, used to sense the opening angle of the cabinet door; A control unit, which is deployed locally in the refrigeration device or in the cloud. According to the data of the angle sensor, after the device cabinet door is opened, the picture information captured by the camera is obtained. Based on the picture information, the products and signboards in the refrigeration device are identified; the content that the signboard needs to display is determined according to the positional relationship between the product and the signboard.
[0014] On the other hand, an embodiment of the present application provides a control system for a refrigeration device, including: A memory, used to store programs; A processor, used to load the program to execute the control method of the refrigeration device.
[0015] Through the embodiments of the present application, a camera is installed in the door frame, and the image captured by the camera when the cabinet door is opened and the camera is far away from the shelf is used to determine the product placement seen by the user, so that the content in the product signboard can be dynamically updated, thereby optimizing the user's shopping experience. In some scenarios, such as when re-arranging products on the shelves, there is no need to pay attention to the relationship between the signboard and the product. Brief Description of the Drawings
[0016] In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the following will briefly introduce the drawings required for the description of the embodiments.
[0017] Figure 1 It is a flowchart of a method provided by an embodiment of the present application; Figure 2 It is a schematic structural diagram of the installation position of a camera provided by an embodiment of the present application; Figure 3 It is a schematic diagram of the shooting range when the camera provided by an embodiment of the present application shoots; Figure 4 is a simplified diagram for analyzing the shooting angle of a camera provided by an embodiment of the present application; Figure 5 is a schematic diagram of an image captured by a camera provided by an embodiment of the present application; Figure 6 is a system block diagram provided by an embodiment of the present application. Detailed implementation manners
[0018] To make the objectives, technical solutions and advantages of the present application clearer, the following will describe the technical solutions of the present application clearly and completely with reference to the accompanying drawings in the embodiments of the present application. Apparently, the described embodiments are some but not all of the embodiments of the present application. All other embodiments obtained by those of ordinary skill in the art based on the embodiments in the present application without making creative efforts shall fall within the protection scope of the present application.
[0019] It can be understood that the refrigeration equipment referred to in the present application is generally a display cabinet, which is a freezer equipped with a glass cabinet door. Such cabinets are usually for users to pick up by themselves, including manned scenarios set up in shopping malls and supermarkets, as well as unmanned visual cabinet solutions.
[0020] Refer to Figure 1 , an embodiment of the present application discloses a control method for refrigeration equipment. Refer to Figure 2 and Figure 3 , a camera 202 is installed on the inner side frame 201 of the cabinet door 200 of the refrigeration equipment. It can be understood that the function of the frame 201 is to fix the cabinet door glass 203. It can be understood that the frame 201 where the camera 202 is installed belongs to the side of the cabinet door away from the rotating shaft. When setting the camera, the frame can be grooved or a camera can be installed at a position on the original cabinet door frame that does not interfere with the structure of the freezer. In some solutions, when retrofitting an existing freezer, a camera can also be pasted on the glass near the frame. Refer to Figure 3 , Figure 3 , the arrowed guiding line in Figure 3 and Figure 4 is the shooting direction of the camera 202. The shooting direction of this camera 202 is parallel to the plane where the shelf layer 301 is located, and forms an acute angle of 25° to 45° with the glass surface of the cabinet door. This acute angle is marked as angle α in Figure 3It is represented by a dashed line in the figure, and the shelf layer is located within the cabinet body 300. Generally, the shelves are horizontally arranged, and the shelf layers are arranged in parallel. The shooting direction of the camera can be understood as the direction in which the camera points, which refers to the direction pointed by the center point of the camera lens. There can be one or more cameras. In the case of one camera, it is usually installed in the middle of the cabinet door frame so as to be able to completely capture the situation of the entire shelf. For the solution with multiple cameras, they can be distributed from top to bottom, and each camera corresponds to the area of several layers of shelves. During the recognition stage, the images of each camera are used to identify the goods and signs according to the allocated areas. Similarly, whether there is an occlusion situation in the image is determined based on the number and distribution of the signs recognized from the images captured by the cameras.
[0021] It can be understood that when the camera is installed in the above manner and is shooting directly at the shelf, the cabinet door is in a semi-closed state. According to the normal use method of the display freezer, at this time, the user will not be located between the cabinet door and the shelf to block the shelf. Therefore, by installing a camera with an "inclined" shooting angle on the side frame of the cabinet door far from the hinge, a complete shelf area can be captured when the door is opened at a certain angle. In this way, the problem of limited shooting angle and shooting distance of the in-cabinet camera at present can be solved. Generally, when the sum of the angle between the camera shooting direction and the cabinet door and the angle of the cabinet door opening is equal to 90°, theoretically, the camera shooting direction is perpendicular to the plane of the shelf facing the user. Therefore, a better shooting position can be determined based on the installation angle of the camera. It can be understood that after the cabinet door is opened, the cabinet door will move away from the shelf, thus forming a reasonable shooting distance, enabling the camera to capture the complete shelf area. For example, when the camera is set at an angle of 30° with the cabinet door, when the cabinet door is opened to 90°, the camera shooting direction is perpendicular to the shelf surface, and the camera is directly facing the midline of the shelf surface. Reference can be made to Figure 4 , this figure is in a top-down view, and the components are simplified into lines. The side ad represents the cabinet body, the side ac represents the cabinet door, and the point a represents the hinge 302. Since the lengths of the cabinet body and the cabinet door are basically the same, when the cabinet door is opened to 60°, the projection b of point c on ad is located at the midpoint of ad. At this time, point c is the installation position of the camera, and the angle bca (angle α) is 30°. It can be understood that by setting the appropriate camera angle and the angle of the cabinet door when obtaining the image, the shelf area captured in the obtained image can be relatively easy to identify. Refer to Figure 5 , from Figure 5 , it can be seen that in the shelf area in the cabinet body 300 captured by the camera, the shelf area includes multiple shelf layers 301, each shelf layer 301 has several lanes, and goods such as beverages 304 are placed on the lanes. Signboards 303 are set at the corresponding positions of the goods lanes. The signboards 303 are electronic signboards used to display product information, such as price, product name, product introduction, etc.
[0022] The method comprises the following steps: S0. Obtain the opening angle of the cabinet door. Usually, an angle sensor can be installed on the cabinet door shaft. Common angle sensors include Hall effect angle sensors, magnetoresistive effect angle sensors, photoelectric encoders, etc. In general, the information of this angle sensor is transmitted to the controller of the device.
[0023] S1. Obtain the image information captured by the camera after the equipment cabinet door is opened. In this step, it is determined whether the cabinet door opening angle is within a preset range before obtaining the image information. The image information refers to a video or multiple image frames acquired at time intervals. On the one hand, this embodiment takes into account the validity of the image information. By selecting the image based on the cabinet door opening angle, the processing power of invalid images can be reduced. For the recognition target in this embodiment, at least one clear image is required to complete the recognition. Of course, it is also possible to recognize multiple images to check the results against each other.
[0024] In some embodiments, step S1 specifically includes: S11. When the opening angle of the cabinet door is within a preset angle range, obtaining image information captured by the camera.
[0025] Generally, the identification of the sign and the product can be performed from the picture information taken when the door is closed. It is understandable that the user usually does not block the camera on the inside of the door during the door closing stage. Moreover, during the door closing stage, the user will not move the product again. Therefore, the pictures collected during this time period can correctly capture the status of the equipment shelf after the user's consumption. In this embodiment, the user closing the door refers to the device detecting that the device is finally located in a preset angle range (which can be set to 45°~65°) before the door is locked. The specific range setting is set according to the installation angle of the camera and the actual shooting effect. In general, it can be determined by 90° minus the angle of camera installation, and then plus or minus 10°. For example, when the angle α is 30°, the preset angle range can be set to 50°~70°.
[0026] In addition, even if some users deliberately block the camera when closing the door, the system can discard the results that cannot be fully recognized. Although the shelf changes cannot be updated in time, the probability of users changing products and blocking the camera is low, and the impact on the user experience of other users is quite limited. After the next user uses it normally, the device can correctly update the sign.
[0027] S2. Identify the products and signage in the refrigeration equipment based on the screen information. In the identification solution, the present application proposes two methods. Method 1: Train a corresponding recognition model by using the calibration images of the signage and the products. For example, in the present application, by collecting product images (mainly beverages) and the calibration images of electronic signage, a YOLOv5 model is trained so that the model can distinguish the types and the beverages. It can be understood that a model capable of performing signage recognition and product recognition can be trained. However, for a large number of beverage categories and continuously emerging types, the model needs to be continuously recognized. Therefore, Method 2 is provided: Train the model to recognize the signage and the beverages, without recognizing the specific classification of the beverages, but based on the beverage types placed by the merchant in the equipment, the sample images, and the recognized beverages for feature comparison, so as to determine the type of the beverages, and then the content that the electronic signage should display can be obtained. Of course, for the product recognition algorithm, a mature recognition solution on the market can also be adopted. Currently, companies such as Megvii and SenseTime have mature product recognition vision algorithms, and the details of the existing algorithms are not specifically elaborated in this embodiment.
[0028] In some embodiments, S2 specifically includes: S21. Obtain the configuration information of the signage to determine the number and layout of the signage. Generally, the signage can be configured according to the number of lanes. Therefore, the number and layout of the signage can be represented by n rows * m columns, which is the most common way.
[0029] S22. When the number and layout of the signage recognized from the screen information are consistent with those in the configuration information, identify the products in the screen information. It can be understood that the styles of the signage are the same. The number and layout of the signage in the screen can be counted to determine whether the frame of the image captured by the camera is complete. Therefore, as long as the number or layout of the signage is incorrect, it can be determined that the captured image is blocked or there are other abnormal situations. Under the condition of abnormal situations, there is no need for further recognition. Only when a complete number of signage is recognized, is there a meaning in further identifying the products corresponding to the signage. Whether the signage is in the same column or the same row can be judged by the coordinates of the signage recognition frame. This can be determined by comparing the difference in the horizontal axis coordinates of the two signage recognition frames in the image. For example, for two signage in the same row (horizontal direction), their Y coordinates (vertical coordinates) in the picture are relatively close, and this information can be used to judge whether the two signage are in the same row.
[0030] S23. According to the preset rules, combine the positional relationship between the signage and the products, and map the products corresponding to the signage and / or the prices corresponding to the products to the display content configuration table of the signage to update the display content of each signage.
[0031] It can be understood that there is generally a corresponding relationship between the signboard and the goods aisle, and goods are usually placed according to the goods aisle. In some examples, each goods aisle has a partition, and each goods aisle can be configured with a signboard. For vending machines that do not distinguish goods aisles, signboards are configured according to the placement of goods. The configuration of each device signboard can be set through the background. The quantity of each row and column can be set, and the signboard can be above or below the goods. The ID of each signboard can be determined according to the position of the signboard in the image, and the placement order of the signboards has been pre-configured in the background.
[0032] In some embodiments, taking the example that each goods aisle is configured with a signboard, the association rule between the goods and the signboard is defined in the preset rule.
[0033] Among them, the association rule associates the goods with the signboard in the following manner: When the signboard is placed above the goods, extend the recognition frame of the signboard in the image downward by a certain proportion of the area, and associate the goods and the signboard whose intersection area between the recognition frame and the extended area meets the conditions.
[0034] When the signboard is placed below the goods, extend the recognition frame of the signboard in the image upward by a certain proportion of the area, and associate the goods and the signboard whose intersection area between the recognition frame and the extended area meets the conditions.
[0035] Since the size of the signboard is determined, and the interlayer height information between the shelves is also determined. By performing area expansion based on the position and size of the signboard in the figure (the position and size of the signboard are determined by the recognition frame of the signboard in the image), the position where the goods are located can be circled, and according to the matching and coincidence relationship between the position of the goods recognized in the figure and the area obtained by the expansion, the goods corresponding to the signboard can be determined. Generally, it is required that the overlap rate (overlap area / goods recognition frame area) between the extended area and the goods recognition frame reaches a certain proportion, and the goods with the highest overlap rate are selected as the goods corresponding to the signboard. Among them, it can be understood that for different signboard placement methods, different matching rules are adapted.
[0036] S3. Determine the content to be displayed on the sign based on the positional relationship between the product and the sign. It can be understood that after the product is identified and classified, its type and selling price can be determined. When the sign corresponds to the product, the information on the sign can be updated based on the type and price of the product. For example, modify the product name and / or modify the price. The most common scenario is that a user takes out a product but does not consume it and then puts it back in the position of another product, which results in the product seen by the next user being inconsistent with the sign. Or, after an operation of replenishing goods in a round, the placement of the original products has changed. At this time, if the sign is not updated, the content of the sign will be different from the product. Therefore, through this solution, it is convenient to replenish goods, or the sign can be automatically modified when the user exchanges the positions of products.
[0037] S4. After each update of the display content configuration table, check whether the display content configuration table has changed.
[0038] S5. When the display content configuration table has changed, update the content of the sign that has changed.
[0039] In this solution, the content of each sign is configured through a display content configuration table. In the case of changes, the content of these signs is refreshed. If the configuration table has not changed, the content of the signs is not refreshed, which can reduce the sign refresh configuration.
[0040] In some embodiments, there are multiple cameras, and the multiple cameras are arranged from top to bottom along a side frame of the cabinet door away from the rotating shaft; the shooting directions of the cameras are parallel, and the picture captured by each camera corresponds to several shelf areas. It can be understood that for a single camera, there may be certain limitations in the shooting angle for a relatively high shelf cabinet. Therefore, multiple cameras can be set, and different cameras can be used to identify different areas by calibrating the range. For example, there may be an overlap in the shooting areas between multiple cameras. Before image recognition, the processing range of the cameras can be defined. Of course, before image recognition, the pictures captured by multiple cameras can also be processed through image fusion first.
[0041] It can be understood that the pictures collected by the above cameras can be used for other purposes in addition to updating the signs, but this application will not expand on this.
[0042] In some embodiments, the identifying the products and signs in the refrigeration equipment based on the picture information includes: Extract several picture frames with clarity meeting the preset requirements from the picture information for identifying products and signs.
[0043] It can be understood that when selecting a screen frame as the recognition object, several screen frames can be extracted from the screen segments that meet the conditions at a certain time interval, and photos that meet the clarity requirements can be selected from them. Then, several of these photos can be selected for recognition. The method for judging clarity can filter the photo through the Laplacian operator and calculate the variance, calculate the Laplacian of the image and find the variance. If the variance is less than the threshold, it indicates blurriness, otherwise it is clear. Of course, other clarity detection algorithms can also be used.
[0044] Referring to Figure 6 , an embodiment of the present application provides a control system for a refrigeration device, including: A camera, which is installed inside the cabinet door of the refrigeration device. The shooting direction of the camera is parallel to the plane where the shelf layer is located and forms an acute angle of 25° to 45° with the glass surface of the cabinet door, so that when the cabinet door is opened to a preset angle range, the camera can completely capture the shelf area.
[0045] Signboards, which are used to display product and / or price information. There are multiple signboards, which are arranged on one or more shelves; signboards, which are used to display product information or product prices, etc., and are controlled in a wired or wireless manner. Usually, one signboard is set for each product aisle.
[0046] An angle sensor, which is used to sense the opening angle of the cabinet door. The angle sensor can adopt a Hall sensor, a potentiometer sensor, etc. This sensor is mainly used to collect data on the rotation of the cabinet door.
[0047] A control unit, which is deployed locally in the refrigeration device or in the cloud. According to the data of the angle sensor, after the device cabinet door is opened, it obtains the screen information captured by the camera. Based on the screen information, it identifies the products and signboards in the refrigeration device; determines the content that the signboard needs to display according to the positional relationship between the products and the signboards. Specifically, it identifies the position of the signboard in the figure through clear screen frames, then extends the position where the signboard is located according to preset rules to obtain an extended area, identifies the products, calculates the overlapping situation between the product recognition frame and the extended area, and associates the products that meet the preset overlap degree with the signboard. Through the product type and the association relationship, the product description or product price can be updated to the signboard.
[0048] An embodiment of the present application provides a control system for a refrigeration device, including: A memory, which is used to store programs; the memory refers to storage media such as hard disks, memory cards, optical discs, etc. The program refers to the code information written to achieve the control function.
[0049] A processor for loading the program to execute the control method of the refrigeration device. The processor refers to the set of control hardware for implementing the above functions.
[0050] Note that the above is only the preferred embodiment of the present application and the technical principles applied. Those skilled in the art will understand that the present application is not limited to the specific embodiments described herein, and various obvious changes, re-adjustments and substitutions can be made by those skilled in the art without departing from the protection scope of the present application. Therefore, although the present application has been described in detail through the above embodiments, the present application is not limited to the above embodiments. Without departing from the concept of the present application, more other equivalent embodiments can be included, and the scope of the present application is determined by the scope of the appended claims.
Claims
1. A control method for refrigeration equipment, characterized in that: A camera is installed on the inner side of the cabinet door of the refrigeration equipment, and the shooting direction of the camera is parallel to the plane where the shelf layer is located, and forms an acute angle of 25° to 45° with the glass surface of the cabinet door, so that when the cabinet door is opened to a preset angle range, the camera can completely shoot the shelf area. The method includes the following steps: After the equipment cabinet door is opened, the image information captured by the camera is obtained; Based on the image information, identifying the products and identification plates in the refrigeration equipment; Determine what the sign needs to display based on the positional relationship between the product and the sign.
2. A control method for refrigeration equipment according to claim 1, characterized in that: The following steps are also included: Get the opening angle of the cabinet door; The obtaining of the image information captured by the camera after the equipment cabinet door is opened specifically includes: When the opening angle of the cabinet door falls within a preset angle range, image information captured by the camera is obtained.
3. A control method for refrigeration equipment according to claim 1, characterized in that: There are multiple cameras, and the multiple cameras are arranged from top to bottom along a border of the cabinet door away from the rotation axis; the shooting directions of the cameras are parallel, and the picture taken by each camera corresponds to several shelf areas.
4. A control method for refrigeration equipment according to claim 1, characterized in that: The identifying of the commodities and identification plates in the commodity cabinet based on the image information specifically includes: Obtain the configuration information of the signboards to determine the number and layout of the signboards; When the image information identifies that the number and arrangement of the identification plates are consistent with those in the configuration information, identifying the commodity in the image information; According to preset rules and in combination with the positional relationship between the sign and the product, the product corresponding to the sign and / or the price corresponding to the product are mapped to the display content configuration table of the sign to update the display content of each sign.
5. A control method for refrigeration equipment according to claim 4, characterized in that: The preset rules define the association rules between commodities and identification plates; The association rules associate the product with the sign in the following manner: When the sign is placed above the product, the identification frame of the sign in the image is extended downward by a certain proportion of the area, and the product whose intersection area between the identification frame and the extended area meets the condition is associated with the sign; When the identification plate is placed under the commodity, the identification frame of the identification plate in the image is extended upward by a certain proportion of the area, and the commodity whose intersection area between the identification frame and the extended area meets the condition is associated with the identification plate.
6. A control method for refrigeration equipment according to claim 1, characterized in that: The identifying of the commodity and the identification plate in the refrigeration equipment based on the image information includes: A number of picture frames whose clarity meets preset requirements are extracted from the picture information to identify the commodity and the identification plate.
7. A control method for refrigeration equipment according to claim 1, characterized in that: The identification plate and the product are identified from the image information captured when the cabinet door is closed.
8. A control method for refrigeration equipment according to claim 4, characterized in that: The following steps are also included: After each update of the display content configuration table, checking whether the display content configuration table has changed; When the display content configuration table changes, the changed sign content is updated.
9. A control system for refrigeration equipment, characterized in that: include: A camera, the camera is installed on the inner side of the cabinet door of the refrigeration equipment, the shooting direction of the camera is parallel to the plane where the shelf layer is located, and forms an acute angle of 25° to 45° with the glass surface of the cabinet door, so that when the cabinet door is opened to a preset angle range, the camera can completely shoot the shelf area; An identification plate is used to display product and / or price information. There are multiple identification plates, which are arranged on one or more shelves; An angle sensor, used to sense the opening angle of the cabinet door; The control unit is deployed locally on the refrigeration equipment or in the cloud. According to the data from the angle sensor, it obtains the image information captured by the camera after the equipment cabinet door is opened, and identifies the goods and signboards in the refrigeration equipment based on the image information; and determines the content to be displayed on the signboard according to the positional relationship between the goods and the signboard.
10. A control system for refrigeration equipment, characterized in that: include: Memory, used to store programs; A processor, used for loading the program to execute the control method of the refrigeration equipment according to any one of claims 1 to 8.
Citation Information
Patent Citations
Vending machine and operation method thereof
CN106781014A
Photographing method and device, intelligent equipment and storage medium
CN108737717A
Unattended vending method, device and system
CN109190705A
Human-computer interaction device for automatic settlement and application thereof
CN109559453A
Identification method and device
CN111340009A
Cited By
Control method and system of intelligent refrigeration equipment and refrigeration equipment
CN121855168A