Commodity image information collection system and method

Abstract

To provide a system and a method for commodity image information collection which improve the efficiency of collecting images and information of commodities.SOLUTION: A commodity image information collection system comprises: an AIoT management server which transmits a commodity information list to a price tag management server and transmits an image capture start notification to an AI vision system; a price tag management server which, on the basis of binding information between electronic price tags and commodities and the received commodity information list, determines an electronic price tag to be notified, transmits an information display notification, and, when the electronic price tag to be notified performs an information display operation based on the notification, simultaneously generates a matching relationship between the information display operation and a barcode of the commodity and transmits the matching relationship to the AI vision system; an AI vision system which captures an image of the information display operation to obtain captured content, and performs parsing on the basis of the captured content and the matching relationship to obtain a recognition result; and a commodity information management system which associates the electronic price tag with the commodity on the basis of the captured image and the recognition result.SELECTED DRAWING: Figure 1

Description

Technical Field

[0001] The present invention relates to the technical field of mobile interconnection, and particularly to a product image information collection system and method.

Background Art

[0002] This part aims to provide background or context for embodiments of the present invention described in the claims. The descriptions herein are not admitted to be prior art merely because they are included in this part.

[0003] With the continuous development of artificial intelligence technology, the supermarket industry is also moving towards intelligence and digitization. By applying AI technology, supermarkets can better meet customer needs, improve operational efficiency, enhance the user experience, and further expand the market influence of supermarkets. By applying artificial intelligence algorithms, supermarkets can analyze and predict consumer needs in real time, and formulate more accurate marketing strategies to meet consumer needs, leading to increased sales and customer satisfaction. Supermarkets can further use AI technology to automate inventory management, reduce inventory costs and shelf retention rates, and ensure that goods are replenished quickly when needed to meet customer shopping needs.

[0004] Smart shelves are a new type of smart retail tool with smart analysis and automated management functions, which can meet various needs such as supermarket display surface analysis and product recognition. Generally, it includes hardware devices such as electronic price tags, smart cameras, and smart robots. By performing real-time monitoring and data analysis on the products on the shelves, it can improve the shelf utilization rate, optimize inventory management, enhance the customer shopping experience, and improve the business revenue of the supermarket. Smart shelves have already become an important component of supermarket smart retail and will also be an important direction for the future development of supermarkets.

[0005] In a smart shelf, collecting product image information is an important part. The collected product image data can be used for subsequent operations such as product recognition, display analysis, and out-of-stock checking. Note that for these operations, not only the collected product images but also accurate corresponding barcodes and the binding of product information with the images are required.

[0006] However, for collecting product data with similar specification requirements, usually, a manual collection method is used. A dedicated collection device is used to scan the product with a code scanner gun to obtain the barcode, and then, several cameras are used to image and collect the product for processing. Such a method is related to the transportation and movement of products. Not only is the collection efficiency extremely low, but new products often appear in supermarkets, and it is actually very difficult to use a dedicated device for collection.

Summary of the Invention

Problems to be Solved by the Invention

[0007] Embodiments of the present invention provide a product image information collection system configured to improve the efficiency of collecting images and information of products, especially additional products or specific products.

Means for Solving the Problems

[0008] The product image information collection system of embodiments of the present invention includes an AIoT management server configured to send a product information list to a price tag management server and send an imaging start notification to an AI vision system, and a price tag management server configured to determine the electronic price tags to be notified based on the binding information between the electronic price tags and the products and the received product information list, send an information display notification to the electronic price tags to be notified, and at the same time that the electronic price tags to be notified execute an information display operation based on the information display notification, generate a matching relationship between the information display operation and the barcodes of the products and send it to the AI vision system. Upon receiving an imaging start notification, it captures the information display operation to obtain the imaging content, analyzes based on the imaging content and the received matching relationship, and obtains a recognition result including the spatial information and recognition information of the electronic price tag and the product, and is configured to transmit the captured image and the recognition result to the product information management system. The AI vision system A product information management system configured to associate an electronic price tag with a product based on the captured image and the recognition result.

[0009] Embodiments of the present invention are applied to an AI vision system and provide a product image information collection method configured to improve the efficiency of collecting images and information of products, especially additional products or specific products. The product image information collection method includes Upon receiving an imaging start notification sent by the AIoT management server, capturing the information display operation to obtain the imaging content; Analyzing based on the imaging content and the matching relationship, which is the relationship between the information display operation sent by the price tag management server and the barcode of the product, to obtain a recognition result including the spatial information and recognition information of the electronic price tag and the product. The matching relationship is generated when the electronic price tag to be notified by the price tag management server executes the information display operation based on the information display notification. The information display notification is sent to the electronic price tag to be notified after the electronic price tag to be notified is determined based on the binding information between the electronic price tag and the product and the product information list sent by the received AIoT management server by the price tag management server. Transmitting the captured image and the recognition result to the product information management system so that the product information management system associates the electronic price tag with the product.

[0010] Embodiments of the present invention are applied to an AI vision system and provide a product image information collection device configured to improve the efficiency of collecting images and information of products, especially additional products or specific products. The product image information collection device includes An imaging module configured to capture the information display operation to obtain the imaging content when receiving an imaging start notification sent by the AIoT management server. A recognition module configured to obtain a recognition result including spatial information and recognition information of an electronic price tag and a product by analyzing based on the relationship between the captured content, the information display operation transmitted by the price tag management server, and the matching relationship with the barcode of the product. The matching relationship is such that the electronic price tag to be notified by the price tag management server is generated simultaneously when it executes the information display operation based on the information display notification. The information display notification is transmitted to the electronic price tag to be notified by the price tag management server after the electronic price tag to be notified is determined based on the binding information between the electronic price tag and the product and the product information list transmitted by the received AIoT management server. And a recognition module, An association module configured to transmit the captured image and the recognition result to the product information management system so as to associate the electronic price tag and the product by the product information management system.

[0011] In an embodiment of the present invention, the AIoT management server is configured to send a product information list to the price tag management server and send an imaging start notification to the AI vision system. The price tag management server determines the electronic price tags to be notified based on the binding information between the electronic price tags and the products and the received product information list, sends an information display notification to the electronic price tags to be notified. When the electronic price tags to be notified execute an information display operation based on the information display notification, a matching relationship between the information display operation and the barcode of the product is generated and configured to be sent to the AI vision system. When receiving the imaging start notification, the AI vision system captures the information display operation to obtain imaging content, and based on the imaging content and the received matching relationship, analyzes to obtain a recognition result including the spatial information and recognition information of the electronic price tags and the products, and is configured to send the imaging image and the recognition result to the product information management system. The product information management system is configured to associate the electronic price tags with the products based on the imaging image and the recognition result. Compared with the manual collection method in the prior art, in this technical means, the entire system is constructed using AIoT technology to perform automatic discovery, automatic control, automatic recognition, and automatic analysis, improving the collection efficiency of product images and information, and capable of efficiently performing several rounds of collection, reducing the cost of manual repeated collection, and achieving a data closed-loop in the business of the smart shelf.

Brief Description of the Drawings

[0012] To more clearly illustrate the technical solutions in the embodiments of the present invention or the prior art, the following briefly introduces the drawings necessary for the description of the embodiments or the prior art. Obviously, the drawings in the following description are only some embodiments of the present invention, and those skilled in the art can also obtain other drawings based on these drawings without creative efforts. In the figures,

[0013]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Embodiments for Carrying Out the Invention

[0014] In order to make the objectives, technical solutions and advantages of the embodiments of the present invention clearer, the embodiments of the present invention will be described in more detail below with reference to the drawings. Here, the exemplary embodiments of the present invention and their descriptions are for interpreting the present invention and are not intended to limit the present invention.

[0015] The principle of the embodiment of the present invention is to adopt digitization-related devices arranged in a supermarket, and based on the AIoT technology, automatically perform imaging, recognition inference, calculation analysis, and storage, achieving the objectives of automatic discovery, automatic control, automatic recognition, automatic analysis, and automatic storage to the base, improving the collection efficiency of product images and information, and being able to efficiently perform several rounds of collection, reducing the cost of manual repeated collection, and achieving a data closed loop in the business of the smart shelf.

[0016] The electronic price tag in the embodiment of the present invention refers to the electronic type of product price tag commonly seen in conventional supermarkets, which can perform page switching and the attached led lamp can blink and light up.

[0017] FIG. 1 is a schematic diagram of the product image information collection system according to the embodiment of the present invention, An AIoT management server configured to send a product information list to a price tag management server and send an imaging start notification to an AI vision system, Based on the binding information between the electronic price tag and the product, and the received product information list, determine the electronic price tag to be notified, send an information display notification to the electronic price tag to be notified, and when the electronic price tag to be notified executes an information display operation based on the information display notification, generate a matching relationship between the information display operation and the barcode of the product, and a price tag management server configured to send it to the AI vision system, When receiving an imaging start notification, image the information display operation to obtain imaging content, and based on the imaging content and the received matching relationship, analyze to obtain a recognition result including the spatial information and recognition information of the electronic price tag and the product, and an AI vision system configured to send the imaging image and the recognition result to the product information management system, A product information management system configured to associate the electronic price tag with the product based on the imaging image and the recognition result.

[0018] Referring to Figure 2, the system Further includes a code scanning device configured to send the binding information between the electronic price tag and the product on the shelf to the price tag management server, The price tag management server is further configured to record the binding information between the electronic price tag and the product and synchronize it to the AIoT management server for providing.

[0019] Daily, supermarket clerks perform the operation of binding the electronic price tags and products on the shelf using the code scanning device.

[0020] In one embodiment, the AIoT management server further Counts additional products, obtains additional product information from the price tag management server, or introduces additional product information, and adds the additional product information to the product information list. Or is configured to receive a preset product information list.

[0021] The above are two scenarios for obtaining a product information list. In the two scenarios, notifying the AI vision system to capture images can be set in several rounds, so that more product images can be obtained for subsequent steps. The information on additional products may come from the price tag management server, or may be provided to the AIoT management server in a manner introduced from the outside. Of course, it may also be other methods, which are not limited here.

[0022] In one embodiment, the information display operation is page switching or flashing. When the information display operation is page switching, the captured content is the content image of the page switching. When the information display operation is flashing, the captured content is a series of flashing images.

[0023] When specifically implemented, the AI vision system can control the vision sensor device to capture images and perform AI recognition inference calculations on the vision images. The vision sensor device includes, but is not limited to, a fixedly mounted camera, a movable camera, a rotatable camera, a robot with a movable camera, an aircraft with a camera, etc. Moreover, the above vision sensor devices can all obtain the captured content of the shelves by overlooking / looking up / front-facing the product shelves in the supermarket. When the information display operation is page switching, it is for the purpose of displaying a specific page switching code and making it recognized by the camera. When the information display operation is flashing, the captured content obtained by capturing this flashing is a series of flashing images.

[0024] In one embodiment, the spatial information is a position bounding box. Specifically, the AI vision system rejects the captured content without the information display operation. detects the electronic price tags in the remaining captured content, and obtains the position bounding box of each electronic price tag. For each detected electronic price tag, it recognizes the information display operation. Analyze the information display operation based on the matching relationship between the information display operation and the barcode of the product, and determine the barcode of the product corresponding to each electronic price tag. It is configured to detect products in the imaging content and obtain the position bounding box of each product.

[0025] Through the above AI calculation, obtain the position bounding box of the electronic price tag and the position bounding box of the product, and further obtain the barcode of the product corresponding to each electronic price tag. These information are used for subsequent association. The methods for detecting electronic price tags and products include, but are not limited to, conventional visual processing algorithms and deep learning methods. When using deep learning methods, target detection algorithms, image segmentation algorithms, etc. pre-trained by machine learning methods are included, but not limited to these. The methods for recognizing information display operations (i.e., page switching content or blinking of electronic price tags) similarly include, but are not limited to, conventional visual processing algorithms and deep learning methods.

[0026] In one embodiment, for the AI vision system to recognize the information display operation, For each detected electronic price tag, cut out a small price tag image based on the position bounding box of the electronic price tag, Recognize each small price tag image and recognize the information display operation.

[0027] The step of cutting out the above-mentioned small price tag image can accelerate the recognition of the information display operation.

[0028] In one embodiment, the product information management system specifically Based on the spatial information of the electronic price tag and the spatial information of the product, determine the product closest to each electronic price tag as the anchor product corresponding to the electronic price tag. Calculate the similarity between the imaging content of each other product and the imaging content of the anchor product within a predetermined range for each anchor product. If the similarity corresponding to each other product is equal to or greater than a predetermined threshold, determine that the other product and the anchor product are of the same type of product. It is configured to associate and bind each electronic value ticket and the corresponding anchor product with other products that are of the same type as the anchor product.

[0029] When specifically implemented, each of the other products within the predetermined range of the above-mentioned anchor product refers to n products stacked on the left and right sides or the upper part of the anchor product. Associating and binding each electronic value ticket and the corresponding anchor product with other products that are of the same type as the anchor product includes binding the product and the information, and thereby, clear barcode information, product name information, etc. will be assigned to each associated product.

[0030] FIG. 3 is a schematic diagram of the calculation principle of the similarity between the anchor product and other products according to an embodiment of the present invention. For the electronic value ticket A, one anchor product is determined based on the closest distance relationship, and the similarity can be calculated for the surrounding other products and the anchor product. The numbers displayed on the heads of each of the other products represent the image similarity s with the anchor product. When the threshold value is set to 0.85, the three other products with similarity values of 0.86, 0.91, and 0.95 are regarded as products of the same type as the anchor product, form an associated relationship, and can be information-bound with the electronic value ticket A.

[0031] In one embodiment, the product information management system further is configured to cut out a product image from the imaging content for the product based on the spatial information of the product and store the product image and the corresponding product information in a database.

[0032] In one embodiment, the product information management system further visualizes and displays the object of the associated binding, including the imaging content, the recognition result, the anchor product corresponding to the electronic value ticket, each other product within the predetermined range, and the associated and bound product, and is configured to receive an edit including adding, deleting, or correcting the object manually.

[0033] The above - described process is carried out on the display interface of the product information management system. That is, the user can intuitively view the associated binding and can also intervene in the associated binding to achieve adjustment.

[0034] The embodiment of the present invention further proposes a method for collecting product image information applied to an AI vision system. Since its principle is similar to that of the product image information collection system, detailed description is omitted here.

[0035] FIG. 4 is a flowchart of a method for collecting product image information according to an embodiment of the present invention, When receiving an imaging start notification sent by the AIoT management server, step 401 of imaging the information display operation to obtain the imaging content; Based on the imaging content and the matching relationship between the information display operation sent by the price tag management server and the bar code of the product, step 402 of analyzing to obtain a recognition result including the spatial information and recognition information of the electronic price tag and the product. The matching relationship is generated when the electronic price tag to be notified by the price tag management server executes the information display operation based on the information display notification. The information display notification is sent by the price tag management server to the electronic price tag to be notified after determining the electronic price tag to be notified based on the binding information between the electronic price tag and the product and the product information list sent by the received AIoT management server. Step 402; Step 403 of transmitting the imaging image and the recognition result to the product information management system so that the electronic price tag and the product are associated by the product information management system, is included.

[0036] In one embodiment, the step of analyzing and obtaining a recognition result based on the imaging content and the matching relationship sent by the price tag management server is Rejecting the imaging content without an information display operation; Detecting the electronic price tags in the remaining imaging content and obtaining the position bounding box of each electronic price tag; For each detected electronic value note, recognize the information display operation, Analyze the information display operation based on the matching relationship between the information display operation and the barcode of the product, determine the barcode of the product corresponding to each electronic value note, and use the determined barcode of the product as recognition information, Detect the products in the imaging content and obtain the position bounding box of each product, including.

[0037] In one embodiment, the step of recognizing the information display operation is For each detected electronic value note, cut out a small value note image based on the position bounding box of the electronic value note, Recognize each small value note image and recognize the information display operation, including.

[0038] The embodiment of the present invention further proposes a product image information collection device applied to an AI vision system. Its principle is similar to that of the product image information collection system, and detailed description is omitted here.

[0039] FIG. 5 is a schematic diagram of a product image information collection device according to an embodiment of the present invention, An imaging module 501 configured to receive an imaging start notification sent by an AIoT management server and capture an information display operation to obtain imaging content, Based on the imaging content and the matching relationship between the information display operation and the barcode of the product, which is a relationship sent by the value note management server, analyze to obtain a recognition result including the spatial information and recognition information of the electronic value note and the product. The matching relationship is generated when the electronic value note to be notified by the value note management server executes an information display operation based on the information display notification. The information display notification is sent by the value note management server based on the binding information between the electronic value note and the product and the product information list sent by the received AIoT management server after determining the electronic value note to be notified, and then sent to the electronic value note to be notified. Recognition module 502, An association module 503 configured to transmit the captured image and the recognition result to the product information management system so that the electronic price tag and the product are associated by the product information management system.

[0040] In one embodiment, the recognition module 502 is specifically configured to reject the captured content without information display operation, detect the electronic price tags in the remaining captured content, obtain the position bounding box of each electronic price tag, for each detected electronic price tag, recognize the information display operation, analyze the information display operation based on the matching relationship between the information display operation and the barcode of the product, and determine the barcode of the product corresponding to each electronic price tag, detect the products in the captured content, and obtain the position bounding box of each product.

[0041] In one embodiment, the recognition module 502 is specifically configured to for each detected electronic price tag, cut out a small price tag image based on the position bounding box of the electronic price tag, recognize each small price tag image and recognize the information display operation.

[0042] As described above, the system, method, and apparatus proposed in the embodiments of the present invention have the following beneficial effects.

[0043] First, the product information management system can automatically calculate, collect, and store the product image and the bound product information based on the information on the image.

[0044] Second, the architecture of the AIoT management system can be simultaneously connected to the price tag management server and the AI vision system. The price tag management server can be connected to all the electronic price tags in the scene, and the AI vision system can be connected to all the cameras or devices in the scene, thereby realizing the interconnection of various devices.

[0045] Thirdly, the AIoT management system can control the electronic price tag to switch pages or blink by discovering additional products based on the database information and sending the additional product list or the set product list to the price tag management server. It can quickly obtain the image information of manually noticed products added in the supermarket scene, improving the efficiency of the business.

[0046] Fourthly, the AI vision system operates synchronously under the notification of the AIoT management server, can obtain the corresponding image set when the price tag switches pages or blinks, and can perform inference calculations. There is no need to collect manually and repeatedly, avoiding low efficiency and high costs.

[0047] Fifthly, the AI vision system can detect the electronic price tag and products in the shelf image, and can recognize the content of the page switching of the electronic price tag or the blinking light color.

[0048] The embodiment of the present invention further provides a computer device. FIG. 6 is a schematic diagram of the computer device according to the embodiment of the present invention. The computer device 600 includes a memory 610, a processor 620, and a computer program 630 stored in the memory 610 and executable by the processor 620. When the computer program 630 is executed by the processor 620, the above-mentioned product image information collection method is realized.

[0049] The embodiment of the present invention further provides a computer-readable storage medium storing a computer program. When the computer program is executed by a processor, the above-mentioned product image information collection method is realized.

[0050] The embodiment of the present invention further provides a computer program that, when executed by a processor, realizes the above-mentioned product image information collection method.

[0051] Those skilled in the art should understand that the embodiments of the present invention can be provided as a method, a system, or a computer program product. Therefore, the present invention can be implemented in the form of a complete hardware embodiment, a complete software embodiment, or an embodiment combining software and hardware. And the present invention can be implemented in the form of a computer program product implemented on one or more computer-readable storage media (including but not limited to magnetic disk memory, CD-ROM, optical memory, etc.) containing computer-usable program code.

[0052] The present invention will be described with reference to the flowcharts and / or block diagrams of the method, apparatus (system), and computer program product according to the embodiments of the present invention. It should be understood that each flow and / or block in the flowchart and / or block diagram, and the combination of flows and / or blocks in the flowchart and / or block diagram, can be realized by computer program instructions. These computer program instructions are provided to the processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing equipment to generate an apparatus for realizing the functions specified by one or more flows in the flowchart and / or one or more blocks in the block diagram.

[0053] These computer program instructions may be stored in a computer-readable memory that can guide a computer or other programmable data processing equipment to operate in a specific manner, so that a product including an instruction device for realizing the functions specified by one or more flows in the flowchart and / or one or more blocks in the block diagram is generated by the instructions stored in the computer-readable memory.

[0054] These computer program instructions can be loaded onto a computer or other programmable data processing apparatus, thereby causing the computer or other programmable apparatus to implement a process realized by a computer in steps of performing a series of operations, and thus providing steps for realizing a function specified by one flow or a plurality of flows of a flowchart and / or one block or a plurality of blocks of a block diagram by instructions executed on the computer or other programmable apparatus.

[0055] The specific embodiments described above further elaborate on the object, technical solution, and beneficial effects of the present invention. However, it should be understood that the above are merely specific embodiments of the present invention and are not intended to limit the scope of the present invention. Any corrections, equivalent substitutions, improvements, etc. made within the spirit and principles of the present invention should all be included within the scope of the present invention.

Claims

1. An AIOT management server configured to send a product information list to the price tag management server and send an imaging start notification to the AI ​​vision system; a price tag management server configured to determine an electronic price tag to be notified based on binding information between the electronic price tag and the product and the received product information list, to transmit an information display notification to the electronic price tag to be notified, to have the electronic price tag to be notified execute an information display action based on the information display notification, and at the same time to generate a matching relationship between the information display action and the barcode of the product and transmit the matching relationship to the AI ​​vision system; an AI vision system configured to, upon receiving an image capture start notification, capture an image of the information display action to obtain image content, analyze the image content and the received matching relationship to obtain a recognition result including spatial information and recognition information of the electronic price tag and the product, and transmit the captured image and the recognition result to a product information management system; and a product information management system configured to associate an electronic price tag with a product based on a captured image and a recognition result. A product image information collection system comprising:

2. The code scanning device is configured to transmit binding information between the electronic price tag and the product on the shelf to the price tag management server; The price tag management server is further configured to record binding information between the electronic price tag and the product and provide the same to the AIoT management server in a synchronized manner.

2. The product image information collection system according to claim 1.

3. The AIOT management server further includes: Collect statistics on the additional products, obtain additional product information from the price tag management server, import the additional product information, and add the additional product information to the product information list; or configured to receive a preset product information list.

2. The product image information collection system according to claim 1.

4. The information display operation is page switching or blinking, When the information display operation is a page change, the captured content is a content image of the page change; When the information display action is blinking, the captured image is a sequence of blinking images.

2. The product image information collection system according to claim 1.

5. the spatial information being a position bounding box; The AI ​​visual system is The images without any information display activity were rejected. Detecting EPL tags in the remaining image content and obtaining a position bounding box for each EPL tag; For each detected EPL tag, the information display action is recognized; Analyzing the information display action based on a matching relationship between the information display action and the barcode of the product, and determining the barcode of the product corresponding to each electronic price tag; configured to detect items in the imaged content and obtain a position bounding box for each item 2. The product image information collection system according to claim 1.

6. The AI ​​visual system recognizes information display actions, for each detected EPL tag, cropping a sub-image of the EPL tag based on a position bounding box of the EPL tag; Recognizing each price tag sub-image and recognizing an information display action.

6. The product image information collection system according to claim 5.

7. The product information management system is determining a product closest to each EPL tag as an anchor product corresponding to the EPL tag based on the spatial information of the EPL tag and the spatial information of the product; calculating a similarity between the image content of each other product and the image content of the anchor product within a predetermined range for each anchor product, and if the similarity corresponding to each other product is equal to or greater than a predetermined threshold, determining that the other product and the anchor product are the same type of product; Each electronic price tag and corresponding anchor product are configured to be associated with and bound to other products that are the same type of product as the anchor product.

2. The product image information collection system according to claim 1.

8. The product information management system further includes: The system is configured to extract a product image from the captured image based on the spatial information of the product, and store the product image and the corresponding product information in a database.

2. The product image information collection system according to claim 1.

9. The product information management system further includes: Visualize and display the associated binding objects, including the captured image, the recognition result, the anchor product corresponding to the electronic price tag, each of the other products within a predetermined range, and the associated bound products; Configured to accept manual edits to the object, including additions, deletions, or corrections 8. The product image information collection system according to claim 7.

10. In a product image information collection method applied to an AI vision system, When receiving the imaging start notification transmitted by the AIoT management server, imaging the information exhibition operation and acquiring the imaging content; a step of acquiring a recognition result including spatial information and recognition information of the electronic price tag and the product by analyzing the image content and a matching relationship, which is a relationship between the information display action and the product barcode transmitted by the price tag management server, said matching relationship being generated at the same time as the electronic price tag to be notified by the price tag management server executes the information display action based on the information display notification, and said information display notification is transmitted by the price tag management server to the electronic price tag to be notified after the electronic price tag to be notified is determined based on binding information between the electronic price tag and the product and the product information list transmitted by the received AIoT management server; and transmitting the captured image and the recognition result to the product information management system so that the electronic price tag and the product are associated with each other by the product information management system. A product image information collecting method comprising:

11. In a product image information collection device applied to an AI vision system, An imaging module configured to capture an image of an information exhibition operation and acquire an imaging content when receiving an imaging start notification transmitted by the AIoT management server; a recognition module configured to acquire a recognition result including spatial information and recognition information of the electronic price tag and the product by analyzing the image content and a matching relationship, which is a relationship between the information display action and the product barcode transmitted by the price tag management server, said matching relationship being generated at the same time as the electronic price tag to be notified by the price tag management server executes the information display action based on the information display notification, and said information display notification is transmitted by the price tag management server to the electronic price tag to be notified after the electronic price tag to be notified is determined based on binding information between the electronic price tag and the product and the product information list transmitted by the received AIoT management server; and an association module configured to transmit the captured image and the recognition result to the product information management system so that the product information management system associates the electronic price tag with the product. A product image information collection device comprising:

12. A computing device including a memory, a processor, and a computer program stored in the memory and executable by the processor, When the computer program is executed by the processor, the product image information collecting method according to claim 10 is realized.

1. A computer device comprising:

13. A computer program is stored which, when executed by a processor, realizes the product image information collection method according to claim 10. A computer-readable storage medium comprising:

14. A computer program product image information collecting method according to claim 10, when executed by a processor.

Images