Geographical indication product ar visualization traceability display method and system

Abstract

The application discloses a kind of geographical indication product AR visualization traceability display method, comprising the following steps: obtaining the traceable production information and multi-view image sequence of geographical indication product, setting the unique identity code of geographical indication area given for each minimum geographical indication product, and the unique identity code is uploaded to block chain network, form unalterable storage record and generate corresponding query code;Scan the unique identity code of geographical indication product and generate chain access application, verify the legality and authenticity of chain application;Establish the mapping relationship between the virtual image and real image of geographical indication product, real-time estimate six-axis pose data of geographical indication product relative to AR terminal;Geographical indication product and traceable production information are rendered on AR terminal screen.The application can quickly and accurately trace the identification of geographical indication product, solves the technical problems of dynamic scene tracking failure, anti-fake and display fragmentation.

Description

Technical Field

[0001] This invention belongs to the field of geographical indication product traceability and identification technology, specifically involving an AR visualization traceability display method and system for geographical indication products. Background Technology

[0002] Geographical indication (GI) products, due to their unique origin association and high quality, are primarily used to identify the place of origin of a product, serving as a geographical indication. GI products often possess significant brand premium potential and are characterized by high value and a high degree of information technology in their production chain. Traceability information for GI products can be collected by IoT devices. The collected electronic data itself has advantages such as fast transmission speed, large information storage capacity, and diverse presentation formats. However, electronic data also has characteristics such as fragility in authenticity verification, ease of tampering, and strong replicability. Therefore, during the traceability process of GI products, traceability information may be tampered with. The lack of effective supervision and verification of the authenticity of GI products purchased by consumers leads to frequent counterfeiting and imitation in the market, seriously harming consumer rights and the interests of producers in the place of origin.

[0003] Currently, existing geographical indication products are mainly displayed continuously, stably, and accurately through augmented reality (AR) traceability technology. However, AR traceability largely relies on QR code triggering or pure visual SLAM positioning. QR codes are easily copied and counterfeited, failing to provide reliable anti-counterfeiting guarantees; pure visual SLAM positioning is prone to data frame delays or severe discrepancies between reality and virtuality. Therefore, there is a lack of effective means to authenticate geographical indication products themselves, hindering consumers' reliable identification of the authenticity of geographical indication products. Furthermore, it is impossible to guarantee the authenticity of agricultural products while ensuring their legality, compliance, and the security of their sourcing channels. Therefore, how to achieve reasonable information display and sharing while ensuring data security is a crucial issue that geographical indication product traceability technology needs to consider. Summary of the Invention The purpose of this invention is to provide an AR-based visual traceability display method and system for geographical indication products. This invention enables rapid, accurate, and convenient traceability identification of the origin and the entire lifecycle data of geographical indication products, solving the technical problems of tracking failure in dynamic scenarios and the disconnect between anti-counterfeiting and display. To achieve the above objectives, this invention adopts the following technical solution: According to one aspect of the present invention, an AR visualization traceability display method for geographical indication products is disclosed, the traceability display method comprising the following steps: Step 1: Obtain traceable production information and multi-view image sequences for geographical indication products. Based on the production information, set a unique identification code for each smallest geographical indication product, assigning it to the geographical indication area. Upload the unique identification code to the blockchain network to form an immutable evidence record and generate a corresponding query code. Step 2: Scan and collect the unique identification code of the geographical indication product and generate an on-chain access application. When the blockchain network receives the on-chain application and the pre-stored query code, and verifies that the query code matches the unique identification code, it scans the multi-angle image of the geographical indication product corresponding to the current unique identification code and generates a spatial trigger anchor point to verify the legality and authenticity of the on-chain access application. Step 3: The AR terminal establishes a mapping relationship between the virtual image and the real image of the geographical indication product through spatial trigger anchor points, and estimates the six-axis pose data of the geographical indication product relative to the AR terminal in real time based on the mapping relationship. Step 4: During the pose data estimation process, the geographical indication product and traceable production information are rendered on the AR terminal screen in an augmented reality manner, and the verification result of the unique identification code is simultaneously overlaid on the screen display.

[0004] A further preferred embodiment of the above scheme involves obtaining traceable production information and multi-view image sequences for geographical indication products, and assigning a unique identification code to each smallest geographical indication product based on the production information, specifically including the following steps: Based on the differences in the natural environment for the growth of geographical indication products in the research area, different growth distribution maps were drawn up. Electronic fences for the production of geographical indication products were planned within the distribution maps, and production information of geographical indication products within each electronic fence and multi-view image sequences of the production process were obtained. Based on multi-view image sequences, a visual feature description set is extracted from the corresponding electronic fence, and virtual three-dimensional morphological information is established for each geographical indication product within the electronic fence based on the visual feature description set. Each geographical indication product within an electronic fence is assigned a unique location tag when it leaves the electronic fence. Based on production information and multi-view image sequences, each geographical indication product within an electronic fence is classified and identified, and the corresponding location tag is configured to form the smallest packaging sales unit of the geographical indication product. Then, a unique identification code is assigned to each smallest packaging sales unit of the geographical indication product.

[0005] In a further preferred embodiment of the above scheme, the pose data includes the pose of the geographical indication product, the pose of the AR terminal, and the relative pose between the two. The verification result is presented in the form of a color-coded graphic or text, and the rendered display location is located outside the spatial trigger anchor point.

[0006] In a further preferred embodiment of the above scheme, the spatial triggering anchor point is selected from one or more of the following: geometric feature points on the surface of the geographical indication product packaging, attached QR code / AR mark, embedded UWB tag, physical location of RFID chip or NFC chip.

[0007] In a further preferred embodiment of the above scheme, when estimating the six-axis pose data of the geographical indication product relative to the AR terminal in real time, the six-axis pose data of the AR terminal is also normalized to obtain a motion feature normalization value α, including the following steps: When the normalized value α ≥ the first preset threshold a1, it is determined that the production information of the geographical indication product is in good consistency and the AR interface displays a green verification mark. When the second preset threshold a2 ≤ six-axis pose data and α < the first preset threshold a1, it is determined that the production information of the geographical indication product is slightly inconsistent and a "motion verification abnormality" is prompted. Please note whether the product has been replaced. When the six-axis pose data α < the first preset threshold a1, it is judged as a serious inconsistency, triggering a red anti-counterfeiting alarm and interrupting the AR display.

[0008] In a further preferred embodiment of the above scheme, if the verification query code does not match the unique identification code, the AR display is interrupted and a red warning interface is displayed.

[0009] A further preferred embodiment of the above scheme is to display traceable production information on the physical geographical indication product in a timeline animation format on the screen in a virtual-real fusion manner.

[0010] According to another aspect of the present invention, an AR visualization traceability display system for geographical indication products is provided. This AR visualization traceability display system is used to execute an AR visualization traceability display method for geographical indication products according to the present invention. The AR visualization traceability display system includes: Data acquisition device for performing multi-view image sequence acquisition at the production end of geographical indication products; A growth monitoring server is used to store production information and multi-view images of geographical indication products; The landmark monitoring server is used to generate a unique identification code based on production information and the instructions for using the management mark uploaded from multiple perspectives; A blockchain network is used to store unique identification codes corresponding to traceable production information, forming an immutable evidence record, and generating corresponding query codes. The AR terminal is equipped with an application for on-chain access application, which guides users to scan multi-angle images of the geographical indication product, performs local visual tracking and augmented reality rendering, and displays the verification result of the unique identification code.

[0011] In a further preferred embodiment of the above scheme, the AR terminal includes an image sensor, an inertial measurement unit, a processor, a display, and a wireless communication interface. The processor is used to communicate with the blockchain network and run an application that enables visual traceability display.

[0012] In summary, the present invention adopts the above technical solution, and the present invention has the following technical effects: The AR visualization display solution for traceability information of this invention is no longer limited to static labels. It solves the technical problems of tracking failure in dynamic scenes and the disconnect between anti-counterfeiting and display. It can quickly, accurately, and conveniently identify the origin and the authenticity of the entire life cycle data of geographical indication products, providing new technical support for the intelligent traceability identification of geographical indication products. It truly realizes the full traceability of geographical indication products and achieves comprehensive control over the quality of traceable products. This invention can accurately and stably render traceability information and verification results spatially on the product entity, realizing an immersive and highly reliable interactive experience. Attached Figure Description

[0013] Figure 1 This is a flowchart illustrating an AR visualization traceability display method for geographical indication products according to the present invention. Figure 2 This is a system principle diagram of an AR visualization traceability display system for geographical indication products according to the present invention. Detailed Implementation

[0014] To make the objectives, technical solutions, and advantages of this invention clearer, the invention will be further described in detail below with reference to the accompanying drawings and preferred embodiments. However, it should be noted that many details listed in the specification are merely to provide the reader with a thorough understanding of one or more aspects of the invention, and these aspects of the invention can be implemented even without these specific details.

[0015] Combination Figure 1 As shown, according to a geographical indication product AR visualization traceability display method of the present invention, the traceability display method includes the following steps: Step 1: Obtain traceable production information and multi-view image sequences for geographical indication products. Based on the production information, assign a unique identification code to each smallest geographical indication product, and upload the unique identification code to the blockchain network to form an immutable evidence record, while generating a corresponding query code. In this embodiment of the invention, assigning a unique identification code to each smallest geographical indication product based on the production information specifically includes the following steps: To address the differences in the natural environment for the growth of geographical indication products in the research area, the growth areas of geographical indication products are divided into different growth distribution maps. Electronic fences for the production of geographical indication products are planned within these growth distribution maps. Production information and multi-view image sequences of the production process are acquired within each electronic fence. Dividing the growth distribution maps allows for differentiated understanding of soil temperature and humidity, altitude, latitude and longitude, wind speed, and light distribution in the geographical indication research area. Virtual electronic fences are then planned for geographical indication products within the growth distribution maps, thereby generating electronic fence information for the geographical indication's place of origin. Soil temperature and humidity sensors, wind speed sensors, altimeters, BeiDou positioning devices, and light sensors are used to monitor the environmental information of geographical indication products growing within the electronic fences in real time. Network monitoring equipment at different locations collects image sequences from different perspectives in real time, and the collected environmental information and image sequences are periodically uploaded to the growth monitoring server at the geographical indication product growth end via a network communication module, periodically storing the temporal characteristics of geographical indication product growth. Visual feature description sets for geographical indication products within electronic fences are extracted based on multi-view image sequences. Virtual three-dimensional morphological information is then established for each product within the electronic fence based on these visual feature description sets, and this information is shared and stored on a growth monitoring server. The virtual three-dimensional morphological information includes growth information for the geographical indication products, such as plant height, leaf area, stem diameter, leaf color, fruit color, size, environmental information, and production care data extracted for crops (tea, citrus, etc.), as well as post-harvest testing and circulation data. This provides an intuitive display of the three-dimensional morphological growth of the geographical indication products. Environmental information includes, but is not limited to, soil temperature and humidity, pH value, light intensity, air temperature and humidity, and rainfall data. Production care data includes: seed / seedling source, fertilization / weeding records, pest and disease control records, harvesting time, and processing parameters. Quality testing data includes: physicochemical index test results, sensory evaluation data, and safety index test data. Circulation data includes: production time, batch number, logistics trajectory, and sales terminal information. Each geographical indication product within an electronic fence is assigned a unique location tag upon leaving the fence. Based on production information and multi-view image sequences, each geographical indication product within the electronic fence is categorized and labeled with a corresponding location tag, ensuring that each product within the electronic fence area has a corresponding location tag, forming the smallest packaging sales unit of the geographical indication product. This enables automatic tracking of geographical indication products from growth to harvest, improving data accuracy and reliability. Then, each smallest packaging sales unit of the geographical indication product is assigned a unique identification code. The geographical indication user uploads the categorized and labeled geographical indication product's growth information, image sequences, and smallest packaging sales unit information to the geographical indication rights holder's geographical indication supervision server to apply for a geographical indication usage instruction. After approving the application instruction, the geographical indication rights holder issues the unique identification code corresponding to the smallest packaging sales unit of the geographical indication product to the geographical indication user and simultaneously uploads the unique identification code to the blockchain network, enabling the growth monitoring server and geographical indication supervision server to match the geographical indication product's location tag, growth information, visual feature description, and other data with the unique identification code. Step 2: The AR terminal scans and collects the unique identification code of the geographical indication product and generates an on-chain access application. When the blockchain network receives the on-chain application and the pre-stored query code, it verifies that the query code matches the unique identification code. It then scans multi-angle images of the geographical indication product corresponding to the current unique identification code and generates a spatial trigger anchor point. The query code attached to the unique identification code is compared with the pre-stored query code, and the obtained identification code is compared with the unique identification code stored in the blockchain network. Only after successful verification can further scanning and verification be performed to verify the legality and authenticity of the on-chain access application. If the verification query code does not match the unique identification code, the AR display is interrupted and a red warning interface is displayed. If the verification query code matches the unique identification code, user interaction preferences (including but not limited to user attention to the taste, color, nutritional components, etc. of the geographical indication product) can be filled into the virtual 3D morphological information. The virtual 3D morphological information is displayed according to the priority of the interaction preferences. Step 3: The AR terminal establishes a mapping relationship between the virtual 3D morphological information (virtual image) of the geographical indication product and the real image through spatial trigger anchor points. When establishing the mapping relationship, the AR terminal obtains the current location information and establishes virtual location sharing with the location tag corresponding to the electronic fence. The AR terminal can obtain the virtual location of the geographical indication product, thereby knowing and obtaining the growth location area of ​​the geographical indication product. Based on the mapping relationship, the six-axis pose data of the geographical indication product relative to the AR terminal is estimated in real time. The pose data includes the pose of the geographical indication product, the pose of the AR terminal, and the relative pose of the two. The spatial trigger anchor points are selected from one or more of the following: geometric feature points on the surface of the geographical indication product packaging, attached QR codes / AR tags, embedded UWB tags, RFID chips, or the physical location of NFC chips. Step 4: During the pose data estimation process, the geographical indication product and traceable production information are rendered on the AR terminal screen using augmented reality. The verification result of the unique identification code is simultaneously overlaid on the screen display. The verification result is displayed as a color-coded graphic or text. The rendered display position is located outside the spatial trigger anchor point. In this invention, when estimating the six-axis pose data of the geographical indication product relative to the AR terminal in real time, the six-axis pose data of the AR terminal is also normalized to obtain a motion feature normalization value α. Specifically, this includes the following steps: When the normalized value α ≥ the first preset threshold a1 (a1 = 0.85α), it is determined that the production information of the geographical indication product is in good consistency and the AR interface displays a green verification mark. When the second preset threshold a2 ≤ six-axis pose data and α < the first preset threshold a1, it is determined that the production information of the geographical indication product is slightly inconsistent and a "motion verification abnormality" is prompted. Please note whether the product has been replaced. When the six-axis attitude data α < the first preset threshold a1 (a1 < 0.55α), it is judged as seriously inconsistent, triggering a red anti-counterfeiting alarm and interrupting the AR display.

[0016] To address this, this invention utilizes posture data normalization processing. Its anti-counterfeiting status is no longer limited to static labels but also incorporates dynamic AR visual elements that continuously track real-world feature areas. Attempts to forge or interrupt the experience will cause the AR visual scene to disappear or become ineffective, thus eliminating the possibility of counterfeiting or deception. In this invention, traceable production information is layered on top of the geographical indication product in a virtual-real fusion manner using a timeline animation on the screen. The timeline animation showcases key nodes throughout the entire process from planting to processing and packaging, displaying textual and graphic records of the geographical indication product's growth process, as well as on-site images or visual evidence. The priority of each layer is dynamically adjusted based on user interaction preferences. The virtual three-dimensional form of the geographical indication product, including but not limited to product growth animation, processing animation, growth environment simulation, and growth care, is precisely superimposed onto the real product. The product's anti-counterfeiting verification status is continuously tracked and formed into AR visual elements. This invention achieves stable rendering of AR visual content, and the AR visual content continuously tracks the characteristics of the real geographical indication product, achieving a highly anti-counterfeiting and robust AR traceability experience for geographical indication products.

[0017] According to another aspect of the invention, in combination Figure 1 and Figure 2 As shown, the present invention provides an AR visualization traceability display system for geographical indication products. The AR visualization traceability display system is used to execute an application program of the AR visualization traceability display method for geographical indication products of the present invention. The AR visualization traceability display system includes a data acquisition device, a growth monitoring server, a geographical indication supervision server, a blockchain network, and a mobile AR terminal. The data acquisition device is used to perform multi-view image sequence acquisition at the production end of geographical indication products; the data acquisition device includes, but is not limited to, soil temperature and humidity sensors, wind speed sensors, altimeters, Beidou positioning devices, light sensors, and network monitoring equipment; The growth monitoring server is used to store production information and multi-view images of geographical indication products; the geographical indication supervision server is used to generate a unique identification code based on the production information and the geographical indication usage instructions uploaded from the multi-view images. A blockchain network is used to store unique identification codes corresponding to traceable production information, forming an immutable evidence record, and generating corresponding query codes. The AR terminal is equipped with an application for on-chain access application. It establishes a mapping relationship between the virtual three-dimensional morphological information (virtual image) of the geographical indication product and the real image. When establishing the mapping relationship, it obtains the current location information of the AR terminal and uploads the current location information to the growth monitoring server. It establishes virtual location sharing between the current location information and the location tag corresponding to the electronic fence. The AR terminal can obtain the virtual location of the geographical indication product, thereby guiding users to scan multi-angle images of the geographical indication product, performing local visual tracking and augmented reality rendering, and displaying the verification result of the unique identification code. The AR terminal includes an image sensor, an inertial measurement unit, a processor, a display, and a wireless communication interface. The processor is used to communicate with the blockchain network and run an application to realize visual traceability display. The AR terminal is a smartphone, tablet computer, or head-mounted augmented reality device.

[0018] The above description is only a preferred embodiment of the present invention. It should be noted that for those skilled in the art, several improvements and modifications can be made without departing from the principle of the present invention, and these improvements and modifications should also be considered within the scope of protection of the present invention.

Claims

1. A method for AR-based visual traceability display of geographical indication products, characterized in that: The source tracing and display method includes the following steps: Step 1: Obtain traceable production information and multi-view image sequences for geographical indication products. Based on the production information, set a unique identification code for each smallest geographical indication product, assigning it to the geographical indication area. Upload the unique identification code to the blockchain network to form an immutable evidence record and generate a corresponding query code. Step 2: Scan and collect the unique identification code of the geographical indication product and generate an on-chain access application. When the blockchain network receives the on-chain application and the pre-stored query code, and verifies that the query code matches the unique identification code, it scans the multi-angle image of the geographical indication product corresponding to the current unique identification code and generates a spatial trigger anchor point. Step 3: The AR terminal establishes a mapping relationship between the virtual image and the real image of the geographical indication product through spatial trigger anchor points, and estimates the six-axis pose data of the geographical indication product relative to the AR terminal in real time based on the mapping relationship. Step 4: During the pose data estimation process, the geographical indication product and traceable production information are rendered on the AR terminal screen in an augmented reality manner, and the verification result of the unique identification code is simultaneously overlaid on the screen display.

2. The AR visualization traceability display method for geographical indication products according to claim 1, characterized in that: Obtain traceable production information and multi-view image sequences for geographical indication products, and assign a unique identification code to each smallest geographical indication product based on the production information. The specific steps include the following: Based on the differences in the natural environment for the growth of geographical indication products in the research area, different growth distribution maps were drawn up. Electronic fences for the production of geographical indication products were planned within the distribution maps, and production information of geographical indication products within each electronic fence and multi-view image sequences of the production process were obtained. Based on multi-view image sequences, a visual feature description set is extracted from the corresponding electronic fence, and virtual three-dimensional morphological information is established for each geographical indication product within the electronic fence based on the visual feature description set. Each geographical indication product within an electronic fence is assigned a unique location tag when it leaves the electronic fence. Based on production information and multi-view image sequences, each geographical indication product within an electronic fence is classified and identified, and the corresponding location tag is configured to form the smallest packaging sales unit of the geographical indication product. Then, a unique identification code is assigned to each smallest packaging sales unit of the geographical indication product.

3. The AR visualization traceability display method for geographical indication products according to claim 1, characterized in that: The pose data includes the pose of the geographical indication product, the pose of the AR terminal, and the relative pose between the two. The verification result is presented in the form of a color-coded graphic or text, and the rendered display location is located outside the spatial trigger anchor point.

4. The AR visualization traceability display method for geographical indication products according to claim 1 or 3, characterized in that: The spatial trigger anchor point is selected from one or more of the following: geometric feature points on the surface of the geographical indication product packaging, attached QR code / AR mark, embedded UWB tag, physical location of RFID chip or NFC chip.

5. A method for AR visualization and traceability display of geographical indication products according to claim 1 or 3, characterized in that: When estimating the six-axis pose data of the geographical indication product relative to the AR terminal in real time, the six-axis pose data of the AR terminal is also normalized to obtain the motion feature normalization value α, including the following steps: When the normalized value α ≥ the first preset threshold a1, it is determined that the production information of the geographical indication product is in good consistency and the AR interface displays a green verification mark. When the second preset threshold a2 ≤ six-axis pose data and α < the first preset threshold a1, it is determined that the production information of the geographical indication product is slightly inconsistent and "motion verification abnormal" is prompted. Please note whether the product has been replaced. When the six-axis pose data α < the first preset threshold a1, it is judged as a serious inconsistency, triggering a red anti-counterfeiting alarm and interrupting the AR display.

6. The AR visualization traceability display method for geographical indication products according to claim 1, characterized in that: If the verification query code does not match the unique identification code, the AR display will be interrupted and a red warning interface will be displayed.

7. The AR visualization traceability display method for geographical indication products according to claim 1, characterized in that: The traceable production information is displayed on the physical geographical indication product in a timeline animation on the screen, using a virtual-real fusion approach.

8. An AR visualization traceability display system for geographical indication products, characterized in that: The AR visualization traceability display system is used to execute the AR visualization traceability display method for geographical indication products as described in any one of claims 1 to 7. The AR visualization traceability display system includes: Data acquisition device for performing multi-view image sequence acquisition at the production end of geographical indication products; A growth monitoring server is used to store production information and multi-view images of geographical indication products; The landmark monitoring server is used to generate a unique identification code based on production information and the instructions for using the management mark uploaded from multiple perspectives; A blockchain network is used to store unique identification codes corresponding to traceable production information, forming an immutable evidence record, and generating corresponding query codes. The AR terminal is equipped with an application for on-chain access application, which guides users to scan multi-angle images of the geographical indication product, performs local visual tracking and augmented reality rendering, and displays the verification result of the unique identification code.

9. The AR visualization traceability display system for geographical indication products according to claim 8, characterized in that: The AR terminal includes an image sensor, an inertial measurement unit, a processor, a display, and a wireless communication interface. The processor is used to communicate with the blockchain network and run an application that enables visual traceability display.

Images