Multi-modal identification data anti-counterfeiting traceability method, system and device and medium
By embedding associated data and label location credentials into the anti-counterfeiting and traceability system, combined with blockchain verification, two-way traceability and identity verification of product packaging are achieved, solving the problems of easy label replacement and limited information, and improving the security and transparency of anti-counterfeiting and traceability.
Patent Information
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- FOSHAN YUHE TECHNOLOGY CO LTD
- Filing Date
- 2025-12-29
- Publication Date
- 2026-04-17
AI Technical Summary
In existing anti-counterfeiting and traceability systems, labels are easily torn off and replaced maliciously, the correlation between multi-level packaging is weak and one-way, and it cannot meet the needs for comprehensive information and two-way query. The verification information is limited and cannot meet the needs of logistics unpacking verification and warehouse rapid inventory.
By employing a multimodal recognition method, dynamic location binding and bidirectional hierarchical association are achieved by embedding associated data and label location credentials into the label information at each packaging level. Combined with blockchain network verification, identity anti-counterfeiting verification and physical location consistency verification are performed, generating data that includes upward traceability and downward tracing.
It enables two-way traceability of product packaging, improves the accuracy and reliability of anti-counterfeiting verification, enhances information transparency, meets the real-time verification needs of logistics and warehouse management, and improves user experience.
Smart Images
Figure CN121883033A_ABST
Abstract
Description
Technical Field
[0001] This application relates to the fields of industrial automation and anti-counterfeiting traceability technology, and in particular to a multimodal recognition data anti-counterfeiting traceability method, system, device and medium. Background Technology
[0002] In the fields of industrial automation and anti-counterfeiting traceability technology, anti-counterfeiting traceability systems are crucial for ensuring the authenticity and traceability of products. With the rapid development of industries such as manufacturing, logistics warehousing, and commodity circulation, the demand for product anti-counterfeiting traceability is increasing daily. An effective anti-counterfeiting traceability system can help companies improve product safety and credibility, protect consumer rights, and also assist regulatory authorities in effectively supervising the market. In the logistics process, accurate traceability information can improve logistics efficiency and reduce the risk of lost or damaged goods; in the commodity circulation sector, consumers can use traceability systems to understand the origin and quality of products, enhancing their trust in the products.
[0003] In existing anti-counterfeiting and traceability systems, QR codes, RFID, or NFC tags are commonly used for product identification. These tags are typically affixed to the product for identification and tracking. Regarding the association of multiple packaging levels, this often relies on manual data entry or simple barcode scanning. For example, during the process of packaging a product from a single item to a box or stack, manual recording or barcode scanning is needed to establish connections between different levels of packaging. During the verification process, the verification typically only returns the authenticity result, mainly by simply comparing the label information to determine the product's authenticity.
[0004] However, these existing technologies have many drawbacks. The fixed label positions in existing systems make them easy to be maliciously replaced with other counterfeit products, thus reducing the reliability of anti-counterfeiting measures. Furthermore, the hierarchical relationships between multi-level packaging are weak and unidirectional, relying heavily on manual data entry or simple barcode scanning, and typically only allowing upward traceability. It's impossible to directly obtain information from lower-level packaging through higher-level packaging, failing to meet the needs of comprehensive information and two-way querying in practical applications. Simultaneously, the returned verification information is limited; the verification process usually only returns the authenticity result, without providing detailed information about the items inside the packaging, failing to meet the needs of logistics unpacking verification and rapid warehouse inventory checks. Summary of the Invention
[0005] The purpose of this application is to provide a multimodal recognition data anti-counterfeiting and traceability method that can achieve simultaneous identity anti-counterfeiting verification and reliable packaging content verification in a single scanning operation through dynamic location binding and bidirectional hierarchical association, while reducing the occurrence of malicious replacement of anti-counterfeiting labels.
[0006] Firstly, this application provides a multimodal recognition-based data anti-counterfeiting and traceability method, which adopts the following technical solution: A multimodal recognition-based data anti-counterfeiting and traceability method includes: Generate label information for each packaging level of the product, wherein the label information includes the association data of the current packaging level of the product and the label location certificate. The association data is used for identity verification of the association of each packaging level, and the label location certificate is used for consistency verification of the physical location of each packaging level. Based on the label information of each packaging level of the product, code is assigned to the corresponding packaging level; In response to scanning the anti-counterfeiting label on the product packaging to obtain label information, the product packaging is verified for authenticity based on the label information. If the product packaging passes the anti-counterfeiting verification, then based on the associated data, query and return the associated data and item list for each packaging level associated with the product.
[0007] By adopting the above technical solution, each layer of packaging carries associated data for hierarchical identity verification and label location credentials for physical location consistency verification. This not only enables anti-counterfeiting verification of product packaging but also confirms whether the anti-counterfeiting label has been maliciously tampered with based on physical location verification. After both verifications are successful, the associated data and item list of each packaging layer associated with the product can be queried and returned, thereby achieving two-way traceability of the product. This allows scanning device users to obtain the authenticity status and packaging contents information with a single scan, improving the user experience.
[0008] In a preferred embodiment, this application can be further configured such that the step of generating label information for each packaging layer of the product includes: The verified level hash value corresponding to the current packaging level is obtained from the blockchain network and set as the associated data of the current packaging level. The verified level hash value is calculated and generated based on the hash value of the previous packaging level, the unique identifier of the current packaging level, and the level index. The verified hierarchical hash value is combined with the tag location credential and encoded to generate the tag information.
[0009] By adopting the above technical solution, the label information of each layer of packaging is generated by combining the verified layer hash value in the blockchain network with the label location certificate, which ensures the authenticity and immutability of the anti-counterfeiting data. This not only improves the security of the anti-counterfeiting label, but also enables precise tracking of the product packaging layers through the combination of layer index and unique identifier.
[0010] In a preferred embodiment, this application can be further configured as follows: the step of obtaining label information in response to a scanning operation of the anti-counterfeiting label on the product packaging, and performing anti-counterfeiting verification on the product packaging based on the label information, includes: Based on the associated data in the tag information, hierarchical identity verification is performed on the associated data; Based on the tag location certificate in the tag information and the measured location information reported by the scanning device performing the scanning operation, physical location consistency verification is performed. The identity verification is deemed successful only if both the associated data verification and the physical location consistency verification are successful.
[0011] By adopting the above technical solution, product packaging is verified for authenticity from two dimensions: hierarchical association and physical location. This improves the accuracy and reliability of the verification. The verification is only considered successful when both dimensions are verified, which can more effectively identify counterfeit products and ensure the security of product anti-counterfeiting traceability.
[0012] In a preferred embodiment, this application can be further configured as follows: the step of verifying the association data based on the associated data in the label information by performing authentication of the association data at various packaging levels includes: Based on the associated data in the label information scanned by the authorized scanning device, the hierarchical hash value of the current packaging level is recalculated; The recalculated hierarchical hash value is compared with the verified hash value obtained from the blockchain network; If the hierarchical hash value matches the verified hash value, then the associated data verification is successful.
[0013] By adopting the above technical solution, the verified hierarchical hash value is obtained and compared with the recalculated hierarchical hash value of the current packaging level. This effectively verifies the identity of associated data, ensures the accuracy and reliability of hierarchical association identity verification, helps improve the security of the entire anti-counterfeiting and traceability system, and ensures the effectiveness of product packaging identity anti-counterfeiting verification.
[0014] In a preferred embodiment, this application can be further configured as follows: the step of verifying physical location consistency based on the tag location certificate in the tag information and the measured location information reported by the scanning device performing the scanning operation includes: Based on the decoding rules issued by the server, the anti-counterfeiting label is decoded to obtain the associated data and label location certificate; Based on the label location certificate, the theoretical position coordinates of the anti-counterfeiting label are obtained, and the theoretical position coordinates are compared with the measured position coordinates reported by the scanning device to obtain the coordinate deviation value. If the coordinate deviation value is within the preset tolerance range, the physical location consistency verification is deemed successful.
[0015] By adopting the above technical solution, the anti-counterfeiting label can be decoded based on the decoding rules issued by the server to obtain associated data and label location credentials, thereby obtaining the theoretical position coordinates of the anti-counterfeiting label. Then, the theoretical position coordinates are compared with the measured position coordinates reported by the scanning device to obtain the coordinate deviation value. When the coordinate deviation value is within the preset tolerance range, the physical position consistency verification is determined to be passed, thus realizing the consistency verification of the physical position of the product packaging, improving the security of the anti-counterfeiting traceability system, and preventing the label from being maliciously torn or replaced.
[0016] In a preferred embodiment, this application can be further configured as follows: if the anti-counterfeiting verification of the product packaging passes, the step of querying and returning the associated data and item list for each packaging level associated with the product based on the associated data includes: Based on the hierarchical information in the associated data, query the associated data of the corresponding direct parent package from the blockchain to obtain upward tracing information; Based on the unique identifier of the current packaging level, query the corresponding list of inclusion relationships in the blockchain to obtain the list of items traced downwards; The upstream traceability information is combined with the downstream item list and returned.
[0017] By adopting the above technical solution, bidirectional traceability at the product packaging level can be achieved. By querying the associated data of the direct parent packaging, upward traceability information can be obtained, and by querying the list of included relationships, a list of items for downward traceability can be obtained. Combining the two and returning them allows scanning device users to obtain complete associated data and a list of items at the packaging level with a single scan, thereby improving the information transparency and application value of the anti-counterfeiting traceability system.
[0018] In a preferred embodiment, this application can be further configured as follows: if the anti-counterfeiting verification of the product packaging passes, the step of querying and returning the associated data and item list for each packaging level associated with the product based on the associated data includes: Obtain upstream traceability information and downstream item lists, including: The upstream traceability information is obtained by querying the associated data of the direct parent package from the blockchain network, and only includes the core data fields used for hierarchical association verification, excluding the label position certificate of the parent package; The item list for downward tracing is generated by querying the inclusion relationship list from the blockchain network and extracting the core data fields for hierarchical association verification of all direct child packages, without including any label location credentials for child packages; The upstream traceability information is combined with the downstream item list and returned.
[0019] By adopting the above technical solution, after the product packaging identity anti-counterfeiting verification is passed, the upstream traceability information and the downstream traceability item list containing only the core data fields for hierarchical association verification and excluding label location vouchers can be obtained and returned together, reducing the amount of data transmission, improving query efficiency, and realizing two-way traceability of multi-level product packaging.
[0020] Secondly, this application provides a multimodal recognition data anti-counterfeiting and traceability system, which adopts the following technical solution: A multimodal recognition-based data anti-counterfeiting and traceability system includes: Label generation module: used to generate label information for each level of product packaging, wherein the label information includes the association data of the current packaging level of the product and the label location certificate. The association data is used for identity verification of the association of each level of packaging, and the label location certificate is used for consistency verification of the physical location of each level of packaging. Label coding module: Used to code the corresponding packaging layer based on the label information of each packaging layer of the product; Circulation verification module: used to obtain label information in response to scanning operation of anti-counterfeiting label on product packaging, and to perform anti-counterfeiting verification on product packaging based on the label information; Data query module: If the product packaging identity anti-counterfeiting verification is successful, it is used to query and return the associated data and item list of each packaging level associated with the product based on the associated data.
[0021] Thirdly, this application provides an electronic device that adopts the following technical solution: An electronic device includes a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor executes the computer program to implement the steps of the above-described multimodal recognition data anti-counterfeiting and traceability method.
[0022] Fourthly, this application provides a computer storage medium, as follows: A computer-readable storage medium storing a computer program, which, when executed by a processor, implements the steps of the aforementioned multimodal recognition data anti-counterfeiting and traceability method.
[0023] In summary, this application has the following beneficial technical effects: 1. This application uses hierarchical identity verification based on associated data and physical location consistency verification based on tag location credentials. It can not only trace back to the parent packaging associated data, but also trace back to the item list to achieve two-way traceability, and expand the application value of the system in inventory management, logistics verification and consumer inquiry. 2. After the scanning device scans the anti-counterfeiting label generated by the method of this application, if the identity anti-counterfeiting verification is successful, it can obtain the associated data and item list of each packaging level associated with the product. The information is transparent and controllable, improving the user experience. 3. This application uses the physical location of the label as an anti-counterfeiting element, performs physical location consistency verification, realizes dual verification of space and time, enhances the reliability and accuracy of anti-counterfeiting, and inherits the security advantages of dynamic location anti-counterfeiting and hierarchical hash chain based on blockchain network storage and verification of hierarchical hash value. Attached Figure Description
[0024] Figure 1 This is a flowchart of a multimodal recognition data anti-counterfeiting and traceability method in one embodiment of this application.
[0025] Figure 2 This is a flowchart of a sub-step of step S2 in one embodiment of this application.
[0026] Figure 3 This is a flowchart of a sub-step of step S20 in one embodiment of this application.
[0027] Figure 4 This is a flowchart of a sub-step of step S21 in one embodiment of this application.
[0028] Figure 5 This is a flowchart of a sub-step of step S211 in one embodiment of this application.
[0029] Figure 6 This is a sub-step of step S3 in one embodiment of this application. Figure 1 .
[0030] Figure 7 This is a sub-step of step S3 in one embodiment of this application. Figure 2 .
[0031] Figure 8 This is a schematic diagram of the structure of a multimodal recognition data anti-counterfeiting and traceability system according to one embodiment of this application.
[0032] Figure 9 This is a schematic block diagram of an electronic device in one embodiment of this application.
[0033] Attached labels: 1. Label generation module; 2. Label coding module; 3. Circulation verification module; 4. Data query module. Detailed Implementation
[0034] The following is in conjunction with the appendix Figure 1-9 This application will be described in further detail.
[0035] It should be noted that, in the embodiments of this invention, the data related to object information, when applied to specific products or technologies, requires the permission or consent of the object. Furthermore, the collection, use, and processing of this data must comply with the relevant laws, regulations, and standards of the relevant countries and regions. In other words, if the embodiments of this invention involve data related to an object, it must be obtained with the object's authorization and consent, the authorization and consent of relevant departments, and in accordance with the relevant laws, regulations, and standards of the country and region. If the embodiments involve personal information, the acquisition of all personal information requires the individual's consent. If sensitive information is involved, the separate consent of the information subject is required. The embodiments also need to be implemented with the object's authorization and consent.
[0036] refer to Figure 1 A multimodal recognition-based data anti-counterfeiting and traceability method, specifically including: S1. Generate label information for each packaging level of the product. The label information includes the association data of the current packaging level of the product and the label location certificate. The association data is used for identity verification of the association of each packaging level, and the label location certificate is used for consistency verification of the physical location of each packaging level.
[0037] Specifically, by embedding associated data and label location credentials into the anti-counterfeiting label simultaneously, the scanning device can collect dual key information for identity binding and spatial location verification in a single scanning action.
[0038] S2. Based on the label information of each packaging level of the product, assign codes to the corresponding packaging level.
[0039] Specifically, during the coding process, the coding device obtains the physical location data carried in the label information of each level of packaging, and injects the physical label onto the product packaging surface based on this data. Since the label position credential is not a fixed value but is related to dynamic parameters at the time of affixing, attackers cannot predict the physical location of the legitimate label. This effectively prevents the situation where genuine labels are removed from authentic products and pasted onto counterfeit products, significantly improving the anti-counterfeiting label's resistance to migration.
[0040] S3. Respond to the scanning operation of the anti-counterfeiting label on the product packaging to obtain label information, and perform anti-counterfeiting verification on the product packaging based on the label information.
[0041] Specifically, in each process of production, manufacturing, logistics, warehousing, and commodity distribution, product packaging at each level can be simultaneously verified by logging into the cloud and using authorized scanning devices. Successful verification of both the first layer of encryption based on the label's location on the product packaging and the second layer of encryption based on associated data proves that the label has neither been maliciously torn off nor maliciously counterfeited. In other words, this dual verification mechanism solves the problem of easy counterfeiting caused by relying solely on static identifiers in existing technologies. Even if a counterfeiter copies the label content, it is difficult to reproduce the legitimate spatial attachment position on a counterfeit product, thus fundamentally preventing the deceptive use of the label after it has been maliciously transferred, and significantly enhancing anti-counterfeiting reliability.
[0042] S4. If the product packaging identity verification passes, then based on the associated data, query and return the associated data and item list for each packaging level associated with the product.
[0043] Specifically, based on confirming the authenticity of the product, the system proactively provides structured two-way traceability information, including upstream packaging data for tracing back to the source, as well as a list of directly subordinate items for tracing down to the source. This breaks through the limitations of existing systems that only provide a single result of authenticity, enabling the logistics process to instantly verify the contents of the box, the warehousing operation to quickly complete inventory checks, and consumers to intuitively understand the product composition, fully meeting the needs of actual business for information integrity and two-way query capabilities.
[0044] refer to Figure 2 Furthermore, in one embodiment, step S1 is refined into the following sub-steps: S10. Obtain the verified level hash value corresponding to the current packaging level from the blockchain network and set it as the associated data of the current packaging level. The verified level hash value is calculated and generated based on the hash value of the previous level packaging, the unique identifier of the current packaging level, and the level index.
[0045] Specifically, when identity verification is initiated, the server uses the unique identifier of the current package obtained from the scan, and leverages the immutability and publicly verifiable nature of the blockchain, to query the hierarchical hash value of the package that has been stored in the coding stage. This hierarchical hash value is generated by the system in the production stage using a deterministic hash function based on the previous level hash, the current ID, and the hierarchical index, and is written to the blockchain. This ensures that the obtained reference hash value truly reflects the original coding state and serves as an immutable benchmark, providing a trusted anchor point for subsequent cryptographic verification.
[0046] The label on the innermost layer of packaging, which is actually the innermost layer of the product packaging, is generated using the unique identifier and layer index of the current packaging layer.
[0047] S11. Combine and encode the verified hierarchical hash value with the tag location credential to generate tag information.
[0048] Specifically, the server extracts associated data from the tag information uploaded by the scanning device, including the current packaging identifier, the hash value of the previous level packaging, and the current level index. It then re-executes the calculation using the same hash algorithm as the coding stage to generate the current hash value for comparison. This allows the coding logic to be reproduced on the verification side, ensuring that only the original, legally generated associated data can produce matching results. Any tampering, replacement, or forgery of the tag content will cause the calculation results to deviate, thus effectively identifying illegal or abnormal packaging.
[0049] Combining verified hierarchical hash values with label location credentials ensures the integrity and uniqueness of label information. Label information not only includes the hierarchical relationship of packaging within the supply chain but also strengthens its physical location attribute through location credentials, effectively preventing label duplication or reuse. Furthermore, the standardized algorithm used in the combination encoding process guarantees compatibility and consistency between different stages, enabling verifiers to quickly parse and confirm the authenticity of the labels, thus improving overall traceability efficiency.
[0050] refer to Figure 3 Furthermore, in one embodiment, step S3 is refined into the following sub-steps: S30. Based on the associated data in the tag information, perform hierarchical identity verification on the associated data.
[0051] Specifically, by extracting the current packaging level identifier, the hash value of the previous level, and the level index contained in the tag, the hash value of the current level is recalculated according to the preset hash chain generation rules, and compared with the corresponding hash value already stored in the blockchain to confirm whether the packaging has been correctly coded and bound in a legitimate hierarchical structure. This ensures a strong association between the identities of packaging at each level, avoiding the hierarchical relationship breakage or forgery problems caused by relying on manual input or simple scanning in traditional systems, thus effectively supporting the verification of the authenticity and integrity of multi-level packaging structures.
[0052] S31. Based on the tag location certificate in the tag information and the measured location information reported by the scanning device performing the scanning operation, perform physical location consistency verification.
[0053] Specifically, because the label affixing position is dynamically generated by a batch master random number and a microsecond-level timestamp, it is unique and unpredictable. If the label is torn off and pasted onto other products, its measured position will inevitably deviate from the theoretical value, thus being identified as abnormal by the system. Therefore, by using the decoding rules provided by the server to parse the label position certificate, the theoretical affixing position of the anti-counterfeiting label in the coordinate system of the packaging body is restored. At the same time, the scanning device reconstructs the local coordinate system by identifying the position calibration label on the packaging, and calculates the actual spatial coordinates of the anti-counterfeiting label accordingly. By comparing the deviation between the theoretical position and the measured position, the malicious transfer and reuse of the label can be effectively prevented, solving the security defect that fixed-position labels are easily copied or replaced.
[0054] S32. Identity anti-counterfeiting verification is deemed successful if and only if both the associated data verification and the physical location consistency verification are successful.
[0055] Specifically, dual verification is set as a necessary condition. The system is only allowed to determine that the current product packaging is genuine if both hierarchical association authentication and physical location consistency verification are successful. If either verification fails, the process is terminated and the product is marked as suspected counterfeit.
[0056] In addition, refer to Figure 4 Furthermore, in one embodiment, step S30 is refined into the following sub-steps: S300: Based on the associated data in the label information scanned by the authorized scanning device, recalculate the hierarchical hash value of the current packaging level.
[0057] Specifically, after scanning the anti-counterfeiting label, the authorized scanning device uploads the encrypted label image or original code stream to the server. The server then parses the label content according to the decoding rules corresponding to the product batch, separating the associated data for hierarchical verification and the label location certificate for location verification. The decoding rules include coordinate index mapping logic and key verification methods, but do not expose the original random number or the complete algorithm, further reducing the risk of decoding rule leakage.
[0058] In one embodiment, the server extracts associated data from the tag information uploaded by the scanning device, including the current packaging identifier, the hash value of the previous level packaging, and the current level index. It then re-executes the calculation according to the hash algorithm that is completely consistent with the coding stage to generate the current hash value for comparison. This enables the coding logic to be reproduced on the verification end, ensuring that only the original and legally generated associated data can produce matching results. Any tampering, replacement, or forgery of the tag content will cause the calculation result to deviate, thereby effectively identifying illegal or abnormal packaging.
[0059] S301. Compare the recalculated hierarchical hash value with the verified hash value obtained from the blockchain network.
[0060] Specifically, the system performs a bit-by-bit consistency check between the locally recalculated hash value and the proven hash value retrieved from the blockchain to determine whether the two are completely identical, thereby confirming whether the hierarchical association data of the current packaging remains intact and has not been tampered with by intermediate links.
[0061] S302. If the hierarchical hash value and the verified hash value are consistent, then the associated data verification is successful.
[0062] Specifically, a completely identical hash value is pre-set as the only pass condition. Only when the comparison results match is the current packaged hierarchical identity deemed legitimate and valid, allowing the subsequent location verification to continue; otherwise, it is judged as an association anomaly, the process is terminated and it is marked as suspected forgery.
[0063] In addition, refer to Figure 5 Furthermore, in one embodiment, step S31 is refined into the following sub-steps: S310. Based on the decoding rules issued from the server, decode the anti-counterfeiting label to obtain associated data and label location credentials.
[0064] Specifically, the server parses the anti-counterfeiting label content according to the decoding rules issued by the server, extracts the label location certificate, and combines it with the verification parameters corresponding to the product batch to reconstruct the theoretical affixing position of the anti-counterfeiting label at the time of coding, which is generated by a deterministic hash function using a high-entropy master random number and a microsecond-level timestamp. Furthermore, the theoretical affixing position is located in the packaging coordinate system defined with the position calibration label as the origin, and is within the predefined valid labeling area for this packaging type.
[0065] When a user performs a scan verification, the scanning device prompts the user to scan the position calibration label and anti-counterfeiting label located on the product packaging. This guides the scanning device to simultaneously capture both the position calibration label and the anti-counterfeiting label, which are fixed to the product packaging. The position calibration label is used for subsequent spatial coordinate system reconstruction, while the anti-counterfeiting label is used to extract the data required for verification. These prompts ensure that the scanning device acquires complete visual or radio frequency information to support subsequent positioning calculations.
[0066] For RFID scanners and other barcode scanning devices, a clear scanning area frame will be displayed on the screen, guiding the user to align the scanner with the position calibration label for scanning. Simultaneously, for anti-counterfeiting labels, scanning prompts will provide corresponding guidance based on the label type. For example, if the anti-counterfeiting label is in QR code form, the user will be prompted to clearly align the scanner's camera with the QR code, ensuring the entire QR code is captured, such as using a mobile phone or other camera. If the anti-counterfeiting label is a specific pattern or text combination, the user will be prompted to adjust the angle and distance so that the scanner can clearly capture the key information of the anti-counterfeiting label. This ensures that the scanner can accurately obtain relevant information from both the position calibration label and the anti-counterfeiting label, providing reliable data support for subsequent verification processes.
[0067] In this embodiment, the server uses decoding rules to map the coordinate index in the label location certificate to the theoretical attachment position in the packaging body coordinate system. The scanning device, by recognizing a fixed position calibration label on the packaging, such as an ArUco code at the diagonal vertex or an NFC tag, and using multimodal recognition methods, reconstructs the same packaging body coordinate system with the calibration label as the origin, calculates the measured position coordinates of the anti-counterfeiting label center in the packaging body coordinate system, and then reports it.
[0068] S311. Based on the label location certificate, obtain the theoretical position coordinates of the anti-counterfeiting label, compare the theoretical position coordinates with the measured position coordinates reported by the scanning device, and obtain the coordinate deviation value.
[0069] Specifically, the server compares the offsets of theoretical and measured coordinates in each dimension within a unified coordinate system to form a coordinate deviation value. In one embodiment, when a position calibration label is identified and calibration is successful, a temporary coordinate system is established with the position calibration label as the origin, and the measured position coordinates are obtained through this temporary coordinate system. After successfully identifying a unique position calibration label, the scanning device uses this label as a reference point and, in conjunction with the packaging's shape features, constructs a packaging body coordinate system with the calibration label as the origin. The spatial coordinates of the anti-counterfeiting label's center point are then calculated within this packaging body coordinate system as the measured position coordinates.
[0070] Then, based on the location calibration label as the origin, the standard packaging CAD model corresponding to the decoded product information is loaded. The geometric structure and size parameters provided by the CAD model are used to help calculate the complete direction and scale of the packaging coordinate system, so as to construct a more accurate packaging body coordinate system, and calculate the three-dimensional spatial coordinates of the anti-counterfeiting label center point in the coordinate system as the measured position coordinates.
[0071] The label location certificate is obtained through decoding rules. The label location certificate is a random number based on the timestamp at the time of registration and the batch of the product. The theoretical position coordinates of the anti-counterfeiting label are generated by a hash function in the packaging coordinate system defined by the position calibration label on the product packaging as the origin.
[0072] The measured location coordinates are compared with the theoretical location coordinates to obtain the coordinate deviation value. In other words, by comparing the theoretical location coordinates with the measured location coordinates to obtain the coordinate deviation value, the consistency of the physical location is verified. This achieves a dual verification judgment that is linked to both spatial and temporal dimensions, thereby improving the security of anti-counterfeiting and traceability and reducing the risk of labels being maliciously replaced.
[0073] S312. If the coordinate deviation value is within the preset tolerance range, the physical position consistency verification is deemed to have passed.
[0074] Specifically, a reasonable spatial tolerance threshold is set according to the packaging type. When the deviation between the theoretical position and the measured position on each coordinate axis does not exceed the preset spatial tolerance threshold, the anti-counterfeiting label is considered to be in a legal affixation state, and the physical position consistency verification is successful; otherwise, it is considered abnormal and the verification is judged to have failed.
[0075] In addition, refer to Figure 6 Furthermore, in one embodiment, step S4 is refined into the following sub-steps: S40. Based on the hierarchical information in the associated data, query the associated data of the corresponding direct parent package from the blockchain to obtain the upstream tracing information.
[0076] Specifically, once the identity verification is successful, the associated data in the current packaging label is parsed to extract the upper-level packaging identifier pointed to by the associated data. Using this identifier as an index, the corresponding stored parent packaging associated data is retrieved in the blockchain network.
[0077] The associated data includes core fields for hierarchical verification, such as the parent hash value, batch information, and timestamp, but does not include the parent's label location credential. The parent's label location credential is only returned when the anti-counterfeiting code on the parent packaging is scanned, allowing for more granular location traceability verification. The acquired information constitutes key nodes in the upward traceability path.
[0078] S41. Based on the unique identifier of the current packaging level, query the corresponding inclusion relationship list from the blockchain to obtain the item list that can be traced downwards.
[0079] Specifically, using the unique identifier of the current packaging as the primary key, the system searches the blockchain for a list of containment relationships bound to the unique identifier. This list records the identifiers of all direct child packaging and the core data fields used for hierarchical association verification. Based on this, a structured item list is generated, which includes the type, quantity, and verification status of the child packaging, but does not contain any child label location credentials. Only when the anti-counterfeiting code of a child packaging is scanned will the child label location credentials be returned for more granular location traceability verification.
[0080] S42. Combine the upstream traceability information with the downstream item list and return it.
[0081] Specifically, the upstream traceability information obtained from the blockchain is structurally integrated with the downstream item list to form a unified data view that includes the current packaging, upstream source, and downstream components. This view is then returned to the scanning device in one go via a scanning interface, allowing users to obtain complete related data at the packaging level and an item list with a single scan. Furthermore, the returned data is organized according to hierarchical topology, ensuring information integrity and ease of parsing.
[0082] In addition, refer to Figure 7 Furthermore, in one embodiment, step S4 is refined into the following sub-steps: S43. Obtain upstream traceability information and a list of items for downstream tracing, including: The upstream traceability information is obtained by querying the associated data of the direct parent package from the blockchain network, and only includes the core data fields used for hierarchical association verification, excluding the label location credentials of the parent package.
[0083] The item list traceable downwards is generated by querying the list of containment relationships from the blockchain network, extracting the core data fields for hierarchical association verification of all direct child packages, and does not include any label location credentials for child packages.
[0084] Specifically, after the identity verification is successful, two query operations will be performed: First, based on the parent identifier in the current packaging association data, retrieve the association data of its direct parent packaging from the blockchain, and extract core fields for verification such as parent hash value, packaging identifier, and hierarchical index; Second, using the unique identifier of the current packaging as the key, query the pre-stored list of inclusion relationships in the blockchain, extract the core verification fields of the same type for all direct child packaging, and form a structured list of items.
[0085] S44. Return the combined upstream traceability information and the downstream item list.
[0086] Specifically, the returned data combination enables simultaneous acquisition of bidirectional structured information of multi-level packaging with a single verification, meeting the real-time needs for detailed data in scenarios such as logistics unpacking and verification, and rapid warehouse inventory. At the same time, by eliminating unnecessary fields such as location vouchers, it balances query efficiency and privacy protection, significantly improving the usability and scalability of the anti-counterfeiting and traceability system in actual business.
[0087] It should be understood that the sequence number of each step in the above embodiments does not imply the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of this application.
[0088] This application also provides a multimodal recognition data anti-counterfeiting and traceability system, which corresponds one-to-one with the multimodal recognition data anti-counterfeiting and traceability method in the embodiments.
[0089] refer to Figure 8 A multimodal recognition-based data anti-counterfeiting and traceability system includes: a label generation module 1, a label coding module 2, a circulation verification module 3, and a data query module 4. Detailed descriptions of each functional module are as follows: Label generation module 1: Used to generate label information for each level of product packaging. The label information includes the associated data of the current packaging level of the product and the label location certificate. The associated data is used for identity verification of the association of each level of packaging, and the label location certificate is used for consistency verification of the physical location of each level of packaging.
[0090] Label coding module 2: Used to code the corresponding packaging layer based on the label information of each packaging layer of the product.
[0091] Circulation verification module 3: Used to respond to the scanning operation of the anti-counterfeiting label on the product packaging to obtain label information, and to perform anti-counterfeiting verification on the product packaging based on the label information.
[0092] Data Query Module 4: If the product packaging identity anti-counterfeiting verification is successful, it is used to query and return the associated data and item list of each packaging level associated with the product based on the associated data.
[0093] The technical effects of each module, as described above, are explained as follows: Label generation module 1 generates label information containing associated data and label location credentials, ensuring the uniqueness and traceability of products at each packaging level and effectively preventing label tampering and counterfeiting. Label coding module 2 further strengthens anti-counterfeiting capabilities by accurately coding each level of packaging, achieving dual binding at both the physical and data levels, thus improving the overall system reliability. Circulation verification module 3 can quickly respond to scanning operations and complete identity verification in real time, providing efficient security for the product circulation process. Data query module 4, after successful verification, provides comprehensive associated data and a list of items, enhancing information transparency and providing users with a complete traceability path, greatly improving user experience and trust. Through the collaborative work of these modules, a secure and easy-to-use anti-counterfeiting and traceability system is constructed.
[0094] Specific limitations regarding the multimodal recognition data anti-counterfeiting and traceability system can be found in the context of the limitations on the multimodal recognition data anti-counterfeiting and traceability method, and will not be repeated here. Each module in the aforementioned multimodal recognition data anti-counterfeiting and traceability system can be implemented entirely or partially through software, hardware, or a combination thereof. These modules can be embedded in or independent of the processor in an electronic device, or stored in the memory of the electronic device as software, so that the processor can call and execute the corresponding operations of each module. In one embodiment, an electronic device is provided, which is a user terminal. (Reference) Figure 9 The electronic device includes a processor, memory, network interface, and database connected via a system bus. The processor provides computing and control capabilities. The memory includes a non-volatile storage medium and internal memory. The non-volatile storage medium stores the operating system, computer programs, and database. The internal memory provides the environment for the operation of the operating system and computer programs in the non-volatile storage medium. The database stores detection data tables. The network interface communicates with external scanning devices via a network connection. When the computer program is executed by the processor, it implements a multimodal recognition data anti-counterfeiting and traceability method.
[0095] In one embodiment, an electronic device is provided, including a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor executes the computer program to perform the following steps: S1. Generate label information for each packaging level of the product. The label information includes the association data of the current packaging level of the product and the label location certificate. The association data is used for identity verification of the association of each packaging level, and the label location certificate is used for consistency verification of the physical location of each packaging level.
[0096] S2. Based on the label information of each packaging level of the product, assign codes to the corresponding packaging level.
[0097] S3. Respond to the scanning operation of the anti-counterfeiting label on the product packaging to obtain label information, and perform anti-counterfeiting verification on the product packaging based on the label information.
[0098] In one embodiment, the sub-steps of step S1 refinement include: S10. Obtain the verified level hash value corresponding to the current packaging level from the blockchain network and set it as the associated data of the current packaging level. The verified level hash value is calculated and generated based on the hash value of the previous level packaging, the unique identifier of the current packaging level, and the level index.
[0099] S11. Combine and encode the verified hierarchical hash value with the tag location credential to generate tag information.
[0100] In one embodiment, the sub-steps of step S3 refinement include: S30. Based on the associated data in the tag information, perform hierarchical identity verification on the associated data.
[0101] S31. Based on the tag location certificate in the tag information and the measured location information reported by the scanning device performing the scanning operation, perform physical location consistency verification.
[0102] S32. Identity anti-counterfeiting verification is deemed successful if and only if both the associated data verification and the physical location consistency verification are successful.
[0103] In one embodiment, the sub-steps of step S30 are further refined as follows: S300: Based on the associated data in the label information scanned by the authorized scanning device, recalculate the hierarchical hash value of the current packaging level.
[0104] S301. Compare the recalculated hierarchical hash value with the verified hash value obtained from the blockchain network.
[0105] S302. If the hierarchical hash value and the verified hash value are consistent, then the associated data verification is successful.
[0106] In one embodiment, the sub-steps of step S31 include: S310. Based on the decoding rules issued from the server, decode the anti-counterfeiting label to obtain associated data and label location credentials.
[0107] S311. Based on the label location certificate, obtain the theoretical position coordinates of the anti-counterfeiting label, compare the theoretical position coordinates with the measured position coordinates reported by the scanning device, and obtain the coordinate deviation value.
[0108] S312. If the coordinate deviation value is within the preset tolerance range, the physical position consistency verification is deemed to have passed.
[0109] In one embodiment, the sub-steps of step S4 refinement include: S40. Based on the hierarchical information in the associated data, query the associated data of the corresponding direct parent package from the blockchain to obtain the upstream tracing information.
[0110] S41. Based on the unique identifier of the current packaging level, query the corresponding inclusion relationship list from the blockchain to obtain the item list that can be traced downwards.
[0111] S42. Combine the upstream traceability information with the downstream item list and return it.
[0112] In one embodiment, the sub-steps of step S4 refinement include: S43. Obtain upstream traceability information and a list of items for downstream tracing, including: S44. Return the combined upstream traceability information and the downstream item list.
[0113] Those skilled in the art will understand that all or part of the processes in the methods of the above embodiments can be implemented by a computer program instructing related hardware. The computer program can be stored in a non-volatile computer-readable storage medium. When executed, the computer program can include the processes of the embodiments of the above methods. Any references to memory, storage, databases, or other media used in the embodiments provided in this application can include non-volatile and / or volatile memory. Non-volatile memory can include read-only memory (ROM), programmable ROM (PROM), electrically programmable ROM (EPROM), electrically erasable programmable ROM (EEPROM), or flash memory. Volatile memory can include random access memory (RAM) or external cache memory. By way of illustration and not limitation, RAM is available in various forms, such as static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), dual data rate SDRAM (DDRSDRAM), enhanced SDRAM (ESDRAM), synchronous link DRAM (SLDRAM), Rambus direct RAM (RDRAM), direct memory bus dynamic RAM (DRDRAM), and memory bus dynamic RAM (RDRAM), etc.
[0114] Those skilled in the art will clearly understand that, for the sake of convenience and brevity, the above-described division of functional units and modules is used as an example. In practical applications, the above functions can be assigned to different functional units and modules as needed, that is, the internal structure of the device can be divided into different functional units or modules to complete all or part of the functions described above.
Claims
1. A data anti-counterfeiting traceability method of multi-modal recognition, characterized in that, include: Generate label information for each packaging level of the product, wherein the label information includes the association data of the current packaging level of the product and the label location certificate. The association data is used for identity verification of the association of each packaging level, and the label location certificate is used for consistency verification of the physical location of each packaging level. Based on the label information of each packaging level of the product, code is assigned to the corresponding packaging level; In response to scanning the anti-counterfeiting label on the product packaging to obtain label information, the product packaging is verified for authenticity based on the label information. If the product packaging passes the anti-counterfeiting verification, then based on the associated data, query and return the associated data and item list for each packaging level associated with the product.
2. The method of claim 1, wherein, The step of generating label information for each packaging layer of the product includes: The verified level hash value corresponding to the current packaging level is obtained from the blockchain network and set as the associated data of the current packaging level. The verified level hash value is calculated and generated based on the hash value of the previous packaging level, the unique identifier of the current packaging level, and the level index. The verified hierarchical hash value is combined with the tag location credential and encoded to generate the tag information.
3. The method of claim 1, wherein, The step of responding to a scanning operation of the anti-counterfeiting label on the product packaging to obtain label information, and performing anti-counterfeiting verification on the product packaging based on the label information, includes: Based on the associated data in the label information, the associated data is used to perform identity verification for each level of packaging hierarchy; Based on the tag location certificate in the tag information and the measured location information reported by the scanning device performing the scanning operation, physical location consistency verification is performed. The identity verification is deemed successful only if both the associated data verification and the physical location consistency verification are successful.
4. The method of claim 3, wherein, The step of verifying the association data at various packaging levels based on the associated data in the label information includes: Based on the associated data in the label information scanned by the authorized scanning device, the hierarchical hash value of the current packaging level is recalculated; The recalculated hierarchical hash value is compared with the verified hash value obtained from the blockchain network; If the hierarchical hash value matches the verified hash value, then the associated data verification is successful.
5. The method of claim 3, wherein, The step of verifying physical location consistency based on the tag location certificate in the tag information and the measured location information reported by the scanning device performing the scanning operation includes: Based on the decoding rules issued by the server, the anti-counterfeiting label is decoded to obtain the associated data and label location certificate; Based on the label location certificate, the theoretical position coordinates of the anti-counterfeiting label are obtained, and the theoretical position coordinates are compared with the measured position coordinates reported by the scanning device to obtain the coordinate deviation value. If the coordinate deviation value is within the preset tolerance range, the physical location consistency verification is deemed successful.
6. The method according to claim 1, characterized in that, If the product packaging's anti-counterfeiting verification passes, the step of querying and returning the associated data and item list for each packaging level associated with the product based on the associated data includes: Based on the hierarchical information in the associated data, query the associated data of the corresponding direct parent package from the blockchain to obtain upstream tracing information; Based on the unique identifier of the current packaging level, query the corresponding list of inclusion relationships in the blockchain to obtain the list of items traced downwards; The upstream traceability information is combined with the downstream item list and returned.
7. The method according to claim 6, characterized in that, If the product packaging's anti-counterfeiting verification passes, the step of querying and returning the associated data and item list for each packaging level associated with the product based on the associated data includes: Obtain upstream traceability information and downstream item lists, including: The upstream traceability information is obtained by querying the associated data of the direct parent package from the blockchain network, and only includes the core data fields used for hierarchical association verification, excluding the label position certificate of the parent package; The item list for downward tracing is generated by querying the inclusion relationship list from the blockchain network and extracting the core data fields for hierarchical association verification of all direct child packages, without including any label location credentials for child packages; The upstream traceability information is combined with the downstream item list and returned.
8. A multimodal recognition data anti-counterfeiting and traceability system, characterized in that, include: Label generation module (1): used to generate label information for each level of product packaging, wherein the label information includes the association data of the current packaging level of the product and the label location certificate, the association data is used for identity verification of the association of each level of packaging, and the label location certificate is used for consistency verification of the physical location of each level of packaging. Label coding module (2): Used to code the corresponding packaging layer based on the label information of each packaging layer of the product; Circulation verification module (3): used to obtain label information in response to scanning operation of anti-counterfeiting label on product packaging, and to perform anti-counterfeiting verification on product packaging based on the label information; Data query module (4): If the product packaging identity anti-counterfeiting verification is passed, then based on the associated data, query and return the associated data and item list of each packaging level associated with the product.
9. An electronic device, characterized in that, It includes a memory and a processor, wherein the memory stores a computer program that can be loaded by the processor and executed as any one of the multimodal recognition data anti-counterfeiting and traceability methods as claimed in claims 1 to 7.
10. A computer-readable storage medium, characterized in that, The computer program stores a data anti-counterfeiting and traceability method that can be loaded by a processor and executed as claimed in any one of claims 1 to 7.