Multi-material tracking and tracing method, device, equipment and storage medium

Abstract

The present invention provides a multi-material tracking and tracing method, device, equipment and storage medium, wherein the method comprises: when a label scanning device scans a product label on a plurality of product materials in different links of a supply chain, corresponding activity data is generated, and the activity data is updated as storage data to a corresponding position of a storage device, and when the storage device completes the update of the storage data, the storage data is displayed on a user device corresponding to the label scanning device; in response to a purchase scanning operation of a third scanning device scanning a product label, the connection relationship between the storage device and the product label is disconnected. The method generates and displays activity data for querying the status of an item, which can achieve efficient supply chain management and material authenticity, and adds a mechanism for transferring ownership authorization during label scanning. When a purchase occurs, the upper-layer associated data related to the purchase is disconnected to ensure seamless transfer of ownership information.

Description

Technical Field

[0001] The present invention relates to the field of logistics tracking, and in particular to a multi-material tracking and tracing method, device, equipment and storage medium. Background Art

[0002] Current supply chain tracking and tracing systems often face the complex management of multiple goods and materials, especially in terms of label scanning and data storage. In traditional supply chain management, tracking multiple goods and materials often requires the use of different systems or methods, which increases the complexity and cost of management. For example, different types of labels or tracking systems are required to obtain pre-processed images for different types of goods and materials, and these systems cannot achieve effective data sharing or integration, resulting in information silos and management chaos. In addition, as the supply chain extends and diversifies, pre-processed images of goods and materials will be scanned multiple times at different links, but the current system cannot achieve effective data updates and synchronization, resulting in information inconsistencies or delays. Therefore, existing methods cannot effectively track the transportation and processing of multiple goods and materials. Summary of the Invention

[0003] The main purpose of the present invention is to solve the technical problem that the existing material tracking methods cannot effectively track the transportation and processing processes of various goods and materials.

[0004] A first aspect of the present invention provides a multi-material tracking and tracing method, the multi-material tracking and tracing method comprising:

[0005] The multi-material tracking and tracing method is applied to a multi-material tracking and tracing system, wherein the multi-material tracking and tracing system includes a hardware processing device and a storage device; the multi-material tracking and tracing method includes:

[0006] When a label scanning device scans product labels on a plurality of product materials at different stages of a supply chain, corresponding activity data is generated, and the activity data is updated as storage data to a corresponding location of the storage device through a preset connection relationship between the product labels and the storage device, wherein the plurality of product materials include at least a first material and a second material, and the product labels include at least a first label associated with the first material and a second label associated with the second material;

[0007] The method includes: generating corresponding activity data when a label scanning device scans product labels on a plurality of product materials in different links of a supply chain; and updating the activity data as storage data to a corresponding location of the storage device through a preset connection relationship between the product labels and the storage device.

[0008] In response to a first scanning operation of the first tag and the second tag by a first tag scanning device, associating the first material with the second material according to the first tag and the second tag to obtain at least one association parameter of the first material and the second material;

[0009] generating, by the hardware processing device, first activity data of the first material and second activity data of the second material based on the scan information of the first scan operation, the material information of the first material and the second material, and the at least one associated parameter, respectively, and updating the first activity data and the second activity data as storage data to corresponding locations of the storage device through the connection relationship;

[0010] In response to a second scanning operation in which a second label scanning device scans the first label or the second label, generating, by the hardware processing device, third activity data of the first material or fourth activity data of the second material based on scanning information of the second scanning operation, the first activity data, and the second activity data;

[0011] generating fourth activity data of the second material based on the at least one associated parameter and the third activity data or generating third activity data of the first material based on the at least one associated parameter and the fourth activity data;

[0012] updating the third activity data and the fourth activity data as storage data to corresponding locations of the storage device respectively according to the connection relationship by the hardware processing device;

[0013] When the storage device completes updating of the stored data, the stored data is displayed on the user device corresponding to the tag scanning device;

[0014] In response to a purchase scanning operation in which a third scanning device scans the first tag or the second tag, the connection between the storage device and the first tag or the second tag is disconnected.

[0015] Optionally, in the first implementation of the first aspect of the present invention, after the storage device completes updating the stored data, displaying the stored data on the user device corresponding to the tag scanning device includes:

[0016] After the storage device completes updating of the stored data, determining the user type of the user device corresponding to the current tag scanning device;

[0017] Determining user rights of the user device according to the user type, and filtering data from the storage data of the storage device according to the user rights;

[0018] The filtered stored data is displayed on the user device corresponding to the current tag scanning device.

[0019] Optionally, in a second implementation of the first aspect of the present invention, displaying the filtered stored data on a user device corresponding to the current tag scanning device includes:

[0020] Determining a product label corresponding to the stored data after the data screening as a target product label;

[0021] Obtaining a uniform resource locator corresponding to the target product label, and determining a webpage address corresponding to the stored data after the data screening according to the uniform resource locator;

[0022] updating the website content of the website corresponding to the webpage address according to the stored data after the data screening;

[0023] The website corresponding to the webpage address is accessed through the user device corresponding to the current tag scanning device, and the website content of the website is displayed on the user device corresponding to the current tag scanning device.

[0024] Optionally, in a third implementation of the first aspect of the present invention, the first material is an outer packaging material, and the second material is a product material within the first material;

[0025] In response to a purchase scanning operation in which a third scanning device scans the first tag or the second tag, disconnecting the storage device from the first tag or the second tag includes:

[0026] In response to a purchase scanning operation of scanning the first tag or the second tag by a third scanning device, generating purchase activity data corresponding to the first tag or the second tag, and updating the purchase activity data as storage data to a corresponding location of the storage device through the connection relationship;

[0027] Determining whether the scanning object of the third scanning device is the first tag or the second tag;

[0028] If the scanning object of the third scanning device is the first tag, disconnecting the storage device from the first tag and the second tag;

[0029] If the scanning object of the third scanning device is the second tag, the association between the first material and the second material is cancelled, the at least one association parameter is deleted, and the connection relationship between the storage device and the second tag is disconnected.

[0030] Optionally, in a fourth implementation of the first aspect of the present invention, the product tag is an RFID tag and / or a QR code; and in response to a purchase scanning operation of scanning the first tag or the second tag by a third scanning device, generating purchase activity data corresponding to the first tag or the second tag includes:

[0031] In response to a purchase scanning operation in which a third scanning device scans the first tag or the second tag, acquiring an RFID tag signal and / or a QR code image of the first tag or the second tag by the third scanning device;

[0032] parsing the RFID tag signal and / or the QR code image of the first tag or the second tag to determine the first material or the second material corresponding to the purchase scanning operation;

[0033] The hardware processing device generates purchase activity data corresponding to the first tag or the second tag based on the scan information of the purchase scan operation and the activity data corresponding to the first material or the second material corresponding to the purchase scan operation.

[0034] Optionally, in a fifth implementation of the first aspect of the present invention, when the third scanning device simultaneously scans multiple first tags or multiple second tags and the product tags are RFID tags and QR codes, parsing the RFID tag signals and / or QR code images of the first tags or the second tags to determine the first material or the second material corresponding to the purchase scanning operation includes:

[0035] Inputting the acquired multiple RFID tag signals into a preset tag positioning model to obtain the tag position of the corresponding first tag or the second tag;

[0036] Positioning multiple QR codes in the QR code image based on the tag position to obtain a corresponding relationship between the RFID tag signal and the QR code;

[0037] Parse multiple RFID tag signals and multiple QR code images to obtain signal tag information corresponding to each RFID tag signal and image tag information corresponding to each QR code image;

[0038] Comparing the signal label information corresponding to each RFID tag signal and the image label information corresponding to each QR code image according to the corresponding relationship to determine whether the signal label information and the image label information that have a corresponding relationship are consistent;

[0039] If not, redetermine the correspondence between the RFID tag signal and the QR code;

[0040] If so, the plurality of first materials or the plurality of second materials corresponding to the purchase scanning operation are determined according to the corresponding signal tag information and the image tag information.

[0041] Optionally, in a sixth implementation of the first aspect of the present invention, when the third scanning device simultaneously scans multiple first tags or multiple second tags and the product tag is a QR code, parsing the RFID tag signal and / or QR code image of the first tag or the second tag to determine the first material or the second material corresponding to the purchase scanning operation includes:

[0042] performing image preprocessing on the QR code image of the first tag or the second tag to obtain a preprocessed image;

[0043] Inputting the preprocessed image into a preset QR code detection model, wherein the QR code detection model includes an input layer, a feature extraction layer, a feature pyramid network, a feature fusion layer, a multi-task detection layer and an output layer;

[0044] Mapping the preprocessed image to a high-dimensional space through the input layer to obtain initial feature information in the high-dimensional space;

[0045] Extracting features from the initial feature information through the feature extraction layer to obtain convolution features at different levels;

[0046] Performing upsampling operations on convolutional features at different levels through the feature pyramid network to obtain upsampling results, and concatenating the upsampling results with convolutional features at different levels to obtain initial fusion features at different levels;

[0047] The initial fusion features at different levels are fused through the feature fusion layer to obtain secondary fusion features;

[0048] Performing multi-task detection on the secondary fusion features through the multi-task detection layer to obtain multiple task detection results;

[0049] Determining, by the output layer, positioning frames of multiple QR codes in the QR code image according to the multiple task detection results;

[0050] The QR code in each positioning box is parsed to determine the first material or the second material corresponding to the purchase scanning operation.

[0051] A second aspect of the present invention provides a multi-material tracking and tracing device, wherein the multi-material tracking device is applied to a multi-material tracking system, wherein the multi-material tracking system includes a hardware processing device and a storage device; the multi-material tracking and tracing device includes:

[0052] a data generation module configured to generate corresponding activity data when a label scanning device scans product labels on a plurality of product materials at different links in a supply chain, and update the activity data as storage data to a corresponding location of the storage device through a preset connection relationship between the product labels and the storage device, wherein the plurality of product materials include at least a first material and a second material, and the product labels include at least a first label associated with the first material and a second label associated with the second material;

[0053] The data generation module is specifically used for:

[0054] In response to a first scanning operation of the first tag and the second tag by a first tag scanning device, associating the first material with the second material according to the first tag and the second tag to obtain at least one association parameter of the first material and the second material;

[0055] generating, by the hardware processing device, first activity data of the first material and second activity data of the second material based on the scan information of the first scan operation, the material information of the first material and the second material, and the at least one associated parameter, respectively, and updating the first activity data and the second activity data as storage data to corresponding locations of the storage device through the connection relationship;

[0056] In response to a second scanning operation in which a second label scanning device scans the first label or the second label, generating, by the hardware processing device, third activity data of the first material or fourth activity data of the second material based on scanning information of the second scanning operation, the first activity data, and the second activity data;

[0057] generating fourth activity data of the second material based on the at least one associated parameter and the third activity data or generating third activity data of the first material based on the at least one associated parameter and the fourth activity data;

[0058] updating the third activity data and the fourth activity data as storage data to corresponding locations of the storage device respectively according to the connection relationship by the hardware processing device;

[0059] A display module, configured to display the stored data on a user device corresponding to the tag scanning device after the storage device completes updating the stored data;

[0060] The connection disconnection module is configured to disconnect the connection between the storage device and the first tag or the second tag in response to a purchase scanning operation in which a third scanning device scans the first tag or the second tag.

[0061] A third aspect of the present invention provides a multi-material tracking and tracing device, comprising: a memory and at least one processor, wherein the memory stores instructions, and the memory and the at least one processor are interconnected via a line; the at least one processor calls the instructions in the memory so that the multi-material tracking and tracing device performs the steps of the above-mentioned multi-material tracking and tracing method.

[0062] A fourth aspect of the present invention provides a computer-readable storage medium having instructions stored therein, which, when executed on a computer, causes the computer to execute the steps of the above-mentioned multi-material tracking and tracing method.

[0063] The aforementioned multi-material tracking and tracing method, apparatus, device, and storage medium generate corresponding activity data when a label scanning device scans product labels on multiple product materials at different stages of the supply chain. The activity data is then updated as stored data to the corresponding location on the storage device. After the storage device completes the data update, the stored data is displayed on the user device corresponding to the label scanning device. In response to a purchase scan operation performed by a third scanning device scanning the product label, the connection between the storage device and the product label is disconnected. This method generates and displays activity data for querying item status, enabling efficient supply chain management and ensuring material authenticity. Furthermore, it incorporates a mechanism for transferring ownership authorization during label scanning. When a purchase occurs, the upper-level associated data related to the purchase is disconnected, ensuring seamless transfer of ownership information.

[0064] Other features and advantages of the present invention will be described in the following description, and in part will become apparent from the description, or understood by practicing the present invention. The purposes and other advantages of the present invention are realized and obtained by the structures particularly pointed out in the description, claims and drawings.

[0065] In order to make the above-mentioned objects, features and advantages of the present invention more obvious and easy to understand, preferred embodiments are given below and described in detail with reference to the accompanying drawings. BRIEF DESCRIPTION OF THE DRAWINGS

[0066] Figure 1 Schematic diagram of a first embodiment of a multi-material tracking and tracing method according to an embodiment of the present invention;

[0067] Figure 2 A schematic diagram of an embodiment of a multi-material tracking and tracing device according to an embodiment of the present invention;

[0068] Figure 3 Schematic diagram of an embodiment of a multi-material tracking and tracing device in an embodiment of the present invention. DETAILED DESCRIPTION

[0069] To make the objectives, technical solutions, and advantages of the embodiments of the present invention more clear, the technical solutions of the present invention will be clearly and completely described below with reference to the accompanying drawings. Obviously, the embodiments described are only part of the embodiments of the present invention, not all of them. All other embodiments obtained by ordinary technicians in this field based on the embodiments of the present invention without making any creative efforts shall fall within the scope of protection of the present invention.

[0070] The terms "including," "having," and any variations thereof, as used in the embodiments of the present invention are intended to cover non-exclusive inclusions. For example, a process, method, system, product, or apparatus comprising a series of steps or units is not limited to the listed steps or units, but may optionally include other steps or units not listed, or may optionally include other steps or units inherent to the process, method, product, or apparatus.

[0071] To facilitate understanding of this embodiment, a multi-material tracking and tracing method disclosed in an embodiment of the present invention is first described in detail. Figure 1 As shown, this method includes the following steps:

[0072] 101. In response to a first scanning operation of a first label scanning device on the first label and the second label respectively, associate the first material and the second material according to the first label and the second label to obtain at least one association parameter of the first material and the second material;

[0073] In one embodiment of the present invention, the first label scanning device is an electronic device specifically designed to read label information on goods and materials. It can identify and interpret electronic tags (such as RFID tags, QR codes, or barcodes) attached to goods and materials, thereby obtaining information related to the goods. Such devices are typically equipped with one or more scanning technologies to quickly and accurately capture data from the labels. The first scanning operation describes the actions performed by the first label scanning device when it first contacts the labels attached to the first and second materials. This process involves identifying and reading data from the labels attached to each material (the first and second labels). The scanning operation can be automatic or manual, depending on the device's settings and operating environment. During this process, the scanning device uses built-in scanning technology (such as optical scanning or radio frequency identification) to capture information from the labels and convert it into electronic data. The scanning device or a subsequent data processing system analyzes the information read from the first and second labels based on pre-defined logic or algorithms. This information may include product identifiers, batch numbers, production dates, and other information, which can be used to link the two materials. By analyzing this data, the system can identify the relationship between the two materials, such as whether they belong to the same production batch or need to be processed or shipped together. The at least one association parameter refers to one or more indicators that the system can determine after completing the association process to represent or quantify the relationship between the first material and the second material. For example, the association parameter may be a common production batch number of the two materials, or a shipping priority relationship between the two materials.

[0074] 102. Generate, by the hardware processing device, first activity data of the first material and second activity data of the second material based on the scan information of the first scan operation, the material information of the first material and the second material, and the at least one associated parameter, and update the first activity data and the second activity data as storage data to corresponding locations of the storage device through the connection relationship.

[0075] In one embodiment of the present invention, generating activity data for different materials is a key step in supply chain management. It allows enterprises to accurately track and manage the status and flow of various materials throughout production, warehousing, and transportation. Activity data contains real-time information about the materials, such as their location, status (e.g., in process, completed, in transit), and timestamps, helping to improve supply chain transparency, efficiency, and responsiveness. A hardware processing device (e.g., an intelligent processor integrating scanning, computing, and communication capabilities) first reads the label information on the first and second materials based on the scanned information acquired during a first scanning operation. This information typically includes product identifiers, batch numbers, and production dates. Next, the hardware processing device combines the scanned information with specific material information (e.g., physical characteristics, source, and destination), and at least one associated parameter determined in the previous step to generate an activity data record for each material. This record not only reflects the material's current status and location but also includes its relationships with other materials, such as being part of the same production batch or having a common destination. After generating the activity data, the hardware processing device transmits and updates the first and second activity data to the corresponding locations on the storage device via a predefined connection (e.g., a network-based interface, wireless communication protocol, etc.). This storage device can be a central database, cloud storage service or other form of data storage system that can securely store, manage and analyze data from all links in the supply chain.

[0076] 103. In response to a second scanning operation of a second label scanning device scanning the first label or the second label, generating, by the hardware processing device, third activity data of the first material or fourth activity data of the second material based on scanning information of the second scanning operation, the first activity data, and the second activity data;

[0077] In one embodiment of the present invention, the primary difference between the first and second label scanning devices lies in their scanning range and purpose. The first label scanning device scans the first and second labels, typically to initially capture or register material information and generate preliminary activity data. The second label scanning device, on the other hand, scans a specific label (either the first or second label). This typically occurs at a later stage in the supply chain, such as logistics transit, warehouse inbound or outbound, or production line input, to update the material's activity data to reflect its latest status. The second label scanning device scans the first or second label at a specific stage in the supply chain. This step occurs in response to the material arriving at a new processing stage or undergoing a status change, and is performed only on one of the labels. The hardware processing device receives scan information from the second scanning operation. This information includes label identification information and may also include a timestamp and location information. Based on this information, the hardware processing device identifies whether the scanned material is the first or second material. The hardware processing device then uses the results of the second scanning operation, combined with the existing first or second activity data, to generate updated activity data (third or fourth activity data). For example, if the second scanning device scans the first label, the hardware processing device will generate third activity data for the first material based on the scanned information and the first activity data. If the second label is scanned, the hardware processing device will generate fourth activity data for the second material. The generated third or fourth activity data is then sent to the storage device via the hardware processing device and a pre-defined connection to update the current status of the material. These updates reflect the material's latest location, status, or other relevant information, providing real-time data support for supply chain management.

[0078] 104. Generate fourth activity data of the second material based on the at least one associated parameter and the third activity data, or generate third activity data of the first material based on the at least one associated parameter and the fourth activity data;

[0079] In one embodiment of the present invention, due to the existence of association parameters, after the product label corresponding to one of the first material and the second material is scanned by a scanning device and activity data is generated, the other material will also synchronously generate activity data based on the association parameters and preset association rules.

[0080] Specifically, the labels associated with each material can be further linked to each other by defining the associations between the materials and the physical relationships between them. When a specific number of product units are shipped in a carton, each product unit has its own label, and the carton has a separate label that defines the relationship between the carton and the product and indicates the specific product unit in the carton. The carton label is the parent of the labels of the product units it contains. The logistics transactions recorded in the tracking and tracing system for each carton will also automatically update the information of the product units in the carton. If a product is removed and its label is scanned at any checkpoint in the supply chain, the data related to the label on the carton will also be automatically updated.

[0081] 105. Update the third activity data and the fourth activity data as storage data to corresponding locations of the storage device respectively according to the connection relationship by the hardware processing device;

[0082] In one embodiment of the present invention, the third and fourth activity data are updated as storage data to specific locations on the corresponding storage devices based on pre-defined connection relationships via a processing device within the system. This process involves the hardware processing device writing the latest activity data to the corresponding storage locations on the storage devices according to pre-established rules and association mechanisms, enabling timely data updates and storage. This process ensures that the data in the storage devices remains up-to-date, facilitating subsequent data query and management operations.

[0083] 106. After the storage device completes updating the stored data, the stored data is displayed on the user device corresponding to the tag scanning device;

[0084] In one embodiment of the present invention, when the storage device completes the update of the stored data, displaying the stored data on the user device corresponding to the tag scanning device includes: when the storage device completes the update of the stored data, determining the user type of the user device corresponding to the current tag scanning device; determining the user rights of the user device according to the user type, and filtering data from the stored data of the storage device according to the user rights; and displaying the filtered stored data on the user device corresponding to the current tag scanning device.

[0085] Specifically, there are many types of users in the supply chain, and their user types and permissions vary depending on their roles and responsibilities in the supply chain: Suppliers are responsible for providing raw materials or components. They need access to order information, inventory levels, and logistics status related to the products they supply, but do not need access to competitor data or sensitive retailer sales data. Manufacturers process raw materials into final products. They need access to supplier information, production progress, inventory status, and shipping information to adjust production plans and logistics arrangements. Logistics service providers: Responsible for the transportation and distribution of products. They need to obtain information on transportation routes, status updates, and delivery schedules to optimize transportation efficiency and costs. Retailers: Retailers sell products directly to end users. They focus on sales data, inventory status, and market demand information to make replenishment and promotion decisions. End users: Although end users are usually not directly involved in supply chain management, they may need access to information such as product origin, authenticity verification, and instructions for use.

[0086] Specifically, the system filters the corresponding data from the storage device based on the user's permission level. For example, suppliers may only have access to order and inventory information directly related to them, while manufacturers can access a wider range of supply chain data, including information on all suppliers, production progress, and inventory status. Data filtering is achieved through advanced database queries and access control lists (ACLs), ensuring that each user type can only access the information open to them. The filtered data is displayed on the user device corresponding to the tag scanning device. This is usually achieved through a customized user interface (UI) designed with the user's specific needs and permissions in mind. For example, the interface of a logistics service provider may focus on displaying shipping routes and status updates, while the interface of a retailer may focus more on sales data and inventory status. Data display can use visual tools such as charts, dashboards, and real-time alerts to help users quickly understand information and make decisions.

[0087] Furthermore, the displaying of the stored data after data filtering on the user device corresponding to the current label scanning device includes: determining the product label corresponding to the stored data after data filtering as the target product label; obtaining the uniform resource locator corresponding to the target product label, and determining the web page address corresponding to the stored data after data filtering according to the uniform resource locator; updating the website content of the website corresponding to the web page address according to the stored data after data filtering; accessing the website corresponding to the web page address through the user device corresponding to the current label scanning device, and displaying the website content of the website on the user device corresponding to the current label scanning device.

[0088] Specifically, the system first filters the data stored in the database based on user permissions and requests to locate the specific information required for a specific user or task. This filtered data is used to identify the corresponding product tags, which serve as target product tags. Each product tag contains a unique identifier, such as an RFID tag ID or QR code content. This identifier is directly linked to the stored data, allowing users to quickly identify and track specific products. Each target product tag is associated with a URL that points to a webpage containing more information about the product. The system parses the information in the tag to obtain this URL. The parsed URL is the webpage address corresponding to the filtered stored data. Users can use this address to access the specific website page for detailed information. As the status of products in the supply chain changes (such as inventory levels and logistics status), the stored data associated with the product tags is updated. Accordingly, the webpage content located by the tags also needs to be updated to reflect the latest information. This is typically accomplished automatically by a backend management system to ensure that the website content is synchronized with actual conditions. After the user's device scans the product tag to obtain the URL, they can access the website corresponding to the webpage address. The content on the website, including text, images, videos, etc., will be displayed on the user's device, providing detailed information about the goods, such as specifications, instructions for use, logistics tracking, etc.

[0089] 107. In response to a purchase scanning operation in which a third scanning device scans the first tag or the second tag, disconnect the storage device from the first tag or the second tag.

[0090] In one embodiment of the present invention, the first material is the outer packaging material, and the second material is the product material within the first material; the disconnection between the storage device and the first label or the second label in response to the purchase scanning operation of the third scanning device scanning the first label or the second label includes: generating purchase activity data corresponding to the first label or the second label in response to the purchase scanning operation of the third scanning device scanning the first label or the second label, and updating the purchase activity data as storage data to the corresponding position of the storage device through the connection relationship; judging whether the scanning object of the third scanning device is the first label or the second label; if the scanning object of the third scanning device is the first label, disconnecting the storage device from the first label and the second label; if the scanning object of the third scanning device is the second label, canceling the association between the first material and the second material, deleting the at least one association parameter and disconnecting the storage device from the second label.

[0091] Specifically, when a customer or a third-party scanning device in a point-of-sale (POS) system scans a product's first or second label, the system recognizes this as an indication of purchase intent. This scanning action triggers the system to generate purchase activity data corresponding to the scanned label. This generated purchase activity data contains important information such as product identification, purchase time, and quantity. This data is then updated to the corresponding location on a storage device through a specific connection for further processing and recording. If the scanned label is the first label, the system disconnects the storage device from both the first and second labels. This indicates that the product represented by the label on the outer packaging material and the label on the inner product material has been purchased, and their status needs to be updated in the system. If the scanned label is the second label, the system not only disconnects the storage device from the second label but also disassociates the first material (the outer packaging material) from the second material (the product material). This typically involves deleting at least one associated parameter to reflect the purchase status of the product material itself.

[0092] Specifically, when the first material is scanned, there is no need to cancel the association between the first material (outer packaging material) and the second material (product material). This is because when the first material is scanned, it indicates that the purchase scanning operation corresponds to the outer packaging material and all product materials in the outer packaging material, and when the second material is scanned, it indicates that the purchase scanning operation corresponds to the product material described in the outer packaging material. At this time, the association needs to be canceled. This is because once the product is purchased, disconnecting the connection relationship can prevent the same product from being scanned and processed repeatedly, thereby avoiding possible errors and confusion. Subsequent updates to the activity data of the first material will not affect the second material that has been sold.

[0093] Furthermore, the product label is an RFID tag and / or a QR code; the generation of purchase activity data corresponding to the first tag or the second tag in response to the purchase scanning operation of the first tag or the second tag being scanned by the third scanning device includes: obtaining the RFID tag signal and / or QR code image of the first tag or the second tag through the third scanning device in response to the purchase scanning operation of the first tag or the second tag being scanned by the third scanning device; parsing the RFID tag signal and / or QR code image of the first tag or the second tag to determine the first material or the second material corresponding to the purchase scanning operation; generating the purchase activity data corresponding to the first tag or the second tag based on the scanning information of the purchase scanning operation and the activity data corresponding to the first material or the second material corresponding to the purchase scanning operation through the hardware processing device.

[0094] Specifically, in response to a purchase scan operation, the third scanning device first captures information from the first or second tag on the product using radio waves or optical scanning technology. This involves receiving radio frequency signals from RFID tags and / or capturing QR code images. RFID tags and QR codes carry key product information, such as product identification, batch number, and production date. The scanned RFID tag signal and QR code image are then sent to a parsing module. This module decodes the data contained in these signals and images to determine whether they correspond to the outer packaging material (first material) or the inner product material (second material), respectively. This step is crucial for accurately recording product purchase information, as it impacts subsequent data processing and inventory management operations. Once the scan operation determines whether the first or second material is scanned, the hardware processing device generates purchase activity data based on the scan information and the specific activity data associated with the corresponding material. This activity data reflects product purchase details, such as purchase time, quantity, and product type. The generated purchase activity data is then used to update the corresponding records in the storage device. This includes not only marking the product as sold but also potentially adjusting inventory levels, generating sales reports, and updating customer purchase histories.

[0095] Furthermore, when the third scanning device simultaneously scans multiple first tags or multiple second tags and the product tags are RFID tags and QR codes, the parsing of the RFID tag signals and / or QR code images of the first tags or the second tags to determine the first material or the second material corresponding to the purchase scanning operation includes: inputting the acquired multiple RFID tag signals into a preset tag positioning model to obtain the tag positions of the corresponding first tags or the second tags; locating the multiple QR codes in the QR code image based on the tag positions to obtain the corresponding relationship between the RFID tag signals and the QR codes; and The method comprises the steps of: parsing an RFID tag signal and a plurality of QR code images to obtain signal tag information corresponding to each RFID tag signal and image tag information corresponding to each QR code image; comparing the signal tag information corresponding to each RFID tag signal and the image tag information corresponding to each QR code image according to the corresponding relationship to determine whether the signal tag information and the image tag information with the corresponding relationship are consistent; if not, re-determining the corresponding relationship between the RFID tag signal and the QR code; and if so, determining a plurality of first materials or a plurality of second materials corresponding to the purchase scanning operation according to the signal tag information and the image tag information with the corresponding relationship.

[0096] Specifically, when scanning multiple RFID tags and QR codes simultaneously, the system needs to distinguish and identify the unique information of each tag, especially when these tags are closely spaced. Using a pre-defined tag localization model helps the system accurately identify the physical location of each tag, thereby distinguishing them. This tag localization model helps ensure data collection accuracy by reducing data confusion and mismatches through physical location information, especially when processing large quantities of goods. To perform tag localization, the system first uses an RFID reader to collect signals from all surrounding RFID tags. These signals are then input into a pre-defined tag localization model, which uses signal strength, direction, and other relevant parameters to infer the approximate location of each tag. Based on the RFID tag location information, the system then spatially localizes the scanned QR code image—determining the physical location of each QR code. Comparing the signal tag information with the image tag information ensures consistency. Comparing the RFID tag signal information with the QR code image verifies that they represent the same product. This is a critical step in ensuring the consistency of data acquired from two different technologies, avoiding mismatches caused by technical failures or data processing errors. Furthermore, inconsistent data can lead to erroneous inventory management decisions or customer service issues. By verifying the consistency of this information, the system can correct any errors before continuing processing, ensuring data accuracy and reliability. Once the correspondence between the RFID tag signal and the QR code image is determined and verified to be consistent, the system can use this matched data to determine the specific material (primary or secondary) represented by each tag. By integrating information from the RFID and QR codes, the system is able to generate a detailed material list, including quantity, type, and other information. This information can then be used in a variety of business processes, including inventory management, order processing, and supply chain optimization.

[0097] Furthermore, when the third scanning device scans multiple first tags or multiple second tags at the same time and the product tag is a QR code, the parsing of the RFID tag signal and / or QR code image of the first tag or the second tag to determine the first material or second material corresponding to the purchase scanning operation includes: performing image preprocessing on the QR code image of the first tag or the second tag to obtain a preprocessed image; inputting the preprocessed image into a preset QR code detection model, wherein the QR code detection model includes an input layer, a feature extraction layer, a feature pyramid network, a feature fusion layer, a multi-task detection layer and an output layer; mapping the preprocessed image to a high-dimensional space through the input layer to obtain initial feature information in the high-dimensional space; and inputting the preprocessed image into a high-dimensional space through the feature extraction layer. The method comprises the following steps: performing feature extraction on the initial feature information by a sampling layer to obtain convolution features of different levels; performing upsampling operation on the convolution features of different levels through the feature pyramid network to obtain upsampling results, and splicing the upsampling results with the convolution features of different levels to obtain initial fusion features of different levels; performing feature fusion on the initial fusion features of different levels through the feature fusion layer to obtain secondary fusion features; performing multi-task detection on the secondary fusion features through the multi-task detection layer to obtain multiple task detection results; determining the positioning frames of multiple QR codes in the QR code image according to the multiple task detection results through the output layer; parsing the QR codes in each positioning frame to determine the first material or the second material corresponding to the purchase scanning operation.

[0098] Specifically, in the initial processing stage, the system first processes the RGB image through a specially designed input layer. This layer uses a 7×7 convolutional module to convert the standard RGB image into a feature representation in a high-dimensional space. This conversion step is crucial for subsequent feature extraction and parsing, as it provides the deep learning model with a rich, actionable set of features that better capture image details and structural information. The image features are then input into a backbone network consisting of three residual modules, which constitute the feature extraction layer. The use of residual modules addresses the vanishing gradient problem that can occur in deep networks while ensuring efficient information transfer across multiple layers. This layer aims to extract convolutional features with rich spatial and semantic information, which is crucial for understanding and recognizing QR codes in images. The extracted features are then fed into a feature pyramid network (FPN), which aims to further enhance the model's ability to recognize objects of varying scales. By fusing features from different layers, the FPN produces feature representations that contain both rich spatial details and strong semantic information. These features processed by FPN are then fed into the feature fusion layer, which is designed to perform multiple semantic fusions of the shallow representation information and deep representation information of the QR code target. This fusion strategy ensures that the features extracted from different depths can be effectively integrated, providing a more comprehensive and detailed feature basis for the accurate detection and recognition of QR codes. After feature fusion processing, the obtained information enters the multi-task detection layer. This layer performs tasks such as key point regression, positioning box regression, and positioning box classification, and is the key to achieving accurate QR code detection. The key point regression task locates the corner points of the QR code, the positioning box regression accurately calculates the bounding box of each QR code, and the positioning box classification distinguishes between different categories of boxes. Finally, the output layer generates the final output images based on the results of the multi-task detection layer. These images contain QR code detection boxes, corner point positions, and box category information. In this way, each detected QR code is not only accurately located, but its type is also correctly classified.

[0099] In this embodiment, when a label scanning device scans product labels on multiple product materials at different stages of the supply chain, corresponding activity data is generated. The activity data is updated as storage data to the corresponding location of the storage device. After the storage device completes the storage data update, the storage data is displayed on the user device corresponding to the label scanning device. In response to a purchase scan operation in which a third scanning device scans the product label, the connection between the storage device and the product label is disconnected. This method generates and displays activity data for querying the status of an item, enabling efficient supply chain management and material authenticity. It also adds a mechanism for transferring ownership authorization during label scanning. When a purchase occurs, the upper-level associated data related to the purchase is disconnected, ensuring seamless transfer of ownership information. Finally, the QR code in each positioning frame is parsed, that is, the data in the QR code is read and decoded to determine the first material or second material corresponding to the purchase scan operation.

[0100] The above describes the multi-material tracking and tracing method in the embodiment of the present invention. The following describes the multi-material tracking and tracing device in the embodiment of the present invention. The multi-material tracking device is applied to a multi-material tracking system. The multi-material tracking system includes a hardware processing device and a storage device. Figure 2 In one embodiment of the present invention, a multi-material tracking and tracing device includes:

[0101] The data generation module 201 is configured to generate corresponding activity data when a label scanning device scans product labels on a plurality of product materials at different links in a supply chain, and update the activity data as storage data to a corresponding location of the storage device through a pre-set connection relationship between the product labels and the storage device, wherein the plurality of product materials include at least a first material and a second material, and the product labels include at least a first label associated with the first material and a second label associated with the second material;

[0102] The data generation module 201 is specifically used for:

[0103] In response to a first scanning operation of the first tag and the second tag by a first tag scanning device, associating the first material with the second material according to the first tag and the second tag to obtain at least one association parameter of the first material and the second material;

[0104] generating, by the hardware processing device, first activity data of the first material and second activity data of the second material based on the scan information of the first scan operation, the material information of the first material and the second material, and the at least one associated parameter, respectively, and updating the first activity data and the second activity data as storage data to corresponding locations of the storage device through the connection relationship;

[0105] In response to a second scanning operation in which a second label scanning device scans the first label or the second label, generating, by the hardware processing device, third activity data of the first material or fourth activity data of the second material based on scanning information of the second scanning operation, the first activity data, and the second activity data;

[0106] generating fourth activity data of the second material based on the at least one associated parameter and the third activity data or generating third activity data of the first material based on the at least one associated parameter and the fourth activity data;

[0107] updating the third activity data and the fourth activity data as storage data to corresponding locations of the storage device respectively according to the connection relationship by the hardware processing device;

[0108] A display module 202 is configured to display the stored data on a user device corresponding to the tag scanning device after the storage device completes updating the stored data;

[0109] The connection disconnection module 203 is configured to disconnect the storage device from the first tag or the second tag in response to a purchase scanning operation of the first tag or the second tag being scanned by a third scanning device.

[0110] In an embodiment of the present invention, the multi-material tracking and tracing device implements the aforementioned multi-material tracking and tracing method. The multi-material tracking and tracing device generates corresponding activity data when a label scanning device scans product labels on multiple product materials at different stages of the supply chain. The activity data is then updated as stored data to a corresponding location on the storage device. After the storage device completes the data update, the stored data is displayed on a user device corresponding to the label scanning device. In response to a purchase scan operation involving a third scanning device scanning the product label, the connection between the storage device and the product label is disconnected. This method generates and displays activity data for querying item status, enabling efficient supply chain management and ensuring material authenticity. Furthermore, it incorporates a mechanism for transferring ownership authorization during label scanning. When a purchase occurs, the upper-level associated data related to the purchase is disconnected, ensuring seamless transfer of ownership information.

[0111] above Figure 2 The multi-material tracking and tracing apparatus in the embodiment of the present invention is described in detail from the perspective of modular functional entities. The multi-material tracking and tracing device in the embodiment of the present invention is described in detail from the perspective of hardware processing.

[0112] Figure 3 Figure 3 is a schematic diagram of the structure of a multi-material tracking and tracing device provided by an embodiment of the present invention. The multi-material tracking and tracing device 300 may vary significantly depending on configuration or performance. The device may include one or more central processing units (CPUs) 310 (e.g., one or more processors), memory 320, and one or more storage media 330 (e.g., one or more mass storage devices) storing applications 333 or data 332. The memory 320 and storage media 330 may be either transient or persistent storage. The program stored in the storage medium 330 may include one or more modules (not shown), each of which may include a series of instructions for operating on the multi-material tracking and tracing device 300. Furthermore, the processor 310 may be configured to communicate with the storage medium 330, executing the series of instructions stored in the storage medium 330 on the multi-material tracking and tracing device 300 to implement the steps of the multi-material tracking and tracing method described above.

[0113] The multi-material tracking and tracing device 300 may further include one or more power supplies 340, one or more wired or wireless network interfaces 350, one or more input and output interfaces 360, and / or one or more operating systems 331, such as Windows Server, Mac OS X, Unix, Linux, FreeBSD, etc. As will be appreciated by those skilled in the art, Figure 3 The illustrated structure of the multi-material tracking and tracing device does not limit the multi-material tracking and tracing device provided by the present invention, and may include more or fewer components than shown in the figure, or combine certain components, or arrange the components differently.

[0114] The present invention also provides a computer-readable storage medium, which may be a non-volatile computer-readable storage medium or a volatile computer-readable storage medium. The computer-readable storage medium stores instructions, which, when executed on a computer, enable the computer to execute the steps of the multi-material tracking and tracing method.

[0115] Those skilled in the art will clearly understand that, for the convenience and brevity of description, the specific working processes of the above-described systems, devices, and units can refer to the corresponding processes in the aforementioned method embodiments and will not be repeated here.

[0116] If the integrated unit is implemented as a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present invention, or the portion that contributes to the prior art, or all or part of the technical solution, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions for enabling a computer device (which can be a personal computer, server, or network device, etc.) to execute all or part of the steps of the method described in each embodiment of the present invention. The aforementioned storage medium includes various media that can store program code, such as a USB flash drive, a mobile hard drive, a read-only memory (ROM), a random access memory (RAM), a magnetic disk, or an optical disk.

[0117] As described above, the above embodiments are only used to illustrate the technical solutions of the present invention, rather than to limit the same. Although the present invention has been described in detail with reference to the above embodiments, those skilled in the art should understand that the technical solutions described in the above embodiments can still be modified, or some of the technical features thereof can be replaced by equivalents. However, these modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the embodiments of the present invention.

Claims

1. A multi-material tracking and tracing method, characterized in that: The multi-material tracking and tracing method is applied to a multi-material tracking and tracing system, the multi-material tracking and tracing system comprising a hardware processing device and a storage device; The multi-material tracking and tracing method comprises: When a plurality of commodity materials are in different links of a supply chain, when a label scanning device scans commodity labels on the plurality of commodity materials, corresponding activity data is generated, and the activity data is updated as storage data to a corresponding position of the storage device through a preset connection relationship between the commodity labels and the storage device, wherein the plurality of commodity materials include at least a first material and a second material, and the commodity labels include at least a first label related to the first material and a second label related to the second material; When the label scanning device scans the product labels on the various product materials in different links of the supply chain, the corresponding activity data is generated, and the activity data is updated as storage data to the corresponding position of the storage device through the preset connection relationship between the product labels and the storage device, including: In response to a first scanning operation of a first tag scanning device on the first tag and the second tag respectively, associating the first material with the second material according to the first tag and the second tag to obtain at least one association parameter of the first material and the second material; Generate, by the hardware processing device, first activity data of the first material and second activity data of the second material based on the scan information of the first scan operation, the material information of the first material and the material information of the second material and the at least one associated parameter, respectively, and update the first activity data and the second activity data as storage data to corresponding positions of the storage device through the connection relationship; In response to a second scanning operation of a second label scanning device scanning the first label or the second label, generating, by the hardware processing device, third activity data of the first material or fourth activity data of the second material based on scanning information of the second scanning operation, the first activity data, and the second activity data; generating fourth activity data of the second material based on the at least one associated parameter and the third activity data or generating third activity data of the first material based on the at least one associated parameter and the fourth activity data; updating the third activity data and the fourth activity data as storage data to corresponding positions of the storage device respectively according to the connection relationship by the hardware processing device; When the storage device completes updating of the stored data, the stored data is displayed on the user device corresponding to the tag scanning device; In response to a purchase scanning operation in which a third scanning device scans the first label or the second label, disconnecting the connection relationship between the storage device and the first label or the second label, wherein the first material is an outer packaging material, and the second material is a product material within the first material; disconnecting the connection relationship between the storage device and the first label or the second label in response to a purchase scanning operation in which the third scanning device scans the first label or the second label comprises: generating purchase activity data corresponding to the first label or the second label in response to a purchase scanning operation in which the third scanning device scans the first label or the second label, and updating the purchase activity data as storage data to a corresponding position of the storage device through the connection relationship; determining whether the scanning object of the third scanning device is the first label or the second label; if the scanning object of the third scanning device is the first label, disconnecting the connection relationship between the storage device and the first label and the second label; if the scanning object of the third scanning device is the second label, canceling the association between the first material and the second material, deleting the at least one association parameter, and disconnecting the connection relationship between the storage device and the second label; The product tag is an RFID tag and / or a QR code; the generating of the purchase activity data corresponding to the first tag or the second tag in response to the purchase scanning operation of the third scanning device scanning the first tag or the second tag includes: in response to the purchase scanning operation of the third scanning device scanning the first tag or the second tag, acquiring the RFID tag signal and / or the QR code image of the first tag or the second tag through the third scanning device; parsing the RFID tag signal and / or the QR code image of the first tag or the second tag to determine the first material or the second material corresponding to the purchase scanning operation; generating the purchase activity data corresponding to the first tag or the second tag based on the scanning information of the purchase scanning operation and the activity data corresponding to the first material or the second material corresponding to the purchase scanning operation through the hardware processing device; When the third scanning device scans multiple first tags or multiple second tags at the same time and the product tags are RFID tags and QR codes, the parsing of the RFID tag signals and / or QR code images of the first tags or the second tags to determine the first material or the second material corresponding to the purchase scanning operation includes: Input the acquired multiple RFID tag signals into a preset tag positioning model to obtain the tag position of the corresponding first tag or the second tag; locate the multiple QR codes in the QR code image based on the tag position to obtain the corresponding relationship between the RFID tag signal and the QR code; parse the multiple RFID tag signals and the multiple QR code images to obtain the signal tag information corresponding to each RFID tag signal and the image tag information corresponding to each QR code image; compare the signal tag information corresponding to each RFID tag signal and the image tag information corresponding to each QR code image according to the corresponding relationship to determine whether the signal tag information and the image tag information with a corresponding relationship are consistent; if not, redetermine the corresponding relationship between the RFID tag signal and the QR code; if so, determine the multiple first materials or multiple second materials corresponding to the purchase scanning operation according to the signal tag information and the image tag information with a corresponding relationship; When the third scanning device scans multiple first tags or multiple second tags at the same time and the product tag is a QR code, the parsing of the RFID tag signal and / or the QR code image of the first tag or the second tag to determine the first material or the second material corresponding to the purchase scanning operation includes: performing image preprocessing on the QR code image of the first tag or the second tag to obtain a preprocessed image; inputting the preprocessed image into a preset QR code detection model, wherein the QR code detection model includes an input layer, a feature extraction layer, a feature pyramid network, a feature fusion layer, a multi-task detection layer and an output layer; mapping the preprocessed image to a high-dimensional space through the input layer to obtain initial feature information in the high-dimensional space; and ... and The initial feature information is subjected to feature extraction to obtain convolution features at different levels; the convolution features at different levels are upsampled by the feature pyramid network to obtain upsampled results, and the upsampled results are concatenated with the convolution features at different levels to obtain initial fusion features at different levels; the initial fusion features at different levels are subjected to feature fusion by the feature fusion layer to obtain secondary fusion features; the secondary fusion features are subjected to multi-task detection by the multi-task detection layer to obtain multiple task detection results; the positioning frames of multiple QR codes in the QR code image are determined by the output layer according to the multiple task detection results; the QR codes in each positioning frame are parsed to determine the first material or the second material corresponding to the purchase scanning operation.

2. The multi-material tracking and tracing method according to claim 1, characterized in that: After the storage device completes the update of the stored data, displaying the stored data on the user device corresponding to the tag scanning device includes: When the storage device completes updating of the stored data, determining the user type of the user device corresponding to the current tag scanning device; Determining user rights of the user device according to the user type, and filtering data from the storage data of the storage device according to the user rights; The filtered stored data is displayed on the user device corresponding to the current tag scanning device.

3. The multi-material tracking and tracing method according to claim 2, characterized in that: The step of displaying the filtered stored data on the user device corresponding to the current tag scanning device includes: Determine the product label corresponding to the stored data after the data screening as the target product label; Obtaining a uniform resource locator corresponding to the target product label, and determining a webpage address corresponding to the stored data after the data screening according to the uniform resource locator; updating the website content of the website corresponding to the webpage address according to the stored data after the data screening; The website corresponding to the webpage address is accessed through the user device corresponding to the current tag scanning device, and the website content of the website is displayed on the user device corresponding to the current tag scanning device.

4. A multi-material tracking and tracing device, characterized in that: The multi-material tracking device is applied to a multi-material tracking system, and the multi-material tracking system includes a hardware processing device and a storage device; The multi-material tracking and tracing device comprises: A data generation module, used for generating corresponding activity data when a label scanning device scans product labels on a plurality of product materials in different links of a supply chain, and updating the activity data as storage data to a corresponding position of the storage device through a preset connection relationship between the product labels and the storage device, wherein the plurality of product materials include at least a first material and a second material, and the product labels include at least a first label related to the first material and a second label related to the second material; The data generation module is specifically used for: In response to a first scanning operation of a first tag scanning device on the first tag and the second tag respectively, associating the first material with the second material according to the first tag and the second tag to obtain at least one association parameter of the first material and the second material; Generate, by the hardware processing device, first activity data of the first material and second activity data of the second material based on the scan information of the first scan operation, the material information of the first material and the material information of the second material and the at least one associated parameter, respectively, and update the first activity data and the second activity data as storage data to corresponding positions of the storage device through the connection relationship; In response to a second scanning operation of a second label scanning device scanning the first label or the second label, generating, by the hardware processing device, third activity data of the first material or fourth activity data of the second material based on scanning information of the second scanning operation, the first activity data, and the second activity data; generating fourth activity data of the second material based on the at least one associated parameter and the third activity data or generating third activity data of the first material based on the at least one associated parameter and the fourth activity data; updating the third activity data and the fourth activity data as storage data to corresponding positions of the storage device respectively according to the connection relationship by the hardware processing device; A display module, configured to display the stored data on a user device corresponding to the tag scanning device after the storage device completes updating the stored data; A connection and disconnection module is used to disconnect the connection relationship between the storage device and the first label or the second label in response to a purchase scanning operation of the third scanning device scanning the first label or the second label, wherein the first material is an outer packaging material, and the second material is a product material in the first material; the disconnection relationship between the storage device and the first label or the second label in response to the purchase scanning operation of the third scanning device scanning the first label or the second label comprises: generating purchase activity data corresponding to the first label or the second label in response to the purchase scanning operation of the third scanning device scanning the first label or the second label, and updating the purchase activity data as storage data to the corresponding position of the storage device through the connection relationship; judging whether the scanning object of the third scanning device is the first label or the second label; if the scanning object of the third scanning device is the first label, disconnecting the connection relationship between the storage device and the first label and the second label; if the scanning object of the third scanning device is the second label, canceling the association between the first material and the second material, deleting the at least one association parameter and disconnecting the connection relationship between the storage device and the second label; The product tag is an RFID tag and / or a QR code; the generating of the purchase activity data corresponding to the first tag or the second tag in response to the purchase scanning operation of the third scanning device scanning the first tag or the second tag includes: in response to the purchase scanning operation of the third scanning device scanning the first tag or the second tag, acquiring the RFID tag signal and / or the QR code image of the first tag or the second tag through the third scanning device; parsing the RFID tag signal and / or the QR code image of the first tag or the second tag to determine the first material or the second material corresponding to the purchase scanning operation; generating the purchase activity data corresponding to the first tag or the second tag based on the scanning information of the purchase scanning operation and the activity data corresponding to the first material or the second material corresponding to the purchase scanning operation through the hardware processing device; When the third scanning device scans multiple first tags or multiple second tags at the same time and the product tags are RFID tags and QR codes, the parsing of the RFID tag signals and / or QR code images of the first tags or the second tags to determine the first material or the second material corresponding to the purchase scanning operation includes: Input the acquired multiple RFID tag signals into a preset tag positioning model to obtain the tag position of the corresponding first tag or the second tag; locate the multiple QR codes in the QR code image based on the tag position to obtain the corresponding relationship between the RFID tag signal and the QR code; parse the multiple RFID tag signals and the multiple QR code images to obtain the signal tag information corresponding to each RFID tag signal and the image tag information corresponding to each QR code image; compare the signal tag information corresponding to each RFID tag signal and the image tag information corresponding to each QR code image according to the corresponding relationship to determine whether the signal tag information and the image tag information with a corresponding relationship are consistent; if not, redetermine the corresponding relationship between the RFID tag signal and the QR code; if so, determine the multiple first materials or multiple second materials corresponding to the purchase scanning operation according to the signal tag information and the image tag information with a corresponding relationship; When the third scanning device scans multiple first tags or multiple second tags at the same time and the product tag is a QR code, the parsing of the RFID tag signal and / or the QR code image of the first tag or the second tag to determine the first material or the second material corresponding to the purchase scanning operation includes: performing image preprocessing on the QR code image of the first tag or the second tag to obtain a preprocessed image; inputting the preprocessed image into a preset QR code detection model, wherein the QR code detection model includes an input layer, a feature extraction layer, a feature pyramid network, a feature fusion layer, a multi-task detection layer and an output layer; mapping the preprocessed image to a high-dimensional space through the input layer to obtain initial feature information in the high-dimensional space; and ... and The initial feature information is subjected to feature extraction to obtain convolution features at different levels; the convolution features at different levels are upsampled by the feature pyramid network to obtain upsampled results, and the upsampled results are concatenated with the convolution features at different levels to obtain initial fusion features at different levels; the initial fusion features at different levels are subjected to feature fusion by the feature fusion layer to obtain secondary fusion features; the secondary fusion features are subjected to multi-task detection by the multi-task detection layer to obtain multiple task detection results; the positioning frames of multiple QR codes in the QR code image are determined by the output layer according to the multiple task detection results; the QR codes in each positioning frame are parsed to determine the first material or the second material corresponding to the purchase scanning operation.

5. A multi-material tracking and tracing device, characterized in that, The multi-material tracking and tracing device includes: a memory and at least one processor, the memory having instructions stored therein; The at least one processor calls the instructions in the memory to enable the multi-material tracking and tracing device to perform the steps of the multi-material tracking and tracing method as described in any one of claims 1-3.

6. A computer-readable storage medium having instructions stored thereon, characterized in that: When the instructions are executed by a processor, the steps of the multi-material tracking and tracing method as described in any one of claims 1 to 3 are implemented.

Images