Hand-processed product traceability equipment hardware, information software system, method and equipment

Abstract

The invention relates to hand-processed product traceability equipment hardware, an information software system, a method and equipment, and belongs to the field of agricultural informatization and food safety. An equipment hardware system comprises a universal manual processing workbench, a traceability box with an intelligent lock and a passive self-destruction mechanism, and an equipment identity verification and issuing CA (Certificate Authority); the information software system comprises a traceability standard system, an authorization template library, a credible verification program library, an equipment verification personnel identity verification system, a key issuing system, packet switching detection supporting product processing flow identification and traceability report generation software based on a multi-modal large model, and a production authorization declaration system. The traceability equipment comprises a traceability box, a visual identification workbench, a traceability identity authorization system, a product processing flow management system and a third-party detection and verification module. The problems that in the manual processing process of products, data cannot be automatically collected, multi-source mixing cannot be tracked, package falling cannot be defended, and data cannot be verified are solved.

Description

Technical Field

[0001] This invention relates to hardware, information software system, method, and equipment for tracing the origin of handcrafted products, belonging to the fields of agricultural informatization and food safety technology. Background Technology

[0002] Product traceability during the manual processing stage is a global challenge, and there is currently no effective solution. The main difficulties that make this process so challenging include:

[0003] 1. The processing lacks the support of traceability information carriers.

[0004] Product traceability information needs to be linked to a traceability information carrier. Existing traceability information carriers include...

[0005] 1) Physical entities, such as QR codes, RFID, smart hardware, etc.;

[0006] 2) Physical attribute types, such as fingerprints, irises, product textures, abundance of feature elements, and feature spectra;

[0007] 3) Missing additives: such as missing DNA, quantum dots, etc.;

[0008] These traceability information carriers become ineffective during processes such as peeling, cutting, crushing, grinding, pounding, tableting, pulping, stirring, centrifuging, sedimentation, filtering, boiling, frying, stir-frying, baking, puffing, granulation, extraction, grilling, pyrolysis, and mixing of multiple ingredients. Because of these carriers, in manual processing scenarios, automatically collected traceability information cannot be linked to the product. Existing traceability systems rely solely on manual entry of traceability information, and products can be arbitrarily switched during processing, leading to a lack of consumer trust in the corresponding traceability reports.

[0009] 4) At the same time, as processing progresses, the product itself does not have physical continuity. For example, one potato will become dozens of potato strips, and multiple bottles of liquid will be mixed into one bottle of liquid. The one-item-one-code system cannot track this process that does not have physical continuity, which causes the traceability system to fail directly.

[0010] 2. In manual processing and low-tech scenarios, there is a lack of technical means to prevent product swapping.

[0011] Switching refers to the unauthorized access or actions taken to a product by an unauthorized person. Such access alters the traceable product or changes its attributes, resulting in a discrepancy between the traceability system records and the product's actual attributes.

[0012] To determine which product interactions are authorized, or which interactions will truly, accurately, and promptly update product attributes, automated data collection equipment is needed. However, in manual processing scenarios, even the supply of electricity and network may not be possible, let alone automated data collection.

[0013] At this point, the product can be accessed without authorization, and various attacks can be carried out on it, such as injecting water, removing segments, adding additives, drilling holes in the liquor, or fumigating medicinal materials to steal the effective ingredients. These attacks cannot be reflected in the traceability system, which leads to consumers not trusting the corresponding traceability information reports.

[0014] 3. The traceability process can be bypassed, and it is difficult to gain consumer trust.

[0015] In manual processing scenarios, worker behavior is unpredictable and difficult to control, and workers will actively circumvent the traceability system, such as by attaching labels to barcode scanners to save time scanning items; multiple people using multiple tools may cause the tool-behavior-operator binding relationship to fail, etc. Traditional traceability methods cannot combat malicious operations by workers, and it is necessary to prove that workers have correctly carried out the traceability process, but such proof is very difficult.

[0016] 4. The challenge of consumer trust.

[0017] Given that manufacturers only highlight the advantages of their products in traceability reports while actively avoiding mentioning defects, consumers will not benefit from reviewing traceability reports when making purchasing decisions. Consequently, consumers will not trust traceability reports provided by manufacturers or third parties provided by manufacturers.

[0018] If consumers can independently verify the authenticity, accuracy, comprehensiveness, and relevance of data provided by manufacturers to the product itself, and generate human-readable product reports based on the verified data, then the consumer trust problem can be solved. Summary of the Invention

[0019] The technical problem solved by this invention is that it provides hardware, information software system, method, and equipment for tracing the source of manually processed products, in order to solve the problems of inability to automatically collect data, inability to track mixed sources, inability to prevent data swapping, and inability to verify data in the process of manually processing products in a low-tech, multi-person collaborative environment.

[0020] The technical solution of the present invention is as follows: In the first aspect, the present invention provides a hardware system for tracing the source of hand-processed products, including: a general-purpose hand-processing workbench, a traceability box with a smart lock and a self-destruct mechanism, and a CA for device authentication and issuance;

[0021] The general-purpose manual processing workbench integrates product processing trays, video capture, worker identification, traceability box docking, cloud data query and video upload functions;

[0022] All authorized and verified workstations are issued non-retrievable keys by the CA (Certificate Authority) based on the national cryptographic standard SM9 identity base encryption algorithm, which authenticates and issues the device.

[0023] Products enter and exit the workbench from the traceability box. Only after the traceability box is connected to the workbench will it automatically submit the box number and the number of times it has been unlocked to the workbench. The workbench compares this data with the traceability processing authorization. Only after confirming that the traceability box is carrying authorized products can the smart lock be opened and closed, and the product is taken out of the box and placed in the processing tray of the workbench. At this time, the tray will contain traceable products with traceability information provided by the traceability box.

[0024] Workers process products on pallets according to authorized workflows. Cameras on the workbench record the entire process. After processing, the products are placed back into the boxes, and the boxes are locked with the confirmation of the workbench staff, ensuring that the products remain within the workbench's view from removal to return. The workbench then uploads the processing authorization, box opening and closing records, worker identification data, and processing video to the cloud after signing them. This data serves as traceability proof for the work section, and the traceability proof is linked to the traceability box.

[0025] In multi-stage processing, each processing stage is required to have a workbench, and between processing stages, the product is always carried by a locked traceability box; at this time, in subsequent stages, the traceability box number read by the workbench will be consistent with the number of the previous stage, and the unlocking count read by the subsequent stage will be continuous with the unlocking count read by the previous stage.

[0026] The traceability certificate for each work section will be stored in the cloud. The traceability box numbers will be consistent and the number of times the boxes are unlocked will be consecutive, forming a unique chain. This chain will be used to verify whether the traceability certificate is complete and comprehensive.

[0027] Secondly, the present invention provides a traceability information software system for handcrafted products, including: a traceability standard system, an authorization template library, a trusted verification program library, an equipment verification personnel identity verification system and a key issuance system, software for detecting product substitution that supports product processing flow identification and software for generating traceability reports based on a multimodal large model, and a production authorization application system;

[0028] The traceability standard system is used to clarify product types, standardized production / processing procedures, production authorization requirements, verification procedure descriptions, and the format of the final traceability report. It serves as the top-level basis and judgment standard for the entire traceability system, and all authorizations, verifications, and report generation must be carried out in accordance with this standard.

[0029] The authorized template library is used to standardize management and production process templates on top of traceability standards; after enterprises complete their key parameters according to the templates, they can form executable and verifiable enterprise-level production authorizations.

[0030] The production authorization application system is used by enterprises to fill in the information online based on the "authorization template library" and upload it to the cloud to form specific enterprise production authorization data for this batch of products;

[0031] The trusted verification program library is used to automatically check whether there is any substitution, whether the process is compliant, and whether the chain of evidence is complete and has not been tampered with.

[0032] The equipment verification personnel identity verification system and key issuance system are used to verify the real name / authority of the workbench, traceability box, and operators, ensuring that "who, when, at which workstation, which product is produced, which raw materials are used, what process is used, and what the process requirements are" all correspond one-to-one with the authorization.

[0033] The product substitution detection system that supports product processing flow identification is used to track products / personnel / movement lines in processing videos using the YOLO-World zero-shot visual recognition model, identify suspicious events, and achieve product substitution detection.

[0034] The traceability report generation software system based on the multimodal large model is used to send keyframes and authorization rules into the multimodal large model after verification, and automatically generate a readable and verifiable product traceability report based on the report prototype in the traceability standard.

[0035] Furthermore, the system includes the following processing flow:

[0036] For each traceable product, the relevant departments jointly issue the traceability standard for that product;

[0037] Based on traceability standards, standard production processes for products will be developed and released through authorization of templates from the authorized template library.

[0038] Based on template authorization, enterprises supplement key data in the production authorization application system according to specific production needs to form enterprise production authorization data. This enterprise production authorization data is uploaded to the cloud in advance and distributed to general-purpose manual processing workbenches.

[0039] Based on traceability standards and enterprise production authorization data, traceability standard software was jointly developed by representatives of production enterprises and program developers. This traceability standard software includes video analysis, visual verification, and packet loss detection capabilities, and provides a prompt for generating traceability reports based on large models, based on the traceability standards.

[0040] Input the product's enterprise production authorization data and traceability certificates for each processing stage into the traceability standard software. The software first checks whether the enterprise's production authorization data is complete and compliant. Then, it uses visual recognition to determine whether the product has been swapped during processing. It checks whether the product has been swapped during storage and transportation based on the unlocking records. If no swapping is found, the software submits a video of the product processing process to a multimodal large model to generate a readable product traceability report.

[0041] Furthermore, the template authorization refers to management data that all participating companies in a product must comply with. Template authorization is a formalized text based on standards and reached through coordination and compromise among participating production units. On the one hand, template authorization includes stipulating the national standards that a product must meet, the product's consumer billing method, the profit distribution ratio of each stage, the acceptance standards between each stage, and the penalty measures. On the other hand, template authorization is a template for enterprises to generate specific production process authorizations. Enterprises can fill in specific production data in the template to form enterprise production authorizations that can be used to guide production and traceability verification.

[0042] Furthermore, the method for determining whether a product has been switched during processing using visual recognition includes:

[0043] In the video, the visual recognition frame of the product is marked by visual recognition, and the position of the recognition frame determines the position of the product in the processing process, which must always meet the product movement line specified in the authorization.

[0044] During the product processing, only authorized workers are allowed to handle the product, and the handling process must meet the authorization requirements.

[0045] At the same time, to prevent workers from obscuring the product and causing visual recognition failure, it is stipulated that workers must keep the product facing the camera at all times during the operation process;

[0046] Visual recognition continuously identifies and tracks videos. If a product identification box disappears after a time threshold, or if a similar product or an item that could be mixed in with the product is detected in the field of view, an alarm is triggered that the product has been switched.

[0047] Furthermore, checking whether the product has been switched during storage and transportation based on the unlocking record is equivalent to checking whether the product unlocking record matches the unlocking record specified in the authorization. If they do not match, it means that someone has accessed the product without authorization, and the product has been switched. At the same time, the traceability box may self-destruct under violent tampering, so it is also necessary to check whether the traceability box has self-destructed. If the box has self-destructed, it means that the product has been switched.

[0048] Furthermore, the method for submitting a multimodal large model and generating a readable product traceability report includes:

[0049] According to the traceability standard software, the product video is split into key frames. Then, the product key frames, the product standard production behavior specified in the authorization, and the Prompt used in the national standard to detect whether the product production is compliant are sent to the multimodal large model for analysis. The multimodal large model gives a report for each key frame.

[0050] Then, the reports from each keyframe will be merged from the multimodal large model into a final product traceability report that is readable by consumers, guided by the specific format of the report to be generated as specified in the traceability standard.

[0051] Thirdly, the present invention provides a method for tracing the origin of handcrafted products, the method comprising:

[0052] S1: Before production, the manufacturing company releases its production authorization data in advance, and discloses the detailed production process, product flow, and testing methods of the traceable products.

[0053] S2: Use an authorized traceability box to carry the products to be processed, and the traceability information of the products in the box must meet the authorization requirements;

[0054] S3: Place the traceability box on a workbench equipped with a camera. After the operator is identified, the workbench verifies the correctness of the authorization, verifies the matching between the traceability box and the authorization, and verifies the matching between the traceability record and the authorization of the product to be processed, query the cloud server for the unlocking dynamic code of the traceability box, and then unlock the box and take out the product.

[0055] S4: The camera on the workbench continuously records the product processing flow, dynamically recording the product movement and operator behavior, and stops recording video after knowing that the product has been placed in the traceability box and locked.

[0056] S5: Package the product traceability certificate for this work section, then upload the traceability certificate to the cloud after identity-based signature;

[0057] S6: After all work sections are completed, the manufacturer obtains the traceability certificate for each work section in reverse order of the number of unlocks based on the traceability certificate in the cloud.

[0058] S7: The manufacturer calls the traceability standard software to perform visual recognition and matching of authorization / unlocking records to check whether the product has been swapped. If it has not been swapped, a multimodal large model is sent to generate a product traceability report, and the product traceability report is used to analyze whether the production process is compliant. If there are problems in the production process, the target product cannot be sold as a traceable product, and workers who swapped the product or produced it in violation of regulations will be punished.

[0059] S8: If the product traceability report is qualified, the manufacturer will bind the product traceability report and the data of the traceability box and upload them to the cloud together;

[0060] S9: Before purchasing products, consumers can scan the traceability box to obtain a product traceability report and product traceability certificate from the cloud.

[0061] S10: Consumers can view the product traceability report provided by the manufacturer, pay to purchase the product, and receive the product, manufacturer traceability report, and traceability certificate at the same time. They can then return the traceability box to the store for recycling.

[0062] S11: If, after receiving the product, any discrepancy exists between the product and the traceability report, the consumer can send the traceability certificate to a verification party that has downloaded the traceability standard software or verify it themselves to generate a new report. If, during the verification process, it is determined that the product has been tampered with or that the manufacturer has provided false advertising, the consumer can recover their losses through consumer associations or legal means.

[0063] Fourthly, the present invention provides a traceability device for handcrafted products, comprising:

[0064] Traceability Box: The number of times the box is unlocked cannot be tampered with. The box is opened with a unique identifier under authorized support. It uses a smart lock to control the opening permission and is equipped with a self-destruct mechanism to destroy the products inside the box or record the destructive behavior when the box is opened without authorization.

[0065] Visual recognition workbench: Equipped with a production pallet, camera device, embedded processing unit and worker identification module, it continuously captures video images of the entire product processing process on the pallet, and provides signature and upload functions to generate a visual information carrier to replace physical tags for product identity binding; it integrates video acquisition, digital signature, data packaging and upload functions to upload the raw data and signature information during the processing to the cloud platform;

[0066] Traceability and Identity Authorization System: Customized authorization information is used to verify the identity of processing personnel. Only authorized personnel can open and close locks, take out products, and perform other tasks.

[0067] Product processing flow management system: Based on the product standard processing flow and verification flow, and verification procedures, an authorization for managing product production is generated, requiring the processing flow to be carried out in accordance with the authorization provisions, and a video for verification is submitted with the product;

[0068] Third-party testing and verification module: Based on the testing requirements given in the authorization, it uses visual recognition modules such as YOLO-World to analyze the product verification video, check whether the product has been tampered with, and whether the movement path meets the authorization requirements; and submits the verified video to the multimodal large model to generate a human-readable report based on the product standard.

[0069] Furthermore, each traceability box has a unique number, namely the box ID. Each box ID remains unchanged. The box can automatically record its own unlocking count, namely the box SN. Each unlocking count increments by 1. Authorization is based on the "box ID|box SN". If either the box ID or the box SN is incorrect, the box cannot be opened. The ID and SN are tamper-proof. The box is embedded with NFC to ensure that it will automatically open after verification upon entering the platform.

[0070] The traceability box has a breaching and damage mechanism, and contains levers and gas cylinders inside. If the box lid opens when the smart lock is closed, it means that the box has been physically breached, and paint / acid is sprayed into the products inside, destroying the products inside.

[0071] The production workbench is based on NFC to automatically link to the traceability box and verify whether the authorization downloaded at the current time is consistent with the "Box ID|Box SN". If they are consistent, the camera is activated to record the entire production process on the workbench from multiple angles. Then, the worker who has already scanned his face sends an opening command through a foot switch. After that, the worker takes the product out of the box, places it on the processing tray, and performs the processing operation.

[0072] The third-party testing and verification module is a binding system. It uses boxes to bind videos based on authorization, videos to identify the manufactured products based on YOLOworld, and binds the product's traceability information to the product's visual recognition frame. The product is bound to a type based on authorization, the type is bound to a testing program based on standards, the program verifies the video to generate a testing report, and the report content is filled into the cloud and bound to the box.

[0073] The visual information carrier is a visual recognition frame. When the product is split or mixed, the recognition frame can also split and mix automatically, and can automatically inherit or merge the traceability information in the original recognition frame to realize the traceability data tracking of mixed materials from multiple sources.

[0074] The third-party detection and verification module uses an identity-based signature system to verify whether each video has been tampered with. If any video has been tampered with, the generation of a traceability report will be rejected. If the number of videos is less than the standard requirement, it means that the traceability chain has been interrupted, and the generation of a traceability report will also be rejected.

[0075] The visual information carrier has a smart contract module that can be embedded and execute traceability logic. The smart contract module includes a programmable instruction set for processing permission verification, data inheritance rules, product status management, and identification loss alarm mechanism.

[0076] If the visual information carrier loses its binding continuously for more than a preset time threshold during processing, the system will automatically interrupt the traceable identity binding of the product and mark it as a non-traceable product to prevent the formation of an incomplete chain of evidence. If the video frames are continuous and the product movement and worker movement meet the authorization requirements, then the product has not been swapped. The video will be decomposed into key frames, sent to a multimodal large model, and a human-readable traceability report will be generated.

[0077] The beneficial effects of this invention are:

[0078] 1. This invention provides a "visual information carrier" technology without physical identifier binding, enabling virtual tracking that remains continuously bound even in environments where physical processing damages the device;

[0079] 2. Introduce a visual recognition-based, multimodal behavior analysis and authorization mechanism to prevent swapping behavior at the source;

[0080] 3. Introduce a "payment verification, anomaly compensation" mechanism that allows consumers to scan and verify instantly, enhancing the credibility of traceability reports;

[0081] 4. Adopting an equipment rental model lowers the barrier to entry for enterprises;

[0082] 5. Provide a complete chain of evidence to assist in judicial evidence preservation, enhancing its practicality in areas such as regulation and finance;

[0083] 6. Implement a reverse incentive mechanism for workers, transforming confrontation into collaboration and ensuring data authenticity.

[0084] 7. This invention provides a reliable traceability method for the manual processing of products, which can achieve the following characteristics:

[0085] By using the visual recognition frame of the product as a non-contact traceability information carrier in the manual processing steps, the problem of automatically binding traceability information in most manual processing steps such as peeling and chopping is solved, and the automatic collection of traceability data is realized. It also solves the traceability problem when products come from multiple sources or are split.

[0086] By providing a traceability box that can only be unlocked under processed video, a complete, end-to-end anti-swapping solution is offered, covering the entire process from farm to table. This anti-swapping mechanism can effectively defend against partial swapping of objects in open environments.

[0087] By providing the traceability box with passive self-destruct capability, it solves the problem of providing products with resistance to violent attacks in warehousing environments where there is no network or power supply for a long time.

[0088] By using zero-sample visual recognition and LLM multimodal large model, we provide consumers with a method to verify the authenticity of traceability information and generate their own reports, allowing consumers to effectively trust the traceability reports. Attached Figure Description

[0089] Figure 1 This invention is a national standard, a traceable product standard, verification procedure library, template library, production authorization, production data and certification, and report relationship diagram;

[0090] Figure 2 A schematic diagram of the three key data components in this invention;

[0091] Figure 3 This is a production flow chart for the present invention;

[0092] Figure 4 This is a flowchart of the verification section in this invention. Detailed Implementation

[0093] Example 1: As Figures 1-4 As shown, in a first aspect, the present invention provides a hardware system for tracing the origin of handcrafted products, including: a general-purpose handcrafted workbench, a traceability box with a smart lock and a self-destruct mechanism, and a CA for device authentication and issuance;

[0094] The general-purpose manual processing workbench integrates product processing trays, video capture, worker identification, traceability box docking, cloud data query and video upload functions;

[0095] All authorized and verified workstations are issued with an unextractable key by the CA (Certificate Authority) based on the national cryptographic standard SM9 identity base encryption algorithm, ensuring that the product traceability proof data submitted by the workstation is tamper-proof and can be verified by third parties.

[0096] Products enter and exit the workbench from the traceability box. Only after the traceability box is connected to the workbench will it automatically submit the box number and the number of times it has been unlocked to the workbench. The workbench compares this data with the traceability processing authorization. Only after confirming that the traceability box is carrying authorized products can the smart lock be opened and closed, and the product is taken out of the box and placed in the processing tray of the workbench. At this time, the tray will contain traceable products with traceability information provided by the traceability box.

[0097] Workers process products on pallets according to authorized workflows. Cameras on the workbench record the entire process. After processing, the products are placed back into the boxes, and the boxes are locked with the confirmation of the workbench staff, ensuring that the products remain within the workbench's view from removal to return. The workbench then uploads the processing authorization, box opening and closing records, worker identification data, and processing video to the cloud after signing them. This data serves as traceability proof for the work section, and the traceability proof is linked to the traceability box.

[0098] In multi-stage processing, each processing stage is required to have a workbench, and between processing stages, the product is always carried by a locked traceability box; at this time, in subsequent stages, the traceability box number read by the workbench will be consistent with the number of the previous stage, and the unlocking count read by the subsequent stage will be continuous with the unlocking count read by the previous stage.

[0099] The traceability certificate for each work section will be stored in the cloud. The traceability box numbers will be consistent and the number of times the boxes are unlocked will be consecutive, forming a unique chain. This chain will be used to verify whether the traceability certificate is complete and comprehensive.

[0100] Secondly, the present invention provides a traceability information software system for handcrafted products, including: a traceability standard system, an authorization template library, a trusted verification program library, an equipment verification personnel identity verification system and a key issuance system, software for detecting product substitution that supports product processing flow identification and software for generating traceability reports based on a multimodal large model, and a production authorization application system;

[0101] The traceability standard system is used to clarify product types, standardized production / processing procedures, production authorization requirements, verification procedure descriptions, and the format of the final traceability report. It serves as the top-level basis and judgment standard for the entire traceability system, and all authorizations, verifications, and report generation must be carried out in accordance with this standard.

[0102] The authorized template library is used to standardize management and production process templates on top of traceability standards; after enterprises complete their key parameters according to the templates, they can form executable and verifiable enterprise-level production authorizations.

[0103] The production authorization application system is used by enterprises to fill in the information online based on the "authorization template library" and upload it to the cloud to form specific enterprise production authorization data for this batch of products;

[0104] The trusted verification program library is used to automatically check whether there is any substitution, whether the process is compliant, and whether the chain of evidence is complete and has not been tampered with.

[0105] The equipment verification personnel identity verification system and key issuance system are used to verify the real name / authority of the workbench, traceability box, and operators, ensuring that "who, when, at which workstation, which product is produced, which raw materials are used, what process is used, and what the process requirements are" all correspond one-to-one with the authorization.

[0106] The product substitution detection system that supports product processing flow identification is used to track products / personnel / movement lines in processing videos using the YOLO-World zero-shot visual recognition model, identify suspicious events, and achieve product substitution detection.

[0107] The traceability report generation software system based on the multimodal large model is used to send keyframes and authorization rules into the multimodal large model after verification, and automatically generate a readable and verifiable product traceability report based on the report prototype in the traceability standard.

[0108] Furthermore, the system includes the following processing flow:

[0109] For each traceable product (such as French fries), the government, industry associations, and universities will jointly publish a traceability standard. This standard, based on national production standards for agricultural products, provides standardized content for the product's traceability process. The standard must include at least: the product type, a description of the production and processing steps, product production authorization requirements, a description of the verification procedure, and the specific format of the report to be generated. The traceability standard is the fundamental document for agricultural product traceability.

[0110] Based on traceability standards, product production standard processes are jointly developed by representatives of manufacturing enterprises and universities, and released through authorized templates from the authorized template library.

[0111] Based on template authorization, enterprises supplement key data in the production authorization application system according to specific production needs to form enterprise production authorization data. This enterprise production authorization data is uploaded to the cloud in advance and distributed to the general manual processing workbench to guide the production process. It also serves as a third-party verifier, providing important data to verify whether products have been swapped and whether production is compliant.

[0112] Based on traceability standards and enterprise production authorization data, traceability standard software was jointly developed by representatives of production enterprises and program developers. This traceability standard software includes video analysis, visual verification, and packet loss detection capabilities, and provides a prompt for generating traceability reports based on large models, based on the traceability standards.

[0113] Input the product's enterprise production authorization data and traceability certificates for each processing stage into the traceability standard software. The software first checks whether the enterprise's production authorization data is complete and compliant. Then, it uses visual recognition to determine whether the product has been swapped during processing. It checks whether the product has been swapped during storage and transportation based on the unlocking records. If no swapping is found, the software submits a video of the product processing process to a multimodal large model to generate a readable product traceability report.

[0114] Furthermore, the template authorization refers to management data that all participating companies in a product must comply with. Template authorization is a formalized text based on standards and reached through coordination and compromise among participating production units. On the one hand, template authorization includes stipulating the national standards that a product must meet, the product's consumer billing method, the profit distribution ratio of each stage, the acceptance standards between each stage, and the penalty measures. On the other hand, template authorization is a template for enterprises to generate specific production process authorizations. Enterprises can fill in specific production data in the template to form enterprise production authorizations that can be used to guide production and traceability verification.

[0115] Furthermore, the method for determining whether a product has been switched during processing using visual recognition includes:

[0116] In the video, the visual recognition frame of the product is marked by visual recognition, and the position of the recognition frame determines the position of the product in the processing process, which must always meet the product movement line specified in the authorization.

[0117] During the product processing, only authorized workers are allowed to handle the product, and the handling process must meet the authorization requirements.

[0118] At the same time, to prevent workers from obscuring the product and causing visual recognition failure, it is stipulated that workers must keep the product facing the camera at all times during the operation process;

[0119] Visual recognition continuously identifies and tracks videos. If a product identification box disappears after a time threshold, or if a similar product or an item that could be mixed in with the product is detected in the field of view, an alarm is triggered that the product has been switched.

[0120] In this invention, the visual recognition is general, which is difficult to predict in advance. At the same time, it is difficult to predict in advance the obstruction and attack objects (such as rats) that may appear in the production process. Therefore, the visual recognition used in this system requires general, zero-sample, and semantic recognition capabilities. For this reason, we chose Yolo-World as the core visual recognition method.

[0121] Furthermore, checking whether the product has been switched during storage and transportation based on the unlocking record is equivalent to checking whether the product unlocking record matches the unlocking record specified in the authorization. If they do not match, it means that someone has accessed the product without authorization, and the product has been switched. At the same time, the traceability box may self-destruct under violent tampering, so it is also necessary to check whether the traceability box has self-destructed. If the box has self-destructed, it means that the product has been switched.

[0122] Furthermore, the method for submitting a multimodal large model and generating a readable product traceability report includes:

[0123] According to the traceability standard software, the product video is split into key frames. Then, the product key frames, the product standard production behavior specified in the authorization, and the Prompt used in the national standard to detect whether the product production is compliant are sent to the multimodal large model for analysis. The multimodal large model gives a report for each key frame.

[0124] Then, the reports from each keyframe will be merged from the multimodal large model into a final product traceability report that is readable by consumers, guided by the specific format of the report to be generated as specified in the traceability standard.

[0125] Thirdly, the present invention provides a method for tracing the origin of handcrafted products, the method comprising:

[0126] S1: Before production, the manufacturing company releases its production authorization data in advance, and discloses the detailed production process, product flow, and testing methods of the traceable products.

[0127] S2: Use an authorized traceability box to carry the products to be processed, and the traceability information of the products in the box must meet the authorization requirements;

[0128] S3: Place the traceability box on a workbench equipped with a camera. After the operator is identified, the workbench verifies the correctness of the authorization, verifies the matching between the traceability box and the authorization, and verifies the matching between the traceability record and the authorization of the product to be processed, query the cloud server for the unlocking dynamic code of the traceability box, and then unlock the box and take out the product.

[0129] S4: The camera on the workbench continuously records the product processing flow, dynamically recording the product movement and operator behavior, and stops recording video after knowing that the product has been placed in the traceability box and locked.

[0130] S5: Package video data, authorization, worker identity authentication data, lock opening records, etc. into a product traceability certificate for this section, and then upload the traceability certificate to the cloud after identity-based signature;

[0131] S6: After all work sections are completed, the manufacturer obtains the traceability certificate for each work section in reverse order of the number of unlocks based on the traceability certificate in the cloud.

[0132] S7: The manufacturer calls the traceability standard software to perform visual recognition and matching of authorization / unlocking records to check whether the product has been swapped. If it has not been swapped, a multimodal large model is sent to generate a product traceability report, and the product traceability report is used to analyze whether the production process is compliant. If there are problems in the production process, the target product cannot be sold as a traceable product, and workers who swapped the product or produced it in violation of regulations will be punished.

[0133] S8: If the product traceability report is qualified, the manufacturer will bind the product traceability report and the data of the traceability box and upload them to the cloud together;

[0134] S9: Before purchasing products, consumers can scan the traceability box to obtain a product traceability report and product traceability certificate from the cloud.

[0135] S10: Consumers can view the product traceability report provided by the manufacturer, pay to purchase the product, and receive the product, manufacturer traceability report, and traceability certificate at the same time. They can then return the traceability box to the store for recycling.

[0136] S11: If, after receiving the product, any discrepancy exists between the product and the traceability report, the consumer can send the traceability certificate to a verification party that has downloaded the traceability standard software or verify it themselves to generate a new report. If, during the verification process, it is determined that the product has been tampered with or that the manufacturer has provided false advertising, the consumer can recover their losses through consumer associations or legal means. Here, because the manufacturer's traceability report is signed by the manufacturer and cannot be denied, and the traceability certificate has a digital signature on the workbench and cannot be tampered with, the manufacturer cannot escape liability for breach of contract.

[0137] Fourthly, the present invention provides a traceability device for handcrafted products, comprising:

[0138] Traceability Box: The number of times the box is unlocked cannot be tampered with. The box is opened with a unique identifier under authorized support. It uses a smart lock to control the opening permission and is equipped with a self-destruct mechanism to destroy the products inside the box or record the destructive behavior when the box is opened without authorization.

[0139] Visual recognition workbench: Equipped with a production pallet, camera device, embedded processing unit and worker identification module, it continuously captures video images of the entire product processing process on the pallet, and provides signature and upload functions to generate a visual information carrier to replace physical tags for product identity binding; it integrates video acquisition, digital signature, data packaging and upload functions to upload the raw data and signature information during the processing to the cloud platform;

[0140] Traceability and Identity Authorization System: Customized authorization information is used to verify the identity of processing personnel. Only authorized personnel can open and close locks, take out products, and perform other tasks.

[0141] Product processing flow management system: Based on the product standard processing flow and verification flow, and verification procedures, an authorization for managing product production is generated, requiring the processing flow to be carried out in accordance with the authorization provisions, and a video for verification is submitted with the product;

[0142] Third-party testing and verification module: Based on the testing requirements given in the authorization, it uses visual recognition modules such as YOLO-World to analyze the product verification video, check whether the product has been tampered with, and whether the movement path meets the authorization requirements; and submits the verified video to the multimodal large model to generate a human-readable report based on the product standard.

[0143] Furthermore, each traceability box has a unique number, namely the box ID. Each box ID remains unchanged. The box can automatically record its own unlocking count, namely the box SN. Each unlocking count increments by 1. Authorization is based on the "box ID|box SN". If either the box ID or the box SN is incorrect, the box cannot be opened. The ID and SN are tamper-proof. The box is embedded with NFC to ensure that it will automatically open after verification upon entering the platform.

[0144] The traceability box has a breaching and damage mechanism, and contains levers and gas cylinders inside. If the box lid opens when the smart lock is closed, it means that the box has been physically breached, and paint / acid is sprayed into the products inside, destroying the products inside.

[0145] The production workbench is based on NFC to automatically link to the traceability box and verify whether the authorization downloaded at the current time is consistent with the "Box ID|Box SN". If they are consistent, the camera is activated to record the entire production process on the workbench from multiple angles. Then, the worker who has already scanned his face sends an opening command through a foot switch. After that, the worker takes the product out of the box, places it on the processing tray, and performs the processing operation.

[0146] The third-party testing and verification module is a binding system. It uses boxes to bind videos based on authorization, videos to identify the manufactured products based on YOLOworld, and binds the product's traceability information to the product's visual recognition frame. The product is bound to a type based on authorization, the type is bound to a testing program based on standards, the program verifies the video to generate a testing report, and the report content is filled into the cloud and bound to the box.

[0147] The visual information carrier is a visual recognition frame. When the product is split or mixed, the recognition frame can also split and mix automatically, and can automatically inherit or merge the traceability information in the original recognition frame to realize the traceability data tracking of mixed materials from multiple sources.

[0148] The third-party detection and verification module uses an identity-based signature system to verify whether each video has been tampered with. If any video has been tampered with, the generation of a traceability report will be rejected. If the number of videos is less than the standard requirement, it means that the traceability chain has been interrupted, and the generation of a traceability report will also be rejected.

[0149] The visual information carrier has a smart contract module that can be embedded and execute traceability logic. The smart contract module includes a programmable instruction set for processing permission verification, data inheritance rules, product status management, and identification loss alarm mechanism.

[0150] If the visual information carrier loses its binding continuously for more than a preset time threshold during processing, the system will automatically interrupt the traceable identity binding of the product and mark it as a non-traceable product to prevent the formation of an incomplete chain of evidence. If the video frames are continuous and the product movement and worker movement meet the authorization requirements, then the product has not been swapped. The video will be decomposed into key frames, sent to a multimodal large model, and a human-readable traceability report will be generated.

[0151] This invention employs a method of "alternating between visual recognition boxes and traceability boxes as carriers of traceability information," and utilizes a third party to verify the traceability information and generate reports, thereby addressing the following issues:

[0152] 1) The challenge of preventing data tampering in artificial environments and scenarios without data collection equipment coverage.

[0153] 2) Provides automatic recording of traceability data through processes such as peeling, chopping, pulping, and frying.

[0154] 3) It provides protection against partial product substitution, and can counter attacks such as water injection, strip removal, perforation of the liquor, and theft of active ingredients through fumigation of medicinal materials.

[0155] 4) It naturally solves the problem of traceability when multiple sources are mixed.

[0156] 5) The traceability report is generated by a third party, effectively solving the problem that consumers cannot trust reports provided by manufacturers.

[0157] This invention is applicable to the construction of a trustworthy agricultural system involving agricultural producers, government regulators, and financial institutions.

[0158] The advantages of this invention over existing patents are as follows:

[0159] 1. Core innovation: Replacing physical labels with "visual information carriers":

[0160] Existing pain points: In manual processing (cutting, chopping, mixing, marinating), existing patents (based on QR codes / RFID / NFC) are prone to physical tags being damaged, falling off, or failing to adapt to changes in product form (splitting, mixing), causing the "one item, one code" binding to fail. This is a major bottleneck for traceability in this scenario.

[0161] The advantages of this invention: By using computer vision (such as YOLO-World) to dynamically generate and track "visual frames" attached to the product entity as virtual carriers, it perfectly solves the problem of continuous binding under changes in physical form. This is a revolutionary breakthrough and its biggest and most core advantage. Very few (or none) existing patents can effectively solve this problem.

[0162] 2. Effective Prevention and Control of "Switching" Behavior: Analysis and Authorization Closed Loop

[0163] Existing pain points: The existing system lacks effective monitoring of operator behavior, making it difficult to detect and prevent product substitution (such as replacing high-quality products with inferior ones). It mainly relies on process records and post-event audits, which suffer from poor real-time performance and high costs.

[0164] Advantages of this invention:

[0165] Source control: Smart locks + self-destruct traceability boxes + real-name authorization ensure that only authorized personnel operate specific batches of products during authorized times.

[0166] Process monitoring: Video analytics not only tracks product frames but also analyzes operator behavior (multimodal analysis), and can automatically identify abnormal behaviors (such as non-compliance with procedures or suspicious substitution actions).

[0167] Data trustworthiness assurance: Edge TEE signature and one-time key verification mechanism prevent data tampering and report forgery. This forms a complete anti-data-swapping chain from physical access control to operational behavior monitoring and data anti-counterfeiting.

[0168] 3. Improved credibility and verifiability:

[0169] Existing pain points: Many traceability systems are "black boxes" or require self-certification by enterprises, making it difficult for consumers to verify the authenticity of data at low cost, resulting in a lack of public trust ("pseudo-credibility"). The verification process is complex or impossible to verify.

[0170] Advantages of this invention:

[0171] Third-party testing:

[0172] The product comes with a manufacturer's report and unalterable production data and certificates, which can be retested by a third party designated by the consumer or by the consumer themselves through a testing procedure.

[0173] By introducing automatic or semi-automatic third-party detection modules (video analysis) based on large models and adopting a strong identity-based signature (SM9), the authority and accountability of reports are significantly improved.

[0174] Complete chain of evidence and judicial preservation: From equipment signature to test report signature, a closed-loop chain of evidence is formed to support judicial preservation and meet the high requirements of supervision and financial risk control.

[0175] 4. Applicability and feasibility:

[0176] Existing pain points: Existing high-cost and high-complexity solutions (such as end-to-end blockchain + a large number of IoT devices) are difficult to deploy and apply in low-tech, multi-person collaborative manual processing environments (such as small workshops and cooperatives).

[0177] Advantages of this invention:

[0178] Equipment rental model: Significantly reduces the initial investment threshold, especially suitable for small and medium-sized product processors.

[0179] Example 2: A food processing plant purchases potatoes from multiple origins and pre-processes them manually in the slicing area for subsequent vacuum packaging and sale. To prevent risks such as confusion of origin, tampering, and adulteration, and to provide consumers with verifiable traceability reports, the cooperative uses the hardware, information software system, method, and equipment for traceability of manually processed products as described in Example 1 of this invention. This achieves fully visualized and reliable traceability throughout the entire process. The specific usage process is as follows:

[0180] Step 1: Pre-processing and sealing in boxes;

[0181] Each batch of potatoes from different production areas (such as farmers A and B) is weighed upon arrival at the factory and then placed into two smart traceability boxes by management personnel (each box has a unique ID and a smart lock, and is equipped with a self-destruct mechanism upon opening). The system records information such as the box ID, origin, and storage time, and generates corresponding authorizations: specifying that a specific worker will process the potatoes at a specific processing table at a specific time.

[0182] Step 2: Workbench authorization and unpacking operation;

[0183] Before processing begins, workers complete real-name verification via facial recognition on the processing workbench. After placing the traceability box on the workbench, the NFC module automatically identifies the box ID and SN (number of unlocks) and compares them with the authorized information in the system. Once the comparison is successful, the workbench activates the camera device and allows workers to trigger the unlocking action via a foot switch, unlocking the traceability box and allowing the potatoes to be taken out.

[0184] Step 3: Visual tracking of the processing;

[0185] Workers place potatoes one by one on a workbench tray and manually peel and slice them with knives. The camera device tracks the movement trajectory of each potato in the frame using the YOLO-World visual recognition model and binds it to the identity information corresponding to the original box ID. At the same time, it tracks the worker's hand movement path. If unauthorized operation is detected or a potato leaves the view frame for more than 1 second, the system will automatically issue an alert and interrupt the traceability identity binding of that batch of potatoes, marking it as a "non-traceable product".

[0186] Step 4: Data processing, data archiving, and encrypted upload;

[0187] After a box of potatoes is sliced, the worker repacks the finished product into an empty box and locks it; the system packages, encrypts, and digitally signs the data such as video and image analysis parameters, operator ID, and timestamps of the entire processing process, and then uploads it to the cloud platform database;

[0188] Step 5: Third-party video detection and report generation;

[0189] Authorized third-party testing agencies use visual recognition tools to automatically detect whether the potato slicing process is compliant, based on the slicing process standards set by the factory: such as whether the potatoes were sliced ​​from the same box, whether there was any abnormal personnel involved, and whether the slicing process is continuous. After the detection is correct, the system automatically generates a "Visual Traceability Report of Potato Slicing Processing" through a large model, and the detection node signs it with SM9 to ensure that it cannot be forged.

[0190] Step 6: Product traceability verification;

[0191] Before being vacuum-packed, the finished potato chips are printed and affixed with a QR code by a sealing machine; consumers can scan the code to view the product's traceability information after purchasing at the retail end, including:

[0192] Information on farmers in the country of origin;

[0193] Processing time and operator number;

[0194] Video keyframe screenshots and behavior analysis summary;

[0195] Third-party testing and signature report;

[0196] If consumers have doubts about product quality, they can trigger the "delayed verification" mechanism, which will allow the system backend to re-verify the processing records and initiate a compensation procedure based on the results.

[0197] This equipment and method possess full-process digital signature, tamper-proof recording, dynamic social supervision, and end-user verification capabilities, empowering the product supply chain with credibility. It is especially suitable for highly reliable traceability in scenarios with high food safety risks and non-automated processing.

[0198] The specific embodiments of the present invention have been described in detail above with reference to the accompanying drawings. However, the present invention is not limited to the above embodiments. Within the scope of knowledge possessed by those skilled in the art, various changes can be made without departing from the spirit of the present invention.

Claims

1. A hardware system for tracing the origin of handcrafted products, characterized in that, include: A general-purpose manual processing workbench, a traceability box with a smart lock and a self-destruct mechanism, and a CA for equipment authentication and issuance; The general-purpose manual processing workbench integrates product processing trays, video capture, worker identification, traceability box docking, cloud data query and video upload functions; All authorized and verified workstations are issued non-retrievable keys by the CA (Certificate Authority) based on the national cryptographic standard SM9 identity base encryption algorithm, which authenticates and issues the device. Products enter and exit the workbench from the traceability box. Only after the traceability box is connected to the workbench will it automatically submit the box number and the number of times it has been unlocked to the workbench. The workbench compares this data with the traceability processing authorization. Only after confirming that the traceability box is carrying authorized products can the smart lock be opened and closed, and the product is taken out of the box and placed in the processing tray of the workbench. At this time, the tray will contain traceable products with traceability information provided by the traceability box. Workers process products on pallets according to authorized workflows. Cameras on the workbench record the entire process. After processing, the products are placed back into the boxes, and the boxes are locked with the confirmation of the workbench staff, ensuring that the products remain within the workbench's view from removal to return. The workbench then uploads the processing authorization, box opening and closing records, worker identification data, and processing video to the cloud after signing them. This data serves as traceability proof for the work section, and the traceability proof is linked to the traceability box. In multi-stage processing, each processing stage is required to have a workbench, and between processing stages, the product is always carried by a locked traceability box; at this time, in subsequent stages, the traceability box number read by the workbench will be consistent with the number of the previous stage, and the unlocking count read by the subsequent stage will be continuous with the unlocking count read by the previous stage. The traceability certificate for each work section will be stored in the cloud. The traceability box numbers will be consistent and the number of times the boxes are unlocked will be consecutive, forming a unique chain. This chain will be used to verify whether the traceability certificate is complete and comprehensive.

2. A software system for tracing the origin of handcrafted products, characterized in that, include: Traceability standard system, authorization template library, trusted verification program library, equipment verification personnel identity verification system and key issuance system, package swapping detection that supports product processing flow identification and traceability report generation software based on multimodal large model, and production authorization application system; The traceability standard system is used to clarify product types, standardized production / processing procedures, production authorization requirements, verification procedure descriptions, and the format of the final traceability report. It serves as the top-level basis and judgment standard for the entire traceability system, and all authorizations, verifications, and report generation must be carried out in accordance with this standard. The authorized template library is used to standardize management and production process templates on top of traceability standards; After enterprises complete their key parameters according to the template, they can generate an executable and verifiable enterprise-level production authorization. The production authorization application system is used by enterprises to fill in the information online based on the "authorization template library" and upload it to the cloud to form specific enterprise production authorization data for this batch of products; The trusted verification program library is used to automatically check whether there is any substitution, whether the process is compliant, and whether the chain of evidence is complete and has not been tampered with. The equipment verification personnel identity verification system and key issuance system are used to perform real-name / authority verification on workbenches, traceability boxes, and operators to ensure that "who, when, at which workstation, which product is produced, which raw materials are used, what process is used, and what the process requirements are" all correspond one-to-one with the authorization. The product substitution detection system that supports product processing flow identification is used to track products / personnel / movement lines in processing videos using the YOLO-World zero-shot visual recognition model, identify suspicious events, and achieve product substitution detection. The traceability report generation software system based on the multimodal large model is used to send keyframes and authorization rules into the multimodal large model after verification, and automatically generate a readable and verifiable product traceability report based on the report prototype in the traceability standard.

3. The traceability information software system for handcrafted products according to claim 2, characterized in that, The system includes the following processing flow: For each traceable product, the relevant departments jointly issue the traceability standard for that product; Based on traceability standards, standard production processes for products will be developed and released through authorization of templates from the authorized template library. Based on template authorization, enterprises supplement key data in the production authorization application system according to specific production needs to form enterprise production authorization data. This enterprise production authorization data is uploaded to the cloud in advance and distributed to general-purpose manual processing workbenches. Based on traceability standards and enterprise production authorization data, traceability standard software was jointly developed by representatives of production enterprises and program developers. This traceability standard software includes video analysis, visual verification, and packet loss detection capabilities, and provides a prompt for generating traceability reports based on large models, based on the traceability standards. Input the product's enterprise production authorization data and traceability certificates for each processing stage into the traceability standard software. The software first checks whether the enterprise's production authorization data is complete and compliant. Then, it uses visual recognition to determine whether the product has been swapped during processing. It checks whether the product has been swapped during storage and transportation based on the unlocking records. If no swapping is found, the software submits a video of the product processing process to a multimodal large model to generate a readable product traceability report.

4. The traceability information software system for handcrafted products according to claim 3, characterized in that, The template authorization refers to management data that all participating companies in a product must adhere to; the template authorization is based on standards and is reached through coordination and compromise among the participating production units, and is a formalized text. On the one hand, template authorization includes stipulating the national standards that a product must meet, the product's consumer billing method, the profit distribution ratio of each stage, the acceptance standards between each stage, and the penalty measures; on the other hand, template authorization is a template for enterprises to generate specific production process authorizations. Enterprises can fill in specific production data in the template to form enterprise production authorizations that can be used to guide production and traceability verification.

5. The traceability information software system for handcrafted products according to claim 3, characterized in that, The method for determining whether a product has been switched during processing using visual recognition includes: In the video, the visual recognition frame of the product is marked by visual recognition, and the position of the recognition frame determines the position of the product in the processing process, which must always meet the product movement line specified in the authorization. During the product processing, only authorized workers are allowed to handle the product, and the handling process must meet the authorization requirements. At the same time, to prevent workers from obscuring the product and causing visual recognition failure, it is stipulated that workers must keep the product facing the camera at all times during the operation process; Visual recognition continuously identifies and tracks videos. If a product identification box disappears after a time threshold, or if a similar product or an item that could be mixed in with the product is detected in the field of view, an alarm is triggered that the product has been switched.

6. The traceability information software system for handcrafted products according to claim 3, characterized in that, The step of checking whether the product has been switched during storage and transportation based on the unlocking record is equivalent to checking whether the product unlocking record matches the unlocking record specified in the authorization. If they do not match, it means that someone has accessed the product without authorization, and the product has been switched. At the same time, the traceability box may self-destruct under violent tampering, so it is also necessary to check whether the traceability box has self-destructed. If the box has self-destructed, it means that the product has been switched.

7. The traceability information software system for handcrafted products according to claim 3, characterized in that, The method for submitting a multimodal large model and generating a readable product traceability report includes: According to the traceability standard software, the product video is split into key frames. Then, the product key frames, the product standard production behavior specified in the authorization, and the Prompt used in the national standard to detect whether the product production is compliant are sent to the multimodal large model for analysis. The multimodal large model gives a report for each key frame. Then, the reports from each keyframe will be merged from the multimodal large model into a final product traceability report that is readable by consumers, guided by the specific format of the report to be generated as specified in the traceability standard.

8. A method for tracing the origin of handcrafted products, characterized in that, The method includes: S1: Before production, the manufacturing company releases its production authorization data in advance, and discloses the detailed production process, product flow, and testing methods of the traceable products. S2: Use an authorized traceability box to carry the products to be processed, and the traceability information of the products in the box must meet the authorization requirements; S3: Place the traceability box on a workbench equipped with a camera. After the operator is identified, the workbench verifies the correctness of the authorization, verifies the matching between the traceability box and the authorization, and verifies the matching between the traceability record and the authorization of the product to be processed, query the cloud server for the unlocking dynamic code of the traceability box, and then unlock the box and take out the product. S4: The camera on the workbench continuously records the product processing flow, dynamically recording the product movement and operator behavior, and stops recording video after knowing that the product has been placed in the traceability box and locked. S5: Package the product traceability certificate for this work section, then upload the traceability certificate to the cloud after identity-based signature; S6: After all work sections are completed, the manufacturer obtains the traceability certificate for each work section in reverse order of the number of unlocks based on the traceability certificate in the cloud. S7: The manufacturer calls the traceability standard software to perform visual recognition and matching of authorization / unlocking records to check whether the product has been swapped. If it has not been swapped, a multimodal large model is sent to generate a product traceability report, and the product traceability report is used to analyze whether the production process is compliant. If there are problems in the production process, the target product cannot be sold as a traceable product, and workers who swapped the product or produced it in violation of regulations will be punished. S8: If the product traceability report is qualified, the manufacturer will bind the product traceability report and the data of the traceability box and upload them to the cloud together; S9: Before purchasing products, consumers can scan the traceability box to obtain a product traceability report and product traceability certificate from the cloud. S10: Consumers can view the product traceability report provided by the manufacturer, pay to purchase the product, and receive the product, manufacturer traceability report, and traceability certificate at the same time. They can then return the traceability box to the store for recycling. S11: If, after receiving the product, any discrepancy exists between the product and the traceability report, the consumer can send the traceability certificate to a verification party that has downloaded the traceability standard software or verify it themselves to generate a new report. If, during the verification process, it is determined that the product has been tampered with or that the manufacturer has provided false advertising, the consumer can recover their losses through consumer associations or legal means.

9. A traceability device for handcrafted products, characterized in that, include: Traceability Box: The number of times the box is unlocked cannot be tampered with. The box is opened with a unique identifier under authorized support. It uses a smart lock to control the opening permission and is equipped with a self-destruct mechanism to destroy the products inside the box or record the destructive behavior when the box is opened without authorization. Visual recognition workbench: Equipped with a production pallet, camera device, embedded processing unit and worker identification module, it continuously captures video images of the entire product processing process on the pallet, and provides signature and upload functions to generate a visual information carrier to replace physical tags for product identity binding; it integrates video acquisition, digital signature, data packaging and upload functions to upload the raw data and signature information during the processing to the cloud platform; Traceability and Identity Authorization System: Customized authorization information is used to verify the identity of processing personnel. Only authorized personnel can open and close locks, take out products, and perform other tasks. Product processing flow management system: Based on the product standard processing flow and verification flow, and verification procedures, an authorization for managing product production is generated, requiring the processing flow to be carried out in accordance with the authorization provisions, and a video for verification is submitted with the product; Third-party testing and verification module: Based on the testing requirements given in the authorization, it uses visual recognition modules such as YOLO-World to analyze the product verification video, check whether the product has been tampered with, and whether the movement path meets the authorization requirements; and submits the verified video to the multimodal large model to generate a human-readable report based on the product standard.

10. A traceability device for handcrafted products according to claim 9, characterized in that, Each traceability box has a unique number, i.e., box ID. Each box ID remains unchanged. The box can automatically record its own unlocking count, i.e., box SN. Each unlocking count increments by 1. Authorization is based on the box ID|box SN. If either the box ID or box SN is incorrect, the box cannot be opened. The ID and SN are tamper-proof. The box is embedded with NFC to ensure that it will automatically open after verification upon entering the platform. The traceability box has a breaching and damage mechanism, and contains levers and gas cylinders inside. If the box lid opens when the smart lock is closed, it means that the box has been physically breached, and paint / acid is sprayed into the products inside, destroying the products inside. The production workbench is based on NFC to automatically link to the traceability box and verify whether the authorization downloaded at the current time is consistent with the "Box ID|Box SN". If they are consistent, the camera is activated to record the entire production process on the workbench from multiple angles. Then, the worker who has already scanned his face sends an opening command through a foot switch. After that, the worker takes the product out of the box, places it on the processing tray, and performs the processing operation. The third-party testing and verification module is a binding system. It uses boxes to bind videos based on authorization, videos to identify the manufactured products based on YOLOworld, and binds the product's traceability information to the product's visual recognition frame. The product is bound to a type based on authorization, the type is bound to a testing program based on standards, the program verifies the video to generate a testing report, and the report content is filled into the cloud and bound to the box. The visual information carrier is a visual recognition frame. When the product is split or mixed, the recognition frame can also split and mix automatically, and can automatically inherit or merge the traceability information in the original recognition frame to realize the traceability data tracking of mixed materials from multiple sources. The third-party detection and verification module uses an identity-based signature system to verify whether each video has been tampered with. If any video has been tampered with, the generation of a traceability report will be rejected. If the number of videos is less than the standard requirement, it means that the traceability chain has been interrupted, and the generation of a traceability report will also be rejected. The visual information carrier has a smart contract module that can be embedded and execute traceability logic. The smart contract module includes a programmable instruction set for processing permission verification, data inheritance rules, product status management, and identification loss alarm mechanism. If the visual information carrier loses its binding continuously for more than a preset time threshold during processing, the system will automatically interrupt the traceable identity binding of the product and mark it as a non-traceable product to prevent the formation of an incomplete chain of evidence. If the video frames are continuous and the product movement and worker movement meet the authorization requirements, then the product has not been swapped. The video will be decomposed into key frames, sent to a multimodal large model, and a human-readable traceability report will be generated.

Images