Final inspection method and system for agricultural machinery based on digital twin technology

Abstract

The invention relates to an agricultural machinery final inspection method and system based on a digital twinning technology, and belongs to the field of digital twinning technologies. The agricultural machine final inspection method based on the digital twin technology comprises the steps of identifying the type and the model of a to-be-inspected agricultural machine; determining a final inspection scheme of the to-be-inspected agricultural machine; constructing a virtual final inspection workshop according to the final inspection scheme of the agricultural machinery to be inspected, wherein the virtual final inspection workshop comprises an agricultural machinery twinborn body, an equipment twinborn body and a personnel twinborn body; obtaining entity state data of the agricultural machinery to be detected, and updating the twin of the agricultural machinery in the virtual final detection workshop through a mapping mechanism according to the entity state data; and the personnel twinborn body operates the equipment twinborn body to detect the twinborn body of the agricultural machine, detection data is uploaded to the control terminal, and a detection result is obtained after analysis. The final inspection efficiency is improved, and manpower and material resources are saved.

Description

Technical Field

[0001] The present invention belongs to the field of digital twin technology, and specifically relates to a final inspection method and system for agricultural machinery based on digital twin technology. Background Art

[0002] With the development of agricultural modernization and intelligence, the role of agricultural machinery and equipment in agricultural production has become increasingly important. Especially in the production, inspection and maintenance of agricultural machinery, how to improve production efficiency, reduce costs and improve product quality has become an urgent need of the industry. Digital twin technology, as an emerging technical means, has been widely used in manufacturing and industrial control fields. By establishing a digital model of the physical entity, digital twin technology can monitor and optimize the operating status of the system in real time, and perform accurate prediction and analysis, thereby improving production efficiency and product quality.

[0003] Existing final inspections of agricultural machinery are usually carried out in traditional agricultural machinery final inspection workshops. The final inspection work still relies on manual operation and experience judgment, and is greatly affected by the equipment status and manual experience. In particular, some internal components require the agricultural machinery to be disassembled before inspection, which results in a technical problem of low final inspection efficiency. Summary of the invention

[0004] In view of the above analysis, an embodiment of the present invention aims to provide a final inspection method and system for agricultural machinery based on digital twin technology, so as to solve the technical problem of low final inspection efficiency in the prior art.

[0005] The object of the present invention is achieved in that: The first aspect of the present invention provides a method for final inspection of agricultural machinery based on digital twin technology, comprising: Identify the type and model of agricultural machinery to be inspected; Determine the final inspection plan for the agricultural machinery to be inspected; Constructing a virtual final inspection workshop according to the final inspection plan of the agricultural machinery to be inspected, wherein the virtual final inspection workshop includes an agricultural machinery twin, an equipment twin, and a personnel twin; Acquire the physical state data of the agricultural machinery to be inspected, and update the twin of the agricultural machinery in the virtual final inspection workshop according to the physical state data through a mapping mechanism; The personnel twin operates the equipment twin to test the agricultural machinery twin, uploads the test data to the control terminal, and obtains the test results after analysis.

[0006] Furthermore, the determining of the final inspection plan of the agricultural machinery to be inspected includes: the control terminal searches a plan library for a final inspection plan that matches the agricultural machinery to be inspected according to the type and model of the agricultural machinery to be inspected.

[0007] Furthermore, it also includes: adding constraints to the final inspection plan to optimize the final inspection plan, the constraints include that the same inspection item can only be inspected on one inspection device, all inspection items are sorted according to priority, and inspections are performed in order of priority, and one inspector cannot perform two or more inspection items at the same time.

[0008] Furthermore, the virtual final inspection workshop is constructed according to the type and model of the agricultural machinery to be inspected, the inspection task and the inspection personnel, including: calling the matching agricultural machinery twin model in the agricultural machinery model library according to the type and model of the agricultural machinery to be inspected, and calling the equipment twin and personnel twin that meet the requirements in the equipment model library and the personnel model library respectively according to the requirements for the inspection equipment and inspection personnel in the final inspection plan, and integrating the agricultural machinery twin, equipment twin and personnel twin into a virtual final inspection workshop; respectively initializing the basic attributes, final inspection attributes and final inspection completion attributes of the agricultural machinery twin and equipment twin, as well as the basic information, operation information and guidance information of the personnel twin.

[0009] Furthermore, the basic attributes of the agricultural machinery twin include the type, model and final inspection line position of the agricultural machinery, the final inspection attributes include the inspection items and the inspection data of each item, and the final inspection completion attributes include the final inspection report; the basic attributes of the equipment twin include inspection items and equipment information, the final inspection attributes include operating mechanism, mechanical motion rules, interactive communication, signal excitation and state transition, and the final inspection completion attributes include equipment report; the operation information of the personnel twin includes inspection information entry, work efficiency and inspection standardization, and the guidance information includes skill training, targeted guidance and proficiency evaluation.

[0010] Furthermore, the physical state of the agricultural machinery to be inspected is obtained, and the agricultural machinery twin in the virtual final inspection workshop is updated according to the physical state through a mapping mechanism, including: collecting the mechanical motion parameters, interactive communication signals and structural state data of the agricultural machinery to be inspected through sensors, hardware acquisition terminals, barcode recognition devices or radio frequency identification devices installed on the agricultural machinery to be inspected or the final inspection equipment, and after data processing, the structure, function and operation state of the agricultural machinery to be inspected are mapped in real time to the virtual final inspection workshop through three-dimensional modeling technology to dynamically update the agricultural machinery twin.

[0011] Furthermore, the personnel twin operates the equipment twin to inspect the agricultural machinery twin, including: according to the inspection items in the final inspection plan, the control terminal generates an inspection task instruction; the personnel twin receives the inspection task instruction, operates the equipment twin required for the current inspection item to virtually disassemble and inspect the designated parts of the agricultural machinery twin, and updates the status of the virtual final inspection workshop in real time.

[0012] Furthermore, the real-time updating of the status of the virtual final inspection workshop includes: after each inspection item is completed, real-time updating of the final inspection attributes of the agricultural machinery twin, the final inspection attributes of the equipment twin and the operation information of the personnel twin.

[0013] Furthermore, uploading the test results to the control terminal includes: after completing all test items, uploading the final inspection attributes of the agricultural machinery twin, the final inspection attributes of the equipment twin and the operation information of the personnel twin to the control terminal, generating corresponding test results after analysis, sending the test results to the virtual final inspection workshop, and updating the final inspection completion attributes of the agricultural machinery twin, the final inspection completion attributes of the equipment twin and the guidance information of the personnel twin.

[0014] A second aspect of the present invention provides an agricultural machinery final inspection system based on digital twin technology, comprising: Agricultural machinery identification module, used to identify the type and model of agricultural machinery to be inspected; A final inspection plan determination module is used to determine the final inspection plan for the agricultural machinery to be inspected; A virtual workshop construction module is used to construct a virtual final inspection workshop according to the final inspection plan of the agricultural machinery to be inspected, wherein the virtual final inspection workshop includes an agricultural machinery twin, an equipment twin, and a personnel twin; A status update module is used to obtain the entity status data of the agricultural machinery to be inspected, and update the twin of the agricultural machinery in the virtual final inspection workshop according to the entity status data through a mapping mechanism; The virtual detection module is used for the personnel twin to operate the equipment twin to detect the agricultural machinery twin, upload the detection data to the control terminal, and obtain the detection results after analysis.

[0015] Compared with the prior art, the present invention can achieve at least one of the following beneficial effects: The agricultural machinery final inspection method based on digital twin technology provided by the present invention constructs a virtual final inspection workshop including agricultural machinery twins, equipment twins and personnel twins, and then maps the status of the physical agricultural machinery to the virtual final inspection workshop through a mapping mechanism, thereby completing the final inspection task of the agricultural machinery in the virtual space, improving the final inspection efficiency and saving manpower and material resources. BRIEF DESCRIPTION OF THE DRAWINGS

[0016] In order to more clearly illustrate the embodiments of this specification or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments recorded in the embodiments of this specification. For ordinary technicians in this field, other drawings can also be obtained based on these drawings.

[0017] Figure 1 A flowchart of a method for final inspection of agricultural machinery based on digital twin technology provided in Example 1 of the present invention; Figure 2 Schematic diagram of the agricultural machinery final inspection system based on digital twin technology provided in Example 2 of the present invention. DETAILED DESCRIPTION

[0018] In order to make the purpose, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are part of the embodiments of the present invention, not all of the embodiments. It should be noted that, in the absence of conflict, the embodiments and features in the embodiments disclosed in this disclosure can be combined, separated, interchanged and / or rearranged with each other. Based on the embodiments in the present invention, all other embodiments obtained by ordinary technicians in this field without making creative work are within the scope of protection of the present invention.

[0019] Example 1 A specific embodiment of the present invention, as Figure 1 As shown, a final inspection method for agricultural machinery based on digital twin technology is disclosed, comprising the following steps: S1. Identify the type and model of the agricultural machinery to be inspected; Exemplarily, the identification methods include: barcode recognition: scanning the identification barcode on the body of the agricultural machinery to be inspected, and parsing the agricultural machinery model and type information pre-stored in the barcode; radio frequency identification (RFID): reading the RFID tags embedded in key parts of the agricultural machinery, and obtaining the agricultural machinery model, production batch and inspection history data stored in the tags; image recognition: using a camera to capture images of the appearance of the agricultural machinery, and using a pre-trained convolutional neural network model to identify the model features of the agricultural machinery (such as brand logos, structural outlines), and matching them with standard images in the model library.

[0020] S2. Determine the final inspection plan for the agricultural machinery to be inspected; In this embodiment, step S2 specifically includes: the control terminal searches the solution library for a final inspection solution that matches the agricultural machinery to be inspected according to the type and model of the agricultural machinery to be inspected.

[0021] Specifically, the solution library pre-stores final inspection solutions for various types and models of agricultural machinery, and determines the final inspection solution for the agricultural machinery to be inspected through model comparison.

[0022] In some embodiments, step S2 also includes: adding constraints to the final inspection plan to optimize the final inspection plan, the constraints include that the same inspection item can only be inspected on one inspection device, all inspection items are sorted according to priority, and inspections are performed in order of priority, and one inspector cannot perform two or more inspection items at the same time.

[0023] S3. Construct a virtual final inspection workshop according to the final inspection plan of the agricultural machinery to be inspected, wherein the virtual final inspection workshop includes an agricultural machinery twin, an equipment twin, and a personnel twin; In this embodiment, step S3 specifically includes: S301. According to the type and model of the agricultural machinery to be inspected, call the matching agricultural machinery twin model in the agricultural machinery model library, and according to the requirements for the inspection equipment and inspection personnel in the final inspection plan, call the equipment twin and personnel twin that meet the requirements in the equipment model library and the personnel model library respectively, and integrate the agricultural machinery twin, equipment twin and personnel twin into a virtual final inspection workshop; Exemplarily, different equipment twins correspond to different final inspection modules, such as the whole machine and engine, transmission system, steering system, braking system, hydraulic system, frame and travel system, cutting table, threshing part, grain box, grass box, bran box, stalk chopper, cab and outer cover, lighting and signal, and specific operating device detection; the final inspection plan consists of several final inspection modules, and the final inspection modules can also be increased or decreased according to needs; the final inspection attributes of the agricultural machinery twin are associated with the final inspection attributes of the equipment twin and the operation information of the personnel twin through the data interface, and a logical mapping relationship between the three is established; a virtual final inspection workshop scene is constructed using 3D modeling software (such as Unity or Unreal Engine), the agricultural machinery twin is placed in a virtual inspection station, the equipment twin is arranged according to the actual layout, and the personnel twin is assigned to the designated station.

[0024] S302. Initialize the basic attributes, final inspection attributes, and final inspection completion attributes of the agricultural machinery twin and the equipment twin, as well as the basic information, operation information, and guidance information of the personnel twin.

[0025] Specifically, the basic attributes of the agricultural machinery twin include the type, model and location of the final inspection line; the final inspection attributes include the inspection items and the inspection data of each item; the final inspection completion attributes include the final inspection report; the basic attributes of the equipment twin include inspection items and equipment information; the final inspection attributes include operating mechanism, mechanical motion rules, interactive communication, signal excitation and state transition; the final inspection completion attributes include equipment report; the operation information of the personnel twin includes inspection information entry, work efficiency and inspection standardization; the guidance information includes skill training, targeted guidance and proficiency evaluation.

[0026] S4, obtaining the physical state data of the agricultural machinery to be inspected, and updating the twin of the agricultural machinery in the virtual final inspection workshop according to the physical state data through a mapping mechanism; Specifically, through sensors, hardware acquisition terminals, barcode recognition devices or radio frequency identification devices installed on the agricultural machinery to be inspected or the final inspection equipment, the mechanical motion parameters, interactive communication signals and structural status data of the agricultural machinery to be inspected are collected. After data processing, the structure, function and operating status of the agricultural machinery to be inspected are mapped in real time to the virtual final inspection workshop through three-dimensional modeling technology to dynamically update the agricultural machinery twin.

[0027] S5. The personnel twin operates the equipment twin to detect the agricultural machinery twin, uploads the detection data to the control terminal, and obtains the detection results after analysis.

[0028] In this embodiment, step S5 specifically includes: S501, according to the inspection items in the final inspection plan, the control terminal generates an inspection task instruction; Specifically, the control terminal parses the list of inspection items in the final inspection plan, breaks down each item into atomic operations (such as removing the engine hood and testing the hydraulic oil pressure); then assigns tasks according to the capability attributes of the equipment twin (such as detection range and accuracy), generates an instruction set containing operation steps, parameter thresholds and time nodes, and sends the instruction set to the corresponding personnel twin.

[0029] S502: The personnel twin receives the inspection task instruction, operates the equipment twin required for the current inspection project to virtually disassemble and inspect the designated parts of the agricultural machinery twin, and updates the status of the virtual final inspection workshop in real time.

[0030] Specifically, real-time updating of the status of the virtual final inspection workshop includes: after each inspection item is completed, real-time updating of the final inspection attributes of the agricultural machinery twin, the final inspection attributes of the equipment twin, and the operation information of the personnel twin.

[0031] S503. After completing all inspection items, the final inspection attributes of the agricultural machinery twin, the final inspection attributes of the equipment twin, and the operation information of the personnel twin are uploaded to the control terminal. After analysis, the corresponding inspection results are generated, and the inspection results are sent to the virtual final inspection workshop. The final inspection completion attributes of the agricultural machinery twin, the final inspection completion attributes of the equipment twin, and the guidance information of the personnel twin are updated.

[0032] Specifically, after all inspection items are completed, the control terminal analyzes the quality level, fault information, cause and quality status of the inspection parts according to the inspection data of each inspection item of the agricultural machinery twin, and forms a final inspection report for the agricultural machinery to be inspected; analyzes the reliability of the equipment and the equipment's own performance according to the working data of each equipment twin, and forms an equipment report; analyzes the proficiency of each inspection personnel according to the operation information of the personnel twin, what skills training is needed, gives targeted guidance, and forms guidance information; then transmits the inspection results consisting of the final inspection report, equipment report, and guidance information back to the virtual final inspection workshop, and updates the final inspection completion attributes of the agricultural machinery twin, the final inspection completion attributes of the equipment twin, and the guidance information of the personnel twin.

[0033] In some embodiments, the final inspection plan is also optimized by recording the test results, verifying the accuracy of the test results, analyzing the reasons for the low accuracy, and optimizing the relevant parts of the final inspection plan using intelligent algorithms.

[0034] Compared with the existing technology, the agricultural machinery final inspection method based on digital twin technology provided in this embodiment constructs a virtual final inspection workshop including agricultural machinery twins, equipment twins and personnel twins, and then maps the status of the physical agricultural machinery to the virtual final inspection workshop through a mapping mechanism, thereby completing the final inspection task of the agricultural machinery in the virtual space, improving the final inspection efficiency and saving manpower and material resources.

[0035] Example 2 This embodiment provides an agricultural machinery final inspection system based on digital twin technology. Figure 2 As shown, including: Agricultural machinery identification module, used to identify the type and model of agricultural machinery to be inspected; A final inspection plan determination module is used to determine the final inspection plan for the agricultural machinery to be inspected; A virtual workshop construction module is used to construct a virtual final inspection workshop according to the final inspection plan of the agricultural machinery to be inspected, wherein the virtual final inspection workshop includes an agricultural machinery twin, an equipment twin, and a personnel twin; A status update module is used to obtain the entity status data of the agricultural machinery to be inspected, and update the twin of the agricultural machinery in the virtual final inspection workshop according to the entity status data through a mapping mechanism; The virtual detection module is used for the personnel twin to operate the equipment twin to detect the agricultural machinery twin, upload the detection data to the control terminal, and obtain the detection results after analysis.

[0036] The specific implementation methods described above further illustrate the objectives, technical solutions and beneficial effects of the present invention in detail. It should be understood that the above description is only a specific implementation method of the present invention and is not intended to limit the scope of protection of the present invention. Any modifications, equivalent substitutions, improvements, etc. made within the spirit and principles of the present invention should be included in the scope of protection of the present invention.

Claims

1. A final inspection method for agricultural machinery based on digital twin technology, characterized in that: include: Identify the type and model of agricultural machinery to be inspected; Determine the final inspection plan for the agricultural machinery to be inspected; Constructing a virtual final inspection workshop according to the final inspection plan of the agricultural machinery to be inspected, wherein the virtual final inspection workshop includes an agricultural machinery twin, an equipment twin, and a personnel twin; Acquire the physical state data of the agricultural machinery to be inspected, and update the twin of the agricultural machinery in the virtual final inspection workshop according to the physical state data through a mapping mechanism; The personnel twin operates the equipment twin to test the agricultural machinery twin, uploads the test data to the control terminal, and obtains the test results after analysis.

2. The agricultural machinery final inspection method based on digital twin technology according to claim 1 is characterized in that: The final inspection plan for the agricultural machinery to be inspected is determined, including: The control terminal searches the solution library for a final inspection solution that matches the agricultural machinery to be inspected according to the type and model of the agricultural machinery to be inspected.

3. The agricultural machinery final inspection method based on digital twin technology according to claim 2 is characterized in that: Also includes: Add constraints to the final inspection plan to optimize the final inspection plan. The constraints include that the same inspection item can only be inspected on one inspection device, all inspection items are sorted according to priority, and inspections are performed in order of priority. One inspector cannot perform two or more inspection items at the same time.

4. The agricultural machinery final inspection method based on digital twin technology according to claim 2 is characterized in that: The virtual final inspection workshop is constructed according to the final inspection plan of the agricultural machinery to be inspected, including: According to the type and model of the agricultural machinery to be inspected, the matching agricultural machinery twin model in the agricultural machinery model library is called; according to the requirements for the inspection equipment and inspection personnel in the final inspection plan, the equipment twin and personnel twin that meet the requirements in the equipment model library and the personnel model library are called respectively, and the agricultural machinery twin, equipment twin and personnel twin are integrated into a virtual final inspection workshop; Initialize the basic attributes, final inspection attributes, and final inspection completion attributes of the agricultural machinery twin and equipment twin, as well as the basic information, operation information, and guidance information of the personnel twin.

5. The agricultural machinery final inspection method based on digital twin technology according to claim 2 is characterized in that: The basic attributes of the agricultural machinery twin include the type, model and location of the final inspection line; the final inspection attributes include the inspection items and the inspection data of each item; the final inspection completion attributes include the final inspection report; the basic attributes of the equipment twin include the inspection items and equipment information; the final inspection attributes include the operating mechanism, mechanical motion rules, interactive communication, signal excitation and state transition; the final inspection completion attributes include the equipment report; the operation information of the personnel twin includes the inspection information input, work efficiency and inspection standardization; the guidance information includes skill training, targeted guidance and proficiency evaluation.

6. The agricultural machinery final inspection method based on digital twin technology according to claim 4 is characterized in that: The obtaining of the physical state of the agricultural machinery to be inspected and updating the twin of the agricultural machinery in the virtual final inspection workshop according to the physical state through a mapping mechanism include: By installing sensors, hardware acquisition terminals, barcode recognition devices or radio frequency identification devices on the agricultural machinery to be inspected or the final inspection equipment, the mechanical motion parameters, interactive communication signals and structural status data of the agricultural machinery to be inspected are collected. After data processing, the structure, function and operating status of the agricultural machinery to be inspected are mapped in real time to the virtual final inspection workshop through three-dimensional modeling technology to dynamically update the agricultural machinery twin.

7. The agricultural machinery final inspection method based on digital twin technology according to claim 6 is characterized in that: The human twin operates the equipment twin to detect the agricultural machinery twin, including: According to the inspection items in the final inspection plan, the control terminal generates inspection task instructions; The personnel twin receives the inspection task instruction, operates the equipment twin required for the current inspection project to virtually disassemble and inspect the designated parts of the agricultural machinery twin, and updates the status of the virtual final inspection workshop in real time.

8. The agricultural machinery final inspection method based on digital twin technology according to claim 7 is characterized in that: The real-time update of the status of the virtual final inspection workshop includes: After each inspection item is completed, the final inspection attributes of the agricultural machinery twin, the final inspection attributes of the equipment twin, and the operation information of the personnel twin are updated in real time.

9. The agricultural machinery final inspection method based on digital twin technology according to claim 8 is characterized in that: The test data is uploaded to the control terminal, and the test results are obtained after analysis, including: After completing all inspection items, the final inspection attributes of the agricultural machinery twin, the final inspection attributes of the equipment twin, and the operation information of the personnel twin are uploaded to the control terminal. After analysis, the corresponding test results are generated and sent to the virtual final inspection workshop to update the final inspection completion attributes of the agricultural machinery twin, the final inspection completion attributes of the equipment twin, and the guidance information of the personnel twin.

10. An agricultural machinery final inspection system based on digital twin technology, characterized in that: include: Agricultural machinery identification module, used to identify the type and model of agricultural machinery to be inspected; A final inspection plan determination module is used to determine the final inspection plan for the agricultural machinery to be inspected; A virtual workshop construction module, used to construct a virtual final inspection workshop according to the final inspection plan of the agricultural machinery to be inspected, wherein the virtual final inspection workshop includes an agricultural machinery twin, an equipment twin, and a personnel twin; A status update module is used to obtain the entity status data of the agricultural machinery to be inspected, and update the twin of the agricultural machinery in the virtual final inspection workshop according to the entity status data through a mapping mechanism; The virtual detection module is used for the personnel twin to operate the equipment twin to detect the agricultural machinery twin, upload the detection data to the control terminal, and obtain the detection results after analysis.

Images