Aviation equipment supply chain tracking method and system based on the Internet of Things

Abstract

The present invention discloses an aviation equipment supply chain tracking method and system based on the Internet of Things, and relates to the technical field of supply chain management. The system includes an aviation equipment placement device, a tracking locator, a locator delivery device, a packaging box sealing device, two Compton backscatter imaging devices and a tracking monitoring platform server, and through their connection relationship and linkage, the tracking locator can be activated and bound to the aviation equipment packaging box and the aviation equipment in the box, and then the packaging box transportation trajectory is determined according to the uploaded positioning information, and according to the consistency evaluation results of the outer surface images of the front and rear boxes, it is determined whether there is an aviation equipment safety risk, and whether an alarm action is triggered when it is. Compared with the existing manual inspection method, this can not only reduce the workload, improve the inspection efficiency and avoid human errors, but also timely discover the situation of aviation equipment being swapped and alarm, thereby efficiently and accurately ensuring the supply chain transportation safety of aviation equipment.

Description

Technical Field

[0001] The present invention belongs to the technical field of supply chain management, and in particular relates to an aviation equipment supply chain tracking method and system based on the Internet of Things. Background Art

[0002] Aviation equipment generally refers to aviation materials, specifically the general term for various materials used in the manufacture of aircraft, aircraft engines and airborne equipment. Aviation materials are the material guarantee for the development and production of aviation products, and are also the technical basis for aviation products to achieve the performance, service life and reliability that people expect.

[0003] At present, the transportation safety of aviation equipment is mainly ensured through manual inspection during the supply and transportation of aviation equipment. However, this method obviously has problems such as large workload, low efficiency, easy human errors and difficulty in timely detection of aviation equipment being swapped. Summary of the invention

[0004] The purpose of the present invention is to provide an aviation equipment supply chain tracking system and method based on the Internet of Things, so as to solve the problems of large workload, low efficiency, easy human error and difficulty in timely detection of aircraft equipment substitution in the existing manual inspection method in the aircraft equipment supply and transportation process.

[0005] In order to achieve the above object, the present invention adopts the following technical solutions:

[0006] In a first aspect, an aviation material supply chain tracking system based on the Internet of Things is provided, comprising an aviation material placement device, a tracking locator, a locator delivery device, a packaging box sealing device, a first Compton backscatter imaging device, a second Compton backscatter imaging device and a tracking and monitoring platform server, wherein the aviation material placement device, the locator delivery device, the packaging box sealing device and the first Compton backscatter imaging device are sequentially arranged along the aviation material packaging production line, the number of the second Compton backscatter imaging devices is multiple and they are respectively arranged at each transfer node on the aviation material supply chain, the tracking locator is connected to the tracking and monitoring platform server via wireless Internet of Things communication, and the locator delivery device, the first Compton backscatter imaging device and the second Compton backscatter imaging device are respectively connected to the tracking and monitoring platform server via Internet of Things communication;

[0007] The aviation equipment placement device is used to place the aviation equipment inside the aviation equipment packaging box;

[0008] The tracking locator is used to periodically upload the local unique identification and positioning information to the tracking and monitoring platform server after activation;

[0009] The locator delivery device is used to activate the tracking locator and deliver the tracking locator into the interior of the aviation equipment packaging box where the aviation equipment has been placed, and also transmit the unique identifier of the tracking locator to the tracking monitoring platform server;

[0010] The packaging box sealing device is used to seal the aviation equipment packaging box in which the aviation equipment and the positioner are placed;

[0011] The first Compton backscatter imaging device is used to perform imaging processing on the outer surface of the aviation equipment packaging box to obtain a first box outer surface image, and transmit the first box outer surface image to the tracking and monitoring platform server;

[0012] The second Compton backscatter imaging device is used to perform imaging processing on the outer surface of the aviation equipment packaging box when the aviation equipment packaging box passes through the transfer node, obtain a second box outer surface image, and transmit the second box outer surface image to the tracking and monitoring platform server;

[0013] The tracking and monitoring platform server is used to determine the transportation trajectory of the aviation equipment packaging box based on the positioning information uploaded by the tracking locator and bound to the unique identifier, and when it is found that the aviation equipment packaging box passes through any transfer node in the aviation equipment supply chain according to the transportation trajectory, it is also used to perform a consistency evaluation on the first box outer surface image and the second box outer surface image uploaded by the second Compton backscatter imaging device arranged at any transfer node. If the consistency evaluation result indicates inconsistency, an alarm action is triggered.

[0014] Based on the above invention content, a new supply chain management solution is provided, which can automatically check the safety of aviation equipment during the supply and transportation of aviation equipment, namely, it includes aviation equipment placement equipment, tracking locators, locator delivery equipment, packaging box sealing equipment, two Compton backscatter imaging devices and tracking monitoring platform servers, and through their connection relationship and linkage, the tracking locator can be activated and bound to the aviation equipment packaging box and the aviation equipment in the box, and then the packaging box transportation trajectory is determined according to the positioning information uploaded by the tracking locator, and according to the consistency evaluation results of the outer surface images of the front and rear boxes, it is determined whether there is an aviation equipment safety risk, and whether an alarm action is triggered when it is. Compared with the existing manual inspection method, this can not only reduce the workload, improve the inspection efficiency and avoid human errors, but also timely discover the situation of aviation equipment being swapped and trigger an alarm, thereby efficiently and accurately ensuring the supply chain transportation safety of aviation equipment, which is convenient for practical application and promotion.

[0015] In a possible design, the aviation equipment packaging box is made of materials other than electromagnetic shielding materials.

[0016] In one possible design, when the aircraft equipment packaging box is made of electromagnetic shielding material, the box body of the aircraft equipment packaging box is provided with a through hole connecting the inside and the outside, and when the locator delivery device delivers the tracking locator into the interior of the aircraft equipment packaging box, the antenna of the tracking locator is exposed from the through hole.

[0017] In one possible design, the tracking locator is powered by a disposable battery, wherein the battery life of the disposable battery is greater than the maximum time required for transportation from the location of the locator delivery device to the terminal location of the aviation equipment supply chain.

[0018] In a possible design, the locator delivery device includes a locator storage box, a manipulator, an RFID tag reader, a packaging box passing trigger, and an industrial computer, wherein the locator storage box stores a plurality of tracking locators carrying RFID tags, and the industrial computer is respectively communicatively connected to the manipulator, the RFID tag reader, the packaging box passing trigger, and the tracking monitoring platform server;

[0019] The packaging box passing trigger is used to send a trigger signal to the industrial computer when it is found that the aviation equipment packaging box containing the aviation equipment passes through the locator delivery device along the aviation equipment packaging production line;

[0020] The industrial computer is used to control the manipulator to take out any tracking locator from the locator storage box and activate it when receiving the trigger signal, and then place the any tracking locator into the interior of the aviation equipment packaging box where the aviation equipment is placed after passing through the RFID tag reader;

[0021] The RFID tag reader is used to read the RFID tag in any tracking locator when any tracking locator passes by, obtain the unique identification of any tracking locator, and transmit the unique identification of any tracking locator to the industrial computer;

[0022] The industrial computer is also used to transmit the unique identification of any tracking locator to the tracking and monitoring platform server.

[0023] In one possible design, the package box passes through a trigger using an AI camera integrated with a package box recognition algorithm.

[0024] In one possible design, performing consistency evaluation on the first outer surface image of the box body and the second outer surface image of the box body uploaded by the second Compton backscatter imaging device arranged at any of the transfer nodes includes:

[0025] Performing image feature extraction processing on the first outer surface image of the casing to obtain a plurality of first outer surface features of the casing;

[0026] The image feature extraction process is also performed on the second outer surface image of the second box body uploaded by the second Compton backscatter imaging device arranged at any of the transfer nodes to obtain a plurality of second outer surface features of the box body;

[0027] The multiple first outer surface features of the box body and the multiple second outer surface features of the box body are imported into a consistency evaluation model pre-trained based on a gradient boosting decision tree (GBDT) model and used to fuse the alignment dimension of the outer surface features of the box body and the similarity matching dimension of the distribution of the outer surface features of the box body to perform consistency evaluation on the two objects, and the consistency evaluation result is output.

[0028] In one possible design, transmitting the first outer surface image of the housing or the second outer surface image of the housing to the tracking and monitoring platform server includes:

[0029] Importing the outer surface image of the box and the locally stored sample outer surface image of the box into a pre-trained image difference description generation model, and outputting an image difference description text between the outer surface image of the box and the sample outer surface image of the box, wherein the outer surface image of the box refers to the first outer surface image of the box or the second outer surface image of the box;

[0030] Performing hash processing on the outer surface image of the box body based on a hash algorithm to obtain a first hash value;

[0031] The image difference description text and the first hash value are packaged and transmitted to the tracking and monitoring platform server, so that the tracking and monitoring platform server first imports the locally pre-stored sample image of the outer surface of the box body and the image difference description text into the AI ​​drawing tool based on AIGC, outputs the image to be stored, and then performs the hash processing on the image to be stored based on the hash algorithm to obtain the second hash value, and finally, when it is determined that the second hash value matches the first hash value, the image to be stored is saved as the outer surface image of the box body, and a transmission success indication is fed back.

[0032] In a possible design, after determining whether the second hash value matches the first hash value, the tracking and monitoring platform server further performs the following steps S241 to S247:

[0033] S241. If it is determined that the second hash value does not match the first hash value, the number of image regeneration times is initialized to 1, and then step S242 is executed;

[0034] S242. Determine whether the number of times the image is regenerated exceeds a preset number threshold, if so, execute step S247, otherwise execute step S243;

[0035] S243. Re-import the sample image of the outer surface of the box and the image difference description text into the AI ​​drawing tool, output a new image to be stored, and then execute step S244;

[0036] S244. Perform the hash processing on the new image to be stored based on the hash algorithm to obtain a new second hash value, and then execute step S245;

[0037] S245. Determine whether the new second hash value matches the first hash value. If so, save the new image to be stored as the outer surface image of the cabinet, and feedback a transmission success indication to the Compton backscatter imaging device that uploaded the outer surface image of the cabinet. Otherwise, increment the image regeneration times by 1, and then return to step S242;

[0038] S247. Feedback a transmission failure indication to the Compton backscatter imaging device that uploads the image of the outer surface of the box.

[0039] Secondly, an aviation equipment supply chain tracking method based on the Internet of Things is also provided, including:

[0040] Placing the aviation equipment into the interior of the aviation equipment packaging box by using the aviation equipment placing equipment;

[0041] Activating the tracking locator through the locator delivery device and delivering the tracking locator to the interior of the aviation equipment packaging box in which the aviation equipment has been placed, and transmitting the unique identification of the tracking locator to the tracking and monitoring platform server, wherein the tracking locator is connected to the tracking and monitoring platform server through the Internet of Things communication and is used to periodically upload the local unique identification and positioning information to the tracking and monitoring platform server after activation, and the locator delivery device is also connected to the tracking and monitoring platform server through wireless Internet of Things communication;

[0042] Sealing the aviation equipment packaging box containing the aviation equipment and the positioner by using a packaging box sealing device;

[0043] Performing imaging processing on the outer surface of the aviation equipment packaging box by a first Compton backscatter imaging device to obtain a first box outer surface image, and transmitting the first box outer surface image to the tracking and monitoring platform server, wherein the first Compton backscatter imaging device is also connected to the tracking and monitoring platform server via Internet of Things communication;

[0044] The outer surface of the aviation equipment packaging box passing through the transfer node is imaged by a second Compton backscatter imaging device to obtain a second box outer surface image, and the second box outer surface image is transmitted to the tracking and monitoring platform server, wherein the number of the second Compton backscatter imaging devices is multiple and they are respectively arranged at each transfer node in the aviation equipment supply chain, and the second Compton backscatter imaging is also connected to the tracking and monitoring platform server through Internet of Things communication;

[0045] The tracking and monitoring platform server first determines the transportation track of the aviation equipment packaging box according to the positioning information uploaded by the tracking locator and bound to the unique identifier, and when it is found that the aviation equipment packaging box passes through any transfer node in the aviation equipment supply chain according to the transportation track, it also performs consistency evaluation on the first box outer surface image and the second box outer surface image uploaded by the second Compton backscatter imaging device arranged at any transfer node, and triggers an alarm action if the consistency evaluation result indicates inconsistency;

[0046] The above-mentioned aviation equipment placement equipment, positioner delivery equipment, packaging box sealing equipment and first Compton backscatter imaging equipment are arranged in sequence along the aviation equipment packaging production line.

[0047] Beneficial effects of the above scheme:

[0048] (1) The present invention creatively provides a new supply chain management solution that can automatically check the safety of aircraft equipment during the supply and transportation of aircraft equipment, namely, it includes aircraft equipment placement equipment, tracking locators, locator delivery equipment, packaging box sealing equipment, two Compton backscatter imaging devices and a tracking and monitoring platform server. Through their connection relationship and linkage, the tracking locator can be activated and bound to the aircraft equipment packaging box and the aircraft equipment in the box. Then, based on the positioning information uploaded by the tracking locator, the transportation trajectory of the packaging box is determined, and based on the consistency evaluation results of the outer surface images of the front and rear boxes, it is determined whether there is an aircraft equipment safety risk, and whether an alarm action is triggered. Compared with the existing manual inspection method, this can not only reduce the workload, improve the inspection efficiency and avoid human errors, but also timely discover the situation of aircraft equipment being swapped and trigger an alarm, thereby efficiently and accurately ensuring the safety of the supply chain transportation of aircraft equipment, and facilitating practical application and promotion. BRIEF DESCRIPTION OF THE DRAWINGS

[0049] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0050] Figure 1 A schematic diagram of the structure of an aviation equipment supply chain tracking system based on the Internet of Things provided in an embodiment of the present application. DETAILED DESCRIPTION

[0051] In order to more clearly illustrate the technical solutions in the embodiments of the present invention or the prior art, the present invention will be briefly introduced below in combination with the drawings and the description of the embodiments or the prior art. Obviously, the following description of the structure of the drawings is only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work. It should be noted that the description of these embodiments is used to help understand the present invention, but does not constitute a limitation of the present invention.

[0052] It should be understood that although the terms first and second, etc. may be used herein to describe various objects, these objects should not be limited by these terms. These terms are only used to distinguish one object from another object. For example, a first object can be referred to as a second object, and similarly, a second object can be referred to as a first object without departing from the scope of the exemplary embodiments of the present invention.

[0053] It should be understood that the term "and / or" that may appear in this document is merely a description of the association relationship between associated objects, indicating that there may be three relationships. For example, A and / or B can indicate three situations: A exists alone, B exists alone, or A and B exist at the same time. For another example, A, B and / or C can indicate the existence of any one of A, B and C or any combination of them. The term " / and" that may appear in this document describes another type of association object relationship, indicating that there may be two relationships. For example, A / and B can indicate two situations: A exists alone or A and B exist at the same time. In addition, the character " / " that may appear in this document generally indicates that the previous and next associated objects are in an "or" relationship.

[0054] Embodiment 1

[0055] like Figure 1As shown, the aviation equipment supply chain tracking system based on the Internet of Things provided in this embodiment includes but is not limited to aviation equipment placement equipment, tracking locators, locator delivery equipment, packaging box sealing equipment, a first Compton backscatter imaging device, a second Compton backscatter imaging device and a tracking and monitoring platform server, wherein the aviation equipment placement equipment, the locator delivery equipment, the packaging box sealing equipment and the first Compton backscatter imaging device are arranged in sequence along the aviation equipment packaging production line, there are multiple second Compton backscatter imaging devices and they are respectively arranged at various transfer nodes on the aviation equipment supply chain, the tracking locator is connected to the tracking and monitoring platform server via wireless Internet of Things communication, and the locator delivery equipment, the first Compton backscatter imaging device and the second Compton backscatter imaging device are respectively connected to the tracking and monitoring platform server via Internet of Things communication.

[0056] The aircraft equipment placement device is used to place the aircraft equipment inside the aircraft equipment packaging box. The aircraft equipment is the core object to be transported and tracked in the supply chain, and can be, but not limited to, aircraft, aircraft engines, or airborne equipment. In addition, the aircraft equipment placement device can use existing conventional manipulators to achieve the corresponding placement function.

[0057] The tracking locator is used to periodically upload the local unique identification and positioning information to the tracking and monitoring platform server after activation. The tracking and positioning function of the tracking locator can be implemented by existing technical means, such as using a satellite locator product based on Beidou satellite positioning technology to implement it; and since the tracking locator is a one-time application and will not be recovered, a low-cost satellite locator is preferred.

[0058] The locator delivery device is used to activate the tracking locator and deliver the tracking locator to the interior of the aviation equipment packaging box where the aviation equipment has been placed, and also transmit the unique identifier of the tracking locator to the tracking and monitoring platform server. Specifically, the locator delivery device includes but is not limited to a locator storage box, a manipulator, an RFID (Radio Frequency Identification) tag reader, a packaging box passing trigger, and an industrial computer, wherein the locator storage box stores a plurality of the tracking locators carrying RFID tags, and the industrial computer is communicatively connected to the manipulator, the RFID tag reader, the packaging box passing trigger, and the tracking and monitoring platform server respectively; the packaging box passing trigger is used to send a trigger signal to the industrial computer when it is found that the aviation equipment packaging box where the aviation equipment has been placed passes the locator delivery device along the aviation equipment packaging assembly line; the industrial computer is used to receive the trigger signal When the tracking locator is placed in the aircraft equipment packaging box, the manipulator is controlled to take out any tracking locator from the locator storage box and activate it, and then the tracking locator is placed in the aircraft equipment packaging box where the aircraft equipment is placed after passing through the RFID tag reader; the RFID tag reader is used to read the RFID tag in any tracking locator when the tracking locator passes, obtain the unique identification of any tracking locator, and transmit the unique identification of any tracking locator to the industrial computer; the industrial computer is also used to transmit the unique identification of any tracking locator to the tracking monitoring platform server. Since the tracking locator is placed in the interior of the aircraft equipment packaging box, in order to avoid the adverse effect of the box body on the wireless signal reception and transmission of the tracking locator, preferably, the aircraft equipment packaging box is made of materials other than electromagnetic shielding materials (such as wood); or when the aircraft equipment packaging box is made of electromagnetic shielding materials, the box body of the aircraft equipment packaging box is provided with a through hole connecting the inside and the outside, and when the locator placement device places the tracking locator in the interior of the aircraft equipment packaging box, the antenna of the tracking locator is exposed from the through hole. Specifically, the packaging box passes through a trigger using an AI (Artificial Intelligence) camera integrated with a packaging box recognition algorithm, wherein the packaging box recognition algorithm can be specifically implemented based on, but not limited to, an existing target detection algorithm (such as a YOLOv5 target detection algorithm). In addition, the manipulator can be conventionally implemented using existing industrial manipulator products.

[0059] The packaging box sealing device is used to seal the aviation equipment packaging box in which the aviation equipment and the locator are placed. The purpose of the aforementioned sealing is to achieve the binding of the aviation equipment packaging box with the aviation equipment and the tracking locator in the box, and it is not easy to be removed; the specific sealing process may include but is not limited to: first cover the box lid, then lock the box lid, and finally seal it. In addition, the packaging box sealing device can use an existing conventional manipulator to achieve the corresponding sealing function.

[0060] The first Compton backscatter imaging device is used to perform imaging processing on the outer surface of the aviation equipment packaging box to obtain a first box outer surface image, and transmit the first box outer surface image to the tracking and monitoring platform server. The first box outer surface image may include, but is not limited to, a box front view image, a box rear view image, a box left view image, a box right view image, a box top view image and / or a box bottom view image, etc., and can be specifically based on Compton backscatter imaging technology (which uses scattered photon information after the radiation interacts with the material to image the electron density of the material. Compared with the traditional transmission imaging method, Compton scattering imaging has the advantages of flexible system structure, high imaging contrast and low radiation dose, and has broad application prospects in the fields of non-destructive testing, medical diagnosis and safety inspection).

[0061] The second Compton backscatter imaging device is used to image the outer surface of the aviation equipment packaging box when the aviation equipment packaging box passes through the transfer node, obtain a second box outer surface image, and transmit the second box outer surface image to the tracking and monitoring platform server. The specific view of the second box outer surface image needs to be consistent with the first box outer surface image to facilitate subsequent consistency evaluation. For example, the second box outer surface image and the first box outer surface image need to simultaneously include the box front view image, box rear view image, box left view image, box right view image and box top view image. In addition, the second box outer surface image can also be obtained by conventional acquisition based on Compton backscatter imaging technology.

[0062] The tracking and monitoring platform server is used to determine the transportation track of the aircraft equipment packaging box according to the positioning information uploaded by the tracking locator and bound to the unique identifier, and when it is found that the aircraft equipment packaging box passes through any transfer node in the aircraft equipment supply chain according to the transportation track, it also performs consistency evaluation on the first box outer surface image and the second box outer surface image uploaded by the second Compton backscatter imaging device arranged at any transfer node, and triggers an alarm action if the consistency evaluation result indicates inconsistency. Since the tracking locator is bound to the aircraft equipment packaging box and the aircraft equipment in the box, the unique identifier is also bound to the aircraft equipment packaging box and the aircraft equipment, and then it can be judged whether the aircraft equipment packaging box and the aircraft equipment pass through any transfer node in the aircraft equipment supply chain according to the transportation track. The consistency evaluation result is used as a criterion for determining whether the box has been opened during the transportation process from the aircraft equipment packaging line to any transfer node: if the two images (i.e., the first box outer surface image and the second box outer surface image uploaded by the second Compton backscatter imaging device arranged at any transfer node) are inconsistent, it is determined to be opened, and it is assumed that there is a risk that the aircraft equipment has been swapped, otherwise it is assumed that the aircraft equipment is safe. In addition, the specific method of the alarm action can be, but is not limited to, sending an alarm message to the management personnel.

[0063] Therefore, based on the aforementioned aircraft equipment supply chain tracking system, a new supply chain management solution is provided that can automatically check the safety of aircraft equipment during the supply and transportation of aircraft equipment, that is, it includes aircraft equipment placement equipment, tracking locators, locator delivery equipment, packaging box sealing equipment, two Compton backscatter imaging devices and tracking monitoring platform servers. Through their connection relationship and linkage, the tracking locator can be activated and bound to the aircraft equipment packaging box and the aircraft equipment in the box. Then, according to the positioning information uploaded by the tracking locator, the transportation trajectory of the packaging box is determined, and according to the consistency evaluation results of the outer surface images of the front and rear boxes, it is determined whether there is an aircraft equipment safety risk, and whether an alarm action is triggered. Compared with the existing manual inspection method, this can not only reduce the workload, improve the inspection efficiency and avoid human errors, but also timely discover the situation of aircraft equipment being swapped and trigger an alarm, thereby efficiently and accurately ensuring the supply chain transportation safety of aircraft equipment, which is convenient for practical application and promotion.

[0064] Preferably, the tracking locator is powered by a disposable battery, wherein the battery life of the disposable battery is greater than the maximum time required for transportation from the location of the locator delivery device to the terminal location of the aviation equipment supply chain. The maximum time required for transportation can be obtained based on conventional analysis of historical transportation record data.

[0065] Preferably, a consistency assessment is performed on the first box outer surface image and the second box outer surface image uploaded by the second Compton backscatter imaging device arranged at any of the transfer nodes, including but not limited to the following steps S11 to S13.

[0066] S11. Perform image feature extraction processing on the first outer surface image of the casing to obtain a plurality of first outer surface features of the casing.

[0067] S12. The image feature extraction process is also performed on the second box outer surface image uploaded by the second Compton backscatter imaging device arranged at any of the transfer nodes to obtain a plurality of second box outer surface features.

[0068] S13. Import the multiple first outer surface features of the box body and the multiple second outer surface features of the box body into a consistency evaluation model that is pre-trained based on a gradient boosting decision tree (GBDT) model and is used to fuse the alignment dimension of the outer surface features of the box body and the similarity matching dimension of the distribution of the outer surface features of the box body to perform consistency evaluation on the two objects, and output the consistency evaluation result.

[0069] In step S13, the gradient boosting decision tree (GBDT) is an integrated learning algorithm widely used in regression and classification problems in machine learning, so the consistency evaluation model can be trained based on a certain amount of sample data and label data (such as consistency or inconsistency) through a conventional model training process. In addition, the consistency evaluation result can be in the form of, but not limited to, consistency, inconsistency, or confidence of consistency.

[0070] Preferably, transmitting the first box outer surface image or the second box outer surface image to the tracking and monitoring platform server includes but is not limited to the following steps S21 to S23.

[0071] S21. Import the outer surface image of the box and the locally stored sample image of the outer surface of the box into a pre-trained image difference description generation model, and output the image difference description text between the outer surface image of the box and the sample image of the outer surface of the box, wherein the outer surface image of the box refers to the first outer surface image of the box or the second outer surface image of the box.

[0072] In the step S21, the goal of the image difference captioning (IDC) model is to compare two similar pictures and capture the visual differences between them, and then describe these differences in natural language. Specifically, it can be implemented by, but not limited to, using existing models based on pre-extracted object-level difference features, models based on dynamic correlation attention mechanisms, difference description models based on Transformer (a classic NLP model proposed by Google's team in 2017) structures, and / or models that combine the use of semantic segmentation models and graph convolutional neural networks to describe image differences. Specifically, the image difference description text can be, but is not limited to, composed of several keywords. In addition, the specific pre-training process of the image difference description generation model can also be implemented with reference to the prior art.

[0073] S22. Perform hash processing on the outer surface image of the box body based on a hash algorithm to obtain a first hash value.

[0074] In step S22, the hash algorithm is an existing algorithm and is used to map a binary value of any length into a shorter and fixed-length binary value. This short binary value is called a hash value. Therefore, the algorithm can be applied to perform the hash processing on the outer surface image of the box to obtain the first hash value.

[0075] S23. The image difference description text and the first hash value are packaged and transmitted to the tracking and monitoring platform server, so that the tracking and monitoring platform server first imports the locally pre-stored sample image of the outer surface of the box and the image difference description text into an AI drawing tool based on AIGC (Artificial Intelligence Generated Content, generative artificial intelligence, which is an important symbol of the transition from the artificial intelligence 1.0 era to the 2.0 era), outputs the image to be stored, and then performs the hash processing on the image to be stored based on the hash algorithm to obtain a second hash value. Finally, when it is determined that the second hash value matches the first hash value, the image to be stored is saved as the outer surface image of the box, and a transmission success indication is fed back.

[0076] In the step S23, the image difference description text and the first hash value can be packaged and transmitted to the tracking and monitoring platform server based on the existing wireless communication technology or wired communication technology. Since the total data volume of the image difference description text and the first hash value is generally at the Kb level, relative to the image of the outer surface of the box with a data volume of the Mb level, the demand for network bandwidth during data packet transmission can be greatly reduced. The AI ​​drawing tool is an existing drawing software, which can include but is not limited to AI drawing software such as Midjourrney, Dell-E, Stable Diffusion, NovelAI and Disco Diffusion. Since these software belong to large models, they have the characteristics of many parameters, long training time, good generalization, strong versatility and high practicality, and can be applied to drawing in various scenes. Therefore, they can be well applied to this embodiment, that is, the receiving side can restore and reproduce the outer surface image of the box based on the sample image of the outer surface of the box and the image difference description text. Since hash values ​​have the characteristics of being irreversible, unique, and collision-resistant, the matching result of the second hash value and the first hash value can be used as a basis for measuring whether the image of the outer surface of the box is successfully restored and reproduced on the receiving side: if they match, the restoration is successful, otherwise the restoration fails. In addition, considering the possibility that a single restoration may fail, multiple restoration measures can also be adopted, that is, after determining whether the second hash value matches the first hash value, the tracking and monitoring platform server also performs the following steps S241 to S247.

[0077] S241. If it is determined that the second hash value does not match the first hash value, the number of image regeneration times is initialized to 1, and then step S242 is executed.

[0078] S242. Determine whether the number of times the image is regenerated exceeds a preset number threshold, if so, execute step S247, otherwise execute step S243.

[0079] In the step S242, the number threshold may be pre-set based on historical experience, for example, 3 times.

[0080] S243. Re-import the sample image of the outer surface of the box and the image difference description text into the AI ​​drawing tool, output a new image to be stored, and then execute step S244.

[0081] S244. Perform the hash processing on the new image to be stored based on the hash algorithm to obtain a new second hash value, and then execute step S245.

[0082] S245. Determine whether the new second hash value matches the first hash value. If so, save the new image to be stored as the outer surface image of the box body, and feedback a transmission success indication to the Compton backscatter imaging device that uploaded the outer surface image of the box body. Otherwise, increment the image regeneration times by 1, and then return to execute step S242.

[0083] S247. Feedback a transmission failure indication to the Compton backscatter imaging device that uploads the image of the outer surface of the box.

[0084] In the step S247, the transmission failure indication may be used to instruct the Compton backscatter imaging device that uploaded the outer surface image of the box to directly package and transmit the outer surface image of the box to the tracking and monitoring platform server.

[0085] In summary, the aviation equipment supply chain tracking system provided by this embodiment has the following technical effects:

[0086] (1) This embodiment provides a new supply chain management solution that can automatically check the safety of aircraft equipment during the supply and transportation of aircraft equipment, namely, it includes aircraft equipment placement equipment, tracking locators, locator delivery equipment, packaging box sealing equipment, two Compton backscatter imaging devices and a tracking and monitoring platform server. Through their connection relationship and linkage, the tracking locator can be activated and bound to the aircraft equipment packaging box and the aircraft equipment in the box. Then, according to the positioning information uploaded by the tracking locator, the transportation trajectory of the packaging box is determined, and according to the consistency evaluation results of the outer surface images of the front and rear boxes, it is determined whether there is an aircraft equipment safety risk, and whether an alarm action is triggered. Compared with the existing manual inspection method, this can not only reduce the workload, improve the inspection efficiency and avoid human errors, but also timely discover the situation of aircraft equipment being swapped and trigger an alarm, thereby efficiently and accurately ensuring the safety of the supply chain transportation of aircraft equipment, and facilitating practical application and promotion.

[0087] Embodiment 2

[0088] This embodiment further provides an aviation equipment supply chain tracking method based on the Internet of Things on the basis of the aviation equipment supply chain tracking system provided in the first embodiment, including but not limited to the following steps S1 to S6.

[0089] S1. Place the aircraft equipment into the aircraft equipment packaging box using the aircraft equipment placement equipment.

[0090] S2. Activate the tracking locator through the locator delivery device and deliver the tracking locator to the interior of the aviation equipment packaging box where the aviation equipment has been placed, and also transmit the unique identifier of the tracking locator to the tracking and monitoring platform server, wherein the tracking locator is connected to the tracking and monitoring platform server via Internet of Things communication and is used to periodically upload the local unique identifier and positioning information to the tracking and monitoring platform server after activation, and the locator delivery device is also connected to the tracking and monitoring platform server via wireless Internet of Things communication.

[0091] S3. Seal the aviation equipment packaging box containing the aviation equipment and the positioner by using packaging box sealing equipment.

[0092] S4. The outer surface of the aviation equipment packaging box is imaged by a first Compton backscatter imaging device to obtain a first box outer surface image, and the first box outer surface image is transmitted to the tracking and monitoring platform server, wherein the first Compton backscatter imaging is also connected to the tracking and monitoring platform server via Internet of Things communication.

[0093] S5. Perform imaging processing on the outer surface of the aviation equipment packaging box at the transfer node through the second Compton backscatter imaging device to obtain a second box outer surface image, and transmit the second box outer surface image to the tracking and monitoring platform server, wherein there are multiple second Compton backscatter imaging devices and they are respectively arranged at each transfer node in the aviation equipment supply chain, and the second Compton backscatter imaging is also connected to the tracking and monitoring platform server via Internet of Things communication.

[0094] S6. The tracking and monitoring platform server first determines the transportation trajectory of the aircraft equipment packaging box based on the positioning information uploaded by the tracking locator and bound to the unique identifier, and when it is found that the aircraft equipment packaging box passes through any transfer node in the aircraft equipment supply chain according to the transportation trajectory, it also performs a consistency assessment on the first box outer surface image and the second box outer surface image uploaded by the second Compton backscatter imaging device arranged at any transfer node. If the consistency assessment result indicates inconsistency, an alarm action is triggered.

[0095] The above-mentioned aviation equipment placement equipment, positioner delivery equipment, packaging box sealing equipment and first Compton backscatter imaging equipment are arranged in sequence along the aviation equipment packaging production line.

[0096] The technical details and technical effects of this embodiment can be derived with reference to the aforementioned embodiment 1, and will not be described in detail here.

[0097] Finally, it should be noted that the above description is only a preferred embodiment of the present invention and is not intended to limit the protection scope of the present invention. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present invention shall be included in the protection scope of the present invention.

Claims

1. An aviation equipment supply chain tracking system based on the Internet of Things, characterized in that: It includes an aviation equipment placement device, a tracking locator, a locator delivery device, a packaging box sealing device, a first Compton backscatter imaging device, a second Compton backscatter imaging device and a tracking and monitoring platform server, wherein the aviation equipment placement device, the locator delivery device, the packaging box sealing device and the first Compton backscatter imaging device are sequentially arranged along the aviation equipment packaging production line, there are multiple second Compton backscatter imaging devices and they are respectively arranged at various transfer nodes on the aviation equipment supply chain, the tracking locator is connected to the tracking and monitoring platform server via wireless Internet of Things communication, and the locator delivery device, the first Compton backscatter imaging device and the second Compton backscatter imaging device are respectively connected to the tracking and monitoring platform server via Internet of Things communication; The aviation equipment placement device is used to place the aviation equipment inside the aviation equipment packaging box; The tracking locator is used to periodically upload the local unique identification and positioning information to the tracking and monitoring platform server after activation; The locator delivery device is used to activate the tracking locator and deliver the tracking locator into the interior of the aviation equipment packaging box where the aviation equipment has been placed, and also transmit the unique identifier of the tracking locator to the tracking monitoring platform server; The packaging box sealing device is used to seal the aviation equipment packaging box in which the aviation equipment and the positioner are placed; The first Compton backscatter imaging device is used to perform imaging processing on the outer surface of the aviation equipment packaging box to obtain a first box outer surface image, and transmit the first box outer surface image to the tracking and monitoring platform server; The second Compton backscatter imaging device is used to perform imaging processing on the outer surface of the aviation equipment packaging box when the aviation equipment packaging box passes through the transfer node, obtain a second box outer surface image, and transmit the second box outer surface image to the tracking and monitoring platform server; The first outer surface image of the box body or the second outer surface image of the box body is transmitted to the tracking and monitoring platform server, including: importing the outer surface image of the box body and the locally stored outer surface sample image of the box body into a pre-trained image difference description generation model, and outputting an image difference description text between the outer surface image of the box body and the outer surface sample image of the box body, wherein the outer surface image of the box body refers to the first outer surface image of the box body or the second outer surface image of the box body; performing hash processing on the outer surface image of the box body based on a hash algorithm to obtain a first hash value; packaging and transmitting the image difference description text and the first hash value to the tracking and monitoring platform server, so that the tracking and monitoring platform server first imports the locally stored outer surface sample image of the box body and the image difference description text into an AI drawing tool based on AIGC, outputs an image to be stored, and then performs the hash processing on the image to be stored based on the hash algorithm to obtain a second hash value, and finally, when it is determined that the second hash value matches the first hash value, the image to be stored is saved as the outer surface image of the box body, and a transmission success indication is fed back; The tracking and monitoring platform server is used to determine the transportation track of the aviation equipment packaging box according to the positioning information uploaded by the tracking locator and bound to the unique identifier, and when it is found that the aviation equipment packaging box passes through any transfer node in the aviation equipment supply chain according to the transportation track, it also performs consistency evaluation on the first box outer surface image and the second box outer surface image uploaded by the second Compton backscatter imaging device arranged at any transfer node, and triggers an alarm action if the consistency evaluation result indicates inconsistency; The consistency evaluation is performed on the first outer surface image of the box body and the second outer surface image of the box body uploaded by the second Compton backscatter imaging device arranged at any of the transfer nodes, including: performing image feature extraction processing on the first outer surface image of the box body to obtain a plurality of first outer surface features of the box body; performing the image feature extraction processing on the second outer surface image of the box body uploaded by the second Compton backscatter imaging device arranged at any of the transfer nodes to obtain a plurality of second outer surface features of the box body; importing the plurality of first outer surface features of the box body and the plurality of second outer surface features of the box body into a consistency evaluation model obtained by pre-training based on a gradient boosting decision tree (GBDT) model and used to fuse the alignment dimension of the outer surface features of the box body and the similarity matching dimension of the distribution of the outer surface features of the box body to perform consistency evaluation on the two objects, and outputting a consistency evaluation result; After determining whether the second Hash value matches the first Hash value, the tracking and monitoring platform server further performs the following steps S241 to S247: S241. If it is determined that the second hash value does not match the first hash value, the number of image regeneration times is initialized to 1, and then step S242 is executed; S242. Determine whether the number of times the image is regenerated exceeds a preset number threshold, if so, execute step S247, otherwise execute step S243; S243. Re-import the sample image of the outer surface of the box and the image difference description text into the AI ​​drawing tool, output a new image to be stored, and then execute step S244; S244. Perform the hash processing on the new image to be stored based on the hash algorithm to obtain a new second hash value, and then execute step S245; S245. Determine whether the new second hash value matches the first hash value. If so, save the new image to be stored as the outer surface image of the cabinet, and feedback a transmission success indication to the Compton backscatter imaging device that uploaded the outer surface image of the cabinet. Otherwise, increment the image regeneration times by 1, and then return to step S242; S247. Feedback a transmission failure indication to the Compton backscatter imaging device that uploads the image of the outer surface of the box.

2. The aviation equipment supply chain tracking system according to claim 1, characterized in that: The aviation equipment packaging box is made of materials other than electromagnetic shielding materials.

3. The aviation equipment supply chain tracking system according to claim 1, characterized in that: When the aircraft equipment packaging box is made of electromagnetic shielding material, the box body of the aircraft equipment packaging box is provided with a through hole connecting the inside and the outside, and when the locator delivery device delivers the tracking locator into the interior of the aircraft equipment packaging box, the antenna of the tracking locator is exposed from the through hole.

4. The aviation equipment supply chain tracking system according to claim 1, characterized in that: The tracking locator is powered by a disposable battery, wherein the battery life of the disposable battery is greater than the maximum time required for transportation from the location of the locator delivery device to the terminal location of the aviation equipment supply chain.

5. The aviation equipment supply chain tracking system according to claim 1, characterized in that: The locator delivery device includes a locator storage box, a manipulator, an RFID tag reader, a packaging box passing trigger and an industrial computer, wherein the locator storage box stores a plurality of tracking locators carrying RFID tags, and the industrial computer is respectively communicatively connected to the manipulator, the RFID tag reader, the packaging box passing trigger and the tracking monitoring platform server; The packaging box passing trigger is used to send a trigger signal to the industrial computer when it is found that the aviation equipment packaging box containing the aviation equipment passes through the locator delivery device along the aviation equipment packaging production line; The industrial computer is used to control the manipulator to take out any tracking locator from the locator storage box and activate it when receiving the trigger signal, and then place the any tracking locator into the interior of the aviation equipment packaging box where the aviation equipment is placed after passing through the RFID tag reader; The RFID tag reader is used to read the RFID tag in any tracking locator when any tracking locator passes by, obtain the unique identification of any tracking locator, and transmit the unique identification of any tracking locator to the industrial computer; The industrial computer is also used to transmit the unique identification of any tracking locator to the tracking and monitoring platform server.

6. The aviation equipment supply chain tracking system according to claim 5, characterized in that: The packaging box passes through a trigger using an AI camera integrated with a packaging box recognition algorithm.

Images