A remote collaboration augmented reality intelligent diagnosis system for aircraft assembly
By integrating the helmet body, augmented reality display, intelligent collaboration module, and environmental perception module, and combining them with the AI assembly engineer module, the problems of low information acquisition efficiency, reliance on experience for fault diagnosis, and difficulty in cross-regional collaboration in traditional aircraft assembly have been solved, achieving an efficient and safe aircraft assembly process.
Patent Information
- Application Number
- CN202610674086.9
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2026-05-15
- Publication Date
- 2026-07-10
AI Technical Summary
Traditional aircraft assembly relies on paper-based process manuals and experience, resulting in low information acquisition efficiency, reliance on personal experience for fault diagnosis, difficulty in cross-regional collaboration, and limited safety protection. Existing AR technology has limited functionality and lacks intelligent collaborative capabilities.
It adopts a helmet body, an augmented reality display module, an intelligent collaboration module, and an environmental perception module, combined with an AI assembly engineer module, to achieve information overlay display, intelligent diagnosis, remote collaboration, and environmental monitoring, and integrates multi-level honeycomb sound-absorbing panels to improve safety.
It has achieved efficient and accurate information acquisition, intelligent fault diagnosis and solution optimization, ensured cross-regional collaborative guidance and operational safety, and significantly improved assembly efficiency, accuracy and safety.
Smart Images

Figure CN122363525A_ABST
Abstract
Description
Technical Field
[0001] This invention relates to the field of aviation assembly and smart wearable device technology, and more specifically, to a remote collaborative augmented reality intelligent diagnostic system for aircraft assembly. Background Technology
[0002] With the rapid development of the aviation industry, the structural complexity and assembly precision requirements of aircraft are increasing. Modern aircraft assembly involves tens of thousands of parts, and its assembly process must strictly follow process specifications. However, traditional aircraft assembly operations mainly rely on paper process manuals, on-site operations by experienced technicians, and post-assembly inspection, which has significant shortcomings such as low information acquisition efficiency, reliance on personal experience for fault diagnosis and handling, difficulties in cross-regional collaboration, and limited safety protection measures.
[0003] In recent years, augmented reality (AR) and artificial intelligence (AI) technologies have provided new solutions to the above problems. However, existing solutions generally suffer from shortcomings such as limited AR functionality, lack of intelligent collaboration capabilities, and structural designs that are not adapted to the aviation operation environment. Summary of the Invention
[0004] The purpose of this invention is to overcome the shortcomings of the prior art and provide a remote collaborative augmented reality intelligent diagnostic method for aircraft assembly that can improve assembly efficiency, accuracy and safety.
[0005] To achieve the above objectives, the present invention provides a remote collaborative augmented reality intelligent diagnostic system for aircraft assembly, characterized in that it comprises: The helmet body is made of a composite shell structure of ABS industrial plastic material and embedded non-Newtonian fluid material, and integrates multi-level honeycomb sound-absorbing panels; An augmented reality display module is fixed to the front of the helmet body and is used to overlay and display virtual information; The intelligent collaboration module, deployed in an embedded processor, is used for multi-system data interaction and remote collaborative connection. The AI assembly engineer module runs on an embedded processor or in the cloud and includes a fault diagnosis unit, an assembly scheme generation unit, a knowledge retrieval and learning unit, and an auxiliary assembly unit. An environmental sensing module, including at least an air monitoring sensor, is used to detect harmful gases in real time.
[0006] The present invention also provides a method for applying the above-mentioned system, including steps such as system activation, environmental early warning, fault diagnosis and solution generation, assisted assembly, remote collaboration, and data recording and reporting.
[0007] Compared with existing technologies, this invention achieves "what you see is what you get" information acquisition through augmented reality technology, realizes intelligent diagnosis and solution optimization through AI, realizes efficient and intuitive cross-regional guidance through remote collaboration, and ensures operational safety through structural optimization and environmental perception, significantly improving the efficiency, accuracy and safety of aircraft assembly. Attached Figure Description
[0008] Figure 1 This is a diagram showing the overall architecture of the system of the present invention.
[0009] Figure 2 This is a schematic diagram illustrating the working principle of the intelligent collaboration module.
[0010] Figure 3 Functional architecture diagram for the AI assembly engineer module.
[0011] Figure 4 This is a schematic diagram of the material layering structure of the helmet body.
[0012] Figure 5 Six-view diagram of the AR all-in-one device. Detailed Implementation
[0013] To make the objectives, technical solutions, and advantages of the present invention clearer, the embodiments of the present invention will be described in detail below with reference to the accompanying drawings.
[0014] Example 1: System Overall Architecture and Workflow like Figure 1 As shown, the remote collaborative augmented reality intelligent diagnostic system for aircraft assembly provided in this embodiment adopts an "edge-cloud" collaborative architecture. The edge device is a smart helmet, which integrates an embedded processor, a 5G / Wi-Fi communication module, a microphone / speaker, an IMU, and various sensor interfaces. The AR all-in-one device is fixed to the front of the helmet via a detachable interface. The cloud platform includes an AI assembly engineer cloud inference server, an assembly knowledge base, and a remote expert client.
[0015] A typical workflow includes: wearing and activating the device, environmental monitoring, data linking with the aircraft system, AI generating diagnostics and solutions, AR guiding operation, remote assistance, and uploading the completion report.
[0016] Example 2: Three Collaboration Modes of the Intelligent Collaboration Module like Figure 2 As shown, the intelligent collaboration module includes multi-system collaboration (access to the airborne data bus and the workshop MES system), human-machine collaboration (optimization of AI suggestions based on operation records), and remote collaboration (real-time sharing of first-person AR images and expert annotations).
[0017] Example 3: Detailed Implementation of the AI Assembly Engineer Module like Figure 3 As shown, in the AI assembly engineer module: the fault diagnosis unit adopts a fault reasoning model based on graph neural networks (GNN); the assembly scheme generation unit is based on a decision engine of reinforcement learning (RL); the knowledge retrieval and learning unit uses large language model (LLM) for semantic matching and closed-loop learning; and the auxiliary assembly unit uses SLAM technology to locate parts and monitors the operation process through visual inspection.
[0018] Example 4: Helmet Material and Structural Characteristics like Figure 4 As shown, the helmet shell consists of three layers: an outer layer of ABS industrial plastic, a middle layer filled with a non-Newtonian fluid material (shear-thickening liquid), and an inner lining of memory foam. Multi-level honeycomb sound-absorbing panels are integrated into the earcups, and an electronic noise-canceling module is also included.
[0019] Example 5: AR All-in-One Device and Detachable Plug-in like Figure 5 As shown, the AR all-in-one device includes front-facing glasses, a rear-facing data processing unit, rotary buttons, and a quick-release clip-on helmet mounting ring. Detachable plug-ins (such as air monitoring plug-ins and lighting plug-ins) are hot-swappable via mounting holes on both sides and conductive contacts.
[0020] Example 6: Application Scenarios and Effect Verification Field tests conducted at the wing assembly station of a certain type of regional jet verified the effectiveness of the invention: the AR visualization manual reduced operation time by approximately 46%, and no human error was observed in the completed test assembly tasks; remote collaboration successfully handled pipeline interface misalignment faults; air monitoring sensitivity achieved an early warning within 2 seconds; and in a 110dB noise environment, the helmet could reduce ear noise to 82dB.
[0021] In summary, this invention integrates AR display, AI diagnostics, remote collaboration, and environmental monitoring functions, combined with optimized material and structural design, to achieve an intelligent upgrade of aircraft assembly operations, significantly improving assembly efficiency, accuracy, and safety.
Claims
1. A remote collaborative augmented reality intelligent diagnostic system for aircraft assembly, characterized in that, include: The helmet body is constructed from a composite shell structure made of ABS industrial plastic and embedded with non-Newtonian fluid materials, and integrates multi-level honeycomb sound-absorbing panels inside the shell for impact resistance and noise reduction. An augmented reality display module, fixed to the front of the helmet body, overlays virtual information in the wearer's field of vision. This virtual information includes at least a visual assembly manual, fault diagnosis results, and remote collaboration visuals. An intelligent collaboration module, deployed in the embedded processor of the helmet body, enables multi-system data interaction with the aircraft monitoring system and assembly management system, and establishes a remote collaborative connection with a remote expert terminal via a communication network, sharing real-time audio, video, and data. The AI assembly engineer module, running on the embedded processor or a collaborative cloud server, includes: a fault diagnosis unit for identifying fault modes and locating fault locations based on aircraft sensor data and normal operating parameter models; an assembly scheme generation unit for generating optimal assembly schemes by combining assembly manuals and historical data; a knowledge retrieval and learning unit for querying the assembly knowledge base and continuously learning new cases; an auxiliary assembly unit for providing visual operation guidance through the augmented reality display module; and an environmental perception module, including at least an air monitoring sensor, for real-time detection of harmful gas concentrations in the work environment and issuing early warnings.
2. The system according to claim 1, characterized in that, The intelligent collaboration module includes: a multi-system collaboration unit for data docking and information integration with the aircraft fault diagnosis system, assembly management system, and logistics support system; a human-machine collaboration unit for optimizing the diagnostic algorithm and assembly suggestions of the AI assembly engineer module based on the operator's operating habits and historical feedback; and a remote collaboration unit for real-time sharing of on-site video, augmented reality first-person perspective images, and diagnostic data via 5G or Wi-Fi networks, and for receiving annotations and voice guidance from remote experts.
3. The system according to claim 1, characterized in that, The fault diagnosis unit of the AI assembly engineer module is specifically used to: analyze the flight parameters, engine status, and hydraulic system data collected by various aircraft sensors, compare them with the preset normal operation parameter model, identify potential fault modes and abnormal situations, and output a detailed diagnostic report including the fault location and possible causes.
4. The system according to claim 1, characterized in that, The assembly scheme generation unit is specifically used to: integrate fault diagnosis results, aircraft model information, assembly manual specifications, and historical assembly records to generate at least one assembly scheme, and evaluate the assembly cost, time consumption, required manpower and tools of each scheme, and present them through the augmented reality display module after prioritizing them.
5. The system according to claim 1, characterized in that, The auxiliary assembly unit is specifically used to: overlay and display disassembly and assembly step animations, torque value markings, safety operation prompts and danger area warnings on the real assembly parts through the augmented reality display module, and monitor the assembly process in real time, and issue a correction reminder when an operational deviation is detected.
6. The system according to claim 1, characterized in that, In the shell structure of the helmet body, the non-Newtonian fluid material is distributed in the interlayer area between the helmet liner and the outer shell, which is used to increase stiffness to absorb impact energy when subjected to instantaneous impact, and to maintain flexibility to adapt to different head shapes during normal wear.
7. The system according to claim 1, characterized in that, The multi-level honeycomb sound-absorbing panel is a multi-level honeycomb sound-absorbing panel with embedded porous layers. Its sound absorption frequency response is continuously adjustable in the low to mid frequency range of 0.58-2.04kHz. The sound-absorbing panel is integrated into the helmet earcups and has multiple noise reduction intensity adjustment functions.
8. The system according to claim 1, characterized in that, The augmented reality display module is fixed to the front of the helmet body through a detachable functional plug-in interface; the environmental perception module, as an independent detachable plug-in, is electrically connected and physically fixed to the helmet body through the interface.
9. The system according to claim 1, characterized in that, The augmented reality display module is integrated into the augmented reality all-in-one machine. The augmented reality all-in-one machine includes a front-mounted augmented reality glasses assembly, a rear-mounted data processing and communication unit, a rotary button, and a helmet mounting ring. The augmented reality all-in-one machine is detachably assembled to the helmet body via the helmet mounting ring.
10. A remote collaborative augmented reality intelligent diagnostic system for aircraft assembly, applied to the system according to any one of claims 1-9, characterized in that, Includes the following steps: S1: The wearer activates the system through the augmented reality display module on the helmet body, and the AI assembly engineer module automatically completes self-check and establishes a data link with the aircraft fault diagnosis system; S2: The environmental sensing module collects air data of the working environment in real time. If the concentration of harmful gases exceeds the standard, it issues an audible and visual warning through the augmented reality display module. S3: The AI assembly engineer module performs fault diagnosis based on aircraft sensor data, identifies fault modes and locations, and generates at least one assembly solution, which is presented to the wearer through the augmented reality display module. S4: The wearer performs the assembly operation according to the visual assembly manual or the operation guide overlaid with augmented reality. The auxiliary assembly unit monitors the operation process in real time and prompts safety precautions. S5: When encountering a difficult fault, the intelligent collaboration module establishes an audio and video connection with the remote expert, shares the first-person perspective view of the scene and diagnostic data with the remote expert terminal, receives annotations and guidance from the remote expert, and displays them synchronously in the augmented reality display module; S6: After assembly is completed, the system automatically records the assembly process data, updates the assembly knowledge base, and submits an assembly report to the assembly management system.
