Gas turbine electronic technical manual and digital prototype system integrated with AR (Augmented Reality) technology

Abstract

The invention discloses a gas turbine electronic technical manual and digital prototype system integrated with an AR (Augmented Reality) technology, which relates to the technical field of industrial equipment operation and maintenance, comprises terminal equipment, edge equipment and cloud equipment, and integrates an augmented reality processing module, a natural interaction and authentication module, a data management module, a digital twin engine module and a collaborative session management module, a three-dimensional digital prototype containing a gas turbine core component geometric model, a technical document and real-time sensing data are synchronized through a data integration management module, a virtual entity of virtual-real mapping is constructed by a digital twin engine, and fault prediction analysis is carried out. An analysis result and operation guidance are visually superposed on real equipment by utilizing an augmented reality technology, and meanwhile, operation guidance and remote collaboration based on natural interaction are supported, so that the problems of information fragmentation and non-visual guidance in an existing operation and maintenance mode are solved, immersive monitoring and intelligent operation and maintenance of an equipment state are realized, and the operation and maintenance efficiency is improved. And the operation accuracy and efficiency of the gas turbine are improved.

Description

Technical Field

[0001] This invention relates to the field of industrial equipment operation and maintenance technology, specifically to an electronic technical manual and digital prototype system for gas turbines that integrates AR technology. Background Technology

[0002] In the maintenance, repair, and training of large, complex, and high-value industrial equipment such as gas turbines, the complex structure of gas turbines (including multiple precision components such as compressors, combustion chambers, and turbines) and their harsh high-temperature, high-pressure, and high-speed operating environment often require technicians to repeatedly consult thick documents and compare abstract textual descriptions with the complex physical structure on-site when performing critical tasks such as disassembling and assembling turbine blades and adjusting combustion chamber clearances. This process is not only inefficient but also highly susceptible to serious operational errors, even leading to equipment damage or safety accidents, due to misunderstandings or delayed information retrieval in the high-temperature and high-noise environment.

[0003] Existing digital solutions attempt to digitize equipment information, but they often suffer from information silos. For example, high-precision 3D models of gas turbines, historical maintenance records of core components, real-time operating parameters for monitoring surge and vibration, and step-by-step operation manuals are often stored in different independent systems, lacking effective integration and correlation. This makes it difficult for technicians to easily obtain comprehensive and integrated information relevant to the current task when diagnosing faults such as compressor surge or turbine blade fouling, making it difficult to form a comprehensive and real-time understanding of the equipment status.

[0004] For the complex disassembly, assembly, and maintenance processes of gas turbines, even if electronic steps are provided, they are mostly text or two-dimensional image lists. Operators still need to rely on their spatial imagination to map them onto the complex three-dimensional equipment structure. This abstract way of transmitting information has a high cognitive load, which increases the difficulty of training and the risk of on-site operation. Moreover, when on-site personnel encounter difficult problems that they cannot solve independently, seeking help from field experts for remote diagnosis also has the problems of high communication costs and low efficiency. Furthermore, the inability to conduct intuitive operation demonstrations also seriously affects the timeliness and accuracy of troubleshooting. Summary of the Invention

[0005] The purpose of this invention is to provide an electronic technical manual and digital prototype system for gas turbines that integrates AR technology. By constructing a digital twin system that connects cloud data, edge computing, and terminal AR devices, the invention deeply integrates a three-dimensional digital prototype, real-time operating data, and an interactive manual, and intuitively overlays them onto the real equipment in an augmented reality manner. It supports natural interaction with gestures and voice, as well as remote expert collaboration, and realizes the transformation from static documents to dynamic three-dimensional interactive operation and maintenance mode. This significantly improves the accuracy of operations, the speed of fault handling, and the quality of personnel training, and solves the problems mentioned in the background art.

[0006] To achieve the above objectives, the present invention provides the following technical solution:

[0007] An electronic technical manual and digital prototype system for a gas turbine integrating AR technology, including hardware and software architecture;

[0008] The hardware architecture adopts a three-tiered structure of terminal devices, edge devices, and cloud devices. The terminal devices are augmented reality head-mounted devices, including optical see-through displays, multi-camera arrays, depth sensors, inertial measurement units, microphone arrays, and speakers. The edge devices are edge servers deployed within the factory area. The cloud devices include product lifecycle management servers and computerized maintenance management servers.

[0009] The software architecture includes an augmented reality processing module, a natural interaction authentication module, a data integration management module, a digital twin engine module, and a collaborative session management module;

[0010] The data integration management module is used to integrate and synchronize digital prototype data, document information, and real-time sensor data; to construct a virtual entity synchronized with the real gas turbine state through the digital twin engine module and to perform state monitoring and predictive analysis; to achieve high-precision registration of virtual and real spaces and augmented reality visualization of state information through the augmented reality processing module; to support gesture- and voice-based interactive operations and work guidance through the natural interaction authentication module; and to establish remote collaborative sessions through the collaborative session management module to achieve a shared augmented reality space with multi-party participation.

[0011] Preferably, the specific process of the data integration management module includes:

[0012] Obtain 3D digital prototype data from the product lifecycle management server; retrieve document information from the computerized maintenance management server and associate it with digital prototype components; establish a link with the PLC distributed control system to receive, process, and temporarily store real-time sensor data;

[0013] The digital twin engine module loads the data and injects real-time data to create a synchronized virtual entity, and performs status monitoring, performance calculation, anomaly detection, and lifespan prediction.

[0014] Preferably, the workflow of the augmented reality processing module includes:

[0015] The system invokes sensors to perform synchronous localization and map building; captures images and identifies feature points through cameras to complete coarse registration; compares real-time point cloud data with the geometric information of the digital prototype to achieve fine registration and stable overlay; and requests and renders digital twin status data as overlay display of visual graphic elements.

[0016] During the task guidance phase, based on the instructions parsed by the natural interaction authentication module, the technical manual content is queried and the text steps are converted into 3D animations and icons for guidance.

[0017] Preferably, when the operation involves smart tools, the natural interaction authentication module identifies the tool's identity and receives instructions through wireless communication technology; after the operation is completed, it confirms that the instructions have been recorded and triggers the digital twin engine to update the component status, while simultaneously transmitting the work order progress back through the data integration management module.

[0018] Preferably, the process of the collaborative session management module includes:

[0019] In response to collaboration requests, a collaborative session is created that includes spatial anchor points, digital twin status, and audio and video channels; remote experts are connected to the shared augmented reality space to maintain the consistency of virtual content; and the experts' annotation instructions, voice comments, and model operations are synchronized to the on-site terminal devices in real time, which are then rendered as virtual annotations or status changes by the augmented reality processing module.

[0020] Preferably, in a collaborative session, the natural interaction authentication module recognizes the natural gesture operation commands of the remote expert and synchronizes them to all participants by the collaborative session management module.

[0021] Preferably, in training and certification scenarios, the natural interaction certification module records the trainee's operation sequence, time consumption, tool selection, and gesture standardization behavior data, compares the behavior data with the standard operating procedure, performs quantitative evaluation, and generates a multi-dimensional evaluation report.

[0022] Preferably, the digital twin engine module can simulate specific fault states to assess the trainees' responsiveness.

[0023] Compared with the prior art, the beneficial effects of the present invention are:

[0024] 1. This invention integrates and dynamically correlates data from different platforms and equipment at different stages of their lifecycles through a unified digital twin model. In particular, it integrates the gas turbine's aerodynamic and thermodynamic model, historical maintenance records, and real-time sensor data, establishing a real-time and accurate mapping relationship between virtual information and physical entities. This fundamentally solves the problem of information fragmentation and enables technicians to gain a unified, comprehensive, and timely updated understanding of the overall performance and health status of the gas turbine.

[0025] 2. This invention uses an augmented reality head-mounted device to precisely overlay and fix a three-dimensional model of the internal structure of a gas turbine, its operating parameters, historical data, and step-by-step operation instructions onto the actual gas turbine in the form of intuitive three-dimensional graphics and information tags. This greatly reduces the cognitive threshold for understanding the complex spatial structure and abstract operating parameters of a gas turbine, eliminating the need for operators to repeatedly switch between drawings, manuals, and equipment for comparison. It significantly improves the intuitiveness and accuracy of operation instructions and effectively avoids operational errors caused by misinterpretation of information.

[0026] 3. By creating a shared augmented reality conversational context, this invention breaks the geographical limitations of remote collaboration. Remote experts can directly annotate, operate, and explain on the shared digital twin model of the gas turbine. Their instructions can be presented to on-site personnel in real time and with precision, which greatly improves the communication efficiency and guidance accuracy for gas turbine faults and significantly shortens the diagnosis and troubleshooting time for complex faults.

[0027] 4. This invention also records and quantifies all behavioral data of trainees during the operation of the digital twin model and automatically compares it with the standard operating procedure, thereby achieving objectivity and data-driven skills assessment. The digital twin engine can simulate gas turbine fault states such as fuel nozzle blockage and sensor failure, enabling training to be conducted more safely and frequently, and achieving high efficiency and standardization in the training and certification process. Attached Figure Description

[0028] Figure 1 This is a diagram of the overall system architecture of the present invention. Detailed Implementation

[0029] The technical solutions of the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of the present invention, and not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of the present invention.

[0030] To address the issues of fragmented and decentralized information in current gas turbine operation and maintenance processes, and the inability to achieve remote collaboration that hinders intuitive guidance for gas turbine operations and maintenance, please refer to [link to relevant documentation]. Figure 1 This embodiment provides the following technical solution:

[0031] An electronic technical manual and digital prototype system for gas turbines integrating AR technology. The hardware foundation of the system consists of three equipment layers: terminal equipment, edge equipment, and cloud equipment. Its selection and deployment fully consider the high temperature, high noise, and strong electromagnetic interference environment of the gas turbine plant, as well as the high speed, high temperature and high pressure characteristics of the gas turbine itself.

[0032] The terminal equipment mainly adopts industrial-grade augmented reality head-mounted devices with explosion-proof certification and active heat dissipation systems. The augmented reality head-mounted devices integrate head-mounted sensors, including optical displays, multi-camera arrays, depth sensors, inertial measurement units, microphone arrays, and speakers, and also have internal processing chips. The optical displays have high brightness to cope with the complex lighting in the factory. The multi-camera array and depth sensors are optically optimized for the metallic reflective properties of the high-temperature components on the surface of the gas turbine. The inertial measurement unit needs to have strong vibration interference resistance to ensure the stability of positioning in the vibration environment of the gas turbine operation.

[0033] The edge devices consist of edge servers deployed in cabinets near the gas turbine control room. They establish data links with the gas turbine's PLC distributed control system via the industrial Ethernet protocol and are responsible for near-end processing of high computational load tasks. The cloud devices include product lifecycle management servers and computerized maintenance management servers, which integrate professional data including gas turbine aerodynamic and thermodynamic models and rotor dynamics models.

[0034] The system's software architecture comprises five core functional modules: augmented reality processing, natural interaction authentication, data integration management, digital twin engine, and collaborative session management. The augmented reality processing and natural interaction authentication modules are integrated into the augmented reality headset; the data integration management, digital twin engine, and collaborative session management modules are located on an edge server. These modules exchange data and coordinate commands efficiently through network interfaces.

[0035] In the initialization phase of the system's preparation for executing tasks, the data integration management module first initiates a synchronization request to the product lifecycle management server to obtain a three-dimensional digital prototype of the gas turbine, which contains precise geometric models, material properties, and design clearance data of core aerodynamic and thermodynamic components such as compressor blades, combustion chamber flame tubes, and turbine blades. The digital prototype has undergone lightweight processing, but fully retains the gas turbine's assembly hierarchy, component identification codes, and physical properties.

[0036] Once the synchronization request is complete, the data integration management module establishes a connection with the computerized maintenance management server, retrieves the document information for the specified gas turbine, including but not limited to the gas turbine's unique maintenance procedures, historical work orders, maintenance records, and interactive electronic technical manuals, and associates the document information with the corresponding components in the digital prototype. This association enables personnel to quickly access the document information and improves operational efficiency.

[0037] Simultaneously, the data integration management module establishes a data link with the PLC distributed control system installed within the plant. The PLC distributed control system continuously receives real-time sensor monitoring data streams from the gas turbine. Key parameters of the data stream include, but are not limited to, compressor inlet and outlet pressure differentials and flow sequences for monitoring surge, turbine inlet temperature distribution for assessing the health of hot components, key phaser signals and multi-section vibration phase data for rotor vibration analysis, and exhaust temperature field data for efficiency monitoring. The data stream is then transmitted to the data integration management module via a data interface. After acquiring the data stream, the data integration management module first performs timestamp alignment and filtering on the multi-source heterogeneous data to eliminate the effects of sensor noise and communication delays. Specifically, let the original data stream be... ,in This represents the count of the i-th sensor. To suppress high-frequency electromagnetic interference in the field, a cutoff frequency of is applied to each signal channel. A Butterworth low-pass filter was applied to obtain the noise-reduced dataset. For sensors with different sampling rates, linear interpolation was used to align them to a standard timestamp sequence. Ultimately, this generates a standardized, time-synchronized sensor measurement dataset. Dataset It serves as the data source for subsequent state calculations and visualization rendering by the digital twin engine. The processed data is categorized, tagged, and temporarily stored in the edge server's storage for later retrieval.

[0038] The data integration and management module will pull the 3D digital prototype data and its associated document information, as well as the real-time sensor monitoring dataset. All of these are provided to the digital twin engine module for model initialization.

[0039] The digital twin engine module loads the digital prototype twin model and injects the real-time sensor monitoring dataset. This module creates a dynamic virtual entity synchronized with the actual state of a gas turbine, with core functions including condition monitoring and fault prediction. For condition monitoring, the module constructs residual operators based on physical conservation laws to quantify the consistency between measurement data and the physical model, where mass conservation residuals... The calculation method is as follows:

[0040]

[0041] in, The fluid density field is obtained by Kriging interpolation, with units of kg / m³. 3 t is the timestamp, and u is the flow field velocity vector in m / s. It is a divergence operator.

[0042] Similarly, the momentum conservation residuals were calculated. and energy conservation residual These residuals serve as the basis for system anomaly detection:

[0043]

[0044] in, , , , The reference characteristic quantity (usually the design point operating condition value) is used for dimensionless transformation. , , Weighting coefficients are set based on fault sensitivity.

[0045] For anomaly detection, this module employs a prediction model based on an LSTM network, using real-time sensor monitoring datasets. Acquire historical sensor sequences It takes input as input and outputs the predicted value of the current state. If the predicted value Compared with measured values error norm If the preset threshold ϵ is exceeded, an alarm is triggered. For predicting the remaining life of a component, a degradation model based on the Wiener process is used to calculate the cumulative damage index.

[0046] Once the personnel on site put on the augmented reality headset and activated it, the internal augmented reality processing module began to work.

[0047] The augmented reality processing module first invokes the optical see-through display, multi-view camera array, depth sensor, and inertial measurement unit to execute the Simultaneous Localization and Mapping (SLAM) procedure. The SLAM algorithm estimates the device's pose in the environment by fusing multi-sensor data through an extended Kalman filter (EKF). ,in, The state vector represents the set of all possible rigid body transformations. It incorporates position, pose quaternions, linear velocity, and angular velocity, and is optimized by minimizing the reprojection error of feature points, thereby quickly building a 3D spatial understanding of the surrounding environment. This ensures that augmented reality content can be accurately overlaid on the real world, improving the user experience.

[0048] Next, the augmented reality processing module quickly acquires real-time 3D point cloud data of a local area of ​​the gas turbine using a multi-camera array and depth sensor. Coarse registration is achieved by solving a rigid transformation. To achieve this, the rigid transformation aims to minimize the 3D point cloud data. The model point cloud obtained by sampling from the digital prototype model at the estimated initial position The objective function for the overall positional deviation between them can be simplified to:

[0049]

[0050] in, For image feature points, These are the corresponding points in the model.

[0051] After coarse registration is completed, a more refined registration process is initiated, and the augmented reality processing module processes the real-time point cloud data acquired by the depth sensor. Surface mesh model of digital prototype For comparison, the Iterative Closest Point (ICP) algorithm is used for optimization. The ICP algorithm iteratively solves the following optimization problem to find the optimal rotation matrix R and translation vector t:

[0052]

[0053] in, .

[0054] By combining coarse and fine registration, the spatial alignment error between the virtual model and the real device is greatly reduced, achieving high-precision and stable superposition, and improving the efficiency and accuracy of registration.

[0055] After successful registration, the augmented reality processing module requests current status data from the digital twin engine module. Its rendering program then transforms the digital prototype twin model data into various visualized graphical elements. Performance indicators are overlaid as data labels on prominent positions on the gas turbine casing. For high-temperature areas of the gas turbine, the module renders the temperature field data as a color thermogram, directly mapping it onto the cylinder block model to visually indicate any abnormal temperature distribution. When abnormal vibration is detected, the module overlays time-domain waveforms, spectrum diagrams, or animated shaft center trajectories at the bearing housing and rotor penetration points to help personnel quickly locate the vibration source. During maintenance guidance, for complex operations such as replacing the first-stage turbine blades, the augmented reality processing module provides precise guidance down to the alignment of each cooling vent and the tightening sequence of torque bolts, thus providing personnel with an immersive condition monitoring and maintenance experience. Visualized displays enable maintenance personnel to intuitively understand the equipment status, improving operational and monitoring efficiency.

[0056] When personnel need to perform specific operations, the system enters the operation guidance phase. During the operation, the natural interaction authentication module runs continuously, collecting and tracking the personnel's gesture and voice commands through a multi-camera array and microphone array, and then parsing the commands and transmitting them to the augmented reality processing module.

[0057] The augmented reality processing module queries the data integration management module for the corresponding interactive electronic technical manual content. The data integration management module returns text-based operation steps to the augmented reality processing module. The augmented reality processing module then transforms these text-based operation steps into intuitive 3D animations, icons, and prompts to guide the user through the operation step by step.

[0058] If the user operates a smart tool, the natural interaction authentication module can also identify the tool's identity via Bluetooth or ultra-wideband technology and accept instructions issued by the smart tool.

[0059] After each step is completed, the personnel's confirmation instruction will be recorded through the natural interaction authentication module, triggering the digital twin engine module to update the status of the operated component, and the work order progress will be sent back to the computerized maintenance management server through the data integration management module.

[0060] For complex faults or scenarios requiring expert support, when on-site personnel initiate a collaboration request, the collaboration session management module creates an independent, secure collaboration session on the edge server. This session contains a complete digital twin of specialized data such as aerodynamic and thermodynamic parameters and vibration spectra. After remote experts join the session via an invitation link, the collaboration session management module connects all parties to the same shared augmented reality space, ensuring that all participants have a consistent spatial location and state of the virtual content. They can not only view on-site video but also directly manipulate the shared digital twin; for example, they can mark the relative position of the current operating point and surge boundary on the compressor characteristic curve and circle suspicious harmonic components on the vibration spectrum. The collaboration session function breaks down geographical limitations, enabling experts to provide support remotely, reducing travel costs and time.

[0061] Subsequently, the collaborative session management module synchronizes the operations of remote experts, including annotation instructions, voice comments, and disassembly or rotation of digital prototypes, to the augmented reality head-mounted devices of on-site personnel in real time with low latency. The augmented reality processing module receives these synchronized instructions and renders them as virtual annotations or model state changes superimposed on the real scene.

[0062] The natural interaction authentication module enables remote experts to directly manipulate shared digital prototype twin models using natural gestures. These gestures are recognized and converted into operation commands, which are then synchronized to all participants by the collaborative session management module, thereby achieving collaborative diagnosis and guidance across geographical distances.

[0063] In training and certification scenarios, the system assessment focuses on gas turbine operation and maintenance skills. The digital twin engine module simulates gas turbine-specific fault conditions, such as simulating fuel nozzle blockage leading to uneven combustion or simulating sensor malfunctions providing false signals. Trainees need to diagnose and handle these issues under AR guidance. While trainees operate in training mode, the natural interaction certification module records their behavioral data throughout, including but not limited to: response time in simulated emergency shutdown procedures, stability of rate of acceleration control during virtual startup, and adherence to probe path procedures during borehole inspections.

[0064] The behavioral data is compared with the standard operating procedures provided by the data integration management module, and a quantitative score is generated through a multi-indicator weighted evaluation model.

[0065]

[0066] in, To ensure the accuracy of the operation steps, For task completion time, For the sake of standardized actions, , , The weights set.

[0067] By analyzing trainees' behavioral data, their skill levels are quantitatively assessed, generating evaluation reports that include at least multiple dimensions such as emergency response, working condition adjustment, precision maintenance, operational stability, efficiency, and standardization. This provides a reliable data foundation for achieving objective and fair skills certification.

[0068] Working principle: The data integration and management module acquires the latest 3D digital prototype data of the gas turbine, synchronizes all technical documents and historical maintenance records related to the equipment, and associates these documents with specific components in the digital prototype one by one. By continuously receiving real-time operating data of the gas turbine, all of this data is finally integrated, classified, and stored. The digital twin engine module uses the above data to construct a virtual entity that is completely synchronized with the real gas turbine.

[0069] When on-site personnel wearing augmented reality headsets approach the gas turbine, the augmented reality processing module first senses and understands the surrounding environment through its sensor array. It then performs an initial alignment between the digital twin model and the real equipment. By comparing real-time collected 3D environmental information with the geometric data of the digital prototype, it achieves high-precision and stable overlay of the virtual model onto the real equipment. Finally, the digital twin's status data is transformed into visual information such as heat maps and data labels, accurately overlaid on the corresponding locations on the real equipment.

[0070] The natural interaction authentication module parses operation instructions, while the augmented reality processing module retrieves the corresponding interactive electronic technical manual content and transforms it into 3D animations and graphic prompts overlaid on the real-world scene to guide personnel in completing the operation. The collaborative session management module establishes a virtual space containing a shared digital twin model and audio-visual links, inviting remote experts to join. Experts can see an augmented reality view consistent with the on-site experience and can remotely operate the digital twin model and add annotations via gestures. All their operations are synchronized in real-time to the on-site personnel, enabling remote collaboration. In training scenarios, specific faults can be simulated to assess trainees' responsiveness.

[0071] It should be noted that, in this document, relational terms such as "first" and "second" are used only to distinguish one entity or operation from another, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Furthermore, the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such process, method, article, or apparatus.

[0072] Although embodiments of the invention have been shown and described, it will be understood by those skilled in the art that various changes, modifications, substitutions and alterations can be made to these embodiments without departing from the principles and spirit of the invention.

Claims

1. A gas turbine electronic technical manual and digital prototype system integrating AR technology, characterized in that, The system includes terminal devices, edge devices, and cloud devices. The terminal devices are equipped with augmented reality processing modules and natural interaction authentication modules. The edge devices are equipped with data integration management modules, digital twin engine modules, and collaborative session management modules. The cloud devices include product lifecycle management servers and computerized maintenance management servers. The data integration and management module is used to synchronize digital prototype data and document information from cloud devices, as well as to collect real-time operating sensor data of the gas turbine. The digital twin engine module is used to construct a virtual entity that is synchronized with the real gas turbine state, and to perform state monitoring and predictive analysis on the real gas turbine. The augmented reality processing module is used to achieve registration between virtual and real spaces and to transform digital twin state data into visual information overlaid on the real scene; The natural interaction authentication module is used to parse the user's gesture commands and voice commands to perform interactive operations and task guidance. The collaborative session management module is used to establish and manage remote collaborative sessions, and to build an augmented reality space shared by multiple parties.

2. The gas turbine electronic technical manual and digital prototype system integrating AR technology according to claim 1, characterized in that, The specific functions of the data integration management module include: A synchronization request is initiated to the product lifecycle management server to obtain three-dimensional digital prototype data that has been lightweighted but retains the assembly hierarchy and component identification codes. The three-dimensional digital prototype data includes the precise geometric model, material properties and design clearance data of core aerodynamic components such as compressor blades, combustion chamber flame tubes and turbine blades. Establish a connection with the computerized maintenance management server, retrieve historical work orders, maintenance records, and interactive electronic technical manuals for the specified gas turbine, and associate the document information with the corresponding components in the digital prototype; A data link is established with the PLC distributed control system in the plant area to receive and process the real-time sensing and monitoring data stream of the gas turbine. The real-time sensing and monitoring data stream includes at least the compressor inlet and outlet pressure difference and flow sequence, turbine inlet temperature distribution, key phase signal and multi-section vibration phase data, and exhaust temperature field data. The data is then classified, tagged, and temporarily stored.

3. The gas turbine electronic technical manual and digital prototype system integrating AR technology according to claim 1, characterized in that, The specific functions of the digital twin engine module include: Load the digital prototype data provided by the data integration and management module, and inject real-time sensor monitoring data to create a virtual entity that is synchronized with the actual gas turbine status; The embedded physical model and data analysis algorithm are used to perform condition monitoring, performance calculation, anomaly detection and component remaining life prediction of gas turbines. The anomaly detection targets typical gas turbine faults including compressor surge, blade fouling, combustion instability and rotor misalignment.

4. The gas turbine electronic technical manual and digital prototype system integrating AR technology according to claim 1, characterized in that, The specific workflow of the augmented reality processing module includes: It calls upon the sensors on the terminal device to perform synchronous localization and map building, and understands the three-dimensional space of the surrounding environment; By capturing images using a camera array and using machine learning models to identify equipment feature points or QR codes, a preliminary coarse registration between the digital prototype and the real gas turbine is completed. The real-time point cloud data acquired by the depth sensor is compared and optimized with the surface geometry information of the digital prototype. Fine registration is performed through the iterative nearest point algorithm to achieve stable superposition of virtual and real spaces. The system requests current status data from the digital twin engine module and uses a rendering program to transform the model data into various visual graphic elements, including performance index data labels, temperature field thermograms, vibration time-domain waveforms, spectrum diagrams, or shaft center trajectory animations, which are then overlaid and displayed on the correct position of the real device.

5. The gas turbine electronic technical manual and digital prototype system integrating AR technology according to claim 1, characterized in that, The natural interaction authentication module continuously collects and analyzes the personnel's gesture and voice commands during the work guidance phase; The augmented reality processing module queries the corresponding interactive electronic technical manual content from the data integration management module based on the parsed instructions, and converts the returned text-based operation steps into 3D animations, icons, and prompts to guide the user step by step.

6. The gas turbine electronic technical manual and digital prototype system integrating AR technology according to claim 5, characterized in that, When personnel operate intelligent tools, the natural interaction authentication module identifies the tool's identity and receives instructions from the tool through wireless communication technology. After each step of the operation is completed, the personnel's confirmation instruction is recorded by the natural interaction authentication module, which triggers the digital twin engine module to update the status of the operated component. At the same time, the work order progress is transmitted back to the computerized maintenance management server through the data integration management module.

7. The gas turbine electronic technical manual and digital prototype system integrating AR technology according to claim 1, characterized in that, The specific workflow of the collaborative session management module includes: In response to collaboration requests from on-site personnel, a collaboration session is created, which includes spatial anchor point information, digital twin status, and audio / video stream channels. Remote experts join the session via an invitation link, and the collaborative session management module connects all parties to the same shared augmented reality space, ensuring that the virtual content in the field of vision of all participants has a consistent spatial location and status.

8. The gas turbine electronic technical manual and digital prototype system integrating AR technology according to claim 7, characterized in that, The collaborative session management module synchronizes annotation instructions, voice comments, and operation instructions for digital prototypes issued by remote experts to the terminal devices of on-site personnel in real time during the collaborative session. The augmented reality processing module receives operation instructions and renders them as virtual annotations or model state changes superimposed on the real scene.

9. A gas turbine electronic technical manual and digital prototype system integrating AR technology according to claim 7, characterized in that, In the collaborative session, the natural interaction authentication module recognizes the natural gestures of remote experts operating the shared digital twin model and converts them into operation commands; The collaborative session management module synchronizes operation instructions to all session participants for remote collaborative diagnosis and guidance.

10. A gas turbine electronic technical manual and digital prototype system integrating AR technology according to claim 1, characterized in that, The natural interaction authentication module records trainees' operation sequences, time consumption, tool selection, and gesture standardization behavior data in training and certification scenarios. It compares the behavioral data with the standard operating procedures provided by the data integration management module to quantitatively assess trainees' skill levels and generate an evaluation report that includes operational accuracy, efficiency, and standardization. The digital twin engine module simulates specific fault states of gas turbines, including uneven combustion speed caused by fuel nozzle blockage or false signals provided by sensor malfunctions, to assess trainees' responsiveness.

Images