A holographic three-dimensional digital visualization management system and method for nuclear power plants

Abstract

The embodiment of the present application discloses a kind of nuclear power station holographic three-dimensional digital visualization management system and method.The system includes: component hierarchical module is used to divide the three-dimensional model of nuclear power station into multiple components, and each component is assigned corresponding importance;Task mode module is used to determine the mode parameters associated with the current task;Visible and hidden control module is used to receive mode parameters and the importance of component, and generate the visible and hidden control strategy of component based on the preset multidimensional mapping rule, and determine the visible state of each component in holographic display space based on importance and visible and hidden control strategy;Holographic rendering module is used to render component based on visible state, to obtain stereoscopic holographic image visible to naked eye.Through the technical scheme of the embodiment of the present application, key components are quickly filtered and displayed according to component importance, avoiding component display redundancy, and the component visible and hidden control strategy can be dynamically matched, improving the relevance of visible content and current task.

Description

Technical Field

[0001] This invention relates to the field of electronic digital data processing technology, and in particular to a holographic three-dimensional digital visualization management system and method for nuclear power plants. Background Technology

[0002] As high-risk, structurally complex industrial systems, nuclear power plants place extremely high demands on their operation and maintenance management, fault diagnosis, and emergency drills, requiring well-structured information display, a strong focus on key components, and intuitive operational interactions. The adoption of 3D digital visualization systems, particularly the introduction of holographic display technology to achieve naked-eye 3D stereoscopic display, has become a crucial means to improve the efficiency of intelligent management in nuclear power plants. Compared to traditional 2D interfaces or static models, holographic 3D visualization platforms offer greater cognitive intuitiveness and immersive interactive experiences in the spatial dimension.

[0003] However, existing 3D visualization systems for nuclear power plants still face problems such as redundant component display and weak task adaptability when applied to holographic display scenarios. For example, the component display hierarchy is too simple, lacking a hierarchical control mechanism based on the degree of criticality. Furthermore, they cannot automatically match component display strategies according to different task scenarios, resulting in information filtering delays. Summary of the Invention

[0004] This invention provides a holographic three-dimensional digital visualization management system and method for nuclear power plants. It can quickly filter and display key components based on their importance, avoid redundant component display, and dynamically match component visibility control strategies, thereby improving the relevance of visual content to the current task.

[0005] In a first aspect, embodiments of the present invention provide a holographic three-dimensional digital visualization management system for nuclear power plants, comprising: a component hierarchical module, a task mode module, a display / concealment control module, and a holographic rendering module; wherein... The component classification module is used to divide the three-dimensional model of the nuclear power plant into multiple components and assign a corresponding importance to each component. The task mode module is used to determine mode parameters associated with the current task; the mode parameters include at least: task mode and a display / hidden determination threshold. The visibility control module is used to receive the mode parameters and the importance of the components, generate the visibility control strategy of the components based on the preset multidimensional mapping rules, and determine the visibility status of each component in the holographic display space based on the importance and the visibility control strategy. The holographic rendering module is used to render components based on the visible state to obtain a stereoscopic holographic image visible to the naked eye.

[0006] Secondly, embodiments of the present invention also provide a holographic three-dimensional digital visualization management method for nuclear power plants, the method comprising: The component classification module divides the three-dimensional model of the nuclear power plant into multiple components and assigns a corresponding importance to each component. The task mode module determines the mode parameters associated with the current task; the mode parameters include at least: task mode and a display / hidden determination threshold. The display control module receives the mode parameters and the importance of the components, generates the display control strategy for the components based on the preset multidimensional mapping rules, and determines the visual state of each component in the holographic display space based on the importance and the display control strategy. The holographic rendering module renders components based on the visible state to obtain a stereoscopic holographic image visible to the naked eye.

[0007] Thirdly, embodiments of the present invention also provide an electronic device, the electronic device comprising: One or more processors; Memory, used to store one or more programs; When the one or more programs are executed by the one or more processors, the one or more processors implement the nuclear power plant holographic three-dimensional digital visualization management method provided in any embodiment of the present invention.

[0008] Fourthly, embodiments of the present invention provide a computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, implements the holographic three-dimensional digital visualization management method for nuclear power plants as provided in any embodiment of the present invention.

[0009] Fifthly, embodiments of the present invention provide a computer program product, including a computer program that, when executed by a processor, implements the nuclear power plant holographic three-dimensional digital visualization management method provided in any embodiment of the present invention.

[0010] The technical solution of this invention includes a component grading module for dividing a three-dimensional model of a nuclear power plant into multiple components and assigning a corresponding importance to each component; a task mode module for determining mode parameters associated with the current task; the mode parameters include at least a task mode and a visibility / concealment threshold; a visibility / concealment control module for receiving the mode parameters and the importance of the components, generating a visibility / concealment control strategy for the components based on a preset multidimensional mapping rule, and determining the visual state of each component in the holographic display space based on the importance and the visibility / concealment control strategy; and a holographic rendering module for rendering the components based on the visual state to obtain a naked-eye visible stereoscopic holographic image. By combining the component hierarchy module and the visibility control module, the system can quickly filter and display key components based on their importance, effectively reducing unnecessary information interference and improving the visibility efficiency of critical components. Through the linkage between the task mode module and the visibility control module, the system can dynamically match the visibility control strategy of components under different task modes, ensuring that the displayed content is closely related to the current task, improving task execution efficiency and information focus capabilities. Through the collaborative processing of the visibility control module and the holographic rendering module, the priority state of components can be directly converted into image rendering effects (such as highlighting, transparency, and hiding), enhancing the intuitiveness and hierarchy of 3D visualization.

[0011] It should be understood that the description in this section is not intended to identify key or essential features of the embodiments of the present invention, nor is it intended to limit the scope of the invention. Other features of the invention will become readily apparent from the following description. Attached Figure Description

[0012] To more clearly illustrate the technical solutions in the embodiments of the present invention, the accompanying drawings used in the description of the embodiments will be briefly introduced below. Obviously, the accompanying drawings described below are only some embodiments of the present invention. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0013] Figure 1 This is a flowchart of a holographic three-dimensional digital visualization management system for nuclear power plants provided in Embodiment 1 of the present invention; Figure 2 This is a diagram illustrating the process of determining the importance of a component according to Embodiment 1 of the present invention; Figure 3 This is a flowchart of a holographic three-dimensional digital visualization management system for nuclear power plants provided in Embodiment 2 of the present invention; Figure 4 This is a schematic diagram of the structure of a control and acquisition unit according to Embodiment 2 of the present invention; Figure 5This is a flowchart of a holographic three-dimensional digital visualization management method for nuclear power plants provided in Embodiment 3 of the present invention. Detailed Implementation

[0014] To enable those skilled in the art to better understand the present invention, the technical solutions of the present invention will be clearly and completely described below with reference to the accompanying drawings of the embodiments of the present invention. Obviously, the described embodiments are only some embodiments of the present invention, and not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort should fall within the scope of protection of the present invention.

[0015] It should be noted that the terms "first," "second," etc., in the specification, claims, and accompanying drawings of this invention are used to distinguish similar objects and are not necessarily used to describe a specific order or sequence. It should be understood that such data can be interchanged where appropriate so that the embodiments of the invention described herein can be implemented in orders other than those illustrated or described herein. Furthermore, the terms "comprising" and "having," and any variations thereof, are intended to cover a non-exclusive inclusion; for example, a process, method, system, product, or apparatus that comprises a series of steps or units is not necessarily limited to those steps or units explicitly listed, but may include other steps or units not explicitly listed or inherent to such processes, methods, products, or apparatus.

[0016] Example 1 Figure 1 This is a schematic diagram of the structure of a holographic three-dimensional digital visualization management system for a nuclear power plant, provided in Embodiment 1 of the present invention. Figure 1 As shown, the system includes: a component hierarchical module, a task mode module, a visibility control module, and a holographic rendering module.

[0017] The system includes: a component classification module, which divides the 3D model of the nuclear power plant into multiple components and assigns a corresponding importance to each component; a task mode module, which determines the mode parameters associated with the current task; the mode parameters include at least the task mode and the visibility / concealment threshold; a visibility / concealment control module, which receives the mode parameters and the importance of the components, generates a visibility / concealment control strategy for the components based on preset multidimensional mapping rules, and determines the visual state of each component in the holographic display space based on the importance and the visibility / concealment control strategy; and a holographic rendering module, which renders the components based on the visual state to obtain a stereoscopic holographic image visible to the naked eye.

[0018] It should be noted that before the system officially goes into operation, the necessary 3D models and data foundation for holographic display must first be prepared. To this end, the system accesses the following basic data resources from the nuclear power plant engineering modeling stage: structural models exported from 3D modeling platforms (such as Revit, CATIA, etc.), P&ID process drawings, logic control documents, and operation monitoring parameter libraries. This data undergoes format conversion, structural extraction, and semantic mapping through a unified data processing interface module, forming a standardized component information library. Furthermore, the modeling engine (such as Unity, Unreal, or WebGL 3D tools) generates holographic-compatible 3D data formats (such as glTF, FBX, etc.) for unified use by various modules of the system, achieving naked-eye visible stereoscopic holographic visualization rendering.

[0019] In this embodiment of the disclosure, a nuclear power plant can refer to a high-risk industrial facility that includes complex equipment and pipelines such as reactors, cooling systems, and instrumentation and control systems. A 3D model can refer to a digital twin model of a nuclear power plant constructed using 3D modeling software (such as Revit or CATIA), containing spatial geometry and logical relationships; its format can be glTF, FBX, etc. A component can refer to an independently identifiable basic unit in the 3D model, such as equipment (pumps, valves), pipelines, instruments, control cabinets, or components thereof. Importance can refer to a quantitative representation of the component's importance in the current task.

[0020] In this embodiment, the current task can refer to a specific work scenario that the operator needs to perform, such as equipment inspection, troubleshooting, emergency response, planned maintenance, or personnel training. The mode parameters can refer to a set of data output by the task mode module that defines the system behavior rules under the current task. The mode parameters include at least: task mode (i.e., mode type) and a visibility / hiddenness determination threshold. The task mode can refer to a preset work scenario configuration corresponding to a specific operation and maintenance goal, such as inspection mode, troubleshooting mode, emergency mode, maintenance mode, and training mode. The visibility / hiddenness determination threshold can refer to a preset threshold for classifying the visible state of components. The visibility / hiddenness determination threshold is used to map components of different importance to specific visible states (such as highlighted, semi-transparent, or hidden).

[0021] In this embodiment, the preset multidimensional mapping rule can refer to the decision logic and functional relationship stored in the system, used to deduce how each component should be displayed based on the task mode. The visibility control strategy can refer to the specific rule set dynamically generated by the multidimensional mapping rule according to the current task, used to guide the allocation of the visual state of all components. The holographic display space can refer to a three-dimensional virtual space presented by a naked-eye holographic display device (such as a holographic projection film or a light field display), which can be observed by the user from multiple angles. The visual state can refer to the final presentation mode of the component in the holographic display space. The visual state includes at least one of the following: display, highlight, semi-transparency, and hiding. The visual state determines whether the component is visible and its visual prominence. The stereoscopic holographic image can refer to a three-dimensional visual image that can perceive depth and spatial relationships without auxiliary equipment.

[0022] Specifically, the system comprising a component hierarchical module, a task mode module, a visibility control module, and a holographic rendering module implements the operational steps of this invention as follows. This linkage process achieves intelligent information focusing from task recognition to 3D rendering, significantly improving the operation and maintenance efficiency and operational safety in the complex environment of nuclear power plants.

[0023] The task mode module determines the current task (such as emergency response) based on user instructions or system status and outputs corresponding mode parameters, including the task mode (such as EMERGENCY) and the visibility threshold (such as a highlight threshold of 0.85). Simultaneously, the component classification module analyzes the 3D model of the nuclear power plant, identifies all components, and determines the pre-set importance of each component corresponding to the current task mode.

[0024] The visibility control module receives the aforementioned mode parameters and the importance of all components. Based on built-in preset multi-dimensional mapping rules, it determines the visibility control template corresponding to the current task's mode. Then, it replaces the default threshold in the visibility control template with the visibility determination threshold to obtain the visibility control strategy corresponding to the current task. For example, this strategy can specify that in emergency mode, the component importance is compared with thresholds 0.85 and 0.50 to determine the highlighted, semi-transparent, or hidden visual state, respectively. The visibility control module applies this strategy to the specific importance data of each component, determining the visual state of each component in the holographic display space, forming a clear mapping list between components and visual states.

[0025] The holographic rendering module performs differentiated rendering based on the visual state of each component determined in the previous step. For example, it enhances the brightness and outline of components in a highlighted state, reduces the opacity of semi-transparent components, and does not render components in a hidden state. Finally, all processed components are combined into a stereoscopic holographic image visible to the naked eye and presented in the holographic display space, where key components that are currently of great importance are highlighted, while non-key components are weakened or hidden.

[0026] The technical solution of this invention includes a component grading module for dividing the three-dimensional model of a nuclear power plant into multiple components and assigning a corresponding importance to each component; a task mode module for determining mode parameters associated with the current task; the mode parameters include at least a task mode and a visibility / concealment threshold; a visibility / concealment control module for receiving the mode parameters and the importance of the components, generating a visibility / concealment control strategy for the components based on preset multi-dimensional mapping rules, and determining the visual state of each component in the holographic display space based on the importance and the visibility / concealment control strategy; and a holographic rendering module for rendering the components based on the visual state to obtain a stereoscopic holographic image visible to the naked eye. By combining the component hierarchy module and the visibility control module, the system can quickly filter and display key components based on their importance, effectively reducing unnecessary information interference and improving the visibility efficiency of critical components. Through the linkage between the task mode module and the visibility control module, the system can dynamically match the visibility control strategy of components under different task modes, ensuring that the displayed content is closely related to the current task, improving task execution efficiency and information focus capabilities. Through the collaborative processing of the visibility control module and the holographic rendering module, the priority state of components can be directly converted into image rendering effects (such as highlighting, transparency, and hiding), enhancing the intuitiveness and hierarchy of 3D visualization.

[0027] Optionally, the component classification module includes: a component identification unit and an importance calculation unit; the component classification module is used to divide the three-dimensional model of the nuclear power plant into multiple components and assign a corresponding importance to each component, including: The component identification unit is used to divide the component boundaries based on the three-dimensional topology and logical connection relationship of the three-dimensional model, and obtain multiple components corresponding to the three-dimensional model; the importance calculation unit is used to determine the importance of the component based on the structural location, operation frequency and safety level dimension of the component.

[0028] In this embodiment, the importance of a component can be further labeled with a preset level (such as high, medium, or low) corresponding to the threshold range of importance, for use by the visibility control module. Three-dimensional topology refers to the shape, size, position, and spatial adjacency and containment relationships of each geometric element in a three-dimensional model. For example, three-dimensional topological relationships can include the geometric boundaries, position coordinates, and relative arrangement relationships of each component in the model. Three-dimensional topological relationships are used to identify independent entity components and their spatial affiliation. Logical connection relationships refer to data in the model that characterizes the functional associations between components, such as process piping connections, electrical signal links, and control loops. For example, logical connection relationships include information such as process connections, signal links, control loops, and media flow paths between components. The connection relationship between the main control instrument and the execution component is associated through signal channels, or the connection relationship between the pump and the cooling loop is resolved through the flow network. The three-dimensional topological relationships and logical connection relationships are the basic data established during the engineering modeling phase of the nuclear power plant, pre-stored in the system database, and retrieved and analyzed by the component identification unit.

[0029] In this embodiment of the disclosure, the component boundary can refer to the geometric and logical extent of each independent functional entity determined by analyzing the three-dimensional topological and logical connection relationships. Structural location can refer to the spatial distance of a component relative to the core area of ​​a nuclear power plant (such as a reactor) or its critical position in the system flow. Operating frequency can refer to the statistical frequency with which a component is operated, activated, or appears in alarm records within a historical period. Safety level dimension can refer to the importance level (such as Class 1E safety equipment) assigned to a component based on nuclear safety regulations and design documents, related to its safety functions.

[0030] Specifically, Figure 2 A process for determining the importance of components is presented; see [link to documentation]. Figure 2 The component identification unit reads the 3D model data of the nuclear power plant, first analyzing its 3D topology to distinguish different geometric shapes. It then analyzes the logical connections implied in the design data, such as pipeline connections and signal control links. Combining this information, it precisely delineates the component boundaries of each independent device, pipe section, valve, and other component, forming a component list. The importance calculation unit calculates the indicators of each component in the list across multiple dimensions: calculating the Euclidean distance from the component to the reactor to assess its structural location; querying the historical database to count the component's operating frequency; and reading the equipment ledger to obtain the component's safety level dimension. The importance calculation unit normalizes and weights these multi-dimensional indicators (weights can come from the task mode module), ultimately outputting a quantified comprehensive importance index for each component. This involves assigning importance levels to components and categorizing them into high, medium, and low importance grades. The beneficial effect of this step is that it enables automated, structured analysis and quantitative assessment of the importance of massive, heterogeneous 3D model data, providing a reliable and objective data foundation for subsequent intelligent explicit / implicit control.

[0031] Optionally, the mode parameters also include: dimension adjustment weights; and an importance calculation unit, which is also used to determine the importance of a component based on the dimension adjustment weights and the component's corresponding structural location, operating frequency, safety level dimension, and control flow hub nature.

[0032] In this embodiment, the dimension adjustment weight can refer to the proportion of contribution of different scoring dimensions (such as structural location, safety level, operating frequency, and control flow hub status) in calculating the importance of a component. For example, the safety level has a higher weight in emergency mode, while the operating frequency has a higher weight in inspection mode. Control flow hub status can refer to the degree of criticality of a component in an automated control or energy transfer network, derived from logical connection relationship analysis, i.e., the degree to which the component serves as a central hub in the information flow / control flow path. Information flow path can refer to the signal / control link path obtained from the parsing of logical connection relationships. Accident evolution impact weight can refer to the scenario impact weight (high / medium / low) related to the task mode. Information flow / control flow path influence can be a criticality indicator (such as whether it is located at a central node / critical link) calculated based on the information flow path. Information flow / control flow path influence can be used to characterize the criticality of a component in an automated control link or energy flow transfer path, i.e., the more central the node, the more important it is.

[0033] Specifically, the task mode module, based on the current task (such as emergency mode), includes a set of dimension adjustment weights (such as structural position weights) in the output mode parameters. =0.45, security level weight =0.20, frequency weight =0.15, logical dependency (control flow pivotal) weight =0.20). When calculating the importance of a component, the importance calculation unit uses not only the component's standardized score value (structural location score) but also... Security level rating Frequency of operation score Logical dependency scoring Furthermore, these weights are used for weighted summation: .in, The weight of the k-th scoring dimension is set by the task mode module according to the context of the current task; The standardized score value of component i in the k-th scoring dimension is uniformly normalized to the interval [0, 1]. Logical dependency scores are obtained by analyzing network topology and calculating the betweenness centrality of the nodes containing the component. The beneficial effect of this step is that by adjusting the weights according to dimensions, a strong correlation is achieved between component importance assessment and task objectives, enabling the same component to obtain the most relevant importance evaluation for different tasks, greatly enhancing the system's adaptability.

[0034] For example, the above steps can also be understood as follows: the importance calculation unit assigns a comprehensive importance index to the component based on the information flow path and accident evolution impact weight between the component and other logically related object units in the nuclear power plant digital model. This involves dynamically adjusting the importance level and its corresponding importance rating label. This allows for contextual adaptability of component classification in task modes such as accident simulations and emergency response drills. Other object units include measurement point object units, control logic object units, and actuator object units that have signal links or control loops with the component, and / or equipment object units that have process connections or media flow relationships with the component.

[0035] The information flow path and accident evolution impact weights are categorized into high, medium, and low levels. These weight levels directly affect the priority of subsequent visualizations. The structural location factor determines whether a component is located on a core path, main equipment axis, or critical enclosed area. For example, valves located on the reactor cooling loop have higher priority than supports in auxiliary compartments. The operating frequency factor is used to statistically analyze the start-up and shutdown frequency, sensor activation counts, and alarm records of components (equipment in a nuclear power plant, i.e., the component units corresponding to the 3D model). Components with frequent operation typically have stronger control or feedback logic and should have a higher priority. The safety level factor is used to identify whether a component belongs to an important safety system (such as an emergency cooling system or containment equipment) based on nuclear power plant design documents or safety evaluation standards, and assigns a weighted judgment.

[0036] In this embodiment of the disclosure, the following four scoring dimensions and their calculation methods are defined. Structural position factor ( ): This measures the spatial distance between a component and the system core (such as a reactor). The closer the distance, the higher the score. The calculation formula is: ;in, Let be the Euclidean distance from component i to the reactor core. This represents the maximum Euclidean distance from system component i to the reactor core. Safety level factor ( ): Assigning safety levels to components based on nuclear safety standards The rating ranges from 1 to 5, representing non-safety related to Class 1E safety equipment, respectively. The score is calculated as follows: Frequency factor ( Based on the frequency with which a component is invoked or operated by a task within a certain period (e.g., 30 days). To avoid the influence of extreme values, a logarithmic compression method is used. The calculation formula is as follows: ;in, The highest call frequency among all components. Logical dependency factor ( The number of dependencies indicates the degree to which a component is depended upon in the system's logical structure. A higher number of dependencies indicates a more critical control path. The scoring formula is: ;in This represents the number of times component i is referenced by other modules. This represents the maximum number of system dependencies.

[0037] The task mode module automatically sets weights based on the task type. Values. For example, in emergency mode, the weight of security level and logical dependency dimensions is increased; in inspection mode, more emphasis is placed on structural location and usage frequency. Scoring Results The importance level can be divided into three levels: high, medium, and low, according to a set threshold. This level is used to drive the determination of subsequent component visibility strategies and the hierarchical scheduling of visualization.

[0038] Based on the above technical solutions, the comprehensive importance index of the components... The component index can be calculated by the system based on multiple dimensions, including structural location, security level, and frequency of operation. When loading a task scenario, the task mode module calls this component index and compares it with the display threshold set for the corresponding scenario to determine the component's visibility state (e.g., highlighted, semi-transparent, hidden). Different task modes correspond to different display / hidden control thresholds. For example, in inspection mode, the highlighted display threshold... A value of 0.75 (i.e., a value greater than or equal to 0.75 is required for highlighting) is the threshold for semi-transparent display. A value of 0.4 (meaning greater than or equal to 0.4 and less than 0.75) allows for semi-transparent display; less than To hide. For example, in troubleshooting mode, highlighting the threshold value. The threshold for semi-transparent display is 0.7. The threshold value is 0.3. This is the highlighting threshold in emergency mode. The threshold for semi-transparent display is 0.85. The threshold is 0.5. This is the highlighting threshold in maintenance mode. The threshold for semi-transparent display is 0.65. It is 0.35.

[0039] In emergency mode, to enable rapid positioning and focused display of critical equipment, the system sets a higher high-brightness display threshold (e.g., 0.85) and a medium display threshold (e.g., 0.50) to control the rendering load of non-critical equipment, thereby reducing visual interference and improving task response efficiency.

[0040] Specifically, during operation, when the importance of component i... Greater than or equal to the highlight threshold When this happens, the system sets the component to a highlighted state; if... Between and In between, set to semi-transparent; when Below When the time comes, the component will be automatically hidden.

[0041] Optionally, the task modes may include at least: inspection mode, troubleshooting mode, emergency mode, maintenance mode, and training mode.

[0042] In this embodiment, the inspection mode can refer to a task mode used for routine equipment status inspection. The mode parameters of the inspection mode prioritize displaying sensor and instrument readings and high-frequency access points, while secondary structures are semi-transparent. The troubleshooting mode can refer to a task mode for responding to system alarms or anomalies. The mode parameters of the troubleshooting mode can automatically locate and highlight faulty components and their associated upstream and downstream paths based on the fault source. The emergency mode can refer to a task mode used for accident handling or drills. The mode parameters of the emergency mode significantly increase the safety level weight and visibility threshold, forcibly highlighting safety-critical equipment (such as emergency diesel engines and cooling circuits) and hiding irrelevant areas. The maintenance mode can refer to a task mode used for planned maintenance operations. The mode parameters of the maintenance mode highlight the equipment to be maintained and its logically related components. The training mode can refer to a task mode used for training new employees. The mode parameters of the training mode support batch control of component visibility according to teaching steps, combined with explanation and guidance.

[0043] Specifically, the task mode module pre-configures the aforementioned task modes and their corresponding complete mode parameter packages (including mode labels, dimension weights, explicit / implicit thresholds, etc.). After a user selects a mode through the interactive control module or automatically triggered by the system, the module loads the corresponding parameter package and outputs it. The beneficial effect of this step is that it abstracts the complex nuclear power plant operation and maintenance scenario into standardized, configurable modes, enabling the system to understand the essential differences between different tasks and invoke the preset optimal visualization strategy, achieving a leap from a general display platform to an intelligent task assistance system.

[0044] In this embodiment, the task mode module pre-sets various typical task scenario modes related to nuclear power plant operation. Each task mode corresponds to specific operational objectives, operating procedures, and components of interest. Task modes include, but are not limited to, the following categories: Inspection Mode: Used for routine equipment inspections. Inspection mode prioritizes displaying key measuring points, sensors, and pipeline nodes, while setting secondary structures to semi-transparent or hidden. Maintenance Mode: Used for planned maintenance operations. Maintenance mode highlights the components to be maintained and their upstream and downstream dependent structures, such as main pumps and control cabinets, while temporarily irrelevant components are hidden or set to low brightness. Troubleshooting Mode: Used for responding to alarms or fault prompts. Troubleshooting mode automatically focuses on the fault point and its connecting paths, displaying equipment status and operating parameters to improve troubleshooting efficiency. Emergency Mode: Used for accident drills or emergency response. Emergency mode highlights important safety equipment, such as emergency diesel engines and cooling circuits, while rendering non-emergency areas with low weight to avoid information interference. Training Mode: Used for new employees or simulation teaching. Training mode provides phased guided demonstrations, with components grouped and displayed progressively according to the teaching content, and can be manually adjusted.

[0045] Each task mode can be preset in the system or loaded by the user and automatically switched based on the operating status. The task mode module is used to manage and output task parameters in the system. The task mode module pre-configures multiple typical nuclear power plant operating scenarios and defines specific task weight configurations for each scenario to drive the generation of subsequent explicit and implicit control strategies. Task parameters are a set of mode parameters that characterize the current task context. Task parameters may also include the task mode type and its corresponding display priority rules / areas of interest / related component sets, used to drive the adaptive generation of component importance classification and explicit / implicit control schemes.

[0046] Specifically, various nuclear power scenarios include, but are not limited to, the following: Inspection mode, used for routine inspection tasks during daily operation. In inspection mode, frequently inspected components such as equipment measuring points, sensors, and pipeline nodes are prioritized for display. For example, in inspection mode, the system defaults to the following component visibility status determination rules: component scoring. If it is set to display mode, it will usually be displayed in the central area of ​​the hologram; If so, set it to semi-transparent state for auxiliary reference; If a key information item is displayed in a hidden state, it will be set to a hidden state to avoid interference from non-critical information. By segmenting the settings and combining the distribution patterns of visual focus with the cognitive load control strategy design for nuclear power plant inspection tasks, we can ensure that key information is effectively conveyed while reducing user visual fatigue and the risk of misoperation.

[0047] The troubleshooting mode is used to respond to system faults or abnormal alarms. Based on the fault source location information, the system focuses on displaying its upstream and downstream impact paths and related subsystems. For example, all fault path components are forcibly highlighted, while adjacent components are displayed with medium weight. In troubleshooting mode, the task mode module automatically deduces the upstream and downstream logical dependencies of the faulty component based on the alarm source identifier from the control system. The display control module receives this path information and triggers the following display control strategy: components on the fault path (such as abnormal equipment or broken valves) are forcibly highlighted to ensure user visual focus; adjacent components directly connected to the path component (such as pre-pump units or control units) are set to constant or medium brightness to facilitate reasoning and troubleshooting; and components in other unrelated areas are hidden or dimly lit to reduce visual interference.

[0048] Emergency mode is used for high-pressure mission scenarios such as accident simulations and emergency response drills. In emergency mode, critical safety equipment, such as cooling circuits, emergency diesel engines, and control valve assemblies, is prioritized, while non-critical components are hidden or made transparent to reduce visual interference. For example, a mission tag triggers an increase in the weight of the safety level dimension to greater than or equal to 0.45. Specifically, in emergency mode, to enhance the responsiveness to nuclear power plant safety components, the system dynamically adjusts the weight configuration of each component's dimensions. Specifically, the mission mode module transmits the emergency mission tag to the display / concealment control module, triggering an increase in the safety level dimension weight from the default value in inspection mode (e.g., 0.2) to a higher value in emergency mode (e.g., 0.45). The corresponding strategy in emergency mode in this state ensures that components with higher safety levels (such as emergency diesel engines, safety valves, and cooling circuits) receive higher importance in the weighting, thus being highlighted or always displayed in subsequent display / concealment control strategies, ensuring visual priority for critical mission equipment. Simultaneously, peripheral components without direct association are made semi-transparent or hidden to reduce interference.

[0049] Maintenance mode is used for planning maintenance and component replacement work preparation. Maintenance mode displays the equipment to be maintained, its upstream and downstream components and connection nodes, with the equipment to be maintained highlighted, dependent paths semi-transparent, and the rest highlighted or hidden.

[0050] The training mode is designed for new employee operational drills or system instruction. In this mode, component groups are displayed in batches according to stages or knowledge points, which can be combined with voice explanations or interactive prompts. For example, a step-by-step display / concealment control algorithm can be enabled to unlock component display permissions based on the teaching progress. Specifically, in training mode, the system uses this algorithm to manage the phased permissions of components in the nuclear power plant's 3D model. The task mode module divides component groups according to a preset teaching task flow. Each group corresponds to one teaching step. The display / hidden control module only shows [the information] in the initial teaching state. The system selects components within the current teaching stage, while other components are set to hidden or locked. The system receives trigger signals from the interactive control module (such as a voice prompt "Next" or a click command) and updates the current teaching stage status. And activate the corresponding component group. Display permissions are granted. Simultaneously, voice explanations and interactive prompts are triggered, along with the step-by-step display and hiding of components, improving new employees' efficiency in understanding the system structure and functions.

[0051] Optionally, the visibility control module is used to determine the visual state of each component in the holographic display space based on importance and visibility control strategy, including: The visibility control module is used to generate a component priority list based on the visibility control strategy and the importance of each component, and to map each component to its corresponding visibility state according to the component priority list; wherein, the component priority list defines the mapping relationship between each component and a visibility state selected from display, highlight, semi-transparent and hidden.

[0052] In this embodiment of the disclosure, the component priority list can refer to a structured data set generated by the visibility control module. The component priority list explicitly records the correspondence between the unique identifier of each component and its assigned visual state (show, highlight, semi-transparent, hidden). The component priority list is a key data interface connecting decision-making (visibility control strategy) and execution (holographic rendering).

[0053] Specifically, the visibility control module generates visibility control strategies (such as...). Highlight, show, translucent, After hiding, iterate through all components. For each component, extract the quantified value corresponding to its importance (such as task priority score). The module substitutes the component ID into the strategy for judgment to obtain the visible state of the component. Then, it records the pair of information: component ID and its corresponding visible state. Once all components have been processed, these records are aggregated to generate the final component priority list. The holographic rendering module can directly read this list to determine the rendering method for each component. The beneficial effect of this step is that it solidifies the dynamic decision-making process into a clear, static instruction list, eliminating the need for repeated calculations of decision logic in the rendering stage; instead, it focuses on efficient execution, greatly improving the performance and stability of the system's real-time rendering.

[0054] Optionally, based on the explicit / implicit control strategy and the importance of each component, a component priority list is generated, including: Obtain the dominant scoring dimension of the current task and its corresponding target reference value from the pattern parameters; obtain the standardized score of each component under the dominant scoring dimension; determine the task priority score of each component based on the target reference value and the standardized score; generate a component priority list based on the explicit and implicit control strategy and the task priority score.

[0055] In this embodiment of the disclosure, the dominant scoring dimension (k) can refer to the specific dimension that is selected as the most critical for evaluating the priority of the component in the current task mode (such as the security level in emergency mode). Structural position under inspection mode ). Target reference value ( This can refer to a preset ideal value that accompanies the dominant scoring dimension, used for standardized calculations. For example, the security level... It can be set to 1.0 (representing the highest security level), structural integrity. It can be set to 0.8. Standardized score ( This can refer to the score of component i after normalization on the dominant scoring dimension k, typically ranging from [0,1]. Task priority score ( ) can refer to using a formula The calculated core score is used for final sorting and state determination of components under the current task. Where, Score the task priority of component i; Let i be the standardized score of component i in the k-th rating dimension; This is the target reference value corresponding to the current task. In inspection mode, this is the dominant scoring dimension. The corresponding target reference value is 0.8; in troubleshooting mode, the dominant scoring dimension is... The corresponding target reference value is 0.9; in emergency mode, the dominant scoring dimension The corresponding target reference value is 1; in maintenance mode, the dominant scoring dimension The corresponding target reference value is 0.75.

[0056] Specifically, the explicit / implicit control module parses the dominant scoring dimension k and the target reference value corresponding to the current task from the mode parameters. The module queries or calculates the standardized score of each component i in dimension k. For each component i, according to the formula Calculate its task priority score. This formula compares the component's actual performance with the ideal task objective. The module will calculate the priority score for all components. The value is compared with the thresholds defined in the explicit / implicit control strategy (such as 0.85, 0.6, 0.4) to determine the visibility state of each component. Finally, the IDs of all components and their determined states are compiled to generate a component priority list. The beneficial effect of this step is that it provides a computationally efficient and logically clear method for priority quantification. By focusing on the dominant scoring dimension, the decision logic is highly consistent with the core task objective; by introducing a target reference value, cross-task comparability and normalization of scores are achieved, enabling the subsequent fixed threshold determination mechanism to operate stably.

[0057] Based on the above technical solution, when the task label changes (i.e., the current task type changes), the dominant scoring dimension k and the target reference value... Update accordingly and trigger the action. This includes recalculating rendering priorities to achieve adaptive adjustments. Furthermore, the visibility control module calculates all components based on the aforementioned strategy. The value is set, and components are divided into different visibility levels according to the set display status threshold.

[0058] Specifically, If so, then set it as highlighted; If so, then set it to normal display; If so, set it to semi-transparent; If a component is set to a hidden state, it is then divided according to the above strategy, resulting in a priority list where each component corresponds to a display state, which serves as the input parameter for subsequent rendering modules.

[0059] Optionally, the holographic rendering module includes: a layer management unit and a focus enhancement unit; the holographic rendering module, used for rendering components based on the visible state to obtain a naked-eye visible stereoscopic holographic image, includes: The layer management unit is used to set the rendering order and occlusion relationship of each component in the holographic display space based on the visual state, and to perform holographic rendering based on the rendering order and occlusion relationship to obtain the holographic image to be enhanced; the focus enhancement unit is used to identify the key components corresponding to the current task, and to perform focus enhancement processing on the key components in the holographic image to be enhanced to obtain a stereoscopic holographic image visible to the naked eye.

[0060] In this embodiment, the rendering order and occlusion relationship can refer to the rules in the graphics rendering pipeline that determine which components are drawn first and which components may be occluded. The layer management unit adjusts this relationship to ensure that key components are rendered first and are visible even if their spatial position is later. The holographic image to be enhanced can refer to an intermediate image that has undergone basic 3D rendering, contains all visible components, but has not yet undergone targeted visual highlighting processing. Key components can refer to components that are not only visible in the current task but also need to attract the user's attention. Key components are usually selected from the components with the highest scores in the component priority list.

[0061] Specifically, the layer management unit receives a component priority list. It places all highlighted and visible components on a high-priority rendering layer, semi-transparent components on a low-priority layer, and hidden components are not added to the rendering queue. During rendering, by adjusting the depth buffer value, it forces components in the high-priority layer to always be drawn on top of the low-priority layer, thereby optimizing the rendering order and occlusion relationships and preventing critical components from being occluded. After this step, the holographic image to be enhanced is generated. The focus enhancement unit identifies the critical components of the current task (such as those mentioned above) from the component priority list or the task context. (Scoring components). For key components, additional visual enhancement processing is applied to the unit. For example, its surface brightness and saturation are increased, high-contrast outlines are added to its edges (edge ​​sharpening), or the camera is automatically adjusted to keep it in the center of the image when the viewing angle changes (focus locking). After these enhancement processes, the holographic image to be enhanced is transformed into the final output, a visually layered, focused, and naked-eye visible stereoscopic holographic image. The beneficial effect of this step is that it transforms logical priorities (visual states) into an intuitive and hierarchical visual experience through graphics means (layer management, visual enhancement), effectively overcoming the problems of mutual information occlusion and unclear focus in holographic displays, and greatly improving the efficiency of information acquisition and operational accuracy for users in complex 3D scenes.

[0062] For example, the layer management unit sets the rendering order and occlusion relationships of each component in three-dimensional space to ensure the visibility priority of key components, including the following steps: S1. Identify the set of key components related to the current task from the priority list and mark these components as: key.

[0063] S2. Divide all visible components into multiple layers according to priority. Specifically, layer A is the key component layer (components in the key component set); layer B is the medium-priority visible component layer; and layer C is the low-priority or auxiliary component layer.

[0064] S3. During the holographic rendering process, before each frame is rendered, the layer management unit renders the layers in the following order: first the background component (layer C), then the mid-level components (layer B), and finally the key components (layer A). In layer A, the key components are set to be rendered first, ensuring that their rendering is not obscured by other components, even if they are relatively far away in physical distance.

[0065] S4. Based on the current camera viewpoint, perform depth sorting on all visible components, but apply a forced front attribute to critical components. This means critical components can be set to the front during rendering to prevent them from being occluded by components of other layers. Specifically, to adapt to the operator's observation needs, a dynamic camera viewpoint adjustment mechanism is provided. When the user issues voice, gesture, or other interactive commands through the interactive control module, the virtual camera's position, viewing direction, or tilt angle is adjusted in real time, enabling multi-angle browsing of the 3D scene.

[0066] After the viewpoint adjustment is complete, the layer management unit will perform a depth-based rendering sort of all currently visible components. This ensures that even if the user adjusts the viewpoint each time, such as from front to back, the components will still be displayed in priority order. During this process, the system introduces a mechanism to force key components to be prioritized. That is, for key components that are determined to be of high importance or have priority in the current task, they will be forcibly placed at the front of the rendering list during sorting, even if their spatial position is at the back.

[0067] The adjustment does not affect the spatial structure of the 3D model; it only adjusts the Z-buffer order in the graphics rendering pipeline to prevent important components from being occluded by non-critical structures. Specifically, for component i, its adjusted rendering depth value... The definition is as follows: ; In the formula, Let Z be the standard depth value of component i under the current camera projection (i.e., the Z value in the normalized device coordinate space). In other words, in this invention, the Z value in the normalized device coordinate space... This represents the relative depth position of component i from the current viewpoint. Its value is automatically calculated by the graphics rendering system based on the component's spatial coordinates and the camera's viewpoint, typically ranging from 0 to 1. A smaller value indicates that the component is closer to the camera. In default perspective rendering, the system obtains this value through the standard graphics transformation pipeline based on the component's world coordinates and camera parameters. Therefore, no manual user intervention is required, and it can be directly used for component depth sorting. The adjusted rendering depth value for component i is used for actual rendering sorting. K is the set of components marked as critical in the current task mode; V is the set of all components currently in the visible state; It is a tiny positive number used to ensure that critical components are always rendered in front of other components; a typical value is 0.01.

[0068] For example, in troubleshooting mode, when a user rotates their view to view the components behind the device, if the faulty component is behind an obstruction layer, it will be forced to be rendered in front of the field of view to ensure that its information is clearly presented. In addition, the focus enhancement unit can perform brightness enhancement, edge sharpening, or focus locking on critical components, enabling operators to quickly locate critical devices in complex scenes.

[0069] S5. During the rendering process, if a non-critical component is completely obscured by other components, the layer management unit will remove it from the current frame rendering or reduce its transparency to a hidden state to save rendering resources and reduce visual interference.

[0070] During rendering, the system can determine whether a component is completely occluded by other components based on the screen overlap relationship and depth information (i.e., depth value) of the components in the current view. If it is confirmed that a component is completely occluded and is not a critical component, it can be removed from the current frame or its transparency can be reduced to optimize rendering efficiency. Non-critical components are only used for filtering objects. The determination of non-critical components is based on whether the component belongs to the set K marked as critical components in the current task mode. (i.e., non-critical). Depth information is not used to determine criticality, but rather to determine whether a component is completely occluded based on the screen overlap relationship from the current viewpoint. Culling or reducing opacity is only performed when a component is neither part of the critical set K nor is it completely occluded due to overlap and depth confirmation, in order to avoid accidentally deleting foreground or partially visible components and to ensure rendering accuracy and efficiency.

[0071] S6. Synchronized with layer order control, the focus enhancement unit performs additional visual processing on key components, further improving their visual recognizability. Specifically, the focus enhancement unit prioritizes multiple candidate components based on their task relevance and viewpoint characteristics, dynamically adjusting their visual display to maintain the visual focus of key components during complex view switching or multi-angle browsing. Task relevance is determined by assigning a value of 1 if the component is identified as an element on the task's critical path by the task mode module; a value of 0.5 if the component belongs to the task's recommended attention list (e.g., upstream / downstream components); and a value of 0 for other components. This represents the visibility of the component from the current viewpoint, where a value of 1 is assigned if the component is fully visible.

[0072] For example, the focus enhancement unit's workflow includes candidate component selection, focus priority determination, and visual effect enhancement. The process of selecting candidate key components is as follows: The focus enhancement unit first selects a subset of components with higher weight scores from the component priority list generated by the visibility control module under the current task mode (such as the previously mentioned components). Those (or those exceeding a certain threshold) are selected as candidate key components. Candidate components are not taken directly from all of layer A, but rather a subset with higher weight scores is selected from the component priority list generated by the visibility control module (such as those mentioned above). (Or higher than the threshold) are selected as candidate key components. The priority list itself is obtained by the visibility control module calculating and sorting the components according to the task strategy. Using it to select the Top-N ensures that the enhanced objects are consistent with the task strategy. It can be understood that the set of key components K (hard labels) is used for layer A; candidate key components are used for focus enhancement (soft filtering), and are selected from the Top-N priority list by default, which may include K and its upstream / downstream recommended focus components.

[0073] The process of focusing on priority determination is as follows: For candidate key components, the system calculates the focus priority score based on the following dimensions. : In the formula, The value ranges from 0 to 1, representing the relevance of the component to the current task. If the component is identified by the task mode module as an element on the task's critical path, it is assigned a value of 1; if the component belongs to the task's recommended attention list (such as upstream / downstream components), it is assigned a value of 0.5; for other components, it is assigned a value of 0. This represents the visibility of the component from the current viewpoint. A value of 1 is assigned if the entire component is visible; otherwise, a value of 1 is assigned. If it is completely obscured, assign a value of 0.5; if it is completely obscured, assign a value of 0. Let be the significance coefficient of component i. In the formula, This is the contour complexity factor. If component i belongs to the category of complex contour components (such as components with multiple edges / multiple curved surfaces, such as valve rods, instrument panels, etc.), this factor value is assigned. =1; otherwise =0. It is a task flagging factor (0 or 1) that determines whether a component is marked as a critical / alarming / critical component by the task system. If it is a critical / alarming component, a value is assigned. =1, otherwise =0; It is a weight, a fixed value, such as 0.5. Based on the user's past frequency of operation on this component; The weighting factor set for task mode satisfies =1.

[0074] Among them, the perspective presentation features include at least the visibility of the component from the current perspective. And its position coordinates on the screen / whether it is in the main visual area. Visibility This can be determined based on the occlusion relationship from the current viewpoint. The focus enhancement unit will score according to focus priority. Sort the components to determine the final set of key components used for visual enhancement.

[0075] The visual enhancement process is as follows: For key components with high focus priority, the focus enhancement unit performs visual enhancement operations including: brightness enhancement, edge sharpening, and focus locking. Brightness enhancement can refer to increasing the component's base brightness by a scaling factor adjusted in the shader rendering. Scale factor Determined according to the following formula: In the formula, The significance coefficient of the component is denoted as [0,1]. The minimum brightness enhancement factor is set to 1.1 (i.e., increases by 1). brightness); The maximum brightness enhancement factor is set to 1.4 (i.e., increases by 1.4). brightness).

[0076] Edge sharpening refers to performing edge extraction operations on the edges of components to enhance contrast and provide outlining, thereby improving their recognizability in holographic images. Specifically, when rendering the model edges, a high-contrast outline (such as a white or yellow line, approximately 2-3 pixels wide) is uniformly drawn to highlight their boundary contours. This outline is directly based on the geometric information of the component's geometric model edge lines, without using complex image filters or operators.

[0077] Focus locking refers to keeping key components in the main visual focus area, such as the center of the view or the direction the main camera is pointing, when the viewpoint changes or the scene changes dynamically. It can also blur or darken surrounding components to improve the focusing effect.

[0078] For example, the focus enhancement unit calculates the position coordinates of a key component on the screen. If the key component deviates from the screen center by more than a preset threshold (such as the display width or height), the focus enhancement unit will detect the component's position. If the component is outside the designated area, the user is prompted to move the viewpoint or rotate the screen using interactive operations (such as gestures or view control buttons) to bring the component into the main visual area. Simultaneously, the brightness of non-critical components is reduced to a preset ratio (e.g., set to a fraction of the original brightness). To minimize visual interference, the focus enhancement unit updates the component score every frame or re-evaluates it based on task / viewpoint changes. If a new component's score surpasses that of the currently focused component, the visual enhancement target is dynamically updated. Through the collaborative processing of the visibility control module and the holographic rendering module, the priority state of components can be directly converted into image rendering effects (such as highlighting, transparency, and hiding), enhancing the intuitiveness and hierarchy of 3D visualization.

[0079] Example 2 Figure 3 This is a flowchart of a nuclear power sensitive data security protection system according to Embodiment 2 of the present invention. Based on the above embodiments, this embodiment further includes an interactive control module, and the functions of the interactive control module are described in detail. Explanations of terms that are the same as or corresponding to those in the above embodiments are not repeated here. Figure 3 As shown, the system includes: a component hierarchical module, a task mode module, a visibility control module, a holographic rendering module, and an interactive control module.

[0080] The system includes the following modules: a component classification module, which divides the 3D model of the nuclear power plant into multiple components and assigns a corresponding importance to each component; a task mode module, which determines the mode parameters associated with the current task, including at least the task mode and a visibility / concealment threshold; a visibility / concealment control module, which receives the mode parameters and the importance of the components, generates a visibility / concealment control strategy for the components based on preset multidimensional mapping rules, and determines the visual state of each component in the holographic display space based on the importance and the visibility / concealment control strategy; a holographic rendering module, which renders the components based on their visual state to obtain a stereoscopic holographic image visible to the naked eye; and an interactive control module, which adjusts the current task or the visual state of the components based on user-triggered voice commands or gestures.

[0081] In this embodiment of the disclosure, voice commands can refer to control commands issued by the user through natural language, such as switching to inspection mode or highlighting the cooling pump. Gesture operations can refer to commands expressed by the user through hand movements within the system interaction area, such as swiping left to switch tasks, using two fingers to zoom in and out of the view, or tapping a specific component.

[0082] Specifically, the interactive control module collects voice commands via a microphone array and captures hand gestures via a depth camera and infrared sensor array. Voice and gesture recognition algorithms then convert these into standardized control signals. For example, upon recognizing an emergency mode voice command, the module sends a switching command to the task mode module; upon recognizing a gesture to hide an area, the module generates a local component hiding command and sends it to the show / hide control module. The benefit of this step is that it provides a natural and intuitive human-computer interaction method, enabling maintenance personnel to quickly control the system even with both hands occupied or at a distance, significantly improving operational flexibility and response speed.

[0083] For example, the system further includes a central processing unit (CPU) and a server. The CPU is connected to the server, the component hierarchy module, the task mode module, the display / concealment control module, the holographic rendering module, and the interactive control module, and centrally controls these modules. The server is connected to the component hierarchy module, the task mode module, the display / concealment control module, the holographic rendering module, and the interactive control module, and stores the intermediate and process data of these modules in its database for querying and retrieval.

[0084] Optionally, the interactive control module includes: a manipulation acquisition unit and a command mapping unit; the interactive control module is used to adjust the current task or the visual state of a component based on received voice commands or gesture operations triggered by the user, including: The control acquisition unit is used to acquire action data within the interactive area; the instruction mapping unit is used to transmit the adjusted current task to the task mode module when the current task is adjusted, and to transmit the adjusted visual state to the display / concealment control module when the visual state of the component is adjusted.

[0085] In this embodiment of the disclosure, the interaction area can refer to a three-dimensional spatial range defined by the system, located in front of or around the holographic display device, which can be effectively captured by devices such as depth cameras and infrared sensors to capture user actions. Action data can refer to the raw signals captured by the control acquisition unit (such as depth cameras, infrared sensor arrays, and microphone arrays), which are processed to represent the user's intentions and contain information such as action type, confidence level, and user ID.

[0086] Specifically, the devices in the control acquisition unit work collaboratively to continuously monitor the interactive area. When the user makes a gesture or speaks, the unit acquires raw motion data (such as depth image sequences and audio streams), performs denoising, segmentation, and feature extraction. The command mapping unit matches the processed features with a pre-set command library. For example, a specific gesture trajectory is mapped to switching to troubleshooting mode, or a voice command to hide the left valve is mapped to a command to hide a specific component. Subsequently, the command mapping unit sends the task switching command to the task mode module, or directly sends the component visibility adjustment command to the visibility control module for execution. The beneficial effect of this step is that it achieves high-precision, low-latency intent recognition and command distribution, ensuring that user interaction can accurately and instantly influence the system's core decisions and display output.

[0087] For example, Figure 4 A schematic diagram of the control and acquisition unit is provided. See also... Figure 4The control and acquisition unit includes: an interactive touch panel 6, a zoom control area 5, a depth camera 4, an infrared sensor array 3, a microphone array 2, and a user identification component 1. The depth camera is used to capture the user's hand gestures and limb movement trajectories within the infrared sensor array; the infrared sensor array enhances the ability to capture movements in low-light environments and assists the depth camera in recognizing contours; the microphone array collects user voice commands to trigger voice interaction operations such as task switching and component scheduling; the user identification component identifies the current operator's identity (optional methods include facial recognition / wearing tags / RFID), in conjunction with access control and command attribution judgment.

[0088] The depth camera is mounted directly in front of or above the interactive area, slightly above the user's line of sight, and angled towards the center of the interactive space to capture real-time information on gestures and body movement trajectories. The depth camera's field of view covers the entire user's operating area and forms a stereoscopic perception network with the infrared sensor array to improve spatial resolution and anti-occlusion recognition capabilities. The infrared sensor array is deployed in a surround configuration, positioned at the edges (such as the four corners or borders) of the holographic console or interactive platform, forming a spatial collaborative perception system with the depth camera. In low-light or complex lighting conditions, the infrared sensors effectively assist the depth camera in recognizing user contours and movements through thermal imaging or infrared contour capture.

[0089] The microphone array is deployed around the holographic interactive area, forming a 360-degree sound pickup coverage network. The microphones are spaced 20-30cm apart, forming a beamforming array with functions such as voice source localization, background noise suppression, and speaker recognition. It can accurately capture user voice commands for triggering voice control operations such as task switching and component scheduling. The user identification component identifies the current operator through methods including a facial recognition module (located below depth camera 4), a wearable tag sensor, or an RFID reader (located at user entrances / exits or interactive control consoles). This identification component, in conjunction with the microphones and depth map, enables the attribution and permission binding of voice commands and gestures, ensuring the security and controllability of operations.

[0090] In this embodiment, the user's behavioral action data within the interactive area can be fully covered by the control acquisition unit. This data is then standardized and input into the instruction mapping unit to achieve precise control over the visible / hidden state of components. Taking a user's left swipe gesture as an example, the depth camera continuously acquires the three-dimensional coordinate data of the palm's center point, forming a time-series trajectory. The system calculates the spatial displacement direction and amplitude per unit time to determine if it meets the sliding characteristic conditions, such as a displacement distance exceeding 10 cm, a direction change angle less than 15 degrees, and a duration between 0.5 and 1 second. If a match is found, it is standardized into an action label: Swipe_Left, with an accompanying confidence score (e.g., ...). (and timestamp information).

[0091] In addition, the microphone array collects user voice signals, converts them into command text through a speech recognition model, and matches them against a keyword library. For example, when a user says "hide this part," the system standardizes it as "Cmd_Hide_Current." If the voice content is incomplete, the intent recognition mechanism further infers the operation target based on the current task context and assigns a fuzzy matching level. All standardized action data will include user identification information (such as user ID and permission level) to determine whether the user has the necessary permissions to control the visibility of the current component, preventing accidental or unauthorized operations. The standardized data packets have a unified format for easy subsequent parsing and execution, as follows: .

[0092] Furthermore, the instruction mapping unit generates component control instructions (such as display, hide, and switch view) by referring to the instruction mapping table according to the standardized instructions and the current task mode, and transmits them to the display control module for execution, thereby realizing the dynamic adjustment of the component display status.

[0093] For example, the instruction mapping unit includes an intent recognition mechanism, which combines the user's historical operation patterns with the current task to determine the user's possible operation goals; when the user has not completed the explicit instruction input, the corresponding component's response prompt is triggered in advance to realize a predictive interactive feedback mechanism for ambiguous instructions.

[0094] Among them, the intent recognition mechanism adopts a multi-dimensional behavior voting mechanism to analyze the user's behavioral characteristics in the interaction area, construct a multi-dimensional interaction clue matrix, and perform voting-style scoring judgment on each candidate component to determine whether it is a target component that the current user may pay attention to or intend to operate.

[0095] Specifically, the score obtained through the multi-dimensional behavioral voting mechanism is as follows: In the formula, The voting result of component i in the k-th behavior voting dimension is a boolean value (0 or 1).

[0096] In this embodiment, the following voting dimensions are set for each component: **Gaze lingering dimension:** This determines whether the user's head direction or gaze direction is continuously directed towards the component for more than a set threshold (e.g., 800ms). If this is met, one vote is recorded. **Spatial proximity dimension:** This determines whether the user's hand is spatially close to the component. If the shortest distance between the hand and the component is less than 0.4m, one vote is recorded. **Historical operation dimension:** This extracts a list of frequently used component operations from user interaction records. If the current component is in the Top-N range, one vote is recorded. **Task matching dimension:** This determines whether the component, output by the task mode module, is directly related to the current task objective. If related, one vote is recorded.

[0097] Wherein, the Top-N range refers to the top N components with the highest operation frequency after counting the user's operation behaviors on all components within a period of time (such as one day, one task, or an operation cycle). For example, if N=10 is set, the Top-10 components are the top 10 components with the highest number of user operations within the statistical period. The statistical method may include user operation behaviors such as clicking, focusing, visibility adjustment, and parameter viewing. If the current component to be evaluated appears among these 10 components, it is considered that the user operates it frequently, and it gets 1 vote.

[0098] Specifically, the voting result for each dimension is: . According to the total score determine the intention priority of the component. For example, when , the component is determined as a high-intention object, and the system actively triggers its visual prompts (such as highlighted flashing, name marking, etc.); when , it is regarded as a medium-intention object, the system maintains the current state of the component but preloads the interaction logic; when , it is regarded as a low-intention object, and no special treatment is performed.

[0099] It should be noted that through the cooperation of the interaction control module and the holographic rendering module, users can directly control the display behavior of the three-dimensional view through voice or gesture operations, which improves the instant response of interaction and operation friendliness of the system. Through the multi-module integration of the component grading module, task mode module, visibility control module, holographic rendering module and interaction control module, the system has the full-link linkage capability from task recognition, component evaluation, display optimization to interaction feedback, ensuring that the system still has high visibility, high accuracy and high interactivity in complex environments.

[0100] Illustratively, the interaction control module further comprises an interaction acquisition unit, and the interaction acquisition unit is configured to acquire the operator's operation data, wherein the operation data includes zoom-in or zoom-out data. Referring to Figure 4 , the interaction acquisition unit includes an interactive touch panel and a data collector electrically connected to the interactive touch panel. The data collector stores the operator's motion data on the interactive touch panel. The interactive touch panel is arranged at one side of the holographic interaction area. An interactive control screen is arranged in the interactive touch panel. A control area is arranged on the screen. The control area is used for identifying two typical zoom gesture behaviors. The gesture behaviors include gesture zoom-in operation and gesture zoom-out operation.

[0101] The interactive touch panel further integrates a force sensing layer to collect real-time data on the pressure applied by the user's finger within the touch area. This layer is constructed from piezoelectric materials (such as PVDF), capacitive pressure sensors, or flexible sensors based on resistance changes. The pressure sensors are distributed in a grid pattern across the touch area, forming several sensing points (e.g., 4-9 points per square centimeter) to acquire a two-dimensional pressure map. The force sensing layer is located directly below the main control area of ​​the touch panel and covers the entire interactive area. It can also be placed within a zoom control area within the control area. This zoom control area features enhanced resolution and sensing sensitivity to meet the precision requirements for pressure adjustment during zooming in and out.

[0102] For example, the data acquisition unit is connected to the pressure sensing layer and performs A / D conversion, filtering, and data normalization on the acquired raw electrical signals. The raw acquired data consists of changes in sensor voltage / capacitance / resistance. After normalization, it is converted into a floating-point value between 0 and 1, denoted as P, which represents the average pressure applied per unit time. The minimum effective detection value preset by the sensor is used. With the maximum value To define the range boundaries, use the linear normalization formula: ; In the formula, This is the minimum effective value detected by the pressure sensor (e.g., 0.2N, representing a light touch). The maximum effective value of the pressure sensor (e.g., 5.0N, representing heavy pressure); This represents the raw pressure value collected by the sensor at the current moment. The standardized pressure value is obtained through the above formula, and... For subsequent adjustment of coefficients The calculation involves several steps. During the zoom-in gesture, the operator performs a two-finger outward swipe gesture (sliding two fingers outward from a close position) within the control area. The system records the increasing trend of the distance between the two fingers in real time. If the swipe distance exceeds a set threshold (e.g., 3mm) in consecutive frames, a zoom-in command is triggered, and the system increases the display ratio of the current model accordingly. Conversely, during the zoom-out gesture, the operator performs a two-finger close gesture (bringing two fingers closer to the center from an open state) within the control area. The system identifies the reduction in the distance between the two fingers. If the detected swipe distance is less than a set threshold (e.g., -3mm), a zoom-out command is triggered, reducing the display ratio of the holographic model. After triggering the zoom-in or zoom-out command, the holographic model reacts according to a scaling factor, which is calculated using the following formula: ; In the formula, This is the scaling factor, initially set to 1; This is an adjustment factor used to smooth out scaling effects; This represents the change in distance between the two fingers between the current frame and the previous frame (unit: pixels / mm). This scaling factor is transmitted in real time to the holographic rendering module to perform zoom-in or zoom-out rendering on the 3D model in the current view, achieving delay-free dynamic view adjustment. Additionally, the adjustment coefficient... Determine based on the following formula: ; In the formula, The base scaling factor (default setting is 1.0). To adjust the sensitivity coefficient, the value range is 0.2-0.5. The specific value can be automatically set according to the operator's role or task mode: for example, set it to 0.2 in novice or tutorial mode to avoid accidental operation. For regular users, set it to 0.3, where 0.3 is used to adjust the sensitivity coefficient. The default value. However, in emergency response modes where high interaction speed is critical, it can be set to... Set it to 0.5 to improve the interface's responsiveness. P is the normalized pressure value in the current interaction.

[0103] It should be noted that the system, through the combination of the interactive touch panel and the data acquisition device, can accurately collect behavioral feature data such as the operator's zoom gestures, pressure, and sliding distance, ensuring the real-time response and interactive accuracy of the holographic 3D model during operation. It has the advantages of natural and intuitive operation, sensitive response, and low accidental touch rate.

[0104] Example 3 Figure 5 This is a flowchart illustrating a holographic three-dimensional digital visualization management method for nuclear power plants, as provided in Embodiment 2 of the present invention. This embodiment is applicable to the holographic three-dimensional digital visualization management of nuclear power plants. The method can be executed by a holographic three-dimensional digital visualization management system for nuclear power plants, which can be implemented in hardware and / or software and can be configured in electronic devices. Figure 5 As shown, the method includes: S510. The three-dimensional model of the nuclear power plant is divided into multiple components through the component classification module, and a corresponding importance is assigned to each component.

[0105] S520. Determine the mode parameters associated with the current task through the task mode module; the mode parameters include at least: task mode and display / hidden determination threshold.

[0106] S530: Receive mode parameters and component importance through the display / concealment control module, generate display / concealment control strategy for components based on preset multi-dimensional mapping rules, and determine the visual status of each component in the holographic display space based on importance and display / concealment control strategy.

[0107] S540: The holographic rendering module renders components based on the visible state to obtain a stereoscopic holographic image visible to the naked eye.

[0108] The technical solution of this invention includes a component grading module for dividing the three-dimensional model of a nuclear power plant into multiple components and assigning a corresponding importance to each component; a task mode module for determining mode parameters associated with the current task; the mode parameters include at least a task mode and a visibility / concealment threshold; a visibility / concealment control module for receiving the mode parameters and the importance of the components, generating a visibility / concealment control strategy for the components based on preset multi-dimensional mapping rules, and determining the visual state of each component in the holographic display space based on the importance and the visibility / concealment control strategy; and a holographic rendering module for rendering the components based on the visual state to obtain a stereoscopic holographic image visible to the naked eye. By combining the component hierarchy module and the visibility control module, the system can quickly filter and display key components based on their importance, effectively reducing unnecessary information interference and improving the visibility efficiency of critical components. Through the linkage between the task mode module and the visibility control module, the system can dynamically match the visibility control strategy of components under different task modes, ensuring that the displayed content is closely related to the current task, improving task execution efficiency and information focus capabilities. Through the collaborative processing of the visibility control module and the holographic rendering module, the priority state of components can be directly converted into image rendering effects (such as highlighting, transparency, and hiding), enhancing the intuitiveness and hierarchy of 3D visualization.

[0109] Optionally, the interactive control module can adjust the current task or the visual state of the component based on the voice commands or gestures triggered by the user.

[0110] Optionally, the component classification module includes: a component identification unit and an importance calculation unit; The component classification module divides the 3D model of the nuclear power plant into multiple components and assigns a corresponding importance to each component. This includes: using the component identification unit to divide the component boundaries based on the 3D topology and logical connection relationship of the 3D model to obtain multiple components corresponding to the 3D model; and using the importance calculation unit to determine the importance of the component based on its structural location, operating frequency, and safety level dimension.

[0111] Optionally, the mode parameters may also include: dimension adjustment weights; The method also includes: determining the importance of a component by adjusting the weights based on the dimension and the structural location, operation frequency, safety level dimension, and control flow hub nature of the component through the importance calculation unit.

[0112] Optionally, the task modes may include at least: inspection mode, troubleshooting mode, emergency mode, maintenance mode, and training mode.

[0113] Optionally, the visibility state of each component in the holographic display space is determined by the visibility control module based on importance and visibility control strategy, including: generating a component priority list according to the visibility control strategy and the importance of each component, and mapping each component to the corresponding visibility state according to the component priority list; wherein, the component priority list defines the mapping relationship between each component and a visibility state selected from display, highlight, semi-transparent and hidden.

[0114] Optionally, based on the explicit / implicit control strategy and the importance of each component, a component priority list is generated, including: obtaining the dominant scoring dimension of the current task and its corresponding target reference value from the mode parameters; obtaining the standardized score of each component under the dominant scoring dimension; determining the task priority score of each component based on the target reference value and the standardized score; and generating a component priority list based on the explicit / implicit control strategy and the task priority score.

[0115] Optionally, the holographic rendering module includes: a layer management unit and a focus enhancement unit; The holographic rendering module renders components based on the visible state to obtain a stereoscopic holographic image visible to the naked eye. This includes: setting the rendering order and occlusion relationship of each component in the holographic display space based on the visible state through the layer management unit, and performing holographic rendering based on the rendering order and occlusion relationship to obtain the holographic image to be enhanced; identifying the key components corresponding to the current task through the focus enhancement unit, and performing focus enhancement processing on the key components in the holographic image to be enhanced to obtain a stereoscopic holographic image visible to the naked eye.

[0116] Optionally, the interactive control module includes: a control acquisition unit and a command mapping unit; The interactive control module adjusts the current task or the visual state of a component based on voice commands or gestures triggered by the user. This includes: collecting motion data within the interactive area through the control acquisition unit; transmitting the adjusted current task to the task mode module when the current task is adjusted through the instruction mapping unit, and transmitting the adjusted visual state to the display / concealment control module when the visual state of a component is adjusted.

[0117] It is worth noting that in the above embodiments of holographic three-dimensional digital visualization management of nuclear power plants, the various units and modules included are only divided according to functional logic, but are not limited to the above division, as long as the corresponding functions can be achieved; in addition, the specific names of each functional unit are only for easy differentiation and are not used to limit the scope of protection of the present invention.

[0118] It should be understood that the various forms of processes shown above can be used, with steps reordered, added, or deleted. For example, the steps described in this invention can be executed in parallel, sequentially, or in different orders, as long as the desired result of the technical solution of this invention can be achieved, and this is not limited herein.

[0119] The specific embodiments described above do not constitute a limitation on the scope of protection of this invention. Those skilled in the art should understand that various modifications, combinations, sub-combinations, and substitutions can be made according to design requirements and other factors. Any modifications, equivalent substitutions, and improvements made within the spirit and principles of this invention should be included within the scope of protection of this invention.

Claims

1. A holographic three-dimensional digital visualization management system for nuclear power plants, characterized in that, include: The system includes a component hierarchy module, a task mode module, a visibility control module, and a holographic rendering module; among these... The component classification module is used to divide the three-dimensional model of the nuclear power plant into multiple components and assign a corresponding importance to each component. The task mode module is used to determine mode parameters associated with the current task; the mode parameters include at least: task mode and a display / hidden determination threshold. The visibility control module is used to receive the mode parameters and the importance of the components, generate the visibility control strategy of the components based on the preset multidimensional mapping rules, and determine the visibility status of each component in the holographic display space based on the importance and the visibility control strategy. The holographic rendering module is used to render components based on the visible state to obtain a stereoscopic holographic image visible to the naked eye.

2. The system according to claim 1, characterized in that, The system also includes: an interactive control module; The interactive control module is used to adjust the current task or the visual state of the component based on the voice commands or gestures triggered by the user.

3. The system according to claim 1, characterized in that, The component classification module includes: a component identification unit and an importance calculation unit; The component classification module is used to divide the three-dimensional model of the nuclear power plant into multiple components and assign a corresponding importance to each component, including: The component identification unit is used to divide the component boundaries based on the three-dimensional topology and logical connection relationship of the three-dimensional model, and obtain multiple components corresponding to the three-dimensional model. The importance calculation unit is used to determine the importance of the component based on its structural location, operating frequency, and safety level.

4. The system according to claim 3, characterized in that, The mode parameters also include: dimension adjustment weights; The importance calculation unit is also used to adjust the weights based on the dimensions and the structural position, operating frequency, safety level dimension and control flow hub nature of the component to determine the importance of the component.

5. The system according to claim 1, characterized in that, The task modes include at least: inspection mode, troubleshooting mode, emergency mode, maintenance mode, and training mode.

6. The system according to claim 1, characterized in that, The visibility control module is used to determine the visibility state of each component in the holographic display space based on the importance and the visibility control strategy, including: The visibility control module is used to generate a component priority list based on the visibility control strategy and the importance of each component, and to map each component to its corresponding visible state according to the component priority list. The component priority list defines the mapping relationship between each component and a visual state selected from display, highlight, semi-transparent, and hidden.

7. The system according to claim 6, characterized in that, Based on the explicit / implicit control strategy and the importance of each component, a component priority list is generated, including: Obtain the dominant scoring dimension of the current task and its corresponding target reference value from the mode parameters; Obtain the standardized score for each component under the dominant scoring dimension; Based on the target reference value and the standardized score, the task priority score for each component is determined; Based on the explicit / implicit control strategy and the task priority score, a component priority list is generated.

8. The system according to claim 1, characterized in that, The holographic rendering module includes: a layer management unit and a focus enhancement unit; The holographic rendering module is used to render components based on the visible state to obtain a stereoscopic holographic image visible to the naked eye, including: The layer management unit is used to set the rendering order and occlusion relationship of each component in the holographic display space based on the visual state, and to perform holographic rendering based on the rendering order and occlusion relationship to obtain the holographic image to be enhanced. The focus enhancement unit is used to identify the key components corresponding to the current task and perform focus enhancement processing on the key components in the holographic image to be enhanced, so as to obtain a stereoscopic holographic image visible to the naked eye.

9. The system according to claim 2, characterized in that, The interactive control module includes: a control acquisition unit and a command mapping unit; The interactive control module is used to adjust the current task or the visual state of a component based on voice commands or gestures triggered by the user, including: The control acquisition unit is used to acquire action data within the interactive area; The instruction mapping unit is used to transmit the adjusted current task to the task mode module when the current task is adjusted, and to transmit the adjusted visual state to the display / concealment control module when the visual state of the component is adjusted.

10. A holographic three-dimensional digital visualization management method for nuclear power plants, applied to a holographic three-dimensional digital visualization management system for nuclear power plants as described in claims 1 to 9, characterized in that, include: The component classification module divides the three-dimensional model of the nuclear power plant into multiple components and assigns a corresponding importance to each component. The task mode module determines the mode parameters associated with the current task; The mode parameters include at least: task mode and visibility / hidden determination threshold; The display control module receives the mode parameters and the importance of the components, generates the display control strategy for the components based on the preset multidimensional mapping rules, and determines the visual state of each component in the holographic display space based on the importance and the display control strategy. The holographic rendering module renders components based on the visible state to obtain a stereoscopic holographic image visible to the naked eye.

Images