Nuclear emergency exercise auxiliary system and nuclear emergency exercise method based on augmented reality

Abstract

The invention provides a nuclear emergency exercise auxiliary system and a nuclear emergency exercise method based on augmented reality, the system comprises a data layer, a business layer, a view layer, a function layer, a hardware layer and the like, the data layer defines a plurality of stages included in a nuclear accident emergency exercise process and operation of each stage through a configuration file; the data layer is also used for receiving an operation instruction from a server and executing a corresponding data operation based on the configuration file and the operation instruction; the business layer executes the corresponding business logic according to the data operation executed by the data layer; the business layer is used for deploying a nuclear accident scene model, and the nuclear accident scene model is a three-dimensional scene model restored according to various field scenes; the functional layer provides a nuclear radiation environment and a virtual-real combined environment of the nuclear accident emergency exercise according to the business logic executed by the business layer, so that a user can operate in a real environment and feel the change of a three-dimensional picture in an immersive manner from a visual angle, and emergency personnel can see a three-dimensional scene close to a real accident; and performing nuclear accident exercise in an immersive manner.

Description

Technical Field

[0001] The present application relates to the technical field of emergency exercise auxiliary systems, and in particular to a nuclear emergency exercise auxiliary system and a nuclear emergency exercise method based on augmented reality. Background Art

[0002] According to the "Regulations on the Management of Nuclear Accident Emergency Exercises in Nuclear Power Plants", nuclear power plant operators and provinces and cities where nuclear power plants are located need to conduct nuclear emergency exercises regularly. The usual purpose of the exercise is to control the unit, protect personnel, and notify and communicate with the outside world in an emergency state. Specifically, it may include testing the applicability of nuclear emergency plans and emergency procedures, testing the availability of emergency facilities and equipment, testing the emergency response capabilities of emergency personnel, and the coordination, communication, and cooperation capabilities between emergency professional groups. The existing nuclear emergency exercise scenarios are mainly based on design basis accidents, severe accidents, etc. The exercise scenarios are mainly based on the severe accident (or full range) simulator of the nuclear power plant to simulate the main line accidents, and various assumed equipment failures or defects are inserted into the simulator. The real accident scenario is based on the assumptions and monitoring parameters of the power plant emergency personnel, and the real unit remains in normal condition. Therefore, the scenario development of the exercise relies heavily on simulator simulation, professional analysis, and role-playing.

[0003] The existing scheme cannot simulate real accident scenarios well. Based on hypothetical accident scenarios, emergency personnel cannot have an immersive experience during the exercise, and it is difficult to create a tense atmosphere of a nuclear accident. There is no feedback on the status of on-site equipment, and good exercise results cannot be achieved. Summary of the invention

[0004] The present application aims to solve one of the technical problems in the related art at least to some extent.

[0005] To this end, the first purpose of this application is to propose a nuclear emergency exercise auxiliary system based on augmented reality to achieve an immersive experience for exercise personnel during nuclear accident exercises.

[0006] The second objective of this application is to propose a nuclear emergency exercise method based on augmented reality.

[0007] To achieve the above-mentioned purpose, the first embodiment of the present application proposes a nuclear emergency exercise auxiliary system based on augmented reality, including:

[0008] A data layer, wherein the data layer defines the multiple stages and operations of each stage included in the nuclear accident emergency exercise process through a configuration file; the data layer is also used to receive an operation instruction from a server, and perform corresponding data operations based on the configuration file and the operation instruction;

[0009] A business layer, wherein the business layer executes corresponding business logic according to the data operation executed by the data layer; the business layer is used to deploy a nuclear accident scenario model, wherein the nuclear accident scenario model is a three-dimensional scenario model restored according to a variety of on-site scenarios, and the same nuclear accident scenario model corresponds to one or more business logics;

[0010] A view layer, wherein the view layer displays to the user the screen information of the nuclear power plant simulator during a nuclear accident and an interactive nuclear accident scenario model according to the business logic executed by the business layer;

[0011] A functional layer, wherein the functional layer provides a nuclear radiation environment and a virtual-real combined environment for the nuclear accident emergency drill according to the business logic executed by the business layer, so that the user can operate in a real environment and immersively experience changes in the three-dimensional image from a viewing angle;

[0012] A hardware layer, the hardware layer includes a server, and the server is used to provide computing resources for the function implementation of the data layer, business layer, view layer and function layer;

[0013] The communication layer is used to communicate with the exercise guidance and control host, the nuclear power plant simulator, and the AR helmet.

[0014] In some implementations, the functional layer includes a spatial positioning module, a gesture tracking module, a guidance module, a three-dimensional exploded diagram module, an eye tracking module, a monitoring and recording module, an identification function module and an audio and video streaming module. The spatial positioning module is used to identify the orientation information of the real environment through high-precision spatial positioning technology, and realize the precise superposition of virtual information and the real environment based on the orientation information of the real environment; the gesture tracking module is used to track the user's gesture movements through sensors, and realize the interaction between the user and the virtual environment based on the gesture movements; the guidance module is used to provide visual and auditory guidance information according to the business logic of the business layer; the three-dimensional exploded diagram module is used to provide a user's gesture movement ... The business logic of the business layer is used to show the structure and working principle of complex equipment to users through three-dimensional graphics; the eye tracking module is used to track the user's line of sight direction and focus, and based on the line of sight direction and focus, provide information and feedback corresponding to the business logic of the business layer; the monitoring and recording module is used to record the view of the exercise personnel and push the view of the exercise personnel to the server; the recognition function module is used to identify the objects and environment operated by the user through image recognition or object recognition technology, and provide real-time feedback and evaluation based on the objects and environment operated by the user and the business logic of the business layer; the audio and video streaming module is used to transmit the audio and video information during the exercise in real time.

[0015] In some implementations, the business layer includes positioning business logic, finger pointing business logic, UI business logic and processing service logic. The positioning business logic is used to process business logic related to user location, and the finger pointing business logic is used to process the interaction of users pointing to virtual objects through fingers or other input devices; the UI business logic serves as a bridge between the business layer and the user interface and is used to process business logic related to the user interface; the processing service logic is used to process the logic of software backend services and communication with remote servers.

[0016] In some implementations, the data layer includes a configuration file, a step configuration file, and a server-side instruction distribution module. The configuration file is used to store software configuration information, and the step configuration file is used to store configuration information of software operation steps or processes and define each stage in the nuclear accident emergency drill and corresponding operation information for each stage; the server-side instruction distribution module is used to receive instructions from the server and perform corresponding data operations according to the instructions.

[0017] In some implementations, the view layer includes a component reference module and a component update module. The component reference module is used to reference various user interface components to construct a user interaction interface; the component update module is used to update the displayed components when the user interacts with the software or the software status changes.

[0018] In some implementations, the communication layer includes a wireless local area network, a wired local area network, and a 5G network.

[0019] In some implementations, the server at the hardware layer is an AI server.

[0020] To achieve the above-mentioned purpose, the second embodiment of the present application proposes a nuclear emergency exercise method based on augmented reality, comprising:

[0021] Configure the nuclear emergency exercise main line and corresponding nuclear emergency exercise scenarios through the exercise control host;

[0022] Generate a simulated accident sequence based on the nuclear emergency exercise main line through a nuclear power plant simulator, and run the simulated accident units in the nuclear emergency exercise scenarios at each stage of the nuclear emergency exercise main line according to the simulated accident sequence; project the monitoring screen of the simulated accident unit onto the AR helmet worn by each emergency personnel for display;

[0023] Through the AR helmet, the augmented reality-based nuclear emergency exercise auxiliary system as described in any one of claims 1 to 7 is called to perform a virtual and real combination of the monitoring screen of the simulated accident unit and the corresponding nuclear accident scene model screen, so as to allow the user to immersively experience the nuclear emergency process.

[0024] In some implementations, the nuclear accident scenario model screen includes a faulty equipment scenario model screen, a different dose nuclear radiation area scenario model screen, and an earthquake and fire area scenario model screen.

[0025] In some implementations, the method further includes:

[0026] The emergency response of each emergency personnel is evaluated and scored through the surveillance video transmitted back to the server by the AR helmet.

[0027] The augmented reality-based nuclear emergency exercise auxiliary system and nuclear emergency exercise method provided by the present application realize augmented reality AR technology through the function layer, view layer, business layer, data layer, hardware layer and communication layer, establish possible scenario models in nuclear accidents in nuclear power plants, and insert these scenario models according to the purpose of the exercise in the exercise process with the simulated accident of the nuclear power plant simulator as the main line accident, so that emergency personnel can see the three-dimensional scene close to the real accident and conduct nuclear accident exercises in an immersive way. The system avoids the safety risks that may arise from the operation training of many high-risk scenarios, and can simulate the scene of the accident to the maximum extent, which is impossible for many real scene simulations, and also reduces the loss required to build the actual scene. The nuclear radiation environment atmosphere under the conditions of nuclear accidents is highly restored, and the exercise personnel can feel the impact of nuclear radiation on vision through helmet projection, thereby mobilizing a tense atmosphere; each character wearing an AR helmet can see both the real picture of the environment and equipment and the virtual 3D nuclear accident picture. At the same time, the emergency response action will be transmitted back to the server, and the server will analyze and respond to the nuclear accident picture to make the exercise more realistic. The exercise process will be recorded by the AR helmet and transmitted back to the server, which will facilitate the monitoring, recording, evaluation and scoring of the exercise process, thereby making a more reasonable evaluation of the exercise process.

[0028] Additional aspects and advantages of the present application will be given in part in the description below, and in part will become apparent from the description below, or will be learned through the practice of the present application. BRIEF DESCRIPTION OF THE DRAWINGS

[0029] The above and / or additional aspects and advantages of the present application will become apparent and easily understood from the following description of the embodiments in conjunction with the accompanying drawings, in which:

[0030] Figure 1 A structural block diagram of a nuclear emergency exercise auxiliary system based on augmented reality provided in an embodiment of the present application;

[0031] Figure 2 A flowchart of a nuclear emergency drill based on augmented reality provided in an embodiment of the present application;

[0032] Figure 3A flowchart of a nuclear emergency drill method based on augmented reality is provided as an example of the present application. DETAILED DESCRIPTION

[0033] Embodiments of the present application are described in detail below, and examples of the embodiments are shown in the accompanying drawings, wherein the same or similar reference numerals throughout represent the same or similar elements or elements having the same or similar functions. The embodiments described below with reference to the accompanying drawings are exemplary and are intended to be used to explain the present application, and should not be construed as limiting the present application.

[0034] After analysis, the existing exercise methods are based on hypothetical accident scenarios, and there are several problems: the emergency response actions of emergency organizations, earthquake disaster emergency response actions, equipment repair, emergency radiation monitoring of the site and off-site environment, medical rescue and other exercise processes cannot achieve immersive experience, and it is difficult to create a tense atmosphere of nuclear accidents. Nuclear radiation exists under nuclear accident conditions, and the radiation environment cannot be well simulated in on-site exercises. Simulator data and protective actions alone are not enough to mobilize a tense atmosphere. Emergency actions such as earthquake disasters, emergency radiation monitoring, and medical rescue are difficult to simulate and lack visual shock. Equipment repair is not realistic enough, and usually only the data status is confirmed on the simulator, without feedback on the status of the on-site equipment. Exercise monitoring records and evaluation scores rely on personnel, and the evaluation is subjective.

[0035] In order to solve at least one of the above problems, the embodiments of the present application provide a nuclear emergency drill auxiliary system and a nuclear emergency drill method based on augmented reality.

[0036] The following describes a nuclear emergency drill auxiliary system and a nuclear emergency drill method based on augmented reality according to an embodiment of the present application with reference to the accompanying drawings.

[0037] Figure 1 This is a structural block diagram of a nuclear emergency exercise auxiliary system based on augmented reality provided in an embodiment of the present application. Figure 1 As shown, the nuclear emergency exercise auxiliary system based on augmented reality includes: a function layer, a view layer, a business layer, a data layer, a hardware layer and a communication layer. Each layer is further described below.

[0038] First of all, it should be noted that the augmented reality-based nuclear emergency exercise auxiliary system of the embodiment of the present application is used to insert augmented reality AR accident scenarios into existing nuclear emergency exercises, allowing emergency personnel to immersively conduct nuclear accident exercises, and monitor and record the operations of the exercise personnel, so as to evaluate and score the exercise personnel based on the monitoring records; it can also realize point-to-point monitoring and communication of exercise personnel, guide and train novices, and effectively train team collaboration and rehearsal. The nuclear emergency exercise auxiliary system can build a three-dimensional model of the 1:1 restoration scene based on the collected emergency response actions, earthquake disaster emergency response actions, equipment repairs, emergency radiation monitoring of the site and off-site environment, medical rescue and other on-site scenarios, and obtain three-dimensional scenario models of emergency response actions, earthquake disaster emergency response actions, equipment repairs, emergency radiation monitoring of the site and off-site environment, medical rescue, etc., so that each character wearing an AR helmet can see both the real picture of the environment and equipment and the virtual 3D nuclear accident picture, realizing the combination of virtual and real.

[0039] The data layer defines the multiple stages and operations of each stage of the nuclear accident emergency drill process through configuration files; the data layer is also used to receive operation instructions from the server and perform corresponding data operations based on configuration files and operation instructions. The data layer is also called the data access layer or persistence layer, which is related to data storage and retrieval.

[0040] The business layer executes the corresponding business logic according to the data operations performed by the data layer; the business layer is used to deploy nuclear accident scenario models, which are three-dimensional scenario models restored based on multiple on-site scenarios. The same nuclear accident scenario model corresponds to one or more business logics. For example, the three-dimensional scenario models or animations of emergency response actions, earthquake disaster emergency response actions, equipment repair, on-site and off-site environmental emergency radiation monitoring, medical rescue, etc. are deployed in the business layer, and the corresponding nuclear accident scenario models are presented through business logic.

[0041] The view layer displays the screen information of the nuclear power plant simulator and the interactive nuclear accident scenario model during a nuclear accident to the user according to the business logic executed by the business layer. The view layer is mainly responsible for displaying information and interactive interfaces to users.

[0042] The functional layer provides a nuclear radiation environment and a virtual-real environment for nuclear accident emergency drills based on the business logic executed by the business layer, so that users can operate in a real environment and immersively experience the changes in the three-dimensional picture from the perspective. The functional layer is also called the software functional layer, which mainly provides a virtual, interactive operating environment. The functional layer can use augmented reality technology to establish a 3D scene that restores the three-dimensional scene of the faulty equipment and nuclear accident radiation environment (including earthquakes and fires) of the nuclear power plant 1:1. Emergency drill personnel wearing AR helmets can see the simulator screen pushed by the nuclear power plant simulator and the 3D accident scene screen constructed by this system. The functional layer can realize AR positioning tracking, gesture interaction control, line of sight tracking, information guidance and other functions through the business logic of the business layer.

[0043] The hardware layer includes servers, which are used to provide computing resources for the data layer, business layer, view layer, and function layer. In other words, the hardware layer refers to the physical devices and hardware resources that support the operation of the software. The function of the hardware layer is to provide the necessary infrastructure to ensure that the software can run and perform its functions effectively.

[0044] The communication layer is used to communicate with the exercise control host, nuclear power plant simulator, and AR helmet. The nuclear power plant simulator, the exercise control host, and the nuclear emergency exercise auxiliary system of this embodiment are connected through a local area network.

[0045] It should be noted that the purpose of the exercise control host is to control the direction of the exercise, and to realize the configuration of the exercise scenario design, process guidance and intervention, real-time monitoring and playback of the exercise process, evaluation and analysis, etc. It can issue instructions to the nuclear power plant simulator, and the nuclear power plant simulator simulates various equipment failures, and at the same time, the scenario assistance system projects the 3D model corresponding to the faulty equipment to the on-site nuclear emergency personnel (the model is a combination of the real and the virtual); for example, it pushes three-dimensional scene images such as earthquakes, fires, and medical rescue to the on-site exercise personnel, giving the on-site nuclear emergency personnel a visual impact; it can also mark the nuclear radiation area in the plant through the scenario assistance system, so that the emergency personnel can experience the nuclear radiation environment immersively.

[0046] It should be noted here that the nuclear power plant simulator is a special equipment used to simulate the normal operation and accident process of nuclear power plant units. It uses a computer as a working platform, simulates the physical, process and control processes of the nuclear power plant through simulation mathematical models, and uses a computer graphical interface as a simulation system with a human-machine interface. It is used to project the monitoring screen of the simulated accident unit onto the AR helmet of each emergency personnel to simulate the nuclear accident process. The nuclear power plant simulator simulates the accident sequence as the main line of the exercise, providing a reasonable basis for the processes of each stage of the exercise.

[0047] In some embodiments, the functional layer includes a spatial positioning module, a gesture tracking module, a guidance module, a three-dimensional exploded diagram module, an eye tracking module, a monitoring and recording module, an identification function module and an audio and video streaming module. The spatial positioning module is used to identify the orientation information of the real environment through high-precision spatial positioning technology, and realize the precise superposition of virtual information and the real environment based on the orientation information of the real environment. The gesture tracking module is used to track the user's gesture movements through sensors, and realize the interaction between the user and the virtual environment based on gesture movements; the guidance module is used to provide visual and auditory guidance information according to the business logic of the business layer; the three-dimensional exploded diagram module is used to show the structure and working principle of complex equipment to the user through three-dimensional graphics according to the business logic of the business layer; the eye tracking module is used to track the user's line of sight direction and focus, and provide information and feedback corresponding to the business logic of the business layer based on the line of sight direction and focus; the monitoring and recording module is used to record the view of the exercise personnel and push the view of the exercise personnel to the server; the identification function module is used to identify the objects and environment operated by the user through image recognition or object recognition technology, and provide real-time feedback and evaluation based on the objects and environment operated by the user and the business logic of the business layer; the audio and video streaming module is used to transmit the audio and video information during the exercise in real time.

[0048] Therefore, the spatial positioning module ensures that the virtual information is accurately superimposed on the user's actual environment through high-precision spatial positioning technology, providing an accurate sense of direction and position. The gesture tracking module uses sensors to track the user's gestures, allowing the user to interact with the virtual environment through natural body language, enhancing immersion and interactivity. The guidance module provides visual and auditory guidance during use, guiding users to make correct operations and decisions in the simulated environment, and improving the pertinence and effectiveness of the scenario. The three-dimensional exploded diagram module displays the structure and working principle of complex equipment through three-dimensional graphics, helping users to deeply understand the internal structure and operation process of the equipment. The eye tracking module tracks the user's line of sight and focus, enabling the software to provide corresponding information and feedback based on the user's gaze point, enhancing the personalization and responsiveness of the scenario. The monitoring and recording module pushes and records the perspective of the exercise personnel, and users can monitor and evaluate in real time through the background. The recognition function module provides real-time feedback and evaluation for the scenario by identifying the objects and environment operated by the user. The audio and video streaming module transmits audio and video information during the exercise in real time, facilitating remote and multi-person collaboration, and improving the flexibility and sharing of the scenario. Therefore, augmented reality technology allows users to interact with virtual information in real time through gestures, voice or touch, and can track the user's position, posture and other information in real time, and superimpose virtual information on the real world in real time.

[0049] In some embodiments, the business layer includes positioning business logic, finger pointing business logic, UI business logic and processing service logic. The positioning business logic is used to process business logic related to the user's position, and the finger pointing business logic is used to process the user's interaction with the virtual object by pointing to the virtual object with a finger or other input device; the UI business logic serves as a bridge between the business layer and the user interface and is used to process business logic related to the user interface; the processing service logic is used to process the logic of the software backend service and communication with the remote server.

[0050] Therefore, the business logic related to the user's position is processed through the positioning business logic, the interaction of the user pointing to the virtual object through the finger or other input device is processed through the finger pointing business logic, and the business logic related to the user interface is processed through the UI business logic, for example, responding to the user's interface operations, such as button clicks, sliding, etc., and converting these operations into the execution of business logic. It is also responsible for feeding back the results of the business logic to the user interface to update the display content. The logic of the software backend service is processed by the processing service logic, such as server requests, data processing, and response generation. In AR technology, processing service logic may involve communication with a remote server to obtain the latest exercise data and synchronize exercise progress.

[0051] In some embodiments, the data layer includes a configuration file, a step configuration file and a server-side instruction distribution module. The configuration file is used to store the configuration information of the software. The step configuration file is used to store the configuration information of the steps or processes of the software operations and to define the various stages in the nuclear accident emergency drill process and the corresponding operation information of each stage; the server-side instruction distribution module is used to receive instructions from the server and perform corresponding data operations according to the instructions.

[0052] Exemplarily, the configuration file stores the configuration information of the software, such as database connection strings, API keys, function switches, etc. This configuration information is usually loaded when the software starts and is managed by the data layer at runtime. The step configuration file may contain the configuration of the steps or processes of the software operation. For example, in an exercise scenario, the step configuration file may define the various stages and corresponding operations in the exercise process. The server-side instruction distribution module may involve receiving instructions from the server and performing corresponding data operations based on these instructions. For example, the server may send instructions to update database records, or request the retrieval of specific data.

[0053] In some embodiments, the view layer includes a component reference module and a component update module. The component reference module is used to reference various user interface components to build a user interaction interface; the component update module is used to update the displayed components when the user interacts with the software or the software status changes.

[0054] For example, the view layer needs to reference various user interface components, such as buttons, icons, text boxes, etc., in order to build an interface for user interaction. These components allow users to interact with the software through visual elements and perform operations such as clicking and sliding. When the user interacts with the software or the software state changes, the view layer is responsible for updating the displayed components through the component update module. For example, when the user completes an operation or the exercise progress is updated, the view layer will reflect these changes to provide real-time feedback.

[0055] In some embodiments, the communication layer includes wireless LAN, wired LAN and 5G network, and wireless, wired LAN or 5G network is used to ensure that the server, AR helmet (each user client) are in the same network to facilitate two-way data transmission.

[0056] In some embodiments, the server at the hardware layer is an AI server. AI servers are high-performance computers designed specifically for artificial intelligence applications. They are usually equipped with powerful GPUs or other dedicated AI acceleration chips to provide the necessary computing power. The emergency response in the nuclear emergency drill can be recorded through a helmet and transmitted back to the AI ​​server. The AI ​​server will analyze and give a corresponding response to the 3D nuclear accident screen based on the operation of the virtual and real screen, allowing emergency personnel to immersively experience the nuclear emergency process.

[0057] The system of this embodiment uses augmented reality AR technology to establish scenario models such as possible faulty equipment in nuclear power plant nuclear accidents, nuclear radiation areas of different doses, earthquake and fire areas, etc., and superimposes the images projected by the AR helmet and the nuclear power plant simulator to achieve a combination of virtual and real. For example, in existing exercises, the exercisers cannot visually feel the impact of radiation. Through augmented reality technology, after adding a virtual emergency nuclear radiation area, the exercisers can feel the visual impact of nuclear radiation through helmet projection.

[0058] It can be seen that the nuclear emergency drill auxiliary system of this embodiment adopts a modular design, supports distributed multi-level deployment, supports functional WIFI or 5G deployment, and supports the integration of software function layer, view layer, business layer, data layer, hardware layer, etc.

[0059] The augmented reality-based nuclear emergency drill auxiliary system of the embodiment of the present application implements augmented reality AR technology through the function layer, view layer, business layer, data layer, hardware layer and communication layer, establishes possible scenario models in nuclear accidents in nuclear power plants, and inserts these scenario models according to the purpose of the exercise in the process of exercises with simulated accidents of nuclear power plant simulators as the main line of accidents, so that emergency personnel can see three-dimensional scenarios close to real accidents and conduct nuclear accident exercises in an immersive manner. The system avoids the safety risks that may arise from many high-risk scenario operation trainings, and can simulate the scenarios of accidents to the maximum extent, which is impossible for many real-life scenario simulations, and also reduces the loss required to build actual scenarios. It can be applied to personnel training in fields such as nuclear emergency and conventional emergency. Disaster prevention and psychological scenario immersive training experience.

[0060] Based on the above embodiments, Figure 2 A flowchart of a nuclear emergency drill method based on augmented reality provided in an embodiment of the present application is shown in FIG. Figure 2 As shown, the nuclear emergency exercise method based on augmented reality includes the following steps:

[0061] Step 101, configuring the nuclear emergency exercise main line and the corresponding nuclear emergency exercise scenario through the exercise control host.

[0062] Step 102, a simulated accident sequence is generated based on the main line of the nuclear emergency exercise by a nuclear power plant simulator, and the simulated accident units in the nuclear emergency exercise scenarios of each stage of the main line of the nuclear emergency exercise are run according to the simulated accident sequence; the monitoring screen of the simulated accident unit is projected onto the AR helmet worn by each emergency personnel for display.

[0063] Step 103, through the AR helmet, call the augmented reality-based nuclear emergency exercise auxiliary system of the above embodiment to simulate the monitoring screen of the accident unit and the corresponding nuclear accident scene model screen, so as to allow the user to experience the nuclear emergency process immersively.

[0064] Exemplarily, the nuclear accident scenario model screen includes a faulty equipment scenario model screen, a scenario model screen of areas with different doses of nuclear radiation, a scenario model screen of areas with earthquakes and fires, and the like.

[0065] In some embodiments, the method can also evaluate and score the emergency response of each emergency personnel through the surveillance video transmitted back to the server by the AR helmet.

[0066] It can be understood that in nuclear emergency drills, the emergency response and operation screens of each emergency personnel can be recorded through AR helmets and sent back to the server. The server will score the emergency personnel's operations based on the emergency personnel's operations on the virtual and real screens. At the same time, through the returned video, the exercise control host can watch the operation screens of each emergency role, and can make point-to-point calls or supervise and guide the emergency personnel, which is convenient for monitoring, recording, evaluating and scoring the exercise process.

[0067] The nuclear emergency exercise method based on augmented reality in the embodiment of the present application can allow emergency personnel to immersively experience the exercise accident scenario, and feel the emergency response actions of the emergency organization, earthquake disaster emergency response actions, equipment repair, emergency radiation monitoring of the site and off-site environment, medical rescue and other exercise processes restored in a 1:1 manner. The nuclear radiation environment atmosphere under the conditions of nuclear accidents is highly restored, and the exercise personnel can feel the visual impact of nuclear radiation through helmet projection, thereby mobilizing a tense atmosphere. It can highly restore the on-site scenes of emergency operations such as earthquakes and fires, emergency radiation monitoring, and medical rescue, and give people a visual impact through a 1:1 virtual environment. The exercise environment and equipment status are combined in a virtual and real way. Each character wearing an AR helmet can see both the real pictures of the environment and equipment and the virtual 3D nuclear accident pictures. At the same time, the emergency response actions will also be transmitted back to the server, and the server will analyze and respond to the nuclear accident pictures to make the exercise more realistic.

[0068] The exercise process will be recorded by the AR helmet and transmitted back to the server, which will facilitate the monitoring, recording, evaluation and scoring of the exercise process, thereby making a more reasonable evaluation of the exercise process.

[0069] In order to clearly illustrate the above embodiment, specific examples are now provided for illustration. Figure 3 A flowchart of a nuclear emergency drill method based on augmented reality is provided as an example of the present application.

[0070] The exercise control host configures the exercise scenario according to the instructions and conducts guidance and intervention during the exercise. The simulator runs the simulated accident according to the instructions and forwards the control instructions to the server. The server receives the exercise control instructions and analyzes the exercise script and screen; the data layer receives the instructions from the server and performs corresponding data operations according to these instructions; the business layer processes the business logic and uses the view layer to show the user the screen information of the unit process system at the time of the accident and the three-dimensional accident scenario that can be interacted with; the function layer is used to provide the exercise nuclear radiation environment and the real virtual and real combination environment, operate in the real environment, and immerse in the three-dimensional picture changes from the perspective. Emergency personnel operate the virtual 3D scene screen, interact with the three-dimensional screen in expected response, and monitor and record the interactive screen. Evaluators can evaluate and score the responses in the first-person perspective screen of the AR helmet of each emergency exercise participant (recorded and sent back to the server).

[0071] In the description of the aforementioned embodiments, the description with reference to the terms "one embodiment", "some embodiments", "example", "specific example", or "some examples" etc. means that the specific features, structures, materials or characteristics described in conjunction with the embodiment or example are included in at least one embodiment or example of the present application. In this specification, the schematic representations of the above terms do not necessarily refer to the same embodiment or example. Moreover, the specific features, structures, materials or characteristics described may be combined in any one or more embodiments or examples in a suitable manner. In addition, those skilled in the art may combine and combine the different embodiments or examples described in this specification and the features of the different embodiments or examples, without contradiction.

[0072] In addition, the terms "first" and "second" are used for descriptive purposes only and should not be understood as indicating or implying relative importance or implicitly indicating the number of the indicated technical features. Therefore, the features defined as "first" and "second" may explicitly or implicitly include at least one of the features. In the description of this application, the meaning of "plurality" is at least two, such as two, three, etc., unless otherwise clearly and specifically defined.

[0073] Any process or method description in a flowchart or otherwise described herein may be understood to represent a module, fragment or portion of code comprising one or more executable instructions for implementing the steps of a custom logical function or process, and the scope of the preferred embodiments of the present application includes alternative implementations in which functions may not be performed in the order shown or discussed, including performing functions in a substantially simultaneous manner or in the reverse order depending on the functions involved, which should be understood by technicians in the technical field to which the embodiments of the present application belong.

[0074] The logic and / or steps represented in the flowchart or otherwise described herein, for example, can be considered as an ordered list of executable instructions for implementing logical functions, and can be embodied in any computer-readable medium for use by an instruction execution system, device or apparatus (such as a computer-based system, a system including a processor, or other system that can fetch instructions from an instruction execution system, device or apparatus and execute the instructions), or in combination with these instruction execution systems, devices or apparatuses. For the purpose of this specification, "computer-readable medium" can be any device that can contain, store, communicate, propagate or transmit a program for use by an instruction execution system, device or apparatus, or in combination with these instruction execution systems, devices or apparatuses. More specific examples of computer-readable media (a non-exhaustive list) include the following: an electrical connection with one or more wires (electronic device), a portable computer disk box (magnetic device), a random access memory (RAM), a read-only memory (ROM), an erasable and programmable read-only memory (EPROM or flash memory), a fiber optic device, and a portable compact disk read-only memory (CDROM). In addition, the computer-readable medium may even be paper or other suitable medium on which the program is printed, since the program may be obtained electronically, for example, by optically scanning the paper or other medium and then editing, interpreting or processing in other suitable ways if necessary, and then stored in a computer memory.

[0075] It should be understood that the various parts of the present application can be implemented by hardware, software, firmware or a combination thereof. In the above-mentioned embodiments, multiple steps or methods can be implemented by software or firmware stored in a memory and executed by a suitable instruction execution system. For example, if implemented by hardware, as in another embodiment, it can be implemented by any one of the following technologies known in the art or their combination: a discrete logic circuit having a logic gate circuit for implementing a logic function for a data signal, a dedicated integrated circuit having a suitable combination of logic gate circuits, a programmable gate array (PGA), a field programmable gate array (FPGA), etc.

[0076] A person skilled in the art may understand that all or part of the steps in the method for implementing the above-mentioned embodiment may be completed by instructing related hardware through a program, and the program may be stored in a computer-readable storage medium, which, when executed, includes one or a combination of the steps of the method embodiment.

[0077] In addition, each functional unit in each embodiment of the present application may be integrated into a processing module, or each unit may exist physically separately, or two or more units may be integrated into one module. The above-mentioned integrated module may be implemented in the form of hardware or in the form of a software functional module. If the integrated module is implemented in the form of a software functional module and sold or used as an independent product, it may also be stored in a computer-readable storage medium.

[0078] The storage medium mentioned above may be a read-only memory, a magnetic disk or an optical disk, etc. Although the embodiments of the present application have been shown and described above, it can be understood that the above embodiments are exemplary and cannot be understood as limiting the present application. A person of ordinary skill in the art may change, modify, replace and modify the above embodiments within the scope of the present application.

Claims

1. A nuclear emergency exercise auxiliary system based on augmented reality, characterized in that: include: A data layer, wherein the data layer defines the multiple stages and operations of each stage included in the nuclear accident emergency exercise process through a configuration file; the data layer is also used to receive an operation instruction from a server, and perform corresponding data operations based on the configuration file and the operation instruction; A business layer, wherein the business layer executes corresponding business logic according to the data operation executed by the data layer; the business layer is used to deploy a nuclear accident scenario model, wherein the nuclear accident scenario model is a three-dimensional scenario model restored according to a variety of on-site scenarios, and the same nuclear accident scenario model corresponds to one or more business logics; A view layer, wherein the view layer displays to the user the screen information of the nuclear power plant simulator during a nuclear accident and an interactive nuclear accident scenario model according to the business logic executed by the business layer; A functional layer, wherein the functional layer provides a nuclear radiation environment and a virtual-real combined environment for the nuclear accident emergency drill according to the business logic executed by the business layer, so that the user can operate in a real environment and immersively experience changes in a three-dimensional image from a viewing angle; A hardware layer, the hardware layer includes a server, and the server is used to provide computing resources for the function implementation of the data layer, business layer, view layer and function layer; The communication layer is used to communicate with the exercise guidance and control host, the nuclear power plant simulator, and the AR helmet.

2. The system according to claim 1, characterized in that The functional layer includes a spatial positioning module, a gesture tracking module, a guidance module, a three-dimensional exploded diagram module, an eye tracking module, a monitoring and recording module, an identification function module and an audio and video streaming module. The spatial positioning module is used to identify the position information of the real environment through high-precision spatial positioning technology, and realize the precise superposition of virtual information and the real environment based on the position information of the real environment; the gesture tracking module is used to track the user's gesture movements through sensors, and realize the interaction between the user and the virtual environment based on the gesture movements; The guidance module is used to provide visual and auditory guidance information according to the business logic of the business layer; The three-dimensional exploded diagram module is used to show the structure and working principle of complex equipment to the user through three-dimensional graphics according to the business logic of the business layer; the eye tracking module is used to track the user's line of sight direction and focus, and provide information and feedback corresponding to the business logic of the business layer based on the line of sight direction and focus; the monitoring and recording module is used to record the view of the exercise personnel and push the view of the exercise personnel to the server; The recognition function module is used to identify the objects and environment of user operations through image recognition or object recognition technology, and provide real-time feedback and evaluation based on the objects and environment of user operations and the business logic of the business layer; the audio and video streaming module is used to transmit audio and video information during the exercise in real time.

3. The system according to claim 1, characterized in that The business layer includes positioning business logic, finger pointing business logic, UI business logic and processing service logic. The positioning business logic is used to process business logic related to user location, and the finger pointing business logic is used to process the interaction of users pointing to virtual objects through fingers or other input devices; the UI business logic serves as a bridge between the business layer and the user interface and is used to process business logic related to the user interface; the processing service logic is used to process the logic of software backend services and communication with remote servers.

4. The system according to claim 1, characterized in that The data layer includes a configuration file, a step configuration file and a server-side instruction distribution module. The configuration file is used to store the configuration information of the software. The step configuration file is used to store the configuration information of the steps or processes of the software operation and define the various stages in the nuclear accident emergency drill and the corresponding operation information of each stage; the server-side instruction distribution module is used to receive instructions from the server and perform corresponding data operations according to the instructions.

5. The system according to claim 1, characterized in that The view layer includes a component reference module and a component update module. The component reference module is used to reference various user interface components to construct a user interaction interface; the component update module is used to update the displayed components when the user interacts with the software or the software status changes.

6. The system according to claim 1, characterized in that The communication layer includes wireless LAN, wired LAN and 5G network.

7. The system according to claim 1, characterized in that The server at the hardware layer is an AI server.

8. A nuclear emergency exercise method based on augmented reality, characterized in that: include: Configure the nuclear emergency exercise main line and corresponding nuclear emergency exercise scenarios through the exercise control host; Generate a simulated accident sequence based on the nuclear emergency exercise main line through a nuclear power plant simulator, and run the simulated accident units in the nuclear emergency exercise scenarios at each stage of the nuclear emergency exercise main line according to the simulated accident sequence; project the monitoring screen of the simulated accident unit onto the AR helmet worn by each emergency personnel for display; Through the AR helmet, the augmented reality-based nuclear emergency exercise auxiliary system as described in any one of claims 1 to 7 is called to perform a virtual and real combination of the monitoring screen of the simulated accident unit and the corresponding nuclear accident scene model screen, so as to allow the user to immersively experience the nuclear emergency process.

9. The method according to claim 8, characterized in that The nuclear accident scenario model screen includes a faulty equipment scenario model screen, a different dose nuclear radiation area scenario model screen, and an earthquake and fire area scenario model screen.

10. The method according to claim 8, characterized in that The method further comprises: The emergency response of each emergency personnel is evaluated and scored through the surveillance video transmitted back to the server by the AR helmet.

Images