Control simulation system, using augmented reality, for nuclear power plant facility control panel

Abstract

The present invention provides a control simulation system for a nuclear power plant facility, wherein an operator can be trained to control an emergency diesel generator (EDG) installed in a nuclear power plant by using a control panel model and augmented reality regarding control panel manipulation. According to the present invention, the control simulation system for a nuclear power plant facility comprises: a control part provided to perform control training on a nuclear power plant facility; a utilization part comprising a processing unit and a display unit, the processing unit generating augmented reality related to guidance about the manipulation of the control part, and the display unit being provided to photograph the control part, acquire an image of the control part, recognize the control part from the image, receive the augmented reality from the processing unit to map the augmented reality to the recognized control part, and output the mapped augmented reality; and a monitoring part which generates a simulation measurement value of the nuclear power plant facility on the basis of manipulation data generated by manipulating the control part, and provides the simulation measurement value and a normal measurement value that is acquired when the nuclear power plant facility operates normally. Accordingly, the present invention has the effect of enabling pre-training on control panel manipulation, thereby enhancing the operator's operational ability.

Description

Control simulation system for nuclear power plant control panels using augmented reality

[0001] The present invention relates to a control simulation system for a nuclear power plant control panel using augmented reality, and more specifically, to a control simulation system for a nuclear power plant control panel using augmented reality that implements a control simulation system for nuclear power plant using augmented reality.

[0002] Recently, nuclear power plants have been using virtual reality (VR)-based nuclear power plant simulations to train workers. The prior art for this type of nuclear power plant simulation is disclosed in Korean Patent No. 10-1893850 (Fire Situation Simulation Device in a Nuclear Power Plant Main Control Room and Environmental Condition Learning Method Therefor, August 27, 2018). This registered invention simulates a fire situation in a nuclear power plant main control room to enhance workers' work skills.

[0003] Meanwhile, nuclear power plants are equipped with emergency diesel generators (EDGs) to supply emergency power to safety equipment in the event of a power loss. The EDGs are crucial for preventing nuclear accidents by providing timely power to safety equipment in emergency situations.

[0004] Here, the emergency diesel generator is controlled by the operator, and high operational capability is required to prevent major accidents. However, the lack of a simulation system for emergency diesel generators previously led to training relying on written documents or operator experience, resulting in low training efficiency.

[0005] The purpose of the present invention is to provide a control simulation system for a nuclear power plant control panel using augmented reality, which enables operator control training for the control panel of an emergency diesel generator (EDG) installed in a nuclear power plant using a control panel model and augmented reality regarding control panel operation.

[0006] The control simulation system of a nuclear power plant control panel using augmented reality according to the present invention includes a control unit for experiencing control of a nuclear power plant, a processing unit for generating augmented reality for operation guidance of the control unit, a utilization unit for photographing the control unit, a display unit for obtaining an image of the control unit, recognizing the control unit from the image, receiving the augmented reality from the processing unit, and mapping the augmented reality to the recognized control unit and outputting it, and a monitoring unit for generating a virtual measurement value of the nuclear power plant based on operation data regarding the operation of the control unit and providing a normal measurement value acquired when the nuclear power plant is operating normally and the virtual measurement value.

[0007] The above monitoring unit can generate the virtual measurement value by performing a virtual simulation of the operation of the nuclear power plant facility based on the above operation data.

[0008] The above augmented reality can be generated to guide different operations of the control unit in each procedure of the control procedure for controlling the nuclear power plant equipment.

[0009] The method further includes a storage unit that stores a plurality of augmented reality data that are arranged to generate augmented reality for different operations in each of the above procedures, and the utilization unit can receive a selection signal in which a user selects one of the above control procedures and generate the augmented reality using one of the plurality of augmented reality data based on the selection signal.

[0010] The above-mentioned utilization unit can output a target procedure selection area in which a plurality of procedure selection buttons are provided so that the user can select a target procedure for performing control training among the above-mentioned control procedures, a procedure description area in which a description of the target procedure is output, and an operation description area in which a description of an operation required of the control unit in the target procedure is output.

[0011] The control unit may include a plurality of simulated control tools provided to perform control training of the nuclear power plant equipment, and a plurality of recognition marks individually formed for each simulated control tool so that the display unit recognizes each simulated control tool.

[0012] The above monitoring unit can receive the image from the display unit and output the image.

[0013] Figure 1 is a configuration diagram showing a nuclear power plant control panel control simulation system using augmented reality according to the present embodiment.

[0014] Fig. 2 is a perspective view showing the control unit of a nuclear power plant control panel control simulation system using augmented reality according to the present embodiment.

[0015] Figure 3 is a configuration diagram showing the storage unit of a nuclear power plant control panel control simulation system using augmented reality according to this embodiment.

[0016] Figure 4 is a configuration diagram showing the utilization part of a nuclear power plant control panel control simulation system using augmented reality according to the present embodiment.

[0017] Fig. 5 is a configuration diagram showing a display unit of a nuclear power plant control panel control simulation system using augmented reality according to the present embodiment.

[0018] Figure 6 is a flowchart showing the data processing process of the display unit, input unit, and monitoring unit of the nuclear power plant control panel control simulation system using augmented reality according to the present embodiment.

[0019] Figure 7 is a conceptual diagram showing a screen that outputs virtual measurement values ​​and normal measurement values ​​of a monitoring unit of a nuclear power plant control panel control simulation system using augmented reality according to this embodiment.

[0020] Figure 8 is a conceptual diagram showing a screen for outputting a record report of a monitoring unit of a nuclear power plant control panel control simulation system using augmented reality according to this embodiment.

[0021] Figure 9 is a flowchart showing a simulation method of control panel control using a nuclear power plant control panel control simulation system using augmented reality according to the present embodiment.

[0022] Fig. 10 is a conceptual diagram showing the display of a display unit of a nuclear power plant control panel control simulation system using augmented reality according to the present embodiment.

[0023] Hereinafter, embodiments of the present invention will be described in detail with reference to the attached drawings. However, the present embodiments are not limited to the embodiments disclosed below and may be implemented in various forms. These embodiments are provided only to ensure that the disclosure of the present invention is complete and to fully inform those skilled in the art of the scope of the invention. The shapes of elements in the drawings may be exaggerated for clearer explanation, and elements indicated by the same reference numerals in the drawings represent the same elements.

[0024] Figure 1 is a configuration diagram showing a nuclear power plant control panel control simulation system using augmented reality according to the present embodiment.

[0025] As illustrated in Fig. 1, the augmented reality-based nuclear power plant control panel control simulation system (1000, hereinafter referred to as the "simulation system") according to the present embodiment enables simulation of the control of a control panel used to control nuclear power plant facilities based on augmented reality. Here, the nuclear power plant facilities include an emergency diesel generator (EDG) installed in the nuclear power plant. However, there is no limitation on the nuclear power plant facilities.

[0026] The simulation system (1000) can generate augmented reality related to the operation of a control panel. For example, the simulation system (1000) can generate augmented reality related to dials or switches provided on the control panel and augmented reality guiding the operation of the dials or switches. The augmented reality may relate to different operations of the control panel for controlling nuclear power plant facilities in the control procedures of the nuclear power plant facilities.

[0027] The simulation system (1000) allows workers to experience a virtual simulation of control panel operation through augmented reality. Furthermore, the simulation system (1000) can provide information about the worker's experience status to other workers, i.e., supervisors who supervise the worker's experience.

[0028] For example, a simulation system (1000) may include a control unit (100), a storage unit (200), a utilization unit (300), and a monitoring unit (400).

[0029] First, the control unit (100) creates an environment in which the operator performs virtual operations while experiencing the simulation. The control unit (100) can be linked to the augmented reality described above for the operator's experience. This control unit (100) can be designed to mimic a control panel used in the operation of nuclear power plant facilities.

[0030] Meanwhile, the storage unit (200) stores data required by the operator when performing a simulation. The storage unit (200) can provide the stored data to the utilization unit (300) and the monitoring unit (400). A detailed description of the storage unit (200) will be provided below.

[0031] Meanwhile, the utilization unit (300) allows the worker to experience a virtual simulation of the operation of the control panel. The utilization unit (300) can implement augmented reality based on data provided from the storage unit (200). In addition, the utilization unit (300) can allow the worker to experience augmented reality, and can generate operation data regarding the operation of the control panel during the process of the worker experiencing augmented reality. In addition, the utilization unit (300) can obtain the process experienced by the worker in the form of images. In addition, the utilization unit (300) can provide the operation data and the image of the worker's experience to the monitoring unit (400).

[0032] Meanwhile, the monitoring unit (400) may be configured to output data provided from the storage unit (200) and the utilization unit (300). The monitoring unit (400) may provide information regarding the worker's experience to a supervisor who supervises the worker's experience. For example, the monitoring unit (400) may be provided in a control room environment separate from the training site where the utilization unit (300) is provided. In other words, the monitoring unit (400) may be provided in a space separate from the space where the utilization unit (300) is provided. However, this is for the purpose of explaining the present embodiment, and there is no limitation on the space where the utilization unit (300) and the monitoring unit (400) are provided.

[0033] The monitoring unit (400) can perform a simulation of the operation of nuclear power plant facilities based on the provided operation data. In other words, the monitoring unit (400) can perform a simulation of the operation of nuclear power plant facilities based on the control panel operations experienced by the operator. Through this, the monitoring unit (400) can generate virtual measurement values ​​for nuclear power plant facilities.

[0034] Meanwhile, the storage unit (200), utilization unit (300), and monitoring unit (400) can each transmit and receive data through the nuclear power plant network (10) provided at the nuclear power plant. For example, the nuclear power plant network (10) can be provided with a wireless data transmission system (Wi-Fi; Wireless Fidelity) or 4th generation mobile communication technology (LTE; Long-Term Evolution). A security program can be provided in the nuclear power plant network (10) to prevent data leakage during data transmission and reception.

[0035] Meanwhile, the configuration of the control unit (100), storage unit (200), and utilization unit (300) described above will be described in detail below with reference to the attached drawings.

[0036] Fig. 2 is a perspective view showing the control unit of a nuclear power plant control panel control simulation system using augmented reality according to the present embodiment.

[0037] As illustrated in FIG. 2, the control unit (100) of the simulation system (1000) according to the present embodiment may include a simulated control tool (101) and a recognition mark (103). The simulated control tool (101) may be a replica of an actual control tool, such as a dial and a button of an actual control panel. And the recognition mark (103) may be formed adjacent to each simulated control tool (101). The recognition mark (103) may be provided so that the utilization unit (300) recognizes each simulated control tool (101) during the process of the utilization unit (300) implementing augmented reality. For example, the recognition mark (103) may be provided as a unique code for each simulated control tool (101).

[0038] Meanwhile, the storage unit (200) of the simulation system (1000) according to the present embodiment will be described below with reference to FIG. 3.

[0039] Figure 3 is a configuration diagram showing the storage unit of a nuclear power plant control panel control simulation system using augmented reality according to this embodiment.

[0040] As illustrated in FIG. 3, the storage unit (200) of the simulation system (1000) according to the present embodiment can store facility information (200a), augmented reality data (200b), and a record report (200c).

[0041] The facility information (200a) may include various types of information regarding nuclear power plant facilities. For example, the facility information (200a) may include drawing information, procedure information, and normal measurement values. The drawing information may depict nuclear power plant facilities and their constituent components. The procedure information may be information regarding control procedures required for the operation of nuclear power plant facilities. The procedure information may include information regarding the control sequence to be performed in each control procedure and the operation of the control panel. The procedure information may be generated based on the procedure manual used in the nuclear power plant. The normal measurement values ​​may be about the temperature, pressure, and voltage obtained from each component of the nuclear power plant facilities when the nuclear power plant facilities are operating normally.

[0042] Augmented reality data (200b) may be pre-generated to generate augmented reality. Here, the augmented reality may guide the operation of the control unit (100). The augmented reality may be a description of the operation requested from the user by the control unit (100). For example, the augmented reality may express the operation description for the simulated control tool (101) in the form of text or symbols such as arrows. Such augmented reality data (200b) may be individually generated for each augmented reality according to the operation requested in the control procedure and may be provided in multiple pieces.

[0043] The record report (200c) may be designed to record information acquired through the experience of the worker during the process of operation.

[0044] Meanwhile, below, the utilization part (300) of the simulation system (1000) according to the present embodiment will be described with reference to FIGS. 4 and 5.

[0045] FIG. 4 is a configuration diagram showing the utilization part of a nuclear power plant control panel control simulation system using augmented reality according to the present embodiment, and FIG. 5 is a configuration diagram showing the display unit of a nuclear power plant control panel control simulation system using augmented reality according to the present embodiment.

[0046] As illustrated in FIGS. 4 and 5, the utilization unit (300) of the nuclear power plant control panel control simulation system (1000) using augmented reality according to the present embodiment may include a storage unit (310), a processing unit (320), a display unit (330), and an input unit (340).

[0047] First, the storage unit (310) may be a storage medium provided separately from the aforementioned storage unit (200). The storage unit (310) may store operational data and experience images generated during the worker's experience. Furthermore, the storage unit (310) may store a portion of the data stored by the storage unit (200) so that the worker can perform the experience even when the nuclear power plant network (10) is unable to transmit or receive data with the utilization unit (300).

[0048] The processing unit (320) is configured to perform data processing, data calling, and data provision. The processing unit (320) can call augmented reality data (200c) from the storage unit (200). For example, the processing unit (320) can perform the call based on a user selection signal provided from the input unit (340). In addition, the processing unit (320) can generate augmented reality using the called augmented reality data (200c). The processing unit (320) can provide the generated augmented reality to the display unit (330).

[0049] The display unit (330) outputs the provided augmented reality so that it can be mapped to the simulation control tool (101) of the control unit (100). For example, the display unit (330) may be provided as an HMD (Head Mounted Display). The display unit (330) can be worn by a worker.

[0050] For example, the display unit (330) may include a display (331), a camera (333), a sensor module (335), and a processing module (337).

[0051] The display (331) is made of a transparent material. The display (331) can be positioned in front of the operator's field of vision when the operator wears the display unit (330).

[0052] The camera (333) may be configured to capture the front of the worker. When the worker performs the experience, the camera (333) may capture the front of the worker to obtain an image of the experience.

[0053] The sensor module (335) can collect information about the surrounding environment and the worker. For example, the sensor module (335) can include a camera sensor, a depth sensor, an acceleration sensor, a gyro sensor, and a geomagnetic sensor. When the worker is positioned in front of the control unit (100) while wearing the display unit (330), the sensor module (335) can collect information about the control unit (100) and the surrounding environment of the control unit (100). In addition, the sensor module (335) can collect information about the eye movements and hand gestures of the display unit (330).

[0054] The processing module (337) can recognize the status of the control unit (100) and the operator using the information collected by the sensor module (335). For example, the processing module (337) can recognize the shape of the control unit (100) and recognize the recognition mark (103) provided on the control unit (100) based on optical character recognition (OCR). In addition, the processing module (337) can recognize the user's gaze and hand gestures through a predetermined analysis. Through this, the processing module (337) can output the augmented reality provided from the processing unit (320) so that it is linked to the control unit (100) from the operator's viewpoint. In addition, the processing module (337) can detect the operation and generate operation data when the operator performs the control panel operation experience through augmented reality.

[0055] For example, the manipulation data may be data indicating that a dial is rotated or a switch is turned ON / OFF.

[0056] Meanwhile, the input unit (340) is provided so that the worker can input various information during the experience. Furthermore, the input unit (340) can provide the information input by the worker to the processing unit (320). Here, the input information may be information for selecting a control procedure to be experienced by the worker. Through this, the processing unit (320) can call up augmented reality data (200b) regarding the selected control procedure.

[0057] Additionally, the input unit (340) can call up a record report (200c) from the storage unit (200) or the storage unit (310). And the input unit (340) can output a record report (200c) so that the worker can write the record report (200c).

[0058] Meanwhile, the operation of the display unit (330), input unit (340), and monitoring unit (400) of the system (1000) in the simulation according to the present embodiment will be described below with reference to FIGS. 6 to 9.

[0059] Fig. 6 is a flowchart showing the data processing process of the display unit, input unit, and monitoring unit of the nuclear power plant control panel control simulation system using augmented reality according to the present embodiment, and Fig. 7 is a conceptual diagram showing a screen for outputting virtual measurement values ​​and normal measurement values ​​of the monitoring unit of the nuclear power plant control panel control simulation system using augmented reality according to the present embodiment. And Fig. 8 is a conceptual diagram showing a screen for outputting a record report of the monitoring unit of the nuclear power plant control panel control simulation system using augmented reality according to the present embodiment.

[0060] As illustrated in FIGS. 6 to 8, the display unit (330) and the input unit (330) according to the present embodiment can provide operation data, experience images, and a record report (200c) to the monitoring unit (400).

[0061] As described above, the monitoring unit (400) can perform a simulation of the operation of nuclear power plant facilities based on the operation data, and can generate virtual measurement values ​​through the simulation. For example, the monitoring unit (400) can generate virtual measurement values ​​for components that constitute nuclear power plant facilities. In addition, the monitoring unit (400) can generate the generated virtual measurement values ​​in the form of a graph so as to be linked to normal measurement values. Accordingly, the monitoring unit (400) can output the virtual measurement values ​​and normal measurement values ​​generated in the form of a graph (P110) and provide them to the supervisor (see FIG. 7).

[0062] In addition, the monitoring unit (400) can output the record report (200c) received from the input unit (340) and provide it to the supervisor. Here, referring to FIG. 8, the monitoring unit (400) can output an experience date selection area (P210) and a record report output area (P220). The experience date selection area (P210) is provided with a plurality of buttons for selecting an experience date. The monitoring unit (400) can output the worker's record report (200c) of the selected experience date by allowing the supervisor to select the experience date through the experience date button (see FIG. 8).

[0063] Meanwhile, below, a method for simulating control panel control of an operator using a simulation system according to the present embodiment will be described with reference to FIGS. 9 and 10.

[0064] FIG. 9 is a flowchart showing a simulation method of control panel control using a nuclear power plant control panel control simulation system using augmented reality according to the present embodiment, and FIG. 10 is a conceptual diagram showing a display of a display unit of a nuclear power plant control panel control simulation system using augmented reality according to the present embodiment.

[0065] As illustrated in FIGS. 9 and 10, the simulation system (1000) according to the present embodiment allows an operator to experience a simulation related to control panel control through an augmented reality implementation step (S100), an operator experience step (S200), and an experience evaluation step (S300).

[0066] First, in the augmented reality implementation step (S100), a worker can be positioned in front of the control unit (100) while wearing a display unit (330) and holding an input unit (340). The worker can select a procedure to experience among the control procedures of the nuclear power plant facility through the display unit (330) or the input unit (340) for the operation of the nuclear power plant facility.

[0067] For example, the display unit (330) may output a screen requesting a selection during the process of selecting a procedure to be experienced by the worker. Here, the display unit (330) may output a control procedure selection area (P310), a control procedure description area (P320), an operation description area (P330), and an augmented reality implementation area (P340) (see FIG. 10).

[0068] In the control procedure selection area (P310), a procedure selection button (P311) is provided to allow the operator to select multiple procedures to be performed among the control procedures of the nuclear power plant equipment. In the control procedure description area (P320), a description of the procedure selected by the operator is output. In addition, in the operation description area (P330), a description of the control panel operation required for the selected procedure can be output. In addition, in the user view output area (P400), the generated augmented reality can be output so as to be linked to the control unit (100).

[0069] Here, the input unit (340) can output the screen of the aforementioned display unit (330) by sharing it. Accordingly, the operator can select a control procedure to be experienced through the display unit (330) or the input unit (340).

[0070] Although not shown, the display unit (330) can further output information about nuclear power plant facilities. Here, the display unit (330) can provide information about nuclear power plant facilities to workers based on facility information (200a) stored in the storage unit (200).

[0071] Meanwhile, when the operator completes procedure selection, the display unit (330) or the input unit (340) generates a signal regarding the selected procedure and provides it to the processing unit (320). The processing unit (320) can call augmented reality data (200b) including augmented reality regarding the selected procedure from the storage unit (200), and generate augmented reality based on the called augmented reality data (200b) and provide it to the display unit (330). The display unit (330) outputs the received augmented reality based on the information collected about the operator and the control unit (100) so as to be linked to the control unit (100) at the operator's point of view.

[0072] In the operator experience stage (S200), the operator can interact with augmented reality to experience control panel control. At this time, the display unit (330) can recognize the operator's actions and generate operation data. The display unit (330) can then provide the operator's experience image and the generated operation data to the monitoring unit (400).

[0073] And when the worker completes the experience for the selected procedure, the worker can call up the record report (200c) through the input unit (340). The worker can write the record report (200c) through the input unit (340), and the input unit (340) can provide the written record report (200c) to the monitoring unit (400).

[0074] In the experience evaluation stage (S300), the monitoring unit (400) can output the worker's experience status so that the supervisor can evaluate the worker's experience. Here, the monitoring unit (400) can output the experience status in real time during the worker's experience process.

[0075] To this end, the monitoring unit (400) can output virtual measurement values ​​generated from a simulation of the operation of nuclear power plant facilities and normal measurement values ​​provided from the storage unit (200). In addition, the monitoring unit (400) can output a record report (200c) and an experience image and provide them to the supervisor.

[0076] Through this process, supervisors can assess the worker's operational skills during the experience and request corrections. Furthermore, workers and supervisors can practice communication in advance in actual field situations.

[0077] For example, a supervisor may instruct a worker on the operation of a control panel during a given control procedure. The worker may operate the control panel, i.e., the control unit (100), according to the supervisor's instructions. The supervisor may then monitor the worker's work status, i.e., the experience status, through the monitoring unit (400).

[0078] The embodiments of the present invention described above and illustrated in the drawings should not be construed as limiting the technical concept of the present invention. The scope of protection of the present invention is limited only by the matters set forth in the claims, and those skilled in the art will be able to make various improvements and modifications to the technical concept of the present invention. Accordingly, such improvements and modifications, as long as they are obvious to those skilled in the art, will fall within the scope of protection of the present invention.

Claims

1. A control unit designed to allow experience of controlling nuclear power plant facilities; A utilization unit including a processing unit that generates augmented reality for the operation guidance of the control unit and a display unit that is arranged to photograph the control unit, obtains an image of the control unit, recognizes the control unit from the image, receives the augmented reality from the processing unit, and maps and outputs the augmented reality to the recognized control unit; and A control simulation system for a nuclear power plant control panel using augmented reality, including a monitoring unit that generates virtual measurement values ​​of the nuclear power plant facility based on operation data regarding the operation of the control unit, and provides normal measurement values ​​acquired when the nuclear power plant facility is operating normally and the virtual measurement values.

2. In paragraph 1, The above monitoring unit A control simulation system for a nuclear power plant control panel using augmented reality, characterized in that it generates the virtual measurement values ​​by performing a virtual simulation of the operation of the nuclear power plant facility based on the above operation data.

3. In paragraph 1, The above augmented reality A control simulation system for a nuclear power plant control panel using augmented reality, characterized in that it is generated to guide different operations of the control unit in each procedure of the control procedure for controlling the nuclear power plant equipment.

4. In paragraph 3, In each of the above procedures, a storage unit is further included for storing a plurality of augmented reality data arranged to generate augmented reality for different operations, The above utilization section A control simulation system for a nuclear power plant control panel using augmented reality, characterized in that the system provides a selection signal in which a user selects one of the above control procedures, and generates the augmented reality using one of the plurality of augmented reality data based on the selection signal.

5. In paragraph 4, The above utilization section A target procedure selection area in which multiple procedure selection buttons are provided so that the user can select a target procedure for performing control training among the above control procedures, A procedure description area where a description of the above target procedure is printed, A control simulation system for a nuclear power plant control panel using augmented reality, characterized in that it outputs an operation description area in which a description of the operation required for the control unit in the above target procedure is output.

6. In paragraph 1, The above control unit A plurality of simulation control tools provided to perform control training of the above nuclear power plant facilities, A control simulation system for a nuclear power plant control panel using augmented reality, characterized in that the display unit includes a plurality of recognition marks individually formed for each of the simulation control tools so as to recognize each of the simulation control tools.

7. In paragraph 1, The above monitoring unit A control simulation system for a nuclear power plant control panel using augmented reality, characterized in that it receives the image from the display unit and outputs the image.

Images