Charging unit visualization apparatus and charging unit visualization method

Abstract

To provide a charging unit visualization apparatus and charging unit visualization method that enhance the safety of work when workers perform work on an electrical facility.SOLUTION: A charging unit visualization apparatus comprises an information processing device, an imaging device that outputs captured image data being image data obtained by imaging a site where an electrical facility is present, and a display device. The information processing device includes: a light-emission region detection unit that detects, for an image based on the captured image data, a light-emission region that is a region which captures light within a predetermined wavelength range emitted by a light-emitting member provided on a charging unit of the electrical facility and emitting light through corona discharge occurring when the charging unit is energized; an enhanced image generation unit that generates enhanced image data in which the light-emission region is emphasized for the captured image data; and an image display unit that causes the display device to display a display image based on the enhanced image data.SELECTED DRAWING: Figure 3

Description

[Technical Field]

[0001] The present invention relates to a live part visualization device and a live part visualization method. [Background technology]

[0002] Patent Document 1 describes an electric shock accident prevention system configured to reliably avoid electric shock accidents by implementing power outage operations when necessary without unnecessary power outage operations. This electric shock accident prevention system is configured to provide a first sensor signal transmitter at a height a first distance vertically below a live section connected to on-site equipment of an electric power station, a second sensor signal transmitter at a height a second distance (<first distance) vertically below the live section, and a sensor detection pole equipped with a first sensor signal receiver for receiving a wireless signal from the first sensor signal transmitter, a second sensor signal receiver for receiving a wireless signal from the second sensor signal transmitter, an information processing device, and a communication device, which are installed in the on-site equipment. The sensor detection pole outputs information indicating a warning when the first wireless signal is interrupted, and performs power outage control by releasing the charging state of the live section when the second wireless signal is interrupted. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Laid-Open No. 2017-118245 Summary of the Invention [Problem to be solved by the invention]

[0004] For example, within the premises of an electrical facility such as a substation, there are facilities to which the live parts (busbars, etc.) of electrical equipment such as transformers, circuit breakers, and disconnecting switches are connected, and if a person inadvertently touches a live high-voltage part, it could lead to electric shock or a power outage.

[0005] However, because electricity is invisible, people cannot directly determine whether a live part is charged or not. For this reason, some mechanism must be in place to prevent workers performing work (inspection, replacement, repair, new installation, etc.) on electrical equipment (such as power transmission and distribution equipment and substation equipment) from coming into contact with live parts.

[0006] In the above-mentioned Patent Document 1, a first sensor signal transmitter is provided at a height vertically below the charging unit by a first distance, and a second sensor signal transmitter is provided at a height vertically below the charging unit by a second distance, and when the first wireless signal from the first sensor signal transmitter is interrupted, information indicating a warning is output, and when the second wireless signal from the second sensor signal transmitter is interrupted, the sensor detection pole releases the charging state of the charging unit, thereby preventing electric shock accidents.

[0007] However, this method requires the installation of a sensor signal transmitter at the site each time work is performed, and if there are many or a wide range of live charging units at the site, it is necessary to install many sensor signal transmitters at the site, which increases equipment costs and forces workers to perform complicated work.

[0008] The present invention has been made in consideration of this background, and aims to provide a live part visualization device and a live part visualization method that can improve the safety of workers when working on electrical equipment. [Means for solving the problem]

[0009] One of the present inventions for achieving the above-mentioned object is a live part visualization device comprising an information processing device having a processor and a storage device, an imaging device that outputs captured image data, which is image data obtained by photographing a site where electrical equipment is present, and a display device, wherein the information processing device detects, from the captured image data, a light-emitting area, which is an area in which light is emitted by a light-emitting element provided in a live part of the electrical equipment due to corona discharge that occurs when the live part is energized, and generates, from the captured image data, enhanced image data that enhances the light-emitting area, and displays an image based on the enhanced image data on the display device.

[0010] Other problems and solutions disclosed in the present application will be made clear in the detailed description and drawings. [Effects of the Invention]

[0011] According to the present invention, it is possible to improve the safety of work performed by workers on electrical equipment. [Brief explanation of the drawings]

[0012] [Figure 1] FIG. 1 is a diagram showing a schematic configuration of a live part visualization system. [Figure 2] FIG. 2 is a diagram showing the main configuration of the live part visualization device. [Figure 3] FIG. 2 is a functional block diagram illustrating main functions of the live charging unit visualization device. [Figure 4] 10 is an example of a display image. DETAILED DESCRIPTION OF THE INVENTION

[0013] Hereinafter, an embodiment of the present invention will be described with reference to the drawings.

[0014] Figure 1 shows a schematic configuration of a live part visualization system 1 according to one embodiment of the present invention. As shown in the figure, the live part visualization system 1 includes a light-emitting member 4 provided in a live part 3 of electrical equipment 2, such as power transmission and distribution equipment or substation equipment, and a live part visualization device 100 used on-site by a worker 6 who performs work on the electrical equipment 2 (repair, inspection, replacement, new installation, etc.).

[0015] The light-emitting member 4 includes an element that emits light in a predetermined wavelength range due to corona discharge occurring around the charging section 3 when it is being charged (energized). The element is, for example, an element that emits light due to the movement of static electricity charges (also called an "electrostatic light-emitting element"). For example, an element whose base material is a ceramic containing "SrAl2O4:Eu2+" that emits light in a wavelength range centered on green due to corona discharge is known (for example, "Direct visualization of invisible static electricity distribution achieved by emitting light," [online], National Institute of Advanced Industrial Science and Technology, [searched March 28, 2024], Internet<URL:https: / / www.aist.go.jp / aist_j / press_release / pr2022 / pr20220602 / pr20220602.html> ").

[0016] However, all currently known light emitting members 4 have a problem in that they have low light emission intensity and are not necessarily easy to see with the naked eye when the intensity of the corona discharge is weak or under direct sunlight.

[0017] The light emitting member 4 is provided on the charging unit 3 of the electrical equipment 2. The light emitting member 4 is, for example, applied to the surface of a resin tape with an adhesive applied to the back side, and the tape is attached to the surface of the charging unit 3 with the adhesive, thereby providing the light emitting member 4 on the charging unit 3. Alternatively, the light emitting member 4 can be provided on the charging unit 3 by applying the light emitting member 4 to the surface of the charging unit 3 in a state where the light emitting member 4 is impregnated in a solvent such as paint, adhesive, or glue.

[0018] The live charging part visualization device 100 is a device worn by a worker 6 when working on electrical equipment 2, and provides the worker 6 with on-site images and various information using an augmented reality (AR) mechanism. In this embodiment, the live charging part visualization device 100 is a head-mounted display type device worn on a person's head (such as "AR goggles," "wearable camera," or "smart glasses"), but the live charging part visualization device 100 may be any other type of device (such as a smartphone, tablet, or notebook computer) as long as it is capable of providing information based on the augmented reality mechanism. Note that if the live charging part visualization device 100 is configured using AR goggles, it is possible to easily realize a live charging part visualization device 100 that is highly portable and easy to handle.

[0019] Figure 2 shows the main configuration of the live part visualization device 100. As shown in the figure, the live part visualization device 100 includes a processor 11, a main memory device 12, an auxiliary memory device 13, an input device 14, an output device 15, a communication device 16, an imaging device 17, and various sensors 18. Of these, the processor 11, the main memory device 12, the auxiliary memory device 13, the input device 14, the output device 15, and the communication device 16 make up an information processing device 10 (computer).

[0020] The processor 11 is configured using, for example, a CPU (Central Processing Unit), an MPU (Micro Processing Unit), a GPU (Graphics Processing Unit), an FPGA (Field Programmable Gate Array), an ASIC (Application Specific Integrated Circuit), an AI (Artificial Intelligence) chip, etc.

[0021] The main storage device 12 is a device that stores programs and data, and is, for example, a read-only memory (ROM), a random access memory (RAM), a non-volatile memory (NVRAM), etc. The auxiliary storage device 13 is, for example, a solid-state drive (SSD), an SD card, a storage area of ​​a cloud server, etc.

[0022] The input device 14 is an interface that accepts input from the outside, and is, for example, a touch panel, a button, an adjustment knob, or an audio input device such as a microphone.

[0023] The output device 15 is an interface that outputs various information such as the progress of processing and the results of processing. The output device 15 is a display device (LCD (Liquid Crystal Display)) and an audio output device (speaker). The input device 14 and the output device 15 constitute a user interface that receives information from the user and presents information to the user.

[0024] The communication device 16 is a device that realizes communication (wired communication or wireless communication) with other devices, and is, for example, a wireless communication module, a USB module, a Bluetooth module (registered trademark), a NIC (Network Interface Card), etc. The communication device 16 communicates with a cloud system via the Internet, for example.

[0025] The photographing device 17 is a device that outputs images (including images (frame images) that constitute a video) acquired by an optical sensor (such as a CCD (Charge Coupled Device) sensor or a CMOS (Complementary Metal Oxide Semiconductor)) as digital image data (still image data or video data; hereinafter referred to as "photographed image data"), and is, for example, a video camera or a digital camera. The photographing device 17 is not limited to one that acquires two-dimensional photographed image data, but may also be one that can acquire three-dimensional photographed image data (photographed image data including depth (distance) information) (such as a stereo camera, a ToF (Time of Flight) camera, a LiDAR (Light Detection and Ranging), or a millimeter-wave radar).

[0026] The various sensors 18 include, for example, an acceleration sensor, an angular velocity sensor (gyro sensor), an angle sensor, a tilt sensor, a position sensor (GNSS (Global Navigation Satellite System)), an acoustic sensor, an optical sensor, a pressure sensor, and a temperature sensor, and provide environmental information used when generating images and various information to be provided to the user.

[0027] 3 is a functional block diagram illustrating the main functions of the charging part visualization device 100. As shown in the figure, the charging part visualization device 100 has the following functions: a preprocessing unit 111, a light emitting region extraction unit 112, a wavelength range setting unit 113, an enhanced image generation unit 114, an object detection unit 115, an additional information generation unit 116, an image synthesis unit 117, and an image display unit 118.

[0028] These functions are realized by the processor 11 reading and executing programs stored in the main memory device 12 or the auxiliary memory device 13, or by functions provided in hardware such as FPGA, ASIC, AI chip, etc. Furthermore, all or part of these functions may be provided by a cloud system via the Internet.

[0029] Of the above functions, preprocessing unit 111 performs processes such as noise reduction and filtering (hereinafter referred to as "preprocessing") on captured image data sent from imaging device 17, with the aim of improving the accuracy of various processes performed in subsequent stages and improving the image quality of images displayed on the display device (output device 15). As shown in the figure, preprocessing unit 111 inputs the captured image data after preprocessing to luminous region extraction unit 112, enhanced image generation unit 114, object detection unit 115, image synthesis unit 117, etc. Note that preprocessing of captured image data is not essential.

[0030] Light emitting region extraction unit 112 extracts (specifies) a region (hereinafter referred to as a "light emitting region") whose color (pixel color) is within the wavelength range of light emitted from light emitting component 4 (hereinafter referred to as "light emitting color") for an image based on the captured image data input from preprocessing unit 111, generates information indicating the extracted light emitting region (information indicating the position or range of the light emitting region in an image based on the captured image data, for example, information expressing the light emitting region in a two-dimensional coordinate system or a three-dimensional coordinate system; hereinafter referred to as "light emitting region information"), and inputs the generated light emitting region information to enhanced image generation unit 114 and additional information generation unit 116. Note that the method (image processing technique) for extracting a light emitting region for captured image data is not necessarily limited, but light emitting region extraction unit 112 extracts a light emitting region by, for example, applying color extraction processing (spectrum extraction processing) to the captured image data.

[0031] Wavelength range setting unit 113 provides a user interface for setting the luminous color that is to be extracted as a luminous region by luminous region extraction unit 112. By using this user interface, a user such as operator 6 can set the luminous color that is to be extracted as a luminous region by luminous region extraction unit 112, depending on the type of light-emitting member 4 provided in charging unit 3.

[0032] The enhanced image generation unit 114 performs image processing (color conversion, density conversion, contrast conversion, etc.) on the captured image data input from the pre-processing unit 111 to enhance the area indicated by the light emitting area information input from the light emitting area extraction unit 112, and inputs the captured image data after this image processing (hereinafter referred to as ``enhanced image data'') to the image synthesis unit 117.

[0033] The object detection unit 115 performs object detection processing (image recognition processing) on ​​the captured image data input from the pre-processing unit 111, generates information about the object appearing in the image based on the captured image data (information indicating the area in which the object appears in the image based on the captured image data (information indicating the position or range (for example, information representing the light-emitting area in a two-dimensional coordinate system or a three-dimensional coordinate system), the name and type of the object, the model and model number of the object, etc.; hereinafter referred to as "object information"), and inputs the generated object information to the additional information generation unit 116.

[0034] The object detection unit 115 generates object information using, for example, a known object detection mechanism based on a machine learning model (for example, R-CNN (Regional CNN (Convolutional Neural Network)), YOLO (You only Look once), SSD (Single Shot Detector), DETR (DEtection Transformer), etc.).

[0035] Based on the captured image data input from pre-processing unit 111, the light emitting area information input from light emitting area extraction unit 112, and the object information input from object detection unit 115, additional information generation unit 116 generates information (messages, images (icons, etc.), information indicating the display position of the above-mentioned messages and images, etc.; hereinafter referred to as "additional information") to be added to areas of the image based on the captured image data that are identified by the light emitting area information or that contain objects identified by the object information, and inputs the generated additional information to image synthesis unit 117.

[0036] The additional information generation unit 116 generates the additional information by searching for additional information stored in advance in a database using, for example, the captured image data or object information as search keywords. The additional information generation unit 116 also generates the additional information using, for example, a machine learning model (DNN (Deep Neural Network), CNN (Convolutional Neural Network), MLP (Multilayer Perceptron), support vector machine, decision tree, random forest, gradient boosting, etc.) that has been trained to output information about the electrical equipment shown in the captured image data (such as the name, type, model number, and specifications of the electrical equipment) by inputting the captured image data or object information.

[0037] The image synthesis unit 117 generates data (hereinafter referred to as "synthetic image data") by adding an image based on the additional information input from the additional information generation unit 116 to the enhanced image data input from the enhanced image generation unit 114 (for example, adding a message or image specified in the additional information to a position specified in the additional information), and inputs the generated synthetic image data to the image display unit 118.

[0038] Image display unit 118 outputs (displays) an image based on the composite image data input from image composition unit 117 (hereinafter referred to as a “display image 400”) to a display device (display) which is output device 15.

[0039] The information processing device 10 displays a video or image based on the display image 400 on the output device 15 (display device) by repeatedly executing the processing performed sequentially by each of the above functions in real time for each of the image data (image data of each frame in the case of video data) of the scene that is sequentially input from the photographing device 17.

[0040] 4 shows an example of a display image 400. The illustrated display image 400 includes highlighted image data 411 and additional information 412. By performing work while constantly checking the display image 400, the worker 6 can safely proceed with work on-site while constantly checking the presence and position of the charging unit 3, thereby preventing electric shock and power outages.

[0041] As explained above, the live charging unit visualization device 100 of this embodiment detects, from captured image data that is image data captured of a site where electrical equipment 2 is present, a light emitting area that is an area that captures light emitted by the light emitting members 4 provided in the live charging unit 3 of the electrical equipment 2 due to corona discharge that occurs when the live charging unit 3 is energized, generates enhanced image data that is data that enhances the light emitting area from the captured image data, and displays an image based on the enhanced image data on the output device 15 (display device). This allows the worker 6 to perform work while constantly checking the presence and position of the live charging unit 3 using the display image 400, allowing the worker 6 to proceed with the work safely.

[0042] Furthermore, when performing work using the above mechanism, the light emitting member 4 is provided in advance on the surface of the charging unit 3 (for example, by sticking or applying it), and the worker 6 simply wears the charging unit visualization device 100 or brings it to the site, allowing the worker 6 to easily use the mechanism. Furthermore, once the light emitting member 4 is provided on the charging unit 3, it can be reused, so it does not require the worker 6 to do any work each time.

[0043] In addition, the charging unit visualization device 100 generates composite image data, which is image data in which image data indicating that the part corresponding to the light-emitting area is the charging unit 3 is added to the highlighted image data, and displays shadows and images based on the composite image data on the output device 15 (display device), thereby making the worker 6 aware of the presence of the charging unit 3.

[0044] In addition, the live part visualization device 100 generates composite image data by adding image data displaying information about the electrical equipment 2 detected by object recognition to the enhanced image data, and displays shadows and images based on the composite image data on the output device 15 (display device), thereby providing the worker 6 with information about the electrical equipment 2 present in the surrounding area in real time, thereby improving workability and safety.

[0045] Although the embodiments of the present invention have been described in detail above, the above description is intended to facilitate understanding of the present invention and is not intended to limit the present invention. The present invention may be modified or improved without departing from the spirit thereof, and the present invention naturally includes equivalents thereof. For example, the above embodiments have been described in detail to clearly explain the present invention, and the present invention is not necessarily limited to those including all of the described configurations. Furthermore, it is possible to add, delete, or replace some of the configurations of the above embodiments with other configurations.

[0046] For example, in the above description, the light emitting member 4 emits visible light in a predetermined wavelength range (visible light in a predetermined wavelength range centered on green), but the light emitting member 4 may emit visible light in another wavelength range or light in a wavelength range other than visible light (light in the infrared or ultraviolet range). In this case, the image capturing device 17 used should be one that can detect light in the wavelength range of the light emitting member 4.

[0047] Furthermore, the live part visualization device 100 may correct the display image 400 based on information acquired from the various sensors 18. Furthermore, the live part visualization device 100 may perform processing (such as buffering and reusing common parts between frames, predicting or pre-generating the next screen based on information acquired from the various sensors 18) to increase the processing load and display speed (frame rate (FPS: frames per second)) for displaying the composite image data. [Explanation of symbols]

[0048] 1 live part visualization system, 2 electrical equipment, 3 live part, 4 light-emitting component, 6 worker, 10 information processing device, 11 processor, 12 main memory device, 13 auxiliary memory device, 14 input device, 15 output device, 17 photographing device, 18 various sensors, 100 live part visualization device, 111 preprocessing unit, 112 light-emitting region extraction unit, 113 wavelength range setting unit, 114 enhanced image generation unit, 115 object detection unit, 116 additional information generation unit, 117 image synthesis unit, 118 image display unit, 400 displayed image, 411 enhanced image data, 412 additional information

Claims

1. an information processing device having a processor and a storage device; an imaging device that outputs image data obtained by capturing an image of a site where electrical equipment is present; A display device; Equipped with The information processing device includes: a light-emitting area is detected from the captured image data, the light being emitted by a light-emitting member provided in a charging unit of the electrical equipment due to corona discharge that occurs when the charging unit is energized; generating enhanced image data that is data in which the light emitting region is enhanced from the captured image data; an image based on the enhanced image data is displayed on the display device; Live part visualization device.

2. The live part visualization device according to claim 1, generating composite image data that is image data obtained by adding image data indicating that the portion corresponding to the light-emitting region is a live portion to the emphasized image data; displaying an image based on the composite image data on the display device; Live part visualization device.

3. The live part visualization device according to claim 1, storing information about the electrical equipment; detecting electrical equipment shown in the photographed image data by performing object recognition on the photographed image data using a machine learning model; generating composite image data that is image data obtained by adding image data that displays information about the detected electrical equipment to the emphasized image data; displaying an image based on the composite image data on the display device; Live part visualization device.

4. The live part visualization device according to claim 1, The captured image data is video data, For image data of each frame of the photographed image data, A light-emitting element provided in a charging unit of the electrical equipment detects a light-emitting area, which is an area where light emitted by a corona discharge that occurs when the charging unit is energized is projected. generating enhanced image data that is data in which the light emitting region is enhanced from the captured image data; an image based on the enhanced image data is displayed on the display device; Live part visualization device.

5. The live part visualization device according to claim 1, the information processing device is mounted on an augmented reality providing device worn on a person's head; The display device is a display device included in the augmented reality providing device. Live part visualization device.

6. an information processing device having a processor and a storage device; an imaging device that outputs image data, which is digital image data obtained by capturing an image of a site where electrical equipment is present; A display device; The information processing device in the live portion visualization device includes: detecting a light-emitting area in the captured image data, the light-emitting area being an area in which light emitted by a light-emitting member provided in a charging unit of the electrical equipment due to corona discharge that occurs when the charging unit is energized; generating enhanced image data that is data in which the light-emitting region is enhanced from the captured image data; and displaying an image based on the enhanced image data on the display device; Perform the live part visualization method.

7. 7. The live part visualization method according to claim 6, The information processing device, generating composite image data that is image data obtained by adding image data indicating that the portion corresponding to the light-emitting region is a live portion to the highlighted image data; and displaying an image based on the composite image data on the display device; The live part visualization method further comprises:

8. 7. The live part visualization method according to claim 6, The information processing device, storing information about the electrical equipment; a step of detecting electrical equipment shown in the photographed image data by performing object recognition on the photographed image data using a machine learning model; generating composite image data that is image data obtained by adding image data that displays information about the detected electrical equipment to the enhanced image data; and displaying an image based on the composite image data on the display device; The live part visualization method further comprises:

Images