AR intelligent identification glasses for power grid machine room

Abstract

The invention relates to AR intelligent identification glasses for a power grid machine room. Comprising a glasses frame and glasses legs, a display system is arranged on the glasses frame, a camera is arranged on each glasses leg, a control mainboard is arranged in one side of each glasses leg, a control system, a wireless transmission system and a graphic processing system are arranged on each control mainboard, and the wireless transmission systems and the graphic processing systems are connected with the control systems. The camera is electrically connected with the display system, the wireless transmission system and the graphic processing system, the display system is electrically connected with the graphic processing system, the wireless transmission system is connected with the data center through wireless signals, and a scene graphic modeling module, a scene graphic storage module and a scene graphic analysis module are arranged in the graphic processing system. According to the invention, the problem of frequent wrong watching or missing watching during inspection can be overcome through the AR intelligent identification glasses, and the timeliness of fault reporting is realized.

Description

Technical Field

[0001] The present invention belongs to the technical field of AR glasses equipment, and in particular relates to AR smart recognition glasses for power grid rooms. Background Art

[0002] The power grid computer room is an indispensable part of the power system. It provides powerful computing and storage support for the operation and management of the power grid, ensuring the safe and stable operation of the power grid. Therefore, the operation and maintenance management of the power grid computer room is particularly important.

[0003] Traditional computer room operation and maintenance management is mostly achieved through data center monitoring and daily inspections by operation and maintenance personnel. The data center can monitor the overall operating status of the computer room equipment, but it is inevitable that data display errors will occur. Therefore, it is necessary to cooperate with the operation and maintenance personnel to inspect the computer room. When any equipment abnormalities are found, they are reported in time and responded to to ensure the normal operation of the equipment. However, the existing computer room inspections are usually only through naked eye observation by personnel, and there are a large number of equipment in the computer room, and the operating conditions of each equipment are different. Mistakes or omissions often occur during inspections, resulting in untimely reporting of faults, affecting the normal operation of the equipment. Summary of the invention

[0004] The purpose of the present invention is to address the defects or shortcomings in the prior art, and to provide an AR smart recognition glasses for a power grid computer room. The computer room scene and the equipment operation status indication therein are modeled through a graphics processing system. When the operation and maintenance personnel wear the glasses, they will first establish a connection with the computer room to be inspected through a wireless module, and call the data model of the computer room to compare with the real scene captured by the camera, so that all the equipment in the computer room can be quickly checked, especially the indication status of the equipment indicator lights. When the equipment indicator lights show abnormalities, the identified computer room information and equipment information are summarized and uploaded to the data center for alarm, and after the inspection of all computer rooms is completed, an inspection report can be generated, and the operation and maintenance management personnel can view the inspection report in the data center to better make correct response operations.

[0005] To achieve the above-mentioned purpose, the technical solution of the present invention is: a pair of AR smart identification glasses for a power grid room, comprising a frame and temples, the frame is provided with a display system, the temples are provided with cameras, one side of the temples is provided with a control mainboard, the control mainboard is provided with a control system and a wireless transmission system and a graphics processing system connected to the control system, the camera is electrically connected to the display system, the wireless transmission system and the graphics processing system, the display system is electrically connected to the graphics processing system, the wireless transmission system is connected to a data center via wireless signals, and the graphics processing system has built-in scene graphics modeling module, scene graphics storage module, and scene graphics analysis module.

[0006] In one embodiment of the present invention, the wireless transmission system includes a Bluetooth module, a WIFI module, and a positioning receiving module. The Bluetooth module, the WIFI module, and the positioning receiving module are all electrically connected to the control system, and the Bluetooth module establishes a connection with the Bluetooth module at the entrance of the power grid room.

[0007] In one embodiment of the present invention, the control system adopts the MT 8768 processing chip and is equipped with an IMG GE8300 graphics processing unit electrically connected to the graphics processing system.

[0008] In one embodiment of the present invention, the scene graph storage module includes a rack graph storage unit, a device graph storage unit, and an indicator light operation state storage unit.

[0009] In one embodiment of the present invention, the scene graphics modeling module receives the room graphics captured by the camera and performs three-dimensional scene graphics modeling on the graphics photo, and stores the model data in the scene graphics storage module, and also stores the captured original image in the scene graphics storage module.

[0010] In one embodiment of the present invention, the scene graphics three-dimensional modeling includes a rack graphics data model, a device graphics data model, and an indicator light operating status data model, and the rack graphics data model, the device graphics data model, and the indicator light operating status data model correspond to the rack graphics storage unit, the device graphics storage unit, and the indicator light operating status storage unit, respectively.

[0011] In one embodiment of the present invention, the positioning receiving module uses a UWB chip to receive wireless signals, and the UWB chip is matched and connected with a UWB transmitting module installed at the entrance of the power grid room and the rack.

[0012] In one embodiment of the present invention, a switch and a touch screen are provided on the side of the temple away from the control main board.

[0013] In one embodiment of the present invention, the operating status of racks, equipment, and equipment indicator lights in a computer room scene is modeled through a graphics processing system, and the control system calls the data model of the computer room scene to compare with the real scene captured by the camera, so that all equipment in the computer room can be quickly checked. When the operating status of the equipment indicator light shows an abnormality, the control system uploads the identified computer room information and equipment information to the data center for an alarm, and after the inspection of all computer rooms is completed, an inspection report can be generated, and the operation and maintenance management personnel can better make correct response operations based on the inspection report.

[0014] In one embodiment of the present invention, the control system performs unified control over the overall operation of the equipment. First, it is necessary to establish a wireless connection with the computer room through a wireless transmission system to locate the position of the inspection operation and maintenance personnel. When establishing the wireless connection, each computer room and rack has been set with a number name, and the display system and the data center can see the location of the operation and maintenance personnel in the map model, which is convenient for unified management. Secondly, after entering the computer room, you can start shooting and modeling the computer room. The racks, equipment and equipment indicator lights photographed by the camera are graphically modeled through the scene graphics modeling module. After the modeling is completed, the equipment number name is further set and saved, so that the abnormal equipment number name can be quickly found during the inspection, and the reporting and maintenance are more accurate. When all computer rooms complete the data modeling, they are stored in the scene graphics storage module;

[0015] During the subsequent inspection, the wireless transmission system establishes a connection with the computer room to be inspected, and the graphics processing system automatically calls the scene graphics data model of the corresponding computer room. The scene graphics analysis module receives the real-time image transmitted by the camera and matches and analyzes it with the called data model. The matching order includes rack number, equipment location, and equipment operation indicator light indication. First, it is necessary to ensure that the called rack number is consistent with the rack number transmitted by the real-time image before the next comparison and judgment is carried out. The data model of the equipment location also includes the specific shape of the equipment. When the real-time image is consistent with the called data model, the matching of the equipment operation indicator light indication is started. The indicator light can quickly understand the equipment operation status. If the comparison result of the equipment operation indicator light is abnormal, the control system will issue an abnormal alarm, and the display system will display red in full screen. The abnormal data is synchronously transmitted to the data center through the wireless transmission system for alarm prompts. The dual-end synchronous alarm can respond faster and better in the shortest time.

[0016] Compared with the prior art, the present invention has the following beneficial effects: the present invention models the computer room scene and the equipment operation status indication therein through a graphics processing system. When the operation and maintenance personnel wear it, they will first establish a connection with the computer room to be inspected through a wireless module, call the data model of the computer room and compare it with the real scene captured by the camera, so that all the equipment in the computer room can be quickly checked, especially the indication status of the equipment indicator light. When the equipment indicator light shows an abnormality, the identified computer room information and equipment information are summarized and uploaded to the data center for alarm, and after the inspection of all computer rooms is completed, an inspection report can be generated. The operation and maintenance management personnel can view the inspection report in the data center and make better and correct response operations. The present invention can overcome the problem of misreading or missing during inspections through AR smart recognition glasses, and realize the timeliness of fault reporting. BRIEF DESCRIPTION OF THE DRAWINGS

[0017] Figure 1 It is a schematic diagram of the structure of the present invention;

[0018] Figure 2 It is a schematic diagram of the principle framework of the present invention;

[0019] Figure 3 It is a schematic diagram of the scene recognition principle of the present invention;

[0020] Explanation of the accompanying drawings: frame 1, temple 2, display system 3, camera 4, control main board 5, control system 51, wireless transmission system 52, graphics processing system 53, Bluetooth module 521, WIFI module 522, positioning receiving module 523, scene graphics modeling module 531, scene graphics storage module 532, scene graphics analysis module 533. DETAILED DESCRIPTION

[0021] The technical solution of the present invention is described in detail below in conjunction with the accompanying drawings.

[0022] See also Figure 1-Figure 3 As shown, the technical solution adopted in this specific embodiment is: an AR smart identification glasses for a power grid room, which includes a frame 1 and temples 2. The frame 1 is provided with a display system 3. The display system adopts virtual image transparent chip technology. The lens is a transparent lens, and image information can be displayed on the lens, so that the operation and maintenance personnel can wear AR glasses during the inspection process and use AR glasses to inspect the room. The inspection information is displayed through the display system;

[0023] A camera 4 is provided on the temple 2. In the present embodiment, the camera has two main functions: first, the racks and equipment in the machine room are photographed and modeled by the camera; second, the real-time image is transmitted during the inspection process for comparison with the established data model;

[0024] A control mainboard 5 is arranged in one side of the temple 2, and a control system 51, a wireless transmission system 52, and a graphics processing system 53 are arranged on the control mainboard 5. The camera 4 is electrically connected to the graphics processing system 53, and the wireless transmission system 52 is connected to the data center via a wireless signal. The graphics processing system 53 has a built-in scene graphics modeling module 531, a scene graphics storage module 532, and a scene graphics analysis module 533. In this embodiment, the control system performs unified control over the overall operation of the equipment. First, it is necessary to establish a wireless connection with the computer room and the racks in the computer room through the wireless transmission system, locate the position of the inspection operation and maintenance personnel, and then establish the wireless connection. Each computer room and rack has been assigned a number name, and the display system and data center can see the location of the operation and maintenance personnel in the map model, which is convenient for unified management. Secondly, after entering the computer room, you can start shooting and modeling the computer room. Through the scene graphic modeling module, the racks, equipment and equipment indicator lights photographed by the camera are graphically modeled. After the modeling is completed, the equipment name can be further set and saved, such as rack 1-server 1, rack 2-UPS1. Setting the equipment name is convenient for quickly finding the abnormal equipment name during the inspection, and reporting and maintenance are more accurate. When all computer rooms complete the data modeling, they are stored in the scene graphic storage module;

[0025] During the subsequent inspection, the wireless transmission system establishes a connection with the room to be inspected, the graphics processing system automatically calls the scene graphics data model of the room, and the scene graphics analysis module receives the real-time image transmitted by the camera, and matches and analyzes it with the called data model. The matching order includes the rack number, equipment location, and equipment operation indicator light indication. First, it is necessary to ensure that the called rack number is consistent with the rack number transmitted by the real-time image before the next comparison and judgment is carried out. The data model of the equipment location also includes the specific shape of the equipment. When the real-time image is consistent with the called data model, the equipment operation indicator light indication is matched. Since the main purpose of daily inspection is to check the equipment operation status During the inspection, the indicator lights can be used to quickly understand the equipment operation status. In traditional inspection methods, the naked eye is mostly used for identification, which is not only inefficient but also prone to errors. Through the good data model comparison method in this embodiment, a comparison can be made quickly in the shortest time. For example, a normally operating device has four green indicator lights, and a real-time image transmission image has four green indicator lights. At this time, it is determined that the equipment is operating normally. If there are only three or fewer green indicator lights, the comparison result is abnormal, and the control system issues an abnormal alarm. The display system will display red in full screen, and the abnormal data is synchronously transmitted to the data center through the wireless transmission system for alarm prompts. The dual-end synchronous alarm can respond faster and better in the shortest time.

[0026] More specifically, the wireless transmission system 52 includes a Bluetooth module 521, a WIFI module 522, and a positioning receiving module 523. The Bluetooth module 521, the WIFI module 522, and the positioning receiving module 523 are all electrically connected to the control system 51. The Bluetooth module 521 establishes a connection with the Bluetooth module at the entrance of the computer room. In this embodiment, the wireless transmission system includes multiple modules. The Bluetooth module is used to establish a connection between the device and the computer room and obtain a good identification number of the computer room, so that the corresponding computer room data model can be automatically called for comparison. The positioning receiving module establishes a connection with the rack in the computer room to determine the location of the operation and maintenance personnel, so that the scene graphics modeling module can generate a real-time operation and maintenance map during normal operation, and the operation and maintenance personnel and data center managers can be more aware of the progress of the operation and maintenance inspection. The WIFI module establishes a wireless connection with the data center and transmits all data.

[0027] To be more specific, the control system 51 adopts the MT 8768 processing chip and is equipped with an IMG GE8300 graphics processing unit electrically connected to the graphics processing system 53. In this embodiment, the MT 8768 processing chip is used as the main control chip. The chip has a smaller size, lower power consumption, and stronger processing performance. It is also equipped with an IMG GE 8300 graphics processing unit, which can process graphic information faster and better.

[0028] To be more specific, the scene graphics storage module 532 includes a rack graphics storage unit, a device graphics storage unit, and an indicator light operation status storage unit. In the present embodiment, three models are mainly processed, and each data model is classified and stored for modular management. When data is called, the data model can be called in the shortest time, thereby achieving faster data comparison efficiency during inspection and improving inspection efficiency.

[0029] To be more specific, after receiving the computer room graphics captured by the camera 4, the scene graphics modeling module 531 performs scene graphics three-dimensional modeling on the graphics photo, and stores the model data in the scene graphics storage module 532, and the original image captured is also stored in the scene graphics storage module 532. The scene graphics three-dimensional modeling includes a rack data model, an equipment graphics data model, and an indicator light status data model. The rack data model, the equipment graphics data model, and the indicator light status data model correspond to the rack graphics storage unit, the equipment graphics storage unit, and the indicator light operation status storage unit, respectively. In this embodiment, the computer room needs to be photographed and modeled before inspection. All scene photos are three-dimensionally modeled by the scene graphics modeling module, and the model data is classified and stored. During the inspection, a single and unified call is performed. Since the camera transmits the overall image in real time, the scene graphics analysis module will first uniformly call the overall data of the three data models, and then call the rack data model separately for comparison, and then compare the remaining two data models. Multiple comparisons ensure that the inspection data is correct.

[0030] More specifically, the positioning receiving module 523 uses a UWB chip to receive wireless signals. The UWB chip is matched and connected with the UWB transmitting module installed at the entrance of the computer room and the rack. In this embodiment, UWB indoor positioning technology is used as a positioning method. It not only has accurate positioning, but also has a fast response speed, good real-time performance, is not easily affected by environmental interference, and has lower power consumption, which is more conducive to building an inspection trajectory map for operation and maintenance personnel. Specifically, in this embodiment, the UWB positioning technology uses the TOA positioning algorithm, and the positioning receiving module is used as a label module. Taking the UWB chip at the entrance of the computer room and the UWB chips of two adjacent racks as examples, the entrance of the computer room is the first base station, and the two adjacent racks are the second and third base stations. The positioning receiving module can also transmit signals. By measuring the arrival time between the tag transmission signal to three or more base stations, the tag position is calculated by the formula, where x and y are the tag coordinates, and x 1 ,y 1 is the coordinate of the first base station, x 2 ,y 2 is the coordinate of the second base station, x 3 ,y 3 is the coordinate of the third base station, assuming c is the tag transmission signal speed, t is the time, the following calculation formula can be obtained:

[0031]

[0032] The above three formulas can be used to obtain the specific values ​​of the tag coordinates, thereby calculating the tag position. Since it is a near-field measurement, the signal transmission speed can ignore the distance difference, so the speed is the same. Only the time of a single tag signal transmission needs to be measured, which can reduce the time spent on measurement and generate the trajectory map of the operation and maintenance personnel more quickly.

[0033] To be more specific, a switch and a touch screen are provided on the side of the temple 2 away from the control main board 5. It can be more understood that a power supply system is also provided inside the temple, and the power supply system supplies power to all modules. When the device is in use, the device can be specifically operated through the touch screen. In one embodiment, a voice control system can also be provided to operate the device through voice, thereby improving the convenience of device operation.

[0034] The working principle of the present invention is as follows: before formal use, all computer rooms and equipment need to be photographed and modeled. When all equipment in the computer room is in normal operation, wear AR glasses and establish a connection with each computer room through the Bluetooth module. The Bluetooth name of each computer room has been set. When in a certain computer room, the control system 51 will upload the name of the paired computer room to the data center, displaying the location of the computer room where the operation and maintenance personnel are located at this time. At the same time, the positioning receiving module receives the signal sent by the UWB module at the computer room and rack position to locate the specific location of the operation and maintenance personnel. At this time, scene graphics shooting and modeling can be started, and the racks of each computer room and the equipment thereon are photographed through the camera 4. When shooting, it is necessary to ensure that all equipment indicator lights are recorded, and all captured images are stored in the scene graphics storage module 532 and uploaded to the data center for synchronous storage. At this time, the scene graphics modeling module 531 models the captured graphics, and classifies the scene models according to the Bluetooth name of the computer room, and classifies the corresponding rack positions and equipment positions. The classification number is based on the signal received by the positioning receiving module. After shooting and modeling each computer room, it is necessary to manually operate and archive it once to complete the shooting and modeling of the racks and equipment in the computer room. When all computer rooms are shot and modeled, you can start using AR glasses for daily inspections, and turn on camera 4 during the inspection. Enter the operation and maintenance inspection interface, the Bluetooth module 521 establishes a connection with the room to be inspected, the graphics processing system 53 automatically calls the scene graphics data model of the room, and the operation and maintenance personnel will receive the position signal sent by the UWB transmission module of each rack when passing through different racks, and automatically call the matched data model. The scene graphics analysis module 533 matches and analyzes the image captured by the camera 4 with the called data model. The matching information includes the rack number, equipment location, and equipment operation indicator light indication. When one of the information does not match, a prompt message will be issued, and the graphics processing system 53 will call the stored data again to re-match to ensure that the called rack data model is consistent with the inspected machine. The rack corresponds to the rack, and two comparisons are performed to ensure that the inspection results are correct. At this time, the indication of the equipment operation indicator light is finally confirmed. When the indicator light indication does not match the stored indicator light status data model, the control system 51 sends an alarm signal and sends the alarm signal to the data center through the WIFI module 522. At the same time, the display system 3 will display a red light alarm. The operation and maintenance personnel and data center managers can find abnormal equipment at the first time. The abnormal data is recorded and stored in the control system 51. When the inspection is completed, the operation and maintenance personnel generate an inspection report through the touch screen operation and send it to the data center. The management personnel can better manage the equipment in the computer room according to the inspection report.

[0035] The above description is only used to illustrate the technical solution of the present invention rather than to limit it. Other modifications or equivalent substitutions made to the technical solution of the present invention by ordinary technicians in this field should be included in the scope of the claims of the present invention as long as they do not depart from the spirit and scope of the technical solution of the present invention.

Claims

1. An AR smart recognition glasses for a power grid room, characterized in that: The invention comprises a spectacles frame (1) and spectacles legs (2); the spectacles frame (1) is provided with a display system (3); the spectacles legs (2) are provided with a camera (4); a control mainboard (5) is provided in one side of the spectacles legs (2); a control system (51) and a wireless transmission system (52) and a graphics processing system (53) connected to the control system (51) are provided on the control mainboard (5); the camera (4) is electrically connected to the display system (3), the wireless transmission system (52) and the graphics processing system (53); the display system (3) is electrically connected to the graphics processing system (53); the wireless transmission system (52) is connected to a data center via a wireless signal; and the graphics processing system (53) has a built-in scene graphics modeling module (531), a scene graphics storage module (532) and a scene graphics analysis module (533).

2. The AR smart recognition glasses for a power grid room according to claim 1, characterized in that: The wireless transmission system (52) comprises a Bluetooth module (521), a WIFI module (522), and a positioning receiving module (523); the Bluetooth module (521), the WIFI module (522), and the positioning receiving module (523) are all electrically connected to the control system (51); and the Bluetooth module (521) is connected to a Bluetooth module at the entrance of a power grid room.

3. The AR smart recognition glasses for power grid room according to claim 1, characterized in that: The control system (51) uses an MT 8768 processing chip and is equipped with an IMG GE 8300 graphics processing unit and is electrically connected to the graphics processing system (53).

4. The AR smart recognition glasses for a power grid room according to claim 1, characterized in that: The scene graphics storage module (532) comprises a rack graphics storage unit, a device graphics storage unit, and an indicator light running state storage unit.

5. The AR smart recognition glasses for power grid room according to claim 4, characterized in that: The scene graphics modeling module (531) receives the computer room graphics photographed by the camera (4), performs scene graphics three-dimensional modeling on the graphics photo, stores the model data in the scene graphics storage module (532), and also stores the original image photographed in the scene graphics storage module (532).

6. The AR smart recognition glasses for power grid room according to claim 5, characterized in that: The scene graphics three-dimensional modeling includes a rack graphics data model, a device graphics data model, and an indicator light operation status data model, and the rack graphics data model, the device graphics data model, and the indicator light operation status data model correspond to the rack graphics storage unit, the device graphics storage unit, and the indicator light operation status storage unit respectively.

7. The AR smart recognition glasses for a power grid room according to claim 2, characterized in that: The positioning receiving module (523) uses a UWB chip to receive wireless signals, and the UWB chip is matched and connected with the UWB transmitting module provided at the entrance of the power grid room and the rack.

8. The AR smart recognition glasses for power grid room according to claim 1, characterized in that: A switch and a touch screen are arranged on the side of the temple (2) away from the control main board (5).

9. The AR smart recognition glasses for a power grid room according to claim 1, characterized in that: The operating status of the racks, equipment, and equipment indicator lights in the computer room scene is modeled through the graphics processing system (53), and the control system (51) calls the data model of the computer room scene to compare with the real scene captured by the camera (4), so that all the equipment in the computer room can be quickly checked. When the operating status of the equipment indicator light shows an abnormality, the control system (51) uploads the identified computer room information and equipment information to the data center for alarm, and after the inspection of all computer rooms is completed, an inspection report can be generated, and the operation and maintenance management personnel can better make correct response operations based on the inspection report.

10. The AR smart recognition glasses for a power grid room according to claim 1, characterized in that: The control system (51) performs unified control over the overall operation of the equipment. First, it is necessary to establish a wireless connection with the computer room through the wireless transmission system (52) to locate the position of the inspection operation and maintenance personnel. When establishing the wireless connection, each computer room and rack has been set with a number name. The display system (3) and the data center can see the location of the operation and maintenance personnel in the map model, which is convenient for unified management. Secondly, after entering the computer room, you can start shooting and modeling the computer room. Through the scene graphic modeling module (531), the racks, equipment and equipment indicator lights photographed by the camera are graphically modeled. After the modeling is completed, the equipment number name is further set and saved, so that abnormal equipment number names can be quickly found during inspection, and more accurate reporting and maintenance can be performed. When all computer rooms complete data modeling, they are stored in the scene graphic storage module (532); During the subsequent inspection, the wireless transmission system (52) establishes a connection with the room to be inspected, the graphics processing system (53) automatically calls the scene graphics data model of the corresponding room, the scene graphics analysis module (533) receives the real-time image transmitted by the camera, and performs matching analysis with the called data model. The matching sequence includes rack number, equipment location, and equipment operation indicator light indication. First, it is necessary to ensure that the called rack number is consistent with the rack number of the real-time image transmission before the next comparison and judgment is carried out. The data model of the equipment location also includes the specific shape of the equipment. When the real-time image is consistent with the called data model, the matching of the equipment operation indicator light indication is started. The equipment operation status can be understood most quickly through the indicator light. If the comparison result of the equipment operation indicator light is abnormal, the control system (51) issues an abnormal alarm, and the display system (3) displays red in full screen. The abnormal data is synchronously transmitted to the data center through the wireless transmission system (52) for alarm prompt. The double-end synchronous alarm can respond faster and better in the shortest time.

Images