Electric power equipment identification method and device based on AR glasses, and electronic equipment
By using AR glasses to display the inspection process and identify images during power equipment inspection, the problems of high skill requirements, poor accuracy, low efficiency and high cost in the existing power equipment inspection methods are solved, and more efficient and accurate are achieved power equipment inspection.
Patent Information
- Application Number
- CN202310975462.4
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2023-08-03
- Publication Date
- 2025-02-14
AI Technical Summary
The existing power equipment inspection methods have high requirements for inspection personnel, poor accuracy, low efficiency and high cost.
The power equipment recognition method based on AR glasses is adopted to display the inspection process through the AR glasses, and images to be inspected are obtained and identified to obtain equipment information.
It improves the accuracy of equipment information identification of power equipment, improves patrol efficiency, reduces labor costs, allows inspection personnel to complete inspections without having high skills, and realizes simultaneous identification of multiple equipment.
Smart Images
Figure CN119445422A_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the fields of augmented reality (AR), the Internet and image processing technology, and in particular to a method, device and electronic device for identifying power equipment based on AR glasses. Background Art
[0002] With more and more power equipment in power rooms and substations, in order to ensure reliable and safe power transmission, inspection of power equipment, so as to understand the operating status of power equipment and troubleshoot has become an indispensable power operation task.
[0003] Related technologies: The inspection of power equipment mainly involves inspectors entering substations or power machine rooms to conduct visual inspections. This method requires high skills from inspectors and has problems such as poor accuracy, low inspection efficiency, and high labor costs. Summary of the invention
[0004] In order to solve the problems of high skill requirements for inspectors, poor accuracy, low inspection efficiency and high labor costs in the power equipment inspection method in the related technology, this application proposes a power equipment identification method, device and electronic device based on AR glasses.
[0005] On one hand, an embodiment of the present application proposes a method for identifying power equipment based on AR glasses, the method comprising: when an inspector wears AR glasses to inspect power equipment, displaying the inspection process corresponding to the inspector through the AR glasses, the inspection process including multiple power equipment to be inspected; acquiring at least one image to be inspected taken by the AR glasses, wherein each image to be inspected includes at least one of the multiple power equipment to be inspected; and identifying each image to be inspected to obtain equipment information of each power equipment to be inspected.
[0006] On the other hand, an embodiment of the present application proposes an AR glasses-based power equipment identification device, the device comprising: a display module, used to display the inspection process corresponding to the inspector through the AR glasses when the inspector wears the AR glasses to inspect the power equipment, the inspection process including multiple power equipment to be inspected; a first acquisition module, used to acquire at least one image to be inspected taken by the AR glasses, wherein each of the image to be inspected includes at least one of the multiple power equipment to be inspected; and an identification module, used to identify each of the images to be inspected to obtain equipment information of each of the power equipment to be inspected.
[0007] On the other hand, an embodiment of the present application proposes an electronic device, including: a memory and a processor; the memory stores computer instructions, and when the computer instructions are executed by the processor, the power equipment identification method based on AR glasses of the embodiment of the present application is implemented.
[0008] On the other hand, an embodiment of the present application proposes a non-transitory computer-readable storage medium storing computer instructions, wherein the computer instructions are used to enable the computer to execute the power equipment identification method based on AR glasses disclosed in an embodiment of the present application.
[0009] On the other hand, an embodiment of the present application proposes a computer program product, which, when an instruction processor in the computer program product executes, implements the power equipment identification method based on AR glasses in the embodiment of the present application.
[0010] The technical solution proposed in the embodiment of the present application is that during the process of the inspector wearing AR glasses to inspect the power equipment, the AR glasses display the inspection process corresponding to the inspector, the inspection process includes multiple power equipment to be inspected, and at least one image to be inspected obtained by the AR glasses is obtained, wherein each image to be inspected includes at least one of the multiple power equipment to be inspected, and each image to be inspected is identified to obtain the equipment information of each power equipment to be inspected. Therefore, during the process of the inspector inspecting the power equipment, the AR glasses display the inspection process corresponding to the inspector, so that the inspector can inspect the power equipment according to the inspection process set for it, standardize the inspection process of the power equipment, and assist in the identification of the equipment information of the power equipment through AR glasses, so that the identification process has a more immersive and operational sense, and assist in the inspection of the power equipment through the intelligent means of image recognition, which improves the recognition accuracy of the equipment information of the power equipment, improves the inspection efficiency, and reduces the labor cost in the inspection process, so that the inspector does not need to have high skills to realize the inspection of the power equipment. In addition, the embodiment of the present application can realize the simultaneous identification of multiple power equipment, further improving the inspection efficiency of the power equipment. BRIEF DESCRIPTION OF THE DRAWINGS
[0011] The accompanying drawings are used to better understand the present solution and do not constitute a limitation of the present application.
[0012] Figure 1 It is a flow chart of a method for identifying power equipment based on AR glasses according to an embodiment of the present application.
[0013] Figure 2 It is a flow chart of a method for identifying power equipment based on AR glasses according to another embodiment of the present application.
[0014] Figure 3It is a flow chart of a method for identifying power equipment based on AR glasses according to another embodiment of the present application.
[0015] Figure 4 It is a structural schematic diagram of an electric power equipment identification device based on AR glasses according to an embodiment of the present application.
[0016] Figure 5 is a block diagram of an electronic device according to an embodiment of the present application. DETAILED DESCRIPTION
[0017] Embodiments of the present invention are described in detail below, and examples of the embodiments are shown in the accompanying drawings, wherein the same or similar reference numerals throughout represent the same or similar elements or elements having the same or similar functions. The embodiments described below with reference to the accompanying drawings are exemplary and are intended to be used to explain the present application, and should not be construed as limiting the present application.
[0018] It should be noted that the acquisition, storage, use, and processing of data in the technical solution of this application are in compliance with the relevant provisions of national laws and regulations.
[0019] The power equipment inspection method in the related art has high requirements on the skills of the inspectors, and has problems such as poor accuracy, low inspection efficiency and high labor costs.
[0020] In response to the above-mentioned problems, the present application proposes an AR glasses-based power equipment identification method, device and electronic device, wherein the method displays the inspection process corresponding to the inspection personnel through the AR glasses during the process of the inspection personnel wearing AR glasses to inspect the power equipment, and the inspection process includes multiple power equipment to be inspected. After obtaining at least one image to be inspected taken by the AR glasses, wherein each image to be inspected includes at least one of the multiple power equipment to be inspected, each image to be inspected is identified to obtain the equipment information of each power equipment to be inspected.
[0021] Thus, during the process of the inspector wearing AR glasses to inspect the power equipment, the AR glasses display the inspection process corresponding to the inspector, the inspection process includes multiple power equipment to be inspected, and at least one image to be inspected taken by the AR glasses is obtained, wherein each image to be inspected includes at least one of the multiple power equipment to be inspected, and each image to be inspected is identified to obtain the equipment information of each power equipment to be inspected. Thus, during the process of the inspector inspecting the power equipment, the AR glasses display the inspection process corresponding to the inspector, so that the inspector can inspect the power equipment according to the inspection process set for it, standardize the inspection process of the power equipment, assist in the identification of the equipment information of the power equipment through AR glasses, so that the identification process has a more immersive and operational sense, and assist in the inspection of the power equipment through the intelligent means of image recognition, improve the recognition accuracy of the equipment information of the power equipment, improve the inspection efficiency, reduce the labor cost in the inspection process, so that the inspector does not need to have high skills, but can also realize the inspection of the power equipment. In addition, the embodiment of the present application can realize the simultaneous identification of multiple power equipment, further improving the inspection efficiency of the power equipment.
[0022] The following describes the power equipment identification method, device and electronic device based on AR glasses according to the embodiments of the present application with reference to the accompanying drawings.
[0023] Figure 1 It is a flow chart of an electric equipment identification method based on AR glasses according to an embodiment of the present application. It should be noted that the execution subject of the electric equipment identification method based on AR glasses provided in this embodiment is an electric equipment identification device based on AR glasses, and the electric equipment identification device based on AR glasses is referred to as the identification device below. The identification device can be implemented by software and / or hardware. The identification device in this embodiment can be AR glasses, or it can be an application configured in AR glasses. In the embodiment of the present application, the identification device is described as an intelligent inspection system configured in AR glasses. The intelligent inspection system is a system based on a new Web architecture built according to AR augmented reality technology, big data technology, Internet of Things and visual recognition technology.
[0024] like Figure 1 As shown, the power equipment identification method based on AR glasses may include the following steps 101-103.
[0025] Step 101, when the inspector wears AR glasses to inspect power equipment, the inspection process corresponding to the inspector is displayed through the AR glasses, and the inspection process includes multiple power equipment to be inspected.
[0026] In one embodiment, the inspection process corresponding to each inspector can be pre-set in the intelligent inspection system according to the department and role of the inspector, wherein the inspection process corresponding to inspectors in different departments and roles can be different. Therefore, when the inspector wears AR glasses to inspect power equipment, the inspection process corresponding to the inspector can be displayed through the AR glasses to guide the inspector's inspection content.
[0027] Among them, the power equipment to be inspected may include power equipment that the inspectors need to inspect, such as pressure plates, circuit breaker indicator lights, operating handles, status lights, button lights, pointer meters, cross lights, etc.
[0028] Among them, the multiple power equipment to be inspected can be equipment in the same power cabinet or in different power cabinets, and this application does not impose any restrictions on this.
[0029] Step 102: Acquire at least one image to be inspected captured by the AR glasses, wherein each image to be inspected includes at least one of the multiple electrical devices to be inspected.
[0030] In one embodiment, the inspection personnel can use the camera function of the AR glasses to photograph multiple power equipment to be inspected according to the inspection process to obtain at least one image to be inspected.
[0031] Wherein, when the image to be inspected includes one, the image to be inspected includes all the electric power equipment to be inspected. When the image to be inspected includes multiple images, each image to be inspected includes at least one electric power equipment to be inspected.
[0032] In one embodiment, the inspection process may also include an inspection sequence of multiple power devices to be inspected, so that the inspectors can use AR glasses to photograph each power device to be inspected in turn according to the inspection sequence to obtain multiple images to be inspected, each of which includes one or more power devices to be inspected. That is, when multiple images to be inspected are included, each image to be inspected is obtained by photographing multiple power devices to be inspected in the inspection sequence.
[0033] Step 103: identify each image to be inspected to obtain device information of each power device to be inspected.
[0034] The equipment information of the power equipment to be inspected includes at least one of the following: whether the power equipment to be inspected is in working state, in what working state, whether a fault occurs, the cause of the fault, operating parameters, and equipment attribute information.
[0035] The operating parameters may include the light color, voltage, and pointer meter readings of circuit breaker indicator lights, status lights, button lights, cross lights, etc.
[0036] The equipment attribute information may include the manufacturer, model, date of manufacture, rated current, rated current, and other information of the power equipment to be inspected.
[0037] In one embodiment, all the power devices to be inspected in all the images to be inspected may be identified simultaneously, thereby improving the efficiency of identifying the power devices and further improving the inspection efficiency of the power devices.
[0038] In one embodiment, after the device information of each power device to be inspected is identified, the device information of each power device to be inspected can be superimposed on the corresponding image to be inspected for display on the display screen of the AR glasses. The display mode of the device information includes at least one of text, sound, image, and three-dimensional model animation.
[0039] For example, when a certain image to be inspected includes a button light and a cross light, the image to be inspected can be displayed on the display screen of the AR glasses, and the device information of the button light can be superimposed on the position of the button light in the image to be inspected, and the device information of the cross light can be superimposed on the position of the cross light in the image to be inspected. In this way, the inspection personnel can intuitively see the identification results of each power device to be inspected through the AR glasses.
[0040] In addition, in the embodiment of the present application, the identification results of each power equipment to be inspected can be recorded according to the inspection order in the inspection process to form a report so that the entire inspection process can be reviewed later.
[0041] In summary, the power equipment identification method based on AR glasses provided in the embodiment of the present application, when the inspector wears AR glasses to inspect the power equipment, the inspection process corresponding to the inspector is displayed through the AR glasses, the inspection process includes multiple power equipment to be inspected, and at least one image to be inspected taken by the AR glasses is obtained, wherein each image to be inspected includes at least one of the multiple power equipment to be inspected, and each image to be inspected is identified to obtain the equipment information of each power equipment to be inspected. Therefore, by displaying the inspection process corresponding to the inspector during the inspection of the power equipment by the AR glasses, the inspector can inspect the power equipment according to the inspection process set for it, standardizing the inspection process of the power equipment, and assisting the identification of the equipment information of the power equipment with the help of AR glasses, so that the identification process has a more immersive and operational sense, and assisting the inspection of the power equipment with the intelligent means of image recognition, the accuracy of the identification of the equipment information of the power equipment is improved, the inspection efficiency is improved, and the labor cost during the inspection process is reduced, so that the inspector does not need to have high skills to realize the inspection of the power equipment. Furthermore, the embodiments of the present application can realize the simultaneous identification of multiple power equipment, further improving the inspection efficiency of the power equipment.
[0042] Combine the following Figure 2, the inspection process corresponding to the inspection personnel displayed on the AR glasses in an embodiment of the present application and the process of identifying each image to be inspected are explained.
[0043] Figure 2 1 is a flow chart of a method for identifying power equipment based on AR glasses according to another embodiment of the present application. This embodiment is a further refinement or optimization of the above embodiment.
[0044] like Figure 2 As shown, the power equipment identification method based on AR glasses may include the following steps 201-206.
[0045] Step 201, when the inspector wears AR glasses to inspect power equipment, the user name and password entered by the inspector on the AR glasses are received, and the inspector is authenticated according to the user name and password.
[0046] In one embodiment, when the inspector wears AR glasses to inspect power equipment, he can first open the intelligent inspection system and log in. Specifically, the AR glasses can first display the login interface of the intelligent inspection system, and the inspector can enter the user name and password on the login interface, so that the intelligent inspection system can authenticate the inspector according to the user name and password.
[0047] Among them, the intelligent inspection system includes a client configured in the AR glasses, and a background server connected to the client for communication. The background server is used for authentication and organizational structure management, including department management, role management and personnel management. After the inspection personnel enter the user name and password in the client's login interface, the user name and password can be sent from the client to the background server, which compares the password with the password corresponding to the user name stored in the system. If the comparison is consistent, it is determined that the inspection personnel authentication is passed. If the comparison is inconsistent, it is determined that the inspection personnel authentication is not passed.
[0048] Step 202, when the authentication is passed, the inspection process pre-set for the inspection personnel is obtained according to the user name of the inspection personnel, and the inspection process includes a plurality of power equipment to be inspected.
[0049] Step 203: The inspection process corresponding to the inspection personnel is displayed through AR glasses.
[0050] In one embodiment, in order to more reasonably distribute the inspection tasks and improve the inspection efficiency, the background server of the intelligent inspection system can perform organizational structure management, and pre-set the inspection process corresponding to each inspection personnel according to the department and role of the inspection personnel, among which the inspection process corresponding to inspection personnel in different departments and different roles can be different. Therefore, if the inspection personnel pass the authentication, the client of the intelligent inspection system can obtain the inspection process pre-set for the inspection personnel from the background server according to the user name of the inspection personnel, and display the inspection process corresponding to the inspection personnel through AR glasses to guide the inspection personnel on the inspection content.
[0051] Therefore, the inspection personnel can carry out the inspection of the power equipment according to the inspection process, and avoid affecting the inspection of the power equipment due to forgetting the inspection process.
[0052] In one embodiment, an inspection system database may be pre-set, and the inspection system database includes drawings, parameter tables, videos, pictures, three-dimensional models and other related information of various types of power equipment. When displaying the inspection process of the inspectors, at least one of the following information of at least one power equipment to be inspected may be attached as an attachment and displayed on the AR glasses at the same time: three-dimensional model, image, video, operation steps, precautions, so that the inspectors can understand the above information of the power equipment to be inspected as needed.
[0053] Step 204: Acquire at least one image to be inspected captured by the AR glasses, wherein each image to be inspected includes at least one of the multiple electrical devices to be inspected.
[0054] The specific implementation process and principle of step 204 may refer to the description of other embodiments and will not be repeated here.
[0055] Step 205 , in response to obtaining an image recognition instruction triggered by a key operation or voice from an inspection personnel, calling an image recognition model.
[0056] Among them, the image recognition model can be any convolutional neural network model or other neural network model that can realize image recognition, and this application does not impose any restrictions on this.
[0057] In one embodiment, an image recognition model can be pre-trained. When image recognition is needed, the inspection personnel can trigger the image recognition instruction through key operation or voice triggering to call the image recognition model for image recognition. The intelligent inspection system can call the image recognition model in response to obtaining the image recognition instruction triggered by the inspection personnel through key operation or voice.
[0058] In one embodiment, device images obtained by photographing multiple power devices through AR glasses under different lighting environments and different shooting angles, as well as sample device information of multiple power devices, can be obtained, and the image recognition model can be trained using this information. That is, the device images and sample device information are used to train the image recognition model.
[0059] The sample equipment information includes at least one of the following: whether the power equipment is in working state, in what working state, whether a fault occurs, the cause of the fault, operating parameters, and equipment attribute information.
[0060] In one embodiment, the acquired device images and sample device information of multiple power devices can be stored in the inspection system database to assist in acquiring the device information of each power device to be inspected. That is, the device images and sample device information are used to be stored in the inspection system database to assist in acquiring the device information of each power device to be inspected.
[0061] For example, after identifying the type of a certain electrical equipment to be inspected in the inspected image, whether it is in working condition, in what working condition, and the operating parameters, the property information of the equipment can be queried by querying the inspection system database, and the operating parameters can be compared with the normal operating parameters in the inspection system database, so as to determine whether the electrical equipment to be inspected has a fault and determine the cause of the fault.
[0062] Step 206: Use the image recognition model to recognize each image to be inspected, and obtain the equipment information of each power equipment to be inspected.
[0063] In one embodiment, each image to be inspected can be automatically identified by an image recognition model. For different types of power equipment, corresponding image recognition models can be trained respectively, so that each image to be inspected can be simultaneously feature extracted by each image recognition model, and each image to be inspected can be identified based on the extracted features to obtain device information of each power equipment to be inspected.
[0064] It should be noted that during the inspection of power equipment by inspection personnel, for power equipment that is not included in the inspection process, it is also possible to use AR glasses to capture images of the power equipment as needed, and call the image recognition model for identification to obtain the equipment information of the power equipment.
[0065] In summary, the power equipment identification method based on AR glasses provided in the embodiment of the present application receives the user name and password entered by the inspector on the AR glasses during the process of the inspector wearing AR glasses to inspect the power equipment, and authenticates the inspector based on the user name and password. If the authentication is successful, the inspection process pre-set for the inspector is obtained based on the user name of the inspector, and the inspection process includes multiple power equipment to be inspected. The inspection process corresponding to the inspector is displayed through the AR glasses, and at least one image to be inspected taken by the AR glasses is obtained, wherein each image to be inspected includes at least one of the multiple power equipment to be inspected. In response to obtaining an image recognition instruction triggered by a key operation or voice by the inspector, the image recognition model is called, and the image recognition model is used to identify each image to be inspected to obtain the equipment information of each power equipment to be inspected. Therefore, during the process of inspectors inspecting power equipment, AR glasses display the inspection process corresponding to the inspectors, so that the inspectors can inspect the power equipment according to the inspection process set for them, standardizing the inspection process of power equipment, and using AR glasses to assist in the identification of equipment information of power equipment, making the identification process more immersive and operational, and using image recognition as an intelligent means to assist in the inspection of power equipment, the accuracy of the identification of equipment information of power equipment is improved, the inspection efficiency is improved, and the labor cost during the inspection process is reduced, so that inspectors do not need to have high skills to realize the inspection of power equipment. In addition, the embodiment of the present application can realize the simultaneous identification of multiple power equipment, further improving the inspection efficiency of power equipment.
[0066] Combine the following Figure 3 , the power equipment identification method based on AR glasses provided in an embodiment of the present application is further explained.
[0067] Figure 3 FIG. 1 is a flow chart of a method for identifying power equipment based on AR glasses according to another embodiment of the present application. This embodiment is a further refinement or optimization of the above embodiment.
[0068] like Figure 3 As shown, the power equipment identification method based on AR glasses may include:
[0069] Step 301, when the inspector wears AR glasses to inspect power equipment, the inspection process corresponding to the inspector is displayed through the AR glasses, and the inspection process includes multiple power equipment to be inspected.
[0070] Step 302: Acquire at least one image to be inspected captured by the AR glasses, wherein each image to be inspected includes at least one of the multiple electrical devices to be inspected.
[0071] The specific implementation process and principle of steps 301 - 302 may refer to the description of other embodiments and will not be repeated here.
[0072] Step 303: for each image to be inspected, determine the first clarity of the image to be inspected according to the energy gradient function, and determine the second clarity of the image to be inspected according to the grayscale variance function.
[0073] Among them, the energy gradient function and the grayscale variance function are functions used to evaluate the clarity of the image. For related contents, please refer to the relevant technology and will not be described in detail here.
[0074] The first clarity and the second clarity are respectively the value of the energy gradient function and the value of the grayscale variance function calculated according to the image to be inspected.
[0075] Step 304: Determine the target clarity of the image to be inspected according to the first clarity and the second clarity.
[0076] In one embodiment, the ratio of the sum of the first clarity and the second clarity to the total number of pixels in the image to be inspected can be determined as the target clarity of the image to be inspected.
[0077] Step 305 : When the target definition is lower than a preset definition threshold, the image to be inspected is processed to improve the definition of the image to be inspected.
[0078] Among them, the preset clarity threshold can be set as needed, and this application does not impose any restrictions on this.
[0079] It is understandable that when the image is fully focused, the image is clearest and has the most high-frequency components. In the embodiment of the present application, the grayscale change can be used as the basis for focus evaluation. After obtaining the target clarity of each image to be inspected, when the target clarity is lower than the preset clarity threshold, the clarity of the image to be inspected can be converted into a percentage for calculation based on the target clarity, so as to improve the clarity of the image to be inspected taken when the camera of the AR glasses is not focused, thereby improving the accuracy of subsequent image recognition of the image to be inspected.
[0080] Step 306 , in response to obtaining an image recognition instruction triggered by a key operation or voice from an inspection personnel, calling an image recognition model.
[0081] Step 307: Use the image recognition model to recognize each image to be inspected, and obtain the equipment information of each power equipment to be inspected.
[0082] The specific implementation process and principle of steps 306-307 may refer to the description of other embodiments and will not be repeated here.
[0083] Step 308, obtaining a QR code image obtained by photographing the QR code set on the power equipment through AR glasses.
[0084] Among them, the power equipment can be the power equipment to be inspected included in the above-mentioned inspection process, or it can be other power equipment outside the inspection process, and this application does not impose any restrictions on this.
[0085] In one embodiment, a two-dimensional code may be set on the power equipment, and the two-dimensional code carries equipment information of the power equipment, including equipment attribute information of the power equipment, etc.
[0086] When inspectors wear AR glasses to inspect power equipment, they can shoot the QR code set on the power equipment as needed to obtain a QR code image, which can be one or more QR code images, so that the intelligent inspection system can obtain at least one QR code image.
[0087] Step 309, in response to obtaining a QR code recognition instruction triggered by a key operation or voice from an inspection personnel, calling a QR code recognition model.
[0088] Among them, the QR code recognition model can be any convolutional neural network model or other neural network model that can realize QR code image recognition, and this application does not impose any restrictions on this.
[0089] In one embodiment, a QR code recognition model can be pre-trained. When QR code image recognition is needed, the inspection personnel can trigger the QR code recognition instruction through key operation or voice triggering to call the QR code recognition model to perform QR code image recognition. The intelligent inspection system can call the QR code recognition model in response to obtaining the QR code recognition instruction triggered by the inspection personnel through key operation or voice triggering.
[0090] Step 310: Use a two-dimensional code recognition model to recognize the two-dimensional code image to obtain device information of the electric power device corresponding to the two-dimensional code image.
[0091] In one embodiment, each two-dimensional code image can be automatically recognized through a two-dimensional code recognition model to obtain device information of the power device corresponding to the two-dimensional code image.
[0092] Therefore, by setting the corresponding QR code on the power equipment, photographing the QR code with AR glasses to obtain a QR code image, and recognizing the QR code image, it is possible to obtain the equipment information of the power equipment through intelligent means, thereby improving the recognition accuracy of the equipment information of the power equipment, thereby improving the inspection efficiency, reducing the labor cost during the inspection process, and making it possible for inspection personnel to inspect the power equipment without having to have high skills.
[0093] Corresponding to the power equipment identification methods based on AR glasses provided in the above-mentioned embodiments, an embodiment of the present application also provides a power equipment identification device based on AR glasses. Since the power equipment identification device based on AR glasses provided in the embodiment of the present application corresponds to the power equipment identification methods based on AR glasses provided in the above-mentioned embodiments, the implementation method of the power equipment identification method based on AR glasses is also applicable to the power equipment identification device based on AR glasses provided in this embodiment, and will not be described in detail in this embodiment.
[0094] Figure 4 It is a structural schematic diagram of an electric power equipment identification device based on AR glasses according to an embodiment of the present application.
[0095] like Figure 4 As shown, the power equipment identification device 400 based on AR glasses includes: a display module 410, a first acquisition module 420 and an identification module 430.
[0096] The display module 410 is used to display the inspection process corresponding to the inspector through the AR glasses when the inspector wears the AR glasses to inspect the power equipment. The inspection process includes multiple power equipment to be inspected.
[0097] A first acquisition module 420 is used to acquire at least one image to be inspected captured by the AR glasses, wherein each image to be inspected includes at least one of the multiple power devices to be inspected;
[0098] The identification module 430 is used to identify each image to be inspected and obtain device information of each power device to be inspected.
[0099] In one embodiment of the present application, the power equipment identification device 400 based on AR glasses further includes:
[0100] A receiving module is used to receive the user name and password entered by the inspector on the AR glasses;
[0101] Authentication module, used to authenticate inspection personnel based on user name and password;
[0102] The second acquisition module is used to acquire the inspection process pre-set for the inspection personnel according to the user name of the inspection personnel when the authentication is passed.
[0103] In one embodiment of the present application, the inspection process further includes an inspection sequence of multiple power equipment to be inspected. When the images to be inspected include multiple images, each image to be inspected is obtained by photographing the multiple power equipment to be inspected in the inspection sequence;
[0104] And / or, the inspection process also includes at least one of a three-dimensional model, an image, a video, operation steps, and precautions of at least one electrical equipment to be inspected.
[0105] In one embodiment of the present application, the power equipment identification device 400 based on AR glasses further includes:
[0106] A first calling module is used to call the image recognition model in response to obtaining an image recognition instruction triggered by a key operation or voice of an inspection personnel;
[0107] Correspondingly, the recognition module 430 is used to use an image recognition model to recognize each image to be inspected, and obtain the equipment information of each power equipment to be inspected.
[0108] In one embodiment of the present application, the power equipment identification device 400 based on AR glasses further includes:
[0109] A third acquisition module is used to acquire device images of multiple power devices captured by AR glasses under different lighting environments and different shooting angles, and to acquire sample device information of multiple power devices;
[0110] The device image and sample device information are used to train the image recognition model and / or are stored in the inspection system database to assist in obtaining the device information of each power device to be inspected.
[0111] In one embodiment of the present application, the power equipment identification device 400 based on AR glasses further includes:
[0112] A first determination module is used to determine, for each image to be tested, a first clarity of the image to be tested according to an energy gradient function, and to determine a second clarity of the image to be tested according to a grayscale variance function;
[0113] A second determination module, used to determine a target clarity of the image to be inspected according to the first clarity and the second clarity;
[0114] The processing module is used to process the image to be inspected to improve the clarity of the image to be inspected when the target clarity is lower than a preset clarity threshold.
[0115] In one embodiment of the present application, the power equipment identification device 400 based on AR glasses further includes:
[0116] A fourth acquisition module is used to acquire a QR code image obtained by photographing a QR code set on the power equipment through AR glasses;
[0117] The second calling module is used to call the QR code recognition model in response to obtaining the QR code recognition instruction triggered by the inspection personnel through key operation or voice;
[0118] The recognition module is also used to: use a two-dimensional code recognition model to recognize the two-dimensional code image to obtain equipment information of the power equipment corresponding to the two-dimensional code image.
[0119] In one embodiment of the present application, the display module 410 is further used to superimpose the device information of each power device to be inspected on the corresponding image to be inspected for display on the display screen of the AR glasses;
[0120] The display mode of the device information includes at least one of text, sound, image, and three-dimensional model animation;
[0121] The equipment information includes at least one of the following: whether the power equipment to be inspected is in working state, in what working state, whether a fault occurs, the cause of the fault, operating parameters, and equipment attribute information.
[0122] In the power equipment identification device based on AR glasses of the embodiment of the present application, during the process of the inspector wearing AR glasses to inspect the power equipment, the inspection process corresponding to the inspector is displayed by AR glasses, and the inspection process includes multiple power equipment to be inspected, and at least one image to be inspected obtained by AR glasses is obtained, wherein each image to be inspected includes at least one of the multiple power equipment to be inspected, and each image to be inspected is identified to obtain the equipment information of each power equipment to be inspected. Therefore, by displaying the inspection process corresponding to the inspector in the process of the inspector inspecting the power equipment, the inspector can inspect the power equipment according to the inspection process set for it, standardizing the inspection process of the power equipment, and assisting the identification of the equipment information of the power equipment with AR glasses, so that the identification process has a more immersive and operational sense, and assisting the inspection of the power equipment with the intelligent means of image recognition, the accuracy of the identification of the equipment information of the power equipment is improved, the inspection efficiency is improved, and the labor cost in the inspection process is reduced, so that the inspector does not need to have high skills to realize the inspection of the power equipment. In addition, the embodiment of the present application can realize the simultaneous identification of multiple power equipment, further improving the inspection efficiency of the power equipment.
[0123] According to an embodiment of the present application, the present application also provides an electronic device, comprising: a memory, a processor, and a computer program stored in the memory and executable on the processor, characterized in that when the processor executes the computer program, it implements the method for identifying power equipment based on AR glasses as in the aforementioned embodiment.
[0124] According to an embodiment of the present application, the present application also provides a non-transitory computer-readable storage medium storing computer instructions, wherein the computer instructions are used to enable the computer to execute the power equipment identification method based on AR glasses disclosed in an embodiment of the present application.
[0125] like Figure 5 As shown in FIG. 1 , it is a block diagram of an electronic device according to an embodiment of the present application. Figure 5 As shown, the electronic device includes:
[0126] Memory 501 , processor 502 , and computer instructions stored in the memory 501 and executable on the processor 502 .
[0127] When the processor 502 executes the instructions, the power equipment identification method based on AR glasses provided in the above embodiment is implemented.
[0128] Furthermore, the electronic device further comprises:
[0129] The communication interface 503 is used for communication between the memory 501 and the processor 502 .
[0130] The memory 501 is used to store computer instructions that can be executed on the processor 502 .
[0131] The memory 501 may include a high-speed RAM memory, and may also include a non-volatile memory (non-volatile memory), such as at least one disk memory.
[0132] The processor 502 is used to implement the power equipment identification method based on AR glasses of the above embodiment when executing the program.
[0133] If the memory 501, the processor 502 and the communication interface 503 are implemented independently, the communication interface 503, the memory 501 and the processor 502 can be connected to each other through a bus and communicate with each other. The bus can be an Industry Standard Architecture (ISA) bus, a Peripheral Component (PCI) bus or an Extended Industry Standard Architecture (EISA) bus. The bus can be divided into an address bus, a data bus, a control bus, etc. For ease of representation, Figure 5 Only one thick line is used in the diagram, but this does not mean that there is only one bus or only one type of bus.
[0134] Optionally, in a specific implementation, if the memory 501, the processor 502 and the communication interface 503 are integrated on a chip, the memory 501, the processor 502 and the communication interface 503 can communicate with each other through an internal interface.
[0135] The processor 502 may be a central processing unit (CPU), or an application specific integrated circuit (ASIC), or one or more integrated circuits configured to implement the embodiments of the present application.
[0136] The present application also proposes a computer program product, which, when an instruction processor in the computer program product executes, implements the power equipment identification method based on AR glasses of an embodiment of the present application.
[0137] In the description of this specification, the description with reference to the terms "one embodiment", "some embodiments", "example", "specific example", or "some examples" etc. means that the specific features, structures, materials or characteristics described in conjunction with the embodiment or example are included in at least one embodiment or example of the present application. In this specification, the schematic representations of the above terms do not necessarily refer to the same embodiment or example. Moreover, the specific features, structures, materials or characteristics described may be combined in any one or more embodiments or examples in a suitable manner. In addition, those skilled in the art may combine and combine the different embodiments or examples described in this specification and the features of the different embodiments or examples, without contradiction.
[0138] In addition, the terms "first" and "second" are used for descriptive purposes only and should not be understood as indicating or implying relative importance or implicitly indicating the number of the indicated technical features. Therefore, the features defined as "first" and "second" may explicitly or implicitly include at least one of the features. In the description of this application, the meaning of "plurality" is at least two, such as two, three, etc., unless otherwise clearly and specifically defined.
[0139] Any process or method description in a flowchart or otherwise described herein may be understood to represent a module, fragment or portion of code comprising one or more executable instructions for implementing the steps of a custom logical function or process, and the scope of the preferred embodiments of the present application includes alternative implementations in which functions may not be performed in the order shown or discussed, including performing functions in a substantially simultaneous manner or in the reverse order depending on the functions involved, which should be understood by technicians in the technical field to which the embodiments of the present application belong.
[0140] The logic and / or steps represented in the flowchart or otherwise described herein, for example, can be considered as an ordered list of executable instructions for implementing logical functions, and can be embodied in any computer-readable medium for use by an instruction execution system, device or apparatus (such as a computer-based system, a system including a processor, or other system that can fetch instructions from an instruction execution system, device or apparatus and execute the instructions), or in combination with these instruction execution systems, devices or apparatuses. For the purpose of this specification, "computer-readable medium" can be any device that can contain, store, communicate, propagate or transmit a program for use by an instruction execution system, device or apparatus, or in combination with these instruction execution systems, devices or apparatuses. More specific examples of computer-readable media (a non-exhaustive list) include the following: an electrical connection with one or more wires (electronic device), a portable computer disk box (magnetic device), a random access memory (RAM), a read-only memory (ROM), an erasable and programmable read-only memory (EPROM or flash memory), a fiber optic device, and a portable compact disk read-only memory (CDROM). In addition, the computer-readable medium may even be paper or other suitable medium on which the program is printed, since the program may be obtained electronically, for example, by optically scanning the paper or other medium and then editing, interpreting or otherwise processing in a suitable manner if necessary, and then stored in a computer memory.
[0141] It should be understood that the various parts of the present application can be implemented by hardware, software, firmware or a combination thereof. In the above-mentioned embodiments, multiple steps or methods can be implemented by software or firmware stored in a memory and executed by a suitable instruction execution system. For example, if implemented by hardware, as in another embodiment, it can be implemented by any one of the following technologies known in the art or their combination: a discrete logic circuit having a logic gate circuit for implementing a logic function for a data signal, a dedicated integrated circuit having a suitable combination of logic gate circuits, a programmable gate array (PGA), a field programmable gate array (FPGA), etc.
[0142] A person skilled in the art may understand that all or part of the steps in the method for implementing the above-mentioned embodiment may be completed by instructing related hardware through a program, and the program may be stored in a computer-readable storage medium, which, when executed, includes one or a combination of the steps of the method embodiment.
[0143] In addition, each functional unit in each embodiment of the present application may be integrated into a processing module, or each unit may exist physically separately, or two or more units may be integrated into one module. The above-mentioned integrated module may be implemented in the form of hardware or in the form of a software functional module. If the integrated module is implemented in the form of a software functional module and sold or used as an independent product, it may also be stored in a computer-readable storage medium.
[0144] The storage medium mentioned above may be a read-only memory, a magnetic disk or an optical disk, etc. Although the embodiments of the present application have been shown and described above, it can be understood that the above embodiments are exemplary and cannot be understood as limiting the present application. A person of ordinary skill in the art may change, modify, replace and modify the above embodiments within the scope of the present application.
Claims
1. A method for identifying power equipment based on augmented reality AR glasses, characterized in that: The method comprises: When an inspector wears AR glasses to inspect power equipment, the AR glasses display the inspection process corresponding to the inspector, and the inspection process includes multiple power equipment to be inspected; Acquire at least one image to be inspected captured by the AR glasses, wherein each of the images to be inspected includes at least one of the multiple electrical devices to be inspected; Each of the images to be inspected is identified to obtain device information of each of the power devices to be inspected.
2. The method according to claim 1, characterized in that Before displaying the inspection process corresponding to the inspection personnel, the method further includes: Receiving a user name and password entered by the inspector on the AR glasses, and authenticating the inspector according to the user name and the password; When the authentication is passed, the inspection process pre-set for the inspection personnel is obtained according to the user name of the inspection personnel.
3. The method according to claim 1, characterized in that The inspection process also includes an inspection sequence of the plurality of power devices to be inspected. When the plurality of images to be inspected are included, each of the images to be inspected is obtained by photographing the plurality of power devices to be inspected according to the inspection sequence. And / or, the inspection process also includes at least one of a three-dimensional model, an image, a video, an operation procedure, and precautions of the power equipment to be inspected.
4. The method according to claim 1, characterized in that: Before identifying each of the images to be inspected and obtaining the equipment information of each of the electric power equipment to be inspected, the method further includes: In response to obtaining an image recognition instruction triggered by a key operation or voice of the inspection personnel, calling an image recognition model; The identifying of each of the images to be inspected to obtain the equipment information of each of the electric power equipment to be inspected includes: The image recognition model is used to recognize each of the images to be inspected, and equipment information of each of the electric power equipment to be inspected is obtained.
5. The method according to claim 4, characterized in that The method further comprises: Acquire device images of a plurality of power devices captured by the AR glasses under different lighting environments and at different shooting angles, and acquire sample device information of the plurality of power devices; The device image and the sample device information are used to train the image recognition model and / or are stored in the inspection system database to assist in obtaining the device information of each of the power devices to be inspected.
6. The method according to any one of claims 1 to 5, characterized in that Before identifying each of the images to be inspected and obtaining the equipment information of each of the electric power equipment to be inspected, the method further includes: For each image to be inspected, determining a first clarity of the image to be inspected according to an energy gradient function, and determining a second clarity of the image to be inspected according to a grayscale variance function; Determining a target clarity of the image to be inspected according to the first clarity and the second clarity; When the target definition is lower than a preset definition threshold, the image to be inspected is processed to improve the definition of the image to be inspected.
7. The method according to any one of claims 1 to 5, characterized in that The method further comprises: Acquire a two-dimensional code image obtained by photographing a two-dimensional code set on the power equipment through the AR glasses; In response to obtaining a QR code recognition instruction triggered by the inspection personnel through key operation or voice, calling a QR code recognition model; The two-dimensional code recognition model is used to recognize the two-dimensional code image to obtain device information of the electric power device corresponding to the two-dimensional code image.
8. The method according to any one of claims 1 to 5, characterized in that After identifying each of the images to be inspected and obtaining the equipment information of each of the electric power equipment to be inspected, the method further includes: On the display screen of the AR glasses, the device information of each of the power devices to be inspected is superimposed on the corresponding image to be inspected for display; The display mode of the device information includes at least one of text, sound, image, and three-dimensional model animation; The device information includes at least one of the following: whether the power equipment to be inspected is in working state, in what working state, whether a fault occurs, the cause of the fault, operating parameters, and device attribute information.
9. An electric power equipment identification device based on AR glasses, characterized in that: The device comprises: A display module is used to display the inspection process corresponding to the inspector through the AR glasses when the inspector wears the AR glasses to inspect the power equipment, and the inspection process includes multiple power equipment to be inspected; A first acquisition module, configured to acquire at least one image to be inspected captured by the AR glasses, wherein each of the images to be inspected includes at least one of the plurality of power devices to be inspected; The identification module is used to identify each of the images to be inspected and obtain the equipment information of each of the electric power equipment to be inspected.
10. An electronic device, characterized in that: include: A memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor implements the method according to any one of claims 1 to 8 when executing the computer program.