Wearable Augmented Reality Device and Quality Control Method for Electric Power Equipment Materials

Abstract

The present application provides a wearable augmented reality device and a method for quality control of power equipment materials. The device includes: a cap body including a head ring structure; an augmented reality display module installed on the outer wall of the first side of the head ring structure for displaying the quality control data processed by the calculation module, where the quality control data is used to characterize whether the corresponding power equipment materials meet the power production requirements; a calculation module installed on the outer wall of the second side of the head ring structure, communicating with the augmented reality display module, for performing operations on the source data collected by the augmented reality display module to obtain the quality control data of the power equipment materials, wherein the outer wall of the first side and the outer wall of the second side are opposite in position. The intelligent quality control of power equipment materials is realized.

Description

Technical Field

[0001] The present application relates to the field of power systems, and more particularly, to a wearable augmented reality device and a method for quality control of power equipment materials. Background Art

[0002] The processes of quality control, inspection, etc. of power equipment materials involve multiple links, mainly including the preparation of preliminary materials, implementation, and summary stages. There are also close information connections between different links, and they must be carried out strictly in accordance with corresponding standards and requirements. For the power industry, it is of great significance to implement standardized management and informatized monitoring.

[0003] Existing augmented reality display devices applied to the statistics and detection of power data are not applied to the quality control process of power equipment materials. Moreover, the work processes of quality control of power equipment materials mostly rely on manual labor, with a relatively large deviation in the standardization of monitoring and management. There is a lack of an intelligent device or digital system that can record and manage the entire process of quality control of power equipment materials in a modern and intelligent manner. Summary of the Invention

[0004] The main purpose of the present application is to provide a wearable augmented reality device and a method for quality control of power equipment materials, so as to solve the problem in the prior art that there is a lack of a solution for intelligently implementing quality control of power equipment materials.

[0005] To achieve the above object, according to one aspect of the present application, there is provided a wearable augmented reality device for quality control of power equipment materials, characterized by comprising: a cap body including a head ring structure; an augmented reality display module installed on the outer wall of the first side of the head ring structure for displaying the quality control data processed by the calculation module, the quality control data being used to represent whether the corresponding power equipment materials meet the power production requirements; the calculation module installed on the outer wall of the second side of the head ring structure and communicating with the augmented reality display module for performing operations on the source data collected by the augmented reality display module to obtain the quality control data of the power equipment materials, wherein the outer wall of the first side and the outer wall of the second side are opposite in position.

[0006] According to another aspect of the present application, a quality control method for power equipment materials is provided. The method is applied to the computing module in any of the wearable augmented reality devices. The wearable augmented reality device further includes a ranging and temperature measurement module and a positioning module. The ranging and temperature measurement module is installed on the outer wall of the head ring structure through a card slot and is located between the augmented reality display module and the bracket connector. The positioning module is installed inside the computing module and is used to locate the power equipment materials, including: the computing module acquires the image data of the power equipment materials captured by the augmented reality display module; the computing module acquires the temperature information and distance information of the power equipment materials measured by the ranging and temperature measurement module; the computing module acquires the position information of the power equipment materials measured by the positioning module; the computing module processes the image data of the power equipment materials, the temperature information, distance information, and position information of the power equipment materials to obtain the quality control data of the power equipment materials, and the quality control data is used to characterize whether the corresponding power equipment materials meet the power production requirements.

[0007] Applying the technical solution of the present application can provide future-oriented computing capabilities, improve local processing capabilities and decision-making capabilities, support running more advanced and complex algorithms locally, support the expansion and upgrade of more sensors, and support the access of more industrial-level application interfaces in the future. The high-computing power computing module is also a detachable design, and it can be operated and upgraded separately when developing customized functions for the quality control of power equipment materials. BRIEF DESCRIPTION OF THE DRAWINGS

[0008] The schematic diagrams of the drawings forming a part of the present application are used to provide a further understanding of the present application. The schematic embodiments and descriptions thereof of the present application are used to explain the present application and do not constitute an improper limitation to the present application. In the drawings:

[0009] Figure 1 The schematic diagram of the first wearable augmented reality device according to the embodiment of the present application is shown;

[0010] Figure 2 The schematic diagram of the second wearable augmented reality device according to the embodiment of the present application is shown;

[0011] Figure 3 The flowchart of the quality control method for power equipment materials according to the embodiment of the present application is shown;

[0012] Figure 4 The flowchart of a specific quality control method for power equipment materials according to the embodiment of the present application is shown;

[0013] Figure 5 The schematic diagram of the optical waveguide according to the embodiment of the present application is shown.

[0014] Among them, the above-mentioned drawings include the following reference numerals:

[0015] 10. Cap body; 11. Head ring structure; 20. Augmented reality display module; 30. Computing module; 12. Safety protection helmet; 13. Headwear; 14. Bracket connector; 21. Binocular perception camera module; 22. Structured light module; 23. Light waveguide display module; 40. Positioning damping rotating shaft; 50. Distance measurement and temperature measurement module; 60. Removable battery module; 70. Positioning module; 80. First external speaker; 90. Second external speaker; 100. NFC chip; 110. Buckle. Detailed implementation manners

[0016] It should be noted that the following detailed description is illustrative and is intended to provide further explanation of the present application. Unless otherwise specified, all technical and scientific terms used herein have the same meaning as commonly understood by those of ordinary skill in the technical field to which the present application belongs.

[0017] It should be noted that the terms used herein are only for describing the specific implementation manners and are not intended to limit the exemplary implementation manners of the present application. As used herein, unless the context clearly indicates otherwise, the singular form is also intended to include the plural form. In addition, it should be understood that when the terms "comprise" and / or "include" are used in this specification, they indicate the presence of features, steps, operations, devices, components, and / or combinations thereof.

[0018] It should be understood that when an element (such as a layer, film, region, or substrate) is described as being "on" another element, the element can be directly on the other element, or there can also be an intermediate element. Moreover, in the specification and claims, when an element is described as being "connected" to another element, the element can be "directly connected" to the other element, or "connected" to the other element through a third element.

[0019] For the convenience of description, the following explains some nouns or terms related to the embodiments of the present application:

[0020] Quality control: It refers to the quality monitoring in the process from raw material control, production and processing, product manufacturing, finished product inspection to finished product warehousing.

[0021] As introduced in the background art, there is a lack of a solution for intelligently implementing quality control of power equipment materials in the prior art. To solve the problem of lacking a solution for intelligently implementing quality control of power equipment materials, the embodiments of the present application provide a wearable augmented reality device and a method for quality control of power equipment materials.

[0022] Embodiments of the present application provide a wearable augmented reality device applied to quality control of power equipment materials, such as Figure 1 shown, including:

[0023] A cap body 10, including a head ring structure 11;

[0024] Specifically, a rotary fixing ring is placed at the back of the head ring, which can adapt to different head circumferences;

[0025] Specifically, the user can wear it through the head ring structure;

[0026] An augmented reality display module 20, installed on the outer wall of the first side of the head ring structure 11, is used to display the quality control data processed by the calculation module 30. The quality control data is used to characterize whether the corresponding power equipment materials meet the power production requirements;

[0027] A calculation module 30, installed on the outer wall of the second side of the head ring structure 11, communicates with the augmented reality display module 20, and is used to perform operations on the source data collected by the augmented reality display module 20 to obtain the quality control data of the power equipment materials. Among them, the outer walls of the first side and the second side are opposite in position.

[0028] In addition, in order to reduce the wearing fatigue of the operators, lightweight materials are selected for production under the condition of ensuring the mechanical strength of the materials and suitable installation.

[0029] Specifically, the calculation module selects a high-computing power calculation module, which is fixed at the rear of the cap body in the form of a card slot. When upgrading its hardware module, it only needs to be removed from the card slot and a new calculation module is inserted, which is plug-and-play; there are two methods for upgrading its software operating system. One is to obtain the upgrade file by configuring the same IP address through networking; the other is to connect a personal computer and the high-computing power calculation module with a communication line, and pack and send the upgrade file from the computer to the high-computing power calculation module;

[0030] Specifically, the high-computing power computing platform is equipped with sensors at the level of autonomous driving, such as lidar, depth camera, infrared ranging and temperature measuring devices; it supports a series of mobile communication technologies such as WIFI and Bluetooth, with unified protocols and convenient interface design, which can save costs very well; it supports a smart power management solution with hot-swap technology and fast-charging technology, effectively improving the all-weather battery life and the entire life cycle of the device.

[0031] The present invention adopts a high computing power computing module, which can provide future-oriented computing power, improve local processing and decision-making capabilities, support the operation of more advanced and complex algorithms locally, support the expansion and upgrade of more sensors, and support the access of more industrial-level application interfaces in the future. The high computing power computing module is also a detachable design, and can be operated and upgraded separately when developing customized functions for the quality control of power equipment materials.

[0032] The wearable augmented reality device of the present application includes a cap body, an augmented reality display module, and a computing module. Since the cap body has a head ring structure, it can be worn. The computing module communicates with the augmented reality display module and is used to operate on the source data collected by the augmented reality display module to obtain the quality control data of power equipment materials, realizing intelligent quality control of power equipment materials while being wearable.

[0033] The wearable augmented reality device of the present application has characteristics such as explosion-proof, waterproof, dust-proof, anti-static, and anti-corrosion, and supports high-decibel industrial noise environments.

[0034] As Figure 1 and Figure 2 shown, a raised part is fixedly arranged on the outer wall of the head ring structure 11. The cap body 10 further includes:

[0035] A safety protection helmet 12;

[0036] Specifically, the head ring type augmented reality power equipment material quality control wearable device includes a head ring structure and the main body of the augmented reality power equipment material quality control wearable device, which only lacks a safety protection helmet compared with the helmet type augmented reality power equipment material quality control wearable device. There are two buckles 110 on the side of the head ring main body to adjust the tightness when wearing the head ring.

[0037] Among them, a rotary fixing ring is placed at the back of the head part of the safety protection helmet, which can adapt to different head circumferences.

[0038] The headgear 13 is attached and fixed above the safety protection helmet 12 and combined with the safety protection helmet 12 to form a head cover structure;

[0039] Specifically, the headgear is selected as an ergonomic headgear, the safety protection helmet is selected as an ergonomic helmet, and the helmet module adopts an ergonomic bracket, which can ensure the comfort of long-term wearing and the stability in harsh working environments;

[0040] The bracket connector 14 has a first end and a second end. The first end is fixed on the headgear 13, and the second end has a through-hole structure. The raised part passes through the through-hole structure to fix the head cover structure above the head ring structure 11.

[0041] That is to say, in addition to the head-ring structure, there is also a helmet structure, and either of the two can be selected for wearing. The helmet-type device is convenient for use during the quality control of outdoor power equipment supplies, ensuring the safety of operators to the greatest extent; during the quality control of indoor power equipment supplies, removing the bracket connector on the safety helmet turns it into a head-ring device, which can greatly reduce the fatigue of operators.

[0042] Further, as Figure 1 and Figure 2 shown, the augmented reality display module 20 includes:

[0043] The binocular perception camera module 21 includes a first camera and a second camera;

[0044] Specifically, the binocular perception camera module acquires the image of the power equipment directly in front of it;

[0045] Specifically, the binocular perception camera module selects a binocular VSLAM perception camera module. The binocular VSLAM perception camera module is fixed on the cap body in a spiral manner, and it can be independently upgraded according to actual needs. The upgrade only requires replacing the edge computing chip or inertial measurement unit in the module, and there is no need to re-register this module. If the camera module is accidentally worn during work, or a longer focal length lens is needed, etc., the camera module can be independently replaced, without affecting the hardware system of other parts of the device.

[0046] The structured light module 22 is installed between the first camera and the second camera, and the binocular perception camera module 21 and the structured light module 22 are combined into a strip-shaped sensing module;

[0047] Both the binocular perception camera module and the structured light module are detachably arranged, reducing the possibility of their damage and well ensuring their accuracy during work.

[0048] The present invention adopts a scheme that combines a binocular VSLAM perception camera module, a structured light sensor, and an inertial measurement unit, and combines active and passive sensors, meeting the advanced technology level of autonomous driving, achieving high-level positioning accuracy, being able to realize perfect support for multi-degree-of-freedom functions, and being able to meet more application scenarios and complex applications compared with a single vision scheme, and being more adaptable to the all-weather, multi-environment, and intelligent requirements of power equipment supplies quality control equipment. The binocular VSLAM perception camera module, the structured light sensor, and the inertial measurement unit are all designed to be detachable, reducing the possibility of their damage and well ensuring their accuracy during work. The binocular VSLAM perception camera module is fixed on the helmet in a spiral manner, and it can be independently upgraded according to actual needs. The upgrade only requires replacing the edge computing chip or inertial measurement unit in the module, and there is no need to re-register this module, thus completing the upgrade work.

[0049] The optical waveguide display module 23 is installed below the strip-shaped sensing module, and the lens of the optical waveguide display module 23 is fixed by clamping at both ends. The lens on the high-definition optical waveguide display module is fixed by clamping on both sides. When the optical waveguide technology is upgraded, the old lens can be directly removed and a new one can be installed, which is convenient and fast.

[0050] The augmented reality display module adopting the binocular optical waveguide solution can also reduce the work fatigue of the staff and increase the efficiency; the augmented reality display module adopts an optical module bracket to ensure quick switching and solve the problem of pupil adaptation.

[0051] The present invention adopts an optical waveguide display module, which is lighter than the prism and free-form surface optical solutions and can provide a larger viewing angle at the same time, and can have a more comfortable wearing experience. The light engine in the optical waveguide display module is lighter, and the provided light source is clearer, which can provide better light transmittance and field of view, can be expanded from multiple dimensions, has stronger adaptability, greatly guarantees the later upgrade and transformation requirements of the optical waveguide display module, and can make the staff safer during the line inspection process and the equipment and material quality control process. The optical waveguide display module is detachable, can be installed and used immediately, is convenient for storage, and is beneficial to the protection of such high-precision and sophisticated equipment as the optical waveguide display module, reducing the possibility of its damage. The optical waveguide display module can realize the upward flip function, effectively reducing the fatigue degree of the staff during use. The lens on the high-definition optical waveguide display module is fixed by clamping on both sides. When the optical waveguide technology is upgraded, the old lens can be directly removed and a new one can be installed, which is convenient and fast.

[0052] The depth high-definition camera and fill light device adopted by the present invention adopt advanced image processing algorithms and can provide the film and television shooting level of mainstream mobile phones, which can provide clear video signals for remote experts to assist the on-site staff in collaborative work.

[0053] Further, as Figure 1 and Figure 2 shown, a positioning damping rotating shaft 40 is fixedly arranged on the outer wall of the head ring structure 11, and one end of the optical waveguide display module 23 is connected to the positioning damping rotating shaft 40. Specifically, the positioning damping rotating shaft 40 is made of high-strength alloy material. The optical waveguide display module can realize the upward flipping function through the positioning damping rotating shaft, which can ensure the usability and comfort of the wearable device and reduce the eye fatigue of the staff at the same time.

[0054] Further, as Figure 2 shown, the wearable augmented reality device further includes:

[0055] A ranging and temperature measuring module 50 is installed on the outer wall of the head ring structure 11 through a card slot and is located between the augmented reality display module 20 and the bracket connector 14.

[0056] Specifically, an infrared ranging and temperature measuring module is selected and fixed on the device by a slot-type design. It can be conveniently replaced according to the accuracy requirements of quality control. Specifically, infrared ranging and temperature measuring modules with different accuracies are selected according to the accuracy requirements of quality control.

[0057] Furthermore, as Figure 1 shown, the wearable augmented reality device further includes at least one of the following:

[0058] A detachable battery module 60, which is installed at the tail of the cap body 10; in addition, detachable battery modules can also be set at the tail and head (front and rear) of the cap body at the same time, supporting the hot plug technology without shutting down, performing redundant backup on the key components of the power supply device, and being able to replace the faulty power supply and expand and change the system without interrupting the system operation, thereby improving the system's ability to recover from disasters in a timely manner, scalability and flexibility, etc. At the same time, an intelligent power management solution with fast charging technology is set, which can effectively improve the all-weather battery life and the entire life cycle of the device. At the same time, the detachable battery module can be configured and updated with the power management solution separately through the upper computer;

[0059] A positioning module 70, which is installed inside the computing module 30 and is used to locate the materials of power equipment. It is convenient to obtain the geographical location information of the quality control target of power equipment and helps the information security of the quality control work of power equipment.

[0060] Furthermore, as Figure 1 shown, the head ring structure 11 has receiving cavities on opposite sides, namely a first receiving cavity and a second receiving cavity. A first external speaker 80 is arranged in the first receiving cavity, and a second external speaker 90 is arranged in the second receiving cavity; and / or, an NFC chip 100 is installed on the outer wall of the head ring structure 11 close to the augmented reality display module 20, and the NFC chip 100 is used to enter information. In the middle position on both sides of this device, sunken external speakers are placed, and sound outlet grilles are left at positions close to the ear canals, so that the sound emitted from the speakers can directly enter the ears of the users. The combination of the left and right speakers has a stereo effect, and the weight is balanced. The setting of the speakers greatly facilitates the communication between on-site staff and off-site relevant experts during the quality control work of power equipment, effectively improving the work efficiency; at the same time, an NFC chip is placed at the buckle part for relevant personnel to enter information during work, and it can also be connected to relevant terminal devices to monitor the quality control data related to power equipment.

[0061] Furthermore, the augmented reality display module and the computing module are detachably connected to the cap body, and the augmented reality display module and the computing module can be independently upgraded. The ranging and temperature measuring module, the detachable battery module, the positioning module, etc. in this application are all detachable, that is, each module in the wearable augmented reality device in this application is detachable, and the connection between it and the device body, and between the device and the quality control target all adopt the power industry standard protocol (IEC101 / 104), which solves the compatibility problems between components and between components and quality control targets; each module component adopts the plug-and-play technology, and the device terminal registration and configuration information are automatically matched after communication connection, reducing the operations in the aspect of artificial device information management and enabling the device to automatically adapt to the normal operation of each component.

[0062] The xml file model under the configuration data defined by the IEC101 / 104 standard specification is relatively simple, and it is very easy to be compatible with each functional module, which is convenient for storing the data generated in the quality control process. Moreover, the standardized IEC101 / 104 protocol + xml file that supports the configuration information registration and automatic matching function has the same effect as the combination of the MQTT protocol + profile currently adopted by the ubiquitous Internet of Things. It can not only support the existing master station system but also be easily upgraded. Only by adding a standard conversion module to convert the existing 101 / 104 protocol into MQTT communication and converting the existing xml configuration file into a standard profile file can it support the normal working requirements of all modules.

[0063] Each module in the wearable augmented reality device in this application can also be independently upgraded according to the development of reality technology, so as to realize the detachable function of the module at a higher application device level. The present invention also combines the development needs of the current Internet of Things technology to develop a multi-module upgrade scheme. After networking, individual modules can be upgraded according to requirements without the need to package all modules into an upgrade package, and the upgrade operation can be performed through the cloud, which not only saves traffic but also reduces the complexity of device-side upgrades. In addition, this device can also detach each functional module and connect it to the upper computer, perform the upgrade work separately and then reinstall it, which is convenient for the replacement and transformation of functional modules.

[0064] In addition, the wearable augmented reality device of this application is built-in with a multimedia module, and the high-definition camera and the voice call module can solve the communication problems between the personnel inside and outside the venue.

[0065] This application provides a method for quality control of electric power equipment materials, which is applied to Figure 1 and Figure 2The computing module 30 in the wearable augmented reality device shown, the wearable augmented reality device further includes a ranging and temperature measuring module 50 and a positioning module 70. The ranging and temperature measuring module 50 is installed on the outer wall of the head ring structure 11 through a card slot and is located between the augmented reality display module 20 and the bracket connector 14. The positioning module 70 is installed inside the computing module 30 and is used to locate power equipment materials, such as Figure 3 as shown, including:

[0066] Step S101: The computing module acquires the image data of the power equipment materials captured by the augmented reality display module;

[0067] Step S102: The computing module acquires the temperature information and distance information of the power equipment materials measured by the ranging and temperature measuring module;

[0068] Step S103: The computing module acquires the position information of the power equipment materials measured by the positioning module;

[0069] Step S104: The computing module processes the image data of the power equipment materials, the temperature information of the power equipment materials, the distance information of the power equipment materials, and the position information of the power equipment materials to obtain the quality control data of the power equipment materials. The quality control data is used to characterize whether the corresponding power equipment materials meet the power production requirements.

[0070] For the quality control of power equipment materials in this application, the computing module processes the image data of the power equipment materials, the temperature information of the power equipment materials, the distance information of the power equipment materials, and the position information of the power equipment materials to obtain the quality control data of the power equipment materials. The quality control data is used to characterize whether the corresponding power equipment materials meet the power production requirements. The quality control of power equipment materials is realized.

[0071] Further, the computing module processes the image data of the power equipment materials, the temperature information of the power equipment materials, the distance information of the power equipment materials, and the position information of the power equipment materials to obtain the quality control data of the power equipment materials, including:

[0072] Obtain the reference image data, reference temperature information, reference distance information, and reference position information of the power equipment materials;

[0073] Compare the image data with the reference image data, the temperature information with the reference temperature information, the distance information with the reference distance information, and the position information with the reference position information to obtain a comparison result;

[0074] Generate the quality control data of the power equipment materials according to the comparison result. The quality control data at least includes: whether the raw materials of the power equipment materials, the components and sub-assemblies of the power equipment materials meet the corresponding specifications, and whether the assembly site of the power equipment materials meets the production requirements.

[0075] That is to say, by comparing the image data with the reference image data, the temperature information with the reference temperature information, the distance information with the reference distance information, and the position information with the reference position information, the quality control data of the power equipment materials is obtained.

[0076] In order to enable those skilled in the art to more clearly understand the technical solution of this application, the implementation process of the quality control solution for power equipment materials of this application will be described in detail below with specific embodiments.

[0077] Specifically, the wearable augmented reality device of this application can be applied to on-site operations of quality control of materials for narrow maintenance of power equipment, outdoor line inspection, and large-scale remote digital interaction application scenarios of power transmission and transformation, and can cover the entire process of power equipment manufacturing supervision and inspection and monitoring work. When the staff wears the device of the present invention to perform quality control work on power equipment, its analysis flow chart is as Figure 4 shown, and the specific working steps are as follows:

[0078] The first step: The binocular VSLAM perception camera acquires the image of the power equipment directly in front of it, the infrared temperature measurement and ranging module measures physical information such as the temperature, distance, and volume of the target power equipment, and the positioning system acquires the coordinate information of the power equipment. All the above information is packaged and transmitted to the high-computing power platform for unified processing and integration;

[0079] Among them, the accuracy of the digital recognition of the physical information of the target power equipment needs to be key-controlled. The greatest advantage of infrared ranging is the accuracy of short-distance measurement, which can be accurate to a distance within 1 meter. The infrared ranging principle includes the time-difference method ranging principle, the reflected energy method measurement principle, and the phase method ranging principle. According to the actual application scenario of the device, the present invention selects the reflected energy method ranging principle for measurement;

[0080] The reflected energy method is that an infrared signal is emitted by a light-emitting element towards the target, and after being reflected by the object, it is transmitted back to the receiving end of the system. The distance L of the target object is calculated by receiving the magnitude of the energy through a photoelectric conversion device. The calculation formula is as formula 1:

[0081]

[0082] Among them, P is the energy at the receiving end, K is a constant, the magnitude of which is determined by the output power and conversion efficiency of the transmitting system, and d is the diffuse reflectivity of the measured target.

[0083] Second step: All the information obtained by the sensors is sent to a high-computing-power platform, which automatically identifies the corresponding power equipment. Information such as the information of construction personnel, quality, construction progress, material procurement contracts, bidding technical documents, key production processes, factory tests, relevant policies and laws, and key points of equipment material quality control involved in all aspects of production of this power equipment will also be retrieved to form a digital information package for material quality control. The witnessed digital materials are stored and marked in regions and then transmitted to the waveguide display module for on-site operators to use. At the same time, the working video images of on-site staff will be synchronously transmitted to off-site experts so that the off-site experts can perform online editing and annotation on the photographed power equipment and give real-time and effective guidance to the on-site staff.

[0084] Third step: The high-computing-power platform receives the image directly captured by the camera module, converts the obtained image into a format supported by the waveguide display module. Moreover, the high-computing-power platform will perform image processing on the collected image, filtering out noise while retaining the edge information of the original image, maximizing the imaging clarity and resolution of the waveguide display module, as well as the fidelity during the picture transmission process. In the material quality control and inspection work of power equipment, this technology will be beneficial for the staff and off-site relevant experts to understand and grasp the relevant power equipment, and it can also be applied to the situation where the pictures of power equipment captured by the camera are blurred during some extreme working conditions and need to be restored.

[0085] Fourth step: The waveguide display module will display all the relevant information of the power equipment in front of the eyes of the staff wearing the device. The following will describe a simple planar waveguide.

[0086] As Figure 5 shown, the simplest planar waveguide consists of three layers of materials. The middle layer is a waveguide film with a refractive index of a1, which is deposited on a substrate with a refractive index of a2, and above the film is a cladding layer with a refractive index of a3, which is generally air. The difference in refractive index between the film and the substrate is generally between 10-1 and 10-3. To form a real optical waveguide, it is required that a1 must be greater than a2 and a3, that is, a1>a2≥a3. In this way, light can be confined to propagate in the film.

[0087] The propagation of light in the planar waveguide can be regarded as the total reflection of light rays at the interfaces of the film - substrate and the film - cladding, and the light propagates along a zigzag path in the film. The light is not restricted in the y direction and is restricted in the x direction. The specific schematic diagram is as Figure 5 shown.

[0088] In the planar waveguide, a1>a2 and a1>a3. When the incident angle θ1 of the incident light exceeds the critical angle θ0:

[0089]

[0090] The incident light undergoes total internal reflection, and at this time, a certain phase jump occurs at the reflection point. Starting from the Fresnel reflection formula:

[0091]

[0092]

[0093] The phase jump angle at the reflection point is obtained.

[0094]

[0095]

[0096] where: γ = a1csinθ1 is the optical propagation constant, c = 2π / λ is the wave number of light in vacuum, and λ is the wavelength of light.

[0097] The total internal reflection of light can be achieved by using the optical waveguide technology. That is, after the optical machine completes imaging, the light is coupled into the glass substrate of the waveguide, and the light is transmitted to the front of the augmented reality device through the principle of total internal reflection and then released. The total internal reflection of the optical waveguide technology can provide a large field of view for users while ensuring clear imaging and high image contrast.

[0098] The device of the present invention can identify and verify the digital information of the key processes of material quality control, and form a complete digital information report on material quality control. The specific key points include: whether the raw materials, components and sub-assemblies of power equipment meet the corresponding specifications and quality standards; whether the assembly and test sites meet the relevant regulatory requirements; whether the design methods, technological processes and technical levels of production and assembly meet the relevant operating requirements; and whether the factory tests meet the requirements.

[0099] Fifth step: The complete digital report on material quality control formed in the above fourth step will first be stored locally, then fed back to the on-site staff, and at the same time transmitted to off-site experts through advanced communication methods. The on-site staff can communicate with off-site experts in real time through the multimedia function module carried by the present invention, and off-site experts can also provide guidance to the on-site staff to solve the problem of insufficient experience of front-line staff, standardize operation behaviors, and reduce the error rate of staff operations. The on-site staff can understand whether the quality control results of the witnessed power equipment materials meet the standards through the complete witness report, and at the same time highlight, summarize and store the positions and specific information of the key points with abnormalities and non-compliance with construction requirements;

[0100] Step 6: The key points of the power equipment detected with abnormalities in the above step 5 will be recorded and stored in the table. The complete information and data will be sent to the corresponding contracting departments and responsible personnel through the background server. At the same time, the high-computing power computing platform will give specific correction methods based on the corresponding abnormal key point information for reference by relevant staff.

[0101] Specifically, the monocular RGB camera used in the device in this application realizes depth ranging. Geometric clues and assumptions are used to estimate the 3D information of the scene or object from a single RGB image, and perspective projection is used to realize the projection of 3D points in the scene onto the 2D image plane of the camera. The basic formula for depth ranging using perspective projection is:

[0102] or

[0103] Among them: H is the estimated depth value of a point in the scene along the optical axis of the camera, which indicates the distance from the camera to the point in the scene; f is the focal length of the camera, which is a physical parameter of the camera and determines its field of view and the degree of perspective distortion; d is the distance between the centers of the two cameras, which is used to calculate the depth in stereo vision and is estimated based on the camera specifications on a high-computing platform; X, Y are the coordinates of a point in the 3D scene; x, y are the coordinates of the same point in the 2D plane of the camera.

[0104] Formula 7 assumes that the optical axis of the camera is aligned with the Z axis of the real world coordinate system and that the camera has no distortion or calibration errors. At the same time, in order to accurately perform depth estimation, the high computing power platform of the present invention performs depth estimation based on factors such as lighting conditions, camera calibration, scene complexity, etc., to meet the accuracy and certainty of depth estimation.

[0105] Based on the above principles, the applications of wearable working devices for quality control of power equipment and materials in indoor and outdoor scenarios are as follows:

[0106] 1) Indoor scenes

[0107] In indoor scenarios, workers can use augmented reality wearable work devices to implement digital witness records by independently adjusting the wearing mode of headband or helmet according to work requirements.

[0108] In indoor scenarios, power equipment quality control work mainly focuses on material warehousing quality inspection and production process witnessing. During the operation, controlling and adjusting the video sensor to capture clear video images of power equipment under different light sensitivity conditions and effectively identifying abnormal conditions of power equipment components are the key to digital recording.

[0109] A technology for obtaining clearer image data by using a high dynamic range (HDR) algorithm. A series of images with different exposure settings are captured, usually including underexposed images, overexposed images, and one or more properly exposed images, and then these images are aligned and combined to create an HDR image, which has a higher dynamic range than a single-exposure image. This HDR image generation uses tone mapping technology to compress the wide dynamic range of the HDR image into a lower dynamic range suitable for display on standard devices. The tone mapping is based on Equation 8:

[0110]

[0111] In the formula, Ld is the luminance value of the color bar mapped pixel in the output image; Ls is the luminance value of the corresponding pixel in the input image; Lwhite is the luminance value of the brightest pixel in the input image. This formula adjusts the luminance value of each pixel in the HDR image according to Ls and Lwhite to compress the dynamic range and display the detailed image areas in the dark and bright parts.

[0112] The camera on the head ring will capture images of power equipment, and various sensors will measure and collect information about the power equipment (including size and location information); then, the built-in algorithm of the high-computing power platform will record the key point information for the quality control of the power equipment, and then retrieve the quality control information such as the manufacturer, production date, specification model, and process technology of this power equipment and perform an intelligent comparison with the database information and equipment design parameters; if abnormal information is found in the comparison, the abnormal information will be visually prompted to the user through the optical waveguide module and digitally tagged. For product information that is inconsistent with the contract regulations or does not meet the standards, it will be automatically stored and recorded and uploaded to the cloud and remote receiving terminals through the 5G communication module for subsequent re-supervision reference.

[0113] At the same time, the wearable working device has the function of audio and video breakpoint recording in a strong shielding environment in a confined space and without network conditions, and can re-upload the offline recorded data after the network is restored.

[0114] 2) Outdoor scenario

[0115] In the outdoor scenario, the quality control work of power equipment mainly focuses on outdoor tests and witnessing the inspection of packaging and shipping. When operating personnel perform quality control operations in the outdoor environment, they can switch the augmented reality wearable working device to the helmet mode to improve the use safety.

[0116] In an outdoor scenario, the device can obtain the spatial distance between the user and the device under test through image recognition and computational processing of the on-site test environment and the device under test, and provide safety distance guidance prompts for the user during high-voltage insulation tests. At the same time, after plugging in the infrared sensor module, for power equipment undergoing high-current and high-temperature tests, it has the ability to sense infrared temperature within the sensing accuracy range.

[0117] The embodiments of this application are designed based on modularization. The functional modules can be freely combined to meet the usage requirements of multiple working conditions, high precision, and good stability. Moreover, it can effectively reduce the maintenance difficulty, improve the anti-damage ability, and reduce the overall life cycle cost. It fully considers the usage requirements in different working environments and has environmental adaptation designs such as two wearing methods and lighting compensation. And each module can be independently upgraded according to the development of current technologies. The connection between each module and the device main body, as well as between the device and the quality control target, adopts the standardized protocol (IEC101 / 104) of the power industry. It can meet the needs of product customization and iterative upgrade in more application scenarios, greatly enhancing the maintenance convenience and the diversity of usage modes of the device. It improves the usage compatibility of the general-purpose code of the high-computing power platform, which is beneficial to improving the secondary development and usage efficiency of the device. And this invention can be applied to the entire process of the preparation stage, implementation, and summary stage of power equipment material quality control, greatly facilitating the work of material quality control and inspection personnel and improving the efficiency of material quality control work.

[0118] The existing inventions regarding augmented reality devices are detachable based on the most basic structure. This invention is not only detachable in the basic structure, but also each functional module can be detachably and freely combined according to different working environments and usage scenarios to achieve different functions. Moreover, the design structure is novel and supports wearing in different application scenarios.

[0119] When the existing inventions upgrade the device, they must target the entire device. No matter which module is upgraded, it is necessary to package the firmware libraries and data of all modules into an upgrade file, then push it to the device side. The device side then parses the upgrade file and finally upgrades each module one by one. The disadvantage of this approach is that it will also upgrade the modules that do not need to be upgraded, wasting traffic and increasing the risk of device failures at the device side. Based on this, this invention combines the current development needs of the Internet of Things technology and develops a multi-module upgrade solution. It can upgrade a single module according to requirements without packaging all modules into an upgrade package and can perform upgrade operations through the cloud. This not only saves traffic but also reduces the complexity of device-side upgrades.

[0120] In the existing invention, tasks such as material quality control and line inspection of power equipment all need to be completed manually. For the entire process of material quality control and line inspection of power equipment, different specialized units, departments, and technical staff are required. The process of coordinating these tasks is rather cumbersome and complex. Moreover, during the process of material quality control and line inspection of power equipment, corresponding technical staff must be present to supervise the work, which will result in uneven distribution of human resources and high labor costs. The problem brought about by this is that it is very easy for errors to occur in tasks such as material quality control and line inspection of power equipment. The present invention can be applied to the entire process of work preparation, implementation, and summary stages of material quality control and line inspection of power equipment, etc. It coordinates the work arrangements and personnel allocation at each stage. Experts both on-site and off-site participate in tasks such as material quality control and line inspection of power equipment online simultaneously, greatly simplifying the process of tasks such as material quality control and line inspection of power equipment and improving work efficiency.

[0121] The basic structure of the helmet headband of the present invention is manufactured using advanced printing technology, which can simultaneously possess the advantages of high strength and lightweight design. And according to different working scenarios and requirements, the safety helmet in the helmet device is detachable and can be turned into a headband device.

[0122] The present invention natively supports mobile communication technologies such as WIFI and Bluetooth. The protocol interfaces are unified, and near-field communication can be freely switched. The system-on-chip comes with a mobile communication baseband. Compared with the currently known solutions, the communication ability is stronger, more stable, and the power consumption is lower. And it can be paired with a hardware encryption solution. In the offline mode, the local device is equipped with an internal storage to assist in recording offline data, and the offline data can be transmitted to the expert terminal after connecting to the network. The WIFI and Bluetooth communication technologies adopt a modular design. When an upgrade is needed, only the old one needs to be removed from the device and a new one can be replaced, perfectly realizing the plug-and-play function.

[0123] The present invention is applicable to on-site operation of quality control of maintenance materials for power equipment in narrow areas, outdoor line inspection, and large-scale remote digital interaction application scenarios for power transmission and transformation, and can cover the entire process of power equipment manufacturing supervision, inspection, and monitoring. Through the present invention, the power equipment to be witnessed can be automatically identified; relevant drawings, technical standards, manufacturing processes, and other documents of the power equipment can be automatically verified; the main supply qualifications, actual production capacity, and quality system of the witnessed equipment can be verified to determine whether they meet the requirements of the product order contract; the identification and test reports of major new technologies, new materials, and new processes to be adopted during the manufacturing process of the power equipment can be verified; the inspection plan and test requirements during the production process of the witnessed equipment can be inspected, and the time, content, methods, standards, and detection means of inspections and tests during the manufacturing stage can be verified; the manufacturing quality, manufacturing processes, production processes, operating procedures, and the qualification of relevant personnel for taking up their posts, as well as the environmental conditions of the product manufacturing and assembly sites of the main components can be inspected; the certification documents and inspection reports of raw materials, outsourced supporting parts, and rough castings and forgings used in the product, as well as the quality certificates of outsourced processing parts and entrusted processing materials and the inspection materials submitted by the witnessed equipment can be inspected; the historical log can be inspected: including inspection content, inspection situation, inspection items, problems found, handling of problems, production progress of the product, responsible personnel, etc.; after inspecting each set point, a complete digital witnessing report is formed, and the final complete digital witnessing report and the digital information record stipulated in the contract are automatically submitted to the company. For information that violates the operation regulations or does not meet the standards, it is automatically stored for later re-supervision.

[0124] In the present invention, the key digital information of the power equipment with detected abnormalities will be recorded in a table and stored, and sent to the corresponding manufacturing department and responsible personnel through the background server. At the same time, the high-computing power platform will give specific warning prompts according to the corresponding abnormal key point information for relevant staff to take quality control corrective measures in a timely manner.

[0125] The above are only the preferred embodiments of the present application and are not used to limit the present application. For those skilled in the art, various changes and modifications can be made to the present application. Any modifications, equivalent replacements, improvements, etc. made within the spirit and principle of the present application shall be included within the protection scope of the present application.

Claims

1. A wearable augmented reality device, characterized in that, Applied to the quality control of power equipment materials, it is characterized in that it includes: A cap body, including a head ring structure; An augmented reality display module, installed on the outer wall of the first side of the head ring structure, for displaying the quality control data processed by the calculation module, and the quality control data is used to characterize whether the corresponding power equipment material meets the power production requirements; The calculation module is installed on the outer wall of the second side of the head ring structure, communicates with the augmented reality display module, and is used to perform operations on the source data collected by the augmented reality display module to obtain the quality control data of the power equipment material. Among them, the outer wall of the first side and the outer wall of the second side are opposite in position; A protruding member is fixedly arranged on the outer wall of the head ring structure, and the cap body further includes: A safety protection helmet; A headband, attached and fixed above the safety protection helmet, and combined with the safety protection helmet to form a skull structure; A bracket connector, having a first end and a second end. The first end is fixed on the headband, and the second end has a through-hole structure. The protruding member passes through the through-hole structure to fix the skull structure above the head ring structure; The augmented reality display module and the calculation module are detachably connected to the cap body, and the augmented reality display module and the calculation module are independently upgraded. When upgrading the hardware module of the calculation module, only need to remove the calculation module and replace it with a new calculation module.

2. The wearable augmented reality device according to claim 1, characterized in that, The augmented reality display module includes: A binocular perception camera module, including a first camera and a second camera; A structured light module, installed between the first camera and the second camera, and the binocular perception camera module and the structured light module are combined into a strip-shaped sensing module; An optical waveguide display module, installed below the strip-shaped sensing module, and the lens of the optical waveguide display module is fixed by clamping at both ends.

3. The wearable augmented reality device according to claim 2, characterized in that, A positioning damping rotating shaft is fixedly arranged on the outer wall of the head ring structure, and one end of the optical waveguide display module is connected to the positioning damping rotating shaft.

4. The wearable augmented reality device according to claim 1, characterized in that, The wearable augmented reality device further includes: A distance measurement and temperature measurement module, installed on the outer wall of the head ring structure through a card slot, and located between the augmented reality display module and the bracket connector.

5. The wearable augmented reality device according to claim 1, characterized in that, The wearable augmented reality device further includes at least one of the following: A detachable battery module, installed at the tail of the cap body; A positioning module, installed inside the calculation module, for positioning the power equipment materials.

6. The wearable augmented reality device according to claim 1, characterized in that, The head ring structure has accommodation cavities on its opposite sides, namely a first accommodation cavity and a second accommodation cavity. A first external speaker is arranged in the first accommodation cavity, and a second external speaker is arranged in the second accommodation cavity; and / or, An NFC chip is installed on the outer wall of the head ring structure close to the augmented reality display module, and the NFC chip is used for information entry.

7. A method for quality control of electric power equipment materials, characterized in that, The method is applied to a computing module in the wearable augmented reality device according to any one of claims 1 to 6. The wearable augmented reality device further includes a ranging and temperature measuring module and a positioning module. The ranging and temperature measuring module is installed on the outer wall of the head ring structure through a card slot and is located between the augmented reality display module and the bracket connector. The positioning module is installed inside the computing module and is used to locate power equipment materials, including: The computing module acquires the image data of the power equipment materials captured by the augmented reality display module; The computing module acquires the temperature information and distance information of the power equipment materials measured by the ranging and temperature measuring module; The computing module acquires the position information of the power equipment materials measured by the positioning module; The computing module processes the image data of the power equipment materials, the temperature information, distance information, and position information of the power equipment materials to obtain the quality control data of the power equipment materials. The quality control data is used to characterize whether the corresponding power equipment materials meet the power production requirements.

8. The method according to claim 7, characterized in that, The computing module processes the image data of the power equipment materials, the temperature information, distance information, and position information of the power equipment materials to obtain the quality control data of the power equipment materials, including: Acquiring the reference image data, reference temperature information, reference distance information, and reference position information of the power equipment materials; Comparing the image data with the reference image data, comparing the temperature information with the reference temperature information, comparing the distance information with the reference distance information, and comparing the position information with the reference position information to obtain a comparison result; Generating the quality control data of the power equipment materials according to the comparison result. The quality control data at least includes: whether the raw materials, components, and sub-assemblies of the power equipment materials meet the corresponding specifications, and whether the assembly site of the power equipment materials meets the production requirements.

Images