AR+AI smart glasses to improve the safety level of power construction

By using AR+AI smart glasses, real-time information on power equipment and safety guidance can be displayed, solving the problem of insufficient information feedback in traditional power construction, achieving efficient and safe construction support, and improving construction efficiency and safety.

CN119126385BActive Publication Date: 2025-12-02STATE GRID FUJIAN ELECTRIC POWER CO LTD +2
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
CN202411229222.0
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2024-09-03
Publication Date
2025-12-02
Estimated Expiration
2044-09-03

AI Technical Summary

Technical Problem

The lack of real-time information feedback and risk warning in traditional power construction leads to a lack of effective guidance and insufficient safety for construction workers when facing emergencies.

Method used

Using AR+AI smart glasses, which combine a high-resolution display, sensor system, AI data processing module and AR technology, the device displays real-time information, provides safe and standardized operation guidance and risk warnings. It achieves spatial positioning and virtual information overlay through SLAM algorithm, and uses AI algorithm to identify potential risks and generate personalized guidance.

Benefits of technology

It improves the real-time and accuracy of information display in power construction, enhances the intelligence of safety risk warning and work guidance, improves construction efficiency and safety, and provides a comfortable and powerful user experience.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119126385B_ABST
    Figure CN119126385B_ABST
Patent Text Reader

Abstract

This invention proposes an AR+AI smart glasses system to improve the safety level of power construction. The system includes a frame, a high-resolution display, a nose pad, a headband, a detachable anti-glare shield, a high-quality camera, a sensor system, smart lenses, a microphone, and a data processing unit. The nose pad and headband are located on one side of the frame, while the detachable anti-glare shield, high-quality camera, sensor system, and smart lenses are located on the other side. The smart glasses also include an AR technology application module, an AI data processing module, and a user interaction and feedback module. This invention, through AR+AI smart glasses technology, provides more timely and accurate display of power equipment information, guidance on safe and standardized operation, and early warning and prediction of safety risks.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] This invention relates to the field of power equipment technology, and more specifically to an AR+AI smart glasses that improves the safety level of power construction. Background Technology

[0002] Power construction refers to a series of activities such as the installation, commissioning, and maintenance of power equipment. Traditional power safety equipment and monitoring systems often only provide basic data displays and cannot provide real-time feedback on key information. This results in construction personnel lacking effective guidance and risk warnings when facing emergencies, limiting the efficiency and safety of construction operations.

[0003] In view of this, the present invention proposes an AR+AI smart glasses to improve the safety level of power construction. Summary of the Invention

[0004] The purpose of this invention is to propose an AR+AI smart glasses to improve the safety level of power construction. Through AR+AI smart glasses technology, it provides more timely and accurate display of power equipment information, guidance on safe and standardized operation, and prediction and early warning of safety risks.

[0005] To achieve the above objectives, the technical solution of the present invention is: an AR+AI smart glasses for improving the safety level of power construction, comprising a frame, a high-resolution display screen, a nose pad, a headband, a detachable anti-glare shield, a high-quality camera, a sensor system, smart lenses, a microphone, and a data processing unit. The nose pad and headband are located on one side of the frame, while the detachable anti-glare shield, high-quality camera, sensor system, and smart lenses are located on the other side of the frame. The smart glasses also include an AR technology application module, an AI data processing module, and a user interaction and feedback module. The AI ​​data processing module analyzes the on-site data collected by the high-quality camera and sensor system in real time, identifies equipment status, predicts potential risks, and generates personalized work guidance. The AR technology application module enables real-time virtual information overlay and uses the SLAM algorithm for spatial positioning and scene reconstruction, ensuring accurate alignment between virtual information and the actual scene.

[0006] Preferably, the nose pad and headband are made of soft material and can be adjusted according to the user's head size and facial shape.

[0007] Preferably, the high-resolution display uses OLED technology and has an adaptive brightness function to automatically adjust the brightness according to the ambient light.

[0008] Preferably, the high-quality camera employs AI-assisted focusing technology.

[0009] Preferably, the sensor system includes an accelerometer, a gyroscope, a temperature and humidity sensor, and Bluetooth and Wi-Fi modules, wherein the Bluetooth and Wi-Fi modules are used to transmit the collected environmental data to the data processing unit.

[0010] Preferably, the data processing unit is equipped with a high-speed memory and a multi-core processor.

[0011] Preferably, the AI ​​technology includes deep learning models and machine learning algorithms.

[0012] Preferably, the user interaction and feedback module uses a smart lens as the user interface, supports voice and gesture interaction, and adopts a real-time feedback mechanism to adjust the displayed content in real time according to user operation feedback and environmental data, providing personalized work guidance and real-time warnings, including vibration and sound prompts. The user interface supports customized settings, including layout customization and theme settings.

[0013] Compared with the prior art, the present invention has the following beneficial effects:

[0014] 1. This invention employs AR+AI technology to display real-time information on power equipment, safety guidelines, and safety warnings, improving the real-time nature and accuracy of information display. AR technology overlays virtual information into the user's field of vision, allowing operators to intuitively view equipment information. Compared to traditional methods of consulting documents, this saves time and reduces operational risks.

[0015] 2. This invention employs AI algorithms to analyze sensor data in real time. By analyzing and predicting environmental information and tasks during power construction, it quickly generates intelligent feedback and guidance information, helping operators adjust their work methods promptly and improving efficiency. The key to improved real-time performance lies in the real-time overlay of AR technology and the rapid analysis of AI algorithms, enabling operators to obtain accurate information in real-time scenarios, react promptly, and avoid potential risks.

[0016] 3. This invention utilizes AI technology for data processing and analysis to achieve intelligent risk warning and work support functions. AI algorithm optimization improves the system's intelligent decision-making capabilities, enabling it to identify potential safety risks and provide early warnings, helping operators take timely measures to prevent accidents. Intelligent work support functions include real-time guidance and workflow optimization, allowing operators to complete tasks more efficiently during construction. The advantage of intelligent support lies in the data analysis and decision-making capabilities of AI technology, which helps operators make correct decisions in complex environments, improving work efficiency and safety.

[0017] 4. The design and optimization of the hardware components of the smart glasses in this invention ensure a balance between comfort and functionality, enhancing the user experience. The head-mounted device is lightweight and comfortable, equipped with a high-definition display and a high-quality camera, allowing users to maintain comfort even during extended wear. The user interface design is simple and intuitive, easy to operate, and highly interactive, enabling operators to quickly learn and fully utilize the functions provided by the smart glasses. The key to optimizing the user experience lies in the comfort and functionality of the hardware design, as well as the simplicity and intuitiveness of the interface design, allowing operators to use the smart glasses more pleasantly for work. Attached Figure Description

[0018] Figure 1 is a schematic diagram of the structure of the first smart glasses of the present invention;

[0019] Figure 2 is a schematic diagram of the structure of the first smart glasses of the present invention;

[0020] Figure 3 is a schematic diagram of the smart glasses module of the present invention.

[0021] In the image: 1. Frame; 2. Nose pad; 3. Headband; 4. Detachable anti-glare shield; 5. High-quality camera; 6. Sensor system; 7. Smart lens. Detailed Implementation

[0022] The following is in conjunction with the appendix Figure 1-3 The technical solution of the present invention will be described in detail below.

[0023] This invention proposes an AR+AI smart glasses to improve the safety level of power construction, including a frame 1 and a high-resolution display screen. A nose pad 2 and a headband 3 are provided on one side of the frame 1, and a detachable anti-glare cover 4, a high-quality camera 5, a sensor system 6, a smart lens 7 and a microphone are provided on the other side of the frame 1.

[0024] In this embodiment, the nose pad 2 and headband 3 are made of soft material and can be adjusted according to the user's head size and facial shape. They have shock-resistant, waterproof, and high-temperature resistant properties, and are suitable for various construction environments.

[0025] In this embodiment, the high-resolution display uses OLED technology with a resolution of up to 2K, vibrant and rich colors, and supports high frame rate display to ensure clarity and color accuracy. The high-resolution display also has an adaptive brightness function, which automatically adjusts the brightness according to the ambient light to ensure visibility under different lighting conditions.

[0026] In this embodiment, the high-quality camera 5 adopts AI-assisted focusing technology, has an automatic stabilization function, supports 4K video recording, and can capture high-definition environmental images in real time. In addition, the high-quality camera 5 also supports real-time filters and depth-of-field adjustment functions to enhance the user's shooting experience.

[0027] In this embodiment, the sensor system 6 includes an accelerometer, a gyroscope, and a temperature and humidity sensor. It transmits the collected environmental data to the processing unit via Bluetooth and Wi-Fi modules. The sensor system 6 also features a waterproof and dustproof design to ensure reliable operation in harsh environments.

[0028] The smart glasses of this invention include AR technology applications, AI data processing, data processing unit performance, and user interaction and feedback:

[0029] 1. AR Technology Applications: AR technology enables real-time virtual information overlay and uses SLAM algorithms for spatial positioning and scene reconstruction, ensuring precise alignment between virtual information and the actual scene. Additionally, AR technology supports gesture and body motion recognition and virtual object interaction, enhancing user convenience and immersion. Augmented Reality (AR) technology is a technique that cleverly integrates virtual information with the real world. It is widely used in multimedia, 3D modeling, real-time tracking and registration, intelligent interaction, sensing, and other technologies. It simulates computer-generated text, images, 3D models, music, videos, and other virtual information, applying them to the real world. The two types of information complement each other, thus "enhancing" the real world.

[0030] The AR technology of smart glasses mainly includes a high-quality camera 5 mounted on the frame, smart lenses 7, and a smart controller. The high-quality camera 5 captures images from the front and generates a video image; the smart lenses 7 provide a user interface with menu options and real-time display of the video image; the smart controller includes a control chip and a wireless communication module; the control chip receives the video image from the front through the camera interface and dynamically overlays it to generate an AR-enhanced image; the control chip transmits the AR-enhanced image to a remote control terminal via the wireless communication module.

[0031] 2. AI Data Processing: AI algorithms, including deep learning models and machine learning algorithms, are used to analyze sensor data in real time, identify equipment status, predict potential operational and environmental risks, and generate alarm reminders and personalized work guidance. AI algorithms can also learn from users' historical operation data to provide more accurate guidance and suggestions. The AR glasses can construct operational data matching the current project and equipment through data collection or input. In this solution, when users perform construction operations on the target project or equipment, they can capture images and videos of the target project or equipment. During image collection, the system automatically identifies the target equipment's number and operational data. Users can also manually enter the target equipment's operational data, binding this data with the equipment number to output a project report. Specifically, during image acquisition, the AR glasses can identify the equipment number corresponding to the power equipment located within the image acquisition area of ​​the AR glasses, obtain the planned work task corresponding to the equipment number, and collect the operating data of the power equipment based on the planned work task. There may be multiple tasks in the planned work task. In this solution, under the operation of the construction personnel, the AR glasses can complete these planned work tasks one by one. After the data acquisition is completed, the corresponding safety prediction plan task in the planned work task list is marked as completed.

[0032] The AI ​​technology of smart glasses utilizes image processing and analysis, machine learning, and speech recognition. Through a high-quality camera 5, sensor system 6, and microphone installed on the frame 1, the smart glasses can achieve real-time scene recognition, face recognition, text recognition, and speech recognition, facilitating operators to obtain information about the surrounding construction environment and ultimately presenting the information in a visual form on the glasses. A navigation path is generated based on the current location of the AR glasses and the location information of the target device; a navigation path can also be generated based on the target device manually input by the user. Furthermore, the AR glasses can generate a corresponding prompt when the target device in the current navigation does not belong to the planned work task list. Specifically, before or after generating the navigation path, it is determined whether there is a planned work task in the planned work task list that matches the device number corresponding to the current navigation; if not, a prompt message is output to the user.

[0033] 3. Data Processing Unit Performance: The data processing unit employs a high-performance processor, supports edge computing, and can perform complex data processing and analysis locally on the device, reducing reliance on the cloud. Furthermore, the data processing unit is equipped with high-speed memory and a multi-core processor to handle large-scale data processing demands.

[0034] 4. User interaction and feedback:

[0035] Smart Glasses Interface Design: The interface features an intuitive graphical interface and voice interaction, supporting gesture recognition and accurate voice recognition even at 90dB industrial noise levels, making operation simple and convenient. The interface also supports customizable layouts and themes, allowing users to personalize it to their liking. For ease of use in complex industrial environments, the smart glasses can also be equipped with a rotary knob interaction.

[0036] Real-time feedback mechanism: The system adjusts the displayed content in real time based on user operation feedback and environmental data, providing personalized work guidance and real-time warnings to ensure operators complete tasks safely and efficiently. Real-time feedback also includes vibration and sound alerts to enhance user awareness of system status.

[0037] User experience optimization: The smart glasses support customized settings, allowing users to adjust display content, brightness, and other parameters according to their personal preferences, improving user experience and work efficiency. User experience optimization also includes comfortable headphones and acoustic design, providing a clear and comfortable audio experience.

[0038] Working principle:

[0039] These AI smart glasses, comprising a frame 1, a high-resolution display, nose pads 2, headband 3, a detachable anti-glare shield 4, a high-quality camera 5, a sensor system 6, and smart lenses 7, are designed to improve safety during power construction. The high-resolution OLED display supports 2K resolution and high frame rates, ensuring a clear and color-accurate visual experience under various lighting conditions. The high-quality camera 5 integrates AI-assisted focusing technology, supports 4K video recording, and features real-time filters and depth-of-field adjustment for enhanced shooting experience. The sensor system 6 includes an accelerometer, gyroscope, and temperature and humidity sensors to monitor construction environment parameters in real time and transmits data to the processing unit via Bluetooth and Wi-Fi modules, providing data support for intelligent analysis. Combined with advanced AI algorithms, these glasses can identify potential safety hazards, issue timely warnings, and display safety guidance information through the smart lenses 7 and the high-resolution display, providing comprehensive assistance for power construction and ensuring safe and efficient operations.

[0040] The above are preferred embodiments of the present invention. Any changes made to the technical solution of the present invention that do not exceed the scope of the technical solution of the present invention shall fall within the protection scope of the present invention.

Claims

1. An AR+AI smart glasses system for improving the safety level of power construction, characterized in that, The smart glasses include a frame, a high-resolution display, a nose pad, a headband, a detachable anti-glare shield, a high-quality camera, a sensor system, smart lenses, a microphone, and a data processing unit. The nose pad and headband are located on one side of the frame, while the detachable anti-glare shield, high-quality camera, sensor system, and smart lenses are located on the other side. The smart glasses also include an AR technology application module, an AI data processing module, and a user interaction and feedback module. The AI ​​data processing module analyzes real-time data collected by the high-quality camera and sensor system to identify equipment status, predict potential risks, and generate personalized work instructions. The AR technology application module enables real-time virtual information overlay and uses SLAM algorithms for spatial positioning and scene reconstruction, ensuring accurate alignment between virtual information and the actual scene. The sensor system includes an accelerometer, a gyroscope, a temperature and humidity sensor, and Bluetooth and Wi-Fi modules. The Bluetooth and Wi-Fi modules are used to transmit the collected environmental data to the data processing unit. The user interaction and feedback module uses a smart lens as the user interface, supports voice and gesture interaction, and adopts a real-time feedback mechanism to adjust the displayed content in real time based on user operation feedback and environmental data, providing personalized work guidance and real-time warnings, including vibration and sound prompts. The user interface supports customized settings, including layout customization and theme settings.

2. The AR+AI smart glasses for improving the safety level of power construction according to claim 1, characterized in that, The nose pad and headband are made of soft material and are adjustable to fit the user's head size and facial shape.

3. The AR+AI smart glasses for improving the safety level of power construction according to claim 1, characterized in that, The high-resolution display uses OLED technology and has an adaptive brightness function to automatically adjust the brightness according to the ambient light.

4. The AR+AI smart glasses for improving the safety level of power construction according to claim 1, characterized in that, The high-quality camera uses AI-assisted focusing technology.

5. The AR+AI smart glasses for improving the safety level of power construction according to claim 1, characterized in that, The data processing unit is equipped with a high-speed memory and a multi-core processor.

6. The AR+AI smart glasses for improving the safety level of power construction according to claim 1, characterized in that, The AI ​​data processing module includes deep learning models and machine learning algorithms.

Citation Information

Patent Citations

  • Eyewear system for power construction overhead work

    CN110109264A

  • AR intelligent glasses and system thereof

    CN110515207A