An inspection device for teaching and inspection purposes

By combining AR frames and interactive rings, real-time interaction and health monitoring of power inspection equipment are realized, solving the problems of existing VR devices being unable to interact with humans and the large gap between virtual images and actual scenes, thus improving the efficiency and safety of power inspection and training.

CN116844392BActive Publication Date: 2026-01-30YANTAI POWER PLANT OF HUANENG SHANDONG POWER GENERATION CO LTD
View PDF 3 Cites 0 Cited by

Patent Information

Application Number
CN202310687984.4
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2023-06-09
Publication Date
2026-01-30
Estimated Expiration
2043-06-09

AI Technical Summary

Technical Problem

Existing VR devices cannot achieve human-computer interaction in power inspection training. The virtual images differ greatly from the actual scene, resulting in low training efficiency. Furthermore, the image presentation cannot be controlled according to the needs of the trainees. Existing power inspection methods are labor-intensive, inefficient, and have inconsistent inspection quality, making it impossible to connect to the management information system in a timely and accurate manner.

Method used

By employing an AR frame, AR display lenses, and interactive rings, combined with a control signal monitoring device, a health monitoring device, and an automatic monitoring and identification system, the system enables staff to interact with AR technology. The interaction ring's movements control the level of detail in the equipment descriptions displayed on the AR lenses. The health monitoring device helps prevent accidents caused by hypoxia or overwork, while the automatic monitoring and identification system identifies electrical equipment and provides detailed parameters.

Benefits of technology

It improved the efficiency of power inspection and training, enhanced the immersive experience, reduced the occurrence of safety accidents, enabled real-time interaction and health monitoring between staff and AR devices, and improved the safety and accuracy of inspection and training.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN116844392B_ABST
    Figure CN116844392B_ABST
Patent Text Reader

Abstract

This invention relates to the field of power equipment inspection technology, and particularly to an inspection device for teaching and inspection purposes. The device includes an AR frame, an AR display lens, and an interactive ring. The AR frame is equipped with a power module and a health monitoring device, and also features an audio device. Control signal monitoring devices, visual tracking cameras, and interactive video cameras are located on either side of the AR display lens on the AR frame. This invention, by combining AR augmented reality technology with power equipment inspection, can reduce the occurrence of safety accidents, increase inspection efficiency, and help new personnel and trainees better learn about the production site.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] This invention relates to the field of power equipment inspection technology, and in particular to an inspection device for teaching and inspection purposes. Background Technology

[0002] Electricity goes through stages such as power generation, transmission, and distribution from production to use. Significant energy loss occurs during transportation, and potential hazards exist, such as weather conditions, which can lead to material losses. Therefore, minimizing energy loss while ensuring the reliability and security of the power grid makes regular inspections a top priority for power personnel.

[0003] Traditional power line inspection methods suffer from drawbacks such as high labor intensity, low work efficiency, fragmented inspection quality, and limited methods. Furthermore, data from manual inspections cannot be accurately and promptly integrated into the management information system.

[0004] Furthermore, power companies have very high requirements for employee skills because many work positions involve certain dangers. If power company employees are not skilled enough, it may lead to power accidents and affect the stability of power operation. Therefore, it is necessary to continuously carry out employee training to comprehensively improve the overall level and strength of power employees, ensure the stable operation of power transmission, and ensure the safety of life and equipment. Power inspection, power maintenance, and the education and training of new trainees are important components of safe production.

[0005] In the prior art, VR equipment / systems used for power training, such as VR systems for high-voltage substation simulation training (e.g., CN112991506B A VR-based high-voltage substation simulation training operating system), typically have the following problems:

[0006] 1. VR devices provide a completely virtual three-dimensional space, and the gap between virtual images and actual scenes can lead to a decrease in the learning efficiency of trainees.

[0007] 2. The system cannot achieve human-computer interaction and cannot select and control the images presented by the system according to the actual needs or learning direction of the trainees. Summary of the Invention

[0008] The present invention provides an inspection device for teaching and inspection purposes, which solves at least one of the technical problems mentioned in the background art.

[0009] To solve the above-mentioned technical problems, the present invention discloses an inspection device for teaching and inspection purposes, comprising:

[0010] The AR frame consists of an AR display lens and an interactive ring. The AR frame is equipped with a power module and a health monitoring device. It also has an audio device. On both sides of the AR display lens, there are control signal monitoring devices, visual tracking cameras, and video interactive cameras.

[0011] Preferably, the control signal monitoring device includes:

[0012] The system includes visible light detection cameras, a microphone, and feature points. Two visible light detection cameras are mounted on the AR frame, with the two cameras located on the left and right sides of the AR display lens, respectively. The microphone is fixedly connected to the temple on the side of the AR frame via a conduit. The feature points are irregularly arranged on the main interface of the interactive ring and are illuminated by a feature diode module. The main interface of the interactive ring also features an OLED display and a ring switch button, and an interactive button is located on the side of the interactive ring.

[0013] Preferably, the health monitoring device includes:

[0014] The device consists of an electrode patch, an emitter, and a receiver. The electrode patch is installed on the ear rest of the AR frame. The emitter is located directly above the inner wall of the interactive ring, and the receiver is located directly below the inner wall of the interactive ring. The emitter and receiver are electrically connected through the ring monitoring module.

[0015] Preferably, the audio device includes:

[0016] The device includes an earphone, a speaker hole, and a video interactive camera. The earphone is embedded in an earphone slot, which is fixed to the temple on the side of the AR frame. An AR glasses switch button is located next to the earphone slot near the AR display lens, and a speaker hole is provided between the AR glasses switch button and the AR display lens.

[0017] Preferably, it also includes an automatic monitoring and identification system, the automatic monitoring and identification system comprising:

[0018] The identification module is used to identify the equipment to be identified during power inspection.

[0019] The control signal monitoring module is used to monitor the position of the interactive ring and the voice signals emitted by the staff.

[0020] The health monitoring module is used to monitor the staff's monitoring status parameters, including heart rate, blood pressure, and blood oxygen saturation.

[0021] The processing module is electrically connected to the recognition module, the control signal monitoring module, and the AR display module.

[0022] Preferably, the identification module includes:

[0023] The image acquisition unit is used to acquire images of the equipment to be identified during power line inspection.

[0024] An image preprocessing unit is used to preprocess the image of the device to be identified acquired by the image acquisition unit;

[0025] The image feature extraction unit is used to extract features from the image of the equipment to be identified in the power inspection process after the image preprocessing unit has processed it.

[0026] The feature finding unit searches for models in the micro SD card database inserted in the card slot that match each feature based on the feature simulation signal input by the image feature extraction unit. If a model exists in the database that matches the feature simulation signal input by the image feature extraction unit, the unit outputs an analog signal to the first instruction unit.

[0027] The first instruction unit outputs a first instruction signal to the processing module based on the analog signal output by the feature search unit. The first instruction signal is a high or low level signal of binary code.

[0028] Preferably, the control signal monitoring module includes:

[0029] The voice recognition unit is used to recognize the voice commands issued by the staff and output the first analog signal;

[0030] The ring status monitoring unit is used to monitor the current position of the interactive ring and the action of the interactive button, and outputs a second analog signal;

[0031] The second instruction unit outputs a second instruction signal to the processing module based on the first analog signal and the second analog signal. The second instruction signal is a high or low level signal of binary code.

[0032] Preferably, the health monitoring module includes:

[0033] The first signal receiving unit is used to receive the third analog signal input from the electrode patch;

[0034] The second signal receiving unit is used to receive the fourth analog signal input to the receiving electrode;

[0035] The difference comparison unit is used to acquire the difference signal between the third analog signal and the fourth analog signal, process the difference signal, and output it to the judgment unit.

[0036] The judgment unit is used to determine whether the difference signal exceeds the preset range. If it does not exceed the range, it transmits the third analog signal and the fourth analog signal to the signal processing unit; otherwise, it eliminates the third analog signal and the fourth analog signal.

[0037] The signal processing unit is used to combine and process the third analog signal and the fourth analog signal and then output the combined analog signal to the third instruction unit.

[0038] The third instruction unit is used to send a third instruction signal to the processing module based on the merged analog signal. The third instruction signal is a high or low level signal of binary code.

[0039] Preferably, the processing module includes:

[0040] The instruction receiving unit is used to receive the first instruction signal, the second instruction signal, and the third instruction signal, and to transmit the first instruction signal, the second instruction signal, and the third instruction signal to the data analysis and processing unit.

[0041] The data analysis and processing unit is used to analyze and process the analog signal output by the feature finding unit when it receives the first instruction signal, and output a fifth analog signal containing the features of the actual object; the data analysis and processing unit is also used to analyze and process the second analog signal output by the ring state detection unit and the first analog signal output by the speech recognition unit when it receives the second instruction signal, and output a sixth analog signal containing the ring movement state and speech features; the data analysis and processing unit is also used to analyze and process the health parameters output by the signal processing unit when it receives the third instruction signal, and output a seventh analog signal containing the current health characteristics of the staff.

[0042] The modeling unit analyzes the outline, color, and brightness features of the identified equipment based on the fifth analog signal containing the features of the actual object, creates relevant electrical equipment components with the outline, color, and brightness features of the identified equipment, and then assembles them into a physical model of the equipment containing all the features of the identified equipment, and outputs the analog signal of the physical model.

[0043] The positioning unit is used to locate the device to be identified. Based on the analog signal of the device entity model, it combines the coordinates of the device entity model with the actual location coordinates of the device. After superimposing the actual outline of the device with the device entity model, it outputs the eighth analog signal of the model to the AR display unit.

[0044] The AR command unit outputs command signals to the AR glasses based on the sixth, seventh, and eighth analog signals.

[0045] Preferably, the ring monitoring module includes:

[0046] The circuit consists of a ring chip, an LED constant current drive module, and a DAC module. The pins of the ring chip are connected to the receiver in sequence through the differential amplifier module, the bandpass filter module, and the TIA amplifier module. The pins of the ring chip are connected to the collector of the transistor in the differential amplifier module in sequence through the DAC module and the DC bias module. The pins of the ring chip are connected to the emitter in sequence through the DAC module and the LED constant current drive module. The pins of the ring chip are connected to the OLED display, the interactive button module, the characteristic diode module, and the switch module. The VDD pin of the ring chip is connected to the positive power supply, and the GND pin is grounded.

[0047] The technical solution of the present invention will be further described in detail below with reference to the accompanying drawings and embodiments.

[0048] Compared with the prior art, the present invention has the following beneficial effects:

[0049] By setting up a control signal monitoring device, interaction between staff and AR technology can be achieved. Through the movement of the interactive ring, staff can control the level of detail in the equipment descriptions displayed in the AR display lenses and the structure of any component according to their preferences and understanding of the equipment being inspected. This will improve the work efficiency of staff, whether for training or inspection. Furthermore, the health monitoring device can prevent staff from experiencing accidents due to hypoxia, overwork, or abnormal heart rate. The AR glasses also have a GPS positioning module, allowing monitoring personnel to know the real-time location of staff on site, maximizing the immersive experience, improving inspection efficiency, and reducing the occurrence of safety accidents. Attached Figure Description

[0050] The accompanying drawings are provided to further illustrate the invention and form part of the specification. They are used in conjunction with embodiments of the invention to explain the invention and do not constitute a limitation thereof. In the drawings:

[0051] Figure 1 This is a schematic diagram of the main view structure of the AR glasses in this invention.

[0052] Figure 2 This is a schematic diagram of the left-side view structure of the AR glasses in this invention.

[0053] Figure 3 This is a schematic diagram of the main view structure of the interactive ring in this invention.

[0054] Figure 4 This is a top view schematic diagram of the interactive ring structure in this invention.

[0055] Figure 5 This is a circuit block diagram of the AR glasses in this invention.

[0056] Figure 6 This is a flowchart illustrating the principle of the present invention.

[0057] Figure 7 This is a schematic diagram of the interactive ring circuit of the present invention.

[0058] Figure 8 This is an enlarged schematic diagram of the DAC1 module circuit principle of the present invention.

[0059] Figure 9 This is an enlarged schematic diagram of the LED constant current drive module circuit principle of the present invention.

[0060] Figure 10 This is an enlarged schematic diagram of the TIA amplifier module circuit principle of the present invention.

[0061] Figure 11 This is an enlarged schematic diagram of the bandpass filter module circuit principle of the present invention.

[0062] Figure 12 This is an enlarged schematic diagram of the differential amplifier module circuit principle of the present invention.

[0063] Figure 13 This is an enlarged schematic diagram of the DC bias module circuit principle of the present invention.

[0064] Figure 14 This is an enlarged schematic diagram of the characteristic diode module circuit principle of the present invention.

[0065] Figure 15 This is an enlarged schematic diagram of the switching module circuit principle of the present invention.

[0066] Figure 16 This is an enlarged schematic diagram of the circuit principle of the interactive button module of the present invention.

[0067] In the diagram: 1. AR glasses frame; 2. Earphone slot; 3. Power module; 4. Speaker hole; 5. AR glasses switch button; 6. Earphone; 7. Electrode patch; 8. Visual tracking camera; 9. AR display lens; 10. Microphone; 11. Card slot; 12. Visible light detection camera; 13. Nose pad; 14. Interactive video camera; 15. Interactive ring; 16. Emitter; 17. Receiver; 18. Interactive button; 19. Feature point; 20. OLED display; 21. Ring switch button; 22. Bandpass filter module; 23. TIA amplifier module; 24. Differential amplifier module; 25. LED constant current drive module 26. DAC1 Module; 27. Switch Module; 28. Characteristic Diode Module; 29. ​​Interactive Button Module; 30. DAC2 Module; 31. DC Bias Module; R1, First Resistor; R2, Second Resistor; R3, Third Resistor; R4, Fourth Resistor; R5, Fifth Resistor; R6, Sixth Resistor; R7, Seventh Resistor; R8, Eighth Resistor; R9, Ninth Resistor; R10, Tenth Resistor; R11, Eleventh Resistor; R12, Twelfth Resistor; R13, Thirteenth Resistor; R14, Fourteenth Resistor; R15, Fifteenth Resistor; R16, Sixteenth Resistor; R17, Seventeenth Resistor; R18, ... 18. Resistor R19; 19. Resistor R20; 20. Resistor R21; 21. Resistor R22; 22. Resistor R23; 23. Resistor R24; 24. Resistor R25; 25. Resistor R26; 26. Resistor R27; 27. Resistor R28; 28. Resistor R29; 29. ​​Resistor R30; 30. Resistor R31; 31. Resistor R32; 32. Resistor R33; 33. Resistor R34; 34. Resistor R35; 35. Amplifier Q1; Amplifier Q2; Amplifier Q3; Amplifier Q4; Amplifier Q5; Amplifier Q6; Amplifier Q7; Amplifier Q7; Amplifier Q8; Amplifier Q9; Amplifier Q1; Amplifier Q1; Amplifier Q2; Amplifier Q3; Amplifier Q4; Amplifier Q5 ... 4. Fourth amplifier; C1, first capacitor; C2, second capacitor; C3, third capacitor; C4, fourth capacitor; C5, fifth capacitor; C6, sixth capacitor; C7, seventh capacitor; C8, eighth capacitor; C9, ninth capacitor; K1, first switch; K2, second switch; K3, third switch; K4, fourth switch; K5, fifth switch; K6, sixth switch; L1, first LED; L2, second LED; L3, third LED; L4, fourth LED; L5, fifth LED; L6, sixth LED; NMOS transistor; QT7136 LED chip. Detailed Implementation

[0068] The preferred embodiments of the present invention will be described below with reference to the accompanying drawings. It should be understood that the preferred embodiments described herein are for illustration and explanation only and are not intended to limit the present invention.

[0069] Furthermore, in this invention, the use of terms such as "first" and "second" is for descriptive purposes only and does not specifically refer to any order or sequence, nor is it intended to limit the invention. They are merely used to distinguish components or operations described using the same technical terms and should not be construed as indicating or implying relative importance or implicitly specifying the number of indicated technical features. Therefore, a feature defined with "first" or "second" may explicitly or implicitly include at least one of those features. Additionally, the technical solutions and features of the various embodiments can be combined with each other, but this must be based on the ability of those skilled in the art to implement them. If a combination of technical solutions is contradictory or impossible to implement, it should be considered that such a combination of technical solutions does not exist and is not within the scope of protection claimed by this invention.

[0070] Example 1

[0071] This invention provides an inspection device for teaching and patrol purposes, such as... Figure 1 , Figure 2 As shown, it includes:

[0072] AR frame 1, AR display lens 9 and interactive ring 15. AR frame 1 is equipped with power module 3 and health monitoring device. AR frame 1 is also equipped with audio device. On both sides of AR display lens 9, AR frame 1 is equipped with control signal monitoring device, visual tracking camera 8 and video interactive camera 14.

[0073] Preferably, the control signal monitoring device includes:

[0074] Visible light detection cameras 12, microphones 10, and feature points 19 are included. Two visible light detection cameras 12 are mounted on the AR frame 1, and the two visible light detection cameras 12 are located on the left and right sides of the AR display lens 9, respectively. The microphone 10 is fixedly connected to the temple on the side of the AR frame 1 via a conduit. The feature points 19 are irregularly arranged on the main interface of the interactive ring 15. The feature points 19 are controlled to light up by the feature diode module 28. The main interface of the interactive ring 15 also has an OLED display screen 20 and a ring switch button 21. An interactive button 18 is provided on the side of the interactive ring 15.

[0075] The working principle and beneficial effects of the above technical solution are as follows:

[0076] The visible light detection camera 12 can identify feature points 19 on the interactive ring 15. When an employee wears the interactive ring 15 and makes a corresponding interactive action, appearing in the AR glasses' field of vision, the visible light detection camera 12 transmits the current position of the interactive ring 15 and the action of the interactive button 18 to the processing module. After processing, the output analog signal is converted into a digital signal and then transmitted to the AR display module. At this time, the employee can control the display mode of the virtual image in the AR display lens 9. In actual use, a guide line will appear in the direction pointed by the interactive ring 15 seen in the AR display lens 9, making it convenient for the employee to select the content displayed by the AR glasses. For example, when the interactive ring 15 is moved to control the guide line in the AR display lens 9 to move to the inspection equipment and the interactive button 18 is clicked, the AR display lens 9 will display detailed information such as the relevant parameters, internal structure, and precautions of the equipment. When the employee wears the interactive ring 15 and presses and slides the interactive button 18 upwards, the displayed virtual image will be magnified.

[0077] By controlling the signal monitoring device, the interaction between the staff and AR technology can be realized. Through the movement of the interactive ring 15, the staff can control the level of detail of the equipment instructions and the structure of any component displayed in the AR display lens 9 according to their own preferences and their understanding of the inspection equipment. Whether for training or inspection, this will improve the work efficiency of the staff.

[0078] The present invention solves the following problems raised in the background art: In the prior art, VR systems used for high voltage substation simulation training (such as CN112991506B A VR-based high voltage substation simulation training operating system) usually have the following problems: the system cannot realize human-computer interaction and cannot select and control the images presented by the system according to the actual needs or learning direction of the trainees.

[0079] Example 2

[0080] Based on Example 1, such as Figure 1 , Figure 2 , Figure 3 , Figure 4 As shown, the health monitoring device includes:

[0081] Electrode patch 7, emitter 16 and receiver 17 are installed on the ear rest of AR frame 1. Emitter 16 is located directly above the inner wall of interactive ring 15 and receiver 17 is located directly below the inner wall of interactive ring 15. Emitter 16 and receiver 17 are electrically connected through ring monitoring module.

[0082] Preferably, the audio device includes:

[0083] The device includes an earphone 6, a speaker hole 4, and a video interactive camera 14. The earphone 6 is embedded in the earphone slot 2, which is fixed to the temple on the side of the AR frame 1. An AR glasses switch button 5 is provided on the side of the earphone slot 2 near the AR display lens 9. A speaker hole 4 is provided between the AR glasses switch button 5 and the AR display lens 9.

[0084] The working principle and beneficial effects of the above technical solution are as follows:

[0085] The health monitoring device consists of two parts: one part is the electrode patch 7 installed on the ear cup of the AR frame 1, and the other part is installed on the inside of the interactive ring 15. The two parts complement each other. The electrode patch 7 is actually a collection of multiple sensors used to receive physiological signals from the wearer's body and has the function of monitoring the wearer's blood pressure, heart rate, etc.

[0086] By calibrating the health data of two parts of the worker's body, errors in the detection or environmental influences can be avoided, thus preventing the worker from misjudging their current physical condition. The electrode patch 7 is actually a collection of multiple sensors used to receive physiological signals from the wearer's body, and has functions such as monitoring the worker's blood pressure and heart rate. The emitter 16 and receiver 17 measure the absorption rate of light during the capillary pulsation at the point where the worker wears the interactive ring 15, thereby monitoring the human body's blood oxygen saturation, heart rate, and other functions. At the same time, the physical condition data obtained by the health monitoring device will also be displayed on the AR display lens 9. If the data is abnormal, an alarm will be issued through the audio device.

[0087] By installing health monitoring devices, staff can avoid accidents caused by hypoxia, overwork, and abnormal heart rate. The AR glasses also have a GPS positioning module, which allows monitoring personnel to know the real-time location of staff on site, thus maximizing staff safety.

[0088] Example 3

[0089] Based on any one of Examples 1-2, such as Figure 1 , Figure 5 , Figure 6 As shown, it also includes an automatic monitoring and identification system, which includes:

[0090] The identification module is used to identify equipment to be identified during power inspections; such equipment includes transformers, frequency converters, and high and low voltage switchgear.

[0091] The control signal monitoring module is used to monitor the position of the interactive ring and the voice signals emitted by the staff.

[0092] The health monitoring module is used to monitor the staff's monitoring status parameters, including heart rate, blood pressure, and blood oxygen saturation.

[0093] The processing module is electrically connected to the recognition module, the control signal monitoring module, and the AR display module. Its function is to generate a first display parameter based on input data from the recognition module, a second display parameter based on input data from the control signal monitoring module, and a third display parameter based on input data from the health monitoring module. It then analyzes and processes these three parameters, transmitting the digital signals to the analog-to-digital signal conversion module. The analog-to-digital signal conversion module converts the analog signals into digital signals and outputs the digital signals to the AR display module. The AR display module then displays relevant device descriptions and the user's own health status on the AR display lens 9 based on the input digital signals.

[0094] Preferably, the identification module includes:

[0095] The image acquisition unit is used to acquire images of the equipment to be identified during power line inspection.

[0096] An image preprocessing unit is used to preprocess the image of the device to be identified acquired by the image acquisition unit;

[0097] The image feature extraction unit is used to extract features from the image of the device to be identified in the power inspection work after the image preprocessing unit. The most basic feature of the device to be identified is its outline. The set of pixels with drastic changes in gray level around the device in the image of the device to be identified is connected to form an outline according to a certain strategy, thereby forming a segmented region. The image feature extraction unit also extracts basic features such as brightness value, texture and color in the image of the device to be identified.

[0098] The feature finding unit searches for models in the micro SD card database inserted in the card slot 11 that match each feature based on the feature simulation signal input by the image feature extraction unit. If a model exists in the database that matches the feature simulation signal input by the image feature extraction unit, the unit outputs an analog signal to the first instruction unit.

[0099] The first instruction unit outputs a first instruction signal to the processing module based on the analog signal output by the feature search unit. The first instruction signal is a high or low level signal of binary code.

[0100] Preferably, the control signal monitoring module includes:

[0101] The voice recognition unit is used to recognize the voice commands issued by the staff and output the first analog signal;

[0102] The ring status monitoring unit is used to monitor the current position of the interactive ring 15 and the action of the interactive button 18, and outputs a second analog signal;

[0103] The second instruction unit outputs a second instruction signal to the processing module based on the first analog signal and the second analog signal. The second instruction signal is a high or low level signal of binary code.

[0104] Preferably, the health monitoring module includes:

[0105] The first signal receiving unit is used to receive the third analog signal input from the electrode patch 7;

[0106] The second signal receiving unit is used to receive the fourth analog signal input to the receiving pole 17;

[0107] The difference comparison unit is used to acquire the difference signal between the third analog signal and the fourth analog signal, process the difference signal, and output it to the judgment unit.

[0108] The judgment unit is used to determine whether the difference signal exceeds the preset range. If it does not exceed the range, it transmits the third analog signal and the fourth analog signal to the signal processing unit; otherwise, it eliminates the third analog signal and the fourth analog signal.

[0109] The signal processing unit is used to combine and process the third analog signal and the fourth analog signal and then output the combined analog signal to the third instruction unit.

[0110] The third instruction unit is used to send a third instruction signal to the processing module based on the merged analog signal. The third instruction signal is a high or low level signal of binary code.

[0111] Preferably, the processing module includes:

[0112] The instruction receiving unit is used to receive the first instruction signal, the second instruction signal, and the third instruction signal, and to transmit the first instruction signal, the second instruction signal, and the third instruction signal to the data analysis and processing unit.

[0113] The data analysis and processing unit is used to analyze and process the analog signal output by the feature finding unit when it receives the first instruction signal, and output a fifth analog signal containing the features of the actual object; the data analysis and processing unit is also used to analyze and process the second analog signal output by the ring state detection unit and the first analog signal output by the speech recognition unit when it receives the second instruction signal, and output a sixth analog signal containing the ring movement state and speech features; the data analysis and processing unit is also used to analyze and process the health parameters output by the signal processing unit when it receives the third instruction signal, and output a seventh analog signal containing the current health characteristics of the staff.

[0114] The modeling unit analyzes the outline, color, and brightness features of the identified equipment based on the fifth analog signal containing the features of the actual object, creates relevant electrical equipment components with the outline, color, and brightness features of the identified equipment, and then assembles them into a physical model of the equipment containing all the features of the identified equipment, and outputs the analog signal of the physical model.

[0115] The positioning unit is used to locate the device to be identified. Based on the analog signal of the device entity model, it combines the coordinates of the device entity model with the actual location coordinates of the device. After superimposing the actual outline of the device with the device entity model, it outputs the eighth analog signal of the model to the AR display unit.

[0116] The AR command unit outputs command signals to the AR glasses based on the sixth, seventh, and eighth analog signals.

[0117] The working principle and beneficial effects of the above technical solution are as follows:

[0118] When staff wear AR glasses and the interactive ring 15 and move around the work area, electrical equipment entering the field of view of the AR display lens 9 will be automatically captured by the recognition module. After analysis and processing by the processing module, detailed parameters, internal structure, and inspection points of the electrical equipment will be projected onto the AR display lens 9. By setting up a voice recognition unit, staff can issue simple voice commands to control the AR glasses to close, flip pages, and provide explanations of relevant information about the recognized electrical equipment. For example, when a staff member issues the voice command "Detailed explanation of common-emitter amplifier circuit", the processing module will receive a second command signal from the control signal monitoring module. After the data analysis and processing unit inside the processing module analyzes and recognizes the command signal, it will control the AR glasses to generate a new window to display the detailed explanation of "common-emitter amplifier circuit" through the AR command unit. In addition, through the modeling and positioning units within the processing module, a physical model of the relevant electrical equipment appearing in the field of view of the AR glasses can be accurately generated, and the position of the electrical equipment information displayed on the AR display lens 9 can be adjusted in real time according to the relative position of the staff and the electrical equipment. This avoids the situation where the real scene and the virtual model are misaligned due to the staff moving or rotating, making the staff more comfortable to wear AR glasses.

[0119] The automatic monitoring and identification system can place staff in a work environment that combines virtual and reality, increasing their immersive experience, improving inspection efficiency, and reducing the occurrence of safety accidents.

[0120] The present invention addresses the following problems raised in the background art: In the prior art, VR systems used for high-voltage substation simulation training (such as CN112991506B, a VR-based high-voltage substation simulation training operating system) typically have the following problems: VR devices provide a completely virtualized three-dimensional space, and the gap between the virtual image and the actual scene will lead to a decrease in the learning efficiency of trainees.

[0121] Example 4

[0122] Preferably, the AR glasses also include a Bluetooth module, a WIFI module, and a voice recognition module. The WIFI module is selected as the ESP8266WIFI module, and the voice recognition module consists of a microphone and an audio signal processing module.

[0123] The beneficial effects of the above technical solution are as follows:

[0124] By setting up a Bluetooth module, 15 AR glasses of the interactive ring can be wirelessly connected, making it convenient for staff to work. Setting up a WIFI module, together with AR display lens 9, microphone 10 and earphone 6, can realize the function of visual intercom. For example, firstly, the staff inputs the voice command "call XX" through the voice recognition module. After the audio signal is recognized, the AR chip calls the relevant personnel through the WIFI module. After the other party answers, the image will be displayed on the AR display lens 9 through the AR display module, thereby achieving the purpose of visual intercom.

[0125] Example 5

[0126] Based on any one of Examples 1-4, such as Figure 7 , Figure 8 , Figure 9 , Figure 10 , Figure 11 , Figure 12 , Figure 13 , Figure 14 , Figure 15 , Figure 16 As shown, it also includes a ring monitoring module, which includes:

[0127] The ring chip, LED constant current drive module 25, and DAC1 module 26 are connected in sequence. Pin 1 of the ring chip is connected to the receiver 17 through differential amplifier module 24, bandpass filter module 22, and TIA amplifier module 23. Pin 2 of the ring chip is connected to the collector of the transistor in differential amplifier module 24 through DAC2 module 30 and DC bias module 31. Pin 3 of the ring chip is connected to the emitter 16 through DAC1 module 26 and LED constant current drive module 25. Pin 4 of the ring chip is connected to OLED display 20. Pin 5 of the ring chip is connected to interactive button module 29. Pin 6 of the ring chip is connected to characteristic diode module 28. Pin 7 of the ring chip is connected to switch module 27. The VDD pin of the ring chip is connected to the positive power supply, and the GND pin of the ring chip is grounded.

[0128] Preferably, the TIA amplifier module 23 includes:

[0129] The first amplifier Q1 has its emitter grounded, its collector connected to the positive terminal of receiver 17, and the negative terminal of receiver 17 grounded; the first resistor R1 has its first end connected to the collector of the first amplifier Q1; the second resistor R2 has its first end connected to the base of the first amplifier Q1; the third resistor R3 has one end grounded, and the other end connected to the second end of the first resistor R1 and the second end of the second resistor R2 respectively; the first amplifier Q1 has its emitter grounded and its base connected to the output terminal of TIA amplifier module 23.

[0130] Preferably, the bandpass filter module 22 includes:

[0131] The 34th resistor R34 has its first end connected to the output terminal of TIA amplifier module 23; the fourth resistor R4 has one end grounded and the other end connected to the second end of the 34th resistor R34; the third capacitor C3 has its first end connected to the second end of the 34th resistor R34; the emitter of the second amplifier Q2 is connected to the second end of the third capacitor C3; the fifth resistor R5 has one end connected to the base of the second amplifier Q2 and the other end connected to the first end of the third capacitor C3; the second capacitor C2 has one end connected to the base of the second amplifier Q2 and the other end connected to the second end of the 34th resistor R34; the sixth resistor R6 has one end connected to the collector of the second amplifier Q2; the seventh resistor R7 has one end connected to the other end of the sixth resistor R6 and the other end connected to the positive power supply; the fourth capacitor C4 has one end connected to the base of the second amplifier Q2 and the other end connected to the output terminal of bandpass filter module 22.

[0132] The differential amplifier module 24 includes:

[0133] The eighth resistor R8 is connected at one end to the output of the bandpass filter module 22; the emitter of the third amplifier Q3 is connected to the eighth resistor R8, the base of the third amplifier Q3 is connected to the output of the differential amplifier module 24, the a terminal of the third amplifier Q3 is grounded, and the b terminal of the third amplifier Q3 is connected to the positive power supply; the ninth resistor R9 is connected at one end to the emitter of the third amplifier Q3, and the other end of the ninth resistor R9 is connected to the base of the third amplifier Q3; the tenth resistor R10 is connected at one end to the collector of the third amplifier Q3, and the other end of the tenth resistor R10 is the input of the differential amplifier module 24; the eleventh resistor R11 is connected at one end to the collector of the third amplifier Q3, and the other end of the eleventh resistor R11 is grounded.

[0134] The DC bias module 31 includes:

[0135] The ninth capacitor C9 has its first end connected to the input terminal of the differential amplifier Q3; the fourteenth resistor R14 has one end connected to the second terminal of the ninth capacitor C9; the thirteenth resistor R13 has one end connected to the second terminal of the ninth capacitor C9; the twelfth resistor R12 has its first end connected to the other end of the thirteenth resistor R13, and the first end of the twelfth resistor R12 is also connected to the positive terminal of the power supply; the fifteenth resistor R15 has its first end connected to the second terminal of the fourteenth resistor R14; the NPN transistor's emitter is connected to the second terminal of the fifteenth resistor R15, the NPN transistor's base is connected to the second terminal of the ninth capacitor C9, and the NPN transistor's collector is connected to the other end of the twelfth resistor R12; the fifth capacitor C5 has one end connected to the NPN transistor's collector, and the other end of the fifth capacitor C5 is connected to the output terminal of DAC2 module 30; the sixth capacitor C6 has one end connected to the first terminal of the fifteenth resistor R15, and the other end of the sixth capacitor C6 is connected to the NPN transistor's emitter.

[0136] The LED constant current driving module 25 includes:

[0137] Emitter 16 contains two LEDs connected in series, with their anodes connected to the positive terminal of the power supply; NMOS transistor, with its drain connected to the negative terminal of emitter 16; LED chip QX7136, with pin 1 connected to the gate (G) terminal of the NMOS transistor, pin 2 connected to the spherical (S) terminal of the NMOS transistor, pin Vdd connected to the positive terminal of the power supply, and pin GND grounded; 33rd resistor R33, with one end connected to the source (S) terminal of the NMOS transistor, and the other end grounded; 1st capacitor C1, with one end connected to pin Vdd of the LED chip QX7136, and the other end connected to the output terminal of the LED constant current drive module 25 and grounded.

[0138] The DAC1 module 26 includes:

[0139] The base of the fourth amplifier Q4 is connected to the output terminal of the LED constant current driver module 25, and the collector is grounded.

[0140] The 35th resistor, R34, is connected at one end to the base of the fourth amplifier Q4 and at the other end to the emitter of the fourth amplifier Q4; the 16th resistor, R16, is connected at one end to the emitter of the fourth amplifier Q4; the 17th resistor, R17, is connected at one end to the second terminal of the 16th resistor, R16; the 18th resistor, R18, is connected at one end to the second terminal of the 17th resistor, R17; the 19th resistor, R19, is connected at one end to the second terminal of the 18th resistor, R18; the 20th resistor, R20, is connected at one end to the second terminal of the 19th resistor, R19, and the other end is grounded; the 21st resistor, R21, is connected at one end to the second terminal of the 16th resistor, R16; the 22nd resistor, R22, is connected at one end to the second terminal of the 17th resistor, R17; the 23rd resistor, R23, is connected at one end to the second terminal of the 18th resistor, R18; the 24th resistor, R24, is connected at one end to the second terminal of the 19th resistor, R19... Two-terminal switch; the first switch K1, one end of which is connected to the second terminal of the twenty-first resistor R21. When the first switch K1 is open, the second terminal is connected to pin 3 of the ring chip. When the first switch K1 is closed, the second terminal is grounded. The second switch K2, one end of which is connected to the second terminal of the twenty-second resistor R22. When the second switch K2 is open, the second terminal is connected to pin 3 of the ring chip. When the second switch K2 is closed, the second terminal is grounded. The third switch K3, one end of which is connected to the second terminal of the twenty-third resistor R23. When the third switch K3 is open, the second terminal is connected to pin 3 of the ring chip. When the third switch K3 is closed, the second terminal is grounded. The first switch K1, one end of which is connected to the second terminal of the twenty-fourth resistor R24. When the fourth switch K4 is open, the second terminal is connected to pin 3 of the ring chip. When the fourth switch K4 is closed, the second terminal is grounded.

[0141] The interactive button module 29 includes:

[0142] The 32nd resistor R32 is connected to the positive terminal of the power supply at one end; the 5th switch K5 is connected to the second terminal of the 32nd resistor R32 at one end and grounded at the other end; the 7th capacitor C7 is connected to pin 5 of the ring chip and the second terminal of the 32nd resistor R32 at one end and grounded at the other end.

[0143] The characteristic diode module 28 includes:

[0144] The 25th resistor R25 is connected to the positive terminal of the power supply at one end; the first LED L1 is connected to the second terminal of the 25th resistor R25 at one end, and to pin 6 of the ring chip at the other end; the 26th resistor R26 is connected to the positive terminal of the power supply at one end; the second LED L2 is connected to the second terminal of the 26th resistor R26 at one end, and to pin 6 of the ring chip at the other end; the 27th resistor R27 is connected to the positive terminal of the power supply at one end; the third LED L3 is connected to the second terminal of the 27th resistor R27 at one end, and to pin 6 of the ring chip at the other end. The 28th resistor R28 is connected to the positive terminal of the power supply at one end; the fourth LED L4 is connected to the second terminal of the 28th resistor R28 at one end and to pin 6 of the ring chip at the other end; the 29th resistor R29 is connected to the positive terminal of the power supply at one end; the fifth LED L5 is connected to the second terminal of the 29th resistor R29 at one end and to pin 6 of the ring chip at the other end; the 30th resistor R30 is connected to the positive terminal of the power supply at one end; the sixth LED L6 is connected to the second terminal of the 30th resistor R30 at one end and to pin 6 of the ring chip at the other end.

[0145] The switching module 27 includes:

[0146] The 31st resistor R31 has one end connected to the positive terminal of the power supply and the other end connected to pin 7 of the ring chip; the 6th switch K6 has one end connected to the second end of the 31st resistor R31 and the other end grounded.

[0147] The eighth capacitor C8 is connected at one end to the second terminal of the sixth switch K6, and the other end is grounded.

[0148] One end of the OLED display 20 is connected to the positive terminal of the power supply, and the other end is connected to the pin 4 of the ring chip.

[0149] The working principle and beneficial effects of the above technical solution are as follows:

[0150] The interactive ring 15 incorporates a built-in health monitoring module, which includes an LED constant current drive module 25. By using this module, the LEDs are protected from burning out due to reduced resistance caused by heat generation within the interactive ring 15. Furthermore, the LED constant current drive module 25 ensures the stability of the current flowing through the diode at the emitter 16, preventing fluctuations and achieving the desired brightness. This significantly guarantees the accuracy of the health data monitored by the module. The emitter 16 of the LED constant current drive module 25 consists of two light-emitting diodes with specific wavelengths, and the receiver 17 consists of a photodiode. The health monitoring module amplifies the analog signal of the worker's blood oxygen saturation and converts it into a digital signal, which is then transmitted to the processing module of the AR glasses. Simultaneously, it... The LED module 28 is used to light up the LED at the feature point 19, enabling the visible light detection camera 12 of the AR glasses to accurately identify the position of the interactive ring 15. An interactive button module 29 is also provided. When the staff presses the button, a digital signal is generated and transmitted to the processing module of the AR glasses, thereby realizing the purpose of human-computer interaction. This allows the staff to carry out inspection work according to their own preferences and habits. An OLED display screen is set on the front of the interactive ring 15. The advantage of OLED screens over LED screens is that they can emit light themselves, so they do not need a backlight. It uses a very thin organic material coating and a glass substrate. When current passes through, the organic material will emit light. This avoids the situation where the staff cannot immediately observe the information such as battery level and signal strength on the display screen of the interactive ring 15 when they are in a dark working environment.

[0151] Obviously, those skilled in the art can make various modifications and variations to this invention without departing from its spirit and scope. Therefore, if these modifications and variations fall within the scope of the claims of this invention and their equivalents, this invention also intends to include these modifications and variations.

Claims

1. A teaching and inspection device for inspection, characterized by, The application relates to an AR mirror frame (1), an AR display lens (9) and an interactive ring (15), wherein the AR mirror frame (1) is provided with a power module (3) and a health monitoring device, and an audio device is further arranged on the AR mirror frame (1); control signal monitoring devices, a visual tracking camera (8) and a video interactive camera (14) are arranged on the AR mirror frame (1) and located on both sides of the AR display lens (9). The control signal monitoring devices comprise: visible light detection cameras (12), a microphone (10) and feature points (19), two visible light detection cameras (12) are arranged on the AR mirror frame (1) and located on the left and right sides of the AR display lens (9), the microphone (10) is fixedly connected to the side of the AR mirror frame (1) through a wire tube, the feature points (19) are irregularly arranged on the main interface of the interactive ring (15), the feature points (19) are controlled to be lighted by a feature diode module (28), an OLED display screen (20) and a ring switch button (21) are further arranged on the main interface of the interactive ring (15), and an interactive button (18) is arranged on the side of the interactive ring (15). The health monitoring device comprises: an electrode patch (7), an emitting electrode (16) and a receiving electrode (17), the electrode patch (7) is arranged on the ear support of the AR mirror frame (1), the emitting electrode (16) is located directly above the inner wall of the interactive ring (15), the receiving electrode (17) is located directly below the inner wall of the interactive ring (15), and the emitting electrode (16) and the receiving electrode (17) are electrically connected through a ring monitoring module. The ring monitoring module comprises: a ring chip, an LED constant current driving module (25) and a DAC1 module (26), pin 1 of the ring chip is connected to the receiving electrode (17) through a differential amplifier module (24), a band-pass filter module (22) and a TIA amplifier module (23) in sequence, pin 2 of the ring chip is electrically connected to the collector of a triode in the differential amplifier module (24) through a DAC2 module (30) and a direct current bias module (31) in sequence, pin 3 of the ring chip is electrically connected to the emitting electrode (16) through a DAC1 module (26) and an LED constant current driving module (25) in sequence, pin 4 of the ring chip is electrically connected to the OLED display screen (20), pin 5 of the ring chip is electrically connected to an interactive button module (29), pin 6 of the ring chip is electrically connected to a feature diode module (28), pin 7 of the ring chip is electrically connected to a switch module (27), the vdd pin of the ring chip is connected to a positive electrode of a power supply, and the GND pin of the ring chip is grounded. The audio device comprises:

2. The teaching and inspection device according to claim 1, characterized in that: earphones (6), a loudspeaker hole (4) and the video interactive camera (14), the earphones (6) are embedded in an earphone groove (2), the earphone groove (2) is fixed to the side of the AR mirror frame (1), an AR glasses switch button (5) is arranged on the side of the earphone groove (2) close to the AR display lens (9), and the loudspeaker hole (4) is formed between the AR glasses switch button (5) and the AR display lens (9). The automatic monitoring and identification system comprises:

3. The teaching and inspection device of claim 1, wherein: ​ An identification module is configured to identify an equipment to be identified in power inspection work; A control signal monitoring module is configured to monitor a position of the interactive ring and a voice signal emitted by the worker; A health monitoring module is configured to monitor a monitoring state parameter of the worker, and the monitoring state parameter includes heart rate, blood pressure, and blood oxygen saturation; A processing module is electrically connected with the identification module, the control signal monitoring module, and the AR display module.

4. The teaching and inspection device according to claim 3, characterized in that: The identification module includes: An image acquisition unit is configured to acquire an image of the equipment to be identified in the power inspection work; An image preprocessing unit is configured to preprocess the image of the equipment to be identified acquired by the image acquisition unit; An image feature extraction unit is configured to extract features of the image of the equipment to be identified processed by the image preprocessing unit; A feature searching unit is configured to search, according to a feature analog signal input by the image feature extraction unit, a model matched with each feature in a micro SD card database inserted in a card slot (11), and output an analog signal to a first instruction unit if a model matched with the feature analog signal input by the image feature extraction unit exists in the database; The first instruction unit is configured to output a first instruction signal to the processing module according to the analog signal output by the feature searching unit, and the first instruction signal is a high-low level signal of a binary code.

5. A teaching and inspection device for use in teaching and inspection as claimed in claim 4, characterized in that: The control signal monitoring module includes: A voice recognition unit is configured to recognize a voice instruction emitted by the worker and output a first analog signal; A ring state monitoring unit is configured to monitor a current position of the interactive ring (15) and an action of the interactive button (18) and output a second analog signal; A second instruction unit is configured to output a second instruction signal to the processing module according to the first analog signal and the second analog signal, and the second instruction signal is a high-low level signal of a binary code.

6. A teaching and inspection device for use in teaching and inspection as claimed in claim 5, characterized in that: The health monitoring module includes: A first signal receiving unit is configured to receive a third analog signal input by an electrode patch (7); A second signal receiving unit is configured to receive a fourth analog signal input by a receiving electrode (17); A difference comparison unit is configured to obtain a difference signal of the third analog signal and the fourth analog signal, process the difference signal, and output the processed difference signal to a judgment unit; The judgment unit is configured to judge whether the difference signal exceeds a preset range, and if not, transmit the third analog signal and the fourth analog signal to a signal processing unit, otherwise eliminate the third analog signal and the fourth analog signal; A signal processing unit is configured to process the third analog signal and the fourth analog signal, output a combined analog signal to a third instruction unit, and The third instruction unit is configured to output a third instruction signal to the processing module according to the combined analog signal, and the third instruction signal is a high-low level signal of a binary code.

7. A teaching and inspection device for use in teaching and inspection as claimed in claim 6, characterized in that: The processing module includes: An instruction receiving unit is configured to receive the first instruction signal, the second instruction signal, and the third instruction signal, and transmit the first instruction signal, the second instruction signal, and the third instruction signal to a data analysis processing unit; The data analysis processing unit is configured to analyze the analog signal output by the feature searching unit when the first instruction signal is received, and output a fifth analog signal containing the feature of the actual object; the data analysis processing unit is also configured to analyze the second analog signal output by the ring state detection unit and the first analog signal output by the voice recognition unit when the second instruction signal is received, and output a sixth analog signal containing the motion state of the ring and the voice feature; the data analysis processing unit is also configured to analyze the health parameter output by the signal processing unit when the third instruction signal is received, and output a seventh analog signal containing the current health feature of the staff; The modeling unit is configured to analyze the contour, color and brightness feature of the identified device according to the fifth analog signal containing the feature of the actual object, create a related electrical device component with the contour, color and brightness feature of the identified device, and then assemble into a device entity model containing all the features of the identified device, and output an analog signal of the entity model; The positioning unit is configured to position the device to be identified, combine the coordinates of the device entity model with the coordinates of the actual position of the device according to the analog signal of the device entity model, superimpose the actual contour of the device and the device entity model, and output an eighth analog signal of the model to the AR display unit; The AR instruction unit is configured to output an instruction signal to the AR glasses according to the sixth analog signal, the seventh analog signal and the eighth analog signal.

Citation Information

Patent Citations

  • A VR-based simulation training operating system for high-voltage substations

    CN112991506B

  • Wearable finger detection device based on pressure and electromyographic signals

    CN105943041A

  • Cursor control method and AR glasses and intelligent ring based on same

    CN106354253A