Detection and remote control system for AR glasses

Abstract

The invention discloses a detection and remote control system for AR glasses, and the system comprises an identity recognition module, a remote communication module, a behavior analysis module, an environment monitoring module, a visual enhancement module, an emotion recognition module, a threat recognition and defense module, a flight control module, and an energy management module. Determining whether the personnel in the field are internal personnel authorized by the system or not; the remote communication module is used for completing real-time communication and control between personnel and the system; according to the system, only authorized personnel can access the system through the identity recognition module and the threat recognition and defense module, potential threats can be recognized and dealt with in time, the behavior analysis module can monitor and early warn abnormal behaviors, safety awareness and emergency response capability are improved, encrypted data transmission guarantees information safety, data leakage and hostile attacks are prevented, and the system is safe and reliable. The energy management module prolongs the service time of the equipment through intelligent management and environmental energy collection, and improves the operation efficiency and reliability.

Description

Technical Field

[0001] The present invention relates to the field of security detection technology, and in particular to a detection and remote control system for AR glasses. Background Art

[0002] With the advent of the intelligent era, the development and use of machine vision technology are becoming more and more common. However, with the continuous development of AR / VR technology and applications, the market requirements for AR / VR glasses are constantly increasing, making it widely used in many fields such as games, social networking, and education.

[0004] Traditional detection of whether a person in the field is an internal member of the system usually relies on manual recognition or a simple identity recognition system, which results in slow processing speed. Especially in situations with a large number of people, manual recognition is easily affected by subjective judgment, and the probability of misidentification and missed recognition is relatively high. Therefore, we propose a detection and remote control system for AR glasses. Summary of the invention

[0005] The object of the present invention is to provide a detection and remote control system for AR glasses to solve the problems raised in the above background technology.

[0006] To achieve the above-mentioned object, the present invention provides the following technical solutions: a detection and remote control system for AR glasses, comprising an identity recognition module, a remote communication module, a behavior analysis module, an environment monitoring module, a visual enhancement module, an emotion recognition module, a threat recognition and defense module, a flight control module and an energy management module;

[0007] The identity recognition module is used to identify the identity of the personnel and determine whether the personnel on the site are internal personnel authorized by the system;

[0008] The remote communication module is used to complete real-time communication and control between personnel and the system;

[0009] The behavior analysis module is used to analyze and detect the behavior patterns of people on the field, identify and warn of abnormal behavior;

[0010] The environmental monitoring module is used to monitor the environmental variables of the site in real time;

[0011] The visual enhancement module is used to improve the user's visual experience in different environments;

[0012] The emotion recognition module is used to analyze and monitor the emotional state of people on the field;

[0013] The flight control module is used for stabilization and navigation control of the UAV;

[0014] The threat identification and defense module is used to automatically detect and handle security threats;

[0015] The energy management module is used to optimize the energy usage of the equipment and extend the operating time of the system.

[0016] Preferably, the identity recognition module includes a facial recognition unit and an iris recognition unit;

[0017] The facial recognition unit is used to use deep learning facial recognition technology to scan and recognize facial features of people on the site in real time and match them with employee faces pre-stored in the database;

[0018] The iris recognition unit is used to perform a deeper level of biometric verification through high-precision iris scanning technology.

[0019] Preferably, the remote communication module includes a voice command unit and an encrypted data transmission unit;

[0020] The voice command unit is used to remotely control the AR glasses through voice commands;

[0021] The encrypted data transmission unit is used for performing data transmission using the Advanced Encryption Standard.

[0022] Preferably, the behavior analysis module includes a behavior pattern recognition unit and an abnormal behavior early warning unit;

[0023] The behavior pattern recognition unit is used to analyze the monitored behavior data using a machine learning algorithm to identify behavior patterns that do not conform to the norm;

[0024] The abnormal behavior early warning unit is used to detect abnormal behavior. Once abnormal behavior is detected, the system will automatically sound an alarm and notify security personnel.

[0025] Preferably, the environment monitoring module includes an environmental sound monitoring unit and a gas leakage detection unit;

[0026] The ambient sound monitoring unit is used to collect ambient sound through a high-sensitivity microphone and analyze whether there is any abnormal sound;

[0027] The gas leak detection unit detects the presence of harmful gases or smoke.

[0028] Preferably, the vision enhancement module includes a night vision enhancement unit and a panoramic viewing angle unit;

[0029] The night vision enhancement unit is used to automatically turn on the night vision mode in an environment with insufficient light;

[0030] The panoramic viewing angle unit is used to provide a 360-degree viewing angle without blind spots through multiple cameras.

[0031] Preferably, the emotion recognition module includes an emotion fluctuation analysis unit and a stress response unit;

[0032] The emotion fluctuation analysis unit is used to judge the emotional state of a person by analyzing voice and facial expression changes using emotion recognition technology;

[0033] The pressure response unit is used for automatically providing corresponding adjustment suggestions or automatically notifying the counselor when a high pressure signal is detected.

[0034] Preferably, the threat identification and defense module includes an illegal intrusion detection unit and an automatic defense deployment unit;

[0035] The illegal intrusion detection unit is used to analyze the behavior and trajectory of the intruder using a deep learning algorithm to detect potential threats in a timely manner;

[0036] The automatic defense deployment unit is used to automatically initiate defense measures when a direct threat is detected, including closing an entrance or starting a safe isolation zone.

[0037] Preferably, the energy management module includes an intelligent power management unit and an environmental energy collection unit;

[0038] The intelligent power management unit is used to monitor and manage the power usage of the glasses and optimize battery life through algorithms;

[0039] The ambient energy harvesting unit is used to provide additional power to the device using ambient energy conversion technology.

[0040] Compared with the prior art, the present invention has the following beneficial effects:

[0041] 1. The present invention ensures that only authorized personnel can access the system through the identity recognition module and the threat recognition and defense module, and timely identifies and responds to potential threats. The behavior analysis module can monitor and warn of abnormal behavior, improve safety awareness and emergency response capabilities, and the remote communication module supports real-time communication and remote control, so that operators can remotely monitor and manage the use of AR glasses. Encrypted data transmission ensures information security and prevents data leakage and malicious attacks. The energy management module extends the use time of the equipment and improves operational efficiency and reliability through intelligent management and environmental energy collection. The visual enhancement module includes night vision and panoramic viewing functions to enhance the user's visual experience and operational efficiency in different environments. The emotion recognition module analyzes and monitors the user's emotional state and adjusts services in time to improve user satisfaction. Through the setting of the flight control module, after an abnormal situation is discovered, the drone can quickly respond and stably track the abnormal situation of movement.

[0042] 2. The AR glasses of the present invention should be able to remotely retrieve the camera videos in various places inside and transmit the pictures wirelessly to the glasses. Users can switch the camera pictures by pressing buttons to realize real-time monitoring of different areas. BRIEF DESCRIPTION OF THE DRAWINGS

[0043] Figure 1 It is a structural schematic diagram of the identity recognition flow chart of the present invention. DETAILED DESCRIPTION

[0044] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0045] The present invention provides a technical solution: a detection and remote control system for AR glasses, including an identity recognition module, a remote communication module, a behavior analysis module, an environment monitoring module, a visual enhancement module, an emotion recognition module, a threat recognition and defense module, a flight control module and an energy management module;

[0046] The identity recognition module is used to identify the identity of personnel and determine whether the personnel on site are internal personnel authorized by the system.

[0047] It should be noted that the identity recognition module includes a facial recognition unit and an iris recognition unit; the facial recognition unit is used to utilize deep learning facial recognition technology to scan and identify the facial features of people on the premises in real time, and match them with the employee faces pre-stored in the database; the iris recognition unit is used to perform a deeper level of biometric verification through high-precision iris scanning technology.

[0048] The identity recognition module can perform face recognition to verify the identity of the target person. When using a portable security device with AR glasses, the user hangs the identity recognition module on the chest and points the camera forward. When a suspicious target is found, the user can press the button of the identity recognition module to start the camera to shoot the target. The identity recognition module compares the captured image with the staff face data stored in the background system in advance to determine whether the target is a staff member. The recognition result will be transmitted to the AR glasses through voice broadcast and visual display, which is convenient for the user to respond quickly. The recognition process is as follows: Figure 1 shown.

[0049] Conduct a test experiment on the identity recognition module:

[0050] Test purpose: To verify whether the identity recognition module can accurately recognize the face and transmit the recognition results to the AR glasses module.

[0051] Test experiment: ① Store and recognize the same face 50 times to observe whether the recognition module can correctly recognize the stored face;

[0052] ② Use the recognition module to recognize the stored face 1 and the unstored face 2 50 times respectively;

[0053] Experimental results: The recognition accuracy test results are shown in Table 1. For the stored faces, the recognition results can be accurately obtained, and the results show that the recognition is completed; for the unstored faces, the recognition results show unknown faces. Therefore, no matter what kind of face combination, the identity recognition module can accurately identify it, and the recognition accuracy is high.

[0054] Table 1 Recognition accuracy

[0055]

[0056]

[0057] The remote communication module is used to complete real-time communication and control between personnel and systems.

[0058] It should be noted that the remote communication module includes a voice command unit and an encrypted data transmission unit; the voice command unit is used to remotely control the AR glasses through voice commands; the encrypted data transmission unit is used to transmit data using the Advanced Encryption Standard.

[0059] The behavior analysis module is used to analyze and detect the behavior patterns of people on the site, identify and warn of abnormal behavior.

[0060] It should be noted that the behavior analysis module includes a behavior pattern recognition unit and an abnormal behavior warning unit; the behavior pattern recognition unit is used to use a machine learning algorithm to analyze the monitored behavior data and identify behavior patterns that are inconsistent with the norm; the abnormal behavior warning unit is used to detect abnormal behavior. Once abnormal behavior is detected, the system will automatically issue an alarm and notify security personnel.

[0061] The environmental monitoring module is used to monitor the environmental variables of the site in real time.

[0062] It should be noted that the environmental monitoring module includes an environmental sound monitoring unit and a gas leakage detection unit; the environmental sound monitoring unit is used to collect environmental sounds through a high-sensitivity microphone and analyze whether there are any abnormal sounds; the gas leakage detection unit detects the presence of harmful gases or smoke.

[0063] The visual enhancement module is used to improve the user's visual experience in different environments.

[0064] It should be noted that the visual enhancement module includes a night vision enhancement unit and a panoramic viewing angle unit; the night vision enhancement unit is used to automatically turn on the night vision mode in low-light environments; the panoramic viewing angle unit is used to provide a 360-degree view without blind spots through multiple cameras.

[0065] The emotion recognition module is used to analyze and monitor the emotional state of people on the scene.

[0066] It should be noted that the emotion recognition module includes an emotion fluctuation analysis unit and a stress response unit; the emotion fluctuation analysis unit is used to judge the emotional state of a person by analyzing changes in sound and facial expressions using emotion recognition technology; the stress response unit is used to automatically provide corresponding adjustment suggestions or automatically notify the counselor when a high stress signal is detected.

[0067] The flight control module is used to stabilize and navigate the drone.

[0068] It should be noted that the flight control module is a drone module and a monitoring module. The MCU main control of the flight control module uses TM4C123GH6PM. The main functions include attitude self-stabilization, ultrasonic and barometer altitude setting, low-altitude optical flow fixed-point hovering, outdoor GPS fixed-point, cruise control in GPS mode, one-key return landing, OpenMV tracking, and tracking of moving objects. In terms of control strategy, the horizontal position control adopts four-ring cascade control, including horizontal position, horizontal speed, horizontal acceleration and horizontal attitude control; the vertical height control adopts three-ring control. This design aims to achieve highly accurate and stable flight control to ensure the effective execution of the monitoring function; the monitoring camera output uses the HDMI format. The USB camera input of the monitoring module is used for video output through the HDMI converter, thereby simulating the video output of the monitoring camera in the real scene. In this way, the signal of the USB camera can be converted into HDMI format to simulate the high-definition monitoring equipment, which not only realizes the high-definition output of a single-channel camera, but also can realize the simultaneous output of multiple monitoring images through the HDMI multi-screen splitter.

[0069] The threat identification and defense module is used to automatically detect and handle security threats.

[0070] It should be noted that the threat identification and defense module includes an illegal intrusion detection unit and an automatic defense deployment unit; the illegal intrusion detection unit is used to use deep learning algorithms to analyze the behavior and trajectory of intruders and detect potential threats in a timely manner; the automatic defense deployment unit is used to automatically initiate defense measures when a direct threat is detected, including closing the entrance or starting a safe isolation zone; the threat identification and defense module combines deep learning and automation technology to ensure a quick and effective response when facing illegal intrusions. In this way, not only can potential security risks be minimized, but also the losses and impacts can be minimized when security incidents occur.

[0071] The illegal intrusion detection unit is as follows: the system collects data from multiple sources such as surveillance cameras and sensors, and uses image recognition or behavior analysis technology to extract key features from the collected data, such as human movements, abnormal patterns of network requests, etc. The convolutional neural network (CNN) in the deep learning model is used to learn the feature data, so as to train the model to recognize the difference between normal and abnormal behaviors, and the trained model is used in real time to analyze new data to identify whether there are abnormal or potential threatening behaviors. Using CNN for image recognition, a basic convolution layer operation is expressed as:

[0072] f(x)=max(0,x.w+b), x is the input feature, w is the convolution kernel weight, b is the bias term, and max(0,x) represents the ReLU activation function.

[0073] When the automatic defense deployment unit detects a direct threat, it is responsible for automatically initiating defense measures. The working process includes: after the intrusion detection unit issues an alarm, a quick verification is performed to confirm whether a threat actually exists; once the threat is confirmed to be valid, the system will automatically take action according to the preset defense strategy, such as closing the entrance, cutting off the network connection, or activating a secure isolation zone; after the defense measures are initiated, the system will record the event details and conduct subsequent security audits and recovery plans.

[0074] The energy management module is used to optimize the energy usage of the equipment and extend the system's operating time.

[0075] It should be noted that the energy management module includes an intelligent power management unit and an ambient energy harvesting unit; the intelligent power management unit is used to monitor and manage the power usage of the glasses and optimize battery life through algorithms; the ambient energy harvesting unit is used to provide additional power to the device using ambient energy conversion technology.

[0076] In the description of the present invention, it is necessary to understand that the terms "coaxial", "bottom", "one end", "top", "middle", "the other end", "upper", "one side", "top", "inside", "front", "center", "both ends" and the like indicate orientations or positional relationships based on the orientations or positional relationships shown in the accompanying drawings, and are only for the convenience of describing the present invention and simplifying the description, and do not indicate or imply that the device or element referred to must have a specific orientation, be constructed and operated in a specific orientation, and therefore should not be understood as a limitation on the present invention.

[0077] In addition, the terms "first", "second", "third" and "fourth" are used for descriptive purposes only and are not to be understood as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Thus, the features defined as "first", "second", "third" and "fourth" may explicitly or implicitly include at least one of such features.

[0078] In the present invention, unless otherwise clearly stipulated and limited, the terms such as "installation", "setting", "connection", "fixation" and "screw-on" should be understood in a broad sense. For example, it can be a fixed connection, a detachable connection, or an integral one; it can be a mechanical connection or an electrical connection; it can be a direct connection or an indirect connection through an intermediate medium; it can be the internal connection of two elements or the interaction relationship between two elements. Unless otherwise clearly defined, ordinary technicians in this field can understand the specific meanings of the above terms in the present invention according to the specific circumstances.

[0079] Although embodiments of the present invention have been shown and described, it will be appreciated by those skilled in the art that various changes, modifications, substitutions and variations may be made to the embodiments without departing from the principles and spirit of the present invention, and that the scope of the present invention is defined by the appended claims and their equivalents.

Claims

1. A detection and remote control system for AR glasses, characterized in that: It includes identity recognition module, remote communication module, behavior analysis module, environmental monitoring module, visual enhancement module, emotion recognition module, threat identification and defense module, flight control module and energy management module; The identity recognition module is used to identify the identity of the personnel and determine whether the personnel on the site are internal personnel authorized by the system; The remote communication module is used to complete real-time communication and control between personnel and the system; The behavior analysis module is used to analyze and detect the behavior patterns of people on the field, identify and warn of abnormal behavior; The environmental monitoring module is used to monitor the environmental variables of the site in real time; The visual enhancement module is used to improve the user's visual experience in different environments; The emotion recognition module is used to analyze and monitor the emotional state of people on the field; The flight control module is used for stabilization and navigation control of the UAV; The threat identification and defense module is used to automatically detect and handle security threats; The energy management module is used to optimize the energy usage of the equipment and extend the operating time of the system.

2. A detection and remote control system for AR glasses according to claim 1, characterized in that: The identity recognition module includes a facial recognition unit and an iris recognition unit; The facial recognition unit is used to use deep learning facial recognition technology to scan and recognize facial features of people on the site in real time and match them with employee faces pre-stored in the database; The iris recognition unit is used to perform a deeper level of biometric verification through high-precision iris scanning technology.

3. A detection and remote control system for AR glasses according to claim 1, characterized in that: The remote communication module includes a voice command unit and an encrypted data transmission unit; The voice command unit is used to remotely control the AR glasses through voice commands; The encrypted data transmission unit is used for performing data transmission using the Advanced Encryption Standard.

4. A detection and remote control system for AR glasses according to claim 1, characterized in that: The behavior analysis module includes a behavior pattern recognition unit and an abnormal behavior early warning unit; The behavior pattern recognition unit is used to analyze the monitored behavior data using a machine learning algorithm to identify behavior patterns that do not conform to the norm; The abnormal behavior early warning unit is used to detect abnormal behavior. Once abnormal behavior is detected, the system will automatically sound an alarm and notify security personnel.

5. The detection and remote control system for AR glasses according to claim 1, characterized in that: The environmental monitoring module includes an environmental sound monitoring unit and a gas leakage detection unit; The ambient sound monitoring unit is used to collect ambient sound through a high-sensitivity microphone and analyze whether there is any abnormal sound; The gas leak detection unit detects the presence of harmful gases or smoke.

6. A detection and remote control system for AR glasses according to claim 1, characterized in that: The vision enhancement module includes a night vision enhancement unit and a panoramic viewing angle unit; The night vision enhancement unit is used to automatically turn on the night vision mode in an environment with insufficient light; The panoramic viewing angle unit is used to provide a 360-degree viewing angle without blind spots through multiple cameras.

7. A detection and remote control system for AR glasses according to claim 1, characterized in that: The emotion recognition module includes an emotion fluctuation analysis unit and a stress response unit; The emotion fluctuation analysis unit is used to judge the emotional state of a person by analyzing voice and facial expression changes using emotion recognition technology; The pressure response unit is used to automatically provide corresponding adjustment suggestions or automatically notify the counselor when a high pressure signal is detected.

8. The detection and remote control system for AR glasses according to claim 1, characterized in that: The threat identification and defense module includes an illegal intrusion detection unit and an automatic defense deployment unit; The illegal intrusion detection unit is used to analyze the behavior and trajectory of the intruder using a deep learning algorithm to detect potential threats in a timely manner; The automatic defense deployment unit is used to automatically initiate defense measures when a direct threat is detected, including closing an entrance or starting a safe isolation zone.

9. The detection and remote control system for AR glasses according to claim 1, characterized in that: The energy management module includes an intelligent power management unit and an environmental energy collection unit; The intelligent power management unit is used to monitor and manage the power usage of the glasses and optimize battery life through algorithms; The ambient energy harvesting unit is used to provide additional power to the device using ambient energy conversion technology.

Images