A drone-based outdoor activity personnel check-in system and method

Through drone technology integrating sensors and deep learning algorithms, it provides an automated outdoor activity personnel management system, solving the problems of inefficiency and low accuracy in large-scale outdoor activities, and achieving efficient and accurate management and safety Assure.

CN118134444BActive Publication Date: 2024-11-08BEIJING INSTITUTE OF PETROCHEMICAL TECHNOLOGY
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202410145521.X
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2024-02-01
Publication Date
2024-11-08
Estimated Expiration
2044-02-01

AI Technical Summary

Technical Problem

Traditional personnel management methods are inefficient, have low accuracy and slow response in large-scale outdoor activities, making it difficult to apply to a wide outdoor environment.

Method used

UAV technology is used to integrate modern sensors, edge computing and deep learning algorithms, providing flight control, cruise control, face recognition and information reporting systems to realize automated outdoor activity personnel management.

Benefits of technology

It improves the management efficiency and accuracy of large-scale activities, reduces the dependence of human resources, improves response speed and security, provides a non-invasive monitoring method, and enhances the control of event organizers and the experience of participants.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN118134444B_ABST
    Figure CN118134444B_ABST
Patent Text Reader

Abstract

The present invention discloses a check-in system and method for outdoor activity personnel based on unmanned aerial vehicles, including: a flight control subsystem, a cruise control subsystem, a face recognition subsystem, an operation mode switching subsystem and an information reporting subsystem; wherein the flight control subsystem is used to monitor the flight environment; the cruise control subsystem is used to formulate and execute the flight mission of the unmanned aerial vehicle based on the flight environment; the face recognition subsystem is used to accurately identify individuals in the outdoor environment based on the flight mission; the information reporting subsystem is used to transmit the data collected by the unmanned aerial vehicle to the ground data center and activity management personnel; the operation mode switching subsystem adjusts the behavior and processing flow of the unmanned aerial vehicle based on environmental requirements. The system quickly identifies and checks in participants through automated aerial cruising, reducing cumbersome manual operations, especially in the case of a large number of people and a wide range, effectively saving time and labor costs.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the technical field of unmanned aerial vehicles, and in particular to a sign-in system and method for outdoor activity personnel based on unmanned aerial vehicles. Background Art

[0002] With the rapid development of science and technology, drone technology has become an important technology in modern society. Its application range has expanded from military reconnaissance to agricultural monitoring, geological exploration, traffic management, as well as entertainment and security and other civilian fields. In outdoor activities, such as outdoor development, physical education, group learning or various exhibitions, ensuring the safety of participants and maintaining order is one of the main challenges faced by organizers. Traditional personnel management methods mainly rely on handheld devices for sign-in, or personnel statistics and records through fixed facilities. However, these methods have problems such as low efficiency, low accuracy and slow response when dealing with large crowds. Especially in a wide outdoor environment, these traditional methods are even more difficult to apply.

[0003] To sum up, in order to address the problems of inefficiency, low accuracy and slow response speed of traditional personnel management methods in large-scale outdoor activities, drone technology should be integrated with modern sensors, edge computing and deep learning algorithms to provide a comprehensive, efficient and automated outdoor activity personnel management solution. Summary of the invention

[0004] The purpose of the present invention is to provide a drone-based outdoor activity personnel check-in system and method to solve the problems existing in the above-mentioned prior art.

[0005] The present invention provides a check-in system for outdoor activities based on a drone, comprising: a flight control subsystem, a cruise control subsystem, a face recognition subsystem, an operation mode switching subsystem and an information reporting subsystem;

[0006] Wherein, the flight control subsystem is used to monitor the flight environment in real time;

[0007] The cruise control subsystem is used to formulate and execute the flight mission of the UAV based on the flight environment;

[0008] The face recognition subsystem is used to accurately identify individuals in an outdoor environment based on flight missions;

[0009] The information reporting subsystem is used to transmit the data collected by the drone to the ground data center and activity managers;

[0010] The operating mode switching subsystem adjusts the behavior and processing flow of the drone based on environmental requirements.

[0011] Optionally, the cruise control subsystem includes: an environment perception and real-time analysis module, a personnel detection module, a flight path intelligent planning module, an altitude control and optimization module, an edge computing module and a safety consideration module;

[0012] The environment perception and real-time analysis module is used to collect image and distance data based on the camera and lidar sensor carried by the drone, and obtain the current environmental conditions based on the image and distance data;

[0013] The personnel detection module is used to process the image data based on a deep neural network, extract the human body and obtain the personnel detection result;

[0014] The flight path intelligent planning module is used to plan the optimal flight path of the UAV based on the current environmental conditions and the personnel detection results;

[0015] The altitude control and optimization module is used to dynamically adjust the flight altitude of the UAV based on the personnel detection results and the real-time altitude distance provided by the laser radar;

[0016] The edge computing module is used to collaboratively process image data and sensor data;

[0017] The safety consideration module is used to perform emergency risk avoidance for the drone based on unexpected situations.

[0018] Optionally, the face recognition subsystem includes: an image acquisition and preprocessing module, a face rough search and locking module, a space positioning and flight adjustment module, a feature extraction module, a feature comparison and recognition module, an information reporting module and a continuous learning and optimization module;

[0019] The image acquisition and preprocessing module is used to capture the ground personnel image based on the high-definition camera and preprocess the ground personnel image to obtain a preprocessed image;

[0020] The human face rough search and locking module is used to locate and lock the human face area based on the pre-processed image;

[0021] The spatial positioning and flight adjustment module is used to calculate the geographic coordinates of the person on the ground based on the real-time altitude data provided by the laser radar and the GPS coordinates of the drone, and guide the drone to adjust the flight altitude;

[0022] The feature extraction module is used for extracting facial features;

[0023] The feature comparison and recognition module is used to determine the identity of an individual based on the comparison of the extracted facial features with the facial features in the database;

[0024] The information reporting module is used to transmit the determined individual identity to the data center;

[0025] The continuous learning and optimization module is used to improve recognition accuracy based on machine learning.

[0026] Optionally, the operation mode switching subsystem includes: a mode selection and automatic adjustment module and a mode specific operation and optimization module;

[0027] The mode selection and automatic adjustment module is used to automatically switch the operation mode based on the power of the drone, flight conditions, target type and quantity;

[0028] The mode-specific operation and optimization module is used to optimize the currently switched operating mode.

[0029] Optionally, the information reporting subsystem includes: a data aggregation and encapsulation module, a real-time data transmission module, an encryption and security protocol module, a data center receiving and processing module, a result feedback and application interface module, a fault tolerance and backup module and a system monitoring and maintenance module;

[0030] The data aggregation and packaging module is used to format and package the data of the flight control subsystem, the cruise control subsystem, the face recognition subsystem, and the operation mode switching subsystem;

[0031] The real-time data transmission module is used to send the encapsulated data in real time;

[0032] The encryption and security protocol module is used to encrypt the transmission data based on strong encryption technology and secure transmission protocol;

[0033] The data center receiving and processing module is used to receive data transmitted by the drone;

[0034] The result feedback and application interface module is used to provide data to activity managers through the ground data center;

[0035] The fault tolerance and backup module is used to design a fault tolerance mechanism for the information reporting system;

[0036] The system monitoring and maintenance module is used to monitor the status and performance of data transmission in real time.

[0037] Optionally, a method for signing in outdoor activity personnel based on a drone is also included, comprising the following steps:

[0038] When the drone performs the check-in task for outdoor activities, the drone selects the inspection check-in mode based on the operation mode switching subsystem, and collects images and distance data based on the inspection check-in mode and the predetermined flight route;

[0039] The image and distance data are used to detect people in the activity venue based on the edge computing module in the cruise control subsystem to obtain a person detection result;

[0040] When a person is detected, the UAV autonomously monitors the flight environment in real time based on the flight control subsystem to obtain environmental perception;

[0041] Based on the environmental perception and personnel detection results, the cruise control subsystem intelligently plans the drone's cruise route and flight altitude. At the same time, based on the face recognition subsystem, the detected personnel are identified and the identified identity information is uploaded to the data center.

[0042] Optionally, the operation mode switching subsystem also includes a mode selection module; the mode selection module includes: inspection check-in mode, personnel record mode, specific personnel tracking mode and full personnel tracking mode.

[0043] The present invention has the following technical effects:

[0044] The present invention proposes a drone-based sign-in system and method for outdoor activities, which greatly improves the efficiency and accuracy of personnel management in large-scale outdoor activities. The system quickly identifies and signs in participants through automated aerial cruising, reducing tedious manual operations, especially in cases where there are a large number of people and a wide range, effectively saving time and labor costs. The real-time images and data collected by drones are quickly processed by edge computing facilities, which can not only monitor the distribution of the crowd in real time, but also quickly locate specific individuals in emergency situations, thereby improving the event response speed and processing capabilities. The application of drones also provides a non-invasive monitoring method, which maintains a comprehensive observation of the event site without disturbing the event. The use of this technology not only ensures the smooth progress of the event, but also increases the experience of the participants to a certain extent. BRIEF DESCRIPTION OF THE DRAWINGS

[0045] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings required for use in the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative labor.

[0046] Figure 1 A system diagram of a drone-based outdoor activity personnel check-in system and method in an embodiment of the present invention;

[0047] Figure 2 is a block diagram of a cruise control system in an embodiment of the present invention;

[0048] Figure 3A face recognition system block diagram according to an embodiment of the present invention;

[0049] Figure 4 A block diagram of an information reporting system in an embodiment of the present invention;

[0050] Figure 5 4 is a block diagram of an operation mode switching system in an embodiment of the present invention. DETAILED DESCRIPTION

[0051] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0052] Embodiment 1

[0053] Drone technology offers an innovative solution. Drones are highly maneuverable and flexible, and can carry a variety of high-end sensors to monitor ground conditions in real time from the air. By transmitting live aerial images to the control center in real time, drone technology enables organizers to conduct instant analysis of crowd distribution and its dynamics to make decisions quickly and effectively. With the advancement of data processing capabilities and artificial intelligence algorithms, drones can not only capture images, but also perform advanced image recognition and data analysis. Using deep learning technologies such as face recognition and behavioral pattern analysis, drones can perform real-time identity authentication and behavior prediction. This has invaluable value in ensuring the safety of specific individuals, preventing potential security risks, and responding quickly to emergencies.

[0054] In order to solve the problems of the prior art, the purpose of the present invention is to provide a drone-based outdoor activity personnel check-in system and method. This not only improves the management efficiency of large-scale activities, but also improves the level of personnel safety protection, while reducing dependence on manual resources, improving response speed, and enhancing the overall control of the event organizer over the event site.

[0055] A check-in system for outdoor activity personnel based on unmanned aerial vehicles (UAVs), comprising: a flight control subsystem, a cruise control subsystem, a face recognition subsystem, an operation mode switching subsystem and an information reporting subsystem; wherein the flight control subsystem is used for real-time monitoring of the flight environment; the cruise control subsystem is used for formulating and executing the flight mission of the UAV based on the flight environment; the face recognition subsystem is used for accurately identifying individuals in an outdoor environment based on the flight mission; the information reporting subsystem is used for transmitting the data collected by the UAV to a ground data center and activity managers; the operation mode switching subsystem adjusts the behavior and processing flow of the UAV based on environmental requirements.

[0056] The outdoor activity personnel sign-in system and method proposed in the present invention is based on the autonomy and flexibility of the drone, and uses the camera, laser radar, edge computing subsystem, wireless data transmission and other subsystems carried by the drone to detect and identify outdoor activity personnel. The drone is equipped with a flight control subsystem, a cruise control subsystem, a face recognition subsystem, and an operation mode switching subsystem.

[0057] The flight control subsystem is the core part of the outdoor activity personnel check-in subsystem of the UAV of the present invention, which is responsible for realizing the stable flight and precise navigation of the UAV. The subsystem integrates multiple sensor data, real-time environmental analysis and advanced control algorithms to ensure that the UAV can autonomously perform inspection tasks.

[0058] The cruise control subsystem is the intelligent core of the drone personnel check-in subsystem, and is mainly responsible for formulating and executing the drone's flight mission. This subsystem analyzes data from cameras and lidars, combines real-time environmental information and preset parameters, and intelligently plans the drone's cruise route and flight altitude to achieve effective personnel detection and identification. The specific steps are:

[0059] Environmental perception and real-time analysis module: The cruise control subsystem first needs to have accurate perception of the surrounding environment. By continuously collecting image and distance data through the high-definition camera and lidar sensor on the drone, the subsystem can analyze the specific conditions of the current environment in real time, such as terrain changes, personnel distribution, weather conditions, etc., to provide necessary information input for the flight mission.

[0060] Deep neural network personnel detection module: The system uses a well-trained deep neural network model to analyze the captured image data to achieve high-accuracy personnel detection. This technology can identify and distinguish different individuals, and can effectively filter non-target objects in complex outdoor environments, greatly improving the recognition efficiency and accuracy of the sign-in subsystem.

[0061] Intelligent flight path planning module: Based on environmental perception and personnel detection results, the cruise control subsystem will use advanced algorithms to automatically plan the best flight path for the drone. This includes planning of flight actions such as starting, cruising, hovering, turning and landing, ensuring that the drone can approach specific target personnel to complete check-in or identification when necessary, while also effectively covering the entire activity area.

[0062] Altitude control and optimization module: In addition to horizontal path planning, the cruise control subsystem is also responsible for the control and optimization of flight altitude. The system dynamically adjusts the flight altitude of the drone based on the personnel detection results and the real-time altitude data provided by the lidar to obtain clearer image data and more accurate personnel location information.

[0063] Collaborative module of edge computing subsystem: The cruise control subsystem works closely with the edge computing subsystem on the drone. The edge computing subsystem is responsible for processing massive amounts of image and sensor data and feeding back the calculation results to the cruise control subsystem in real time. This design greatly reduces the delay of data transmission and improves the response speed and processing capability of the drone.

[0064] Safety consideration module: Safety is one of the important considerations in the design of the cruise control subsystem. The system monitors the flight environment in real time. If there are unpredictable risks, such as sudden severe weather conditions or the approach of other aircraft, the cruise control subsystem can quickly adjust the flight path or even perform emergency obstacle avoidance or return procedures to ensure the safety of the drone and surrounding personnel.

[0065] The face recognition subsystem is a key technology to achieve accurate sign-in. By integrating high-precision cameras, LiDAR and advanced face recognition algorithms, the subsystem can quickly and accurately identify individuals in dynamic and changing outdoor environments. The specific steps are:

[0066] Image acquisition and preprocessing module: The high-definition camera on the drone continuously captures images of people on the ground during flight. The face recognition subsystem preprocesses these real-time acquired images, including steps such as denoising, contrast enhancement, and size normalization, to improve the accuracy of subsequent processing.

[0067] Face coarse search and lock module: The system first uses the face detection algorithm to quickly locate the face area in the image, a step called face coarse search. Then, the system will further lock the detected face to ensure that it can continue to track the same target when the drone adjusts its flight position or focal length.

[0068] Spatial positioning and flight adjustment module: When a person's face is locked, the lidar is used to determine the relative distance between the locked person and the drone. Combined with the current GPS / Beidou coordinates of the drone, the subsystem can calculate the precise geographic coordinates of the person on the ground. This information will be used to guide the drone to adjust the flight altitude and camera focal length to optimize image acquisition.

[0069] Feature extraction module of deep neural network: The adjusted image is transmitted to the edge computing device on the drone and processed by deep neural networks that are trained to extract feature vectors from face images. Due to the use of edge computing, this process can reduce latency and be completed without relying on remote servers.

[0070] Feature matching and identification module: The extracted facial feature vector is then compared with the facial features pre-stored in the database. This step uses a fast search and matching algorithm to achieve efficient search in large data sets. If the system finds a matching feature, the identity of the individual can be confirmed immediately and the information is recorded.

[0071] Information reporting and access module: The identified individual information is uploaded to the data center through the wireless data transmission system of the drone, and can also be accessed in real time by on-site managers through the mobile APP. This ensures that managers can quickly understand the check-in situation and perform interactive operations when necessary.

[0072] Continuous learning and optimization module: The face recognition subsystem can also use the results of each recognition to optimize itself. The system uses machine learning algorithms to gradually improve the recognition accuracy and adapt to different environmental changes by continuously learning new data, such as lighting conditions, facial expressions, decorations and other factors.

[0073] The information reporting subsystem is a key component of the drone outdoor activity personnel check-in subsystem for aggregating and transmitting data. This subsystem ensures that the data collected by the drone when performing the check-in mission can be accurately and quickly transmitted to the ground data center and activity managers. The main purpose of the system design is to ensure the real-time, accuracy and security of the data. The specific steps are:

[0074] Data aggregation and packaging module: The information reporting subsystem first aggregates the flight data of the drone, the image data collected by the camera, the timestamp, the geographic coordinates, and the recognition results generated by the face recognition module. During this process, the system will format and package the data to ensure the integrity and consistency of the data during transmission.

[0075] Real-time data transmission module: The aggregated data is sent in real time via the wireless data transmission module carried by the drone. This usually involves the use of 4G / 5G mobile networks, satellite communications, or dedicated wireless data links. The technology and frequency bands selected by the wireless data transmission module can ensure the stability and high availability of data transmission in complex outdoor environments.

[0076] Encryption and security protocol module: To ensure the security of data during transmission, the information reporting subsystem uses strong encryption technology and secure transmission protocols. These measures can prevent data from being intercepted or tampered with during transmission, ensuring the security of personal information and flight data.

[0077] Data center receiving and processing module: The data center on the ground is equipped with a high-performance server, which is responsible for receiving the data transmitted by the drone. The server runs an efficient data processing algorithm, which can quickly analyze the received data and store the results in the database.

[0078] Results Feedback and Application Interface Module: Once the data is processed and confirmed, the results will be provided to the event managers through the ground data center. This can be achieved through a dedicated application interface, such as a web page or mobile app. The interface is designed to be user-friendly, allowing managers to instantly view the check-in status of event personnel and the flight status of the drone.

[0079] Fault tolerance and backup module: The information reporting subsystem is designed with a fault tolerance mechanism to ensure that data will not be lost when wireless transmission is temporarily interrupted or the data center processes abnormalities. A copy of the data will be temporarily stored on the drone, and once the connection is restored or the server problem is resolved, the system will automatically retransmit the data.

[0080] System monitoring and maintenance module: The system also includes a comprehensive monitoring module that can monitor the status and performance of data transmission in real time, such as transmission rate, delay and error rate, etc. This not only helps the technical team to find and solve problems in a timely manner, but also is used for continuous optimization and maintenance of the system.

[0081] The operation mode switching subsystem of the drone outdoor activity personnel check-in subsystem is a highly dynamic component used to adjust the behavior and processing flow of the drone based on specific needs and environments. This system can smoothly switch between different working modes to adapt to various monitoring and tracking tasks. Each mode is designed to achieve specific goals and has unique operating parameters and behavior guidelines. The specific steps are:

[0082] Mode selection and automatic adjustment module: The system uses advanced algorithms to automatically identify and switch to the mode that best suits the current mission and environment. This includes analyzing factors such as the drone's battery level, flight conditions, target type and quantity, etc. The system also allows manual mode switching, providing the operator with more direct control.

[0083] Mode-specific operations and optimization modules: In each mode, the drone's flight path, camera operation, sensor usage, and data processing are optimized to improve mission efficiency.

[0084] Detailed description of each mode:

[0085] Inspection check-in mode: This mode is designed for identifying and checking in pre-registered personnel. The drone will follow the predetermined flight route and use facial recognition technology to automatically identify registered personnel in the database and check in. The system ensures the accuracy of the check-in by comparing the collected facial images with the facial data pre-stored in the database in real time, and feeds the check-in information back to the data center in real time.

[0086] Personnel Recording Mode: When a person who has not been pre-registered appears in the scene, Personnel Recording Mode is activated. The drone will then focus on collecting unknown facial information, perform preliminary face capture, information storage, and perform deduplication operations to ensure that there are no duplicate records in the database. This helps to continuously update and expand the personnel database and provide more accurate check-in services for future events.

[0087] Specific Person Tracking Mode: For individuals who require special attention, the drone will switch to Specific Person Tracking Mode. In this mode, the drone continuously monitors the designated individual, not only recording their activity trajectory but also recording the time, which is essential for ensuring the safety of specific individuals or monitoring specific behavior patterns.

[0088] All-staff tracking mode: When the location information of all personnel in the venue needs to be updated in real time, the all-staff tracking mode is enabled. In this mode, the drone uses a high-precision positioning system and image recognition technology to update the location coordinates of the personnel on site and display them in real time on the monitoring interface. This provides on-site management with real-time dynamic personnel layout information, which helps with crowd control and activity management.

[0089] A specific embodiment of the present invention is a system diagram of a drone-based outdoor activity personnel check-in system and method. Figure 1 shown.

[0090] In this embodiment, the drone-based outdoor activity personnel check-in system and method is composed of a drone and a ground control center. The drone is equipped with a camera, a laser radar, a flight control subsystem, and an edge computing subsystem to detect and identify outdoor activity personnel and perform check-in tasks. The ground control center is equipped with a data center and a system monitoring terminal to receive and process data transmitted by the drone and provide real-time check-in status and flight monitoring.

[0091] In actual operation, the drone will first perform the patrol check-in mode. In the patrol check-in mode, the drone flies according to the predetermined flight route and continuously collects images and distance data using cameras and lidar. This data is transmitted to the edge computing subsystem for real-time environmental analysis. The edge computing subsystem processes the data and performs personnel detection through deep neural networks. With a well-trained deep neural network model, the system can detect people in the event venue with high accuracy.

[0092] Once a person is detected, the drone will use the flight control subsystem to autonomously perform the flight mission. The flight control subsystem integrates multiple sensor data, real-time environmental analysis, and advanced control algorithms to ensure that the drone can fly stably and navigate accurately. Based on the environmental perception and personnel detection results, the cruise control subsystem will intelligently plan the drone's cruise route and flight altitude. At the same time, the face recognition subsystem on the drone will identify the detected person and upload the recognition results to the data center.

[0093] The face recognition subsystem is one of the key technologies of the system. During the flight, the camera will continuously capture images of people on the ground and locate the face area in the image through the face detection algorithm. Subsequently, the lidar is used to determine the relative distance between the locked person and the drone and calculate the precise geographic coordinates of the person on the ground. This information will be used to guide the drone to adjust the flight altitude and camera focal length to optimize image acquisition. Through feature extraction and comparison of deep neural networks, the system can quickly and accurately identify the identity of the person and record the check-in information.

[0094] The check-in information will be uploaded to the data center through the wireless data transmission system and fed back to the ground control center in real time. The data center is equipped with a high-performance server responsible for receiving and processing the data transmitted by the drone. The server runs an efficient data processing algorithm, which can quickly parse the data and store the results in the database. At the same time, event managers can access the check-in status and flight status in real time through the system monitoring terminal, so as to quickly understand the situation of the event personnel and perform necessary operations.

[0095] In addition, the system of the present invention also takes safety into consideration. The flight control subsystem can monitor the flight environment in real time. If there are sudden severe weather conditions or the approach of other aircraft, the system will quickly adjust the flight path and perform emergency obstacle avoidance or return procedures to ensure the safety of the UAV and surrounding personnel.

[0096] In different scenarios and needs, the system can also switch operating modes according to specific modes. This includes patrol check-in mode, personnel recording mode, specific personnel tracking mode and all personnel tracking mode. By automatically identifying and switching to the most suitable mode, the system can adapt to different task requirements and environmental conditions, and improve the efficiency and accuracy of check-in tasks.

[0097] The block diagram of the cruise control subsystem is as follows Figure 2 shown.

[0098] In this embodiment, the cruise control system is the intelligent core of the drone-based outdoor activity personnel check-in system, which is used to formulate and execute the drone's flight mission. The cruise control system analyzes data from cameras and lidars, combines real-time environmental information and preset parameters, and intelligently plans the drone's cruise route and flight altitude to achieve effective personnel detection and identification.

[0099] First, the cruise control system performs environmental perception and real-time analysis. The cameras and lidar sensors on the drone continuously collect image and distance data. These data are analyzed in real time by the edge computing system, and the system can obtain the specific conditions of the current environment, such as terrain changes, personnel distribution, weather conditions, etc. These data provide the necessary information input for the flight mission.

[0100] Next, the cruise control subsystem uses deep neural networks for personnel detection. The system uses a well-trained deep neural network model to analyze the captured image data to achieve high-accuracy personnel detection. This technology can recognize and distinguish different individuals, and can effectively filter out non-target objects in complex outdoor environments, thereby greatly improving the recognition efficiency and accuracy of the check-in system.

[0101] Intelligent flight path planning is one of the key steps of the cruise control subsystem. Based on environmental perception and personnel detection results, the cruise control subsystem will use advanced algorithms to automatically plan the best flight path for the drone. This includes planning of flight actions such as starting, cruising, hovering, turning and landing, ensuring that the drone can approach specific target personnel to complete check-in or identification, while also effectively covering the entire activity area.

[0102] During flight, the cruise control subsystem is also responsible for altitude control and optimization. In addition to horizontal path planning, the system dynamically adjusts the drone's flight altitude based on personnel detection results and real-time altitude data provided by the lidar. This allows for clearer image data and more accurate personnel location information, improving the accuracy of the sign-in system.

[0103] The edge computing subsystem plays an important collaborative role in the cruise control system. The edge computing subsystem is responsible for processing massive amounts of image and sensor data and feeding back the calculation results to the cruise control system in real time. This design greatly reduces the delay in data transmission and improves the response speed and processing capabilities of the drone. Through the collaborative work of the edge computing subsystem, the cruise control subsystem can perform flight missions more quickly and accurately.

[0104] In addition, safety considerations are also one of the important factors in the design of the cruise control subsystem. The system monitors the flight environment in real time. If there are unpredictable risks, such as sudden severe weather conditions or the approach of other aircraft, the cruise control subsystem can quickly adjust the flight path or even perform emergency obstacle avoidance or return procedures to ensure the safety of the drone and surrounding personnel.

[0105] The face recognition subsystem block diagram is as follows Figure 3 shown.

[0106] In this embodiment, the face recognition subsystem is the key technology to achieve the accurate check-in function. It integrates high-precision cameras, lidar and advanced face recognition algorithms to quickly and accurately identify individuals in dynamic and changing outdoor environments.

[0107] First of all, image acquisition and preprocessing are the first steps of the face recognition subsystem. The high-definition camera mounted on the drone continuously captures images of people on the ground during flight. The face recognition subsystem preprocesses these real-time acquired images, including steps such as denoising, contrast enhancement, and size normalization, to improve the accuracy of subsequent processing.

[0108] Next, rough face search and lock is one of the key steps of the face recognition system. The system first uses the face detection algorithm to quickly locate the face area in the image, which is called rough face search. Then, the system will further lock the detected face to ensure that it can continue to track the same target when the drone adjusts its flight position or focal length.

[0109] In order to determine the relative distance between the targeted person and the drone, the face recognition subsystem uses LiDAR for spatial positioning and flight adjustment. LiDAR provides real-time altitude data, and combined with the current GPS / Beidou coordinates of the drone, the system can calculate the precise geographic coordinates of the person on the ground. This information will be used to guide the drone to adjust the flight altitude and camera focal length to optimize image acquisition, ensuring clearer image data and more accurate information on the person's location.

[0110] Next, the face recognition subsystem uses feature extraction of deep neural networks for face recognition. The adjusted images are transmitted to the edge computing device on the drone and processed by deep neural networks. These networks are trained to extract feature vectors from face images. With edge computing, this process can reduce latency and be completed without relying on remote servers.

[0111] The extracted facial feature vectors are then compared with facial features pre-stored in the database to achieve efficient search and identification in large data sets. The face recognition subsystem uses a fast search and matching algorithm to quickly and accurately compare the recognition results, confirm the identity of the individual, and record this information.

[0112] The identified individual information is uploaded to the data center through the drone's wireless data transmission system and can be accessed in real time through the mobile app. This design ensures that managers can quickly understand the check-in status and perform interactive operations when necessary.

[0113] In addition, continuous learning and optimization are important features of the face recognition system. The system can use the results of each recognition to optimize itself. Using machine learning algorithms, the system gradually improves the recognition accuracy and adapts to different environmental changes by continuously learning new data, such as lighting conditions, facial expressions, decorations and other factors.

[0114] The information reporting subsystem block diagram is as follows: Figure 4 shown.

[0115] In this embodiment, the information reporting subsystem is an important part of the entire check-in system, responsible for receiving, processing and storing check-in information from the drone, and providing real-time check-in status and flight monitoring.

[0116] First, the information reporting subsystem receives the check-in information from the drone. The drone transmits the collected check-in data to the information reporting subsystem through the wireless data transmission system. This data includes important information such as the identification results of the personnel, check-in time, and geographic coordinates.

[0117] Next, the information reporting subsystem processes and analyzes the sign-in data. The system decodes and analyzes the received data, extracts key information, and stores it in relevant databases. These databases include personnel information databases, sign-in record databases, etc.

[0118] At the same time, the information reporting subsystem will also update the sign-in status in real time. By querying and analyzing the stored sign-in records, the system can provide accurate sign-in status, including the number of people who have signed in, the list of people who have not signed in, etc. Event managers can access this information at any time through the system monitoring terminal to understand the progress of the event.

[0119] In order to ensure the security and reliability of information, the information reporting subsystem is equipped with a high-performance server. The server runs a stable operating system and database management system, and adopts multi-level data backup and security measures to ensure the integrity and availability of sign-in data.

[0120] In addition, the information reporting subsystem also provides flight monitoring functions. By receiving the flight status data of the drone, the system can monitor the flight status of the drone in real time, including flight altitude, flight speed, battery power, etc. This data can be used to evaluate the flight capability and safety of the drone, and adjust and control it as needed.

[0121] For event managers, they can access the information reporting system through a mobile APP on their mobile devices. Through this APP, they can view the check-in status, flight monitoring and other important information in real time. This design makes the use of the information reporting subsystem more convenient and flexible, providing event managers with real-time check-in status and flight monitoring.

[0122] Mode switching system such as Figure 5 As shown,

[0123] The operation mode switching subsystem is designed to adjust the behavior and processing of the drone through highly dynamic components to adapt to the changing monitoring and tracking needs. The system is reflected in its ability to smoothly switch between various working modes, each of which is carefully designed for different working goals and configured with corresponding operating parameters and behavior rules.

[0124] The system can automatically select and adjust to the most appropriate mode by combining advanced algorithms. This process takes into account multiple factors such as the drone's battery level, flight conditions, target type and quantity, etc. to ensure that the mission can be completed effectively in any given environment. At the same time, the system also allows the operator to manually switch modes, which provides the operator with more flexible control and can directly guide the behavior of the drone according to real-time conditions.

[0125] In the patrol check-in mode, the drone flies along a preset route and automatically identifies and checks in pre-registered personnel through facial recognition technology. The facial images captured by the drone are compared with the data in the database in real time to ensure the accuracy of the check-in. After the check-in is completed, the information is immediately transmitted back to the data center for real-time updates.

[0126] If an unregistered person appears on site, the system will switch to personnel recording mode. In this mode, the drone's main responsibility is to collect unknown facial information, perform face capture, data storage, and perform deduplication operations to ensure that the records in the database remain unique. This dynamic information update is crucial to expanding the personnel database and the accuracy of future event check-in services.

[0127] When it is important to monitor the safety or behavior patterns of specific individuals, the drone will switch to the specific person tracking mode. In this mode, the drone will continuously track the monitored individual, record their activity path, and record the time to ensure the individual's safety or monitor their specific behavior patterns.

[0128] Finally, when it is necessary to grasp the real-time location of all personnel in the venue, the system will start the full-person tracking mode. In this mode, the drone uses high-precision positioning technology and image recognition technology to continuously update the location information of the personnel on site and display it in real time on the monitoring interface. This function provides strong technical support for on-site crowd control and event organization, ensuring the effective management of on-site order.

[0129] Through this series of mode switching, the drone outdoor activity personnel check-in system becomes a highly flexible and reliable tool that can adaptively adjust its operating mode according to the needs of various scenarios to ensure that the task can be completed efficiently no matter what the situation. This not only improves the safety of the event, but also greatly improves work efficiency and monitoring quality.

[0130] The above shows and describes the basic principles, main features and advantages of the present invention. It should be understood by those skilled in the art that the present invention is not limited to the above embodiments. The above embodiments and descriptions are only for explaining the principles of the present invention. Without departing from the spirit and scope of the present invention, the present invention may have various changes and improvements, which fall within the scope of the present invention. The scope of protection of the present invention is defined by the attached claims and their equivalents.

Claims

1. A drone-based outdoor activity personnel check-in system, characterized in that: include: Flight control subsystem, cruise control subsystem, face recognition subsystem, operation mode switching subsystem and information reporting subsystem; Wherein, the flight control subsystem is used to monitor the flight environment in real time; The cruise control subsystem is used to formulate and execute the flight mission of the UAV based on the flight environment; The face recognition subsystem is used to accurately identify individuals in an outdoor environment based on flight missions; The information reporting subsystem is used to transmit the data collected by the drone to the ground data center and activity managers; The operation mode switching subsystem adjusts the behavior and processing flow of the drone based on environmental requirements; The cruise control subsystem includes: an environment perception and real-time analysis module, a personnel detection module, a flight path intelligent planning module, an altitude control and optimization module, an edge computing module and a safety consideration module; The environment perception and real-time analysis module is used to collect image and distance data based on the camera and lidar sensor carried by the drone, and obtain the current environmental conditions based on the image and distance data; The personnel detection module is used to process the image data based on a deep neural network, extract the human body and obtain the personnel detection result; The flight path intelligent planning module is used to plan the optimal flight path of the UAV based on the current environmental conditions and the personnel detection results; The altitude control and optimization module is used to dynamically adjust the flight altitude of the UAV based on the personnel detection results and the real-time altitude distance provided by the laser radar; The edge computing module is used to collaboratively process image data and sensor data; The safety consideration module is used to perform emergency risk avoidance for the drone based on emergencies; The face recognition subsystem includes: an image acquisition and preprocessing module, a face rough search and locking module, a space positioning and flight adjustment module, a feature extraction module, a feature comparison and recognition module, an information reporting module and a continuous learning and optimization module; The image acquisition and preprocessing module is used to capture the ground personnel image based on the high-definition camera and preprocess the ground personnel image to obtain a preprocessed image; The human face rough search and locking module is used to locate and lock the human face area based on the pre-processed image; The spatial positioning and flight adjustment module is used to calculate the geographical coordinates of the person on the ground based on the real-time altitude data provided by the laser radar and the GPS coordinates of the drone, and guide the drone to adjust the flight altitude; The feature extraction module is used for extracting facial features; The feature comparison and recognition module is used to determine the identity of an individual based on the comparison of the extracted facial features with the facial features in the database; The information reporting module is used to transmit the determined individual identity to the data center; The continuous learning and optimization module is used to improve recognition accuracy based on machine learning.

2. The outdoor activity personnel check-in system based on drone according to claim 1 is characterized in that: The operation mode switching subsystem includes: a mode selection and automatic adjustment module and a mode specific operation and optimization module; The mode selection and automatic adjustment module is used to automatically switch the operation mode based on the power of the drone, flight conditions, target type and quantity; The mode-specific operation and optimization module is used to optimize the currently switched operating mode.

3. The outdoor activity personnel check-in system based on drone according to claim 1 is characterized in that: The information reporting subsystem includes: data aggregation and packaging module, real-time data transmission module, encryption and security protocol module, data center receiving and processing module, result feedback and application interface module, fault tolerance and backup module and system monitoring and maintenance module; The data aggregation and packaging module is used to format and package the data of the flight control subsystem, the cruise control subsystem, the face recognition subsystem, and the operation mode switching subsystem; The real-time data transmission module is used to send the encapsulated data in real time; The encryption and security protocol module is used to encrypt the transmission data based on strong encryption technology and secure transmission protocol; The data center receiving and processing module is used to receive data transmitted by the drone; The result feedback and application interface module is used to provide data to activity managers through the ground data center; The fault tolerance and backup module is used to design a fault tolerance mechanism for the information reporting system; The system monitoring and maintenance module is used to monitor the status and performance of data transmission in real time.

4. The outdoor activity personnel check-in system based on drone according to claim 1 is characterized in that: A method for signing in outdoor activity personnel based on a drone is also included, comprising the following steps: When the drone performs the check-in task for outdoor activities, the drone selects the inspection check-in mode based on the operation mode switching subsystem, and collects images and distance data based on the inspection check-in mode and the predetermined flight route; The image and distance data are used to detect people in the activity venue based on the edge computing module in the cruise control subsystem to obtain a person detection result; When a person is detected, the UAV autonomously monitors the flight environment in real time based on the flight control subsystem to obtain environmental perception; Based on the environmental perception and personnel detection results, the cruise control subsystem intelligently plans the drone's cruise route and flight altitude. At the same time, based on the face recognition subsystem, the detected personnel are identified and the identified identity information is uploaded to the data center.

5. The outdoor activity personnel check-in system based on drone according to claim 4 is characterized in that: The operation mode switching subsystem also includes a mode selection module; The mode selection module includes: inspection check-in mode, personnel record mode, specific personnel tracking mode and full personnel tracking mode.