Intelligent photoelectric automatic tracking identification device and system

Abstract

The invention belongs to the technical field of low-altitude unmanned aerial vehicle tracking, and particularly relates to an intelligent photoelectric automatic tracking recognition device and system.The intelligent photoelectric automatic tracking recognition device comprises a supporting frame, a central high-resolution imaging camera is installed in the middle of the supporting frame, and a plurality of ultra-wide-view-field cameras are installed on the side of the central high-resolution imaging camera; the central high-resolution imaging camera and the ultra-wide field-of-view camera are both internally provided with visible light and infrared photoelectric imaging systems, and the systems are installed on a multi-dimensional free adjustment structure. The device adopts a composite imaging architecture combining a central high-resolution imaging camera and an ultra-wide field-of-view camera to form an efficient working mode of'wide-area search tracking + accurate recognition '. The single view field of the ultra-wide view field camera exceeds 90 degrees, the combined internally tangent full view field angle reaches 180 degrees, the center view fields are overlapped, a large-range scene can be quickly captured, and preliminary searching and locking of a target are achieved.

Description

Technical Field

[0001] This invention relates to the field of low-altitude unmanned aerial vehicle (UAV) tracking technology, specifically to an intelligent photoelectric automatic tracking and identification device and system. Background Technology

[0002] With the rapid development and widespread adoption of drone technology, non-cooperative low-altitude flying targets pose an increasingly serious challenge to the security of critical facilities and sensitive areas. These targets include, but are not limited to, small drones, birds, and other low-altitude flying objects that may threaten airport operations, nuclear power plant safety, and the protection of highly sensitive areas. The security needs of these areas place higher demands on the accuracy, real-time performance, and reliability of monitoring systems.

[0003] The existing technology still has the following problems: Existing intelligent photoelectric automatic tracking and recognition devices and systems still reveal many shortcomings in practical applications. In terms of optical systems, traditional optical lens designs often struggle to balance the demands of a wide field of view and high resolution. Single-focal-length lenses cannot flexibly adjust imaging effects when facing targets of different distances and sizes, resulting in the loss of detail for distant targets and the inability to fully cover the field of view for close targets. At the photoelectric sensor level, common sensors suffer from bottlenecks in sensitivity and response speed. Some sensors lack the ability to perceive weak light signals, making it difficult to acquire clear images in low-light environments, thus hindering target feature extraction. Simultaneously, the sensor's response speed limits the tracking of fast-moving targets, failing to capture changes in target position in a timely manner, leading to tracking delays or even target loss. Furthermore, the fusion of different types of sensors (such as visible light sensors and infrared sensors) is poor, with problems in data synchronization and collaborative processing, failing to fully leverage the information complementarity advantages of multi-sensor fusion.

[0004] Therefore, an intelligent photoelectric automatic tracking and identification device and system are proposed to address the above problems. Summary of the Invention

[0005] The technical solution adopted by this invention to solve its technical problem is as follows: Existing low-altitude UAV tracking technologies and systems still reveal many shortcomings in practical applications. In terms of optical systems, traditional optical lens designs often struggle to simultaneously meet the demands of a wide field of view and high resolution. Single-focal-length lenses cannot flexibly adjust imaging effects when facing targets of different distances and sizes, resulting in the loss of detail for distant targets and the inability to fully cover the field of view for close targets. Therefore, this invention develops an intelligent photoelectric automatic tracking and recognition device, the system comprising a safety risk monitoring layer, an intelligent decision-making layer, a construction execution layer, and a data collaboration hub.

[0006] The technical solution adopted by the present invention to solve its technical problem is: an intelligent photoelectric automatic tracking and identification device, including a support frame, a multi-dimensional free adjustment structure is installed on the top (or side) of the support frame, a central high-resolution imaging camera is installed in the middle part of the multi-dimensional free adjustment structure, and an ultra-wide field-of-view camera is installed on the side of the central high-resolution imaging camera.

[0007] Preferably, both the central high-resolution imaging camera and the ultra-wide field-of-view camera are equipped with a visible light + infrared photoelectric imaging system, and this system can seamlessly switch between daytime and nighttime brightness conditions.

[0008] Preferably, the ultra-wide field of view of the camera has a single field of view of more than 90 degrees, and the combined inscribed full field of view reaches 180 degrees, with an overlapping area in the center field of view.

[0009] Preferably, the multidimensional free-adjustable structure can automatically guide the steering based on intelligent calculations to ensure that the target is always locked in the central area of ​​the imaging system.

[0010] Preferably, the central high-resolution imaging camera is fixedly connected to an intelligent analysis system, and the intelligent analysis system is capable of performing detailed analysis and identification of the captured target.

[0011] Preferably, the number of ultra-wide field-of-view cameras can be adjusted according to actual needs to cover different monitoring ranges.

[0012] Preferably, the device further includes an ambient light sensing module, which can automatically adjust the camera's exposure parameters according to changes in ambient light to improve recognition accuracy, and can automatically (or manually) switch to visible light or infrared imaging mode between day and night.

[0013] Preferably, the system includes a central high-resolution imaging device, multiple ultra-wide field-of-view cameras, an intelligent tracking control module, and a target recognition and analysis module. The central high-resolution imaging device is used to capture detailed images of the target, the multiple ultra-wide field-of-view cameras are used to search for and lock onto the target, the intelligent tracking control module uses a linkage mode of "intelligent algorithm + multi-dimensional free-adjustable structure" to achieve automatic tracking and locking of the target, and the target recognition and analysis module uses a linkage mode of "deep learning + image recognition technology" to achieve intelligent recognition and analysis of the target.

[0014] Preferably, the central high-resolution imaging device and each ultra-wide field-of-view camera include a visible light imaging submodule and an infrared imaging submodule.

[0015] Preferably, the intelligent tracking control module includes a target locking submodule and an automatic steering control submodule. The target locking submodule is responsible for locking the target in the overlapping area, and the automatic steering control submodule is responsible for guiding the free adjustment structure to track and steer according to intelligent calculation, so as to ensure that the target is always in the central area of ​​the imaging system.

[0016] The advantages of this invention are: 1. The device employs a composite imaging architecture combining a central high-resolution imaging camera and an ultra-wide field-of-view camera, forming a highly efficient working mode of "wide-area search and tracking + precise identification." The ultra-wide field-of-view camera has a single field of view exceeding 90 degrees, and the combined internal field of view reaches 180 degrees with overlapping central fields of view, enabling rapid capture of large-scale scenes and initial target search and locking. The central high-resolution imaging camera then captures details of the locked target. The two cameras have a clear division of labor yet work closely together, greatly improving the efficiency and accuracy of target tracking and identification.

[0017] Both the central high-resolution imaging camera and the ultra-wide field-of-view camera are equipped with a built-in visible light + infrared optoelectronic imaging system, enabling seamless switching between daytime and nighttime brightness conditions. This feature allows the device to overcome the limitations of time and ambient light, continuously and stably acquiring clear images whether in bright daylight or in dim or even dark nights, achieving target tracking and recognition across the entire time domain. This effectively avoids monitoring blind spots caused by changes in lighting conditions, significantly improving the system's environmental adaptability and reliability.

[0018] The multi-dimensional freely adjustable structure can automatically guide the target's direction based on intelligent calculations, ensuring that the target remains locked in the central area of ​​the imaging system. This structure works in conjunction with the "intelligent algorithm + multi-dimensional freely adjustable structure" linkage mode in the intelligent tracking control module, giving the device a high degree of intelligence and flexibility. When the target moves within the monitoring range, the intelligent algorithm quickly calculates changes in the target's position, driving the multi-dimensional freely adjustable structure to adjust the angles of the ultra-wide field-of-view camera and the central high-resolution imaging camera in a timely manner, keeping the target continuously in the optimal imaging position, ensuring the continuity and stability of tracking, and preventing target loss. This is particularly suitable for tracking dynamic targets.

[0019] The intelligent analysis system connected to the bottom of the central high-resolution imaging camera, combined with the "deep learning + image recognition technology" linkage mode in the intelligent tracking control module, constructs a powerful intelligent analysis and processing system. By analyzing the captured images through deep learning algorithms, it can accurately identify the characteristics, behaviors, and states of the target, achieving intelligent target recognition and analysis.

[0020] The number of ultra-wide field-of-view cameras can be flexibly adjusted according to actual needs to cover different monitoring ranges, giving the device and system excellent scalability. Whether it's localized monitoring of small-scale sites or full-area coverage of large spaces, monitoring requirements can be met by increasing or decreasing the number of ultra-wide field-of-view cameras. Meanwhile, each component adopts a modular design concept with standardized interfaces, facilitating installation, disassembly, and maintenance, reducing system upgrade and repair costs, and enhancing the system's versatility and practicality. Attached Figure Description

[0021] To more clearly illustrate the technical solutions in the embodiments of the present invention or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0022] Figure 1 This is a three-dimensional structural diagram of the entire invention from the front view; Figure 2 This is a top-view three-dimensional structural diagram of the present invention; Figure 3 This is a schematic diagram of the framework structure of the intelligent photoelectric automatic tracking and recognition system of the present invention; Figure 4 This is a schematic diagram of the daytime working structure of the visible light + infrared photoelectric imaging system of the present invention; Figure 5 This is a schematic diagram of the nighttime working structure of the visible light + infrared photoelectric imaging system of the present invention.

[0023] In the diagram: 1. Support frame; 2. Central high-resolution imaging camera; 3. Multi-dimensional free-adjustment structure; 4. Ultra-wide field-of-view camera; 5. Environmental adaptability module; 6. Central high-resolution imaging device; 601. Visible light imaging sub-module; 602. Infrared imaging sub-module; 7. Multiple ultra-wide field-of-view cameras; 8. Intelligent tracking control module; 801. Target locking sub-module; 802. Automatic steering control sub-module; 9. Target recognition and analysis module. Detailed Implementation

[0024] The technical solutions of the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of the present invention, and not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of the present invention. Example

[0025] like Figure 1The present invention relates to an intelligent photoelectric automatic tracking and identification device and system, comprising a support frame 1, a central high-resolution imaging camera 2, a multi-dimensional freely adjustable structure 3, an ultra-wide field-of-view camera 4, and an environmental adaptability module 5.

[0026] Please see Figures 1 to 2The diagram illustrates an intelligent photoelectric automatic tracking and recognition device, comprising a support frame 1. A multi-dimensional freely adjustable structure 3 is mounted on the top of the support frame 1, and a central high-resolution imaging camera 2 is mounted on top of the multi-dimensional freely adjustable structure 3. An ultra-wide field-of-view camera 4 is mounted on the side of the central high-resolution imaging camera 2. Both the central high-resolution imaging camera 2 and the ultra-wide field-of-view camera 4 are equipped with visible light + infrared photoelectric imaging systems. During the day, when external light is abundant, ambient light information first illuminates a reflector in the front optical system. The design of this reflector allows it to flexibly adjust its angle to adapt to different lighting conditions. In this case, the reflector swings down, accurately reflecting the received visible light information to the visible light imaging system, where the photoelectric imaging device converts the light signal into an electrical signal, thereby acquiring a high-definition visible light image. This process not only captures the details of the target but also ensures the quality and accuracy of the image. At night, when external visible light becomes weak, the reflector in the front optical system automatically swings up. This action allows the light information to be received by the infrared imaging optical system. The up-and-down movement of the reflector here is merely a description of one action of the reflector. In the optical path, the reflector can also be sideways, its main function being to either prevent reflection so that light goes directly to the subsequent optical system or reflect light to the side of the subsequent optical system. The infrared imaging optical system is specifically designed to capture and convert light information within the infrared spectrum into infrared images. These images are crucial for identifying and tracking targets at night or in low-light environments because they can penetrate darkness and reveal details invisible in visible light. The ultra-wide field-of-view camera 4 has a single field of view exceeding 90 degrees, and the combined inscribed full field of view reaches 180 degrees, with an overlapping area in the central field of view. The multi-dimensional freely adjustable structure 3 can automatically guide the steering based on intelligent calculations to ensure that the target is always locked in the central area of ​​the imaging system. During the target detection phase, the system uses ultra-wide field-of-view cameras arranged in different positions to perform a wide-range search. These cameras each have a field of view exceeding 90 degrees, and by arranging them in pairs, they can cover a full 180-degree field of view, ensuring no blind spots. Once the ultra-wide field-of-view camera detects a target, the system analyzes the image using its built-in target detection algorithm to confirm the target's presence and initial location. After target confirmation, the system further locks onto the target using the ultra-wide field-of-view camera in the central overlapping area. The overlapping camera fields of view in this area provide more precise target location information. Simultaneously, the system's built-in intelligent algorithms begin analyzing the target's trajectory and speed to predict its future position. These algorithms may include machine learning and computer vision techniques. Based on the adjustment instructions calculated by the intelligent algorithms, the multi-dimensional free-adjustment structure automatically adjusts its position and angle to ensure the central high-resolution imaging camera remains pointed at the target. The system continuously monitors changes in the target's position and updates the adjustment instructions in real time to accommodate rapid or irregular movements. The central high-resolution imaging camera continuously captures clear images of the target based on the real-time adjustments of the adjustment structure.The captured images are fed into the target recognition and analysis module, where deep learning and other technologies are used for intelligent analysis to identify the specific type and characteristics of the target. The system uses control algorithms to generate precise adjustment commands to keep the target centered in the imaging system. Simultaneously, a feedback mechanism monitors the execution of the adjustment structure to ensure accurate execution of the commands and makes adjustments based on actual conditions. An intelligent analysis system is fixedly connected to the bottom of the central high-resolution imaging camera 2, and this system can perform detailed analysis and discrimination of the captured targets. The number of ultra-wide field-of-view cameras 4 can be adjusted according to actual needs to cover different monitoring ranges. The device also includes an environmental adaptability module 5, which automatically adjusts the camera's exposure parameters according to changes in ambient light to improve recognition accuracy.

[0027] Please see Figures 1 to 2 The present invention discloses an intelligent photoelectric automatic tracking and recognition device and system, comprising a central high-resolution imaging device 6, multiple ultra-wide field-of-view cameras 7, an intelligent tracking control module 8, and a target recognition and analysis module 9. The central high-resolution imaging device 6 is used to capture detailed images of the target, the multiple ultra-wide field-of-view cameras 7 are used to search for and lock onto the target, the intelligent tracking control module 8 utilizes a linkage mode of "intelligent algorithm + multi-dimensional free-adjustable structure" to achieve automatic tracking and locking of the target, and the target recognition and analysis module 9 utilizes a linkage mode of "deep learning + image recognition technology" to achieve intelligent recognition and analysis of the target. The central high-resolution imaging device 6 includes a visible light imaging submodule 601 and an infrared imaging submodule 602. The intelligent tracking control module 8 includes a target locking submodule 801 and an automatic steering control submodule 802. The target locking submodule 801 is responsible for locking the target in the overlapping area, and the automatic steering control submodule 802 is responsible for tracking and steering according to intelligent calculations to guide the free-adjustable structure, ensuring that the target is always in the central area of ​​the imaging system.

[0028] Working principle: The low-altitude UAV tracking device uses a support frame 1 as a stable foundation structure, bearing the core components of the entire system. The central high-resolution imaging camera 2 mounted at the top works in conjunction with the ultra-wide field-of-view camera 4 at the end of the side multi-dimensional freely adjustable structure 3 to construct a comprehensive, multi-layered target monitoring system. After the system starts up, the ultra-wide field-of-view camera 4, with its individual field of view exceeding 90 degrees and combined inner tangent full field of view reaching 180 degrees, as well as the overlapping area in the central field of view, takes the lead in scanning the monitored area. Whether it's the movement trajectory of various low-altitude targets or the operational status of various devices, everything can be quickly included in the monitoring range, achieving initial search and locking of potential targets. Meanwhile, the central high-resolution imaging camera 2, after the ultra-wide field-of-view camera 4 locks onto the target, rapidly captures details of the target. Leveraging its high resolution, it clearly presents the specific features and status of the target, providing high-definition image data for subsequent analysis. Both the central high-resolution imaging camera 2 and the ultra-wide field-of-view camera 4 are equipped with a visible light + infrared optoelectronic imaging system, which possesses strong environmental adaptability. During the day, when there is ample sunlight, the visible light imaging component operates efficiently, acquiring images with vivid colors and rich details. When night falls or in dimly lit environments, the infrared optoelectronic imaging component automatically and seamlessly switches to capture the infrared radiation emitted by objects, generating clear thermal images. This seamless day-night switching mechanism ensures that the system can stably output high-quality images under any conditions, continuously and effectively monitoring the area of ​​interest.

[0029] During target tracking, the multidimensional freely adjustable structure 3 plays a crucial role. When the target moves on-site, the intelligent computing module within the system analyzes the target's positional changes in real time. Based on this, the multidimensional freely adjustable structure 3 automatically guides the steering based on the intelligent calculation results, precisely adjusting the angle and orientation of the ultra-wide field-of-view camera 4 and the central high-resolution imaging camera 2. This ensures that the target remains in the central area of ​​the imaging system, achieving stable and continuous target tracking and avoiding blind spots or loss of tracking due to target movement. The intelligent analysis system, fixedly connected to the bottom of the central high-resolution imaging camera 2, employs a combined "deep learning + image recognition technology" approach to perform in-depth analysis of the captured target images. Through training on a large amount of data, the intelligent analysis system can accurately identify various low-altitude flying targets, whether there are any violations, and whether any abnormal conditions are present, among other potential safety hazards. Once an anomaly is detected, the system will immediately issue a warning signal, prompting timely action and effectively preventing safety accidents.

[0030] Furthermore, the system's environmental adaptability module 5 monitors changes in ambient light in real time. When light intensity changes, this module automatically adjusts the camera's exposure parameters to ensure that the image remains clear and accurate. For example, under different lighting conditions such as direct sunlight or overcast skies, the environmental adaptability module 5 can react quickly, optimize camera imaging, provide a reliable image data foundation for the intelligent analysis system, and further improve the accuracy of target recognition. The number of ultra-wide field-of-view cameras (UHF 4) is not fixed but can be flexibly adjusted according to the actual scale of the number of drones being monitored and the monitoring requirements. A small number of UHF 4 cameras can meet the monitoring coverage needs; by increasing the number of UHF 4 cameras, full-area monitoring without blind spots can be achieved, fully demonstrating the system's flexibility and scalability. Standardized interface design is used between components to ensure that adjustments to the number of devices or equipment maintenance can be completed quickly and conveniently, reducing system operation and maintenance costs and improving overall operating efficiency.

[0031] The foregoing has shown and described the basic principles, main features, and advantages of the present invention. Those skilled in the art should understand that the present invention is not limited to the above embodiments. The embodiments and descriptions in the specification are merely illustrative of the principles of the invention. Various changes and modifications can be made to the invention without departing from its spirit and scope, and all such changes and modifications fall within the scope of the claimed invention.

Claims

1. An intelligent photoelectric automatic tracking and identification device, characterized in that: Includes a support frame (1), on the top (or side) of the support frame (1) a multi-dimensional free adjustment structure (3) is installed, and a central high-resolution imaging camera (2) is installed in the middle part of the multi-dimensional free adjustment structure (3), and an ultra-wide field-of-view camera (4) is installed on the side of the central high-resolution imaging camera (2).

2. The intelligent photoelectric automatic tracking and identification device according to claim 1, characterized in that: Both the central high-resolution imaging camera (2) and the ultra-wide field-of-view camera (4) are equipped with a visible light + infrared photoelectric imaging system, which can seamlessly switch between daytime and nighttime brightness conditions.

3. The intelligent photoelectric automatic tracking and identification device according to claim 1, characterized in that: The ultra-wide field of view camera (4) has a single field of view of more than 90 degrees, and the combined inscribed full field of view angle reaches 180 degrees, with an overlapping area in the center field of view.

4. The intelligent photoelectric automatic tracking and identification device according to claim 1, characterized in that: The multidimensional free-adjustable structure (3) can intelligently calculate and interpret the image captured by the ultra-wide field-of-view camera to automatically guide the steering, so as to ensure that the target is always locked in the central area of ​​the imaging system.

5. The intelligent photoelectric automatic tracking and identification device according to claim 1, characterized in that: The intelligent analysis system of the central high-resolution imaging camera (2) can perform detailed analysis and identification of the captured target.

6. The intelligent photoelectric automatic tracking and identification device according to claim 1, characterized in that: The number of ultra-wide field-of-view cameras (4) can be adjusted according to actual needs to cover different monitoring ranges.

7. The intelligent photoelectric automatic tracking and identification device according to claim 1, characterized in that: The device also includes an ambient light sensing module (5), which can automatically adjust the camera's exposure parameters according to changes in ambient light to improve recognition accuracy, and can automatically (or manually) switch to visible light or infrared imaging mode between day and night.

8. An intelligent photoelectric automatic tracking and identification system, characterized in that: It includes a central high-resolution imaging device (6), multiple ultra-wide field-of-view cameras (7), an intelligent tracking control module (8), and a target recognition and analysis module (9); the central high-resolution imaging device (6) is used to capture detailed images of the target, the multiple ultra-wide field-of-view cameras (7) are used to search for and lock onto the target, the intelligent tracking control module (8) uses a linkage mode of "intelligent algorithm + multi-dimensional free adjustment structure" to realize automatic tracking and locking of the target, and the target recognition and analysis module (9) uses a linkage mode of "deep learning + image recognition technology" to realize intelligent recognition and analysis of the target.

9. The intelligent photoelectric automatic tracking and identification system according to claim 1, characterized in that: The central high-resolution imaging device (6) includes a visible light imaging submodule (601) and an infrared imaging submodule (602).

10. The intelligent photoelectric automatic tracking and identification system according to claim 1, characterized in that: The intelligent tracking control module (8) includes a target locking submodule (801) and an automatic steering control submodule (802). The target locking submodule (801) is responsible for locking the target in the overlapping area, and the automatic steering control submodule (802) is responsible for guiding the free adjustment structure to track and turn according to intelligent calculation, so as to ensure that the target is always in the central area of ​​the imaging system.

Images