Air-ground integrated device and method

Abstract

The invention discloses an air-ground integrated device and method, and relates to the field of rescue unmanned aerial vehicles, the air-ground integrated device comprises a high-speed spraying vehicle, a command center large screen and an unmanned aerial vehicle, a remote control screen is arranged outside the high-speed spraying vehicle, a split-screen storage all-in-one machine is arranged inside the high-speed spraying vehicle, and a controllable spray head and a controllable support matched with the remote control screen are arranged at the top of the high-speed spraying vehicle; a vehicle-mounted module is arranged in the high-speed spraying vehicle, a three-proofing command panel is fixed outside the high-speed spraying vehicle, and the three-proofing command panel is in wireless data connection with the command center large screen and the unmanned aerial vehicle.

Description

TECHNICAL FIELD

[0001] The present application relates to the field of high-lifting fire truck and unmanned aerial vehicle cooperative rescue, in particular to an air-ground integrated device and method. BACKGROUND

[0002] The high-lifting fire truck is also called high-lifting fire truck, which has become a key rescue equipment in the field of high-rise building and large-span space fire rescue.

[0003] The existing vehicle-mounted video monitoring system has significant technical bottlenecks: the conventional vehicle-mounted camera is limited to a low-resolution imaging element below 4 million pixels, and cannot obtain clear visible light images in smoke or night environment; the fixed installation position limits the viewing angle, the horizontal adjustment angle is < 30°, and the effective observation time is less than 30% due to water mist blocking after water discharge; the wired remote control mode limits the operation personnel's moving range, usually < 5 meters, which seriously affects the operation flexibility. More seriously, the existing system lacks multi-source information fusion capability, the single video transmission bandwidth is less than 4 Mbps, which cannot realize real-time cooperation with the unmanned aerial vehicle reconnaissance system, the time delay is > 500 ms, which causes the fire point positioning error to often exceed 1.5 meters. And it cannot realize the synchronous monitoring of multiple unmanned aerial vehicle viewing angles; it lacks intelligent auxiliary functions, such as automatic marking of thermal imaging temperature extreme value, water cannon trajectory prediction and other algorithm modules.

[0004] Although the industry tries to introduce unmanned aerial vehicle assisted reconnaissance, it is limited by the incompatibility of unmanned aerial vehicle image transmission system and vehicle-mounted terminal protocol, and the common RTSP and RTMP protocols conflict. These technical defects seriously restrict the combat effectiveness of the high-lifting fire truck, and the fire scene situation awareness lags behind. SUMMARY

[0005] Therefore, the purpose of the present application is to provide an air-ground integrated device and method to solve the technical problems that the current high-lifting fire truck self-equipped device interface cannot be compatible with multiple auxiliary functions and the unmanned aerial vehicle cooperation capability is poor.

[0006] To achieve the above-mentioned purpose, the present application provides the following technical scheme: an air-ground integrated device, comprising a high-lifting fire truck, a command center large screen and an unmanned aerial vehicle, the high-lifting fire truck is externally provided with a remote control screen, the high-lifting fire truck is internally provided with a split-screen storage all-in-one machine, the top of the high-lifting fire truck is provided with a controllable spray head and a controllable support matched with the remote control screen, the high-lifting fire truck is internally provided with a vehicle-mounted module, and the high-lifting fire truck is externally fixed with a three-proof command flat panel, the three-proof command flat panel is wirelessly connected with the command center large screen and the unmanned aerial vehicle.

[0007] By adopting the above technical solutions, the high-pressure water cannon truck is used for firefighting operations, the command center's large screen is used for remote monitoring and command, drones provide more video perspectives, the remote control screen displays the received video data, the split-screen storage unit stores the video data and provides multiple data cable interfaces, the vehicle-mounted module realizes data conversion and data transmission, the tri-proof command tablet receives and displays multiple video perspectives, and the tri-proof command tablet is connected to other wireless data connected devices via wireless data connection.

[0008] The present invention is further configured such that the vehicle-mounted module includes a soldier image transmission device and a hard disk recorder, and the soldier image transmission device is wirelessly connected to the NBC command tablet and the command center screen.

[0009] By adopting the above technical solution, the individual soldier image transmission device will transmit the received video data to other cloud devices with wireless data connection, and store and convert the output format of the accessed video through a hard disk recorder.

[0010] The present invention is further configured such that a rear display screen is provided on the outside of the high-pressure jet vehicle.

[0011] By adopting the above technical solution, the tail display shows the accessed video data.

[0012] The present invention is further configured such that a dual-light high-pressure jet camera is provided on the exterior of the high-pressure jet vehicle near the controllable nozzle. The dual-light high-pressure jet camera includes a camera wiper, a visible light camera, a thermal imaging camera, and a ranging module. The dual-light high-pressure jet camera is electrically connected to the rear display screen, and the rear display screen is electrically connected to the individual soldier image transmission device.

[0013] By adopting the above technical solution, the high-pressure jet dual-light camera replaces the original vehicle-mounted camera. It achieves dual-light imaging through a visible light camera and a thermal imaging camera, provides ranging functionality through a ranging module, keeps the visible light camera and thermal imaging camera clear through the camera wiper, maintains fast transmission of video data through an electrical connection between the high-pressure jet dual-light camera and the rear display screen, and ensures that the video data can be further transmitted to the individual soldier image transmission device through an electrical connection between the rear display screen and the individual soldier image transmission device.

[0014] The present invention is further configured such that an original vehicle-mounted camera is installed on the exterior of the high-pressure water jet vehicle near the controllable nozzle, the original vehicle-mounted camera is electrically connected to the split-screen storage unit, the split-screen storage unit is electrically connected to the remote control screen and the hard disk recorder, and the hard disk recorder is electrically connected to the individual soldier image transmission device.

[0015] By adopting the above technical solution, the original vehicle-mounted camera acquires video data, which is then transmitted to the split-screen storage unit via electrical connection. The data is further transmitted to the remote control screen and hard disk recorder, and after being converted by the hard disk recorder, it is transmitted to the individual soldier image transmission device.

[0016] To achieve the above objectives, the present invention provides the following technical solution: an integrated air-ground method, mounted within an integrated air-ground device, comprising the following steps:

[0017] The vehicle-mounted module receives video data from all cameras installed on the high-pressure jet truck via a wire.

[0018] The vehicle-mounted module transmits the video data to the NBC (Nuclear, Biological, Chemical) defense command tablet and the command center's large screen via a soldier's image transmission device.

[0019] The drone collects video datasets using its onboard cameras;

[0020] The drone transmits its video dataset to the cloud via its onboard image transmission module.

[0021] The ruggedized command tablet and command center large screen acquire drone video datasets from the cloud.

[0022] The rugged command tablet uses its built-in software to obtain multiple drone video datasets and output the video data layout to the screen on the command tablet itself.

[0023] The present invention is further configured to include the following steps:

[0024] The tri-proof command tablet establishes a data connection with the drone pilot's mobile communication terminal.

[0025] The tri-proof command tablet receives touch input commands and sends them to the corresponding pilot's mobile communication terminal.

[0026] The present invention is further configured to include the following steps:

[0027] The touch commands sent from the rugged command tablet to the corresponding pilot's mobile communication terminal are converted into text information and simultaneously sent to the command center's large screen.

[0028] The command center's large screen receives external touch operations and reviews the touch commands. If the review is successful or the review expires, no response is given. If the review fails, the command center's large screen generates an interception command and sends it to the rugged command tablet and the drone pilot's mobile communication terminal, notifying the drone pilot's mobile communication terminal to terminate the touch command.

[0029] In summary, this invention establishes a connection between the NBC (Nuclear, Biological, Chemical) protection command tablet and the individual soldier's image transmission device, enabling the command tablet to quickly receive relevant data from the high-pressure water cannon vehicle. Furthermore, the NBC protection command tablet's expandability—referring to software-based algorithm software for assisting firefighting operations and hardware interfaces for connecting to other devices—addresses the inconvenience of collaborating with drones in traditional high-pressure water cannon vehicle operations. Attached Figure Description

[0030] Figure 1 This is a schematic diagram of the components of the present invention.

[0031] In the image: 1. High-pressure water cannon vehicle; 2. Vehicle-mounted module; 201. Individual soldier image transmission equipment; 202. Hard disk video recorder; 3. NBC (Nuclear, Biological, and Chemical) protection command tablet; 4. High-pressure water cannon dual-light camera; 401. Camera wiper; 402. Visible light camera; 403. Thermal imaging camera; 404. Ranging module; 5. Rear display screen; 6. Command center large screen; 7. Remote control screen; 8. Drone; 9. Original vehicle-mounted camera; 10. Split-screen storage all-in-one machine. Detailed Implementation

[0032] The technical solutions of the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings. The embodiments described below with reference to the accompanying drawings are exemplary and are only used to explain the present invention, and should not be construed as limiting the present invention.

[0033] The embodiments of the present invention will now be described.

[0034] An integrated air-ground device, such as Figure 1 As shown, the system includes a high-pressure water jet vehicle 1, a command center large screen 6, and a drone 8. The high-pressure water jet vehicle 1 is equipped with a remote control screen 7 on its exterior and a split-screen storage unit 10 inside. The top of the high-pressure water jet vehicle 1 is equipped with a controllable nozzle and a controllable bracket that work in conjunction with the remote control screen 7. The high-pressure water jet vehicle 1 is equipped with a vehicle-mounted module 2 inside and a tri-proof command tablet 3 fixed on its exterior. The tri-proof command tablet 3 is wirelessly connected to the command center large screen 6 and the drone 8.

[0035] Depending on the actual usage requirements, this device can be installed by installing only a portion of the structure to achieve the corresponding function, or by installing all optional structures to achieve all usage functions.

[0036] Command Center Large Screen 6 refers to the command screen of the fire command center or temporary command post where the equipment is installed. The corresponding command screen can be selected according to the location of the equipment or the requirements of the operation.

[0037] Drone 8 refers to the controllable drones 8 in the formation of the operation or the high-pressure water jet vehicle 1. The number and model of drones 8 are adjusted according to the scale of the operation or the formation and selected according to the needs.

[0038] The rugged command tablet 3 is an essential component of this device. It is a commercially available tablet computer with a protection rating exceeding IP65 and capable of running a Windows operating system. This computer establishes a wireless data connection with the drone 8 and the command center's large screen 6 via any compatible wireless data network (including but not limited to Wi-Fi, 4G, and 5G). The rugged command tablet 3 is equipped with software that can simultaneously display multiple video inputs.

[0039] The vehicle-mounted module 2 is installed in the electrical component installation space of the high-pressure water jet vehicle during the installation of this device. The hard disk video recorder 202 is connected to the split-screen storage unit 10 in the high-pressure water jet vehicle 1 by wiring, and the hard disk video recorder 202 is connected to the individual soldier image transmission device 201 by wiring.

[0040] After the NBC (Nuclear, Biological, and Chemical) Control Command Tablet 3 establishes a connection with the individual soldier image transmission device 201, it can quickly receive relevant data from the high-pressure water cannon vehicle 1. Furthermore, the NBC Control Command Tablet 3's expandability—referring to its ability to support firefighting operations through algorithm software and its hardware interface for connecting to other devices—is utilized. It also acts as an intermediary to address the inconvenience of coordinated operation between the high-pressure water cannon vehicle 1 and the drone 8 during operation.

[0041] When in use, the pilot controls the drone 8 through the control equipment to reach the required location and provide aerial vision, and transmits video data to the tri-proof command tablet 3 and the command center large screen 6 to assist on-site firefighters in judging the fire situation and operations.

[0042] The original vehicle-mounted camera 9 transmits video data to the split-screen storage unit 10, and then to the remote control screen 7, the rear display screen 5, and the hard disk recorder 202. After the video format is converted by the hard disk recorder 202, it is transmitted to the individual soldier image transmission device 201, and then the individual soldier image transmission device 201 transmits the video to the tri-proof command tablet 3 and the command center large screen 6.

[0043] Optionally, a high-intensity dual-light camera 4 can be installed to replace the original vehicle camera 9. During installation, the original wiring can be used to transmit the video data stream to the split-screen storage all-in-one machine 10 for further transmission.

[0044] Optionally, after replacing the original vehicle camera 9 with the high-performance dual-light camera 4, the rear display screen 5 can be modified. The rear display screen 5 can be replaced with any commercially available touchscreen display that has control functions and can integrate video data formats. All control and data transmission lines of the camera wiper 401, visible light camera 402, thermal imaging camera 403, and ranging module 404 are connected to the new rear display screen 5, allowing direct control through the modified rear display screen 5. The wiring integration process includes common adapter modules required for relevant wiring conversion and integration.

[0045] Based on the above structure, in this embodiment, the vehicle-mounted module 2 includes a soldier image transmission device 201 and a hard disk recorder 202. The received video data is transmitted to other cloud devices with wireless data connection through the soldier image transmission device 201. The hard disk recorder 202 stores and converts the output format of the accessed video. The soldier image transmission device 201 is wirelessly connected to the NBC command tablet 3 and the command center large screen 6.

[0046] Based on the above structure, in this embodiment, a rear display screen 5 is provided on the outside of the high-pressure jet vehicle 1 to display the accessed video data.

[0047] Based on the above structure, in this embodiment, a dual-light high-pressure jet vehicle 1 is installed on the outside near the controllable nozzles. The original vehicle-mounted camera 9 is replaced by the dual-light high-pressure jet vehicle 1. The dual-light high-pressure jet vehicle 1 includes a camera wiper 401, a visible light camera 402, a thermal imaging camera 403, and a ranging module 404. The visible light camera 402 and the thermal imaging camera 403 achieve dual-light imaging, the ranging module 404 provides ranging function, the camera wiper 401 keeps the visible light camera 402 and the thermal imaging camera 403 clear, the dual-light high-pressure jet vehicle 1 is electrically connected to the rear display screen 5, and the high-pressure jet vehicle 1 is electrically connected to the rear display screen 5 to ensure fast transmission of video data, and the rear display screen 5 is electrically connected to the individual soldier image transmission device 201, and the video data can be further transmitted to the individual soldier image transmission device 201.

[0048] Based on the above structure, in this embodiment, an original vehicle-mounted camera 9 is installed on the outside of the high-pressure water jet vehicle 1 near the controllable nozzle. Video data is acquired through the original vehicle-mounted camera 9. The original vehicle-mounted camera 9 is electrically connected to the split-screen storage unit 10. The split-screen storage unit 10 is electrically connected to the remote control screen 7 and the hard disk recorder 202. The hard disk recorder 202 is electrically connected to the individual soldier image transmission device 201. Through the electrical connection, the video data is transmitted to the split-screen storage unit 10, and further transmitted to the remote control screen 7 and the hard disk recorder 202. After the format is converted by the hard disk recorder 202, it is transmitted to the individual soldier image transmission device 201.

[0049] To achieve the above control process, this solution also provides an integrated air-to-ground method, which is mounted within an integrated air-to-ground device and includes the following steps:

[0050] S110, the vehicle-mounted module 2 receives video data from all cameras installed on the high-pressure jet vehicle 1 via a line;

[0051] S120, the vehicle-mounted module 2 transmits the video data to the NBC command tablet 3 and the command center large screen 6 via the individual soldier image transmission device 201;

[0052] The S130 and UAV 8 collect UAV video datasets using their onboard cameras.

[0053] The S140 and UAV 8 transmit UAV video datasets to the cloud via their onboard image transmission modules.

[0054] The S150, the rugged command tablet 3, and the command center large screen 6 acquire drone video datasets from the cloud.

[0055] The S160 and the rugged command tablet 3, through their built-in software, will obtain multiple drone video datasets and output multiple video data arrangements to the screen on the command tablet 3 itself.

[0056] Based on the above structure, this embodiment includes the following steps:

[0057] S210, NBC command tablet 3 and UAV 8 establish data connection with the corresponding pilot's mobile communication terminal;

[0058] The S220 and the tri-proof command tablet 3 receive touch command inputs and send the touch command inputs to the corresponding pilot's mobile communication terminal.

[0059] Communication functionality can be further enhanced based on requirements. This functionality can be integrated into a single software application or implemented through other communication software, including but not limited to voice communication software and text communication software. After generating touch commands through touch input, these touch commands are sent to the corresponding drone pilot's mobile communication terminal via the software to complete communication. Touch commands include, but are not limited to, voice commands, text commands, or image commands. The drone pilot's mobile communication terminal includes, but is not limited to, any device that meets the above communication functions, such as mobile phones or tablets.

[0060] Based on the above structure, this embodiment is characterized by including the following steps:

[0061] The S221 and the tri-proof command tablet 3 send touch commands to the corresponding pilot's mobile communication terminal, which are then converted into text information and simultaneously sent to the command center's large screen 6.

[0062] S222, the command center large screen 6 receives external touch operations and reviews the touch commands; if the review is passed or the review is not completed within the time limit, no response is made; if the review is not passed, the command center large screen 6 generates an interception command and sends it to the tri-proof command tablet 3 and the pilot's mobile communication terminal, notifying the pilot's mobile communication terminal to terminate the touch command.

[0063] Based on the needs of different management levels and to enable the system to be used in drills or other applications, a corresponding management system is configured for this system. By assigning relevant management personnel to the large screen 6 in the command center, instructions are reviewed and approved. This system can be used for training simulations and other fields. Text information includes, but is not limited to, the statement of the instruction content. External touch operations are manually input by the operator of the large screen 6 in the command center. Termination touch commands include, but are not limited to, voice stop commands, text-based data intervention, or any other method that can achieve the transmission of stop commands.

[0064] Although embodiments of the present invention have been shown and described, these specific embodiments are merely explanations of the invention and are not intended to limit it. The specific features, structures, materials, or characteristics described may be combined in any suitable manner in one or more embodiments or examples. After reading this specification, those skilled in the art may make modifications, substitutions, and variations to the embodiments as needed without departing from the principles and spirit of the invention, but such modifications, substitutions, and variations are protected by patent law as long as they are within the scope of the claims of the present invention.

Claims

1. An integrated air-ground device, comprising a high-pressure water jetting vehicle (1), a command center large screen (6), and a drone (8), wherein the high-pressure water jetting vehicle (1) is externally equipped with a remote control screen (7), the high-pressure water jetting vehicle (1) is internally equipped with a split-screen storage unit (10), and the top of the high-pressure water jetting vehicle (1) is equipped with a controllable nozzle and a controllable bracket that cooperate with the remote control screen (7), characterized in that: The high-pressure jet vehicle (1) is equipped with an on-board module (2) inside, and a tri-proof command tablet (3) is fixed on the outside of the high-pressure jet vehicle (1). The tri-proof command tablet (3) is wirelessly connected to the command center screen (6) and the drone (8).

2. The air-ground integrated device according to claim 1, characterized in that: The vehicle-mounted module (2) includes a soldier image transmission device (201) and a hard disk recorder (202). The soldier image transmission device (201) is wirelessly connected to the NBC command tablet (3) and the command center screen (6).

3. The air-ground integrated device according to claim 2, characterized in that: The high-pressure jet vehicle (1) is equipped with a rear display screen (5) on its outer side.

4. The air-ground integrated device according to claim 3, characterized in that: The high-pressure jet vehicle (1) is equipped with a high-pressure jet dual-light camera (4) near the controllable nozzle. The high-pressure jet dual-light camera (4) includes a camera wiper (401), a visible light camera (402), a thermal imaging camera (403), and a ranging module (404). The high-pressure jet dual-light camera (4) is electrically connected to the rear display screen (5), and the rear display screen (5) is electrically connected to the individual soldier image transmission device (201).

5. The air-ground integrated device according to claim 3, characterized in that: The high-pressure water jet vehicle (1) is equipped with an original vehicle-mounted camera (9) near the controllable nozzle. The original vehicle-mounted camera (9) is electrically connected to the split-screen storage unit (10). The split-screen storage unit (10) is electrically connected to the remote control screen (7) and the hard disk recorder (202). The hard disk recorder (202) is electrically connected to the individual soldier image transmission device (201).

6. An integrated air-to-ground method, mounted within an integrated air-to-ground device, characterized in that, Includes the following steps: The vehicle-mounted module 2 receives video data from all the cameras installed on the high-pressure jet vehicle 1 via a line; The vehicle-mounted module 2 transmits the video data to the NBC (Nuclear, Biological, Chemical) defense command tablet 3 and the command center large screen 6 via the individual soldier image transmission device 201; The drone 8 collects video datasets using its onboard camera; The drone 8 sends its video dataset to the cloud via its onboard image transmission module; The rugged command tablet 3 and the command center large screen 6 acquire drone video datasets from the cloud. The rugged command tablet 3 uses its built-in software to obtain multiple drone video datasets and output multiple video data arrangements to the screen on the command tablet 3 itself.

7. The air-ground integrated method according to claim 6, characterized in that, Includes the following steps: The NBC (Nuclear, Biological, and Chemical) Control Tablet 3 and the corresponding drone 8 pilot's mobile communication terminal establish a data connection. The tri-proof command tablet 3 receives touch input commands and sends them to the corresponding pilot's mobile communication terminal.

8. The air-ground integrated method according to claim 7, characterized in that, Includes the following steps: The tri-proof command tablet 3 sends touch commands to the corresponding pilot's mobile communication terminal, which are then converted into text information and simultaneously sent to the command center's large screen 6. The command center's large screen 6 receives external touch operations and reviews the touch commands. If the review is successful or the review expires, no response is given. If the review fails, the command center's large screen 6 generates an interception command and sends it to the rugged command tablet 3 and the pilot's mobile communication terminal, notifying the pilot's mobile communication terminal to terminate the touch command.

Images