A multimodal recording terminal and system for fire fighting

By using a multi-source sensor fusion module and high-performance data processing, the problem of insufficient information acquisition at fire scenes has been solved, enabling multi-dimensional monitoring and recording, improving fire rescue efficiency and team member safety, and supporting fire training and tactical drills.

CN123123523APending Publication Date: 2026-11-17INST OF FOREST ECOLOGY ENVIRONMENT & PROTECTION CHINESE ACAD OF FORESTRY
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202611284254.X
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2026-08-24
Publication Date
2026-11-17

AI Technical Summary

Technical Problem

Existing fire fighting equipment cannot fully monitor the meteorological conditions, topography, and smoke characteristics at the fire scene, and lacks real-time monitoring of the physiological conditions of firefighters, which makes post-fire analysis difficult and limits the improvement of the fire brigade's combat effectiveness.

Method used

A multi-source sensor fusion module integrates meteorological sensors, high-definition video cameras, terrain sensors, and wearable sensors. Combined with a high-performance data processing unit and a large-capacity storage module, it enables real-time acquisition, fusion, and storage of multi-modal data. The data is then transmitted to a data center for analysis and simulation via a multi-mode communication module.

Benefits of technology

It enables comprehensive monitoring and recording of multi-dimensional information at the fire scene, providing scientific decision support, improving fire rescue efficiency and team member safety, and supporting fire training and tactical drills.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN123123523A_ABST
    Figure CN123123523A_ABST
Patent Text Reader

Abstract

This invention provides a multimodal recording terminal and system for fire fighting, relating to the field of fire fighting monitoring and recording technology. The multimodal recording terminal includes a multi-source sensor fusion module, a data acquisition and preprocessing module, a high-performance data processing unit, a large-capacity storage module, a multi-mode communication module, and an intelligent power management system. Through the fusion of multiple sensor sources, it achieves comprehensive and real-time monitoring and recording of multi-dimensional information such as weather, video, terrain, smoke, and firefighters' physiological indicators during fire fighting, providing rich and accurate data support for fire rescue. Simultaneously, it utilizes VR, AR, and MR technologies to simulate and reproduce the fire fighting process with high fidelity, providing firefighters with a virtual training and drill environment, which helps improve their combat capabilities and ability to cope with complex fire scenarios.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] This invention relates to the field of fire fighting monitoring and recording technology, specifically a fire fighting multimodal recording terminal and system. Background Technology

[0002] In current fire fighting operations, the relevant monitoring and recording technologies have significant deficiencies. Traditional equipment has limited functionality. For example, commonly used video surveillance equipment can only acquire two-dimensional images of the fire scene and cannot provide key information such as the weather conditions, terrain, and detailed characteristics of smoke. Existing technologies lack effective real-time monitoring methods for firefighters' physiological conditions during missions, such as heart rate, blood pressure, and physical exertion.

[0003] This limitation in information acquisition makes it difficult to conduct in-depth debriefing and analysis after fire fighting. Due to the lack of comprehensive data support, it is difficult to accurately assess the fire development trend, the effectiveness of firefighting strategies, and the potential risks faced by firefighters. At the same time, the inability to use recorded data for simulation and reproduction makes it difficult for firefighters to improve their ability to deal with complex fire scenarios through virtual drills. This is not conducive to the continuous progress of fire rescue technology and the improvement of the combat effectiveness of fire brigades. Therefore, those skilled in the art provide a multimodal recording terminal and system for fire fighting to solve the problems mentioned in the background. Summary of the Invention

[0004] Technical problems to be solved To address the shortcomings of existing technologies, this invention provides a multimodal recording terminal and system for fire fighting, which solves the problems of not being able to provide detailed information on on-site meteorological conditions, terrain, and smoke characteristics, and not being able to detect the physiological conditions of firefighters during missions.

[0005] Technical solution To achieve the above objectives, the present invention provides the following technical solution: a multimodal recording terminal for fire fighting, comprising: The multi-source sensor fusion module integrates a meteorological sensor, a high-definition wide-angle video camera, a terrain sensor, a smoke sensor, and a wearable sensor for monitoring the physiological indicators of firefighters. The meteorological sensor measures meteorological parameters such as temperature, humidity, wind speed, wind direction, and air pressure to provide environmental data for analyzing the fire spread trend. The high-definition wide-angle video camera records dynamic images of the fire scene from all directions without interruption. The terrain sensor acquires three-dimensional terrain information of the fire scene to assist firefighters in planning rescue routes. The smoke sensor detects parameters such as smoke concentration, toxic components, and particle size to assess the degree of danger at the fire scene. The wearable sensor monitors the physiological indicators of firefighters, such as heart rate, blood pressure, body temperature, and movement status, to keep track of the firefighters' physical condition in real time. The data acquisition and preprocessing module is used to acquire data output from the multi-source sensor fusion module in a high-speed and synchronous manner, and to amplify and filter the acquired data to remove noise interference and convert analog signals into digital signals for subsequent processing and storage. The high-performance data processing unit, with a built-in multi-core processor, uses a multi-modal data fusion algorithm to deeply fuse and analyze digital signals from different sensors, extracting key features and patterns of fire development stages, fire spread direction, and firefighter fatigue levels, and compressing and encoding the data. The high-capacity storage module uses high-speed, stable solid-state drives as the storage medium. It classifies and stores the data processed by the high-performance data processing unit according to timestamps and sensor types. The storage module adopts a redundant backup design to ensure the security and reliability of data during storage. The data is classified and stored according to timestamps and sensor types, which facilitates subsequent querying and retrieval. The multi-mode communication module is equipped with 5G, 4G, Wi-Fi, Bluetooth and wired Ethernet interfaces. It automatically selects the communication mode according to the on-site network environment and communication needs, and transmits the collected and processed data to the remote server or command center in real time. It also supports communication with the terminals of other fire-fighting equipment and rescue personnel to achieve information sharing and collaborative operation. The intelligent power management system uses a power management chip to intelligently manage the power supply of various components in the terminal, dynamically adjusts the power output according to the device's working status and power consumption requirements, is equipped with a high-capacity lithium battery, and supports fast charging and wireless charging technologies.

[0006] Preferably, the meteorological sensor is installed at a high position at the fire scene, the high-definition wide-angle video camera is installed in a position that can cover the main fire area and can be rotated and zoomed, the terrain sensor is installed on the fire truck or fixed bracket, the smoke sensor is installed near the fire source and the area where people are active, and the wearable sensor is integrated into the firefighter's helmet, clothing and gloves.

[0007] Preferably, in the data acquisition and preprocessing module, a high-speed analog multiplexer is used to select and switch the output signals of multiple sensors, a high-precision analog-to-digital converter is used to convert the analog signals into digital signals, and a digital signal processing chip is used to perform preliminary processing on the acquired data.

[0008] Preferably, the high-performance data processing unit is based on a multi-core processor hardware platform, uses C++ and Python programming languages ​​to develop data processing algorithms, utilizes multi-threaded programming technology to achieve parallel processing and fusion of data from different sensors, uses Kalman filtering and particle filtering methods to optimize and estimate sensor data, and uses machine learning libraries to implement data mining and pattern recognition algorithms.

[0009] Preferably, the high-capacity storage module uses RAID technology for redundant backup and regularly cleans and maintains the stored data.

[0010] Preferably, the multi-mode communication module prioritizes 5G communication in areas with good 5G network coverage, switches to 4G or Wi-Fi communication when 5G network coverage is insufficient, and uses Bluetooth technology for communication between devices at close range.

[0011] A multimodal recording system for fire fighting includes: A data transmission network is used to transmit the data collected and processed by various multimodal monitoring and recording terminals to a data center. The data transmission network includes a wireless communication network and a wired communication network. An encrypted transmission protocol is used to ensure data security. Some terminals are fixedly installed in buildings, fire trucks, and other locations to monitor the overall environment and fire development at the fire scene. Some terminals are carried by firefighters to monitor their own physiological state and local information about their location in real time. The data center adopts a distributed cloud computing architecture and has data storage, processing and analysis capabilities. It is equipped with data management software and database systems to classify, store and manage the transmitted data, and establish data backup and recovery mechanisms. The data processing and analysis platform, based on big data processing technology and artificial intelligence algorithms, cleans, integrates and labels the data stored in the data center, builds a multimodal database, uses machine learning algorithms for data mining and pattern recognition, and uses deep learning algorithms for image recognition and video analysis to provide decision support for fire commanders. The simulation and application module uses virtual reality, augmented reality and mixed reality technologies to simulate and reproduce the fire fighting process based on processed data. It supports multiple interactive methods and can be applied to fire training, tactical drills and accident investigation. The user interface and visualization system provides users with a graphical user interface that displays the collected and analyzed data in various forms such as charts, maps, or videos. It provides operation buttons and menus for data query, report generation, and simulation reproduction control, and adopts responsive design technology to adapt to different devices.

[0012] Preferably, the data transmission network is tested and optimized during the construction process to ensure that the bandwidth, latency and packet loss rate of data transmission meet the system requirements.

[0013] Preferably, the data processing and analysis platform uses the Hadoop and Spark big data processing frameworks to achieve distributed storage and processing of massive multimodal data, utilizes the Scikit-learn and LightGBM machine learning algorithm libraries for data mining and pattern recognition, and uses the TensorFlow and PyTorch deep learning frameworks for tasks such as image recognition and video analysis.

[0014] Preferably, the simulation and application module uses Unity and Unreal Engine game development engines to build realistic fire scenes and fire rescue models, and maps the collected data into the virtual scene in real time to achieve highly realistic reproduction.

[0015] Beneficial effects This invention provides a multimodal recording terminal and system for fire fighting. It has the following beneficial effects: In this invention, by fusing multiple source sensors, comprehensive and real-time monitoring and recording of multi-dimensional information such as weather, video, terrain, smoke, and physiological indicators of firefighters during fire fighting are achieved, providing rich and accurate data support for fire rescue.

[0016] This invention employs high-performance data processing units and advanced big data analysis technology to quickly and accurately fuse, analyze, and mine massive amounts of multimodal data, extracting valuable information and knowledge to provide a scientific basis for fire command and decision-making. At the same time, it utilizes VR, AR, and MR technologies to simulate and reproduce the fire-fighting process with high fidelity, providing firefighters with a virtual training and drill environment, which helps improve firefighters' combat capabilities and ability to cope with complex fire scenarios.

[0017] In this invention, by monitoring the physiological indicators of firefighters in real time, potential safety risks can be detected in a timely manner, and corresponding protective measures can be taken to ensure the safety of firefighters' lives. At the same time, by gaining a comprehensive understanding of the fire scene and making scientific decisions, fire rescue strategies can be optimized and rescue efficiency can be improved.

[0018] In this invention, the system can not only be applied to real-time monitoring and command at fire fighting sites, but also play an important role in multiple fields such as fire training, tactical drills, and accident investigation, and has broad application prospects and social value. Attached Figure Description

[0019] Figure 1 This is a functional schematic diagram of the fire fighting multimodal recording terminal in this invention; Figure 2 This is a schematic diagram of the system structure of the fire fighting multimodal recording system in this invention. Detailed Implementation

[0020] The technical solutions of the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of the present invention, and not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of the present invention.

[0021] Example 1: like Figure 1-2 As shown, this embodiment of the invention provides a multimodal recording terminal for fire fighting, comprising: The multi-source sensor fusion module integrates a meteorological sensor, a high-definition wide-angle video camera, a terrain sensor, a smoke sensor, and a wearable sensor for monitoring the physiological indicators of firefighters. The meteorological sensor measures meteorological parameters such as temperature, humidity, wind speed, wind direction, and air pressure. The high-definition wide-angle video camera records dynamic images of the fire scene from all directions without interruption. The terrain sensor acquires three-dimensional terrain information of the fire scene. The smoke sensor detects parameters such as smoke concentration, toxic components, and particle size. The wearable sensor monitors the physiological indicators of firefighters in real time, including heart rate, blood pressure, body temperature, and movement status. The data acquisition and preprocessing module is used to acquire data output from the multi-source sensor fusion module in a high-speed and synchronous manner, and to amplify, filter and preprocess the acquired data to remove noise interference and convert analog signals into digital signals. The high-performance data processing unit, with a built-in multi-core processor, uses a multi-modal data fusion algorithm to deeply fuse and analyze digital signals from different sensors, extracting key features and patterns of fire development stages, fire spread direction, and firefighter fatigue levels, and compressing and encoding the data. The high-capacity storage module uses high-speed and stable solid-state drives as the storage medium, and classifies and stores the data processed by the high-performance data processing unit according to timestamps and sensor types. The multi-mode communication module is equipped with 5G, 4G, Wi-Fi, Bluetooth and wired Ethernet interfaces. It automatically selects the communication method according to the on-site network environment and communication needs, and transmits the collected and processed data to the remote server or command center in real time. It also supports communication with other fire-fighting equipment and rescue personnel terminals. The intelligent power management system uses a power management chip to intelligently manage the power supply of various components in the terminal, dynamically adjusts the power output according to the device's working status and power consumption requirements, is equipped with a high-capacity lithium battery, and supports fast charging and wireless charging technologies.

[0022] Weather sensors are installed at high points at the fire scene; high-definition wide-angle video cameras are installed in positions that can cover the main fire area and can be rotated and zoomed; terrain sensors are installed on fire trucks or fixed brackets; smoke sensors are installed near the fire source and areas where people are active; and wearable sensors are integrated into firefighters' helmets, clothing, and gloves.

[0023] In the data acquisition and preprocessing module, a high-speed analog multiplexer is used to select and switch the output signals of multiple sensors, a high-precision analog-to-digital converter is used to convert the analog signals into digital signals, and a digital signal processing chip is used to perform preliminary processing on the acquired data.

[0024] The high-performance data processing unit is based on a multi-core processor hardware platform. It uses C++ and Python programming languages ​​to develop data processing algorithms, utilizes multi-threaded programming technology to achieve parallel processing and fusion of data from different sensors, employs Kalman filtering and particle filtering methods to optimize and estimate sensor data, and utilizes machine learning libraries to implement data mining and pattern recognition algorithms.

[0025] The high-capacity storage module uses RAID technology for redundant backup and regularly cleans and maintains the stored data.

[0026] The multi-mode communication module prioritizes 5G communication in areas with good 5G network coverage, switches to 4G or Wi-Fi communication when 5G network coverage is insufficient, and uses Bluetooth technology for communication between devices at close range.

[0027] A multimodal recording system for fire fighting includes: The data transmission network is used to transmit the data collected and processed by various multimodal monitoring and recording terminals to the data center. The data transmission network includes wireless communication networks and wired communication networks, and uses encrypted transmission protocols to ensure data security. The data center adopts a distributed cloud computing architecture and has data storage, processing and analysis capabilities. It is equipped with data management software and database systems to classify, store and manage the transmitted data, and establish data backup and recovery mechanisms. The data processing and analysis platform, based on big data processing technology and artificial intelligence algorithms, cleans, integrates and labels the data stored in the data center, builds a multimodal database, uses machine learning algorithms for data mining and pattern recognition, and uses deep learning algorithms for image recognition and video analysis to provide decision support for fire commanders. The simulation and application module uses virtual reality, augmented reality and mixed reality technologies to simulate and reproduce the fire fighting process based on processed data. It supports multiple interactive methods and can be applied to fire training, tactical drills and accident investigation. The user interface and visualization system provides users with a graphical user interface that displays the collected and analyzed data in various forms such as charts, maps, or videos. It provides operation buttons and menus for data query, report generation, and simulation reproduction control, and adopts responsive design technology to adapt to different devices.

[0028] During the construction of the data transmission network, network performance testing and optimization are carried out to ensure that the bandwidth, latency, and packet loss rate of data transmission meet the system requirements.

[0029] The data processing and analysis platform uses the Hadoop and Spark big data processing frameworks to achieve distributed storage and processing of massive multimodal data, utilizes the Scikit-learn and LightGBM machine learning algorithm libraries for data mining and pattern recognition, and uses the TensorFlow and PyTorch deep learning frameworks for tasks such as image recognition and video analysis.

[0030] The simulation and application module uses the Unity and Unreal Engine game development engines to build realistic fire scenes and fire rescue models, and maps the collected data to the virtual scene in real time to achieve a high degree of simulation and reproduction.

[0031] Example 2: An implementation of a multimodal recording terminal for fire fighting includes: Sensor selection and installation: Based on different monitoring needs and performance indicators, select appropriate sensor models. High-precision, high-reliability meteorological sensors are chosen and installed at high locations at the fire scene to avoid obstruction and ensure accurate measurement of meteorological parameters. High-definition wide-angle video cameras are used and installed in locations that cover the main fire area; they can be rotated and zoomed as needed. LiDAR is used as the terrain sensor and installed on fire trucks or fixed brackets to ensure the scanning range covers the fire scene. Multi-parameter smoke sensors are used and installed near the fire source and areas of human activity to monitor smoke conditions in real time. Wearable physiological sensor models are chosen for their comfort and lightweight design; through professional clothing design and manufacturing, the sensors are integrated into firefighters' helmets, clothing, and gloves to ensure close contact with the skin and obtain accurate physiological data. The data acquisition and preprocessing circuit design includes a dedicated data acquisition circuit that uses a high-speed analog multiplexer to select and switch the output signals from multiple sensors. A high-precision analog-to-digital converter then converts the analog signals into digital signals. Signal amplification, filtering, and anti-interference circuits are added to the data acquisition circuit to improve the quality and stability of the data acquisition. The preprocessing circuit uses a digital signal processing (DSP) chip to perform preliminary processing on the acquired data, such as noise removal, data smoothing, and feature extraction, thus reducing the burden on the subsequent high-performance data processing unit. The data processing unit is implemented using a multi-core processor hardware platform and programming languages ​​such as C++ and Python for data processing algorithms. Multi-threaded programming techniques are employed to achieve parallel processing and fusion of data from different sensors. In the data fusion algorithm, Kalman filtering and particle filtering methods are used to optimize and estimate sensor data, improving data accuracy and reliability. Simultaneously, machine learning libraries are used to implement data mining and pattern recognition algorithms, such as fire classification, fire prediction, and personnel behavior analysis. Storage module configuration and management: High-capacity, high-speed read / write solid-state drives (SSDs) are selected as storage modules, and appropriate storage capacity is configured based on the expected data acquisition volume and storage time requirements. File system management software is used to format and partition the storage modules, and data is classified and stored according to timestamps and sensor types. To improve the security and reliability of data storage, RAID technology is used for redundant backup of the storage modules to prevent data loss. At the same time, data cleanup and maintenance of the storage modules are performed regularly to delete expired or useless data and free up storage space. The communication module setup and debugging involves configuring multi-mode communication modules based on the on-site network environment and communication requirements. In areas with good 5G network coverage, 5G communication is prioritized to achieve high-speed and stable data transmission. In areas with insufficient 5G network coverage, 4G or Wi-Fi communication is switched to. For short-range device-to-device communication, Bluetooth technology is used for data transmission. During the communication module setup process, operations such as network parameter configuration, device pairing, and communication protocol settings are performed. Simultaneously, performance testing and debugging of the communication module are conducted to ensure the stability and accuracy of data transmission. The power management system is designed and optimized, employing a high-efficiency power management chip to intelligently manage the power supply to various components of the terminal. It dynamically adjusts the power output voltage and current based on the device's operating status and power consumption requirements, reducing overall energy consumption. Battery power monitoring and protection circuits are incorporated into the power management system to monitor battery power, voltage, and temperature in real time, preventing overcharging, over-discharging, and overheating. Simultaneously, fast charging and wireless charging circuits are designed to support multiple charging methods, facilitating user charging of the terminal in various scenarios. By optimizing the power management system, the terminal's battery life and operational stability are improved.

[0032] A multimodal recording system for fire fighting includes: Terminal deployment planning and implementation: At the fire scene, a detailed terminal deployment plan is developed based on the type and scale of the fire and the site environment. For fires in large buildings, fixed terminals are installed on each floor, entrance, stairwell, and other locations within the building, while portable terminals are provided to firefighters entering the building. For forest fires, terminals are installed at high points, observation points, and on fire trucks around the fire to monitor the spread of the fire in real time. During terminal deployment, it is ensured that the installation locations of the terminals are reasonable and stable, with good communication signals, and that they are not subject to interference or damage. At the same time, the terminals are numbered and configured to establish a correspondence between the terminals and the monitoring areas, facilitating subsequent data management and analysis. Data transmission network setup and optimization: At the fire scene, a temporary data transmission network is established to ensure that each terminal can transmit collected data to the data center in a timely manner; for wireless communication networks, appropriate frequency bands and communication protocols are selected, and wireless access points and relay equipment are set up to expand the wireless signal coverage; for wired communication networks, fiber optic cables or network cables are laid to establish reliable wired connections; during the data transmission network setup process, network performance testing and optimization are conducted to ensure that data transmission bandwidth, latency, and packet loss rate meet system requirements; simultaneously, encrypted transmission protocols are used to encrypt data to prevent data from being stolen or tampered with during transmission; Data center construction and management involves building high-performance server clusters and storage systems in remote data centers, possessing powerful data storage, processing, and analysis capabilities; adopting a distributed cloud computing architecture to distribute data processing tasks across multiple server nodes, improving system processing efficiency and scalability; installing data management software and database systems within the data center to classify, store, and manage the collected data; establishing data backup and recovery mechanisms to regularly back up data and prevent data loss; and equipping the data center with professional operation and maintenance personnel to monitor and maintain the system in real time, ensuring stable system operation. The development and application of a data processing and analysis platform is based on big data processing technologies and artificial intelligence algorithms. During platform development, big data processing frameworks such as Hadoop and Spark are used to achieve distributed storage and processing of massive amounts of multimodal data. Machine learning algorithm libraries are used for data mining and pattern recognition to establish fire prediction models, personnel behavior analysis models, etc. Simultaneously, deep learning frameworks are used for image recognition, video analysis, and other tasks to improve the accuracy and intelligence of data processing. In practical applications, the data processing and analysis platform is integrated with the fire command system to provide real-time decision support and situation analysis for fire commanders. The development and promotion of simulation and application modules utilizes virtual reality, augmented reality, and mixed reality technologies. During module development, game development engines such as Unity and Unreal Engine are employed to construct realistic fire scenarios and fire rescue models. Through integration with a multimodal database, collected data is mapped into the virtual scene in real time, achieving a high degree of simulation of the fire-fighting process. Simultaneously, rich interactive functions and training tasks are designed, such as fire-fighting drills and emergency response training, to improve firefighters' practical skills and ability to handle complex fire scenarios. In terms of application and promotion, the simulation and application modules are applied to fire training schools, fire stations, and other units, providing firefighters with convenient and efficient training tools. User interface and visualization system design and optimization: Based on user needs and operating habits, an intuitive and user-friendly user interface and visualization system are designed. In the user interface design process, a simple and clear layout and color scheme are adopted to improve readability and usability. Various visualization methods such as charts, maps, and videos are used to present collected and analyzed data to users in an intuitive form. At the same time, operation buttons and menus are provided to facilitate user operations such as data querying, report generation, and simulation playback control. Responsive design technology is adopted during user interface development to ensure that the user interface can be displayed and operated normally on different devices. Through continuous optimization of the user interface and visualization system, user experience and work efficiency are improved.

[0033] Although embodiments of the invention have been shown and described, it will be understood by those skilled in the art that various changes, modifications, substitutions and alterations can be made to these embodiments without departing from the principles and spirit of the invention, the scope of which is defined by the appended claims and their equivalents.

Claims

1. A multimodal recording terminal for fire fighting, characterized in that: include: The multi-source sensor fusion module integrates a meteorological sensor, a high-definition wide-angle video camera, a terrain sensor, a smoke sensor, and a wearable sensor for monitoring the physiological indicators of firefighters. The meteorological sensor measures meteorological parameters such as temperature, humidity, wind speed, wind direction, and air pressure. The high-definition wide-angle video camera records dynamic images of the fire scene from all directions without interruption. The terrain sensor acquires three-dimensional terrain information of the fire scene. The smoke sensor detects parameters such as smoke concentration, toxic components, and particle size. The wearable sensor monitors the physiological indicators of firefighters, such as heart rate, blood pressure, body temperature, and movement status, in real time. The data acquisition and preprocessing module is used to acquire data output from the multi-source sensor fusion module in a high-speed and synchronous manner, and to amplify, filter and preprocess the acquired data to remove noise interference and convert analog signals into digital signals. The high-performance data processing unit, with a built-in multi-core processor, uses a multi-modal data fusion algorithm to deeply fuse and analyze digital signals from different sensors, extracting key features and patterns of fire development stages, fire spread direction, and firefighter fatigue levels, and compressing and encoding the data. The high-capacity storage module uses high-speed and stable solid-state drives as the storage medium, and classifies and stores the data processed by the high-performance data processing unit according to timestamps and sensor types. The multi-mode communication module is equipped with 5G, 4G, Wi-Fi, Bluetooth and wired Ethernet interfaces. It automatically selects the communication method according to the on-site network environment and communication needs, and transmits the collected and processed data to the remote server or command center in real time. It also supports communication with other fire-fighting equipment and rescue personnel terminals. The intelligent power management system uses a power management chip to intelligently manage the power supply of various components in the terminal, dynamically adjusts the power output according to the device's working status and power consumption requirements, is equipped with a high-capacity lithium battery, and supports fast charging and wireless charging technologies.

2. The fire fighting multimodal recording terminal according to claim 1, characterized in that: The meteorological sensor is installed at a high position at the fire scene, the high-definition wide-angle video camera is installed in a position that can cover the main fire area and can be rotated and zoomed, the terrain sensor is installed on the fire truck or fixed bracket, the smoke sensor is installed near the fire source and the area where people are active, and the wearable sensor is integrated into the firefighters' helmets, clothing and gloves.

3. The fire fighting multimodal recording terminal according to claim 1, characterized in that: In the data acquisition and preprocessing module, a high-speed analog multiplexer is used to select and switch the output signals of multiple sensors, a high-precision analog-to-digital converter is used to convert the analog signals into digital signals, and a digital signal processing chip is used to perform preliminary processing on the acquired data.

4. A multi-modal recording terminal for fire fighting according to claim 1, characterized in that: The high-performance data processing unit is based on a multi-core processor hardware platform. It uses C++ and Python programming languages ​​to develop data processing algorithms, utilizes multi-threaded programming technology to achieve parallel processing and fusion of data from different sensors, employs Kalman filtering and particle filtering methods to optimize and estimate sensor data, and utilizes machine learning libraries to implement data mining and pattern recognition algorithms.

5. A fire-fighting multimodal recording terminal according to claim 1, characterized in that: The high-capacity storage module uses RAID technology for redundant backup and regularly cleans and maintains the stored data.

6. A multi-modal recording terminal for fire fighting according to claim 1, characterized in that: The multi-mode communication module prioritizes 5G communication in areas with good 5G network coverage, and switches to 4G or Wi-Fi communication when 5G network coverage is insufficient. Bluetooth technology is used for communication between devices at close range.

7. A multimodal recording system for fire fighting, characterized in that: include: A data transmission network is used to transmit the data collected and processed by various multimodal monitoring and recording terminals to the data center. The data transmission network includes a wireless communication network and a wired communication network, and uses an encrypted transmission protocol to ensure data security. The data center adopts a distributed cloud computing architecture and has data storage, processing and analysis capabilities. It is equipped with data management software and database systems to classify, store and manage the transmitted data, and establish data backup and recovery mechanisms. The data processing and analysis platform, based on big data processing technology and artificial intelligence algorithms, cleans, integrates and labels the data stored in the data center, builds a multimodal database, uses machine learning algorithms for data mining and pattern recognition, and uses deep learning algorithms for image recognition and video analysis to provide decision support for fire commanders. The simulation and application module uses virtual reality, augmented reality and mixed reality technologies to simulate and reproduce the fire fighting process based on processed data. It supports multiple interactive methods and can be applied to fire training, tactical drills and accident investigation. The user interface and visualization system provides users with a graphical user interface that displays the collected and analyzed data in various forms such as charts, maps, or videos. It provides operation buttons and menus for data query, report generation, and simulation reproduction control, and adopts responsive design technology to adapt to different devices.

8. A multi-modal recording system for fire fighting according to claim 7, characterized in that: The data transmission network undergoes network performance testing and optimization during its construction to ensure that the bandwidth, latency, and packet loss rate of data transmission meet system requirements.

9. A multi-modal recording system for fire fighting according to claim 7, characterized in that: The data processing and analysis platform uses the Hadoop and Spark big data processing frameworks to achieve distributed storage and processing of massive multimodal data, utilizes the Scikit-learn and LightGBM machine learning algorithm libraries for data mining and pattern recognition, and uses the TensorFlow and PyTorch deep learning frameworks for tasks such as image recognition and video analysis.

10. A multi-modal recording system for fire fighting according to claim 7, characterized in that: The simulation and application module uses the Unity and Unreal Engine game development engines to build realistic fire scenes and fire rescue models, and maps the collected data to the virtual scene in real time to achieve a high degree of simulation and reproduction.