A fire warning method and system based on smoke image joint feature analysis
By combining smoke sensors, infrared sensors and cameras to collect data, and using convolutional neural networks and multi-layer perceptron models to perform fire risk assessment, the problems of false alarms, missed alarms and lags in fire warnings in existing technologies are solved, achieving higher warning accuracy and adaptability.
Patent Information
- Application Number
- CN202411675865.8
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2024-11-22
- Publication Date
- 2025-09-26
- Estimated Expiration
- 2044-11-22
AI Technical Summary
Existing fire warning technology relies on single sensor data, which is prone to false alarms, missed alarms and lags. It lacks adaptability to complex environments and data fusion capabilities, resulting in insufficient warning accuracy and timeliness.
A joint feature analysis method for smoke images is adopted. Data is collected through smoke sensor arrays, infrared sensor arrays and cameras. 3D and 2D convolutional neural networks are used to extract spatiotemporal, texture and temperature features. Feature fusion is performed through the attention mechanism, and fire risk assessment is performed in combination with a multi-layer perceptron classification model.
It improves the accuracy and real-time performance of fire warnings, reduces false alarms and missed alarms, enhances the system's adaptability to complex environments, and provides strong protection for personal and property safety.
Smart Images

Figure CN119181197B_ABST
Abstract
Description
Technical Field
[0001] The present invention belongs to the technical field of fire warning, and in particular relates to a fire warning method and system based on smoke image joint feature analysis. Background Art
[0002] Existing fire warning technologies mainly rely on single or limited sensor data for judgment. The most common methods include using smoke detectors, temperature sensors or flame detectors; however, these warning methods based on single data sources have obvious defects.
[0003] Although smoke detectors are widely used, normal cooking activities or production processes in kitchens or industrial environments may produce harmless smoke, leading to frequent false alarms. In the early stages of a fire, if the smoke is not high enough to trigger the alarm threshold, it may result in missed alarms, delaying the optimal rescue opportunity. Temperature sensors rely solely on temperature changes to determine the fire situation, which has a lag. In large open spaces or high-ceilinged buildings, it may take a long time for the heat to reach the sensor location when a fire occurs, resulting in delayed warning. In addition, some types of fires (such as electrical fires) may not produce significant temperature changes in the early stages, making it difficult for systems that rely solely on temperature sensors to detect potential dangers in a timely manner. Although flame detectors can quickly detect open flames, their effectiveness is greatly reduced in the presence of obstructions. In complex indoor environments, such as offices with partitions or libraries with multiple layers of bookshelves, the flame detector's line of sight may be blocked, resulting in the fire not being detected in time. Although carbon monoxide detectors are effective in detecting smokeless fires, they cannot respond to all types of fires. For example, in the case of electrical fires or the combustion of certain chemicals, not enough carbon monoxide may be produced to trigger an alarm.
[0004] In addition, existing technologies lack data fusion capabilities, and most systems are unable to effectively integrate multi-source data, resulting in one-sided or inaccurate judgments on fire conditions; traditional systems are mostly based on simple threshold judgments and lack the ability to comprehensively analyze complex environmental factors. Fixed alarm thresholds are difficult to adapt to changes in different scenarios and environmental conditions, and can easily cause oversensitivity or slow response; existing systems mainly focus on detecting fires that have already occurred and lack the ability to predict potential fire hazards. Due to the inability to comprehensively analyze environmental factors, false alarms occur frequently, reducing users' trust in the system.
[0005] In view of the above problems, a new fire warning method is needed that can comprehensively analyze multi-source data, has intelligent feature extraction and fusion capabilities, and can adapt to complex environments. Summary of the Invention
[0006] The present invention provides a fire warning method and system based on joint feature analysis of smoke images, aiming to overcome the limitations of existing technologies, improve the accuracy, timeliness and comprehensiveness of warnings, and better cope with fire risks in various complex scenarios.
[0007] In a first aspect, the present invention provides a fire warning method based on joint feature analysis of smoke images, which is applied to fire warning in indoor scenarios. The method comprises the following steps:
[0008] Step S1, setting the data collection frequency of each sensor array and camera to be the same, collecting smoke concentration distribution data and infrared thermal image of the indoor environment based on the smoke sensor array and infrared sensor array, and collecting visible light image of the indoor environment based on the camera.
[0009] In step S2, a 3D convolutional neural network is used to extract the spatiotemporal features of the smoke concentration distribution, and a 2D convolutional neural network is used to extract the texture and shape features of the visible light image and the temperature distribution features of the infrared thermal image; the three features are weightedly fused to generate a joint feature representation.
[0010] In step S3, the fused joint features are represented as a feature sequence based on time order, and the fire risk level of the current time window is obtained based on the trained multi-layer perceptron classification model.
[0011] Furthermore, in step S2, a 3D convolutional neural network is used to extract the spatiotemporal features of the smoke concentration distribution. The structure of the 3D convolutional neural network includes: 3 3D convolutional layers, each followed by a BatchNormalization function and a ReLU activation function, 2 3D maximum pooling layers and 1 fully connected layer; the input is T frames of smoke concentration distribution data, and the output is a 256-dimensional feature vector.
[0012] The mathematical expression of the 3D convolution operation is:
[0013] ;
[0014] in, Indicates that the output feature map is at position Place The value of the output channel; Indicates that the input data is at position Place The value of the input channel; represents the weight of the 3D convolution kernel, represents the spatial position of the convolution kernel, Indicates the The bias term of the output channel, Represent the height, width and depth of the convolution kernel space dimension respectively, Indicates the total number of channels of input data.
[0015] Furthermore, in step S2, the input of the 3D convolutional neural network is continuous p frames of smoke concentration distribution data, where the value of p ranges from 10 to 30, and the input of the 2D convolutional neural network is a single frame of visible light image or infrared thermal image.
[0016] Furthermore, in step S2, the 2D convolutional neural network adopts the ResNet-50 structure, including: 1 7x7 convolutional layer, 16 residual blocks, each residual block contains 3 convolutional layers, 1 global average pooling layer and 1 fully connected layer; the input is a visible light image or an infrared thermal map, and the output is a 512-dimensional feature vector.
[0017] The mathematical expression of the residual block is: ,in Represents the residual map, which consists of 3 convolutional layers. represents the output of the residual block, represents the input of the residual block, Represents the set of weight parameters in the residual map.
[0018] Furthermore, in step S2, the feature fusion adopts the attention mechanism, and the feature fusion method includes: performing linear transformation on the three features, calculating the attention weights, and performing weighted summation to obtain the fusion feature.
[0019] The mathematical expression of the linear transformation is:
[0020] ;
[0021] The mathematical expression of the attention weight is:
[0022] ;
[0023] The fusion feature obtained by weighted summation is expressed as:
[0024] ;
[0025] in, Indicates the characteristics, They correspond to smoke concentration, visible light image and infrared thermal image features respectively; Indicates the query to be generated ,key Sum The weight matrix of Indicates the The query, key, and value of each feature; Indicates that from the feature To Features The attention weight of represents the transpose of the key vector, which is used to perform dot product operations with the query vector. Represents feature dimension; Represents the final fused features.
[0026] Furthermore, in step S3, the multilayer perceptron classification model includes: an input layer, two hidden layers and an output layer; the input layer contains 1024 neurons, the first hidden layer contains 512 neurons, the second hidden layer contains 256 neurons, both hidden layers use ReLU activation function, the output layer contains 4 neurons, corresponding to 4 risk levels, and uses Softmax activation; the fire risk level is divided into four levels: no risk, low risk, medium risk and high risk.
[0027] ;
[0028] Input feature vector; Output of the hidden layer; The final output is the probability distribution of risk levels; The weight matrix of each layer; Bias vectors for each layer.
[0029] Furthermore, in step S1, the data acquisition frequency of the smoke sensor array, infrared sensor array and camera is set to 1 Hz; the resolution of the smoke concentration distribution data collected by the smoke sensor array is 8x8 pixels, the resolution of the infrared thermal image collected by the infrared sensor array is 32x24 pixels, and the resolution of the visible light image collected by the camera is 640x480 pixels.
[0030] Furthermore, in step S3, the length of the characteristic sequence based on time order is L, and the value range of L is 5 to 15.
[0031] In a second aspect, the present invention provides a fire warning system based on joint feature analysis of smoke images, which is used to execute the fire warning method described in the first aspect. The system includes: a data acquisition module, a feature extraction module, a feature fusion module and a risk assessment module connected in sequence.
[0032] The data acquisition module is used to collect smoke concentration distribution data, infrared thermal images and visible light images of the indoor environment. The data acquisition module includes a smoke sensor array, an infrared sensor array and a visible light camera.
[0033] The feature extraction module is used to extract spatiotemporal features, texture and shape features, and temperature distribution features from the collected data. The feature extraction module includes a 3D convolutional neural network and a 2D convolutional neural network.
[0034] The feature fusion module is used to perform weighted fusion on the extracted features to generate a joint feature representation. The feature fusion module adopts a feature fusion algorithm based on the attention mechanism.
[0035] The risk assessment module is used to obtain the fire risk level of the current time window based on the fused feature sequence using a multi-layer perceptron classification model, and includes a trained multi-layer perceptron classification model.
[0036] Furthermore, the system also includes an alarm module for issuing an alarm when a medium risk or a high risk is detected.
[0037] Compared with the prior art, the present invention has the following beneficial effects:
[0038] The present invention provides comprehensive environmental information by combining smoke concentration distribution, infrared thermal images and visible light images, significantly improving the accuracy and reliability of fire warnings. It uses 3D and 2D convolutional neural networks to effectively extract spatiotemporal features, texture shape features and temperature distribution features, enhancing the system's ability to understand complex environments. Through a weighted fusion method, it adaptively adjusts the importance of different features, improving the system's adaptability to different fire scenarios. The accuracy, real-time nature and adaptability of the fire warning of the present invention effectively reduce false alarms and missed alarms, providing strong technical support for protecting personal and property safety. BRIEF DESCRIPTION OF THE DRAWINGS
[0039] Figure 1 This is a flow chart of a fire warning method based on smoke image joint feature analysis of the present invention;
[0040] Figure 2 The figure is a schematic diagram of the composition of a fire warning system based on smoke image joint feature analysis of the present invention. DETAILED DESCRIPTION
[0041] To make the objectives, technical solutions, and advantages of the present invention more clear, the technical solutions of the present invention are described clearly and completely below. Obviously, the embodiments described are only some embodiments of the present invention, not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without making any creative efforts are within the scope of protection of the present invention. Example 1
[0042] like Figure 1FIG. 1 is a flow chart of a fire warning method based on smoke image joint feature analysis according to the present invention, wherein the method comprises the following steps:
[0043] Step S1, setting the data collection frequency of each sensor array and camera to be the same, collecting smoke concentration distribution data and infrared thermal image of the indoor environment based on the smoke sensor array and infrared sensor array, and collecting visible light image of the indoor environment based on the camera.
[0044] All sensors and cameras collect data at the same frequency, ensuring that different types of data are synchronized in time, facilitating subsequent feature extraction and fusion. The typical acquisition frequency can be set to 1 Hz (once per second), which is sufficient to capture dynamic changes in the environment without generating excessive data burden.
[0045] Using an array of multiple smoke sensors can obtain spatially distributed smoke concentration information. This offers advantages over single-point smoke sensors, as it can reflect smoke diffusion patterns and concentration gradients. Infrared sensor arrays collect indoor temperature distribution information, detecting possible heat sources and areas of temperature anomalies. Infrared heat maps can penetrate smoke, providing information that visible light cameras may not be able to capture. Visible light cameras capture real-time indoor images, capturing the visual characteristics of flames and smoke, as well as human activity.
[0046] The data acquisition frequency of the smoke sensor array, infrared sensor array, and camera is set to 1 Hz; the resolution of the smoke concentration distribution data collected by the smoke sensor array is 8x8 pixels, the resolution of the infrared heat map collected by the infrared sensor array is 32x24 pixels, and the resolution of the visible light image collected by the camera is 640x480 pixels.
[0047] In step S2, a 3D convolutional neural network is used to extract the spatiotemporal features of the smoke concentration distribution, and a 2D convolutional neural network is used to extract the texture and shape features of the visible light image and the temperature distribution features of the infrared thermal image; the three features are weightedly fused to generate a joint feature representation.
[0048] 3D convolutional neural networks are used to process smoke concentration distribution data. 3D convolution can simultaneously consider spatial and temporal dimensions, making it ideal for capturing the dynamic characteristics of smoke diffusion. It can learn how smoke concentration changes over time and space, which is crucial for early fire detection. 2D convolutional neural networks are used to process visible light images, extracting texture and shape features. This helps identify the visual characteristics of flames and smoke, as well as detect abnormal environmental changes. They are also used to process infrared thermal images, extracting temperature distribution features to help identify information such as the location of heat sources and heat diffusion patterns.
[0049] The three features are combined using a weighted fusion method. Attention mechanisms or other advanced fusion algorithms can be used to dynamically adjust the weights of various features according to the current environment conditions to generate the most representative joint feature representation.
[0050] When processing time series data (such as the distribution of smoke concentration in consecutive frames), 3D convolutional neural networks can capture the spatiotemporal features in the data. In the smoke concentration detection task, these features help accurately determine the presence, concentration, and changing trends of smoke. For example, a surveillance video records the process of smoke generation and diffusion in a certain area. By extracting consecutive frames from this video as input, the 3D convolutional neural network can capture the changes in the shape of the smoke in space and its diffusion pattern over time. These features are extracted and converted into 256-dimensional feature vectors, providing strong support for subsequent classification or regression tasks.
[0051] A 3D convolutional neural network is used to extract the spatiotemporal features of smoke concentration distribution. The structure of the 3D convolutional neural network includes: three 3D convolutional layers, each followed by a batch normalization function and a ReLU activation function, two 3D max pooling layers, and one fully connected layer. The input is T frames of smoke concentration distribution data, and the output is a 256-dimensional feature vector.
[0052] The mathematical expression of the 3D convolution operation is:
[0053] ;
[0054] in, Indicates that the output feature map is at position Place The value of each output channel; Indicates that the input data is at position Place The value of the input channel; represents the weight of the 3D convolution kernel, represents the spatial position of the convolution kernel, Indicates the The bias term of the output channel, Represent the height, width and depth of the convolution kernel space dimension respectively, Indicates the total number of channels of input data.
[0055] The input of the 3D convolutional neural network is continuous p-frame smoke concentration distribution data, where the value of p ranges from 10 to 30. The input of the 2D convolutional neural network is a single-frame visible light image or infrared thermal image.
[0056] 2D convolutional neural networks (such as ResNet-50) can extract detailed features from images, such as texture, edges, and shapes. Taking visible light images as an example, consider a picture of indoor smoke. Using the ResNet-50 network, we can extract smoke features such as color, shape, and texture. These features are converted into 512-dimensional feature vectors for subsequent analysis and judgment.
[0057] The 2D convolutional neural network adopts the ResNet-50 structure, including: 1 7x7 convolutional layer, 16 residual blocks, each residual block contains 3 convolutional layers, 1 global average pooling layer and 1 fully connected layer; the input is a visible light image or an infrared thermal map, and the output is a 512-dimensional feature vector.
[0058] The mathematical expression of the residual block is: ,in Represents the residual map, which consists of 3 convolutional layers. represents the output of the residual block, represents the input of the residual block, Represents the set of weight parameters in the residual map.
[0059] Feature fusion adopts the attention mechanism. The feature fusion method includes: linear transformation of the three features, calculation of attention weights, and weighted summation to obtain fused features.
[0060] The mathematical expression of the linear transformation is:
[0061] ;
[0062] The mathematical expression of the attention weight is:
[0063] ;
[0064] The fusion feature obtained by weighted summation is expressed as:
[0065] ;
[0066] in, Indicates the characteristics, They correspond to smoke concentration, visible light image and infrared thermal image features respectively; Indicates the query to be generated ,key Sum The weight matrix of Indicates the The query, key, and value of each feature; Indicates that from the feature To Features The attention weight of represents the transpose of the key vector, which is used to perform dot product operations with the query vector. Represents feature dimension; Represents the final fused features.
[0067] In smoke detection tasks, when smoke concentration is high, smoke concentration features may be more important; when smoke is light or difficult to detect, visible light image and infrared thermal image features may provide more effective supplementary information. Through the attention mechanism, we can dynamically adjust the weights of different features to more accurately determine the presence and concentration of smoke.
[0068] The specific implementation steps include: data preprocessing, frame extraction of surveillance video, and obtaining smoke concentration distribution data of continuous frames; at the same time, collecting visible light images and infrared thermal images as supplementary information; feature extraction, using 3D convolutional neural networks to extract the spatiotemporal features of smoke concentration distribution data to obtain a 256-dimensional feature vector; using the ResNet-50 network to extract image features of visible light images and infrared thermal images to obtain a 512-dimensional feature vector; feature fusion, using the attention mechanism to perform linear transformation on the three features, calculate attention weights and weighted summation to obtain the fused features; classification or regression, inputting the fused features into a classifier or regressor for smoke detection or concentration prediction.
[0069] In step S3, the fused joint features are represented as a feature sequence based on time order, and the fire risk level of the current time window is obtained based on the trained multi-layer perceptron classification model.
[0070] The multi-layer perceptron classification model includes: an input layer, two hidden layers, and an output layer; the input layer contains 1024 neurons, the first hidden layer contains 512 neurons, and the second hidden layer contains 256 neurons. Both hidden layers use the ReLU activation function. The output layer contains 4 neurons, corresponding to the four risk levels, and uses Softmax activation; the fire risk level is divided into four levels: no risk, low risk, medium risk, and high risk.
[0071] ;
[0072] Input feature vector; Output of the hidden layer; The final output is the probability distribution of risk levels; The weight matrix of each layer; Bias vectors for each layer.
[0073] The length of the time-based feature sequence is L, with a range of 5 to 15. During model training, we use a labeled dataset to optimize weight and bias parameters. The labels are known fire risk levels associated with the input feature sequence. Using optimization techniques such as backpropagation and gradient descent, we minimize the error between the predicted and actual risk levels.
[0074] Once the model is trained, we can use it to predict the risk level of new feature sequences. By inputting the fused feature sequences into the model, we can obtain a probability distribution representing the likelihood of each risk level. We can then select the category with the highest probability as the predicted risk level. This multi-layer perceptron-based fire risk level assessment method is applicable to various monitoring scenarios, such as industrial plants, warehouses, and residential areas. By analyzing smoke concentration, visible light images, and infrared thermal image features in surveillance videos in real time, we can promptly detect potential fire risks and take appropriate preventive measures to minimize losses. Example 2
[0075] like Figure 2 As shown, this is a schematic diagram of the composition of a fire warning system based on joint feature analysis of smoke images of the present invention. The system includes: a data acquisition module, a feature extraction module, a feature fusion module and a risk assessment module connected in sequence, which are used to execute the fire warning method described in the first aspect.
[0076] The data acquisition module is used to collect smoke concentration distribution data, infrared thermal images and visible light images of the indoor environment. The data acquisition module includes a smoke sensor array, an infrared sensor array and a visible light camera.
[0077] The feature extraction module is used to extract spatiotemporal features, texture and shape features, and temperature distribution features from the collected data. The feature extraction module includes a 3D convolutional neural network and a 2D convolutional neural network.
[0078] The feature fusion module is used to perform weighted fusion on the extracted features to generate a joint feature representation. The feature fusion module adopts a feature fusion algorithm based on the attention mechanism.
[0079] The risk assessment module is used to obtain the fire risk level of the current time window based on the fused feature sequence using a multi-layer perceptron classification model, and includes a trained multi-layer perceptron classification model.
[0080] The system further comprises an alarm module for issuing an alarm when a medium risk or a high risk is detected.
[0081] The system also includes a data preprocessing module that can complete the cleaning and enhancement of the collected data; data cleaning is to add a data cleaning step after the data acquisition module to remove noise, outliers and duplicate data, and ensure the quality of data input to the feature extraction module; data enhancement is to enhance the infrared thermal image and visible light image data, such as rotation, scaling, flipping, etc., to increase the generalization ability of the model and reduce the risk of overfitting.
[0082] The fire warning system proposed in the present invention realizes real-time monitoring and accurate warning of indoor smoke through close cooperation of various modules, providing strong protection for people's life and property safety.
[0083] It should be noted that those skilled in the art will appreciate that various modifications and equivalent substitutions may be made to the present invention without departing from the scope of the present invention. Furthermore, various modifications may be made to the present invention for specific circumstances or materials without departing from the scope of the present invention. Therefore, the present invention is not limited to the specific embodiments disclosed, but rather includes all embodiments falling within the scope of the claims of the present invention.
Claims
1. A fire warning method based on joint feature analysis of smoke images, applied to fire warning in indoor scenarios, includes the following steps: S1, setting the data collection frequency of each sensor array and camera to be the same, collecting smoke concentration distribution data and infrared thermal images of the indoor environment based on the smoke sensor array and infrared sensor array, and collecting visible light images of the indoor environment based on the camera; S2 uses a 3D convolutional neural network to extract the spatiotemporal features of smoke concentration distribution, and a 2D convolutional neural network to extract the texture and shape features of visible light images and the temperature distribution features of infrared thermal images. The three features are weighted and fused to generate a joint feature representation. In step S2, the input of the 3D convolutional neural network is p consecutive frames of smoke concentration distribution data, where the value of p ranges from 10 to 30, and the input of the 2D convolutional neural network is a single frame of visible light image or infrared thermal image; The structure of the 3D convolutional neural network includes: three 3D convolutional layers, each followed by a BatchNormalization function and a ReLU activation function, two 3D max pooling layers, and one fully connected layer; the input is T frames of smoke concentration distribution data, and the output is a 256-dimensional feature vector; The mathematical expression of the 3D convolution operation is: ; in, Indicates that the output feature map is at position Place The value of each output channel; Indicates that the input data is at position Place The value of the input channel; represents the weight of the 3D convolution kernel, represents the spatial position of the convolution kernel, Indicates the The bias term of the output channel, Represent the height, width and depth of the convolution kernel space dimension respectively, Indicates the total number of channels of input data; The 2D convolutional neural network uses the ResNet-50 structure, which includes: 1 7x7 convolutional layer, 16 residual blocks, each residual block contains 3 convolutional layers, 1 global average pooling layer and 1 fully connected layer; the input is a visible light image or infrared heat map, and the output is a 512-dimensional feature vector; S3, represents the fused joint features as a time-ordered feature sequence, and obtains the fire risk level of the current time window based on the trained multi-layer perceptron classification model; In step S3, the length of the time-ordered feature sequence is L, and the value range of L is 5 to 15; During the model training phase, a labeled dataset is used to optimize weight and bias parameters. The labels are known fire risk levels associated with the input feature sequence. The error between the predicted risk level and the actual risk level is minimized through backpropagation and gradient descent optimization. The multi-layer perceptron classification model consists of an input layer, two hidden layers, and an output layer. The input layer contains 1024 neurons, the first hidden layer contains 512 neurons, and the second hidden layer contains 256 neurons. Both hidden layers use the ReLU activation function. The output layer contains four neurons, corresponding to four risk levels, using Softmax activation. Fire risk levels are divided into four levels: no risk, low risk, medium risk, and high risk. ; represents the input feature vector; represents the output of the hidden layer; Represents the probability distribution of risk level of the final output; Represents the weight matrix of each layer; Represents the bias vector of each layer.
2. The fire warning method based on smoke image joint feature analysis according to claim 1, characterized in that: In step S1, the data acquisition frequency of the smoke sensor array, the infrared sensor array, and the camera is set to 1 Hz; the resolution of the smoke concentration distribution data collected by the smoke sensor array is 8x8 pixels, the resolution of the infrared thermal image collected by the infrared sensor array is 32x24 pixels, and the resolution of the visible light image collected by the camera is 640x480 pixels.
3. The fire warning method based on smoke image joint feature analysis according to claim 2 is characterized in that: In step S2, feature fusion adopts an attention mechanism, and the feature fusion method includes: performing linear transformation on the three features, calculating attention weights, and obtaining fusion features by weighted summation; The mathematical expression of the linear transformation is: ; The mathematical expression of the attention weight is: ; The fusion feature obtained by weighted summation is expressed as: ; in, Indicates the characteristics, They correspond to smoke concentration, visible light image and infrared thermal image features respectively; Indicates the query to be generated ,key Sum The weight matrix of Indicates the The query, key, and value of each feature; Indicates that from the feature To Features The attention weight of represents the transpose of the key vector, which is used to perform dot product operations with the query vector. Represents feature dimension; Represents the final fused features.
4. A fire warning system based on joint feature analysis of smoke images, used to execute the fire warning method according to any one of claims 1 to 3, characterized in that: The system comprises: A data acquisition module, for collecting smoke concentration distribution data, infrared thermal images and visible light images of the indoor environment, the data acquisition module includes a smoke sensor array, an infrared sensor array and a visible light camera; A feature extraction module is used to extract spatiotemporal features, texture and shape features, and temperature distribution features from the collected data. The feature extraction module includes a 3D convolutional neural network and a 2D convolutional neural network; A feature fusion module is used to perform weighted fusion on the extracted features to generate a joint feature representation. The feature fusion module adopts a feature fusion algorithm based on an attention mechanism; The risk assessment module is used to derive the fire risk level of the current time window based on the fused feature sequence using a multi-layer perceptron classification model, including a trained multi-layer perceptron classification model.
5. The fire warning system based on smoke image joint feature analysis according to claim 4, characterized in that: The system further comprises an alarm module for issuing an alarm when a medium risk or a high risk is detected.
Citation Information
Patent Citations
Fire detection system and method
CN109345760A
A forest pyrotechnics detection method based on 3D convolution neural network
CN109409256A
Fire monitoring system and method for electrical equipment
CN117854013A
Unmanned aerial vehicle cooperative detection method and device of multi-source heterogeneous sensor
CN118759517A
Cited By
Ancient building group fire early warning method and system based on Internet platform
CN121708702A