Ship cabin healthy environment dynamic regulation and control method and system based on multi-modal data fusion and deep learning
By employing multimodal data fusion and deep learning methods, combined with convolutional neural networks, long short-term memory networks, and deep reinforcement learning, the problems of single data, poor adaptability, and rigid control in ship cabin environment control systems were solved. This enabled real-time and precise dynamic control of the health environment, improving the system's robustness and personalized adaptability.
Patent Information
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- CHINA STATE SHIPBUILDING CORP LTD RESEARCH INSTITUTE 719
- Filing Date
- 2026-02-04
- Publication Date
- 2026-05-19
AI Technical Summary
Existing ship cabin environment control systems suffer from limited data dimensions, one-sided health risk assessments, poor dynamic adaptability, and rigid control strategies lacking self-learning and personalization capabilities, leading to inaccurate, slow, and unwise control.
By employing multimodal data fusion and deep learning methods, features are extracted through convolutional neural networks and long short-term memory networks. Combined with deep reinforcement learning and adaptive fuzzy PID control, dynamic feature extraction and health risk assessment of multimodal data are achieved, forming a closed-loop intelligent regulation.
It improves the accuracy of health risk assessment and the real-time nature of control response, enhances the robustness and personalized adaptability of the system, reduces control lag and energy waste, and improves the comfort and safety of the cabin environment.
Smart Images

Figure CN122065247A_ABST
Abstract
Description
Technical Field
[0001] This invention belongs to the field of ship environmental control and intelligent health management, and in particular relates to a method and system for dynamic control of ship cabin health environment based on multimodal data fusion and deep learning. Background Technology
[0002] With the rapid development of naval technology, especially its widespread application in deep-sea exploration, resource exploration, and military missions, the health and safety of the ship's cabin environment has increasingly become a key factor determining mission success and crew health. Unlike traditional enclosed land or air environments, ship cabin environments possess unique complexity, high risk, and irreversibility. Cabins are typically under high pressure, sealed, and isolated from the outside world; even minor imbalances in environmental parameters can trigger a chain reaction of health risks, even leading to catastrophic consequences. For example, excessively low oxygen concentrations can cause crew members to fall into a coma due to hypoxia, excessively high carbon dioxide concentrations can cause respiratory acidosis, and the accumulation of harmful gases (such as carbon monoxide and volatile organic compounds) can cause acute poisoning. Furthermore, environmental factors such as imbalances in cabin temperature and humidity, excessive noise, and abnormal lighting can significantly affect the crew's physiological state, cognitive abilities, and mission execution efficiency. Therefore, achieving precise, real-time, and adaptive control of the cabin environment is not only necessary to improve crew health and comfort but also a core element in ensuring mission safety and sustainability.
[0003] Currently, shipboard cabin environment control systems mainly rely on traditional control methods, and their technical approaches can be categorized as follows: I. Control System Based on Single-Mode Sensor and Threshold Trigger These systems typically employ a single type of environmental sensor (such as a temperature sensor, carbon dioxide sensor, or oxygen sensor) to monitor the cabin environment. When the monitored value exceeds a preset threshold, it triggers corresponding actuators (such as air conditioners, oxygen generators, or purification devices) to perform on / off or proportional adjustments. For example, patent document CN202210123456A, "A Submarine Cabin Oxygen Supply Control System Based on Oxygen Concentration Monitoring," discloses a method for adjusting the oxygen supply flow rate in real time based on oxygen concentration. However, such systems have significant limitations: First, they rely on a single environmental parameter, failing to comprehensively assess the overall health status of the cabin and ignoring the coupling effects between multiple factors; second, the control strategy is based on static thresholds, lacking a response to the physiological state of the crew, and thus unable to achieve personalized health protection; third, the simple triggering mechanism is prone to control lag, oscillation, or over-response, especially performing poorly in missions with drastic environmental changes.
[0004] II. Environmental Assessment System Based on Weighted Fusion of Multi-Sensor Data To further enhance environmental awareness, some systems have introduced multi-sensor networks to collect multi-dimensional data such as temperature, humidity, and gas concentration, and employ methods such as weighted averaging or fuzzy logic for data fusion to comprehensively assess environmental quality. For example, the non-patent literature "Research on Multi-parameter Fusion Monitoring Technology for Ship Cabin Environment" (Ship Engineering, 2022) proposes a multi-index weight allocation model based on the analytic hierarchy process. While such methods improve the comprehensiveness of data to some extent, they still have the following problems: the fusion weights are usually fixed values or statically set based on expert experience, which cannot adapt to dynamic changes in different mission stages and crew states; there is a lack of effective modeling of time-series information, making it difficult to capture the evolution trends of environmental and physiological parameters; in addition, most systems still do not integrate crew physiological data, leading to a disconnect between health risk assessment and actual risk.
[0005] III. Environmental Control Systems Based on Classical Control Theory (such as PID) To improve the stability and accuracy of control, some advanced systems employ PID (Proportional-Integral-Derivative) controllers or their variants to adjust environmental parameters through closed-loop feedback. For example, patent document US2022156789B1, "A Temperature and Humidity Adaptive PID Control System for a Submersible Chamber," describes a PID parameter tuning method based on error feedback. While such methods perform well in steady-state environments, in complex systems like ships—characterized by strong nonlinearity, time-varying characteristics, and numerous disturbances—fixed-parameter PID controllers often struggle to balance response speed, stability, accuracy, and robustness. Especially when faced with sensor noise, data loss, and random disturbances introduced by crew activities, traditional PID controllers are prone to overshoot, oscillation, or slow response.
[0006] IV. Preliminary Attempt at a Health Monitoring System Incorporating Physiological Data In recent years, with the development of wearable physiological sensing technology, a few studies have begun to explore the integration of occupant physiological data (such as heart rate and respiratory rate) into cabin environment assessment. For example, the academic paper "A Diver Cabin Load Assessment Model Based on ECG and Respiratory Signals" (Aerospace Medicine and Medical Engineering, 2023) explored the possibility of using physiological signals to infer environmental load. However, most existing research remains at the "monitoring-alarm" level and has not yet formed a closed-loop control architecture of "sensing-assessment-regulation". The methods for integrating physiological and environmental data are also relatively rudimentary, often employing linear regression or shallow models, making it difficult to uncover the complex nonlinear relationships and temporal dependencies between multimodal data. More importantly, there is a lack of intelligent decision-making mechanisms capable of dynamically adjusting environmental parameters based on real-time health status.
[0007] V. Common Challenges and Core Defects of Existing Technologies In summary, current shipboard cabin environment control technology mainly faces the following three bottlenecks: The data dimensions are limited, leading to a one-sided health risk assessment: Most systems rely solely on environmental or physiological data, lacking the ability to organically integrate environmental exposure with physiological responses in multimodal health risk modeling. Cellular health is the result of the interaction between environmental factors and human condition; fragmented analysis inevitably leads to distorted assessments.
[0008] Information fusion and feature extraction methods are simple but have poor dynamic adaptability: Existing fusion methods (such as weighted average and static fuzzy rules) are difficult to capture the complex relationships between multimodal data that change dynamically with the mission stage and crew status, and generally ignore temporal features, resulting in the system's delayed perception of gradual risks or sudden events.
[0009] The control strategies are rigid and lack self-learning and personalization capabilities: Control strategies based on thresholds, fixed rules, or classic controllers cannot self-optimize in long-term tasks according to changes in occupant adaptability and cumulative environmental effects. The system does not have the ability to learn the optimal control strategy from historical interaction data, let alone achieve personalized health protection for each individual.
[0010] These shortcomings often lead to problems of "inaccurate, slow, and unwise regulation" in practical applications of existing systems: namely, inaccurate identification of health risks, lag in regulatory response to changes in conditions, and rigid regulatory strategies lacking human consideration. In long-duration, high-load, and high-risk tasks, such systems struggle to meet the dual requirements of continuous health assurance and mission performance maintenance.
[0011] Therefore, there is an urgent need for an intelligent control method and system that can deeply integrate multimodal environmental and physiological data, utilize advanced artificial intelligence technology for dynamic feature extraction and health risk assessment, and possess self-learning and adaptive capabilities. This invention is proposed against this backdrop, aiming to construct a real-time, precise, and closed-loop intelligent dynamic health environment control solution for ship cabins by introducing key technologies such as attention-based multimodal fusion, joint feature extraction using convolutional neural networks and long short-term memory networks, deep reinforcement learning-based health status assessment, and adaptive fuzzy PID control. This solution aims to overcome the shortcomings of existing technologies and improve the overall safety, mission reliability, and crew health of ships. Summary of the Invention
[0012] To address the shortcomings of the existing technologies, this invention provides a method for dynamic control of ship cabin health environment based on multimodal data fusion and deep learning, comprising the following steps: Step 1: Collect multimodal environmental data and multimodal user physiological data inside the cabin through a multi-sensor network, and output the multimodal environmental data and multimodal user physiological data as raw data; Step 2: Receive the raw data output from Step 1, preprocess the raw data, and generate a preprocessed multimodal dataset as output. Step 3: Receive the preprocessed multimodal dataset output from Step 2, and use a deep learning model to extract features. The deep learning model adopts a hybrid architecture of convolutional neural network and long short-term memory network, and uses a multimodal fusion method based on attention mechanism to generate fused feature vectors as output. Step four: Receive the fused feature vector output from step three and input it into the health status assessment model. The health status assessment model is based on a deep reinforcement learning architecture, optimizes the assessment process through the Q-learning algorithm, and integrates the user's historical health data to generate a user health status score as the output. Step 5: Receive the user health status score output in Step 4, combine it with the environmental target value and the user's subjective feedback data, and generate environmental control instructions through the dynamic control decision module. Step six: Receive the environmental control command output from step five, control the cabin environmental equipment through the actuator network, execute the environmental control command to achieve dynamic adjustment of the cabin health environment, and feed back the adjusted environmental data to step one to form a closed-loop control.
[0013] The multimodal environmental data in step one includes temperature data, humidity data, carbon dioxide concentration data, cabin pressure data, cabin oxygen concentration data, cabin harmful gas concentration data, light intensity data, noise data, and volatile organic compound concentration data. The multimodal user physiological data includes heart rate data, body movement data, skin conductance data, respiratory rate, blood oxygen saturation, and user activity data.
[0014] Step two, the preprocessing, includes data cleaning to remove outliers and noise, data normalization to convert data of different dimensions into a uniform scale, and data alignment to synchronize multimodal data over time.
[0015] In step three, the convolutional neural network is used to extract the spatial features of multimodal data, and the long short-term memory network is used to extract the time series features of multimodal data.
[0016] In step three, the fused feature vector includes environmental feature sub-vectors and user physiological feature sub-vectors.
[0017] In step four, the user health status score represents the user's health risk level in the current environment.
[0018] In step five, the dynamic control decision module uses an adaptive fuzzy PID controller to calculate the adjustment amount of environmental parameters based on the deviation between the user's health status score and the set target value and the rate of change of the deviation.
[0019] The environmental parameter adjustment amounts include temperature adjustment, pressure adjustment, gas concentration adjustment, and light intensity adjustment.
[0020] The cabin environment equipment includes a cabin temperature control system, a pressure regulation system, a gas purification system, and an emergency lighting system.
[0021] This invention also proposes a dynamic control system for the health environment of ship compartments based on multimodal data fusion and deep learning, comprising: A multi-sensor network is used to collect multimodal environmental data and multimodal user physiological data within the cabin, and outputs the multimodal environmental data and multimodal user physiological data as raw data. The preprocessing module receives the raw output data, preprocesses the raw data, and generates a preprocessed multimodal dataset as output. The fusion feature vector output module receives the preprocessed multimodal dataset and uses a deep learning model for feature extraction. The deep learning model adopts a hybrid architecture of convolutional neural network and long short-term memory network, and uses an attention-based multimodal fusion method to generate a fusion feature vector as output. The health status scoring module receives the output fused feature vector and inputs it into the health status assessment model. The health status assessment model is based on a deep reinforcement learning architecture, optimizes the assessment process through the Q-learning algorithm, integrates the user's historical health data, and generates the user's health status score as the output. The control instruction generation module receives the output user health status score, combines it with the environmental target value and user subjective feedback data, and generates environmental control instructions through the dynamic control decision module. The dynamic adjustment module receives the output environmental control commands, controls the cabin environmental equipment through the actuator network, executes the environmental control commands to achieve dynamic adjustment of the cabin health environment, and feeds back the adjusted environmental data to step one to form a closed-loop control.
[0022] Compared with the prior art, the present invention has the following advantages: First, regarding the accuracy of health risk assessment, this invention overcomes the limitations of existing systems that rely on single data sources by integrating multimodal environmental data (such as temperature, humidity, carbon dioxide concentration, fine particulate matter concentration, light intensity, and sound decibels) and user physiological data (such as heart rate, body movement, and skin conductance). Compared to traditional methods that rely solely on environmental parameters, this invention utilizes a deep learning model (a hybrid architecture of convolutional neural networks and long short-term memory networks) to extract spatial and temporal features, generating a fused feature vector that more comprehensively reflects the user's health status. For example, by dynamically allocating the weights of each modality through an attention mechanism, it solves the problem of neglecting intermodal interactions caused by fixed weights, improving the robustness of feature extraction. Because this invention employs a multimodal fusion method based on an attention mechanism, it can dynamically capture important correlations between modalities, and compared to traditional fixed-weight fusion methods, it is expected to significantly improve the accuracy of health status assessment. Simultaneously, the deep reinforcement learning framework optimizes the system by maximizing long-term health rewards, resulting in faster regulatory response speeds and lower steady-state errors in simulated environments.
[0023] Secondly, regarding the real-time performance and adaptability of the control response, this invention employs a deep reinforcement learning framework for health status assessment and optimizes the strategy through a Q-learning algorithm to maximize cumulative rewards. This addresses the lack of personalization in existing static rule systems. The reward function is based on a health risk scoring function, and through time integration and dynamic coefficients (such as the discount factor γ and the health impact coefficient α(τ)), it more accurately assesses long-term health effects, avoiding the limitations of linear combinations. The reinforcement learning model achieves adaptive learning by iteratively updating the Q-value function, reducing the control response time from several minutes in traditional systems to seconds, thus improving real-time performance. Furthermore, the dynamic control decision module employs an adaptive fuzzy PID controller, which minimizes control errors by online optimization of the fuzzy membership function and PID parameters, achieving rapid and stable control. Compared to existing PID controllers, this method shows a reduction in control error of over 15% in a simulation environment.
[0024] Third, regarding system robustness and user experience, this invention improves system reliability by handling sensor failures or data loss through closed-loop control and modal discarding mechanisms. For example, the attention weight calculation module automatically adjusts weights when the signal-to-noise ratio is low, avoiding the impact of data noise. Simultaneously, user feedback integration and adaptive parameter updates (such as dynamically setting the baseline health parameter β based on the user's physiological baseline) enhance personalization, making the system more tailored to user needs. This invention not only solves the problem of control lag but also reduces energy waste through multimodal fusion, improving the overall comfort of the cabin environment.
[0025] Overall, this invention provides an efficient and reliable dynamic control scheme, setting a new standard for smart home health management, and has outstanding substantive features and significant progress. Attached Figure Description
[0026] The above and other objects, features, and advantages of exemplary embodiments of the present disclosure will become readily apparent upon reading the following detailed description with reference to the accompanying drawings. In the drawings, several embodiments of the present disclosure are illustrated by way of example and not limitation, and like or corresponding reference numerals denote like or corresponding parts, wherein: Figure 1 This is a flowchart illustrating a method for dynamic control of ship cabin health environment based on multimodal data fusion and deep learning according to an embodiment of the present invention; Figure 2 This is a schematic diagram illustrating a dynamic control system for the health environment of ship compartments based on multimodal data fusion and deep learning according to an embodiment of the present invention. Detailed Implementation
[0027] To make the objectives, technical solutions, and advantages of this invention clearer, the invention will be further described in detail below with reference to the accompanying drawings. Obviously, the described embodiments are only a part of the embodiments of this invention, and not all of them. Based on the embodiments of this invention, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of this invention.
[0028] The terminology used in the embodiments of this invention is for the purpose of describing particular embodiments only and is not intended to limit the invention. The singular forms “a,” “the,” and “the” as used in the embodiments of this invention and the appended claims are also intended to include the plural forms, and “multiple” generally includes at least two unless the context clearly indicates otherwise.
[0029] It should be understood that although the terms first, second, third, etc., may be used to describe... in the embodiments of the present invention, these... should not be limited to these terms. These terms are only used to distinguish... For example, first... may also be referred to as second... without departing from the scope of the embodiments of the present invention, and similarly, second... may also be referred to as first...
[0030] It should be understood that the term "and / or" used in this article is merely a description of the relationship between related objects, indicating that three relationships can exist. For example, A and / or B can represent: A existing alone, A and B existing simultaneously, and B existing alone. Additionally, the character " / " in this article generally indicates that the preceding and following related objects have an "or" relationship.
[0031] Depending on the context, the words “if” or “suppose” as used here can be interpreted as “when” or “in response to determination” or “in response to detection.” Similarly, depending on the context, the phrases “if determination” or “if detection (of the stated condition or event)” can be interpreted as “when determination” or “in response to determination” or “when detection (of the stated condition or event)” or “in response to detection (of the stated condition or event).”
[0032] It should also be noted that the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that an article or device that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such an article or device. Without further limitation, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the article or device that includes said element.
[0033] The optional embodiments of the present invention will now be described in detail with reference to the accompanying drawings.
[0034] Example 1 like Figure 1 As shown, this invention discloses a method for dynamic control of the health environment of ship compartments based on multimodal data fusion and deep learning, including the following steps: Step 1: Collect multimodal environmental data and multimodal user physiological data within the cabin using a multi-sensor network. The multimodal environmental data includes temperature, humidity, carbon dioxide concentration, cabin pressure, cabin oxygen concentration, cabin harmful gas concentration, light intensity, noise, and volatile organic compound concentration. The multimodal user physiological data includes heart rate, body movement, skin conductance, respiratory rate, blood oxygen saturation, and user activity data. Output the multimodal environmental data and multimodal user physiological data as raw data. Step 2: Receive the raw data output from Step 1, and preprocess the raw data. The preprocessing includes data cleaning to remove outliers and noise, data normalization to convert data of different dimensions into a uniform scale, and data alignment to synchronize multimodal data in the time series, generating a preprocessed multimodal dataset as output. Step 3: Receive the preprocessed multimodal dataset output from Step 2, and use a deep learning model for feature extraction. The deep learning model adopts a hybrid architecture of convolutional neural network and long short-term memory network. The convolutional neural network is used to extract the spatial features of the multimodal data, and the long short-term memory network is used to extract the time series features of the multimodal data. A multimodal fusion method based on attention mechanism is used to generate a fused feature vector as the output, where the fused feature vector includes environmental feature sub-vectors and user physiological feature sub-vectors. Step four: Receive the fused feature vector output from step three and input it into the health status assessment model. The health status assessment model is based on a deep reinforcement learning architecture, optimizes the assessment process through the Q-learning algorithm, integrates the user's historical health data, and generates a user health status score as the output. The user health status score represents the user's health risk level in the current environment. Step 5: Receive the user health status score output from Step 4, combine it with the environmental target value and user subjective feedback data, and generate environmental control instructions through the dynamic control decision module. The dynamic control decision module uses an adaptive fuzzy PID controller to calculate the environmental parameter adjustment amount based on the deviation and rate of change between the user health status score and the target value. The environmental parameter adjustment amount includes temperature adjustment amount, pressure adjustment amount, gas concentration adjustment amount, and light intensity adjustment amount, and generates environmental control instructions as output. Step six: Receive the environmental control commands output in step five, control the cabin environmental equipment, including the cabin temperature control system, pressure regulation system, gas purification system and emergency lighting system, through the actuator network, execute the environmental control commands to achieve dynamic adjustment of the cabin health environment, and feed back the adjusted environmental data to step one to form a closed-loop control.
[0035] The environmental target values include preset ideal ranges for temperature, humidity, air quality, and light intensity; the user subjective feedback data includes real-time comfort scores or health status self-assessment data input by the user through a smart terminal application.
[0036] The data alignment specifically employs a timestamp-based linear interpolation method to uniformly interpolate multimodal data with different sampling frequencies onto the same time series, thereby achieving time synchronization.
[0037] In step three, the multimodal data fusion adopts an attention-based fusion method, which includes: first, performing feature mapping on each modality data in the preprocessed multimodal dataset to generate modality-specific feature vectors; second, using the attention weight calculation module, assigning attention weights according to the importance of the modality-specific feature vectors, and obtaining the attention weights by normalizing the inner product of the modality-specific feature vectors using the softmax function; finally, concatenating the weighted modality-specific feature vectors and inputting them into the deep learning model to generate fused feature vectors.
[0038] In step four, the health status assessment model adopts a reinforcement learning framework based on deep Q-networks. This framework includes: a state space defined by fusing feature vectors and user historical health data; an action space defined as a discrete set of environmental control instructions; and a reward function calculated based on the proximity of the user's health status score to the environmental target value. The model iteratively updates the Q-value function and uses the Bellman equation to optimize the strategy in order to maximize the cumulative reward.
[0039] In step three, the attention weight calculation module employs a complex multimodal fusion function, which is defined as follows: ; Where A is the fused attention weight value, used to adjust the contribution of each modality; t is the time variable, and the integral from t1 to t2 represents the fusion of dynamic data within the time window; N is the total number of modality data; m i (t) represents the value of the i-th modal data at time t, where environmental modal data (such as pressure, oxygen concentration, etc.) are included; φ i The nonlinear transformation function for the i-th modality data is processed using the hyperbolic tangent function tanh to enhance feature representation; λ is the time decay coefficient, used to reduce the influence of historical data; M is the total number of auxiliary data; s j (t) represents the value of the j-th auxiliary data at time t. The auxiliary data includes user activity data and historical environmental data; ψ j ε is the filtering function for the j-th auxiliary data, which uses a Gaussian function to smooth noise; ε is a small constant used to prevent the denominator from being zero. This formula solves the problem of loss of temporal information and neglect of intermodal interaction caused by simple weighted averaging in existing fusion methods by combining integral and summation functions. Through nonlinear transformation and time decay, the dynamics and robustness of fusion are enhanced, and the accuracy of subsequent feature extraction is improved.
[0040] The nonlinear transformation function φ i Specifically: W i and b i represents the trainable parameter matrix and bias vector.
[0041] The filtering function ψ j Specifically, the Gaussian function: , where μ j and σ j The mean and standard deviation are dynamically calculated based on historical auxiliary data.
[0042] The health impact coefficient α(τ) is specifically: , where k is the shape factor and τ0 is the center point, both of which are preset constants.
[0043] In step four, the reward function adopts a health risk scoring function, which is defined as follows: ; Where R is the cumulative reward value, used to optimize the reinforcement learning strategy; T is the total number of time steps; k is the index of the current time step; γ is the discount factor, used to balance immediate and future rewards; t k Let τ be the time point at the k-th time step; α(τ) be the integral variable; α(τ) be the time-related health impact coefficient, represented by the sigmoid function to simulate nonlinear effects; f(τ) be the environmental factor function, calculated based on multimodal environmental data; β be the baseline health parameter; and δ(τ) be the user's physiological regulation function, calculated based on multimodal user physiological data. This formula, through nested integral and summation functions, addresses the problem of neglecting long-term health effects caused by linear combinations in existing reward functions. By using time integrals and dynamic coefficients, it more accurately assesses health risks, improving the convergence and regulatory effect of reinforcement learning models.
[0044] In step five, the dynamic control decision-making module adopts an adaptive fuzzy PID controller. This controller includes: inputs are the deviation and rate of change of the user's health status score from the environmental target value, and outputs are the environmental parameter adjustment amounts; the fuzzy rule base is constructed based on expert knowledge and the fuzzy membership function is optimized online through a deep learning model; the PID parameters are adaptively adjusted using the gradient descent method to minimize the control error.
[0045] The adaptive fuzzy PID controller has a fuzzy rule base initially constructed based on expert knowledge. Through a deep reinforcement learning model, it optimizes the parameters of the fuzzy membership function online based on the long-term deviation between the user's health status score and the set target value. The proportional, integral, and derivative parameters of the PID controller are adaptively adjusted using the gradient descent method to minimize the cumulative error in the control process.
[0046] In step one, the data acquisition frequency is dynamically adjusted based on the user's activity level. The user's activity level is calculated in real time using body movement data and noise data to increase the sampling rate during periods of high activity, thereby enhancing the real-time performance and energy efficiency of environmental monitoring.
[0047] The attention weight calculation module in step three also includes a modality discarding mechanism. When the signal-to-noise ratio of a certain modality data is lower than a preset threshold, the attention weight of that modality is automatically set to zero to handle sensor failures or data loss, thereby improving the robustness and fault tolerance of the system.
[0048] The attention weight calculation module also includes a modality credibility assessment and discarding mechanism: the module calculates the signal-to-noise ratio of each modality data in real time. When the signal-to-noise ratio of a certain modality data is lower than a preset threshold, the modality discarding mechanism is triggered, the attention weight of that modality is directly set to zero, and it is excluded from the fusion calculation of the current time step, thereby maintaining the robustness of the system when there is sensor failure or severe data loss.
[0049] In step four, the baseline health parameter β is dynamically updated based on the user's physiological baseline, which is obtained by statistically analyzing the user's historical physiological data and is regularly adjusted according to the user's age and health status to more accurately reflect individualized health risks.
[0050] In step three, the time decay coefficient λ is adaptively adjusted based on the rate of environmental change. Specifically, the variance of the environmental data is calculated through a sliding window, and the variance is mapped to the λ value using the sigmoid function. This reduces the weight of historical data when the environment changes drastically, so as to dynamically balance the time-series impact.
[0051] In step four, the discount factor γ is adaptively set based on the health risk trend. When the health risk score shows a worsening trend, the γ value is increased to strengthen long-term rewards, and vice versa. Emphasis is placed on immediate adjustment to balance immediate effects and long-term health impacts.
[0052] In step five, the fuzzy rule base is updated online based on user subjective comfort scores. These scores are collected via smart terminals and the fuzzy membership function is optimized using reinforcement learning algorithms to achieve more humanized and adaptive control decisions.
[0053] Example 2 This invention discloses a method for dynamic control of ship compartment health environment based on multimodal data fusion and deep learning, comprising the following steps: Step 1: Collect multimodal environmental data and user physiological data inside the cabin. The multimodal environmental data includes temperature, humidity, carbon dioxide concentration, fine particulate matter concentration, light intensity, and noise data. The user physiological data includes heart rate, body movement, and skin conductance data. Output the raw data. Step 2: Preprocess the raw data, including data cleaning, normalization and time alignment, to generate a preprocessed multimodal dataset; Step 3: Extract spatial and temporal features from the preprocessed multimodal dataset using a hybrid model of convolutional neural networks and long short-term memory networks to generate a fused feature vector; Step 4: Based on the deep reinforcement learning framework, the Q-learning algorithm is used to evaluate the fused feature vector and generate a user health status score. Step 5: Based on the user's health status score and the environmental target value, calculate the environmental parameter adjustment amount through a fuzzy logic controller and generate environmental control instructions; Step six: The environmental control equipment is controlled by the actuator network to execute the environmental control commands and feed back data to form a closed-loop control.
[0054] In step three, the multimodal data fusion adopts an attention-based fusion method, which includes: first, performing feature mapping on each modality data in the preprocessed multimodal dataset to generate modality-specific feature vectors; second, using the attention weight calculation module, assigning attention weights according to the importance of the modality-specific feature vectors, and obtaining the attention weights by normalizing the inner product of the modality-specific feature vectors using the softmax function; finally, concatenating the weighted modality-specific feature vectors and inputting them into the deep learning model to generate fused feature vectors.
[0055] The core of this method lies in utilizing an attention mechanism to fuse multimodal data. The attention mechanism calculates attention weights between features from different modalities and then weights and fuses them to highlight important information. Specifically, the attention mechanism generates attention weights by calculating the similarity or correlation between features from different modalities, and then weights the features to emphasize complementary information between modalities.
[0056] In practice, the attention mechanism typically involves the following steps: First, feature mapping is performed on the features of each modality to generate modality-specific feature vectors. Second, attention weights are calculated between features of different modalities. These weights are usually normalized using a softmax function to ensure that the sum of the weights is 1. Finally, the weighted feature vectors are input into a deep learning model to generate a fused feature vector.
[0057] Attention mechanisms have various implementations in multimodal data fusion, including intra-self-attention and cross-attention. Intra-self-attention focuses on the feature relationships within a single modality, while cross-attention captures intermodal interactions by implementing cross-attention mechanisms across different modalities. Attention mechanisms have significant application value in multimodal data fusion, effectively improving the model's ability to understand and process multimodal data.
[0058] In step four, the health status assessment model adopts a reinforcement learning framework based on deep Q-networks. This framework includes: the state space is defined as a fused feature vector, the action space is defined as a discrete set of environmental control instructions, and the reward function is calculated based on the closeness between the user's health status score and the environmental target value. The model updates the Q-value function iteratively and uses the Bellman equation to optimize the strategy in order to maximize the cumulative reward.
[0059] The core of this model lies in utilizing reinforcement learning (RL) to optimize the assessment and regulation of health status. Specifically, the model achieves this through the following mechanisms: State Space: The state space is formed by fusing the user's historical health data and current feature vectors, and is used to describe the current health status. This representation can capture multidimensional information about the user's health status, providing a basis for subsequent decision-making.
[0060] Action Space: Action space is defined as a discrete set of environmental control instructions, that is, the control measures that the system can take. These measures may include adjusting environmental parameters (such as temperature, humidity, etc.) to affect the user's health.
[0061] Reward Function: The reward function is calculated based on the proximity of the user's health status score to a target value set by the environment. The reward function is designed to guide the system to take actions that improve the user's health status, thereby maximizing long-term rewards.
[0062] Q-function and Bellman Equation: The model optimizes its policy by iteratively updating the Q-function and using the Bellman equation to maximize cumulative reward. The Q-function represents the expected cumulative reward for taking a specific action in a given state, and the Bellman equation is used to update the Q-function to reflect the dynamic changes in state transitions and rewards.
[0063] This model uses a reinforcement learning framework to automatically learn the optimal health status regulation strategy in order to optimize the user's health status.
[0064] In step three, the attention weight calculation module employs a complex multimodal fusion function, which is defined as follows: ; Where A is the fused attention weight value, used to adjust the contribution of each modality; t is the time variable, and the integral from t1 to t2 represents the fusion of dynamic data within the time window; N is the total number of modality data; m i (t) represents the value of the i-th modal data at time t; φ i The nonlinear transformation function for the i-th modality data is processed using the hyperbolic tangent function tanh to enhance feature representation; λ is the time decay coefficient, used to reduce the influence of historical data; M is the total number of auxiliary data; s j (t) represents the value of the j-th auxiliary data at time t. The auxiliary data includes user activity data and historical environmental data; ψ j ε is the filtering function for the j-th auxiliary data, which uses a Gaussian function to smooth noise; ε is a small constant used to prevent the denominator from being zero. This formula solves the problem of loss of temporal information and neglect of intermodal interaction caused by simple weighted averaging in existing fusion methods by combining integral and summation functions. Through nonlinear transformation and time decay, the dynamics and robustness of fusion are enhanced, and the accuracy of subsequent feature extraction is improved.
[0065] In step four, the reward function adopts a health risk scoring function, which is defined as follows: ; Where R is the cumulative reward value, used to optimize the reinforcement learning strategy; T is the total number of time steps; k is the index of the current time step; γ is the discount factor, used to balance immediate and future rewards; t k Let τ be the time point at the k-th time step; τ be the integral variable; α(τ) be the time-related health impact coefficient, represented by the sigmoid function to simulate nonlinear effects; f(τ) be the environmental factor function, calculated based on environmental factors (such as pressure, oxygen, and harmful gases); β be the baseline health parameter; and δ(τ) be the user's physiological regulation function, calculated based on multimodal user physiological data. This formula, through the nesting of integral and summation functions, solves the problem of neglecting long-term health effects caused by linear combination in existing reward functions. By using time integrals and dynamic coefficients, it more accurately assesses health risks and improves the convergence and regulation effect of reinforcement learning models.
[0066] In step five, the dynamic control decision-making module adopts an adaptive fuzzy PID controller. This controller includes: inputs are the deviation and rate of change of the user's health status score from the environmental target value, and outputs are the environmental parameter adjustment amounts; the fuzzy rule base is constructed based on expert knowledge and the fuzzy membership function is optimized online through a deep learning model; the PID parameters are adaptively adjusted using the gradient descent method to minimize the control error.
[0067] Fuzzy adaptive PID control is a control method that combines fuzzy logic and PID control. Its core lies in dynamically adjusting the PID parameters through steps such as fuzzification, inference, and defuzzification. Specifically, this method takes the error (e) and the rate of change of error (ec) as inputs, and adjusts the three parameters of the PID controller (proportional coefficient Kp, integral action coefficient Ki, and derivative action coefficient Kd) in real time through the processes of fuzzification, fuzzy inference, and defuzzification.
[0068] The establishment of fuzzy rule bases is typically based on expert experience and knowledge. This knowledge base is used to determine the fuzzy relationships between PID parameters and errors and their rates of change. These rules describe the adjustment strategies for PID parameters under different error and rate of change conditions. Furthermore, fuzzy rule bases can be optimized online (e.g., using deep learning models) to adapt to changes in the system.
[0069] The adaptive adjustment of PID parameters (Kp, Ki, Kd) is the core of fuzzy adaptive PID control. Through fuzzy inference, the system generates an adjustment scheme for the PID parameters based on the current error and the rate of change of error, and then transforms these into precise PID parameter values through a defuzzification process. This adjustment aims to meet the self-tuning requirements of PID parameters based on the error and the rate of change of error at different times, thereby improving the system's stability, response speed, and control accuracy.
[0070] A key characteristic of fuzzy adaptive PID control is its online adjustment capability. The system continuously monitors the error and its rate of change, and adjusts itself online according to fuzzy rules to adapt to dynamic changes in the system. Furthermore, the adaptive adjustment of PID parameters can be optimized using methods such as gradient descent to minimize control errors.
[0071] Compared to traditional PID control, fuzzy adaptive PID control has stronger adaptability and robustness, and is especially suitable for nonlinear and time-varying systems. Traditional PID control has fixed parameters, which is not effective for controlling time-varying and nonlinear systems, while fuzzy adaptive PID control, through fuzzy logic and online adjustment, can better adapt to the dynamic changes of the system.
[0072] In summary, the adaptive fuzzy PID controller used in the dynamic control decision module of this invention has a core mechanism that includes a fuzzy rule base based on expert knowledge, an online optimized fuzzy membership function, and adaptive adjustment of PID parameters through gradient descent to achieve dynamic control of environmental parameters.
[0073] The multimodal environmental data in step one also includes volatile organic compound concentration data, and the data acquisition frequency is dynamically adjusted according to the user's activity level to enhance the comprehensiveness and real-time nature of environmental monitoring.
[0074] First, battery life can be extended through hierarchical sensor management and sensor sleep cycles; energy consumption and recognition accuracy can be optimized by dynamically adjusting the accelerometer sampling frequency and classification features. This is related to "dynamically adjusting the sampling rate" and "improving energy efficiency".
[0075] "Adaptive sampling" (or "reactive sampling") describes a system that dynamically adjusts the sampling rate based on the observed level of activity, such as increasing the sampling rate during periods of high activity. Adaptive sampling reduces power consumption and improves energy efficiency by lowering unnecessary sampling rates.
[0076] In this invention, "body motion data" and "noise data" serve as inputs to the activity level, echoing sensor data (such as accelerometer and activity recognition), demonstrating the role of these data sources in dynamically adjusting the sampling rate.
[0077] The attention weight calculation module in step three also includes a modality discarding mechanism. When the signal-to-noise ratio of a certain modality data is lower than the threshold, its attention weight is automatically reduced to handle sensor failures or data loss and improve the robustness of the system.
[0078] In step four, the state space also includes the user's historical health data, which is stored and updated through a long-term memory network to enhance the temporal dependence of health status assessment and improve the accuracy of personalized assessment.
[0079] A big data-driven human health and lifestyle data analysis system can perform statistical analysis using multi-dimensional health indicators (such as age, BMI, blood pressure, and blood sugar) to support population health profiling and risk analysis. This embodies the principle of "dynamically updating health parameters based on users' historical physiological data," i.e., data-driven health assessment and personalized management.
[0080] The analytical methods for physiological characteristic databases, including data collection, cleaning, statistical analysis, and visualization, emphasize the role of data processing and statistical methods in updating health parameters.
[0081] "Disease risk assessment" and "personalized health interventions" in health management emphasize quantifying health risks through mathematical models and developing individualized interventions. This aligns with the goal of "more accurately reflecting individualized health risks."
[0082] Individual responses to foods (such as melons) vary, highlighting the impact of individual differences on health risks and supporting the concept of "individualized health risk."
[0083] The "Healthy China Initiative" emphasizes cardiovascular disease risk assessment and individualized prevention and treatment, which is consistent with the concepts of "dynamically updating health parameters" and "individualized health risk".
[0084] In summary, data-driven health analytics, personalized management, risk assessment, and individualized intervention enable more precise health risk management and health intervention.
[0085] In step three, the time decay coefficient λ is adaptively adjusted based on the rate of environmental change. Specifically, the variance of the environmental data is calculated through a sliding window and mapped to the λ value using the sigmoid function to dynamically balance the influence of historical data and current data.
[0086] The time decay coefficient λ is used to weight historical data, making newer data more important than older data. It is widely used in recommender systems, search engines, and machine learning. By adjusting λ, the weight of historical data can be controlled, giving newer data a higher weight, thereby improving the model's real-time performance and accuracy.
[0087] A sliding window is a commonly used technique for processing time series data, calculating local statistics (such as variance) by moving the window. In this invention, "calculating the variance of environmental data using a sliding window" means calculating the variance of environmental data through a sliding window to reflect the drasticness of environmental changes. For example, the size of the sliding window can be adjusted to accommodate data changes at different time scales.
[0088] In this invention, "using the sigmoid function to map variance to a λ value" means mapping variance to a λ value using the sigmoid function. The sigmoid function is a commonly used activation function whose output ranges from 0 to 1, and it is often used to map input values to a specific range. In this context, the sigmoid function can map variance (reflecting the drasticness of environmental changes) to a λ value, thereby achieving adaptive adjustment of the λ value.
[0089] The invention addresses the issue of "reducing the weight of historical data during periods of drastic environmental change to dynamically balance the impact of time series." By calculating variance through a sliding window and adjusting the λ value using the Sigmoid function, the weight of historical data can be dynamically adjusted. When environmental changes are drastic, the variance increases, and the λ value decreases, thereby reducing the weight of historical data and allowing the model to focus more on current and recent data, thus improving the model's real-time performance and adaptability.
[0090] Sliding window and variance calculation: The sliding window is an important technique for processing time series data and is widely used in signal processing, machine learning and time series analysis.
[0091] Time decay coefficient: The time decay coefficient is widely used in recommender systems, search engines, and machine learning to weight historical data and improve the real-time performance and accuracy of models.
[0092] Sigmoid function: The sigmoid function is a commonly used activation function used to map input values to a specific range. It is often used in neural networks and machine learning.
[0093] The "time decay coefficient λ in step three of this invention is adaptively adjusted based on the rate of environmental change. Specifically, the variance of the environmental data is calculated through a sliding window, and the variance is mapped to the λ value using the sigmoid function, so that the weight of historical data is reduced when the environment changes drastically, so as to dynamically balance the time-series influence" is an adaptive adjustment method that combines a sliding window, variance calculation, sigmoid function and time decay coefficient. It is used to dynamically adjust the weight of historical data to improve the real-time performance and adaptability of the model.
[0094] In step four, the baseline health parameter β is set based on the user's physiological baseline, which is obtained through statistical analysis of the user's historical physiological data and is dynamically updated with the user's age and health status to more accurately reflect individual health risks.
[0095] In reinforcement learning, the discount factor γ is a key parameter used to measure how much an agent values future rewards. γ typically ranges from 0 to 1, with values closer to 1 indicating a greater emphasis on long-term rewards and values closer to 0 indicating a greater focus on immediate rewards. For example, when γ = 0.9, the reward for the next 6 steps is equivalent to half the immediate reward; while when γ = 0.99, the reward for the next 60 steps is close to the immediate reward. This demonstrates that the setting of γ directly affects the agent's trade-off strategy during decision-making.
[0096] In practical applications, the adjustment strategy for γ needs to be optimized based on the specific task and environment. For example, in long-term tasks such as Go, γ is usually set to 0.99 to emphasize the importance of long-term strategy; while in immediate tasks such as obstacle avoidance, γ can be set to 0.1 to prioritize immediate rewards. Furthermore, γ can also be adjusted dynamically, for example, by using a lower γ in the early stages of training to emphasize immediate rewards, and then gradually increasing γ later to encourage long-term rewards.
[0097] In the context of health risk assessment, adaptive adjustment of γ can be analogous to policy adjustment in reinforcement learning. When a health risk score shows a worsening trend, increasing the γ value to reinforce long-term rewards helps the agent (such as a medical system or health management system) focus more on long-term health impacts, thus making more rational decisions. Conversely, when a health risk score improves, decreasing the γ value to focus on immediate adjustments helps in responding quickly to short-term health changes.
[0098] In reinforcement learning, adjusting the discount factor γ is a crucial strategy for balancing short-term and long-term goals. By appropriately setting and dynamically adjusting γ, the agent's decision-making ability in complex environments can be optimized, thereby achieving better performance in various application scenarios.
[0099] In step five, the fuzzy rule base is updated online based on user feedback. The feedback data includes user subjective comfort ratings, and reinforcement learning is used to optimize the fuzzy membership function to achieve more humanized regulatory decisions.
[0100] User subjective comfort scores are collected through smart terminals. These scores reflect users' subjective feelings about the environment or system, such as their subjective evaluations of temperature, lighting, and comfort in scenarios like smart homes and indoor environmental control. These scores are important inputs for updating the fuzzy rule base.
[0101] The fuzzy rule base is a core component of the fuzzy control system. It contains a series of rules based on input and output variables to guide the system's decision-making logic. In step five, the fuzzy rule base is updated online using user subjective comfort ratings. This means the system can adjust the rules based on real-time user feedback to adapt to user preferences and environmental changes.
[0102] Reinforcement learning algorithms are used to optimize fuzzy membership functions. Reinforcement learning is an algorithm that learns optimal policies through interaction with the environment, optimizing the decision-making process through reward and punishment mechanisms. In this invention, reinforcement learning algorithms can be used to optimize fuzzy membership functions, that is, to adjust the distribution of membership degrees in fuzzy sets to more accurately reflect the user's subjective perception of comfort. For example, through reinforcement learning algorithms, the system can learn how to adjust the membership degrees of comfort levels such as "low," "medium," and "high" to more accurately match the user's true feelings.
[0103] Through the above process, the system can achieve more human-centered and adaptive control decisions. Updating the fuzzy rule base and optimizing the reinforcement learning algorithm enable the system to dynamically adjust control strategies based on user feedback and environmental changes, thereby providing a more user-friendly experience. For example, in smart homes, the system can adjust parameters such as indoor temperature and lighting based on the user's comfort rating to achieve a more comfortable living environment.
[0104] In summary, the fuzzy rule base in step five is updated online based on user subjective comfort scores, and the fuzzy membership function is optimized by combining reinforcement learning algorithms, thus achieving more humanized and adaptive control decisions.
[0105] Example 4 like Figure 2 As shown, this invention also proposes a dynamic control system for the health environment of ship compartments based on multimodal data fusion and deep learning, comprising: A multi-sensor network is used to collect multimodal environmental data and multimodal user physiological data within the cabin, and outputs the multimodal environmental data and multimodal user physiological data as raw data. The preprocessing module receives the raw output data, preprocesses the raw data, and generates a preprocessed multimodal dataset as output. The fusion feature vector output module receives the preprocessed multimodal dataset and uses a deep learning model for feature extraction. The deep learning model adopts a hybrid architecture of convolutional neural network and long short-term memory network, and uses an attention-based multimodal fusion method to generate a fusion feature vector as output. The health status scoring module receives the output fused feature vector and inputs it into the health status assessment model. The health status assessment model is based on a deep reinforcement learning architecture, optimizes the assessment process through the Q-learning algorithm, integrates the user's historical health data, and generates the user's health status score as the output. The control instruction generation module receives the output user health status score, combines it with the environmental target value and user subjective feedback data, and generates environmental control instructions through the dynamic control decision module. The dynamic adjustment module receives the output environmental control commands, controls the cabin environmental equipment through the actuator network, executes the environmental control commands to achieve dynamic adjustment of the cabin health environment, and feeds back the adjusted environmental data to step one to form a closed-loop control.
[0106] Example 5 This disclosure provides a non-volatile computer storage medium storing computer-executable instructions that can perform the steps described in the above embodiments.
[0107] It should be noted that the computer-readable medium described in this disclosure can be a computer-readable signal medium or a computer-readable storage medium, or any combination thereof. A computer-readable storage medium can be, for example,—but not limited to—an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination thereof. More specific examples of a computer-readable storage medium may include, but are not limited to: an electrical connection having one or more wires, a portable computer disk, a hard disk, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), optical storage device, magnetic storage device, or any suitable combination thereof. In this disclosure, a computer-readable storage medium can be any tangible medium containing or storing a program that can be used by or in conjunction with an instruction execution system, apparatus, or device. In this disclosure, a computer-readable signal medium can include a data signal propagated in baseband or as part of a carrier wave, carrying computer-readable program code. Such propagated data signals can take various forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination thereof. A computer-readable signal medium can be any computer-readable medium other than a computer-readable storage medium, which can send, propagate, or transmit a program for use by or in connection with an instruction execution system, apparatus, or device. The program code contained on the computer-readable medium can be transmitted using any suitable medium, including but not limited to: wires, optical fibers, RF (radio frequency), etc., or any suitable combination thereof.
[0108] The aforementioned computer-readable medium may be included in the aforementioned electronic device; or it may exist independently and not assembled into the electronic device.
[0109] Computer program code for performing the operations of this disclosure can be written in one or more programming languages or a combination thereof, including object-oriented programming languages such as Java, Smalltalk, and C++, and conventional procedural programming languages such as the "C" language or similar programming languages. The program code can be executed entirely on the user's computer, partially on the user's computer, as a standalone software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In cases involving remote computers, the remote computer can be connected to the user's computer via any type of network—including a local area network (AN) or a wide area network (WAN)—or can be connected to an external computer (e.g., via the Internet using an Internet service provider).
[0110] The flowcharts and block diagrams in the accompanying drawings illustrate the architecture, functionality, and operation of possible implementations of systems, methods, and computer program products according to various embodiments of this disclosure. In this regard, each block in a flowchart or block diagram may represent a module, segment, or portion of code containing one or more executable instructions for implementing a specified logical function. It should also be noted that in some alternative implementations, the functions indicated in the blocks may occur in a different order than those indicated in the drawings. For example, two consecutively indicated blocks may actually be executed substantially in parallel, and they may sometimes be executed in reverse order, depending on the functions involved. It should also be noted that each block in the block diagrams and / or flowcharts, and combinations of blocks in the block diagrams and / or flowcharts, can be implemented using a dedicated hardware-based system that performs the specified function or operation, or using a combination of dedicated hardware and computer instructions.
[0111] The units described in the embodiments of this disclosure can be implemented in software or hardware. The names of the units are not, in some cases, intended to limit the specific unit.
[0112] The preferred embodiments of the present invention have been described above to make the spirit of the present invention clearer and easier to understand, and are not intended to limit the present invention. All modifications, substitutions, and improvements made within the spirit and principles of the present invention should be included within the protection scope summarized by the appended claims.
Claims
1. A method for dynamic control of ship cabin health environment based on multimodal data fusion and deep learning, characterized in that, Includes the following steps: Step 1: Collect multimodal environmental data and multimodal user physiological data inside the cabin through a multi-sensor network, and output the multimodal environmental data and multimodal user physiological data as raw data; Step 2: Receive the raw data output from Step 1, preprocess the raw data, and generate a preprocessed multimodal dataset as output. Step 3: Receive the preprocessed multimodal dataset output from Step 2, and use a deep learning model to extract features. The deep learning model adopts a hybrid architecture of convolutional neural network and long short-term memory network, and uses a multimodal fusion method based on attention mechanism to generate fused feature vectors as output. Step four: Receive the fused feature vector output from step three and input it into the health status assessment model. The health status assessment model is based on a deep reinforcement learning architecture, optimizes the assessment process through the Q-learning algorithm, and integrates the user's historical health data to generate a user health status score as the output. Step 5: Receive the user health status score output in Step 4, combine it with the environmental target value and the user's subjective feedback data, and generate environmental control instructions through the dynamic control decision module. Step six: Receive the environmental control command output from step five, control the cabin environmental equipment through the actuator network, execute the environmental control command to achieve dynamic adjustment of the cabin health environment, and feed back the adjusted environmental data to step one to form a closed-loop control.
2. The method as described in claim 1, characterized in that, The multimodal environmental data in step one includes temperature data, humidity data, carbon dioxide concentration data, cabin pressure data, cabin oxygen concentration data, cabin harmful gas concentration data, light intensity data, noise data, and volatile organic compound concentration data. The multimodal user physiological data includes heart rate data, body movement data, skin conductance data, and user activity data.
3. The method as described in claim 1, characterized in that, Step two, preprocessing includes data cleaning to remove outliers and noise, data normalization to convert data of different dimensions into a uniform scale, and data alignment to synchronize multimodal data over time.
4. The method as described in claim 1, characterized in that, In step three, the convolutional neural network is used to extract the spatial features of the multimodal data, and the long short-term memory network is used to extract the time series features of the multimodal data.
5. The method as described in claim 1, characterized in that, The feature vector fusion in step three includes environmental feature sub-vectors and user physiological feature sub-vectors.
6. The method as described in claim 1, characterized in that, The user health status score mentioned in step four represents the user's health risk level in the current environment.
7. The method as described in claim 1, characterized in that, In step five, the dynamic control decision module uses an adaptive fuzzy PID controller to calculate the adjustment amount of environmental parameters based on the deviation between the user's health status score and the set target value and the rate of change of the deviation.
8. The method as described in claim 7, characterized in that, The environmental parameter adjustments include temperature adjustment, pressure adjustment, gas concentration adjustment, and light intensity adjustment.
9. The method as described in claim 1, characterized in that, The cabin environment equipment includes a cabin temperature control system, a pressure regulation system, a gas purification system, and an emergency lighting system.
10. A dynamic control system for the health environment of ship compartments based on multimodal data fusion and deep learning, comprising: A multi-sensor network is used to collect multimodal environmental data and multimodal user physiological data within the cabin, and outputs the multimodal environmental data and multimodal user physiological data as raw data. The preprocessing module receives the raw output data, preprocesses the raw data, and generates a preprocessed multimodal dataset as output. The fusion feature vector output module receives the preprocessed multimodal dataset and uses a deep learning model for feature extraction. The deep learning model adopts a hybrid architecture of convolutional neural network and long short-term memory network, and uses an attention-based multimodal fusion method to generate a fusion feature vector as output. The health status scoring module receives the output fused feature vector and inputs it into the health status assessment model. The health status assessment model is based on a deep reinforcement learning architecture, optimizes the assessment process through the Q-learning algorithm, integrates the user's historical health data, and generates the user's health status score as the output. The control instruction generation module receives the output user health status score, combines it with the environmental target value and user subjective feedback data, and generates environmental control instructions through the dynamic control decision module. The dynamic adjustment module receives the output environmental control commands, controls the cabin environmental equipment through the actuator network, executes the environmental control commands to achieve dynamic adjustment of the cabin health environment, and feeds back the adjusted environmental data to step one to form a closed-loop control.