Psychological state analysis system and method for patients with multiple myeloma cardiac amyloidosis

Through deep learning technology, the combined analysis of echocardiography and physiological data of patients with amyloidosis in multiple myeloma heart was solved, which solved the problem of insufficient sensitivity of traditional evaluation methods to changes in psychological state, and achieved the amyloid of multiple myeloma heart. Real-time assessment and early intervention of changing the patient's psychological state.

CN118629596BActive Publication Date: 2024-11-01JILIN UNIVERSITY
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202411103768.1
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2024-08-13
Publication Date
2024-11-01
Estimated Expiration
2044-08-13

AI Technical Summary

Technical Problem

Traditional psychological state assessment methods lack sensitivity to psychological state changes in patients with amyloidosis of multiple myeloma, cannot capture subtle physiological changes and rapid changes in real time, and cannot identify potential psychological problems without obvious symptoms.

Method used

Using a deep learning-based psychological state analysis system for patients with amyloidosis in multiple myeloma heart, the psychological state level assessment is generated through the joint analysis of echocardiography and physiological data. .

Benefits of technology

Real-time assessment of the psychological status of patients with amyloidosis in multiple myeloma heart is achieved, subtle physiological changes are captured, and potential psychological problems are identified in a timely manner, providing a basis for early intervention.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN118629596B_ABST
    Figure CN118629596B_ABST
Patent Text Reader

Abstract

The present application discloses a system and method for analyzing the psychological state of patients with cardiac amyloidosis of multiple myeloma, which relates to the field of intelligent analysis. It uses image analysis and data processing technology based on deep learning to extract semantic features and perform time-series correlation interaction analysis on echocardiogram and physiological data respectively, so as to automatically evaluate the psychological state level of the monitored patients with cardiac amyloidosis of multiple myeloma according to the feature representation of vital signs in time-series semantics under the influence of the semantic features of echocardiogram. By analyzing the echocardiogram and physiological data, the system can capture subtle physiological changes related to the psychological state, which may be ignored in traditional evaluation methods. And by using sensors to collect the patient's heart rate and blood pressure data in real time, it can continuously monitor the patient's psychological state changes and respond to the patient's psychological needs in a timely manner, so that potential psychological problems can be identified from early physiological changes, providing a basis for early intervention.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application relates to the field of intelligent analysis, and more specifically, to a system and method for analyzing the psychological state of patients with multiple myeloma cardiac amyloidosis. Background Art

[0002] Multiple myeloma is a blood cancer involving plasma cells, which invade the bone marrow and affect normal blood cell production. Cardiac amyloidosis is a rare complication of multiple myeloma caused by abnormal immunoglobulin light chains deposited in heart tissue, resulting in damage to heart structure and function.

[0003] Because cardiac amyloidosis may lead to heart failure and other serious cardiac symptoms, these symptoms and their impact on quality of life may have a negative impact on the patient's psychological state, including anxiety and depression. Therefore, psychological status analysis is crucial for such patients.

[0004] However, traditional methods of assessing mental status usually rely on questionnaires or clinical interviews, which may lack sensitivity to subtle physiological changes, such as small fluctuations in heart rate variability or blood pressure, which may be associated with psychological stress. In addition, since mental status may change rapidly over time and in the environment, traditional methods may not be able to capture rapid changes in mental status in real time and cannot identify potential psychological problems in the absence of obvious symptoms.

[0005] Therefore, an optimized psychological state analysis system for multiple myeloma cardiac amyloidosis patients is desired, which can capture and analyze the psychological state of the patient in real time based on a joint analysis of the patient's echocardiographic and physiological data. Summary of the invention

[0006] In order to solve the above technical problems, this application is proposed.

[0007] According to one aspect of the present application, a psychological state analysis system for patients with multiple myeloma cardiac amyloidosis is provided, comprising:

[0008] A patient echocardiogram acquisition module, used to acquire an echocardiogram of a monitored multiple myeloma cardiac amyloidosis patient;

[0009] A patient physiological data acquisition module, used for acquiring a time series of physiological data of the monitored multiple myeloma cardiac amyloidosis patient acquired by a sensor group, wherein the physiological data includes a heart rate value and a blood pressure value;

[0010] A vital sign data time series association module, used for regularizing the time series of the physiological data to obtain a patient heart rate time series input vector and a patient blood pressure time series input vector, and then passing the vector through a patient vital sign time series feature extractor to obtain a patient heart rate time series association feature vector and a patient blood pressure time series association feature vector;

[0011] A heart rate-blood pressure time series feature interactive fusion module, used to obtain a multimodal vital sign time series semantic dynamic interactive fusion feature vector by passing the patient's heart rate time series associated feature vector and the patient's blood pressure time series associated feature vector through a vital sign multimodal parameter time series dynamic interactive fusion module based on a gated response mechanism;

[0012] An echocardiogram semantic feature extraction module, used for passing the echocardiogram through an echocardiogram semantic feature extractor to obtain an echocardiogram semantic feature vector;

[0013] A vital sign time series-echocardiogram feature interaction module, used for combining the multimodal vital sign time series semantic dynamic interaction fusion feature vector and the echocardiogram semantic feature vector through a vital sign-echocardiogram semantic dynamic response interaction encoder based on an adaptive response feature differentiation network to obtain a patient psychological state time series representation vector under the influence of echocardiogram semantics as a patient psychological state time series representation feature under the influence of echocardiogram semantics;

[0014] The psychological state level assessment module is used to obtain a detection result based on the temporal representation characteristics of the patient's psychological state under the influence of the ultrasonic cardiography semantics, and the detection result is used to represent the psychological state level label of the monitored multiple myeloma cardiac amyloidosis patient.

[0015] In the above-mentioned psychological state analysis system for patients with cardiac amyloidosis of multiple myeloma, the vital sign data time series association module includes:

[0016] A data regularization unit, used for regularizing the time series of the physiological data according to the time dimension and the sample dimension to obtain the patient's heart rate time series input vector and the patient's blood pressure time series input vector;

[0017] The patient vital sign timing feature extraction unit is used to pass the patient heart rate timing input vector and the patient blood pressure timing input vector through a patient vital sign timing feature extractor based on a 1D_CNN network to obtain the patient heart rate timing associated feature vector and the patient blood pressure timing associated feature vector.

[0018] In the above-mentioned psychological state analysis system for patients with multiple myeloma cardiac amyloidosis, the heart rate-blood pressure time series feature interactive fusion module includes:

[0019] A heart rate-blood pressure time series association cascade unit, used for cascading the patient's heart rate time series association feature vector and the patient's blood pressure time series association feature vector to obtain a heart rate-blood pressure time series association cascade feature vector;

[0020] A heart rate-blood pressure time series association cascade feature nonlinear processing unit, used for performing convolution coding and nonlinear activation processing on the heart rate-blood pressure time series association cascade feature vector to obtain a heart rate-blood pressure time series association nonlinear transformation activation vector;

[0021] A patient heart rate timing association optimization unit, for inputting the heart rate-blood pressure timing association nonlinear transformation activation vector into a sigmoid function to obtain a heart rate-blood pressure timing association first weight vector, and then performing position point multiplication of the heart rate-blood pressure timing association first weight vector and the patient heart rate timing association feature vector to obtain a patient heart rate timing association optimization feature vector;

[0022] A heart rate-blood pressure time series associated nonlinear transformation difference activation unit, used for calculating the positional subtraction between a unit vector and the heart rate-blood pressure time series associated nonlinear transformation activation vector to obtain a heart rate-blood pressure time series associated nonlinear transformation difference activation vector;

[0023] A patient blood pressure timing association optimization unit, for inputting the heart rate-blood pressure timing association nonlinear transformation difference activation vector into a sigmoid function to obtain a heart rate-blood pressure timing association second weight vector, and then performing position point multiplication of the heart rate-blood pressure timing association second weight vector and the patient blood pressure timing association feature vector to obtain a patient blood pressure timing association optimization feature vector;

[0024] The multimodal vital sign time series semantic dynamic interaction fusion unit is used to calculate the positional addition of the patient's heart rate time series associated optimized feature vector and the patient's blood pressure time series associated optimized feature vector to obtain the multimodal vital sign time series semantic dynamic interaction fusion feature vector.

[0025] In the above-mentioned psychological state analysis system for patients with cardiac amyloidosis of multiple myeloma, the heart rate-blood pressure time series correlation cascade characteristic nonlinear processing unit is used to:

[0026] Performing one-dimensional convolution coding on the heart rate-blood pressure time series associated cascade feature vector to obtain a heart rate-blood pressure time series associated cascade convolution coding feature vector;

[0027] After vector-matrix multiplication of the heart rate-blood pressure timing association cascade convolution coding feature vector and the parameter matrix to obtain the heart rate-blood pressure timing association cascade parameter vector, the heart rate-blood pressure timing association cascade parameter vector and the bias vector are added by position to obtain the heart rate-blood pressure timing association cascade bias feature vector;

[0028] The heart rate-blood pressure time series associated cascade bias feature vector is input into the SiLU activation function for nonlinear activation processing to obtain the heart rate-blood pressure time series associated nonlinear transformation activation vector.

[0029] In the above-mentioned psychological state analysis system for patients with cardiac amyloidosis of multiple myeloma, the echocardiogram semantic feature extraction module is used to: pass the echocardiogram through an echocardiogram semantic feature extractor based on a hollow convolutional neural network to obtain the echocardiogram semantic feature vector.

[0030] In the above-mentioned psychological state analysis system for patients with multiple myeloma cardiac amyloidosis, the vital sign time series-echocardiogram feature interaction module includes:

[0031] A vital sign-echocardiogram semantic position-by-position response unit, used for calculating the position-by-position response between the multimodal vital sign time series semantic dynamic interaction fusion feature vector and the echocardiogram semantic feature vector to obtain a vital sign-echocardiogram semantic position-by-position response feature vector;

[0032] A normalization unit, used for inputting the vital sign-echocardiogram semantic position-by-position response feature vector into a Softmax function for normalization processing to obtain a normalized vital sign-echocardiogram semantic position-by-position response feature vector;

[0033] A vital sign-echocardiogram semantic response weight mask calculation unit, used for inputting the normalized vital sign-echocardiogram semantic position-by-position response feature vector into a learnable gating function to obtain a vital sign-echocardiogram semantic response screening weight mask vector;

[0034] A distinguishable weight mask calculation unit, used for calculating the position point multiplication between the vital sign-echocardiogram semantic response screening weight mask vector and the normalized vital sign-echocardiogram semantic position-by-position response feature vector to obtain a vital sign-echocardiogram semantic position-by-position response distinguishable weight mask vector;

[0035] The patient's psychological state temporal representation unit under the influence of ultrasonic cardiology semantics is used to calculate the position point multiplication between the distinguishable weight mask vector of the vital sign-echocardiography semantic position-by-position response and the vital sign-echocardiography semantic position-by-position response feature vector to obtain the patient's psychological state temporal representation vector under the influence of ultrasonic cardiology semantics.

[0036] In the above-mentioned psychological state analysis system for patients with multiple myeloma cardiac amyloidosis, the vital sign-echocardiogram semantic response weight mask calculation unit is used to:

[0037] Using the negative number of each position feature value in the normalized vital sign-echocardiogram semantic position-by-position response feature vector as the exponent of the natural constant to calculate the position-based exponential function value with e as the base to obtain the normalized vital sign-echocardiogram semantic position-by-position response class support vector;

[0038] The inverse of the sum of the characteristic value of each position in the normalized vital sign-echocardiogram semantic position-by-position response class support vector and a constant one is calculated to obtain the vital sign-echocardiogram semantic response screening weight mask vector.

[0039] In the above-mentioned psychological state analysis system for patients with cardiac amyloidosis of multiple myeloma, the psychological state level assessment module is used to: pass the patient's psychological state time series representation vector under the influence of ultrasonic cardiac semantics through a classifier-based patient psychological state detector to obtain the detection result, and the detection result is used to represent the psychological state level label of the monitored multiple myeloma cardiac amyloidosis patient.

[0040] According to another aspect of the present application, a method for analyzing the psychological state of a patient with cardiac amyloidosis of multiple myeloma is provided, comprising:

[0041] Obtain echocardiograms of patients being monitored for cardiac amyloidosis in multiple myeloma;

[0042] Acquire a time series of physiological data of the monitored multiple myeloma cardiac amyloidosis patient collected by the sensor group, wherein the physiological data includes a heart rate value and a blood pressure value;

[0043] Regularizing the time series of the physiological data to obtain a patient heart rate time series input vector and a patient blood pressure time series input vector, and then passing the vectors through a patient vital sign time series feature extractor to obtain a patient heart rate time series associated feature vector and a patient blood pressure time series associated feature vector;

[0044] The patient's heart rate time series associated feature vector and the patient's blood pressure time series associated feature vector are passed through a vital sign multimodal parameter time series dynamic interactive fusion module based on a gated response mechanism to obtain a multimodal vital sign time series semantic dynamic interactive fusion feature vector;

[0045] Passing the echocardiogram through an echocardiogram semantic feature extractor to obtain an echocardiogram semantic feature vector;

[0046] The multimodal vital sign time series semantic dynamic interaction fusion feature vector and the echocardiogram semantic feature vector are fused through a vital sign-echocardiogram semantic dynamic response interaction encoder based on an adaptive response feature differentiation network to obtain a patient psychological state time series representation vector under the influence of echocardiogram semantics as a patient psychological state time series representation feature under the influence of echocardiogram semantics;

[0047] Based on the temporal characterization characteristics of the patient's psychological state under the influence of the ultrasonic cardiology semantics, a detection result is obtained, and the detection result is used to represent the psychological state level label of the monitored multiple myeloma cardiac amyloidosis patient.

[0048] Compared with the prior art, the present application provides a system and method for analyzing the psychological state of patients with cardiac amyloidosis of multiple myeloma, which uses image analysis and data processing technology based on deep learning to extract semantic features and perform time-series correlation interaction analysis on echocardiograms and physiological data, respectively, so as to automatically evaluate the psychological state level of the monitored patients with cardiac amyloidosis of multiple myeloma according to the feature representation of vital signs in time-series semantics under the influence of the semantic features of the echocardiogram. In this way, by analyzing the echocardiogram and physiological data, the system can capture subtle physiological changes related to the psychological state, which may be ignored in traditional evaluation methods. And by using sensors to collect the patient's heart rate and blood pressure data in real time, it is possible to continuously monitor the patient's psychological state changes and respond to the patient's psychological needs in a timely manner, so that potential psychological problems can be identified from early physiological changes, providing a basis for early intervention. BRIEF DESCRIPTION OF THE DRAWINGS

[0049] By describing the embodiments of the present application in more detail in conjunction with the accompanying drawings, the above and other purposes, features and advantages of the present application will become more apparent. The accompanying drawings are used to provide a further understanding of the embodiments of the present application and constitute a part of the specification. Together with the embodiments of the present application, they are used to explain the present application and do not constitute a limitation of the present application. In the accompanying drawings, the same reference numerals generally represent the same components or steps.

[0050] Figure 1 is a block diagram of a system for analyzing the psychological state of a patient with cardiac amyloidosis of multiple myeloma according to an embodiment of the present application;

[0051] Figure 2 The data flow diagram of the psychological state analysis system for multiple myeloma cardiac amyloidosis patients according to the embodiment of the present application;

[0052] Figure 3 The present invention is a flowchart of a method for analyzing the psychological state of patients with cardiac amyloidosis in multiple myeloma according to an embodiment of the present application. DETAILED DESCRIPTION

[0053] Below, the exemplary embodiments according to the present application will be described in detail with reference to the accompanying drawings. Obviously, the described embodiments are only part of the embodiments of the present application, rather than all the embodiments of the present application, and it should be understood that the present application is not limited to the exemplary embodiments described here.

[0054] As shown in this application and claims, unless the context clearly indicates an exception, the words "a", "an", "an" and / or "the" do not refer to the singular and may also include the plural. Generally speaking, the terms "include" and "comprise" only indicate the inclusion of the steps and elements that have been clearly identified, and these steps and elements do not constitute an exclusive list. The method or device may also include other steps or elements.

[0055] Although the present application makes various references to certain modules in the system according to the embodiments of the present application, any number of different modules can be used and run on the user terminal and / or server. The modules are only illustrative, and different aspects of the system and method can use different modules.

[0056] Flowcharts are used in the present application to illustrate the operations performed by the system according to the embodiments of the present application. It should be understood that the preceding or following operations are not necessarily performed accurately in order. On the contrary, various steps may be processed in reverse order or simultaneously as required. Meanwhile, other operations may also be added to these processes, or a certain step or several steps of operations may be removed from these processes.

[0057] Below, the exemplary embodiments according to the present application will be described in detail with reference to the accompanying drawings. Obviously, the described embodiments are only part of the embodiments of the present application, rather than all the embodiments of the present application, and it should be understood that the present application is not limited to the exemplary embodiments described here.

[0058] Traditional methods for assessing mental state usually rely on questionnaires or clinical interviews, which may lack sensitivity to subtle physiological changes, such as small fluctuations in heart rate variability or blood pressure, which may be associated with psychological stress. In addition, because mental state may change rapidly over time and environment, traditional methods may not be able to capture rapid changes in mental state in real time and cannot identify potential psychological problems in the absence of obvious symptoms. Therefore, an optimized system for analyzing the mental state of patients with cardiac amyloidosis in multiple myeloma is desired, which can capture and analyze the patient's mental state in real time based on a joint analysis of the patient's echocardiogram and physiological data.

[0059] In the technical solution of the present application, a psychological state analysis system for patients with multiple myeloma cardiac amyloidosis is proposed. Figure 1 It is a block diagram of a psychological state analysis system for patients with multiple myeloma cardiac amyloidosis according to an embodiment of the present application. Figure 2 FIG. 4 is a data flow diagram of a system for analyzing the psychological state of a patient with cardiac amyloidosis of multiple myeloma according to an embodiment of the present application. Figure 1 and Figure 2As shown, according to the embodiment of the present application, the psychological state analysis system 300 for patients with multiple myeloma cardiac amyloidosis includes: a patient echocardiogram acquisition module 310, which is used to acquire the echocardiogram of the monitored multiple myeloma cardiac amyloidosis patient; a patient physiological data acquisition module 320, which is used to acquire the time series of physiological data of the monitored multiple myeloma cardiac amyloidosis patient acquired by the sensor group, wherein the physiological data includes heart rate value and blood pressure value; a vital sign data timing association module 330, which is used to regularize the time series of the physiological data to obtain the patient heart rate timing input vector and the patient blood pressure timing input vector, and then pass them through the patient vital sign timing feature extractor to obtain the patient heart rate timing association feature vector and the patient blood pressure timing association feature vector; a heart rate-blood pressure timing feature interactive fusion module 340, which is used to combine the patient heart rate timing association feature vector and the patient blood pressure timing association feature vector through a vital sign data timing feature extractor based on a gated response mechanism. A module for dynamically interacting and fusion of multimodal vital sign parameters in time series to obtain a multimodal vital sign time series semantic dynamic interactive fusion feature vector; an echocardiogram semantic feature extraction module 350, used to pass the echocardiogram through an echocardiogram semantic feature extractor to obtain an echocardiogram semantic feature vector; a vital sign time series-echocardiogram feature interaction module 360, used to pass the multimodal vital sign time series semantic dynamic interactive fusion feature vector and the echocardiogram semantic feature vector through a vital sign-echocardiogram semantic dynamic response interaction encoder based on an adaptive response feature differentiation network to obtain a patient psychological state time series representation vector under the influence of ultrasound semantics as a patient psychological state time series representation feature under the influence of ultrasound semantics; a psychological state level evaluation module 370, used to obtain a test result based on the patient psychological state time series representation feature under the influence of ultrasound semantics, and the test result is used to represent the psychological state level label of the monitored multiple myeloma cardiac amyloidosis patient.

[0060] In particular, the patient echocardiogram acquisition module 310 and the patient physiological data acquisition module 320 are used to acquire the echocardiogram of the monitored multiple myeloma cardiac amyloidosis patient; and to acquire the time series of physiological data of the monitored multiple myeloma cardiac amyloidosis patient acquired by the sensor group, wherein the physiological data includes heart rate value and blood pressure value. It should be understood that the echocardiogram is used to detect the condition of the left ventricular wall of the echocardiogram. In particular, the echocardiogram of the patient with cardiac amyloidosis shows thickening of the left ventricular wall, enhanced myocardial echo, especially enhanced granular echo, which is caused by the deposition of amyloid fibers in the myocardial interstitium. And considering that the patient's physiological indicator data can reflect the patient's psychological state and emotional state changes, and the clinical characteristics will have an impact on the patient's emotions and psychology. Based on this, in the technical solution of the present application, an echocardiogram of the monitored multiple myeloma cardiac amyloidosis patient is obtained, and a time series of physiological data of the monitored multiple myeloma cardiac amyloidosis patient collected by a sensor group is obtained, wherein the physiological data includes heart rate values ​​and blood pressure values. In this way, the patient's mental state can be comprehensively analyzed and evaluated, and timely intervention and treatment can be carried out.

[0061] In particular, the vital sign data timing association module 330 is used to perform data regularization on the time series of the physiological data to obtain the patient heart rate timing input vector and the patient blood pressure timing input vector, and then pass them through the patient vital sign timing feature extractor to obtain the patient heart rate timing association feature vector and the patient blood pressure timing association feature vector. In particular, in a specific example of the present application, first, the time series of the physiological data is data regularized according to the time dimension and the sample dimension to obtain the patient heart rate timing input vector and the patient blood pressure timing input vector; then the patient heart rate timing input vector and the patient blood pressure timing input vector are passed through the patient vital sign timing feature extractor based on the 1D_CNN network to obtain the patient heart rate timing association feature vector and the patient blood pressure timing association feature vector. Taking into account that both the patient heart rate timing input vector and the patient blood pressure timing input vector contain timing feature information within a local time period, based on this, the patient heart rate timing input vector and the patient blood pressure timing input vector are passed through a patient vital sign timing feature extractor based on a 1D_CNN network to capture and mine out the timing dynamic change information and abnormal fluctuations of the patient's heart rate and blood pressure within a local time period, and obtain the patient heart rate timing association feature vector and the patient blood pressure timing association feature vector.

[0062] In particular, the heart rate-blood pressure time series feature interaction fusion module 340 is used to pass the patient's heart rate time series associated feature vector and the patient's blood pressure time series associated feature vector through a vital sign multimodal parameter time series dynamic interaction fusion module based on a gated response mechanism to obtain a multimodal vital sign time series semantic dynamic interaction fusion feature vector. Considering that there is a temporal mutual interaction relationship between the patient's heart rate time series associated feature vector and the patient's blood pressure time series associated feature vector. Therefore, in order to perform temporal semantic interaction fusion on the patient's heart rate time series associated feature vector and the patient's blood pressure time series associated feature vector based on the interaction relationship between the two in the time dimension, so as to provide a more comprehensive description of the physiological state, in the technical solution of the present application, the patient's heart rate time series associated feature vector and the patient's blood pressure time series associated feature vector are passed through a vital sign multimodal parameter time series dynamic interaction fusion module based on a gated response mechanism to obtain a multimodal vital sign time series semantic dynamic interaction fusion feature vector.

[0063] In an embodiment of the present application, the patient's heart rate timing association feature vector and the patient's blood pressure timing association feature vector are passed through a vital sign multimodal parameter timing dynamic interaction fusion module based on a gated response mechanism to obtain a multimodal vital sign timing semantic dynamic interaction fusion feature vector, including: first cascading the patient's heart rate timing association feature vector and the patient's blood pressure timing association feature vector to obtain a heart rate-blood pressure timing association cascade feature vector; cascading the patient's heart rate timing association feature vector and the patient's blood pressure timing association feature vector to more fully express the timing characteristics of the two different physiological parameters of heart rate and blood pressure, capture the complex timing interactions that may exist between them, and provide rich input for subsequent gated responses. Next, the heart rate-blood pressure time series association cascade feature vector is convolutionally encoded and nonlinearly activated to obtain a heart rate-blood pressure time series association nonlinear transformation activation vector; here, the features obtained after the cascade are subjected to one-dimensional convolutional encoding and nonlinear activation processing to extract and enhance local patterns and trends in the heart rate and blood pressure time series fusion features, and capture key local time series information to obtain a heart rate-blood pressure time series association nonlinear transformation activation vector. Then, the heart rate-blood pressure time series association nonlinear transformation activation vector is input into the sigmoid function to obtain the heart rate-blood pressure time series association first weight vector, and the heart rate-blood pressure time series association first weight vector is multiplied by the patient's heart rate time series association feature vector to obtain the patient's heart rate time series association optimized feature vector; then the positional subtraction of the unit vector and the heart rate-blood pressure time series association nonlinear transformation activation vector is calculated to obtain the heart rate-blood pressure time series association nonlinear transformation difference activation vector; the heart rate-blood pressure time series association nonlinear transformation difference activation vector is input into the sigmoid function to obtain the heart rate-blood pressure time series association second weight vector, and the heart rate-blood pressure time series association second weight vector is multiplied by the patient's blood pressure time series association feature vector to obtain the patient's blood pressure time series association optimized feature vector; then the positional addition of the patient's heart rate time series association optimized feature vector and the patient's blood pressure time series association optimized feature vector is calculated to obtain the multimodal vital sign time series semantic dynamic interaction fusion feature vector. In particular, the SiLU function is used here for activation processing, that is, SiLU adaptively gates the input vector through the sigmoid function, which means that it can automatically adjust the amplitude of the activation output, thereby improving the nonlinear expression ability of the network. Finally, the nonlinear transformation activation vector is used to perform weighted fusion on the patient's heart rate time series associated feature vector and the patient's blood pressure time series associated feature vector to dynamically capture the key time series dynamic interaction characteristics in these time series data, so as to obtain a more comprehensive multimodal vital sign time series semantic dynamic interaction fusion feature representation.

[0064] Among them, the process of performing convolution coding and nonlinear activation processing on the heart rate-blood pressure timing association cascade feature vector to obtain the heart rate-blood pressure timing association nonlinear transformation activation vector includes: performing one-dimensional convolution coding on the heart rate-blood pressure timing association cascade feature vector to obtain the heart rate-blood pressure timing association cascade convolution coding feature vector; after vector-matrix multiplication of the heart rate-blood pressure timing association cascade convolution coding feature vector and the parameter matrix to obtain the heart rate-blood pressure timing association cascade parameter vector, the heart rate-blood pressure timing association cascade parameter vector and the bias vector are added by position to obtain the heart rate-blood pressure timing association cascade bias feature vector; the heart rate-blood pressure timing association cascade bias feature vector is input into the SiLU activation function for nonlinear activation processing to obtain the heart rate-blood pressure timing association nonlinear transformation activation vector.

[0065] In summary, in the above embodiment, the patient's heart rate timing-related feature vector and the patient's blood pressure timing-related feature vector are passed through a vital sign multimodal parameter timing dynamic interaction fusion module based on a gated response mechanism to obtain a multimodal vital sign timing semantic dynamic interaction fusion feature vector, including: passing the patient's heart rate timing-related feature vector and the patient's blood pressure timing-related feature vector through a vital sign multimodal parameter timing dynamic interaction fusion module based on a gated response mechanism, and processing them with the following dynamic interaction fusion formula to obtain the multimodal vital sign timing semantic dynamic interaction fusion feature vector; wherein the dynamic interaction fusion formula is:

[0066] ;

[0067] ;

[0068] in, and are respectively the patient's heart rate time series associated feature vector and the patient's blood pressure time series associated feature vector, It is cascade processing. It is a one-dimensional convolutional encoding of the vector. is the parameter matrix, is the bias vector, yes function, is the nonlinear transformation activation vector of the heart rate-blood pressure temporal association, is a unit vector, yes function, For point-by-position multiplication, It is the multimodal vital sign temporal semantic dynamic interactive fusion feature vector.

[0069] In particular, the echocardiogram semantic feature extraction module 350 is used to pass the echocardiogram through an echocardiogram semantic feature extractor to obtain an echocardiogram semantic feature vector. Considering that the echocardiogram contains implicit semantic feature information about cardiac tissue, and the receptive field of the convolutional network in the traditional echocardiogram semantic feature extractor is small, and the ability to capture a larger range of cardiac tissue and structure is weak. Based on this, in the technical solution of the present application, the echocardiogram is passed through an echocardiogram semantic feature extractor based on a dilated convolutional neural network to capture and extract richer and more detailed echocardiogram semantic feature information to obtain an echocardiogram semantic feature vector. It is worth mentioning that the dilated convolutional neural network is a convolutional neural network (CNN) that uses a dilated convolution operation to expand the receptive field while maintaining spatial resolution.

[0070] In particular, the vital sign timing-echocardiogram feature interaction module 360 ​​is used to obtain the patient's psychological state temporal representation vector under the influence of ultrasound cardiology semantics as the patient's psychological state temporal representation feature under the influence of ultrasound cardiology semantics by using the multimodal vital sign timing semantic dynamic interaction fusion feature vector and the ultrasound cardiography semantic feature vector through the vital sign-echocardiogram semantic dynamic response interaction encoder based on the adaptive response feature distinction network. Considering that the multimodal vital sign timing semantic dynamic interaction fusion feature vector and the ultrasound cardiography semantic feature vector have a mutual correlation and influence relationship in local semantics. Therefore, in order to further refine and strengthen the granular semantic interaction between the multimodal vital sign time series semantic dynamic interaction fusion feature and the echocardiography semantic feature, so as to integrate the semantic features from different data sources (physiological time series data and echocardiography image data) to obtain more comprehensive patient information, in the technical solution of the present application, the multimodal vital sign time series semantic dynamic interaction fusion feature vector and the echocardiography semantic feature vector are passed through the vital sign-echocardiography semantic dynamic response interaction encoder based on the adaptive response feature differentiation network to obtain the patient's psychological state time series representation vector under the influence of echocardiography semantics. It should be understood that the vital sign-echocardiography semantic dynamic response interaction encoder based on the adaptive response feature differentiation network calculates the semantic response between the multimodal vital sign time series semantic dynamic interaction fusion feature vector and the echocardiography semantic feature vector at each corresponding position, so as to more carefully reveal the potential interaction between the two in semantics to obtain the position-by-position response feature vector. Then, the position-by-position response feature vector is normalized and gated adaptively selected to obtain the screening weight mask vector, so as to dynamically adjust the importance of the feature position. The screening weight mask vector is used to weight the normalized features to emphasize the more representative features. Finally, the weighted vector is multiplied with the position-by-position response feature vector to generate a temporal representation vector of the patient's psychological state under the influence of ultrasonic cardiology semantics that integrates the importance of multimodal information and semantic features. This provides a strong information basis for accurately evaluating and diagnosing the psychological state of patients with multiple myeloma cardiac amyloidosis.

[0071] In an embodiment of the present application, the multimodal vital sign temporal semantic dynamic interaction fusion feature vector and the echocardiogram semantic feature vector are transformed into a vital sign-echocardiogram semantic dynamic response interaction encoder based on an adaptive response feature differentiation network to obtain a patient psychological state temporal representation vector under the influence of echocardiogram semantics as a patient psychological state temporal representation feature under the influence of echocardiogram semantics, including: calculating the position-by-position response between the multimodal vital sign temporal semantic dynamic interaction fusion feature vector and the echocardiogram semantic feature vector to obtain a vital sign-echocardiogram semantic position-by-position response feature vector; inputting the vital sign-echocardiogram semantic position-by-position response feature vector into a Softmax function for normalization processing to obtain a normalized vital sign-echocardiogram semantic position-by-position response feature vector. Feature vector; a vital sign-echocardiogram semantic response weight mask calculation unit, used to input the normalized vital sign-echocardiogram semantic position-by-position response feature vector into a learnable gating function to obtain a vital sign-echocardiogram semantic response screening weight mask vector; calculate the position point multiplication between the vital sign-echocardiogram semantic response screening weight mask vector and the normalized vital sign-echocardiogram semantic position-by-position response feature vector to obtain a vital sign-echocardiogram semantic position-by-position response distinguishable weight mask vector; calculate the position point multiplication between the vital sign-echocardiogram semantic position-by-position response distinguishable weight mask vector and the vital sign-echocardiogram semantic position-by-position response feature vector to obtain a patient's psychological state temporal representation vector under the influence of echocardiography semantics.

[0072] Among them, the process of inputting the normalized vital sign-echocardiogram semantic position-by-position response feature vector into a learnable gating function to obtain a vital sign-echocardiogram semantic response screening weight mask vector includes: using the negative number of each position feature value in the normalized vital sign-echocardiogram semantic position-by-position response feature vector as the exponent of a natural constant to calculate the position-based exponential function value with e as the base to obtain a normalized vital sign-echocardiogram semantic position-by-position response class support vector; calculating the inverse of the sum of each position feature value in the normalized vital sign-echocardiogram semantic position-by-position response class support vector and a constant one to obtain the vital sign-echocardiogram semantic response screening weight mask vector.

[0073] In summary, in the above embodiment, the multimodal vital sign time series semantic dynamic interaction fusion feature vector and the echocardiogram semantic feature vector are processed through a vital sign-echocardiogram semantic dynamic response interaction encoder based on an adaptive response feature differentiation network to obtain a patient psychological state time series representation vector under the influence of echocardiogram semantics as a patient psychological state time series representation feature under the influence of echocardiogram semantics, including: the multimodal vital sign time series semantic dynamic interaction fusion feature vector and the echocardiogram semantic feature vector are processed through a vital sign-echocardiogram semantic dynamic response interaction encoder based on an adaptive response feature differentiation network with the following dynamic response interaction formula to obtain the patient psychological state time series representation vector under the influence of echocardiogram semantics; wherein the dynamic response interaction formula is:

[0074] ;

[0075] ;

[0076] ;

[0077] ;

[0078] ;

[0079] in, and They are respectively the multimodal vital sign time series semantic dynamic interactive fusion feature vector and the echocardiogram semantic feature vector, represents the vital sign-echocardiogram semantic position-by-position response feature vector, yes function, is the normalized vital sign-echocardiogram semantic position-by-position response feature vector, The natural constant The exponential function with base , is the vital sign-echocardiogram semantic response screening weight mask vector, It is the point multiplication by position. is the vital sign-echocardiogram semantic position-by-position response distinguishable weight mask vector, It is a temporal representation vector of the patient's psychological state under the influence of the ultrasonic cardiology semantics.

[0080] In particular, the psychological state level assessment module 370 is used to obtain a test result based on the temporal characterization feature of the patient's psychological state under the influence of the ultrasonic cardiography semantics, and the test result is used to represent the psychological state level label of the monitored multiple myeloma cardiac amyloidosis patient. In a specific example of the present application, the temporal characterization vector of the patient's psychological state under the influence of the ultrasonic cardiography semantics is passed through a patient psychological state detector based on a classifier to obtain the test result, and the test result is used to represent the psychological state level label of the monitored multiple myeloma cardiac amyloidosis patient. That is, the temporal characterization feature of the patient's psychological state under the influence of the ultrasonic cardiography semantics obtained by the semantic dynamic interaction of the multimodal vital sign temporal semantics dynamic interaction fusion feature vector and the ultrasonic cardiography semantic feature vector is classified and processed, so as to automatically evaluate the psychological state level of the monitored multiple myeloma cardiac amyloidosis patient. In this way, by analyzing the ultrasonic cardiography and physiological data, the system can capture subtle physiological changes related to the psychological state, which may be ignored in traditional assessment methods. In addition, sensors are used to collect the patient's heart rate and blood pressure data in real time, which can continuously monitor changes in the patient's mental state and respond to the patient's psychological needs in a timely manner. This can identify potential psychological problems from early physiological changes and provide a basis for early intervention.

[0081] In a preferred example, the step of passing the patient's psychological state time series representation vector under the influence of ultrasound cardiology semantics through a patient's psychological state detector based on a classifier to obtain a detection result includes:

[0082] Calculating the characteristic mean of the time series representation vector of the patient's psychological state under the influence of the ultrasonic cardiology semantics, and dividing the characteristic mean by the difference between the maximum eigenvalue and the minimum eigenvalue of the time series representation vector of the patient's psychological state under the influence of the ultrasonic cardiology semantics to obtain the distribution representation value of the time series representation of the patient's psychological state under the influence of the ultrasonic cardiology semantics;

[0083] The temporal characterization distribution modulation value of the patient's psychological state under the influence of ultrasonic cardiology semantics is obtained by subtracting the temporal characterization distribution characterization value of the patient's psychological state under the influence of ultrasonic cardiology semantics from one and dividing the result by the temporal characterization distribution characterization value of the patient's psychological state under the influence of ultrasonic cardiology semantics to obtain the temporal characterization distribution modulation value of the patient's psychological state under the influence of ultrasonic cardiology semantics;

[0084] Activating the patient's psychological state temporal representation vector under the influence of ultrasonic cardiology semantics through a probabilistic function to obtain a probabilistic patient's psychological state temporal representation vector under the influence of ultrasonic cardiology semantics;

[0085] After performing point subtraction between the probabilistic temporal representation vector of the patient's psychological state under the influence of ultrasonic cardiology semantics and the temporal representation distribution modulation value of the patient's psychological state under the influence of ultrasonic cardiology semantics, taking the absolute value and calculating the negative of the logarithmic value with base 2 to obtain the probabilistic temporal representation distribution modulation information vector of the patient's psychological state under the influence of ultrasonic cardiology semantics;

[0086] After dividing the distribution representation value of the temporal representation of the patient's psychological state under the influence of ultrasonic cardiology semantics by one minus the difference of each eigenvalue of the temporal representation vector of the patient's psychological state under the influence of the probabilistic ultrasonic cardiology semantics, summing all eigenvalues ​​of the temporal representation vector of the patient's psychological state under the influence of the probabilistic ultrasonic cardiology semantics, and dividing by the length of the temporal representation vector of the patient's psychological state under the influence of the ultrasonic cardiology semantics to obtain the distribution modulation bias value of the temporal representation of the patient's psychological state under the influence of the probabilistic ultrasonic cardiology semantics;

[0087] The optimized temporal representation vector of the patient's psychological state under the influence of ultrasonic cardiology semantics is obtained by multiplying the product of the probabilistic temporal representation distribution modulation information vector of the patient's psychological state under the influence of ultrasonic cardiology semantics and the probabilistic temporal representation distribution modulation bias value of the patient's psychological state under the influence of ultrasonic cardiology semantics and the weight as a hyperparameter;

[0088] The optimized temporal representation vector of the patient's psychological state under the influence of ultrasonic cardiology semantics is passed through a patient psychological state detector based on a classifier to obtain a detection result.

[0089] The optimized temporal representation vector of the patient's psychological state under the influence of echocardiography semantics is expressed as:

[0090] ;

[0091] ;

[0092] in, is the temporal representation vector of the patient's psychological state under the influence of the probabilistic echocardiographic semantics, is the temporal representation distribution representation value of the patient's psychological state under the influence of the ultrasonic cardiology semantics, Subtract by position point, represents the logarithmic function value with base 2, Click on the location to add. is the weight as a hyperparameter, is the length of the time series representation vector of the patient's psychological state under the influence of the echocardiography semantics, is the characteristic value of each position in the temporal representation vector of the patient's psychological state under the influence of the probabilistic echocardiography semantics, is the characteristic mean of the temporal representation vector of the patient's psychological state under the influence of the echocardiography semantics, and are respectively the maximum eigenvalue and the minimum eigenvalue of the temporal representation vector of the patient's psychological state under the influence of the ultrasonic cardiology semantics, It is the optimized temporal representation vector of the patient's psychological state under the influence of echocardiography semantics.

[0093] The applicant of the present application has taken into account that the multimodal vital sign temporal semantic dynamic interaction fusion feature vector and the echocardiogram semantic feature vector respectively express the local temporal correlation dynamic interaction fusion features of the heart rate and blood pressure values ​​of the monitored multiple myeloma cardiac amyloidosis patients and the image semantic features of the echocardiogram. In this way, when the multimodal vital sign temporal semantic dynamic interaction fusion feature vector and the echocardiogram semantic feature vector are passed through a vital sign-echocardiogram semantic dynamic response interaction encoder based on an adaptive response feature differentiation network, the obtained temporal representation vector of the patient's psychological state under the influence of the echocardiogram semantics will also have insufficient semantic dynamic response interaction coverage caused by the difference in feature distribution adaptive responses of physiological data and echocardiogram based on their respective feature distribution modalities, thereby leading to outlier class reasoning mapping deviation, affecting the accuracy of the detection result obtained by the temporal representation vector of the patient's psychological state under the influence of the echocardiogram semantics through a patient psychological state detector based on a classifier.

[0094] Based on this, in the above preferred example, the probability information distribution planning based on the eigenvalue of the temporal characterization vector of the patient's psychological state under the influence of the ultrasonic cardiology semantics is carried out through the Bernoulli probability modulation distribution of the temporal characterization vector of the patient's psychological state under the influence of the ultrasonic cardiology semantics relative to the eigenvalue distribution, and the probability reverse mapping of the probability characteristics of the temporal characterization vector of the patient's psychological state under the influence of the ultrasonic cardiology semantics is used as the extended coverage of the set mapping space of the temporal characterization vector of the patient's psychological state under the influence of the ultrasonic cardiology semantics, so as to independently understand the interaction path between the intuitive probability information distribution and the abstract probability space mapping of the temporal characterization vector of the patient's psychological state under the influence of the ultrasonic cardiology semantics, so as to improve the accuracy of the detection results obtained by the patient's psychological state detector based on the classifier by avoiding the counterfactual reasoning mapping of the outlier feature distribution of the temporal characterization vector of the patient's psychological state under the influence of the ultrasonic cardiology semantics to the class probability. In this way, by analyzing the echocardiogram and physiological data, the system can capture subtle physiological changes related to the psychological state, which may be ignored in traditional evaluation methods. In addition, sensors are used to collect the patient's heart rate and blood pressure data in real time, which can continuously monitor changes in the patient's mental state and respond to the patient's psychological needs in a timely manner. This can identify potential psychological problems from early physiological changes and provide a basis for early intervention.

[0095] As described above, the psychological state analysis system 300 for patients with cardiac amyloidosis of multiple myeloma according to the embodiment of the present application can be implemented in various wireless terminals, such as a server with a psychological state analysis algorithm for patients with cardiac amyloidosis of multiple myeloma. In a possible implementation, the psychological state analysis system 300 for patients with cardiac amyloidosis of multiple myeloma according to the embodiment of the present application can be integrated into a wireless terminal as a software module and / or a hardware module. For example, the psychological state analysis system 300 for patients with cardiac amyloidosis of multiple myeloma can be a software module in the operating system of the wireless terminal, or can be an application developed for the wireless terminal; of course, the psychological state analysis system 300 for patients with cardiac amyloidosis of multiple myeloma can also be one of the many hardware modules of the wireless terminal.

[0096] Alternatively, in another example, the multiple myeloma cardiac amyloidosis patient psychological state analysis system 300 and the wireless terminal may also be separate devices, and the multiple myeloma cardiac amyloidosis patient psychological state analysis system 300 may be connected to the wireless terminal via a wired and / or wireless network and transmit interactive information in accordance with an agreed data format.

[0097] Furthermore, a method for analyzing the psychological state of patients with multiple myeloma cardiac amyloidosis is provided.

[0098] Figure 3 FIG. 4 is a flow chart of a method for analyzing the psychological state of a patient with cardiac amyloidosis in multiple myeloma according to an embodiment of the present application. Figure 3As shown, according to the embodiment of the present application, the method for analyzing the psychological state of a patient with cardiac amyloidosis of multiple myeloma includes the following steps: S1, obtaining an echocardiogram of the monitored patient with cardiac amyloidosis of multiple myeloma; S2, obtaining a time series of physiological data of the monitored patient with cardiac amyloidosis of multiple myeloma collected by a sensor group, wherein the physiological data includes a heart rate value and a blood pressure value; S3, performing data regularization on the time series of the physiological data to obtain a patient heart rate timing input vector and a patient blood pressure timing input vector, and then passing the data through a patient vital sign timing feature extractor to obtain a patient heart rate timing correlation feature vector and a patient blood pressure timing correlation feature vector; S4, converting the patient heart rate timing correlation feature vector and the patient blood pressure timing correlation feature vector into a vital sign multimodal parameter based on a gated response mechanism. A temporal dynamic interactive fusion module is used to obtain a multimodal vital sign temporal semantic dynamic interactive fusion feature vector; S5, the echocardiogram is passed through an echocardiogram semantic feature extractor to obtain an echocardiogram semantic feature vector; S6, the multimodal vital sign temporal semantic dynamic interactive fusion feature vector and the echocardiogram semantic feature vector are passed through a vital sign-echocardiogram semantic dynamic response interactive encoder based on an adaptive response feature differentiation network to obtain a temporal representation vector of the patient's psychological state under the influence of echocardiography semantics as a temporal representation feature of the patient's psychological state under the influence of echocardiography semantics; S7, based on the temporal representation feature of the patient's psychological state under the influence of echocardiography semantics, a test result is obtained, and the test result is used to represent the psychological state level label of the monitored multiple myeloma cardiac amyloidosis patient.

[0099] In summary, the psychological state analysis method of patients with cardiac amyloidosis of multiple myeloma according to the embodiment of the present application is explained, which uses image analysis and data processing technology based on deep learning to perform semantic feature extraction and time-series correlation interaction analysis on echocardiogram and physiological data respectively, so as to automatically evaluate the psychological state level of the monitored patients with cardiac amyloidosis of multiple myeloma according to the characteristic representation of vital signs in time-series semantics under the influence of the semantic features of the echocardiogram. In this way, by analyzing the echocardiogram and physiological data, the system can capture subtle physiological changes related to the psychological state, which may be ignored in traditional evaluation methods. And by using sensors to collect the patient's heart rate and blood pressure data in real time, it is possible to continuously monitor the patient's psychological state changes and respond to the patient's psychological needs in a timely manner, so that potential psychological problems can be identified from early physiological changes, providing a basis for early intervention.

[0100] The embodiments of the present disclosure have been described above, and the above description is exemplary, not exhaustive, and is not limited to the disclosed embodiments. Many modifications and changes will be apparent to those of ordinary skill in the art without departing from the scope and spirit of the described embodiments. The selection of terms used herein is intended to best explain the principles of the embodiments, practical applications, or improvements to the technology in the market, or to enable other persons of ordinary skill in the art to understand the embodiments disclosed herein.

Claims

1. A psychological state analysis system for patients with multiple myeloma cardiac amyloidosis, characterized in that: include: A patient echocardiogram acquisition module, used to acquire an echocardiogram of a monitored multiple myeloma cardiac amyloidosis patient; A patient physiological data acquisition module, used for acquiring a time series of physiological data of the monitored multiple myeloma cardiac amyloidosis patient acquired by a sensor group, wherein the physiological data includes a heart rate value and a blood pressure value; A vital sign data time series association module, used for regularizing the time series of the physiological data to obtain a patient heart rate time series input vector and a patient blood pressure time series input vector, and then passing the vector through a patient vital sign time series feature extractor to obtain a patient heart rate time series association feature vector and a patient blood pressure time series association feature vector; A heart rate-blood pressure time series feature interactive fusion module, used to obtain a multimodal vital sign time series semantic dynamic interactive fusion feature vector by passing the patient's heart rate time series associated feature vector and the patient's blood pressure time series associated feature vector through a vital sign multimodal parameter time series dynamic interactive fusion module based on a gated response mechanism; An echocardiogram semantic feature extraction module, used for passing the echocardiogram through an echocardiogram semantic feature extractor to obtain an echocardiogram semantic feature vector; A vital sign time series-echocardiogram feature interaction module, used for combining the multimodal vital sign time series semantic dynamic interaction fusion feature vector and the echocardiogram semantic feature vector through a vital sign-echocardiogram semantic dynamic response interaction encoder based on an adaptive response feature differentiation network to obtain a patient psychological state time series representation vector under the influence of echocardiogram semantics as a patient psychological state time series representation feature under the influence of echocardiogram semantics; A psychological state level assessment module, used to obtain a test result based on the temporal characterization characteristics of the patient's psychological state under the influence of the ultrasonic cardiography semantics, wherein the test result is used to represent the psychological state level label of the monitored multiple myeloma cardiac amyloidosis patient; The heart rate-blood pressure time series feature interactive fusion module includes: A heart rate-blood pressure time series association cascade unit, used for cascading the patient's heart rate time series association feature vector and the patient's blood pressure time series association feature vector to obtain a heart rate-blood pressure time series association cascade feature vector; A heart rate-blood pressure time series association cascade feature nonlinear processing unit, used for performing convolution coding and nonlinear activation processing on the heart rate-blood pressure time series association cascade feature vector to obtain a heart rate-blood pressure time series association nonlinear transformation activation vector; A patient heart rate timing association optimization unit, for inputting the heart rate-blood pressure timing association nonlinear transformation activation vector into a sigmoid function to obtain a heart rate-blood pressure timing association first weight vector, and then performing position point multiplication of the heart rate-blood pressure timing association first weight vector and the patient heart rate timing association feature vector to obtain a patient heart rate timing association optimization feature vector; A heart rate-blood pressure time series associated nonlinear transformation difference activation unit, used for calculating the positional subtraction between a unit vector and the heart rate-blood pressure time series associated nonlinear transformation activation vector to obtain a heart rate-blood pressure time series associated nonlinear transformation difference activation vector; A patient blood pressure timing association optimization unit, for inputting the heart rate-blood pressure timing association nonlinear transformation difference activation vector into a sigmoid function to obtain a heart rate-blood pressure timing association second weight vector, and then performing position point multiplication of the heart rate-blood pressure timing association second weight vector and the patient blood pressure timing association feature vector to obtain a patient blood pressure timing association optimization feature vector; A multimodal vital sign time series semantic dynamic interactive fusion unit, used for calculating the positional addition of the patient's heart rate time series associated optimized feature vector and the patient's blood pressure time series associated optimized feature vector to obtain the multimodal vital sign time series semantic dynamic interactive fusion feature vector; Wherein, the vital signs time series-echocardiogram feature interaction module includes: A vital sign-echocardiogram semantic position-by-position response unit, used for calculating the position-by-position response between the multimodal vital sign time series semantic dynamic interaction fusion feature vector and the echocardiogram semantic feature vector to obtain a vital sign-echocardiogram semantic position-by-position response feature vector; A normalization unit, used for inputting the vital sign-echocardiogram semantic position-by-position response feature vector into a Softmax function for normalization processing to obtain a normalized vital sign-echocardiogram semantic position-by-position response feature vector; A vital sign-echocardiogram semantic response weight mask calculation unit, used for inputting the normalized vital sign-echocardiogram semantic position-by-position response feature vector into a learnable gating function to obtain a vital sign-echocardiogram semantic response screening weight mask vector; A distinguishable weight mask calculation unit, used for calculating the position point multiplication between the vital sign-echocardiogram semantic response screening weight mask vector and the normalized vital sign-echocardiogram semantic position-by-position response feature vector to obtain a vital sign-echocardiogram semantic position-by-position response distinguishable weight mask vector; The patient's psychological state temporal representation unit under the influence of ultrasonic cardiology semantics is used to calculate the position point multiplication between the distinguishable weight mask vector of the vital sign-echocardiography semantic position-by-position response and the vital sign-echocardiography semantic position-by-position response feature vector to obtain the patient's psychological state temporal representation vector under the influence of ultrasonic cardiology semantics.

2. The psychological state analysis system for patients with multiple myeloma cardiac amyloidosis according to claim 1, characterized in that: The vital sign data time series association module comprises: A data regularization unit, used for regularizing the time series of the physiological data according to the time dimension and the sample dimension to obtain the patient's heart rate time series input vector and the patient's blood pressure time series input vector; The patient vital sign timing feature extraction unit is used to pass the patient heart rate timing input vector and the patient blood pressure timing input vector through a patient vital sign timing feature extractor based on a 1D_CNN network to obtain the patient heart rate timing associated feature vector and the patient blood pressure timing associated feature vector.

3. The psychological state analysis system for patients with multiple myeloma cardiac amyloidosis according to claim 2, characterized in that: The heart rate-blood pressure time series correlation cascade characteristic nonlinear processing unit is used to: Performing one-dimensional convolution coding on the heart rate-blood pressure time series associated cascade feature vector to obtain a heart rate-blood pressure time series associated cascade convolution coding feature vector; After vector-matrix multiplication of the heart rate-blood pressure timing association cascade convolution coding feature vector and the parameter matrix to obtain the heart rate-blood pressure timing association cascade parameter vector, the heart rate-blood pressure timing association cascade parameter vector and the bias vector are added by position to obtain the heart rate-blood pressure timing association cascade bias feature vector; The heart rate-blood pressure time series associated cascade bias feature vector is input into the SiLU activation function for nonlinear activation processing to obtain the heart rate-blood pressure time series associated nonlinear transformation activation vector.

4. The psychological state analysis system for patients with multiple myeloma cardiac amyloidosis according to claim 3, characterized in that: The echocardiogram semantic feature extraction module is used to: pass the echocardiogram through an echocardiogram semantic feature extractor based on a hollow convolutional neural network to obtain the echocardiogram semantic feature vector.

5. The psychological state analysis system for patients with multiple myeloma cardiac amyloidosis according to claim 4, characterized in that: The vital sign-echocardiogram semantic response weight mask calculation unit is used to: Using the negative number of each position feature value in the normalized vital sign-echocardiogram semantic position-by-position response feature vector as the exponent of the natural constant to calculate the position-based exponential function value with e as the base to obtain the normalized vital sign-echocardiogram semantic position-by-position response class support vector; The inverse of the sum of the characteristic value of each position in the normalized vital sign-echocardiogram semantic position-by-position response class support vector and a constant one is calculated to obtain the vital sign-echocardiogram semantic response screening weight mask vector.

6. The psychological state analysis system for patients with multiple myeloma cardiac amyloidosis according to claim 5, characterized in that: The psychological state level assessment module is used to: pass the patient psychological state time series representation vector under the influence of ultrasonic cardiology semantics through a patient psychological state detector based on a classifier to obtain the detection result, and the detection result is used to represent the psychological state level label of the monitored multiple myeloma cardiac amyloidosis patient.

7. A method for analyzing the psychological state of a patient with multiple myeloma cardiac amyloidosis according to the system for analyzing the psychological state of a patient with multiple myeloma cardiac amyloidosis according to claim 1, characterized in that: include: Obtain echocardiograms of patients being monitored for cardiac amyloidosis in multiple myeloma; Acquire a time series of physiological data of the monitored multiple myeloma cardiac amyloidosis patient collected by the sensor group, wherein the physiological data includes a heart rate value and a blood pressure value; Regularizing the time series of the physiological data to obtain a patient heart rate time series input vector and a patient blood pressure time series input vector, and then passing the vectors through a patient vital sign time series feature extractor to obtain a patient heart rate time series associated feature vector and a patient blood pressure time series associated feature vector; The patient's heart rate time series associated feature vector and the patient's blood pressure time series associated feature vector are passed through a vital sign multimodal parameter time series dynamic interactive fusion module based on a gated response mechanism to obtain a multimodal vital sign time series semantic dynamic interactive fusion feature vector; Passing the echocardiogram through an echocardiogram semantic feature extractor to obtain an echocardiogram semantic feature vector; The multimodal vital sign time series semantic dynamic interaction fusion feature vector and the echocardiogram semantic feature vector are fused through a vital sign-echocardiogram semantic dynamic response interaction encoder based on an adaptive response feature differentiation network to obtain a patient psychological state time series representation vector under the influence of echocardiogram semantics as a patient psychological state time series representation feature under the influence of echocardiogram semantics; Based on the temporal characterization characteristics of the patient's psychological state under the influence of the ultrasonic cardiology semantics, a detection result is obtained, and the detection result is used to represent the psychological state level label of the monitored multiple myeloma cardiac amyloidosis patient; The patient's heart rate time series associated feature vector and the patient's blood pressure time series associated feature vector are passed through a vital sign multimodal parameter time series dynamic interactive fusion module based on a gated response mechanism to obtain a multimodal vital sign time series semantic dynamic interactive fusion feature vector, including: Cascading the patient's heart rate time series correlation feature vector and the patient's blood pressure time series correlation feature vector to obtain a heart rate-blood pressure time series correlation cascade feature vector; Performing convolution coding and nonlinear activation processing on the heart rate-blood pressure time series association cascade feature vector to obtain a heart rate-blood pressure time series association nonlinear transformation activation vector; After inputting the nonlinear transformation activation vector of the heart rate-blood pressure timing association into the sigmoid function to obtain the first weight vector of the heart rate-blood pressure timing association, the first weight vector of the heart rate-blood pressure timing association is multiplied by the patient's heart rate timing association feature vector according to the position point to obtain the patient's heart rate timing association optimization feature vector; Calculate the positional subtraction of the unit vector and the heart rate-blood pressure time series associated nonlinear transformation activation vector to obtain a heart rate-blood pressure time series associated nonlinear transformation difference activation vector; After inputting the nonlinear transformation difference activation vector of the heart rate-blood pressure time series association into the sigmoid function to obtain the second weight vector of the heart rate-blood pressure time series association, the second weight vector of the heart rate-blood pressure time series association and the patient's blood pressure time series association feature vector are multiplied by position points to obtain the patient's blood pressure time series association optimization feature vector; Calculating the positional addition of the patient's heart rate time series associated optimized feature vector and the patient's blood pressure time series associated optimized feature vector to obtain the multimodal vital sign time series semantic dynamic interactive fusion feature vector; The multimodal vital sign time series semantic dynamic interaction fusion feature vector and the echocardiogram semantic feature vector are fused through a vital sign-echocardiogram semantic dynamic response interaction encoder based on an adaptive response feature differentiation network to obtain a patient psychological state time series representation vector under the influence of echocardiogram semantics as a patient psychological state time series representation feature under the influence of echocardiogram semantics, including: Calculating the position-by-position response between the multimodal vital sign time series semantic dynamic interaction fusion feature vector and the echocardiogram semantic feature vector to obtain a vital sign-echocardiogram semantic position-by-position response feature vector; Inputting the vital sign-echocardiogram semantic position-by-position response feature vector into a Softmax function for normalization processing to obtain a normalized vital sign-echocardiogram semantic position-by-position response feature vector; Inputting the normalized vital sign-echocardiogram semantic position-by-position response feature vector into a learnable gating function to obtain a vital sign-echocardiogram semantic response screening weight mask vector; Calculating the position-wise multiplication between the vital sign-echocardiogram semantic response screening weight mask vector and the normalized vital sign-echocardiogram semantic position-by-position response feature vector to obtain a vital sign-echocardiogram semantic position-by-position response distinguishable weight mask vector; The position-wise multiplication between the distinguishable weight mask vector of the vital sign-echocardiogram semantic position-by-position response and the feature vector of the vital sign-echocardiogram semantic position-by-position response is calculated to obtain a temporal representation vector of the patient's psychological state under the influence of the echocardiogram semantics.