Elderly health support system based on multi-modal data fusion analysis

By adopting multimodal data fusion analysis technology in the elderly health care management system, combining video, sensing and audio data, the health care needs of the elderly are analyzed, and the data of the associated objects are combined to determine the health care support project, the problem of inaccurate analysis results in the existing technology is solved and higher accuracy of health care support is achieved.

CN119848792AActive Publication Date: 2025-04-18ZHEJIANG FUBAO INTELLIGENT TECH CO LTD
View PDF 8 Cites 0 Cited by

Patent Information

Application Number
CN202510337362.8
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2025-03-21
Publication Date
2025-04-18
Estimated Expiration
2045-03-21

AI Technical Summary

Technical Problem

In the prior art, health care management of elderly people mainly relies on video surveillance systems, and the accuracy of analysis results is difficult to guarantee, resulting in frequent response errors.

Method used

The elderly health care support system based on multimodal data fusion analysis is adopted. The system includes a composite reception port, an analysis and processing module and a health care support module. By identifying the health care scenario type of the monitored elderly, receiving video data, wearable device sensing data and audio data, analyzing and obtaining the health care needs information of the elderly, and combining the data of the associated objects, matching health care support projects are determined.

Benefits of technology

Through multimodal data fusion analysis, the accuracy of health care needs analysis in the elderly is significantly improved, the situation of response errors is reduced, and the overall accuracy of health care support is improved.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119848792A_ABST
    Figure CN119848792A_ABST
Patent Text Reader

Abstract

The invention belongs to the technical field of health care management. The invention provides an elderly health and care support system based on multi-modal data fusion analysis, and the system comprises a composite receiving port which is used for recognizing the health and care scene type of a monitored elderly, and determining an associated object according to the health and care scene type; receiving first multi-modal data related to the monitored old person and second multi-modal data related to the associated object; the analysis processing module is used for analyzing according to the first multi-modal data to obtain first health-care demand information; analyzing according to the second multi-modal data to obtain second health care demand information related to the first health care demand information; determining a plurality of matched health-care support items according to the first health-care demand information and the second health-care demand information; and the health-care support module is used for sending the health-care support items to health-care execution personnel, and the health-care execution personnel provide health-care support for the monitored old people and the associated objects on site. According to the method, the health care requirements of the old people are analyzed based on the multi-modal data, and the accuracy is higher.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the field of health care management technology, and in particular to an elderly health care support system based on multimodal data fusion analysis. Background Art

[0002] At present, health care management for the elderly is an important part of improving their living standards, such as analyzing their health care needs and providing them with relevant health care support. In the prior art, health care management for the elderly is mainly achieved through video surveillance systems, that is, video surveillance systems are used to shoot activity videos of the elderly, perform image recognition on the activity videos, analyze the health care needs of the elderly, and implement corresponding response strategies to provide them with health care support.

[0003] However, the accuracy of the analysis results based solely on activity videos captured by video surveillance systems to analyze the health care needs of the elderly cannot be effectively guaranteed, which leads to easy response errors, which needs to be improved. Summary of the invention

[0004] In response to the above technical problems, the present invention provides an elderly health care support system, electronic device, computer storage medium and computer program product based on multimodal data fusion analysis.

[0005] The present invention discloses a health care support system for the elderly based on multimodal data fusion analysis, the health care support system for the elderly comprising a composite receiving port, an analysis and processing module, and a health care support module; wherein the composite receiving port is used to identify the health care scene type of the monitored elderly, and determine the associated object according to the health care scene type; receive first multimodal data related to the monitored elderly, and second multimodal data related to the associated object; wherein the first multimodal data and the second multimodal data both include at least video data, sensor data of a wearable device, and audio data; the analysis and processing module, Used to obtain first health care demand information based on the first multimodal data analysis; and, to obtain second health care demand information related to the first health care demand information based on the second multimodal data analysis; to determine a number of matching health care support items based on the first health care demand information and the second health care demand information, and to send each of the health care support items to the health care support module; the health care support module is used to send each of the health care support items to health care executive personnel after receiving them, and the health care executive personnel provide on-site health care support for the monitored elderly and the related objects.

[0006] As an optional embodiment, the identifying of the health care scene type of the monitored elderly person and determining the associated objects according to the health care scene type include: identifying the health care scene type of the monitored elderly person, the health care scene type including a nursing home scene and a home scene; if the health care scene type is the nursing home scene, obtaining the elderly in the corresponding nursing home who have a close relationship with the monitored elderly person and whose physical health conditions meet the preset conditions, and taking them as the associated objects; if the health care scene type is the home scene, taking all persons in the home scene whose physical health conditions meet the preset conditions as the associated objects; wherein the physical health condition meeting the preset conditions means that the probability of occurrence of several specified disease types is higher than the preset probability.

[0007] As an optional embodiment, the obtaining of elderly people in the corresponding nursing home who have a close relationship with the monitored elderly person and whose physical health conditions meet preset conditions and taking them as the associated objects includes: obtaining multiple sets of surveillance videos in the corresponding nursing home, extracting multiple elderly people who have companionship behavior with the monitored elderly person based on each of the surveillance videos, counting the number of companionship behaviors of each elderly person, and determining several elderly people with the highest number of companionship behaviors as candidate elderly people; obtaining medical record information of each of the candidate elderly people, and evaluating the incidence probability of several of the specified disease types of the candidate elderly people based on the medical record information, if any of the incidence probabilities is higher than the preset probability, the candidate elderly people are determined as target elderly people, and each target elderly person is taken as the associated object.

[0008] As an optional embodiment, obtaining the first health care needs information based on the analysis of the first multimodal data includes: obtaining the third health care needs information based on the analysis of each single modal data in the first multimodal data, and fusing each of the third health care needs information to obtain the first health care needs information.

[0009] As an optional embodiment, the third health care needs information is integrated to obtain the first health care needs information, including: determining the weighted weights corresponding to the single modal data, and integrating the third health care needs information according to the weighted weights to obtain the first health care needs information.

[0010] As an optional embodiment, the second health care needs information related to the first health care needs information is obtained according to the analysis of the second multimodal data, including: obtaining the preliminary emotional stability of the associated object according to the analysis of each single modal data in the second multimodal data, and determining an adjustment value according to the number of pathogenic events experienced by the associated object, and using the adjustment value to adjust the preliminary emotional stability to the target emotional stability; analyzing the severity level of consequences of the first health care needs information, inputting the severity level of consequences, the target emotional stability, and the medical record information of the associated object into an association analysis model, and the association analysis model outputs the second health care needs information related to the first health care needs information.

[0011] As an optional embodiment, sending each of the health care support projects to the health care implementation personnel includes: retrieving the disposal plan corresponding to each of the health care support projects, and sending each of the disposal plans to the health care implementation personnel.

[0012] The present invention also discloses an electronic device, which is applied to the elderly health care support system based on multimodal data fusion analysis; it includes: at least one processor, a memory, and a computer program stored in the memory and executable on the at least one processor.

[0013] The present invention also discloses a computer storage medium, which is applied to the elderly health care support system based on multimodal data fusion analysis; the computer-readable storage medium stores a computer program.

[0014] The present invention also discloses a computer program product, which is applied to the elderly health care support system based on multimodal data fusion analysis; the computer program product contains computer code, and the computer code can be executed by a processor of an electronic device.

[0015] The beneficial effects of the present invention are: 1) The present invention analyzes the health care needs of the monitored elderly based on their multimodal data. The multimodal data includes at least video data, sensor data of wearable devices, and audio data. The health care needs analyzed in this way are more accurate.

[0016] 2) The present invention also analyzes the multimodal data of the associated objects associated with the monitored elderly, and analyzes their health care needs caused by the health care needs of the monitored elderly, and then provides health care support for the associated objects, that is, the monitored elderly and the associated objects are taken as a combination, and their health care needs are analyzed as a whole, which can further improve the accuracy of health care support. BRIEF DESCRIPTION OF THE DRAWINGS

[0017] In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings required for use in the embodiments are briefly introduced below. It should be understood that the following drawings only show certain embodiments of the present invention and therefore should not be regarded as limiting the scope. For ordinary technicians in this field, other related drawings can be obtained based on these drawings without creative work.

[0018] Figure 1 It is a structural schematic diagram of an elderly health care support system based on multimodal data fusion analysis disclosed in an embodiment of the present invention.

[0019] Figure 2 It is a schematic diagram of a process for determining associated objects in a nursing home disclosed in an embodiment of the present invention.

[0020] Figure 3 It is a flowchart of determining the second health care demand information disclosed in an embodiment of the present invention. DETAILED DESCRIPTION

[0021] The following is a description of the implementation of the present application by specific specific embodiments. People familiar with the technology can easily understand other advantages and effects of the present application from the contents disclosed in this specification. Obviously, the described embodiments are part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in the field without creative work are within the scope of protection of the present application.

[0022] In addition, the technical features involved in the different embodiments of the present application described below can be combined with each other as long as they do not conflict with each other.

[0023] In the prior art, elderly health care management is mainly achieved through video surveillance systems, that is, the elderly's activity videos are shot through the video surveillance system, and image recognition is performed on the activity videos to analyze the elderly's health care needs, and corresponding response strategies are implemented to provide health care support. However, the accuracy of the analysis results is difficult to effectively guarantee based solely on the activity videos shot by the video surveillance system to analyze the elderly's health care needs, which makes it easy to make responses wrong, which needs to be improved.

[0024] In response to the above technical issues, such as Figure 1As shown, an embodiment of the present invention discloses an elderly health care support system based on multimodal data fusion analysis, the elderly health care support system comprising a composite receiving port, an analysis and processing module, and a health care support module; wherein the composite receiving port is used to identify the health care scene type of the monitored elderly, and determine the associated object according to the health care scene type; receive first multimodal data related to the monitored elderly, and second multimodal data related to the associated object; wherein the first multimodal data and the second multimodal data both include at least video data, sensor data of a wearable device, and audio data; the analysis and processing module A module is used to obtain first health care demand information based on the first multimodal data analysis; and to obtain second health care demand information related to the first health care demand information based on the second multimodal data analysis; determine a number of matching health care support items based on the first health care demand information and the second health care demand information, and send each of the health care support items to the health care support module; the health care support module is used to send each of the health care support items to the health care executive personnel after receiving each of the health care support items, and the health care executive personnel provide on-site health care support for the monitored elderly and the related objects.

[0025] Compared with the elderly health care support system based solely on a video surveillance system mentioned in the background technology, the present invention has at least two improvements: 1) The present invention analyzes the health care needs of the monitored elderly based on their multimodal data, and the multimodal data includes at least video data, sensor data of wearable devices, and audio data, so that the accuracy of the health care needs analyzed is higher. 2) The present invention also analyzes the multimodal data of the associated objects associated with the monitored elderly, and analyzes their health care needs generated by the health care needs of the monitored elderly, and then provides health care support for the associated objects, that is, the monitored elderly and the associated objects are combined as a group, and their health care needs are analyzed as a whole, which can further improve the accuracy of health care support.

[0026] The above-mentioned composite receiving port supports multiple communication protocols, so that it can communicate with video surveillance systems, wearable devices, audio receiving devices, etc. to obtain video data, sensor data of wearable devices, and audio data respectively.

[0027] As an optional embodiment, the identifying of the health care scene type of the monitored elderly person and determining the associated objects according to the health care scene type include: identifying the health care scene type of the monitored elderly person, the health care scene type including a nursing home scene and a home scene; if the health care scene type is the nursing home scene, obtaining the elderly in the corresponding nursing home who have a close relationship with the monitored elderly person and whose physical health conditions meet the preset conditions, and taking them as the associated objects; if the health care scene type is the home scene, taking all persons in the home scene whose physical health conditions meet the preset conditions as the associated objects; wherein the physical health condition meeting the preset conditions means that the probability of occurrence of several specified disease types is higher than the preset probability.

[0028] In this embodiment, the monitored elderly can choose to live in a nursing home or at home, and correspondingly, the health care scene types include nursing home scenes and home scenes. The health care scene type of the monitored elderly can be realized by a video surveillance system deployed in the corresponding residence, that is, image analysis is performed on the surveillance video taken by the video surveillance system to perform semantic analysis on the scene type contained therein, and then determine the corresponding health care scene type.

[0029] Improvement 2) of the present invention is to provide health care support to the monitored elderly and the associated objects associated with the monitored elderly at the same time, wherein the health care needs of the monitored elderly may indirectly lead to health care needs of the associated objects. For example, when the monitored elderly suddenly develop a serious disease, the associated objects may trigger related serious diseases (mainly cardiovascular and cerebrovascular diseases) due to tension and worry. By predicting the diseases that may be induced by the associated objects, corresponding health care support can be provided in time, that is, preparatory treatment can be performed.

[0030] There are different identification methods for associated objects in different health care scene types. In the nursing home scene, the elderly in the nursing home who have a close relationship with the monitored elderly and whose physical health conditions meet the preset conditions are taken as associated objects; in the home scene, family members are almost all affected by the disease of the monitored elderly, so all persons whose physical health conditions meet the preset conditions are taken as associated objects. The reason for the arrangement of the present invention is that people who have a close relationship with the monitored elderly are more likely to be affected by the sudden serious illness of the monitored elderly, mainly psychologically, and are more likely to induce themselves to suffer from cardiovascular and cerebrovascular diseases, for example. People in nursing homes who have close contact with the monitored elderly (for example, living in the same room, often doing activities together, etc.) and are in poor health, and people with poor health among family members, all belong to the above-mentioned associated objects.

[0031] Among them, several types of diseases can be pre-specified, mainly cardiovascular and cerebrovascular diseases, because these diseases are more easily affected by emotions and cause onset, and the probability of occurrence of the above types of diseases can be evaluated based on the archival information of each person. If the probability of occurrence is higher than the preset probability, it is determined that the physical health condition meets the preset conditions.

[0032] As an optional embodiment, Figure 2 As shown, the method of obtaining the elderly people in the corresponding nursing home who have a close relationship with the monitored elderly person and whose physical health conditions meet the preset conditions and taking them as the associated objects includes: obtaining multiple groups of surveillance videos in the corresponding nursing home, extracting multiple elderly people who have companionship behavior with the monitored elderly person based on each of the surveillance videos, counting the number of companionship behaviors of each elderly person, and determining several elderly people with the highest number of companionship behaviors as candidate elderly people; obtaining the medical record information of each of the candidate elderly people, and evaluating the incidence probability of several of the specified disease types of the candidate elderly people based on the medical record information, if any of the incidence probabilities is higher than the preset probability, the candidate elderly people are determined as target elderly people, and each target elderly person is taken as the associated object.

[0033] In this embodiment, firstly, multiple groups of monitoring videos in a certain period of time in the nursing home are obtained, from which it can be analyzed which elderly people often go out with the monitored elderly people, such as walking together, playing chess, etc., and the elderly people with the highest number of companionship in a certain period (for example, the first 5) are determined as candidate elderly people. At the same time, the medical record information of these candidate elderly people is also obtained, and the medical record information records the type of disease and the degree of the disease (evaluated by the doctor) of each candidate elderly person. Based on these medical record information, the probability of each candidate elderly person being induced to develop various types of cardiovascular and cerebrovascular diseases can be evaluated, wherein the probability of the candidate elderly person who does not involve the specified disease type in the medical record information is 0, and the probability of the candidate elderly person who involves the specified disease type in the medical record information is greater than 0, and the probability of the disease is positively correlated with the number and degree of the specified disease type involved. Finally, if the probability of the onset of any cardiovascular and cerebrovascular disease of the candidate elderly person is higher than the preset probability, the candidate elderly person is determined as a target elderly person, and each target elderly person is an associated object.

[0034] As an optional embodiment, obtaining the first health care needs information based on the analysis of the first multimodal data includes: obtaining the third health care needs information based on the analysis of each single modal data in the first multimodal data, and fusing each of the third health care needs information to obtain the first health care needs information.

[0035] In this embodiment, after receiving the first multimodal data of the monitored elderly, the analysis and processing module parses each single modal data therefrom, and analyzes the health care needs of the monitored elderly based on each single modal data, that is, obtains multiple third health care needs information. Then, the multiple third health care needs information are integrated and processed, that is, the first health care needs information of the monitored elderly is obtained.

[0036] For example, if the monitored elderly person falls to the ground and cannot get up, the third health care demand information based on the video data is [heart attack, probability: 75%], [hypoglycemia, probability: 40%], the third health care demand information based on the sensor data of the wearable device is [heart attack, probability: 90%], and the third health care demand information based on the audio data is [heart attack, probability: 50%], [hypoglycemia, probability: 50%]. The weighted mean of the probability values ​​of "heart attack" is (65%+80%+50%) / 3=71.7%, and the weighted mean of the probability value of hypoglycemia is 45%. Therefore, "heart attack" is determined to be the most likely first health care demand information.

[0037] As an optional embodiment, the third health care needs information is integrated to obtain the first health care needs information, including: determining the weighted weights corresponding to the single modal data, and integrating the third health care needs information according to the weighted weights to obtain the first health care needs information.

[0038] In this embodiment, the weighted weights corresponding to each unimodal data are also pre-set. When setting the specific weights, it is necessary to consider the recognition accuracy of different unimodal data for health care needs. For example, the accuracy of identifying heart disease based on the sensor data of wearable devices is the highest, while the accuracy of identifying bumps and falls based on video data is the highest, and the accuracy of identifying falls of monitored elderly people in monitoring blind spots based on audio data is the highest. Therefore, the weighted weights corresponding to each unimodal data are set according to different health care needs.

[0039] Then, the weighted mean of each piece of third health care demand information obtained is calculated according to the above-mentioned weighted weights to obtain the first health care demand information.

[0040] As an optional embodiment, Figure 3As shown, the second health care needs information related to the first health care needs information obtained according to the analysis of the second multimodal data includes: obtaining the preliminary emotional stability of the associated object according to the analysis of each single modal data in the second multimodal data, and determining an adjustment value according to the number of pathogenic events experienced by the associated object, and using the adjustment value to adjust the preliminary emotional stability to the target emotional stability; analyzing the severity level of consequences of the first health care needs information, inputting the severity level of consequences, the target emotional stability, and the medical record information of the associated object into an association analysis model, and the association analysis model outputs the second health care needs information related to the first health care needs information.

[0041] In this embodiment, the preliminary emotional stability of the associated object is first obtained by comprehensive analysis of each single modal data in the second multimodal data of the associated object, for example, by analyzing the preliminary emotional stability through the facial expression, heart rate, body temperature, speaking pitch / tone, etc. obtained by recognition. At the same time, the adjustment value is also determined based on the number of pathogenic events experienced by the associated object. The more pathogenic events the associated object has experienced, the less the degree to which its emotions are affected by the fluctuations of such events, and vice versa. Multiplying the adjustment value by the preliminary emotional stability will give the target emotional stability.

[0042] Next, we analyze the severity level of the consequences of the first health care needs information, that is, the severity of the consequences that may be caused by the type of disease suffered by the monitored elderly, such as disability, death, etc. The higher the severity level of the consequences, the more likely it is to cause greater fluctuations in the emotions of the related objects, thereby increasing the probability of inducing cardiovascular and cerebrovascular diseases in the related objects.

[0043] Finally, the severity of the consequence, the target’s emotional stability, and the medical record information of the associated object are input into the association analysis model together, and the model predicts the second health care demand information related to the first health care demand information, that is, the type of disease that the associated object is most likely to have due to the type of disease of the monitored elderly. The association analysis model is preferably built based on Transformer, mainly including an encoder and a decoder, where the encoder can be a dual encoder structure. In addition, the association analysis model can also be built by a large model (such as a BERT large model), which will not be described in detail.

[0044] As an optional embodiment, sending each of the health care support projects to the health care implementation personnel includes: retrieving the disposal plan corresponding to each of the health care support projects, and sending each of the disposal plans to the health care implementation personnel.

[0045] In this embodiment, treatment plans for different types of diseases are pre-set in the database, and the treatment plans include the drugs and equipment to be used, as well as specific standard treatment procedures.

[0046] An embodiment of the present invention also discloses an electronic device, which is applied to the elderly health care support system based on multimodal data fusion analysis; it includes: at least one processor, a memory, and a computer program stored in the memory and executable on the at least one processor.

[0047] An embodiment of the present invention further discloses a computer storage medium, which is applied to the elderly health care support system based on multimodal data fusion analysis; the computer-readable storage medium stores a computer program.

[0048] An embodiment of the present invention further discloses a computer program product, which is applied to the elderly health care support system based on multimodal data fusion analysis; the computer program product contains computer code, and the computer code can be executed by a processor of an electronic device.

[0049] The computer-readable storage medium described above may include, but is not limited to, electronic, magnetic, optical, electromagnetic, infrared, or semiconductor systems, devices or equipment, or any suitable combination of the above. Alternatively, the computer-readable storage medium may be a machine-readable signal medium. More specific examples of machine-readable storage media may include electrical connections based on one or more lines, portable computer disks, hard disks, random access memories (RAM), read-only memories (ROM), erasable programmable read-only memories (EPROM or flash memory), optical fibers, portable compact disk read-only memories (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination of the above.

[0050] To provide interaction with a user, the systems and techniques described herein may be implemented on an electronic device having: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to the user; and a keyboard and a pointing device (e.g., a mouse or trackball) through which the user can provide input to the electronic device. Other types of devices may also be used to provide interaction with the user; for example, the feedback provided to the user may be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user may be received in any form (including acoustic input, voice input, or tactile input).

[0051] It should be understood that the various forms of processes shown above can be used to reorder, add or delete steps. For example, the steps described in the present invention can be executed in parallel, sequentially or in different orders, as long as the desired results of the technical solution of the present invention can be achieved, and this document does not limit this.

[0052] The above specific implementations do not constitute a limitation on the protection scope of the present invention. It should be understood by those skilled in the art that various modifications, combinations, sub-combinations and substitutions can be made according to design requirements and other factors. Any modification, equivalent substitution and improvement made within the spirit and principle of the present invention should be included in the protection scope of the present invention.

Claims

1. An elderly health care support system based on multimodal data fusion analysis, characterized by: The elderly health care support system includes a composite receiving port, an analysis and processing module, and a health care support module; wherein the composite receiving port is used to identify the health care scene type of the monitored elderly and determine the associated object according to the health care scene type; receive first multimodal data related to the monitored elderly and second multimodal data related to the associated object; wherein the first multimodal data and the second multimodal data both include at least video data, sensor data of a wearable device, and audio data; the analysis and processing module is used to obtain first health care demand information based on the first multimodal data analysis; and, obtain second health care demand information related to the first health care demand information based on the second multimodal data analysis; determine a number of matching health care support items based on the first health care demand information and the second health care demand information, and send each of the health care support items to the health care support module; the health care support module is used to send each of the health care support items to a health care executive after receiving each of the health care support items, and the health care executive provides health care support for the monitored elderly and the associated object on site.

2. The elderly health care support system based on multimodal data fusion analysis according to claim 1 is characterized by: Identify the health care scene type of the monitored elderly, and determine the associated objects according to the health care scene type, including: identify the health care scene type of the monitored elderly, the health care scene type includes a nursing home scene and a home scene; if the health care scene type is the nursing home scene, obtain the elderly in the corresponding nursing home who have a close relationship with the monitored elderly and whose physical health conditions meet the preset conditions, and use them as the associated objects; if the health care scene type is the home scene, all persons in the home scene whose physical health conditions meet the preset conditions are used as the associated objects; wherein the physical health condition meeting the preset conditions means that the probability of occurrence of several specified disease types is higher than the preset probability.

3. The elderly health care support system based on multimodal data fusion analysis according to claim 2 is characterized by: Obtain elderly people in the corresponding nursing home who have a close relationship with the monitored elderly person and whose physical health conditions meet preset conditions, and use them as the associated objects, including: obtaining multiple groups of surveillance videos in the corresponding nursing home, extracting multiple elderly people who have companionship behavior with the monitored elderly person based on each of the surveillance videos, counting the number of companionship behaviors of each elderly person, and determining several elderly people with the highest number of companionship behaviors as candidate elderly people; obtaining medical record information of each of the candidate elderly people, and evaluating the incidence probability of several of the specified disease types of the candidate elderly people based on the medical record information, if any of the incidence probabilities is higher than the preset probability, the candidate elderly people are determined as target elderly people, and each target elderly person is used as the associated object.

4. The elderly health care support system based on multimodal data fusion analysis according to claim 3 is characterized by: The first health care demand information is obtained according to the analysis of the first multimodal data, including: obtaining third health care demand information according to the analysis of each single modal data in the first multimodal data, and fusing each of the third health care demand information to obtain the first health care demand information.

5. The elderly health care support system based on multimodal data fusion analysis according to claim 4 is characterized by: The third health care demand information is integrated and processed to obtain the first health care demand information, including: determining the weighted weights corresponding to the single modal data, and integrating the third health care demand information according to the weighted weights to obtain the first health care demand information.

6. The elderly health care support system based on multimodal data fusion analysis according to claim 5 is characterized by: The second health care needs information related to the first health care needs information is obtained according to the analysis of the second multimodal data, including: obtaining the initial emotional stability of the associated object according to the analysis of each single modal data in the second multimodal data, and determining an adjustment value according to the number of pathogenic events experienced by the associated object, and using the adjustment value to adjust the initial emotional stability to the target emotional stability; analyzing the severity level of consequences of the first health care needs information, inputting the severity level of consequences, the target emotional stability, and the medical record information of the associated object into an association analysis model, and the association analysis model outputting the second health care needs information related to the first health care needs information.

7. The elderly health care support system based on multimodal data fusion analysis according to claim 6 is characterized by: Sending each of the health care support projects to the health care executive personnel includes: retrieving the disposal plan corresponding to each of the health care support projects, and sending each of the disposal plans to the health care executive personnel.

8. An electronic device, characterized in that: An elderly health care support system based on multimodal data fusion analysis applied to any one of claims 1-7; comprising: at least one processor, a memory, and a computer program stored in the memory and executable on the at least one processor.

9. A computer storage medium, characterized in that: Applied to the elderly health care support system based on multimodal data fusion analysis as described in any one of claims 1 to 7; the computer-readable storage medium stores a computer program.

10. A computer program product, characterized in that: Applied to the elderly health care support system based on multimodal data fusion analysis as described in any one of claims 1 to 7; the computer program product contains computer code, and the computer code can be executed by a processor of an electronic device.

Citation Information

Patent Citations

  • Emotion monitoring method for patient by combining multiple features

    CN109394247A

  • Intelligent monitoring system for nursing type nursing home based on cloud platform

    CN110327051A

  • Five-in-one comprehensive medical care system based on medical and industrial integration technology

    CN113555136A

  • Elderly evaluation nursing system and method based on Internet of Things

    CN119092130A

  • Social worker service method and system based on long-term diseases

    CN119314630A