Traditional Chinese medicine intelligent diagnosis intervention system, method and electronic device

Abstract

This application relates to the interdisciplinary field of artificial intelligence and medical technology, and provides a TCM intelligent diagnostic intervention system, method, and electronic device. The TCM intelligent diagnostic intervention system includes a data acquisition module, a decision-making module, and an intervention module. The data acquisition module collects the user's first multimodal data. The decision-making module diagnoses the user based on the first multimodal data, obtains a diagnostic result, determines a physical intervention strategy based on the diagnostic result, and determines an intervention area matching the user based on the physical intervention strategy. The intervention area refers to the location on the user where the physical intervention strategy will be applied, and the physical intervention strategy indicates the use of physical factors to intervene in the user. The intervention module performs physical intervention on the user within the intervention area based on the physical intervention strategy. The TCM intelligent diagnostic intervention system provided by this application can achieve personalized matching of intervention strategies, achieve ideal intervention effects, and meet the differentiated health and wellness needs of different patients.

Description

Technical Field

[0001] This application relates to the field of interdisciplinary technology of artificial intelligence and medical technology, and in particular to a traditional Chinese medicine intelligent diagnostic intervention system, method and electronic device. Background Technology

[0002] Traditional Chinese medicine (TCM) diagnosis and treatment, as a core component of my country's traditional medicine, possesses a unique theoretical system and application value in the fields of disease prevention, diagnosis, treatment, and health maintenance. With the integration of information technology and medical technology, various TCM-assisted diagnostic and treatment systems and health maintenance equipment have emerged, but existing technological solutions still have significant limitations.

[0003] On the one hand, most existing TCM-assisted diagnostic and treatment systems can only process single-modality diagnostic and treatment data. This limitation in data processing dimensions restricts the comprehensiveness of diagnostic and treatment information, thus hindering the improvement of diagnostic accuracy. On the other hand, existing TCM physical therapy and rehabilitation equipment generally adopt standardized and homogenized intervention programs, failing to achieve personalized matching of intervention programs, making it difficult to achieve ideal intervention effects, and also failing to meet the differentiated rehabilitation and rehabilitation needs of different patients. Summary of the Invention

[0004] This application provides a TCM intelligent diagnostic intervention system, method, and electronic device to address the shortcomings of existing technologies, such as low accuracy of diagnostic results and inability to achieve personalized matching of intervention plans.

[0005] This application provides a TCM intelligent diagnosis and intervention system, which includes a data acquisition module, a decision-making module, and an intervention module.

[0006] The data acquisition module collects the user's primary multimodal data, which characterizes the user's health status. The decision-making module diagnoses the user based on the primary multimodal data, obtains diagnostic results, determines physical intervention strategies based on the diagnostic results, and identifies intervention areas matching the user based on the physical intervention strategies. The intervention area refers to the location where the physical intervention strategy applies to the user, and the physical intervention strategy indicates the use of physical factors to intervene in the user's health. The intervention module then performs physical interventions on the user within the intervention areas based on the physical intervention strategies.

[0007] According to the TCM intelligent diagnostic and intervention system provided in this application, the TCM intelligent diagnostic and intervention system also includes a control module.

[0008] The data acquisition module is also used to collect the user's second multimodal data, which is used to characterize the intervention effect of the physical intervention strategy.

[0009] The control module is used to adjust the physical intervention strategy based on the second multimodal data, so that the intervention module can perform physical intervention on the user based on the adjusted physical intervention strategy. The intervention effect of the adjusted physical intervention strategy is better than that of the original physical intervention strategy.

[0010] According to the intelligent diagnostic and intervention system for traditional Chinese medicine provided in this application, the data acquisition module is specifically used for: The user's second multimodal data is collected during the physical intervention; or, the user's second multimodal data is collected after the physical intervention is completed.

[0011] According to the TCM intelligent diagnosis and intervention system provided in this application, the decision module integrates TCM professional knowledge and historical experience data. The historical experience data refers to data accumulated based on past TCM clinical practice. The decision module is specifically used to: diagnose the user based on the first multimodal data, TCM professional knowledge and historical experience data, obtain the diagnosis results, and determine the physical intervention strategy based on the diagnosis results.

[0012] According to the TCM intelligent diagnosis and intervention system provided in this application, a multimodal model is deployed in the decision module. The multimodal model is trained based on TCM professional knowledge and historical experience data. The decision module is specifically used to: input the first multimodal data into the multimodal model to obtain the diagnosis results and physical intervention strategies.

[0013] According to the TCM intelligent diagnostic and intervention system provided in this application, the decision-making module is specifically used to determine physical intervention strategies based on diagnostic results and individual differences of the user. Individual differences include the user's personal information, physical characteristics, disease stage, and environmental influencing factors.

[0014] According to the TCM intelligent diagnostic intervention system provided in this application, the physical intervention strategy is used to instruct the user to undergo at least one physical intervention selected from electricity, force, light, magnetism, or heat. Different physical interventions may correspond to the same intervention area, or different physical interventions may correspond to different intervention areas.

[0015] According to the TCM intelligent diagnostic intervention system provided in this application, the first multimodal data includes multiple modalities of data such as text, image, video, audio, or sensor data, where sensor data refers to data collected by sensors.

[0016] This application also provides a traditional Chinese medicine intelligent diagnostic and intervention method for use in electronic devices, the method comprising: First, acquire the user's first multimodal data, which characterizes the user's health level. Based on this first multimodal data, diagnose the user and obtain diagnostic results. Based on the diagnostic results, determine a physical intervention strategy, which indicates the use of physical factors to intervene in the user's health. Based on the physical intervention strategy, determine the intervention area matching the user; the intervention area refers to the location on the user where the physical intervention strategy will be applied.

[0017] This application also provides a traditional Chinese medicine intelligent diagnostic and intervention device, including the following modules: The acquisition module is used to acquire the user's first multimodal data, which is used to characterize the user's health status.

[0018] The diagnostic module is used to diagnose the user based on the first multimodal data and obtain the diagnostic results.

[0019] The determination module is used to determine physical intervention strategies based on diagnostic results. These physical intervention strategies are used to indicate the use of physical factors to intervene in the user.

[0020] The determination module is used to determine the intervention area that matches the user based on the physical intervention strategy. The intervention area refers to the location on the user where the physical intervention strategy is applied.

[0021] This application also provides an electronic device, including a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor executes the computer program to implement the TCM intelligent diagnostic intervention method as described above.

[0022] This application also provides a non-transitory computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, implements the TCM intelligent diagnostic intervention method as described above.

[0023] This application also provides a computer program product, including a computer program that, when executed by a processor, implements the TCM intelligent diagnostic intervention method as described above.

[0024] The aforementioned technical solution can diagnose users based on their multimodal data (such as primary multimodal data) and, based on the diagnostic results, effectively ensure the comprehensiveness of diagnostic information by leveraging the diversity of data processing dimensions, thereby significantly improving the accuracy of diagnostic results. Furthermore, this solution can determine personalized physical intervention strategies and intervention areas tailored to each user based on the diagnostic results. This allows for a more precise match between physical intervention strategies and the user, achieving personalized matching of physical intervention strategies, reaching ideal intervention effects, and meeting the differentiated rehabilitation needs of different patients. Attached Figure Description

[0025] To more clearly illustrate the technical solutions in this application or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0026] Figure 1 This is a schematic diagram of a traditional Chinese medicine intelligent diagnostic and intervention system provided in this application.

[0027] Figure 2 This is a flowchart illustrating a TCM intelligent diagnostic and intervention method provided in this application.

[0028] Figure 3 This is a schematic diagram of the structure of a traditional Chinese medicine intelligent diagnostic and intervention device provided in this application.

[0029] Figure 4 This is a schematic diagram of the structure of an electronic device provided in this application. Detailed Implementation

[0030] To make the objectives, technical solutions, and advantages of this application clearer, the technical solutions of this application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of this application, not all embodiments. Based on the embodiments of this application, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of this application.

[0031] In the description of this application, it should be understood that the terms "center," "lateral," "length," "width," "thickness," "upper," "lower," "front," "rear," "left," "right," "vertical," "horizontal," "top," "bottom," "inner," and "outer," etc., indicating orientation or positional relationships based on the orientation or positional relationships shown in the accompanying drawings, are used only for the convenience of describing this application and simplifying the description, and do not indicate or imply that the device or element referred to must have a specific orientation, or be constructed and operated in a specific orientation, and therefore should not be construed as a limitation of this application. Furthermore, the terms "first," "second," and "third" are used for descriptive purposes only and should not be construed as indicating or implying relative importance or implicitly specifying the number of indicated technical features. Thus, a feature defined with "first," "second," or "third" may explicitly or implicitly include one or more of the stated features. In the description of this application, "a plurality of" means two or more, unless otherwise explicitly specified.

[0032] Traditional Chinese medicine (TCM) diagnosis and treatment, as a core component of my country's traditional medicine, possesses a unique theoretical system and application value in the fields of disease prevention, diagnosis, treatment, and health maintenance. With the integration of information technology and medical technology, various TCM-assisted diagnostic and treatment systems and health maintenance equipment have emerged, but existing technological solutions still have significant limitations.

[0033] On the one hand, most existing TCM-assisted diagnostic systems can only process single-modality diagnostic data, such as text-based symptom descriptions and medical history records, and cannot effectively integrate multi-source heterogeneous data such as images, videos, and physiological signals. The limited scope of data processing restricts the comprehensiveness of diagnostic information, thus making it difficult to improve the accuracy of diagnostic results.

[0034] On the other hand, existing TCM physical therapy and health care equipment, such as moxibustion robots and health massage robots, generally adopt standardized and homogeneous intervention programs. They do not fully consider the individual differences of different patients in terms of physical characteristics, disease stage, and living environment. They cannot achieve personalized matching and dynamic adjustment of intervention programs, making it difficult to achieve ideal intervention effects and meet the differentiated health care needs of different patients.

[0035] To address the aforementioned technical issues, this application provides a Traditional Chinese Medicine (TCM) intelligent diagnostic and intervention system. This system includes a data acquisition module, a decision-making module, and an intervention module. The data acquisition module collects first multimodal data from the user, which characterizes the user's health status. The decision-making module diagnoses the user based on the first multimodal data, obtains a diagnostic result, determines a physical intervention strategy based on the diagnostic result, and identifies an intervention area matching the user based on the physical intervention strategy. The intervention area refers to the location on the user where the physical intervention strategy applies, and the physical intervention strategy indicates the use of physical factors to intervene in the user's health. The intervention module performs physical intervention on the user within the intervention area based on the physical intervention strategy.

[0036] The aforementioned technical solution can diagnose users based on their multimodal data (such as primary multimodal data) and, based on the diagnostic results, effectively ensure the comprehensiveness of diagnostic information by leveraging the diversity of data processing dimensions, thereby significantly improving the accuracy of diagnostic results. Furthermore, this solution can determine personalized physical intervention strategies and intervention areas tailored to each user based on the diagnostic results. This allows for a more precise match between physical intervention strategies and the user, achieving personalized matching of physical intervention strategies, reaching ideal intervention effects, and meeting the differentiated rehabilitation needs of different patients.

[0037] The following is combined with Figures 1-4 This application provides a detailed description of the TCM intelligent diagnostic intervention method and TCM intelligent diagnostic intervention system provided in the embodiments.

[0038] Figure 1 This is a schematic diagram of the system architecture of a TCM intelligent diagnostic and intervention system provided in this application, with reference to... Figure 1 As shown, the TCM intelligent diagnosis and intervention system may include a data acquisition module (also known as the medical eye module) 101, a decision module 102 (also known as the intelligent decision layer or medical brain module) and an intervention module 103 (also known as the decision execution layer or medical hand module).

[0039] The data acquisition module 101 is used to collect multimodal data (hereinafter referred to as first multimodal data) that characterizes the health status of a user (such as a patient). The data acquisition module 101 can send the collected first multimodal data to the decision module 102.

[0040] The decision module 102 can diagnose the user based on the first multimodal data and provide a corresponding physical intervention strategy based on the diagnostic results. The decision module 102 can also determine the intervention area matching the user based on the physical intervention strategy. The physical intervention strategy is used to indicate the use of physical factors to intervene in the user, and the intervention area refers to the location where the physical intervention strategy applies to the user.

[0041] The decision module 102 can send the physical intervention strategy and the intervention area to the intervention module 103. The intervention module 103 can use the physical factors indicated in the physical intervention strategy to perform physical intervention on the user in the intervention area.

[0042] In one example, see further. Figure 1 As shown, the TCM intelligent diagnostic intervention system may also include a control module 104 (also known as a feedback control layer). During or after physical intervention, the data acquisition module 101 can collect the user's multimodal data (hereinafter referred to as second multimodal data), which is used to characterize the intervention effect of the physical intervention strategy. Accordingly, the control module 104 can dynamically adjust the physical intervention strategy based on the second multimodal data, so that the intervention module can perform physical intervention on the user based on the adjusted physical intervention strategy, and the intervention effect of the adjusted physical intervention strategy is better than that of the original physical intervention strategy.

[0043] Figure 2 This is a flowchart illustrating the TCM intelligent diagnostic intervention method provided in this application. The method consists of... Figure 1 The data acquisition module, decision-making module, and intervention module interact as shown. (Refer to...) Figure 2 As shown, the method includes the following steps S201-S203.

[0044] S201, the data acquisition module collects the user's first multimodal data.

[0045] The first multimodal data is used to characterize a user's health status. In one example, the first multimodal data may include data from multiple modalities such as text, images, video, audio, or sensor data, where sensor data refers to data collected by sensors. Text modal data may include, but is not limited to, patient consultation data (covering patient complaints, medical history descriptions, symptom feedback, etc.). Audio modal data may include, but is not limited to, physiological sound data such as the patient's breath sounds and heart sounds that can be collected through audio devices. Sensor data may include, but is not limited to, physiological parameter data such as heart rate, heart rate variability, body temperature, and blood pressure collected through various physiological sensors.

[0046] When the first multimodal data includes sensor data, the data acquisition module may contain multiple sensor modules, each used to acquire different types of health examination data. For example, at least two of the following may be included: a speech recognition module for acquiring voice data; a vision module for acquiring image or video data; a thermal infrared sensor for acquiring user body surface temperature data; a multi-point photoplethysmography (PPG) module for acquiring heart rate, heart rate variability (HRV), and blood pressure data; an intelligent body sound chip module for acquiring user breath sounds and heart sounds; and an electromyography (EMG) sensor module for acquiring EMG signal data. This application does not specifically limit the sensor modules included in the data acquisition module.

[0047] Specifically, when users (such as medical staff or patients' family members) intend to diagnose a patient, they can obtain the patient's first multimodal data through multiple sensor modules in the data acquisition module.

[0048] S202, the decision-making module diagnoses the user based on the first multimodal data, obtains the diagnosis results, determines the physical intervention strategy based on the diagnosis results, and determines the intervention area that matches the user based on the physical intervention strategy.

[0049] Physical intervention strategies are used to instruct the use of physical factors to physically intervene in users. Physical factors may include, but are not limited to, at least one of the following: electricity, force, light, magnetism, sound, heat, etc.

[0050] Intervention area refers to the location on the user where a physical intervention strategy is applied. For example, intervention area can be a specific acupoint in traditional Chinese medicine that corresponds to the diagnosis (such as the temple, Zusanli, Yongquan, etc.), or it can be a key area related to human symptoms determined based on first-modal data (such as the area of ​​muscle strain and pain in the head and neck, the area of ​​fascial tension in the lower back, etc.).

[0051] The data acquisition module and the decision-making module are connected. After acquiring the first multimodal data, the data acquisition module can send the first multimodal data to the decision-making module. Upon receiving the first multimodal data, the decision-making module can diagnose the user based on the first multimodal data and obtain a diagnostic result. Subsequently, based on the diagnostic result, the decision-making module can determine a physical intervention strategy matching the user, and based on the physical intervention strategy, determine the intervention area matching the user.

[0052] To ensure the accuracy of the diagnostic results determined by the decision-making module, in one example, the decision-making module can integrate TCM professional knowledge and historical experience data. Based on this, the decision-making module diagnoses the user based on the first multimodal data, obtains the diagnostic results, and determines the physical intervention strategy based on the diagnostic results. Specifically, this can be implemented as follows: diagnose the user based on the first multimodal data, TCM professional knowledge, and historical experience data, obtain the diagnostic results, and determine the physical intervention strategy based on the diagnostic results.

[0053] Traditional Chinese medicine (TCM) professional knowledge can include structured knowledge such as disease guidelines, medical guidelines, diagnosis and treatment standards, expert consensus, and professional books and literature.

[0054] Historical experience data refers to data accumulated based on past clinical practice in traditional Chinese medicine. Historical experience data can include unstructured data such as the clinical experience of medical experts and case data.

[0055] To effectively accelerate the determination of diagnostic results, in one example, a multimodal model can be deployed in the decision-making module. This multimodal model can be trained based on TCM professional knowledge and historical experience data. Accordingly, the decision-making module diagnoses the user based on the first multimodal data, obtains the diagnostic result, and determines the physical intervention strategy based on the diagnostic result. Specifically, this can be implemented by inputting the first multimodal data into the multimodal model to obtain the diagnostic result and the physical intervention strategy.

[0056] Specifically, the decision-making module can input the first multimodal data into the multimodal model, which can determine and output the corresponding diagnostic results and corresponding physical intervention plans based on TCM professional knowledge and historical experience data.

[0057] In one example, after receiving the diagnosis, the decision-making module can determine a physical intervention strategy based on the diagnosis and the user's individual differences.

[0058] This application does not specifically limit individual differences. For example, individual differences may include a user's (e.g., a patient's) personal information, physical characteristics, disease stage, and environmental influencing factors. Personal information may include the patient's age, gender, weight, height, underlying conditions (such as rheumatism, spleen and stomach weakness, etc.), allergy history, etc. Physical characteristics may include different constitutions such as Qi deficiency, Yang deficiency, or phlegm-dampness, which may be related to the intensity and duration of physical interventions. Disease stages include different phases such as the acute phase, remission phase, or recovery phase. During the acute phase, the focus should be on symptom relief; during the remission phase, the focus should be on conditioning and consolidation; and during the recovery phase, the focus should be on preventing recurrence. The intensity and frequency of physical interventions differ at different stages. Environmental influencing factors may include dry or humid environments. Environmental influencing factors may be related to the type of physical intervention; for example, in a dry environment, gentle, moisturizing physical interventions may be appropriately increased, while in a humid environment, dampness-removing physical interventions may be appropriately increased.

[0059] This application does not specifically limit the method for determining individual differences among users. In one example, the decision-making module can determine individual differences among users based on their personal information, first multimodal data collected by the data acquisition module, TCM professional knowledge, and / or historical experience data.

[0060] In one example, after identifying individual differences among users, the decision-making module can filter physical intervention strategies that match the diagnostic results. These strategies indicate the use of physical factors such as electricity, force, light, sound, magnetism, and heat to intervene with the user. The decision-making module can then determine the target physical intervention strategy that best suits the user from among the strategies matching the diagnostic results, taking into account the individual differences. For example, for users with a cold constitution, a warming physical intervention strategy using physical factors such as heat or infrared light is preferred. For users with sensitive skin or allergies, a non-contact physical intervention strategy is preferred. For users in the recovery phase, a gentle conditioning physical intervention strategy is chosen to avoid the burden of high-intensity physical interventions on the user's body.

[0061] In one example, the physical intervention strategy may include intervention parameters, and the decision-making module can adjust these parameters based on individual user differences. For instance, if the physical intervention strategy includes infrared light stimulation, the decision-making module can adjust the infrared light wavelength, light intensity, light duration, or light frequency based on the user's physical condition. As another example, if the physical intervention strategy includes electrical stimulation, the decision-making module can adjust the electrical stimulation voltage, current intensity, pulse frequency, or pulse waveform based on the muscle tension level indicated by the user's electromyographic signals.

[0062] In one example, taking a user's diagnosis of chronic tension headache as an example, the physical intervention strategy matched to the user may include: (1) Transcutaneous electrical nerve stimulation therapy: small electrode pads are attached to the temples and back neck muscles on the side of the headache, and a low-frequency current (usually 2-10Hz) is set, each treatment lasts for 30 minutes, twice a day. (2) Low-energy phototherapy: a near-infrared laser (wavelength 630-980nm) is used to irradiate the painful area of ​​the head and neck, each area is irradiated for 5 minutes, the total duration does not exceed 20 minutes, twice a day.

[0063] This application does not specifically limit the method for determining the intervention area in its embodiments. In one example, the decision module can extract the user's human morphological feature information from the first multimodal data collected by the data acquisition module, and based on the target location matching the physical intervention strategy (such as acupoints like the temples or Zusanli, or disease-related areas like the head and neck pain area), combine the human morphological feature information for spatial positioning calibration to determine the intervention area on the user.

[0064] Human morphological feature information may include the user's body outline, limb posture, and surface feature points. In one example, human morphological feature information can be determined from image or video data containing the user collected by the visual module in the first multimodal data.

[0065] In one example, after the intervention area is determined, the decision-making module can use a labeling device to visually label the intervention area on the user's body surface, so that the operator can intuitively and accurately locate the intervention area, improving the convenience and accuracy of physical intervention operations.

[0066] The labeling device can be a thermal infrared sensor, a laser positioning module, or a light-emitting diode (LED) dot matrix indicator module, etc., and this application embodiment does not specifically limit it.

[0067] To effectively accelerate the determination of physical intervention strategies and intervention areas, in one example, a multimodal model can be deployed in the decision-making module. After the decision-making module determines the user's individual differences and diagnostic results, it can input the diagnostic results and the user's individual differences into the multimodal model to obtain a physical intervention strategy and intervention area that matches the user.

[0068] S203, the intervention module is based on physical intervention strategies and performs physical interventions on users in the intervention area.

[0069] The intervention module's functionality can be implemented using different intervention devices; that is, the intervention module can perform physical interventions on users through various devices. Specifically, after the decision-making module determines the physical intervention strategy and intervention area, it can send these to the intervention module. The intervention module can then generate intervention instructions for different intervention devices based on the physical intervention strategy and intervention area. The intervention module can then send these intervention instructions to the corresponding intervention devices. Upon receiving the intervention instructions, the intervention devices can parse them to obtain the physical intervention strategy and intervention area to be executed. Subsequently, the intervention devices can perform physical interventions on the user within the intervention area based on the physical intervention strategy.

[0070] In one example, a physical intervention strategy can be used to instruct the user to undergo at least one physical intervention, namely electrical, force, light, sound, magnetic, or thermal. It is understood that different physical interventions may correspond to the same intervention area, or different physical interventions may correspond to different intervention areas. Furthermore, the same physical intervention may act on one intervention area or multiple intervention areas.

[0071] In one example, the physical intervention strategy includes a first strategy and a second strategy. The first strategy instructs the user to receive electrical stimulation in a first area, and the second strategy instructs the user to receive near-infrared light stimulation in a second area. The intervention device includes a first device and a second device, with the first device used for electrical stimulation and the second device used for near-infrared light stimulation. The intervention module can, based on the first strategy, perform electrical stimulation on the user in the first area using the first device. And / or, the intervention module can, based on the second strategy, perform near-infrared light stimulation on the user in the second area using the second device.

[0072] Specifically, taking a physical intervention strategy comprising a first strategy and a second strategy as an example: After receiving the physical intervention strategy, the intervention module can generate a first intervention command based on the first strategy and a first region, and a second intervention command based on the second strategy and the second region. The intervention module can send the first intervention command to a first device and the second intervention command to a second device. After receiving the first intervention command, the first device can perform electrical stimulation on the user in the first region. After receiving the second intervention command, the second device can perform near-infrared light stimulation on the user in the second region.

[0073] For example, taking a first region including the temples and back neck muscles, and a second region including the head and neck pain area, after receiving a first intervention command, the first device can perform electrical stimulation on the user's temples and back neck muscles. After receiving a second intervention command, the second device can perform near-infrared light stimulation on the user's head and neck pain area.

[0074] The aforementioned technical solution can diagnose users based on their multimodal data (such as primary multimodal data) and, based on the diagnostic results, effectively ensure the comprehensiveness of diagnostic information by leveraging the diversity of data processing dimensions, thereby significantly improving the accuracy of diagnostic results. Furthermore, this solution can determine personalized physical intervention strategies and intervention areas tailored to each user based on the diagnostic results. This allows for a more precise match between physical intervention strategies and the user, achieving personalized matching of physical intervention strategies, reaching ideal intervention effects, and meeting the differentiated rehabilitation needs of different patients.

[0075] In one example, the data acquisition module can also collect multimodal data (hereinafter referred to as second multimodal data) from the user to characterize the intervention effect of the physical intervention strategy. The data acquisition module can send the second multimodal data to the control module, which can adjust the physical intervention strategy based on the second multimodal data, so that the intervention module can continuously intervene in the user based on the adjusted physical intervention strategy, and the intervention effect of the adjusted physical intervention strategy is better than that of the original physical intervention strategy.

[0076] The second multimodal data may include multiple data such as heart rate, HRV, temperature, blood pressure, breath sounds, heart sounds, images (such as images containing the user's pain expression) or voice (such as too much electrical stimulation, causing numbness). This application embodiment does not specifically limit the second multimodal data.

[0077] Specifically, after receiving the second multimodal data, the control module can determine the intervention effect based on the second multimodal data. If it is determined that the current intervention effect is not good, the control module can adjust the current physical intervention strategy so that the intervention effect of the adjusted physical intervention strategy is better than that of the original physical intervention strategy.

[0078] For example, using physical intervention strategies such as electrical stimulation and near-infrared light stimulation, assuming that the second multimodal data indicates that the user's HRV gradually decreases and blood pressure gradually increases, the control module can determine that the current intervention effect is inadequate. The control module can adjust the current physical intervention strategy, such as reducing the frequency of electrical stimulation or modifying the wavelength of near-infrared light, to increase the user's HRV and normalize blood pressure.

[0079] This application does not specifically limit the timing of the data acquisition module collecting the second multimodal data. In one example, the data acquisition module can collect the user's second multimodal data during the physical intervention process. In another example, the data acquisition module can collect the user's second multimodal data after the physical intervention is completed.

[0080] In one example, the multimodal model needs to be trained before it can be used. Specifically, two types of core knowledge data can be integrated to build a multi-dimensional training knowledge base. One type is structured knowledge of Traditional Chinese Medicine (TCM), including disease guidelines, medical guidelines, treatment guidelines, expert consensus, and professional books and literature. The other type is unstructured historical experience data, including clinical experience and case data of medical experts. This historical experience data can include multimodal data representing the user's health status, diagnostic results, physical intervention strategies, and efficacy feedback. Then, the TCM knowledge and historical experience data can be input into a multimodal model that supports parallel input of multimodal data such as text, images, videos, and audio. Through supervised learning and reinforcement learning, the multimodal model learns the logical relationships between multimodal data representing the user's health status, diagnostic results, and physical intervention strategies. Finally, through iterative training and parameter optimization, the multimodal model constructs a mapping relationship of "multimodal data - diagnosis - physical intervention strategy," forming a multimodal model that can output diagnostic results and physical intervention strategies.

[0081] Taking the multimodal model as an example of determining the diagnosis of tension headache and the corresponding physical intervention plan, the aforementioned TCM professional knowledge can include structured knowledge such as disease guidelines, medical guidelines, diagnosis and treatment standards, expert consensus, and professional books and literature related to tension headache. The aforementioned historical experience data can include case data of multiple cases (such as 1,000 cases) of tension headache. In this way, the multimodal model learns the correlation logic between the user's multimodal data, the diagnosis and classification results of tension headache, and the physical intervention strategy for tension headache, and then constructs a multimodal model that can realize intelligent diagnosis of tension headache.

[0082] It is understandable that after constructing a multimodal model that can judge diagnostic results and physical intervention strategies, the multimodal model can be further optimized based on updates to TCM professional knowledge, additions to historical experience data, or various parameters during the intervention process for users.

[0083] As can be seen from the above technical solutions, this solution can significantly improve the overall effectiveness of diagnosis and physical intervention from the following three dimensions by constructing a multimodal model that integrates multi-source medical knowledge and combining it with multimodal data processing technology.

[0084] At the level of diagnostic expertise, the solution relies on a multimodal model that integrates structured knowledge such as disease guidelines, medical guidelines, treatment guidelines, expert consensus, and professional books and literature, as well as unstructured data such as the clinical experience and case data of medical experts to carry out intelligent diagnostic decision-making. This replaces the high dependence on the personal experience of physicians in the traditional model, effectively reduces subjective bias in the diagnostic process, and makes the output diagnostic conclusions and intervention plans more in line with clinical standards, with stronger authority and consistency.

[0085] At the level of personalized intervention, the solution is based on multimodal data such as images, videos, and physiological signals acquired by the data acquisition module. Combined with individual differences such as the user's physical characteristics, disease stage, and environmental influencing factors, it generates personalized physical intervention strategies that are suitable for different patients. This breaks the limitations of the homogeneous intervention of existing physical therapy equipment, accurately meets the differentiated diagnostic needs of different patients, and greatly improves the adaptability and accuracy of the intervention process.

[0086] At the dynamic control level, the solution can receive multimodal data in real time to characterize the intervention effect during the implementation of physical intervention, and dynamically adjust the physical intervention strategy accordingly, forming a complete diagnostic closed loop of data collection, intelligent diagnosis, personalized intervention, real-time feedback and physical intervention strategy optimization, so as to achieve continuous optimization of the intervention effect, further enhance the accuracy of the intervention, and ensure that the final intervention effect reaches the expected standard.

[0087] The TCM intelligent diagnostic intervention device provided in this application is described below. The TCM intelligent diagnostic intervention device described below can be referred to in correspondence with the TCM intelligent diagnostic intervention method described above.

[0088] Figure 3 This example illustrates the structure of a TCM intelligent diagnostic intervention device, located within an electronic device. The device may include: The acquisition module 301 is used to acquire the user's first multimodal data, which is used to characterize the user's health status.

[0089] The diagnostic module 302 is used to diagnose the user based on the first multimodal data and obtain the diagnostic results.

[0090] The determination module 303 is used to determine a physical intervention strategy based on the diagnostic results. The physical intervention strategy is used to indicate the use of physical factors to intervene in the user.

[0091] The determination module 303 is used to determine the intervention area that matches the user based on the physical intervention strategy. The intervention area refers to the location where the physical intervention strategy is applied to the user.

[0092] It can be understood that the acquisition module 301, diagnosis module 302 and determination module 303 mentioned above can be sub-modules or sub-units deployed in the decision module of the above-mentioned TCM diagnosis and intervention system.

[0093] Figure 4 An example is a schematic diagram of the physical structure of an electronic device, such as... Figure 4As shown, the electronic device may include: a processor 410, a communication interface 420, a memory 430, and a communication bus 440, wherein the processor 410, the communication interface 420, and the memory 430 communicate with each other through the communication bus 440. The processor 410 can call logical instructions in the memory 430 to execute a traditional Chinese medicine intelligent diagnostic intervention method, which includes: First, acquire the user's first multimodal data, which characterizes the user's health level. Based on this first multimodal data, diagnose the user and obtain diagnostic results. Based on the diagnostic results, determine a physical intervention strategy, which indicates the use of physical factors to intervene in the user's health. Based on the physical intervention strategy, determine the intervention area matching the user; the intervention area refers to the location on the user where the physical intervention strategy will be applied.

[0094] Furthermore, the logical instructions in the aforementioned memory 430 can be implemented as software functional units and, when sold or used as independent products, can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of this application, in essence, or the part that contributes to the prior art, or a part of the technical solution, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute all or part of the steps of the methods described in the various embodiments of this application. The aforementioned storage medium includes various media capable of storing program code, such as USB flash drives, portable hard drives, read-only memory (ROM), random access memory (RAM), magnetic disks, or optical disks.

[0095] On the other hand, this application also provides a computer program product, which includes a computer program that can be stored on a non-transitory computer-readable storage medium. When the computer program is executed by a processor, the computer is able to execute the TCM intelligent diagnostic intervention method provided by the above methods, the method including: First, acquire the user's first multimodal data, which characterizes the user's health level. Based on this first multimodal data, diagnose the user and obtain diagnostic results. Based on the diagnostic results, determine a physical intervention strategy, which indicates the use of physical factors to intervene in the user's health. Based on the physical intervention strategy, determine the intervention area matching the user; the intervention area refers to the location on the user where the physical intervention strategy will be applied.

[0096] Furthermore, this application also provides a non-transitory computer-readable storage medium storing a computer program thereon, which, when executed by a processor, is implemented to perform the TCM intelligent diagnostic intervention method provided by the methods described above, the method comprising: First, acquire the user's first multimodal data, which characterizes the user's health level. Based on this first multimodal data, diagnose the user and obtain diagnostic results. Based on the diagnostic results, determine a physical intervention strategy, which indicates the use of physical factors to intervene in the user's health. Based on the physical intervention strategy, determine the intervention area matching the user; the intervention area refers to the location on the user where the physical intervention strategy will be applied.

[0097] The device embodiments described above are merely illustrative. The units described as separate components may or may not be physically separate. The components shown as units may or may not be physical units; that is, they may be located in one place or distributed across multiple network units. Some or all of the modules can be selected to achieve the purpose of this embodiment according to actual needs. Those skilled in the art can understand and implement this without any creative effort.

[0098] Through the above description of the embodiments, those skilled in the art can clearly understand that each embodiment can be implemented by means of software plus necessary general-purpose hardware platforms, and of course, it can also be implemented by hardware. Based on this understanding, the above technical solutions, in essence or the part that contributes to the prior art, can be embodied in the form of a software product. This computer software product can be stored in a computer-readable storage medium, such as ROM / RAM, magnetic disk, optical disk, etc., and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute the methods described in the various embodiments or some parts of the embodiments.

[0099] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of this application, and are not intended to limit them. Although this application has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some of the technical features. Such modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of the embodiments of this application.

Claims

1. A traditional Chinese medicine intelligent diagnostic and intervention system, characterized in that, The TCM intelligent diagnosis and intervention system includes a data acquisition module, a decision-making module, and an intervention module; The data acquisition module is used to collect the user's first multimodal data, which is used to characterize the user's health level. The decision module is used to diagnose the user based on the first multimodal data, obtain a diagnosis result, determine a physical intervention strategy based on the diagnosis result, and determine an intervention area matching the user based on the physical intervention strategy. The intervention area refers to the location where the physical intervention strategy is applied to the user. The physical intervention strategy is used to indicate the use of physical factors to intervene in the user. The intervention module is used to perform physical intervention on the user in the intervention area based on the physical intervention strategy.

2. The TCM intelligent diagnostic and intervention system according to claim 1, characterized in that, The TCM intelligent diagnostic and intervention system also includes a control module; The data acquisition module is also used to acquire the user's second multimodal data, which is used to characterize the intervention effect of the physical intervention strategy. The control module is used to adjust the physical intervention strategy based on the second multimodal data, so that the intervention module performs physical intervention on the user based on the adjusted physical intervention strategy, and the intervention effect of the adjusted physical intervention strategy is better than the intervention effect of the original physical intervention strategy.

3. The TCM intelligent diagnostic and intervention system according to claim 1 or 2, characterized in that, The data acquisition module is specifically used for: During the physical intervention, the user's second multimodal data is collected; or... After the physical intervention is completed, the user's second multimodal data is collected.

4. The TCM intelligent diagnostic and intervention system according to any one of claims 1-3, characterized in that, The decision-making module integrates TCM professional knowledge and historical experience data. The historical experience data refers to data accumulated based on past TCM clinical practice. The decision-making module is specifically used for: Based on the first multimodal data, the TCM professional knowledge, and the historical experience data, the user is diagnosed to obtain the diagnosis result, and based on the diagnosis result, the physical intervention strategy is determined.

5. The TCM intelligent diagnostic and intervention system according to claim 4, characterized in that, The decision-making module deploys a multimodal model, which is trained based on the TCM expertise and historical experience data. The decision-making module is specifically used for: The first multimodal data is input into the multimodal model to obtain the diagnostic results and the physical intervention strategy.

6. The TCM intelligent diagnostic and intervention system according to any one of claims 1-3, characterized in that, The decision-making module is specifically used for: Based on the diagnostic results and the individual differences of the user, the physical intervention strategy is determined; the individual differences include the user's personal information, physical characteristics, disease stage, and environmental influencing factors.

7. The TCM intelligent diagnostic and intervention system according to any one of claims 1-3, characterized in that, The physical intervention strategy is used to instruct the user to undergo at least one physical intervention, namely electrical, force, light, sound, magnetic or heat. Different physical interventions may correspond to the same intervention area, or different physical interventions may correspond to different intervention areas.

8. The TCM intelligent diagnostic intervention system according to any one of claims 1-3, characterized in that, The first multimodal data includes multiple modalities of data such as text, images, videos, audio, or sensor data, where the sensor data refers to data collected by sensors.

9. A TCM intelligent diagnostic intervention method, characterized in that, Applied to electronic devices, the method includes: Acquire the user's first multimodal data, which is used to characterize the user's health status; Based on the first multimodal data, the user is diagnosed to obtain a diagnosis result; Based on the diagnostic results, a physical intervention strategy is determined, which is used to instruct the user to be intervened using physical factors; Based on the physical intervention strategy, an intervention area matching the user is determined, where the intervention area refers to the location on the user where the physical intervention strategy is applied.

10. An electronic device comprising a memory, a processor, and a computer program stored in the memory and running on the processor, characterized in that, When the processor executes the computer program, it implements the TCM intelligent diagnostic intervention method as described in claim 9.

Images