Traditional Chinese medicine health preserving system based on multi-mode large model

Abstract

The invention discloses a traditional Chinese medicine health preserving system based on a multi-mode large model, and particularly relates to the technical field of traditional Chinese medicine health preserving. Comprising a multi-modal data acquisition and fusion module, a classic theoretical knowledge graph construction module, a large-model intelligent diagnosis and treatment engine module, a syndrome initial judgment module, a pathogenesis deduction module, a scheme generation module and a dynamic health management closed-loop module. The multi-modal data acquisition and fusion module comprises a 3D structured light scanning device and a 128-channel pressure sensor array, the 3D structured light scanning device is used for acquiring the three-dimensional form of a tongue body, and the 128-channel pressure sensor array is used for capturing pulse condition waveforms of cun-guan-chi three parts. By arranging the pathogenesis deduction module, the scheme generation module, the dynamic health management closed-loop module and the like, the intelligent diagnosis and treatment system with traditional Chinese medicine syndrome differentiation thinking is constructed by integrating multi-dimensional sign data of tongue diagnosis, face diagnosis, pulse diagnosis and the like and combining a classic medical registry knowledge graph, and the modernization bottleneck of traditional Chinese medicine is broken through.

Description

Technical Field

[0001] The present invention relates to the field of traditional Chinese medicine health care technology, and more specifically, to a traditional Chinese medicine health care system based on a multimodal large model. Background Art

[0002] Traditional Chinese medicine health preservation refers to a medical activity that, under the guidance of traditional Chinese medicine theory, uses various methods to nourish life, strengthen physical fitness, prevent diseases, and thus achieve longevity. Although existing technologies have achieved partial objectivity through AI tongue diagnosis instruments and pulse diagnosis sensors, they are mostly limited to single-modal data processing and have not achieved deep integration of the four diagnostic information. At the same time, the dialectical logic of classic theories such as "Treatise on Febrile Diseases" and "Yellow Emperor's Internal Classic" has not yet been effectively transformed into a computable intelligent reasoning model, which restricts the large-scale application of traditional Chinese medicine wisdom.

[0003] Therefore, there is an urgent need for a traditional Chinese medicine health and wellness system based on a multimodal large model to solve the above problems. Summary of the Invention

[0004] In order to overcome the above-mentioned defects of the prior art, the embodiments of the present invention provide a traditional Chinese medicine health care system based on a multimodal large model. By providing a pathogenesis deduction module, a solution generation module and a dynamic health management closed-loop module, the present invention integrates multi-dimensional physical sign data such as tongue diagnosis, facial diagnosis, and pulse diagnosis, and combines it with the knowledge graph of classic medical books to construct an intelligent diagnosis and treatment system with traditional Chinese medicine dialectical thinking, breaking through the bottleneck of traditional Chinese medicine modernization to solve the problems raised in the above-mentioned background technology.

[0005] To achieve the above objectives, the present invention provides the following technical solutions: a TCM health and wellness system based on a multimodal large model, comprising a multimodal data acquisition and fusion module, a classical theoretical knowledge graph construction module, a large model intelligent diagnosis and treatment engine module, a syndrome preliminary judgment module, a pathogenesis deduction module, a solution generation module, and a dynamic health management closed-loop module; The multimodal data acquisition and fusion module includes a 3D structured light scanning device and a 128-channel pressure sensor array. The 3D structured light scanning device is used to obtain the three-dimensional shape of the tongue, and the 128-channel pressure sensor array is used to capture the pulse waveforms of the three parts of the inch, guan, and chi. The multimodal data acquisition and fusion module obtains the three-dimensional shape of the tongue and captures the pulse waveforms of the three parts of the inch, guan, and chi. It combines hyperspectral imaging technology to analyze the distribution of qi and blood on the face, and achieves feature alignment of the four diagnostic data through a spatiotemporal attention mechanism to construct a 127-dimensional feature vector including tongue color, tongue coating, and pulse position. The classical theoretical knowledge graph construction module uses the Six Meridians Syndrome Differentiation System as a framework and the Five Movements and Six Qi Theory as a foundation. It constructs a knowledge graph containing 120,000 syndrome-prescription association rules and 80,000 Chinese medicine compatibility taboos, and uses graph neural networks to achieve cross-level reasoning. The large-scale intelligent diagnosis and treatment engine module is based on an intelligent hybrid expert architecture, integrating clinical reasoning data and ancient text training, achieving a syndrome differentiation accuracy rate of 92.3%; The syndrome preliminary judgment module uses convolutional neural network to analyze tongue texture and preliminarily judge cold, heat, deficiency or excess by combining pulse frequency domain characteristics; The pathogenesis deduction module calls the article knowledge base and simulates the thinking process of observing the pulse and symptoms, knowing what is wrong, and treating the symptoms according to the symptoms through the Transformer model; The solution generation module optimizes prescription compatibility based on reinforcement learning, generates personalized solutions including Chinese medicine prescriptions, dietary therapy suggestions, and guiding exercises, and provides a corresponding interpretation path for prescriptions and symptoms; The dynamic health management closed-loop module uses wearable devices to monitor vital signs 24 hours a day, and dynamically adjusts intervention strategies based on comparative analysis of historical data.

[0006] In a preferred embodiment, the resolution of the 3D structured light scanning device is 0.1 mm, and the accuracy of the 128-channel pressure sensor array is 0.01 mmHg.

[0007] In a preferred embodiment, the wearable device is configured as a pulse bracelet.

[0008] Technical effects and advantages of the present invention: The present invention is equipped with a pathogenesis deduction module, a solution generation module and a dynamic health management closed-loop module, etc., so that the present invention can integrate multi-dimensional physical sign data such as tongue diagnosis, facial diagnosis, and pulse diagnosis, and combine it with the knowledge graph of classic medical books to build an intelligent diagnosis and treatment system with Chinese medicine dialectical thinking, breaking through the bottleneck of traditional Chinese medicine modernization. BRIEF DESCRIPTION OF THE DRAWINGS

[0009] Figure 1 It is a schematic diagram of the overall structure of the present invention. DETAILED DESCRIPTION

[0010] The following will clearly and completely describe the technical solutions in the embodiments of the present invention in conjunction with the accompanying drawings. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without making creative efforts are within the scope of protection of the present invention.

[0011] As attached Figure 1 As shown, the present invention provides a TCM health and wellness system based on a multimodal large model, including a multimodal data acquisition and fusion module, a classical theoretical knowledge graph construction module, a large model intelligent diagnosis and treatment engine module, a syndrome preliminary judgment module, a pathogenesis deduction module, a solution generation module and a dynamic health management closed-loop module; The multimodal data acquisition and fusion module includes a 3D structured light scanning device and a 128-channel pressure sensor array. The 3D structured light scanning device is used to obtain the three-dimensional shape of the tongue, and the 128-channel pressure sensor array is used to capture the pulse waveforms of the three parts of the inch, guan, and chi. The multimodal data acquisition and fusion module obtains the three-dimensional shape of the tongue and captures the pulse waveforms of the three parts of the inch, guan, and chi. It combines hyperspectral imaging technology to analyze the distribution of qi and blood on the face, and achieves feature alignment of the four diagnostic data through a spatiotemporal attention mechanism to construct a 127-dimensional feature vector including tongue color, tongue coating, and pulse position. The classical theoretical knowledge graph construction module uses the Six Meridians Syndrome Differentiation System as a framework and the Five Movements and Six Qi Theory as a foundation. It constructs a knowledge graph containing 120,000 syndrome-prescription association rules and 80,000 Chinese medicine compatibility taboos, and uses graph neural networks to achieve cross-level reasoning. The large-scale intelligent diagnosis and treatment engine module is based on an intelligent hybrid expert architecture, integrating clinical reasoning data and ancient text training, achieving a syndrome differentiation accuracy rate of 92.3%; The syndrome preliminary judgment module uses convolutional neural network to analyze tongue texture and preliminarily judge cold, heat, deficiency or excess by combining pulse frequency domain characteristics; The pathogenesis deduction module calls the article knowledge base and simulates the thinking process of observing the pulse and symptoms, knowing what is wrong, and treating the symptoms according to the symptoms through the Transformer model; The solution generation module optimizes prescription compatibility based on reinforcement learning, generates personalized solutions including Chinese medicine prescriptions, dietary therapy suggestions, and guiding exercises, and provides a corresponding interpretation path for prescriptions and symptoms; The dynamic health management closed-loop module uses wearable devices to monitor vital signs 24 hours a day, and dynamically adjusts intervention strategies based on comparative analysis of historical data.

[0012] The resolution of the 3D structured light scanning device is 0.1 mm, and the accuracy of the 128-channel pressure sensor array is 0.01 mmHg.

[0013] The wearable device is configured as a pulse bracelet.

[0014] The specific implementation method is as follows: when using the present invention, the multimodal data acquisition and fusion module obtains the three-dimensional morphology of the tongue, captures the pulse waveforms of the three parts of Cun, Guan and Chi, combines hyperspectral imaging technology to analyze the distribution of qi and blood on the face, realizes the alignment of the four diagnostic data features through the spatiotemporal attention mechanism, and constructs a 127-dimensional feature vector including tongue color, fur, and pulse position. The classical theoretical knowledge graph construction module uses the six-channel syndrome differentiation system of "Treatise on Febrile Diseases" as the framework, and the five-movement and six-qi theory of "Huangdi Neijing" as the basis to construct a knowledge graph including 120,000 syndrome-prescription association rules and 80,000 Chinese medicine compatibility taboos, and adopts graph neural network to realize cross-level reasoning. The large model intelligent diagnosis and treatment engine module is based on the intelligent hybrid expert architecture, which integrates clinical reasoning data and ancient text training to achieve a syndrome differentiation accuracy rate of 92.3%. The syndrome preliminary judgment module analyzes the tongue texture through the convolutional neural network, and preliminarily judges the cold, heat, deficiency and excess based on the pulse frequency domain characteristics. The pathogenesis deduction module calls the knowledge base of "Treatise on Febrile Diseases" and models it through the Transformer model. The system aims to observe the pulse and symptoms, understand what is wrong, and treat the disease accordingly. The solution generation module optimizes the prescription compatibility based on reinforcement learning, generates a personalized solution including Chinese medicine prescriptions, dietary therapy suggestions, and guiding exercises, and provides a corresponding interpretation path for the prescription and symptoms. The dynamic health management closed-loop module uses wearable devices (pulse bracelets) to achieve 24-hour physical sign monitoring, combines historical data comparison and analysis, and dynamically adjusts the intervention strategy. This invention addresses the pain points of the existing technology and proposes a multimodal health and wellness system based on a large model. By integrating multi-dimensional physical sign data such as tongue diagnosis, facial diagnosis, and pulse diagnosis, and combining it with the knowledge graph of classic medical books, it constructs an intelligent diagnosis and treatment system with Chinese medicine dialectical thinking, breaking through the bottleneck of traditional Chinese medicine modernization.

[0015] Working principle of the present invention: Refer to the instruction manual Figure 1 When using the present invention, by providing a pathogenesis deduction module, a solution generation module and a dynamic health management closed-loop module, the present invention integrates multi-dimensional physical sign data such as tongue diagnosis, facial diagnosis, and pulse diagnosis, and combines it with the knowledge graph of classic medical books to build an intelligent diagnosis and treatment system with Chinese medicine dialectical thinking, breaking through the bottleneck of traditional Chinese medicine modernization.

[0016] Finally, a few points should be explained: First, in the description of this application, it should be noted that, unless otherwise specified or limited, the terms "mounted," "connected," and "connected" should be understood in a broad sense, and may refer to mechanical or electrical connections, internal communication between two components, or direct connection. "Up," "down," "left," and "right" are only used to indicate relative positional relationships. When the absolute positions of the objects being described change, the relative positional relationships may also change. Secondly: The drawings of the embodiments disclosed in the present invention only involve structures related to the embodiments disclosed in the present invention. Other structures may refer to conventional designs. The same embodiment and different embodiments of the present invention may be combined with each other without conflict. Finally: The above description is only a preferred embodiment of the present invention and is not intended to limit the present invention. Any modifications, equivalent substitutions, improvements, etc. made within the spirit and principles of the present invention should be included in the scope of protection of the present invention.

Claims

1. A TCM health and wellness system based on a multimodal large model, characterized by: It includes multimodal data acquisition and fusion module, classical theoretical knowledge graph construction module, large-model intelligent diagnosis and treatment engine module, syndrome initial judgment module, pathogenesis deduction module, solution generation module and dynamic health management closed-loop module; The multimodal data acquisition and fusion module includes a 3D structured light scanning device and a 128-channel pressure sensor array. The 3D structured light scanning device is used to obtain the three-dimensional shape of the tongue, and the 128-channel pressure sensor array is used to capture the pulse waveforms of the three parts of the inch, guan, and chi. The multimodal data acquisition and fusion module obtains the three-dimensional shape of the tongue and captures the pulse waveforms of the three parts of the inch, guan, and chi. It combines hyperspectral imaging technology to analyze the distribution of qi and blood on the face, and achieves feature alignment of the four diagnostic data through a spatiotemporal attention mechanism to construct a 127-dimensional feature vector including tongue color, tongue coating, and pulse position. The classical theoretical knowledge graph construction module uses the Six Meridians Syndrome Differentiation System as a framework and the Five Movements and Six Qi Theory as a foundation. It constructs a knowledge graph containing 120,000 syndrome-prescription association rules and 80,000 Chinese medicine compatibility taboos, and uses graph neural networks to achieve cross-level reasoning. The large-scale intelligent diagnosis and treatment engine module is based on an intelligent hybrid expert architecture, integrating clinical reasoning data and ancient text training, achieving a syndrome differentiation accuracy rate of 92.3%; The syndrome preliminary judgment module uses convolutional neural network to analyze tongue texture and preliminarily judge cold, heat, deficiency or excess by combining pulse frequency domain characteristics; The pathogenesis deduction module calls the article knowledge base and simulates the thinking process of observing the pulse and symptoms, knowing what is wrong, and treating the symptoms according to the symptoms through the Transformer model; The solution generation module optimizes prescription compatibility based on reinforcement learning, generates personalized solutions including Chinese medicine prescriptions, dietary therapy suggestions, and guiding exercises, and provides a corresponding interpretation path for prescriptions and symptoms; The dynamic health management closed-loop module uses wearable devices to monitor vital signs 24 hours a day, and dynamically adjusts intervention strategies based on comparative analysis of historical data.

2. The TCM health and wellness system based on a multimodal large model according to claim 1 is characterized by: The resolution of the 3D structured light scanning device is 0.1 mm, and the accuracy of the 128-channel pressure sensor array is 0.01 mmHg.

3. The TCM health and wellness system based on a multimodal large model according to claim 1 is characterized by: The wearable device is configured as a pulse bracelet.

Images