Visual meridian diagnosis and treatment system based on XR mixed reality technology

Abstract

The invention provides a meridian visual diagnosis and treatment system based on an XR mixed reality technology. The system comprises a multi-modal data acquisition module, an intelligent diagnosis engine and an AR diagnosis and treatment interaction module. Through the multi-modal data fusion and dynamic rendering technology, the accuracy and efficiency of traditional Chinese medicine diagnosis and treatment are remarkably improved. According to the system, traditional two-dimensional graphical representation is upgraded into dynamic three-dimensional visualization, and dynamic simulation of qi and blood operation of channels and collaterals is achieved in combination with real-time biological signal feedback; through a high-precision positioning algorithm and quantitative diagnosis and treatment parameters, the problem that a traditional method depends on experience is solved; the holographic reflection diagnosis technology fuses palm HSV analysis and biological impedance detection, double verification is provided for viscera diseases, the AR interaction module enhances the intuition and safety of teaching and clinical operation through force feedback and thermal field simulation, the diagnosis and treatment decision time is shortened, the teaching error rate is reduced, and the diagnosis and treatment efficiency is improved. And an innovative solution is provided for digital development of traditional Chinese medicine.

Description

Technical Field

[0001] The present invention relates to the technical field of the intersection of augmented reality technology and digital diagnosis and treatment in Traditional Chinese Medicine, and in particular to a meridian visualization diagnosis and treatment system based on XR mixed reality technology, which is an intelligent diagnosis and treatment system integrating human body holographic mapping, real-time biosignal feedback and dynamic meridian rendering. Background Art

[0002] Traditional Chinese medicine diagnosis and treatment methods have many limitations: insufficient visualization of meridians, relying on two-dimensional diagrams, unable to show three-dimensional circulation paths and dynamic Qi and blood circulation; low acupoint positioning accuracy, large errors in surface landmark methods, and difficulty adapting to individual body size differences; vague diagnosis and treatment parameters, lack of quantitative standards for acupuncture depth and moxibustion thermal conduction; lack of holographic mapping, and lack of effective spatial association algorithms between hand / foot reflex areas and meridian systems. In the existing technology, AR technology is mostly used for acupoint identification, but it fails to solve core problems such as the dynamic characteristics of meridians, quantitative acupuncture parameters, and visualization of thermal conduction. The present invention overcomes the above-mentioned shortcomings through multimodal data fusion and intelligent algorithms, realizing the digitization and precision of Chinese medicine diagnosis and treatment. Summary of the Invention

[0003] In view of this, in order to solve the problems existing in the technical background, this invention proposes a meridian visualization diagnosis and treatment system based on XR mixed reality technology. Specifically, it includes the following contents:

[0004] A meridian visualization diagnosis and treatment system based on XR mixed reality technology includes: a multimodal data acquisition module, an intelligent diagnosis engine and an AR diagnosis and treatment interaction module; the multimodal data acquisition module is used to collect basic data and real-time biological signals, the basic data including a standard acupoint library, a holographic reflection library and an ear acupoint fetal projection model, and the real-time biological signals including impedance detection data and EDA sensor data; the intelligent diagnosis engine is used to implement a holographic mapping algorithm and dynamic meridian rendering, the holographic mapping algorithm identifies palm pathological characteristics based on the HSV space, and the dynamic meridian rendering includes a meridian flow time algorithm and qi and blood circulation speed calculation; the AR diagnosis and treatment interaction module is used for virtual-reality fusion display and multimodal interaction, the virtual-reality fusion display includes force feedback and millimeter-level depth display of acupuncture needles and temperature gradient simulation of moxibustion thermal fields, and the multimodal interaction includes gesture-triggered meridian circulation animation and voice command-triggered thermal diffusion simulation.

[0005] Furthermore, the standard acupoint library contains three-dimensional coordinate data of 361 main meridian acupoints and 50 extra meridian acupoints, the holographic reflection library contains three-dimensional coordinate data of hand and foot reflex zones, and the ear acupoint fetal projection model is used for association mapping between ear acupoints and internal organs.

[0006] Furthermore, the impedance detection data is used to evaluate the patency of meridians, and the EDA sensor data is used to quantify the pain level.

[0007] Furthermore, the holographic mapping algorithm analyzes the palm image through the HSV color space, identifies the redness area and calculates the organ association score. The specific implementation includes converting the image into the HSV space, extracting the pathological feature area through threshold segmentation, and generating a diagnosis result based on preset rules.

[0008] Furthermore, the meridian flow time algorithm in the dynamic meridian rendering is used to adjust the meridian qi and blood circulation parameters according to the time of day, and the calculation formula for the qi and blood circulation speed is the basic value multiplied by (1+impedance change rate).

[0009] Furthermore, the acupuncture needles in the virtual-reality fusion display achieve tactile feedback through force feedback gloves, and display the needle insertion depth in real time with an accuracy error of less than 0.3mm. The moxibustion thermal field simulates the heat diffusion range and intensity through temperature gradient.

[0010] Furthermore, the gesture-triggered meridian circulation animation in the multimodal interaction includes synchronously displaying a three-dimensional animation of the associated meridians when selecting an acupoint through gesture, and the voice command-triggered thermal diffusion simulation includes controlling the visualization effect of the thermal field of a specific acupoint through voice commands.

[0011] Furthermore, the system also includes a three-dimensional coordinate system conversion algorithm for adapting to personalized coordinate mapping for patients of different body shapes. The specific formula is x′=k1x+b1, y′=k2y+b2, z′=k3z+b3, where k1, k2, k3 and b1, b2, b3 are adaptation parameters.

[0012] Furthermore, the pathology recognition model in the intelligent diagnosis engine adopts the ResNet50 network structure and integrates an adaptive attention module. The training data includes 10,000 palm pathology images for high-precision pathology feature extraction and classification.

[0013] Furthermore, the system supports two modes: clinical diagnosis and treatment and teaching application. The clinical diagnosis and treatment mode generates personalized meridian models through SLAM scanning and recommends treatment plans in real time. The teaching application mode guides students to correct operations through force feedback and AR annotation, reducing the teaching error rate to below 8.7%.

[0014] The above technical solution has the following beneficial effects:

[0015] This invention significantly improves the accuracy and efficiency of TCM diagnosis and treatment through multimodal data fusion and dynamic rendering technology. The system upgrades traditional two-dimensional graphics to dynamic three-dimensional visualization, and combines real-time biosignal feedback to achieve dynamic simulation of the circulation of Qi and blood in the meridians. Through high-precision positioning algorithms and quantitative diagnosis and treatment parameters, it solves the problem of traditional methods relying on experience. Holographic reflection diagnosis technology integrates palm HSV analysis and bioimpedance detection, providing dual verification for internal organ diseases. The AR interaction module enhances the intuitiveness and safety of teaching and clinical operations through force feedback and thermal field simulation. This invention not only shortens the time for diagnosis and treatment decision-making, but also reduces the teaching error rate, providing an innovative solution for the digital development of TCM. BRIEF DESCRIPTION OF THE DRAWINGS

[0016] Figure 1 This is a structural schematic diagram of a meridian visualization diagnosis and treatment system based on XR mixed reality technology of the present invention. DETAILED DESCRIPTION

[0017] The following is a clear and complete description of the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without making any creative efforts are within the scope of protection of the present invention.

[0018] A meridian visualization diagnosis and treatment system based on XR mixed reality technology includes: a multimodal data acquisition module, an intelligent diagnosis engine and an AR diagnosis and treatment interaction module; the multimodal data acquisition module is used to collect basic data and real-time biological signals, the basic data including a standard acupoint library, a holographic reflection library and an ear acupoint fetal projection model, and the real-time biological signals including impedance detection data and EDA sensor data; the intelligent diagnosis engine is used to implement a holographic mapping algorithm and dynamic meridian rendering, the holographic mapping algorithm identifies palm pathological characteristics based on the HSV space, and the dynamic meridian rendering includes a meridian flow time algorithm and qi and blood circulation speed calculation; the AR diagnosis and treatment interaction module is used for virtual-reality fusion display and multimodal interaction, the virtual-reality fusion display includes force feedback and millimeter-level depth display of acupuncture needles and temperature gradient simulation of moxibustion thermal fields, and the multimodal interaction includes gesture-triggered meridian circulation animation and voice command-triggered thermal diffusion simulation.

[0019] The standard acupoint library contains the three-dimensional coordinate data of 361 main meridian acupoints and 50 extra meridian acupoints, the holographic reflection library contains the three-dimensional coordinate data of the hand and foot reflex zones, and the ear acupoint fetal projection model is used for the association mapping of ear acupoints and internal organs. The impedance detection data is used to evaluate the patency of the meridians, the EDA sensor data is used to quantify the pain level, the holographic mapping algorithm analyzes the palm image through the HSV color space, identifies the red area and calculates the organ association score. The specific implementation includes converting the image into the HSV space, extracting the pathological feature area through threshold segmentation, and generating a diagnosis result based on preset rules. The meridian flow time algorithm in the dynamic meridian rendering is used to adjust the meridian qi and blood circulation parameters according to the time. The calculation formula of the qi and blood circulation speed is the base value multiplied by (1+impedance change rate). The acupuncture needles in the virtual-real fusion display realize tactile feedback through force feedback gloves and display the needle insertion depth in real time with an accuracy error of less than 0.3mm. The moxibustion thermal field simulates the heat diffusion range and intensity through temperature gradient. The gesture-triggered meridian circulation animation in the multimodal interaction includes synchronously displaying a three-dimensional animation of the associated meridians when selecting an acupoint through gesture. The voice command-triggered thermal diffusion simulation includes controlling the visualization effect of the thermal field of specific acupuncture points through voice commands. The system also includes a three-dimensional coordinate system conversion algorithm for adapting to personalized coordinate mapping for patients of different body shapes. The specific formulas are x′=k1x+b1, y′=k2y+b2, z′=k3z+b3, where k1, k2, k3 and b1, b2, b3 are adaptation parameters. The pathology recognition model in the intelligent diagnosis engine adopts a ResNet50 network structure and integrates an adaptive attention module. The training data includes 10,000 palm pathology images for high-precision pathology feature extraction and classification. The system supports two modes: clinical diagnosis and treatment and teaching application. The clinical diagnosis and treatment mode generates personalized meridian models through SLAM scanning and recommends treatment plans in real time. The teaching application mode guides students to correct operations through force feedback and AR annotation, reducing the teaching error rate to below 8.7%.

[0020] The present invention works through the collaboration of multi-source data acquisition, intelligent diagnosis engine and AR diagnosis and treatment interaction module. The system constructs a four-dimensional meridian database (three-dimensional coordinates + time dimension) through multimodal perception technologies such as binocular visual positioning, infrared thermal imaging and bioimpedance detection, and develops holographic reflex zone intelligent diagnosis algorithms, such as palm HSV color analysis and spatial association of foot reflex zones with spleen / stomach meridians. The dynamic meridian rendering engine combines the meridian time algorithm and the qi and blood running speed model to realize real-time dynamic display of meridians. The AR diagnosis and treatment interaction module supports virtual and real fusion display and multimodal interaction, such as force feedback gloves and voice command control, which significantly improves the efficiency and accuracy of diagnosis and treatment and teaching.

[0021] Specific application examples are as follows: In Example 1, a patient wears a HoloLens device, and SLAM scanning generates a personalized meridian model. The system detects that the Qi and blood values ​​of the Hand Shaoyin Heart Meridian are below the threshold, and the HSV value of the hypothenar eminence is abnormal. AR prompts acupuncture at the Neiguan acupoint, indicating a needle insertion depth of 12 ± 0.5 mm, and moxibustion at the Tanzhong acupoint, with a thermal field coverage radius of 3 cm.

[0022] In Application Example 2, a student gestures to frame the thenar eminence of their palm. The system displays the three-dimensional path of the Lung Meridian and associates it with acupoint treatment parameters. Incorrect manipulation triggers vibration in the force feedback glove, and AR indicates the correct needle insertion angle.

[0023] The present invention integrates palm HSV analysis and bioimpedance detection for the first time to achieve dual verification. Combined with the meridian flow time influence coefficient and thermal diffusivity, it realizes dynamic display of time and space dimensions, and the error of acupuncture depth is less than 0.3mm. The present invention significantly improves the efficiency and accuracy of diagnosis and treatment: the error of acupoint positioning is reduced from >5mm to ≤0.8mm; meridian rendering is upgraded from static images to 60fps dynamic animation; the diagnosis and treatment decision time is shortened from 20-30 minutes to <3 minutes; the teaching error rate is reduced from 42% to 8.7%.

[0024] The present invention integrates human body holographic mapping, real-time biosignal feedback and dynamic meridian rendering technology to achieve three-dimensional visualization of the twelve main meridians, eight extraordinary meridians and extra-meridian acupoints, and establishes an intelligent diagnostic model of hand / foot reflex areas and internal organs and meridians, thereby improving the accuracy and digitalization level of traditional Chinese medicine diagnosis and treatment.

[0025] The above describes the basic principles and main features of the present invention. Those skilled in the art should understand that the present invention is not limited to the above embodiments. The above embodiments and descriptions only illustrate the principles of the present invention. Without departing from the spirit and scope of the present invention, the present invention may have various changes and improvements, which fall within the scope of the invention to be protected. The scope of protection of the invention is defined by the attached claims and their equivalents.

Claims

1. A meridian visualization diagnosis and treatment system based on XR mixed reality technology, characterized by: include: Multimodal data acquisition module, intelligent diagnosis engine and AR diagnosis and treatment interaction module; The multimodal data acquisition module is used to collect basic data and real-time biological signals. The basic data includes a standard acupoint library, a holographic reflection library and an ear acupoint fetal projection model. The real-time biological signals include impedance detection data and EDA sensor data. The intelligent diagnosis engine is used to implement a holographic mapping algorithm and dynamic meridian rendering. The holographic mapping algorithm identifies palm pathological characteristics based on the HSV space. The dynamic meridian rendering includes a meridian flow time algorithm and a qi and blood circulation speed calculation. The AR diagnosis and treatment interaction module is used for virtual-reality fusion display and multimodal interaction. The virtual-reality fusion display includes force feedback and millimeter-level depth display of acupuncture needles and temperature gradient simulation of the moxibustion thermal field. The multimodal interaction includes gesture-triggered meridian circulation animation and voice command-triggered thermal diffusion simulation.

2. The meridian visualization diagnosis and treatment system based on XR mixed reality technology according to claim 1 is characterized in that: The standard acupoint library contains the three-dimensional coordinate data of 361 main meridian acupoints and 50 extra meridian acupoints, the holographic reflection library contains the three-dimensional coordinate data of the hand and foot reflex zones, and the ear acupoint fetal projection model is used for the association mapping of ear acupoints and internal organs.

3. The meridian visualization diagnosis and treatment system based on XR mixed reality technology according to claim 1 is characterized in that: The impedance detection data is used to evaluate the patency of meridians, and the EDA sensor data is used to quantify the pain level.

4. The meridian visualization diagnosis and treatment system based on XR mixed reality technology according to claim 1 is characterized in that: The holographic mapping algorithm analyzes palm images using the HSV color space, identifies red areas, and calculates organ association scores. The specific implementation includes converting the image into the HSV space, extracting pathological feature areas through threshold segmentation, and generating diagnostic results based on preset rules.

5. The meridian visualization diagnosis and treatment system based on XR mixed reality technology according to claim 1 is characterized in that: The meridian flow time algorithm in the dynamic meridian rendering is used to adjust the meridian qi and blood circulation parameters according to the time of day. The calculation formula for the qi and blood circulation speed is the basic value multiplied by (1+impedance change rate).

6. The meridian visualization diagnosis and treatment system based on XR mixed reality technology according to claim 1 is characterized in that: The acupuncture needles in the virtual-reality fusion display achieve tactile feedback through force feedback gloves and display the needle insertion depth in real time with an accuracy error of less than 0.3mm. The moxibustion thermal field simulates the heat diffusion range and intensity through temperature gradient.

7. The meridian visualization diagnosis and treatment system based on XR mixed reality technology according to claim 1 is characterized in that: The gesture-triggered meridian circulation animation in the multimodal interaction includes synchronously displaying a three-dimensional animation of the associated meridians when selecting an acupoint through gesture, and the voice command-triggered thermal diffusion simulation includes controlling the visualization effect of the thermal field of a specific acupoint through voice commands.

8. The meridian visualization diagnosis and treatment system based on XR mixed reality technology according to claim 1 is characterized in that: The system also includes a three-dimensional coordinate system conversion algorithm for adapting to personalized coordinate mapping for patients of different body shapes. The specific formula is x′=k1x+b1, y′=k2y+b2, z′=k3z+b3, where k1, k2, k3 and b1, b2, b3 are adaptation parameters.

9. The meridian visualization diagnosis and treatment system based on XR mixed reality technology according to claim 1, characterized in that: The pathology recognition model in the intelligent diagnosis engine adopts the ResNet50 network structure and integrates an adaptive attention module. The training data includes 10,000 palm pathology images, which is used to achieve high-precision pathology feature extraction and classification.

10. The meridian visualization diagnosis and treatment system based on XR mixed reality technology according to claim 1, characterized in that: The system supports two modes: clinical diagnosis and treatment and teaching application. The clinical diagnosis and treatment mode generates personalized meridian models through SLAM scanning and recommends treatment plans in real time. The teaching application mode guides students to correct operations through force feedback and AR annotation, reducing the teaching error rate to below 8.7%.

Images