Traditional Chinese medicine massage physiotherapy system and method based on augmented reality technology

Abstract

The invention relates to the technical field of augmented reality, and provides a traditional Chinese medicine massage physiotherapy system based on the augmented reality technology, and the system comprises a data collection module which is used for collecting and monitoring the physical state information of a user; the traditional Chinese medicine massage manipulation recommendation module is used for constructing a knowledge graph through traditional Chinese medicine massage data, reasoning according to the knowledge graph based on the user body state information to obtain a preliminary massage scheme, and optimizing the preliminary massage scheme by using a neural network to obtain an optimal massage scheme; the massage module is used for executing the optimal massage scheme through massage equipment; and the augmented reality technology module is used for dynamically visualizing the massage by using augmented reality equipment. The invention provides a traditional Chinese medicine massage physiotherapy system which can provide personalized services for users and improve massage experience through an augmented reality technology.

Description

Technical Field

[0001] The present invention relates to the field of augmented reality technology, and in particular to a Chinese medicine massage therapy system and method based on augmented reality technology. Background Art

[0002] In modern society, people's lifestyles are gradually becoming fast-paced and high-pressure. Due to long-term sitting and lack of exercise, people have common sub-health problems. This long-term physical burden not only affects work efficiency, but also seriously affects the quality of life, thus surging the market demand for neck, shoulder and back massages. Many consumers seek to relax their bodies and minds through massage chairs to improve their sleep quality, and the smart massage chair market has therefore gained huge room for development.

[0003] However, despite the wide variety of massage chairs on the market, existing massage equipment and services usually only provide general massage modes, and many products only provide a few fixed massage modes. According to the view of traditional Chinese medicine therapy, everyone's physique and health status are different, so the massage technique and strength need to be adjusted in a targeted manner during massage therapy. Existing massage equipment ignores the importance of individual differences in Chinese massage therapy, and lacks sufficient flexibility to adjust the treatment plan according to the user's specific condition, which leads to the singleness and standardization of the massage experience, making it difficult to meet the user's growing diversified and personalized health needs. In addition, the application of augmented reality combined with massage technology is still in its infancy. When displaying the massage process, the existing technology is more of a static visual presentation, and does not fully utilize the advantages of augmented reality technology to provide a more immersive interactive experience. Summary of the invention

[0004] In order to overcome the defect of the above-mentioned prior art that it is impossible to provide accurate massage plans according to the physical conditions and needs of different users, the present invention provides a traditional Chinese medicine massage therapy system and method based on augmented reality technology.

[0005] In order to achieve the above technical effects, the technical solution of the present invention is as follows:

[0006] A Chinese medicine massage therapy system based on augmented reality technology, comprising:

[0007] Data collection module, used to collect and monitor user's physical status information;

[0008] A TCM massage technique recommendation module, which is used to construct a knowledge graph through TCM massage data, and to obtain a preliminary massage plan based on the user's physical condition information and the knowledge graph, and to optimize the preliminary massage plan using a neural network to obtain an optimal massage plan; a massage module, which is used to execute the optimal massage plan through a massage device;

[0009] The augmented reality technology module is used to dynamically visualize the optimal massage plan by using an augmented reality device.

[0010] The present invention also proposes a Chinese medicine massage therapy method based on augmented reality technology, the method comprising:

[0011] Collect user's physical condition information;

[0012] Constructing a knowledge graph based on traditional Chinese medicine massage data, and obtaining a preliminary massage plan based on the user's physical condition information and inference according to the knowledge graph, and optimizing the preliminary massage plan using a neural network to obtain an optimal massage plan;

[0013] The user is massaged according to the optimal massage plan using a massage device, and the massage dynamics are visualized using an augmented reality device.

[0014] The present invention also proposes an electronic device, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein when the processor executes the computer program, the traditional Chinese medicine massage therapy method based on augmented reality technology as described in the present invention is implemented.

[0015] Compared with the prior art, the present invention has the following beneficial effects:

[0016] The present invention uses Chinese massage therapy as the system architecture, uses augmented reality technology as an interactive means, and uses knowledge graphs and neural network models based on Chinese massage data and user physiological data and feedback to provide users with personalized massage plan recommendations. The present invention can generate accurate personalized massage plans based on the specific health conditions, physiques and needs of different users, and provide more targeted physiotherapy services. In addition, the massage dynamics are visualized through augmented reality devices in the augmented reality technology module, and virtual information is integrated with real scenes, which improves the user experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0017] Figure 1 This is an architecture diagram of a traditional Chinese medicine massage therapy system based on augmented reality technology in Example 1.

[0018] Figure 2 This is a schematic diagram of three-dimensional registration of Example 2.

[0019] Figure 3 This is a flow chart of the Chinese medicine massage therapy method based on augmented reality technology in Example 3. DETAILED DESCRIPTION

[0020] The accompanying drawings are only used for illustrative purposes and are not to be construed as limiting the present invention;

[0021] It is understandable to those skilled in the art that some well-known descriptions may be omitted in the drawings.

[0022] The technical solution of the present invention is further described below in conjunction with the accompanying drawings and embodiments.

[0023] Example 1

[0024] This embodiment proposes a Chinese medicine massage therapy system based on augmented reality technology. Figure 1 As shown, this is an architecture diagram of a traditional Chinese medicine massage therapy system based on augmented reality technology in this embodiment.

[0025] The Chinese medicine massage therapy system based on augmented reality technology proposed in this embodiment includes:

[0026] Data collection module, used to collect and monitor user's physical status information;

[0027] A TCM massage technique recommendation module, which is used to construct a knowledge graph through TCM massage data, and to obtain a preliminary massage plan based on the user's physical condition information and the knowledge graph, and to optimize the preliminary massage plan using a neural network to obtain an optimal massage plan; a massage module, which is used to execute the optimal massage plan through a massage device;

[0028] The augmented reality technology module is used to dynamically visualize the optimal massage plan by using an augmented reality device.

[0029] In this embodiment, the system collects and monitors the user's physical condition information in real time through the data acquisition module, builds a knowledge graph based on the Chinese massage data in the Chinese massage technique recommendation module, and inputs the collected user's physical condition information and knowledge graph into the neural network model to predict the optimal massage plan that best suits the user's current condition; then, the Chinese massage technique is presented to the user in a dynamic and visual form through the augmented reality technology module and the massage module, which enhances interactivity and experience. By utilizing the combination of knowledge graph and neural network, this system can deeply learn the theory and practical experience of Chinese massage, and then realize personalized technique recommendation based on the collected user's physical information, which not only improves the efficiency of program formulation, but also ensures that personalized massage plans can be accurately generated, and promotes the digitalization and intelligent application of traditional Chinese medicine theory. In addition, by integrating virtual information with real scenes, it brings users an immersive experience of information enhancement and personalized Chinese health massage, improving the user's experience.

[0030] As an exemplary illustration, the user's physical state information includes an electrocardiogram signal, a blood pressure signal, and an electromyography signal.

[0031] More specifically, the ECG signal is used to monitor the user's heart rate changes during the massage process, evaluate the impact of the massage technique on the user's cardiovascular system, and ensure the safety and effectiveness of the massage process; the blood pressure signal collects the user's blood pressure changes during the massage process, determines whether the current massage technique is suitable for the user's physiological state, and avoids blood pressure increases or decreases caused by improper massage; the electromyography signal collects the user's muscle tension during the massage process and evaluates the effect of the massage in relaxing muscles and relieving fatigue. By comprehensively analyzing the ECG, blood pressure, and electromyography signals, the system can fully understand the user's physiological response, thereby providing a highly personalized massage plan, improving the treatment effect, and ensuring that the massage process is carried out within the user's safe physiological range.

[0032] As another exemplary illustration, the TCM massage data includes TCM massage techniques, acupoint information and TCM physiotherapy information.

[0033] In an optional embodiment, the step of obtaining a preliminary massage plan based on the user's physical state information and reasoning according to the knowledge graph includes:

[0034] Embed entities and relations in the knowledge graph into a low-dimensional vector space through vector operations;

[0035] Input the nodes in the knowledge graph into the neural network and update the adjacent relationships of the nodes in the knowledge graph;

[0036] A preliminary massage plan is obtained based on the updated knowledge graph reasoning.

[0037] Specifically, a knowledge graph is constructed based on TCM massage techniques, acupoint information, and TCM physiotherapy information. In the knowledge graph, vectors are used to represent node information, and matrices are used to represent edge relationships. The expression is as follows:

[0038] v i =Embedding(Node i )

[0039] e ij =Relation(Node i ,Node j )

[0040] Among them, v i is the vector representation of node i, Embedding() is the embedding function, Node i represents node i; e ij Represents the edge relationship between node i and node j. Relation() is a mapping function that represents the relationship between two nodes in the knowledge graph.

[0041] Secondly, use knowledge graph embedding methods such as TransE and TransR to embed nodes and relationships into a low-dimensional vector space, which is expressed as follows:

[0042] h+r≈t

[0043] Among them, h, r, and t represent the embedding vectors of the head entity, relation, and tail entity, respectively.

[0044] Further optionally, the step of optimizing the reasoning process by a neural network includes: using a graph convolutional network to perform weighted summation on the features of a node and its adjacent nodes, using a neural network to perform weighted summation on the features of a node and its adjacent nodes in a knowledge graph, and updating the adjacent relationship of the node according to the weight of the node; the expression of the weighted summation is as follows:

[0045] H (l+1) =σ(AH (l) W (l) )

[0046] Among them, A represents the adjacency matrix of the graph, H (l) is the node representation of the lth layer, W (l) is the weight matrix of the lth layer, and σ is the activation function.

[0047] As an exemplary illustration, the neural network includes a graph convolutional network or a graph attention network.

[0048] In the present embodiment, massage techniques, acupoints and TCM physiotherapy information are structured based on knowledge graph, nodes and relationships in knowledge graph are embedded into low-dimensional vector space, and the embedding of knowledge graph is further optimized by neural network, and the model aggregates the neighbor information of each node through convolution operation to generate new node embedding. The complex TCM massage knowledge graph is converted into a computable low-dimensional vector representation by embedding method, which can effectively represent the relationship between nodes, facilitate subsequent neural network processing, enhance the flexibility and structure of knowledge expression, and enable massage scheme to be optimized based on graph structure. Secondly, by aggregating the information of nodes and their neighbor nodes in neural network, the complex dependency between nodes can be captured, so that the node representation is more accurate to optimize the optimization process of knowledge graph. In addition, the user's physical state information is combined with the embedded representation in the knowledge graph in the neural network to generate the best personalized massage scheme, and the scheme inferred is more in line with the user's specific health status by combining the user's personalized data.

[0049] In an optional embodiment, the step of optimizing the preliminary massage plan using a neural network to obtain an optimal massage plan includes:

[0050] Inputting the preliminary massage plan and the user's physical condition information into the input layer of the neural network, and quantifying the user's physical condition information; using a multi-layer perceptron in the hidden layer of the neural network to extract features from the quantified user's physical condition information;

[0051] The neural network is iteratively optimized through a cross entropy loss function until the neural network converges, and the optimal massage plan is output in an output layer after the neural network converges.

[0052] Specifically, a multilayer perceptron is used in the hidden layer of the neural network to extract the feature hidden layer, and its expression is as follows:

[0053] h n =σ(W n x+b n )

[0054] Among them, h n is the output of the nth hidden layer, W n is the weight matrix of the nth hidden layer, b n is the bias of the nth hidden layer, and σ is the activation function.

[0055] As an exemplary illustration, the ReLU activation function is selected as the activation function.

[0056] The output h of the hidden layer in the neural network n The weight matrix W0 of the output layer is linearly transformed and normalized, and its expression is as follows:

[0057] y=softmax(W0h n +b0)

[0058] Among them, softmax() is the normalization function and b0 is the bias term.

[0059] Furthermore, optionally, the cross entropy loss function is used in the neural network to optimize the model, and the expression of the loss function is as follows:

[0060]

[0061] Among them, y i is the true value of the label, The labels predicted by the neural network model.

[0062] In this embodiment, first, the preliminary massage scheme obtained by knowledge graph reasoning and the user's physical state information are input into the neural network, and in the hidden layer of the neural network, a multi-layer perceptron is used to extract features of the input information. Each hidden layer updates information through a weight matrix, a bias term and an activation function, and generates the output of the next hidden layer. The final output of the hidden layer generates a combination of recommended massage techniques, acupoints and Chinese medicine therapy through a linear transformation and an activation function of the output layer, and optimizes the neural network parameters by back propagation through the definition of a cross entropy loss function. Through the neural network, a deeper level of optimization can be performed based on the existing scheme, so that the generated massage scheme is more in line with the individual's physical state and health needs. Through the layer-by-layer feature extraction of the multi-layer perceptron, the neural network can capture the deep relationship between massage techniques, acupoints and Chinese medicine therapy schemes, so that the model has a stronger expression ability, can handle more complex data patterns, and improve the diversity and rationality of the recommendation.

[0063] Example 2

[0064] This embodiment makes improvements on the Chinese medicine massage therapy system based on augmented reality technology proposed in Embodiment 1.

[0065] In an optional embodiment, the step of dynamically visualizing the optimal massage plan by using an augmented reality device includes: constructing a virtual 3D masseur and a virtual scene as virtual content in the augmented reality device, and aligning the virtual content with the real scene through three-dimensional alignment; wherein the virtual 3D masseur changes the massage technique based on the optimal massage plan.

[0066] Further optionally, the virtual scene includes a beach, a forest and a garden.

[0067] Specifically, massage equipment and other debris are removed from the augmented reality device through an edge texture repair network, and a virtual-real occlusion algorithm is added. 3D modeling is used to draw a virtual human body and identify the locations of human acupuncture points. A keyframe animation is then designed based on the optimal massage plan, and the 3D masseur visualizes the massage technique according to the keyframe animation.

[0068] In this embodiment, the Chinese massage techniques are dynamically visualized in 3D form through augmented reality equipment, and the user can intuitively see the movements of the virtual masseur. This intuitive interactive method helps the user better understand and perceive the massage techniques and their parts of action, improving the user experience and learning effect. Through three-dimensional registration technology, the virtual masseur is accurately matched with the real environment, and the virtual scene can be combined with the user's real environment to provide an immersive user experience, which helps to soothe emotions and increase relaxation.

[0069] In an optional embodiment, the three-dimensional registration converts between the identification coordinate system, the camera coordinate system and the image coordinate system;

[0070] like Figure 2 As shown, it is a schematic diagram of three-dimensional registration.

[0071] The conversion formula between camera coordinates and identification coordinates is as follows:

[0072]

[0073] Among them, (X c ,Y c ,Z c ) and (X W ,Y W ,Z W ) represent random points in the camera coordinate system and the identification coordinate system, V 11 V 12 V 13 Represents the rotational projection of the camera coordinate system on the X-axis of the identification coordinate system, V 21 V 22 V 23 Represents the rotational projection of the camera coordinates on the Y axis of the identification coordinate system, V 31 V 32 V 33 Represents the rotational projection of the camera coordinates on the Z axis of the identification coordinate system; V 3×3 Represents the rotation matrix, which is used to describe the rotation relationship of the camera coordinate system in the identification coordinate system; W x , W y and W z Respectively represent the coordinates of the origin of the camera coordinate system in the X-axis, Y-axis, and Z-axis of the identification coordinate system, W 3×3 Used to describe the position of the origin of the camera coordinate system in the identification coordinate system; T cm is the transformation matrix from the identification coordinates to the camera coordinates;

[0074] The conversion formula between the camera coordinate system and the image coordinate system is as follows:

[0075]

[0076] Where f is the focal length of the camera, h is the scaling factor of the image coordinate system, u is the pixel horizontal axis of the image coordinate system, v is the pixel vertical axis of the image coordinate system, (u0, v0) represents the pixel coordinates of the center point of the image coordinate system, and P represents the fixed physical parameter moment of the camera; d x and d y Respectively represent the actual length of the point on the horizontal and vertical axes of the image coordinate system;

[0077] The conversion formula between the identification coordinate system and the image coordinate system is as follows:

[0078]

[0079] In this embodiment, accurate registration between different coordinate systems is achieved through the conversion between multiple matrices, and the three-dimensional real scene is projected onto the image of the augmented reality device through the conversion of the camera coordinate system and the image coordinate system, and then the virtual content is integrated into the real scene, thereby ensuring that the virtual image can be accurately overlaid on the real-time video stream, enhancing the authenticity and consistency of the visual effect. Among them, by using the rotation matrix and the displacement vector, the position change of the camera coordinate system in the identification coordinate system and the rotation and displacement relationship of the camera in the virtual and real worlds are accurately described. By combining parameters such as focal length and pixel scaling factor, objects in three-dimensional space can be mapped to two-dimensional images, ensuring that the superposition process of virtual and reality is clear and distortion-free, and improving visual accuracy. Through the operation of the three-dimensional registration matrix, complex coordinate transformations can be processed in real time in augmented reality applications, ensuring that the device responds quickly and efficiently, and providing users with a smooth and natural AR experience.

[0080] In an optional embodiment, 8. the augmented reality technology module also includes a tactile feedback enhancement module for mapping the massage device operation area into the virtual content.

[0081] Further optionally, the step of mapping the massage device operation area to the virtual content includes: constructing a tactile device coordinate system based on the position and direction of the massage device, converting the tactile device coordinate system into an image coordinate system, obtaining the position of the massage device in the image coordinate system, and mapping the massage device operation area to the virtual content based on the position of the massage device in the image coordinate system; the conversion formula between the tactile device coordinate system conversion and the image coordinate system is as follows:

[0082]

[0083] Among them, (X h ,Y h ,Z h ) represents a point in the tactile device coordinate system, A 4×4 It is a 4×4 matrix, representing the transformation matrix from the camera coordinate system to the identification coordinate system; C 4×4 It is a 4×4 transformation matrix from the pre-calibrated tactile device coordinate system to the massage device coordinate system.

[0084] In this embodiment, through the transformation matrix between the position of the tactile device and the image coordinate system, the position of the massage device in the real operation area can be accurately mapped to the virtual scene, so that the user can perceive the actual position of the massage device in the augmented reality device, and then achieve precise interaction and operation in the virtual environment, providing a more immersive augmented reality experience.

[0085] In an optional embodiment, the augmented reality technology module also includes a user natural interaction module, which is used to collect the user's gestures, voice or head movements to achieve interaction between the user and the augmented reality device.

[0086] In this embodiment, the user can interact with the augmented reality device through gestures, voice or head movements, which provides the user with a variety of operation methods, makes the interaction more natural and intuitive, and improves the convenience of operation.

[0087] As an example, computer vision technology is used to capture the user's gesture movements and apply them to the AR environment to achieve real-time gesture tracking and recognition. The MediaPipe Hands machine learning library is combined with the system of the augmented reality device to realize the gesture interaction function.

[0088] As another exemplary illustration, the Google Speech-to-Text and Text-to-Speech APIs are used for speech recognition and synthesis, converting speech into instructions that can be understood by a computer, and combined with the system of an augmented reality device to implement voice interaction functions.

[0089] As another exemplary illustration, the movement and position of the user's head is captured by a camera, gyroscope, accelerometer or other sensor to align it with the user's line of sight.

[0090] Example 3

[0091] This embodiment proposes a Chinese medicine massage therapy method based on augmented reality technology, which is applied to the Chinese medicine massage therapy system based on augmented reality technology proposed in embodiments 1 to 2. Figure 3 As shown, it is a flow chart of the Chinese medicine massage therapy method based on augmented reality technology of this embodiment.

[0092] This embodiment proposes a Chinese medicine massage therapy method based on augmented reality technology, the method comprising:

[0093] Collect user's physical condition information;

[0094] Constructing a knowledge graph based on traditional Chinese medicine massage data, and obtaining a preliminary massage plan based on the user's physical condition information and inference according to the knowledge graph, and optimizing the preliminary massage plan using a neural network to obtain an optimal massage plan;

[0095] The user is massaged according to the optimal massage plan using a massage device, and the massage dynamics are visualized using an augmented reality device.

[0096] It can be understood that the method of this embodiment corresponds to the system of the above-mentioned embodiments 1 to 2, and the options in the above-mentioned embodiments 1 to 2 are also applicable to this embodiment, so they will not be described repeatedly here.

[0097] Example 4

[0098] This embodiment proposes a computer device, including a memory and a processor, wherein the memory stores computer-readable instructions, wherein when the computer-readable instructions are executed by the processor, the processor executes the steps of the traditional Chinese medicine massage therapy method based on augmented reality technology proposed in Example 3.

[0099] The terms in the drawings are for illustrative purposes only and should not be construed as limiting this patent;

[0100] Obviously, the above embodiments of the present invention are merely examples for clearly illustrating the present invention, and are not intended to limit the embodiments of the present invention. For those skilled in the art, other different forms of changes or modifications can be made based on the above description. It is not necessary and impossible to list all the embodiments here. Any modifications, equivalent substitutions and improvements made within the spirit and principles of the present invention should be included in the protection scope of the claims of the present invention.

Claims

1. A Chinese medicine massage therapy system based on augmented reality technology, characterized in that: The system comprises: Data collection module, used to collect and monitor user's physical status information; A TCM massage technique recommendation module is used to construct a knowledge graph based on TCM massage data, and to obtain a preliminary massage plan based on the user's physical condition information and the knowledge graph, and to optimize the preliminary massage plan using a neural network to obtain an optimal massage plan; A massage module, used for executing the optimal massage plan through a massage device; The augmented reality technology module is used to dynamically visualize the optimal massage plan by using an augmented reality device.

2. The Chinese medicine massage therapy system based on augmented reality technology according to claim 1 is characterized in that: The step of obtaining a preliminary massage plan based on the user's physical state information and reasoning according to the knowledge graph comprises: Embed entities and relations in the knowledge graph into a low-dimensional vector space through vector operations; Input the nodes in the knowledge graph into the neural network and update the adjacent relationships of the nodes in the knowledge graph; A preliminary massage plan is obtained based on the updated knowledge graph reasoning.

3. The Chinese medicine massage therapy system based on augmented reality technology according to claim 2 is characterized in that: The steps of optimizing the reasoning process based on the neural network include: using the neural network to perform weighted summation on the features of the nodes and their adjacent nodes in the knowledge graph, and updating the adjacent relationship of the nodes according to the weights of the nodes; the expression of the weighted summation is as follows: H (l+1) =σ(AH (l) W (l) ) Among them, A represents the adjacency matrix in the knowledge graph, H (l) is the node representation of the lth layer in the knowledge graph, W (l) is the weight matrix of the lth layer, and σ is the activation function.

4. The Chinese medicine massage therapy system based on augmented reality technology according to claim 1, characterized in that: The step of using a neural network to optimize the preliminary massage plan to obtain the optimal massage plan includes: Inputting the preliminary massage plan and the user's physical condition information into the input layer of the neural network, and quantifying the user's physical condition information; Using a multi-layer perceptron in the hidden layer of the neural network to extract features from the quantified user's physical state information; The neural network is iteratively optimized through a cross entropy loss function until the neural network converges, and the optimal massage plan is output in an output layer after the neural network converges.

5. The Chinese medicine massage therapy system based on augmented reality technology according to claim 1 is characterized in that: The step of dynamically visualizing the optimal massage plan by using an augmented reality device includes: constructing a virtual 3D masseur and a virtual scene as virtual content in the augmented reality device, and aligning the virtual content with the real scene through three-dimensional alignment.

6. The Chinese medicine massage therapy system based on augmented reality technology according to claim 5 is characterized in that: The three-dimensional registration is performed by converting between the identification coordinate system, the camera coordinate system and the image coordinate system; The conversion formula between camera coordinates and identification coordinates is as follows: Among them, (X c ,Y c ,Z c ) and (X W ,Y W ,Z W ) represent random points in the camera coordinate system and the identification coordinate system, V 11 V 12 V 13 Represents the rotational projection of the camera coordinate system on the X-axis of the identification coordinate system, V 21 V 22 V 23 Represents the rotational projection of the camera coordinates on the Y axis of the identification coordinate system, V 31 V 32 V 33 Represents the rotational projection of the camera coordinates on the Z axis of the identification coordinate system; V 3×3 Represents the rotation matrix, which is used to describe the rotation relationship of the camera coordinate system in the identification coordinate system; W x , W y and W z Respectively represent the coordinates of the origin of the camera coordinate system in the X-axis, Y-axis, and Z-axis of the identification coordinate system, W 3×3 Used to describe the position of the origin of the camera coordinate system in the identification coordinate system; T cm is the transformation matrix from the identification coordinates to the camera coordinates; The conversion formula between the camera coordinate system and the image coordinate system is as follows: Where f is the focal length of the camera, h is the scaling factor of the image coordinate system, u is the pixel horizontal axis of the image coordinate system, v is the pixel vertical axis of the image coordinate system, (u0, v0) represents the pixel coordinates of the center point of the image coordinate system, and P represents the fixed physical parameter moment of the camera; d x and d y Respectively represent the actual length of the point on the horizontal and vertical axes of the image coordinate system; The conversion formula between the identification coordinate system and the image coordinate system is as follows:

7. The Chinese medicine massage therapy system based on augmented reality technology according to claim 6 is characterized in that: The augmented reality technology module further includes a tactile feedback enhancement module for mapping the massage device operation area into the virtual content; The step of mapping the massage device operation area to the virtual content includes: constructing a tactile device coordinate system based on the position and direction of the massage device, converting the tactile device coordinate system into an image coordinate system, obtaining the position of the massage device in the image coordinate system, and mapping the massage device operation area to the virtual content based on the position of the massage device in the image coordinate system; the conversion formula between the tactile device coordinate system conversion and the image coordinate system is as follows: Among them, (X h ,Y h ,Z h ) represents a point in the tactile device coordinate system, A 4×4 It is a 4×4 matrix, representing the transformation matrix from the camera coordinate system to the identification coordinate system; C 4×4 It is a 4×4 transformation matrix from the pre-calibrated tactile device coordinate system to the massage device coordinate system.

8. The Chinese medicine massage therapy system based on augmented reality technology according to claim 1, characterized in that: The augmented reality technology module also includes a user natural interaction module, which is used to collect the user's gestures, voice or head movements to achieve interaction between the user and the augmented reality device.

9. A Chinese medicine massage therapy method based on augmented reality technology, applied to the Chinese medicine massage therapy system based on augmented reality technology as claimed in any one of claims 1 to 8, characterized in that: The method comprises: Collect user's physical condition information; Constructing a knowledge graph based on traditional Chinese medicine massage data, and obtaining a preliminary massage plan based on the user's physical condition information and inference according to the knowledge graph, and optimizing the preliminary massage plan using a neural network to obtain an optimal massage plan; The user is massaged according to the optimal massage plan using a massage device, and the massage dynamics are visualized using an augmented reality device.

10. An electronic device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, characterized in that: When the processor executes the computer program, the Chinese medicine massage therapy method based on augmented reality technology as described in claim 9 is implemented.

Images