Interaction method and system applied to traditional Chinese medicine diagnosis and treatment

Abstract

The invention belongs to the technical field of traditional Chinese medicine diagnosis and treatment, and particularly relates to an interaction system applied to traditional Chinese medicine diagnosis and treatment. The traditional Chinese medicine diagnosis and treatment auxiliary device comprises a base, a support arranged on the base, a fixed interaction screen fixedly arranged on the support and a movable interaction screen arranged in the height direction of the support in a sliding mode. The fixed interactive screen is provided with an image acquisition device for acquiring facial information of a user; the main control equipment comprises a model training module, an image acquisition module, a body state evaluation module and a data processing module, according to the scheme, a double-screen type auxiliary device is designed, a scientific and reasonable interaction method is fused, and the interaction system which is convenient, rapid, visual and efficient and provides selectable personalized diagnosis and treatment schemes is provided for a user; based on the system, the invention further provides an interaction method applied to traditional Chinese medicine diagnosis and treatment.

Description

Priority Application

[0001] This application claims priority to Chinese Invention Patent Application No. 202410905077.7, filed on July 5, 2024, entitled “Interactive Method and System Applied to Traditional Chinese Medicine Diagnosis and Treatment, and Traditional Chinese Medicine Diagnosis and Treatment Auxiliary Device,” which is incorporated by reference in its entirety. TECHNICAL FIELD

[0002] The present application belongs to the technical field of traditional Chinese medicine diagnosis and treatment, and specifically relates to an interactive method and system applied to traditional Chinese medicine diagnosis and treatment. BACKGROUND

[0003] At present, with the continuous development of human science and technology, artificial intelligence has brought about changes in many fields, including the medical field. China has a small number of high-level doctors compared to the large population, and there is a shortage of medical resources for doctors and nurses. Moreover, the main experts are generally concentrated in a few large hospitals in central cities. Since they need to face patients from all over the country, the number of patients is large, which sometimes causes ordinary patients to have to wait for several weeks or even months to be treated in some hospitals. In hospitals in remote areas, the number of doctors is even smaller, and timely medical treatment is often not possible. Therefore, there is an urgent need to develop a technology that can accurately diagnose the patient's condition and cause of the disease, propose an ideal diagnosis and treatment plan for the patient, save the patient's valuable treatment time, ensure that the patient receives timely treatment, meet the urgent needs of the general public for medical diagnosis, and improve people's quality of life. Traditional Chinese medicine, generally referred to as Han medicine, is a traditional medicine created by the Chinese Han people. It is a discipline that studies human physiology, pathology, and the diagnosis and prevention of diseases. Traditional Chinese medicine is vast and profound, with many classic Chinese medicine prescriptions and acupuncture prescriptions that can have good therapeutic effects. In view of this, various traditional Chinese medicine diagnosis and treatment robots have been proposed in the prior art.

[0004] For example, the prior art CN201710752932.5 discloses a traditional Chinese medicine diagnosis and treatment robot and a diagnosis and treatment method thereof, which includes a humanoid robot. The front part of the robot is provided with an interactive touch screen, an identity card information reader, a camera, a voice recognition unit, and a face recognition unit. The rear part of the robot is provided with an electronic acupuncture treatment instrument. The robot is internally provided with a central controller that stores a traditional Chinese medicine database. The central controller is signal connected with the electronic acupuncture treatment instrument, the interactive touch screen, the identity card information reader, the camera, the voice recognition unit, and the face recognition unit. The robot can accurately diagnose the patient's condition, provide ideal Chinese medicine prescriptions and acupuncture prescriptions for the patient, greatly shorten the patient's treatment time, be suitable for use in communities, streets, or rural areas, meet the urgent needs of the general public for medical diagnosis and treatment, improve people's quality of life, and have great social significance.

[0005] For example, existing technology CN201811083911.X discloses an intelligent TCM diagnosis and treatment integrated machine, which includes a body. The body consists of a seat with simulated TCM physiotherapy and pulse diagnosis devices, and a pedal connected to the inner side of the front leg of the seat, featuring a desktop, baffle, intelligent monitoring and control system, and support. The intelligent monitoring and control system comprises a display with a human-computer interaction interface, an information storage device, an information acquisition device, a network communication device, a cloud data transmission device, a voice consultation device, a microprocessor, control circuitry, and a power supply and mobile terminal monitoring and control device. The information acquisition device includes a vital sign sensor located on the upper part of the seat back, two tongue, eye, and hand diagnosis devices with cameras and flashlights on the desktop, and a respiratory diagnosis device with a breath sensor. This invention has multiple functions of simulated TCM physiotherapy, multiple simulated TCM diagnosis, and remote TCM diagnosis and rehabilitation education.

[0006] For example, existing technology CN201811048707.4 discloses an artificial intelligence-based traditional Chinese medicine (TCM) diagnosis and treatment system, including: a data acquisition module, a data analysis module, a database management module, a prescription module, and a terminal device. The data acquisition module sends the collected data information to the data analysis module; the data analysis module analyzes the data information and sends the results to both the database management module and the prescription module; the database management module stores the results; and the prescription module provides suggested prescriptions based on the results. This TCM diagnosis and treatment system relies on intelligent devices to conveniently collect information from the four diagnostic methods of inspection, auscultation, inquiry, and palpation, scientifically and objectively analyzes patients, and provides reasonable diagnostic results and prescriptions, greatly facilitating patients' access to medical care and improving the speed of diagnosis and treatment. Simultaneously, through continuous data collection and AI learning based on big data, the system continuously improves the accuracy of diagnostic and treatment decisions, summarizes and even discovers new patterns, and alleviates conflicts to a certain extent.

[0007] In the above scheme, the diagnosis and treatment results are displayed on the interactive touch screen in the form of text or pictures by generating result sheets or prescription sheets. The text is extensive and complex, and ordinary users without TCM knowledge usually cannot quickly understand their physical condition through the results or prescription sheets. In other words, the presentation of the analysis results given by the above device is not intuitive.

[0008] In addition, the aforementioned diagnostic and treatment device uses a single screen to display the user's medical information. The information that can be displayed on a single screen is limited, and data results and other content (such as prescriptions) need to be displayed in pages, resulting in a poor user experience.

[0009] In traditional Chinese medicine, it is believed that the physiological blood and qi of the human body is directly related to the waxing and waning of the moon. For example, Suwen · Eight Spirits Theory records: "When the moon is born, the blood and qi begin to flow; when the moon is full, the blood and qi are full, and the muscles are strong; when the moon is empty, the muscles decrease, and the meridians are empty. The defensive qi leaves, and the body is alone." Again, Suwen · Eight Spirits points out: "When the moon is full, there is no need to supplement, and when the moon is empty, there is no need to treat." Therefore, in the field of traditional Chinese medicine, the moon phase is also commonly used to represent the state of the human body. For example, the first quarter of the moon represents the vigorous and full state of the human body, so the spirit is good, the physical energy is abundant, and the disease resistance is strong. The last quarter of the moon represents the weak and decaying state of the human body, so the spirit and physical energy are poor, and the body's resistance is weak.

[0010] Therefore, there is an urgent need for a method and system that can visually represent the state of the body in the form of a moon phase during traditional Chinese medicine diagnosis and treatment. SUMMARY

[0011] The purpose of the present application is to provide an interactive method and system applied in traditional Chinese medicine diagnosis and treatment, which can partially alleviate or solve the above-mentioned deficiencies, and can visually show the user's body state in the form of a moon phase.

[0012] In order to solve the above-mentioned technical problems, the present application specifically adopts the following technical scheme: an interactive system applied in traditional Chinese medicine diagnosis and treatment, comprising a traditional Chinese medicine diagnosis and treatment auxiliary device and a master control device;

[0013] The traditional Chinese medicine diagnosis and treatment auxiliary device comprises a base, a support arranged on the base, a fixed interactive screen fixedly arranged on the support, and a movable interactive screen slidingly arranged along the height direction of the support; the fixed interactive screen is provided with an image acquisition device for acquiring face information of a user; further comprising a driving mechanism and a transmission mechanism connected with the driving mechanism, the transmission mechanism is connected with the movable interactive screen, and under the action of the driving mechanism, the transmission mechanism can drive the movable interactive screen to reciprocate between a first position and a fifth position of the side wall of the support;

[0014] The master control device comprises:

[0015] A model training module configured to train a pre-constructed machine learning model based on pre-constructed training samples to obtain a neural network model, the training samples comprising: face image data of a plurality of users, the face image data comprising face information, tongue information, skin state and facial features; and the face image data is pre-labeled by an expert with corresponding body state and corresponding moon phase type;

[0016] An image acquisition module configured to acquire face image data of a current user from the traditional Chinese medicine diagnosis and treatment auxiliary device;

[0017] a body state evaluation module configured to evaluate a body state of the current user based on the neural network model and the current facial image data of the user to obtain a body state score of the current user;

[0018] a data processing module configured to determine whether the body state score is greater than or equal to a first preset threshold value, and if yes, control the mobile interactive screen to move to a first position;

[0019] if no, determine whether the body state score is greater than or equal to a third preset threshold value, and if yes, control the mobile interactive screen to move to a third position;

[0020] if no, determine whether the body state score is greater than or equal to a fifth preset threshold value, and if yes, control the mobile interactive screen to move to a fifth position;

[0021] wherein, when the mobile interactive screen is located at the first position, the mobile interactive screen and the fixed interactive screen completely overlap, and the mobile interactive screen or the fixed interactive screen located at the front side displays the data analysis result; when the mobile interactive screen is located at the third position, the mobile interactive screen and the fixed interactive screen partially overlap, the fixed interactive screen displays the data analysis result, and the mobile interactive screen displays a health preservation scheme matched according to the body state score; when the mobile interactive screen is located at the fifth position, the mobile interactive screen is located below the fixed interactive screen, the fixed interactive screen displays the data analysis result, and the mobile interactive screen displays the health preservation scheme matched according to the body state score.

[0022] As an improvement, the data processing module is further configured to determine whether the position of the mobile interactive screen is located at the first position when the body state score is greater than or equal to the first preset threshold value, and if yes, the mobile interactive screen remains at the first position, and if no, control the mobile interactive screen to move to the first position.

[0023] As an improvement, the data processing module is further configured to match at least one health preservation video tutorial for the current user according to the body state score when the body state score is less than the first preset threshold value, and control the mobile interactive screen to move to the fifth position and display a tutorial interface and a follow-up practice interface in the fixed interactive screen and the mobile interactive screen respectively after the user selects the health preservation video tutorial.

[0024] As an improvement, the data processing module is further configured to determine whether the position of the mobile interactive screen is located at the fifth position after the user selects the video tutorial, and if yes, the mobile interactive screen remains at the fifth position, and if no, control the mobile interactive screen to move to the fifth position.

[0025] As an improvement, the data processing module is further configured to determine whether the body state score is greater than or equal to a second set threshold before determining whether the body state score is greater than or equal to a third set threshold, and if so, moving the mobile interactive screen to a second position; if not, determining whether the body state score is greater than or equal to the third set threshold; and,

[0026] Before determining whether the body state score is greater than or equal to a fifth set threshold, determining whether the body state score is greater than or equal to a fourth set threshold, and if so, moving the mobile interactive screen to a fourth position; if not, determining whether the body state score is greater than or equal to the fifth set threshold.

[0027] The application also provides an interactive method applied in traditional Chinese medicine diagnosis and treatment, based on the above-mentioned interactive system applied in traditional Chinese medicine diagnosis and treatment, comprising the following steps:

[0028] S101 training a pre-constructed machine learning model based on pre-constructed training samples to obtain a neural network model, the training samples including: facial image data of multiple users, the facial image data including facial information, tongue information, skin state and facial features; and the facial image data is pre-labeled by experts with corresponding body states and corresponding lunar phase types;

[0029] S102 obtaining facial image of a current user;

[0030] S103 performing body state evaluation based on the neural network model and the facial image of the current user to obtain a body state score of the current user;

[0031] S104a determining whether the body state score is greater than or equal to a first set threshold, and if so, controlling the mobile interactive screen to move to a first position;

[0032] S104c if not, determining whether the body state score is greater than or equal to a third set threshold, and if so, controlling the mobile interactive screen to move to a third position;

[0033] S104e if not, determining whether the body state score is greater than or equal to a fifth set threshold, and if so, controlling the mobile interactive screen to move to a fifth position;

[0034] Specifically, when the mobile interactive screen is in the first position, the fixed interactive screen and the mobile interactive screen completely overlap, and the mobile interactive screen or the fixed interactive screen in front displays the data analysis results; when the mobile interactive screen is in the third position, the fixed interactive screen and the mobile interactive screen partially overlap, the fixed interactive screen displays the data analysis results, and the mobile interactive screen displays the health regimen matched based on the body condition score; when the mobile interactive screen is in the fifth position, the mobile interactive screen is below the fixed interactive screen, the fixed interactive screen displays the data analysis results, and the mobile interactive screen displays the health regimen matched based on the body condition score.

[0035] As an improvement, S104a further includes: when the physical condition score is greater than or equal to a first preset threshold, determining whether the position of the mobile interactive screen is located at a first position; if yes, then not moving the mobile interactive screen; if no, then controlling the mobile interactive screen to move to the first position.

[0036] As an improvement, the method further includes the step: S105 When the physical condition score is less than a first set threshold, at least one video tutorial is matched for the current user based on the physical condition score, and when the user selects the video tutorial, the mobile interactive screen is controlled to move to the fifth position, and the tutorial interface and the follow-up interface are displayed on the fixed interactive screen and the mobile interactive screen respectively.

[0037] As an improvement, S105 further includes determining whether the position of the mobile interactive screen is located at the fifth position after the user selects the video tutorial. If yes, the mobile interactive screen remains at the fifth position; otherwise, the mobile interactive screen is controlled to move to the fifth position.

[0038] As an improvement, this method also includes the following steps:

[0039] Before determining whether the body status score is greater than or equal to the third preset threshold, S104b determines whether the body status score is greater than or equal to the second preset threshold. If so, the mobile interactive screen is controlled to move to the second position; otherwise, proceed to S104c.

[0040] Before determining whether the body status score is greater than or equal to the fifth preset threshold, S104d determines whether the body status score is greater than or equal to the fourth preset threshold. If so, the mobile interactive screen is controlled to move to the fourth position; otherwise, proceed to S104e.

[0041] The principle and beneficial effects of this invention are as follows:

[0042] This application provides an interactive method and system that is simple and convenient to use and provides more intuitive results for application in traditional Chinese medicine diagnosis and treatment. It assesses the user's physical condition based on the user's facial information, and then controls the dual screens in the traditional Chinese medicine diagnosis and treatment auxiliary device to display different lunar phases based on the user's physical condition score (for example, different relative positions of the fixed interactive screen and the mobile interactive screen will display different lunar phases), so that the user can quickly and intuitively know the general situation of his / her physical condition.

[0043] Furthermore, when a user selects a system-recommended video tutorial and practices along with it, the video tutorial and the practice video can be displayed in split-screen mode using a fixed interactive screen and a mobile interactive screen (for example, when the mobile interactive screen is in the fifth position). This avoids the inconvenience caused by only displaying the video tutorial on a single screen and not being able to display the practice video, which would prevent users from checking their practice progress in real time, such as whether the movements are correct or whether they have made mistakes. Alternatively, it avoids the inconvenience caused by shrinking one of the video tutorials and practice videos when they are displayed on a single screen (for example, if the video tutorial is shrunk, the movements cannot be seen clearly; if the practice video is shrunk, it is not clear whether one has made mistakes).

[0044] Meanwhile, users can interact with the device through the dual screens on the auxiliary device. Users can make their own choices based on the conditioning suggestions and / or video tutorials provided by the auxiliary device, thus providing users with more freedom of choice and helping them choose a conditioning plan that suits them. Attached Figure Description

[0045] To more clearly illustrate the technical solutions in the embodiments of the present invention or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. In all the drawings, similar elements or parts are generally identified by similar reference numerals. The elements or parts in the drawings are not necessarily drawn to scale. Obviously, the drawings described below are some embodiments of the present invention, and those skilled in the art can obtain other drawings based on these drawings without any creative effort.

[0046] Figure 1 This is a schematic diagram of the overall structure of a traditional Chinese medicine diagnostic and treatment auxiliary device according to an exemplary embodiment of the present invention;

[0047] Figure 2 This is a schematic diagram of the internal structure of a traditional Chinese medicine diagnostic and treatment auxiliary device according to an exemplary embodiment of the present invention;

[0048] Figure 3 This is a schematic diagram from another angle of an exemplary embodiment of the traditional Chinese medicine diagnosis and treatment auxiliary device of the present invention;

[0049] Figure 4 This is a partial structural schematic diagram of a transmission mechanism according to an exemplary embodiment of the present invention;

[0050] Figure 5a This is a partial exploded view of a traditional Chinese medicine diagnostic and treatment auxiliary device according to an exemplary embodiment of the present invention;

[0051] Figure 5b Another partially exploded view of a traditional Chinese medicine diagnostic and treatment auxiliary device, which is an exemplary embodiment of the present invention;

[0052] Figure 6a This is a schematic diagram illustrating the state of the mobile interactive screen located at a certain position between the first position and the fifth position in an exemplary embodiment of the present invention;

[0053] Figure 6b This is a schematic diagram illustrating the state of the mobile interactive screen in another position between the first position and the fifth position in an exemplary embodiment of the present invention;

[0054] Figure 7 This is a schematic diagram of the modular structure of the interactive system in this invention;

[0055] Figure 8 This is a flowchart illustrating the interactive method applied to TCM diagnosis and treatment in this invention.

[0056] The markings in the diagram are: 1. Base; 2. Support; 3. Fixed interactive screen; 4. Mobile interactive screen; 5. Image acquisition device; 6. Transmission mechanism; 601. Transmission shaft; 602. Transmission pulley; 603. Pull cable; 7. Drive mechanism; 8. Slider; 9. Moving wheel. Detailed Implementation

[0057] To make the objectives, technical solutions, and advantages of the embodiments of the present invention clearer, the technical solutions of the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some, not all, of the embodiments of the present invention. All other embodiments obtained by those skilled in the art based on the embodiments of the present invention without creative effort are within the scope of protection of the present invention.

[0058] In this document, suffixes such as "module," "part," or "unit" used to denote elements are used only for the purpose of illustrative purposes and have no specific meaning in themselves. Therefore, "module," "part," or "unit" may be used interchangeably.

[0059] In this document, the terms "upper," "lower," "inner," "outer," "front," "rear," "one end," and "the other end," etc., indicate the orientation or positional relationship based on the orientation or positional relationship shown in the accompanying drawings. They are used only for the convenience of describing the present invention and for simplifying the description, and do not indicate or imply that the device or element referred to must have a specific orientation, or be constructed and operated in a specific orientation. Therefore, they should not be construed as limitations on the present invention. Furthermore, the terms "first" and "second" are used for descriptive purposes only and should not be construed as indicating or implying relative importance.

[0060] In this document, unless otherwise explicitly specified and limited, the terms "installed," "equipped with," "connected," etc., should be interpreted broadly. For example, "connection" can be a fixed connection, a detachable connection, or an integral connection; it can be a mechanical connection, a direct connection, or an indirect connection through an intermediate medium; it can be a connection within two components. Those skilled in the art can understand the specific meaning of the above terms in this invention based on the specific circumstances.

[0061] In this document, "and / or" includes any and all combinations of one or more of the listed related items.

[0062] In this article, "multiple" means two or more, that is, it includes two, three, four, five, etc.

[0063] Example 1

[0064] This embodiment is basically as follows: Figures 1-6b As shown,

[0065] like Figure 1 As shown, the present invention provides a TCM diagnosis and treatment auxiliary device, including a base 1, a bracket 2 disposed on the base, a fixed interactive screen 3 fixedly disposed on the bracket, and a movable interactive screen 4 slidably disposed along the height direction of the bracket; the fixed interactive screen 3 is provided with an image acquisition device 5 for collecting user facial information;

[0066] Both the fixed interactive screen and the mobile interactive screen are interactive touch screens.

[0067] like Figure 2 As shown, the device also includes a drive mechanism 7 (preferably a motor) and a transmission mechanism 6 connected to the drive mechanism. The transmission mechanism 6 is connected to the mobile interactive screen 4. Under the action of the drive mechanism 7, the transmission mechanism 6 can drive the mobile interactive screen 4 to reciprocate between the first position and the fifth position on the side wall of the bracket.

[0068] When the drive mechanism drives the transmission mechanism to move the mobile interactive screen to the first position, the fixed interactive screen and the mobile interactive screen completely overlap to present the full moon phase (i.e., waxing), which indicates that the user's physical condition is very good, for example, good blood and qi, or very good health.

[0069] When the drive mechanism drives the transmission mechanism to move the mobile interactive screen to the fifth position, the mobile interactive screen is located below the fixed interactive screen, thus presenting the phase of a new moon (i.e., waning), which indicates that the user's physical condition is very poor, for example, a large deficiency of qi and blood, or a very poor health condition.

[0070] When the driving mechanism drives the transmission mechanism to move the mobile interactive screen to any position between the first position and the fifth position, the fixed interactive screen and the mobile interactive screen partially overlap, such as... Figure 6a and Figure 6b As shown, this presents different lunar phases that represent different physical states.

[0071] In some embodiments, when the mobile interactive screen is located below the fixed interactive screen, it means that the two interactive screens are offset in the vertical direction. Furthermore, since the mobile interactive screen and the fixed interactive screen are arranged side by side in the vertical direction, when the mobile interactive screen is located below the fixed interactive screen, the mobile interactive screen is not located directly below the fixed interactive screen, but rather below its front or rear side.

[0072] In some embodiments, the fixed interactive screen and the mobile interactive screen are discs of the same size and shape.

[0073] Depending on the relative positions of the mobile and fixed interactive screens, the fixed interactive screen will display different states. For example, when the mobile and fixed interactive screens overlap, the fixed interactive screen displays the first lunar phase, which is the full moon. When the mobile and fixed interactive screens partially overlap, different lunar phases will be displayed depending on the size of the overlapping part, such as the crescent moon, the first quarter moon, and the waning crescent moon. When the mobile interactive screen is below the fixed interactive screen, the fixed interactive screen displays the second lunar phase, which is the new moon. Corresponding to the theory in traditional Chinese medicine, when the moon is waning, a person's qi and blood are relatively weak (deficient), and when the moon is full, qi and blood are relatively abundant (full). The waxing and waning of the moon is closely related to the functions of the human body's internal organs and the state of qi and blood.

[0074] In other words, as the mobile interactive screen moves from the first position to the fifth position, the phases of the moon displayed on the two screens change from waxing to waning, which represents the change in the body's condition from good to bad. In this way, the user's physical condition can be intuitively understood through the changes in the moon phase.

[0075] In some embodiments, a second, third, and fourth position are also included between the first and fifth positions. These five different positions constitute different lunar phases, corresponding to five different states of the human body. Specifically, the driving mechanism using a transmission mechanism to move the mobile interactive screen to different displacements is existing technology and will not be elaborated here.

[0076] In some embodiments, such as Figure 2 The side wall of the bracket is provided with a slide rail, and a slider 8 is slidably mounted on the slide rail. The slider 8 is fixedly connected to the mobile interactive screen 4; correspondingly, as... Figures 4-5b As shown, the transmission mechanism includes a transmission shaft 601 connected to the output shaft of the drive mechanism 7. Transmission pulleys 602 are respectively provided at both ends of the transmission shaft 601. A pull wire 603 and a pulley group are provided in the slide rail. The pulley group is located at the top of the slide rail. One end of the pull wire 603 is connected to the slider 8, and the other end passes through the transmission pulley 602 and the pulley group in sequence and is connected to the slider 8.

[0077] When the drive mechanism drives the transmission pulley to rotate through the transmission shaft, the transmission pulley drives the pull wire to move through friction, and the pull wire drives the mobile interactive screen to move between the first position and the fifth position through the slider.

[0078] In some embodiments, the support includes a symmetrically arranged left support and a right support, with a slide rail and a slider respectively provided on the left and right supports, and the mobile interactive screen is fixedly connected to the two sliders respectively. By setting two symmetrical supports and slide rails and sliders, the entire device can be made more aesthetically pleasing and more stable.

[0079] In some embodiments, the bracket is equipped with five switches. When the user presses each of the five switches, a drive mechanism is activated to move the interactive screen to the first, second, third, fourth, and fifth positions, respectively. By setting five switches, the user can understand the corresponding position for each month by pressing the switches. Alternatively, the device can be pre-programmed with descriptions of different physical states corresponding to each month, allowing the user to intuitively understand their current physical or health status based on the different lunar phases. Preferably, this physical state refers to the user's state of qi and blood deficiency.

[0080] In addition, a power switch is also provided on the bracket.

[0081] In some embodiments, since a fixed interactive screen and a mobile interactive screen are provided, split-screen display can be performed when the content to be displayed is different or numerous. Split-screen display is existing technology and will not be elaborated here. Specifically, the display content can be distributed by a host computer (e.g., various existing diagnostic robots or intelligent computing devices). For example, when the mobile interactive screen is located in the first position, it is directly in front of the fixed interactive screen, and at this time, the mobile interactive screen can display facial image information of the user collected by the image acquisition device, etc.

[0082] For example, the fixed interactive screen can also display the results of the user's physical condition data analysis, while the mobile interactive screen displays various corresponding health care solutions, such as conditioning suggestions and / or video tutorial suggestions; the partitioned display screen design further makes the device more intuitive to use, thereby improving the user experience.

[0083] In other embodiments, when the mobile interactive screen is located in the first position, it can also be located directly behind the fixed interactive screen. In this case, the fixed interactive screen can display facial image information of the user collected by the image acquisition device. That is to say, the mobile interactive screen or the fixed interactive screen can be set on the front side according to actual needs, and correspondingly, the lunar phase is obtained by varying degrees of obstruction on the rear side.

[0084] In some embodiments, such as Figure 3 As shown, the bottom of the base is provided with at least two casters 9 (preferably omnidirectional casters) to facilitate the movement of the device.

[0085] In some embodiments, the fixed interactive screen and the mobile interactive screen overlap in the initial state. When the user stands in front of the auxiliary device and faces the fixed interactive screen or the mobile interactive screen located in front, the image acquisition device acquires the user's facial image and sends it to the host computer (e.g., an existing TCM diagnosis and treatment robot or intelligent computer) wirelessly or via wired means for data processing. The host computer sends a corresponding trigger signal to the drive mechanism to drive the pull wire to move the slider to one of the five positions, thereby presenting different phases of the moon to show different physical states of the user.

[0086] Example 2

[0087] like Figure 7 As shown, the present invention also provides an interactive system for TCM diagnosis and treatment, including the TCM diagnosis and treatment auxiliary device and main control device of the above embodiment 1;

[0088] The TCM diagnostic and treatment auxiliary device includes a base, a bracket mounted on the base, a fixed interactive screen fixedly mounted on the bracket, and a movable interactive screen slidably mounted along the height direction of the bracket. The fixed interactive screen is equipped with an image acquisition device for collecting user facial information. It also includes a drive mechanism and a transmission mechanism connected to the drive mechanism. The transmission mechanism is connected to the movable interactive screen. Under the action of the drive mechanism, the transmission mechanism can drive the movable interactive screen to reciprocate between a first position and a fifth position on the side wall of the bracket.

[0089] The main control device includes:

[0090] Model training module: configured to train a pre-built machine learning model based on pre-built training samples to obtain a neural network model for evaluating the user's physical condition. The training samples include: facial image data of multiple users, including facial information, tongue information, skin condition and facial features. The facial image data is pre-labeled by TCM experts to correspond to their respective physical conditions (scores) and corresponding lunar phase types.

[0091] Image acquisition module: configured to acquire the current user's facial image data from the aforementioned TCM diagnostic and treatment auxiliary device;

[0092] Body condition assessment module: configured to perform body condition assessment based on the neural network model and the current user's facial image data to obtain the current user's body condition score (e.g., blood and qi deficiency score);

[0093] Data processing module: configured to determine whether the body status score is greater than or equal to a first set threshold; if so, control the mobile interactive screen to move to a first position.

[0094] If not, determine whether the physical condition score is greater than or equal to the third set threshold; if so, control the mobile interactive screen to move to the third position.

[0095] If not, determine whether the physical condition score is greater than or equal to the fifth set threshold; if so, control the mobile interactive screen to move to the fifth position.

[0096] Specifically, when the mobile interactive screen is in the first position, the fixed interactive screen and the mobile interactive screen completely overlap, and the mobile interactive screen or the fixed interactive screen in front displays the data analysis results; when the mobile interactive screen is in the third position, the fixed interactive screen and the mobile interactive screen partially overlap, the fixed interactive screen displays the data analysis results, and the mobile interactive screen displays a health regimen matched based on the body condition score, including conditioning suggestions and / or video tutorial suggestions; when the mobile interactive screen is in the fifth position, the mobile interactive screen is below the fixed interactive screen, the fixed interactive screen displays the data analysis results, and the mobile interactive screen displays a health regimen matched based on the body condition score, including conditioning suggestions and / or video tutorial suggestions.

[0097] Specifically, when the fixed interactive screen and the mobile interactive screen completely overlap, it corresponds to the first lunar phase, which is the full moon, and is in a "waxing" state. When the mobile interactive screen is below the fixed interactive screen, the fixed interactive screen displays the second lunar phase, which is the new moon, and is in a "waning" state. When the fixed interactive screen and the mobile interactive screen partially overlap, the fixed interactive screen displays other lunar phases, such as the crescent moon and the waning crescent moon, which is between "waxing" and "waning". In other words, as the mobile interactive screen moves from the first position to the fifth position, it corresponds to the change of lunar phases from waxing to waning in traditional Chinese medicine, representing a change in the body's condition from good to bad.

[0098] The treatment suggestions include dietary therapy, classic prescriptions, health exercises, tea therapy, acupressure, and music therapy; the video tutorials include Baduanjin, Tai Chi, and Yijinjing.

[0099] In some embodiments, the main control device may be integrated into a mobile interactive screen, a fixed interactive screen, or a base. Of course, in other embodiments, the main control device may also be a host computer, including a smart terminal capable of wireless or wired data communication with the TCM diagnostic and treatment auxiliary device. For example, a smart mobile terminal or a computer device.

[0100] Compared to presenting test reports in text format, this solution utilizes a dual-screen interactive system. The relative displacement between the two screens is controlled based on the user's physical condition, thus displaying different lunar phases. This allows users, even without professional knowledge, to intuitively understand their physical state based on the lunar phases, significantly improving the user experience. Furthermore, the dual-screen split-screen display allows users to simultaneously view two different types of information, such as video tutorials and practice videos, greatly enhancing the user experience.

[0101] In some embodiments, the data processing module is further configured to determine whether the position of the mobile interactive screen is at a first position when the physical condition score is greater than or equal to a first preset threshold. If yes, the mobile interactive screen is not moved and is kept at the first position; otherwise, the mobile interactive screen is controlled to move to the first position.

[0102] In some embodiments, the data processing module is further configured to match at least one video tutorial for the current user based on the physical condition score when the physical condition score is less than a first preset threshold, and to control the mobile interactive screen to move to the fifth position after the user selects the video tutorial, while displaying the tutorial interface and the practice interface on the fixed interactive screen and the mobile interactive screen respectively.

[0103] In other words, when users select video tutorials to practice, the mobile interactive screen is positioned below the fixed interactive screen, meaning the two interactive screens are staggered, thus providing users with a better viewing experience and practice experience.

[0104] By displaying the tutorial interface and the practice interface on two separate interactive screens, the user experience becomes more intuitive. During the practice, the image acquisition module collects the user's practice image data and feeds it back to the data processing module for data analysis. The results of the practice data analysis are then displayed on the practice interface, and corresponding guidance information is matched according to the practice situation, thus providing real-time guidance to the user's practice.

[0105] In some embodiments, users can enter keywords for video tutorials on the mobile interactive screen to search and select specific video tutorials to practice. That is, users can choose the video tutorials they want to practice; or, after the initial diagnosis and practice, users do not need to undergo a re-diagnosis when practicing again; they only need to manually enter keywords to search for specific video tutorials.

[0106] The data processing module is further configured to determine whether the position of the mobile interactive screen is at the fifth position after the user selects the video tutorial. If so, the mobile interactive screen is not moved and is kept at the fifth position. If not, the mobile interactive screen is controlled to move to the fifth position.

[0107] In some embodiments, the data processing module is further configured to determine whether the body state score is greater than or equal to a second preset threshold before determining whether the body state score is greater than or equal to a third preset threshold; if so, move the mobile interactive screen to a second position; if not, determine whether the body state score is greater than or equal to a third preset threshold; and,

[0108] Before determining whether the body status score is greater than or equal to the fifth preset threshold, determine whether the body status score is greater than or equal to the fourth preset threshold. If yes, move the mobile interactive screen to the fourth position; otherwise, determine whether the body status score is greater than or equal to the fifth preset threshold.

[0109] This solution provides users with an intuitive way to get feedback by setting up five different positions on the mobile interactive screen, corresponding to different lunar phases and different physical states of the user.

[0110] Example 3

[0111] like Figure 8 As shown, based on the above-mentioned interactive system applied to TCM diagnosis and treatment, the present invention also provides an interactive method applied to TCM diagnosis and treatment, comprising the following steps:

[0112] S101 trains a pre-built machine learning model based on pre-built training samples to obtain a neural network model. The training samples include: facial image data of multiple users, including facial information, tongue information, skin condition and facial features; the facial image data is pre-labeled by traditional Chinese medicine experts with their respective physical conditions (e.g., the degree of deficiency of qi and blood in the user's body) and their corresponding lunar phase type.

[0113] S102 Obtain the current user's facial image;

[0114] S103 performs a physical status assessment based on the neural network model and the current user's facial image to obtain the current user's physical status score; preferably, the physical status score refers to the degree of deficiency of the user's Qi and blood. The higher the score, the lower the degree of deficiency of Qi and blood, that is, the more sufficient the Qi and blood. If the score is lower, the degree of deficiency of Qi and blood is more serious; correspondingly, different degrees of deficiency of Qi and blood (that is, different physical states) correspond to different lunar phases.

[0115] S104a determines whether the body status score is greater than or equal to a first preset threshold. If so, it controls the mobile interactive screen to move to the first position.

[0116] If S104c is not, then determine whether the body status score is greater than or equal to the third set threshold. If it is, then control the mobile interactive screen to move to the third position.

[0117] If S104e is not, then determine whether the body status score is greater than or equal to the fifth set threshold. If it is, then control the mobile interactive screen to move to the fifth position.

[0118] Specifically, when the mobile interactive screen is in the first position, the fixed interactive screen and the mobile interactive screen completely overlap, and the mobile interactive screen or the fixed interactive screen in front displays the data analysis results; when the mobile interactive screen is in the third position, the fixed interactive screen and the mobile interactive screen partially overlap, the fixed interactive screen displays the data analysis results, and the mobile interactive screen displays a health regimen matched based on the body condition score, including conditioning suggestions and / or video tutorial suggestions; when the mobile interactive screen is in the fifth position, the mobile interactive screen is below the fixed interactive screen, the fixed interactive screen displays the data analysis results, and the mobile interactive screen displays a health regimen matched based on the body condition score, including conditioning suggestions and / or video tutorial suggestions.

[0119] In some embodiments, S104a further includes: when the physical condition score is greater than or equal to a first preset threshold, determining whether the position of the mobile interactive screen is located at a first position; if yes, then not moving the mobile interactive screen; if no, then controlling the mobile interactive screen to move to the first position.

[0120] In some embodiments, the method further includes the step of: S105 When the physical condition score is less than a first set threshold, at least one video tutorial is matched for the current user in the database according to the physical condition score, and when the user selects a video tutorial, the mobile interactive screen is controlled to move to the fifth position, and the tutorial interface and the follow-up interface are displayed on the fixed interactive screen and the mobile interactive screen respectively.

[0121] In some embodiments, S105 further includes determining whether the position of the mobile interactive screen is located at the fifth position after the user selects the video tutorial; if so, the mobile interactive screen is not moved and is kept at the fifth position; if not, the mobile interactive screen is controlled to move to the fifth position.

[0122] In some embodiments, the method further includes the step of: S104b determining whether the body status score is greater than or equal to a second preset threshold before determining whether the body status score is greater than or equal to a third preset threshold; if so, controlling the mobile interactive screen to move to a second position; otherwise, proceeding to S104c.

[0123] Before determining whether the body status score is greater than or equal to the fifth preset threshold, S104d determines whether the body status score is greater than or equal to the fourth preset threshold. If so, the mobile interactive screen is controlled to move to the fourth position; otherwise, proceed to S104e.

[0124] Furthermore, the aforementioned neural network model assesses a user's physical condition based on facial image data. While obtaining the user's physical condition score, it can also obtain the corresponding lunar phase. Therefore, the lunar phase type identified by the neural network model can be compared with the lunar phase type matched based on the physical condition score. If they are the same, the mobile interactive screen is moved to the corresponding position according to the corresponding lunar phase to display the corresponding lunar phase. If they are different, the user is prompted to re-collect facial image data. In other words, mutual verification reduces the probability of misjudgment.

[0125] It should be noted that, in this document, the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or apparatus. Unless otherwise specified, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the process, method, article, or apparatus that includes that element.

[0126] The embodiments of the present invention have been described above with reference to the accompanying drawings. However, the present invention is not limited to the specific embodiments described above. The specific embodiments described above are merely illustrative and not restrictive. Those skilled in the art can make many other forms under the guidance of the present invention without departing from the spirit and scope of the claims. All of these forms are within the protection scope of the present invention.

Claims

1. An interactive system applied to traditional Chinese medicine diagnosis and treatment, characterized in that, The application relates to a Chinese medicine diagnosis and treatment auxiliary device and a main control device. The Chinese medicine diagnosis and treatment auxiliary device comprises a base, a support arranged on the base, a fixed interactive screen fixedly arranged on the support, and a movable interactive screen arranged to slide along the height direction of the support; an image acquisition device for acquiring user facial information is arranged on the fixed interactive screen; a driving mechanism and a transmission mechanism connected with the driving mechanism are further included, the transmission mechanism is connected with the movable interactive screen, and under the action of the driving mechanism, the transmission mechanism can drive the movable interactive screen to reciprocate between a first position and a fifth position of the side wall of the support. The main control device comprises: a model training module configured to train a pre-constructed machine learning model based on pre-constructed training samples to obtain a neural network model for evaluating the physical state of a user, wherein the training samples comprise facial image data of multiple users, the facial image data comprises facial information, tongue information, skin state and facial features, and the facial image data is pre-labeled with corresponding physical states and corresponding lunar phase types by experts; an image acquisition module configured to acquire current user facial image data from the Chinese medicine diagnosis and treatment auxiliary device; a physical state evaluation module configured to evaluate the physical state of a current user based on the neural network model and current user facial image data to obtain a physical state score of the current user; a data processing module configured to determine whether the physical state score is greater than or equal to a first set threshold value, if yes, the movable interactive screen is controlled to move to the first position; if no, it is determined whether the physical state score is greater than or equal to a third set threshold value, if yes, the movable interactive screen is controlled to move to the third position; if no, it is determined whether the physical state score is greater than or equal to a fifth set threshold value, if yes, the movable interactive screen is controlled to move to the fifth position; 2. The interactive system for use in traditional Chinese medicine diagnosis and treatment according to claim 1, characterized in that, wherein when the movable interactive screen is located at the first position, the fixed interactive screen and the movable interactive screen completely overlap, and the movable interactive screen or the fixed interactive screen located at the front side displays a data analysis result; when the movable interactive screen is located at the third position, the fixed interactive screen and the movable interactive screen partially overlap, the fixed interactive screen displays a data analysis result, and the movable interactive screen displays a health preservation scheme matched according to the physical state score; when the movable interactive screen is located at the fifth position, the movable interactive screen is located below the fixed interactive screen, the fixed interactive screen displays a data analysis result, and the movable interactive screen displays a health preservation scheme matched according to the physical state score. The data processing module is further configured to determine whether the position of the movable interactive screen is located at the first position when the physical state score is greater than or equal to the first set threshold value, if yes, the movable interactive screen is kept at the first position, and if no, the movable interactive screen is controlled to move to the first position.

3. The interactive system for use in traditional Chinese medicine diagnosis and treatment according to claim 1, characterized in that, The data processing module is further configured to match at least one health preservation video tutorial for the current user according to the body state score when the body state score is less than a first set threshold, and control the mobile interactive screen to move to the fifth position when the user selects a health preservation video tutorial, while displaying a tutorial interface and a follow-up practice interface in the fixed interactive screen and the mobile interactive screen respectively.

4. The interactive system for use in traditional Chinese medicine diagnosis and treatment according to claim 3, characterized in that, The data processing module is further configured to judge whether the position of the mobile interactive screen is located at the fifth position after the user selects the video tutorial, and if yes, the mobile interactive screen remains at the fifth position, and if not, control the mobile interactive screen to move to the fifth position.

5. The interactive system for use in traditional Chinese medicine diagnosis and treatment according to claim 1, characterized in that, The data processing module is further configured to judge whether the body state score is greater than or equal to a second set threshold before judging whether the body state score is greater than or equal to a third set threshold, and if yes, move the mobile interactive screen to a second position; and if not, judge whether the body state score is greater than or equal to a third set threshold; and, Judge whether the body state score is greater than or equal to a fourth set threshold before judging whether the body state score is greater than or equal to a fifth set threshold, and if yes, move the mobile interactive screen to a fourth position; and if not, judge whether the body state score is greater than or equal to a fifth set threshold.

6. An interactive method applied in traditional Chinese medicine diagnosis and treatment, characterized in that, The interactive system applied in traditional Chinese medicine diagnosis and treatment according to any one of claims 1 to 5 comprises the following steps: S101 training a pre-constructed machine learning model based on pre-constructed training samples to obtain a neural network model, wherein the training samples include: facial image data of multiple users, the facial image data including facial information, tongue information, skin state and facial features; and the facial image data is pre-labeled with corresponding body states and corresponding lunar phase types by experts; S102 obtaining facial image of a current user; S103 performing body state evaluation based on the neural network model and the facial image of the current user to obtain a body state score of the current user; S104a judging whether the body state score is greater than or equal to a first set threshold, and if yes, controlling the mobile interactive screen to move to a first position; S104c if not, judging whether the body state score is greater than or equal to a third set threshold, and if yes, controlling the mobile interactive screen to move to a third position; S104e if not, judging whether the body state score is greater than or equal to a fifth set threshold, and if yes, controlling the mobile interactive screen to move to a fifth position; When the mobile interaction screen is in the first position, the mobile interaction screen and the fixed interaction screen completely overlap, and the mobile interaction screen or the fixed interaction screen located at the front side displays the data analysis result; when the mobile interaction screen is in the third position, the mobile interaction screen and the fixed interaction screen partially overlap, the fixed interaction screen displays the data analysis result, and the mobile interaction screen displays the health regimen matched according to the body state score; when the mobile interaction screen is in the fifth position, the mobile interaction screen is located below the fixed interaction screen, the fixed interaction screen displays the data analysis result, and the mobile interaction screen displays the health regimen matched according to the body state score.

7. The interactive method for use in traditional Chinese medicine diagnosis and treatment according to claim 6, characterized in that, S104a further comprises: When the body state score is greater than or equal to the first set threshold, it is determined whether the position of the mobile interaction screen is in the first position, if yes, the mobile interaction screen is not moved, and if no, the mobile interaction screen is controlled to move to the first position.

8. The interactive method for use in traditional Chinese medicine diagnosis and treatment according to claim 6, characterized in that, Further comprising a step: S105, when the body state score is less than the first set threshold, at least one video tutorial is matched for the current user according to the body state score, and when the user selects the video tutorial, the mobile interaction screen is controlled to move to the fifth position, and a tutorial interface and a follow-up training interface are displayed in the fixed interaction screen and the mobile interaction screen, respectively.

9. The interactive method for use in traditional Chinese medicine diagnosis and treatment according to claim 8, characterized in that, S105 further comprises that after the user selects the video tutorial, it is determined whether the position of the mobile interaction screen is in the fifth position, if yes, the mobile interaction screen is kept in the fifth position, and if no, the mobile interaction screen is controlled to move to the fifth position.

10. The interactive method for use in traditional Chinese medicine diagnosis and treatment according to claim 6, characterized in that, Further comprising a step: S104b, before determining whether the body state score is greater than or equal to the third set threshold, it is determined whether the body state score is greater than or equal to the second set threshold, if yes, the mobile interaction screen is controlled to move to the second position; otherwise, S104c is entered; S104d, before determining whether the body state score is greater than or equal to the fifth set threshold, it is determined whether the body state score is greater than or equal to the fourth set threshold, if yes, the mobile interaction screen is controlled to move to the fourth position; otherwise, S104e is entered.

Images