Meridian interaction science popularization method and system based on multi-modal interaction and RGB spectral mapping

Abstract

The invention discloses a meridian interaction science popularization method and system based on multi-modal interaction and RGB spectral mapping, and relates to the technical field of traditional Chinese medicine science popularization education and human-computer interaction. According to the meridian interaction science popularization method and system based on multi-mode interaction and RGB spectral mapping, through three interaction modes of position sensing, gesture recognition and a touch screen, operation habits of different crowds are adapted, interaction is more immersive, gesture recognition is accurate, meanwhile, trigger deviation is avoided, traditional static display limitation is broken through, and the science popularization effect is better. Exclusive RGB colors are distributed to 14 meridians and collaterals according to the five-element theory, dynamic lighting effects are matched, abstract meridians and collaterals are converted into visual symbols, the cognition threshold is reduced, the voice broadcast function is synchronized, meridian knowledge is transmitted in multiple dimensions, small-week-day and large-week-day achievements of the 14 meridian and collateral modes are matched, the lighting effects and voice feedback are combined, and therefore the effect of the meridian and collateral channels is achieved. Public health cognition is enhanced, and interest and recognition of the public on traditional Chinese medicine culture are stimulated.

Description

TECHNICAL FIELD

[0001] The present application relates to the field of traditional Chinese medicine popular science education and human-computer interaction, in particular to a meridian interaction popular science method and system based on multi-modal interaction and RGB spectrum mapping. BACKGROUND

[0002] The current meridian display method mainly relies on posters, molds or flat screens, which has the following problems: Poor interactivity: traditional static models cannot respond to user operations and lack immersive experience; Insufficient accuracy: although a few existing multi-modal interaction systems introduce sensors, they do not combine human posture recognition to accurately locate the region or meridian, resulting in inaccurate user gesture triggering; Lack of interest: the existing system has a single display form, which is difficult to meet the diverse needs of the public in popular science and experience, Therefore, the meridian interaction popular science method and system based on multi-modal interaction and RGB spectrum mapping is proposed, which constructs a new system combining multi-modal interaction and light effect display, so that users can intuitively trigger the corresponding meridian display through natural gestures, touch or position sensing, and realize dynamic light effect and voice linkage to improve interactivity and interest. SUMMARY

[0003] In view of the deficiencies of the prior art, the meridian interaction popular science method and system based on multi-modal interaction and RGB spectrum mapping are provided, which solves the problems of poor interactivity, insufficient accuracy and lack of interest in the current meridian display method.

[0004] To achieve the above purpose, the following technical solutions are adopted: a meridian interaction popular science method based on multi-modal interaction and RGB spectrum mapping, specifically comprising the following steps: S1, mode configuration: set the global working mode through the touch screen, the global working mode including interaction mode selection and gesture recognition mode selection; The interaction mode selection includes position sensing mode, gesture recognition mode and touch screen trigger mode; The gesture recognition mode selection includes human body partition mode and 14 meridian mode; S2, trigger signal receiving: receiving multi-source input signals, the multi-source input signals including position sensing signals output by the position sensor, gesture signals collected by the RGB-D camera and touch screen area trigger signals output by the touch screen; When receiving the position sensing signal or the touch screen area trigger signal, the human body region or the meridian is acquired and transferred to S4; when receiving the gesture signal, it is transferred to S3; S3, gesture verification and region / meridian recognition: detecting the user's hand posture, determining whether the preset condition is met, if the preset condition is met, matching the gesture position with the human body region model or 14 meridian model based on the human body key point skeleton model, and determining the corresponding human body region or meridian; S4, attribute matching and light effect parameter generation: according to the human body region or meridian, calling the pre-stored meridian mapping table to obtain the five-element attributes of the corresponding human body region associated meridian or target meridian, and generating RGB light effect control parameters; S5, based on the RGB light effect control parameters, controlling the RGB human meridian spectrum screen to output dynamic light effects, and synchronously broadcasting the functions of the corresponding associated meridian, the associated human body parts and the TCM popular science knowledge.

[0005] The application further provides that: in the 14 meridian mode, when multiple different meridians are continuously recognized, the corresponding overall light effect template is triggered: When three different meridians are recognized, the small cycle meridian loop light effect is triggered; When 14 meridians are recognized, the large cycle whole body meridian light effect is triggered.

[0006] The application also discloses a meridian interaction popular science system based on multi-modal interaction and RGB spectrum mapping, which comprises an interactive input module, a control and processing module, a data storage module, a spectrum display module and a voice output module. The interactive input module comprises a position sensor, an RGB-D camera and a touch screen, and is used to send multi-source input signals to the control and processing module. The control and processing module serves as an AI host, and is used to generate dynamic light effect instructions and voice broadcast instructions according to the multi-source input signals. The spectrum display module serves as an RGB human meridian spectrum screen, and comprises a spectrum display module and an RGB addressing light strip, and is used to receive dynamic light effect instructions and output dynamic light effects. The voice output module serves as a sound box, and is used to receive voice broadcast instructions and synchronously broadcast the functions of the meridians, the associated human body parts and the TCM popular science knowledge. The data storage module is embedded in the control and processing module, and is used to store region models, meridian mapping tables and five-element color tables, wherein the region models comprise a human body region model, a 14 meridian model and a gesture verification model.

[0007] The application provides a meridian interaction popular science method and system based on multi-modal interaction and RGB spectrum mapping. The application is suitable for operation habits of different people through three interactive modes of position sensing, gesture recognition and touch screen, makes interaction more immersive, avoids trigger deviation while accurately recognizing gestures, breaks through the limitation of traditional static display, and allocates exclusive RGB colors to 14 meridians according to five-line theory, matches dynamic light effect, converts abstract meridians into visual symbols, reduces cognitive threshold, synchronously broadcasts functions, and transmits meridian knowledge in multiple dimensions, achieves small and large circles of 14 meridians mode, enhances public health cognition, and stimulates public interest and recognition of traditional Chinese culture. BRIEF DESCRIPTION OF DRAWINGS

[0008] Figure 1 It is a schematic diagram of the system architecture of the application. DETAILED DESCRIPTION

[0009] The technical solutions in the embodiments of the application will be clearly and completely described below with reference to the drawings in the embodiments of the application.

[0010] Please refer to Figure 1 The first aspect embodiment of the application provides a meridian interaction popular science method based on multi-modal interaction and RGB spectrum mapping, and has the characteristics that the method specifically includes the following steps: S1, mode configuration: setting a global working mode through a touch screen, and the global working mode includes interactive mode selection and gesture recognition mode selection; The interactive mode selection includes a position sensing mode, a gesture recognition mode and a touch screen trigger mode. The gesture recognition mode selection includes a human body partition mode and a 14-meridian mode, wherein the human body partition mode is used to divide the human body into head, face, neck, chest, abdomen, back, waist, hips, upper limbs, lower limbs and foot regions.

[0011] S2, trigger signal receiving: receiving multi-source input signals, the multi-source input signals include a position sensing signal output by a position sensor, a gesture signal collected by an RGB-D camera and a touch screen area trigger signal output by a touch screen; When the position sensing signal or the touch screen area trigger signal is received, the human body region or the meridian is acquired and transferred to S4; when the gesture signal is received, S3 is transferred.

[0012] S3, gesture verification and region / meridian recognition: detecting a hand posture of a user, determining whether a preset condition is met, if the preset condition is met, matching the gesture position with a human body region model or a 14-meridian model based on a human body key point skeleton model, and determining the corresponding human body region or meridian.

[0013] Further, the preset condition is that the user's index finger is straight, the remaining fingers are closed, and the distance between the fingers and the target region is within a preset threshold range, and the maximum preset threshold is 2 cm.

[0014] S4, attribute matching and light effect parameter generation: according to the human body region or meridian, the pre-stored meridian mapping table is called to obtain the five-element attributes of the corresponding human body region associated meridian or target meridian, and the RGB light effect control parameter is generated.

[0015] Wherein, the meridian mapping table contains the corresponding relationship between human body region and associated meridian, and the five-element attributes of the associated meridian and the corresponding light effect color are fixedly stored in the meridian mapping table, and the relationship between human body region and associated meridian is as follows: Chest→Ren Channel (Dantian), Liver Channel→Yellow Light Effect→Voice Broadcast Chest Related Knowledge; Abdomen→Ren Channel (Guanyuan, Qihai), Spleen Channel→Yellow Light Effect→Voice Broadcast Abdominal Related Knowledge; Back→Duke Channel, Bladder Channel→Deep Blue Purple Light Effect→Voice Broadcast Back Related Knowledge.

[0016] As a detailed description, the RGB light effect control parameter includes color, brightness, flow rate and pulse mode, wherein the color is generated based on the five-element attributes corresponding to the five-element theory of traditional Chinese medicine, and the corresponding relationship between the five-element attributes and the color is: gold-white, wood-green, water-deep blue purple, fire-red, and earth-yellow.

[0017] S5, control the RGB human meridian spectrum screen to output dynamic light effect based on the RGB light effect control parameter, and synchronously broadcast the function of the corresponding associated meridian, the associated human body part and the traditional Chinese medicine popular science knowledge.

[0018] In an exemplary embodiment, in the 14 meridian mode, when multiple different meridians are continuously identified, the corresponding overall light effect template is triggered: When three different meridians are identified, the small cycle meridian loop light effect is triggered; When 14 meridians are identified, the large cycle whole body meridian light effect is triggered.

[0019] The second aspect embodiment of the present application provides a meridian interaction popular science system based on multi-modal interaction and RGB spectrum mapping, which is applied to the above-mentioned meridian interaction popular science method based on multi-modal interaction and RGB spectrum mapping, and includes an interactive input module, a control and processing module, a data storage module, a spectrum display module and a voice output module. The interactive input module includes a position sensor, an RGB-D camera and a touch screen, which is used to send multi-source input signals to the control and processing module, wherein the position sensor selects a radar ranging sensor. The control and processing module is an AI host, which is used to generate dynamic light effect instructions and voice broadcast instructions according to multi-source input signals. The spectrum display module, as an RGB human meridian spectrum screen, comprises a spectrum display module and an RGB addressing light strip, and is configured to receive a dynamic light effect instruction and output a dynamic light effect; The voice output module, as a sound box, is configured to receive a voice broadcast instruction and synchronously broadcast a function of a meridian, a related human body part, and a TCM popular science knowledge; The data storage module is embedded in the control and processing module, and is configured to store a region model, a meridian mapping table, and a five-element color table. The region model comprises a human body region model, a 14-meridian model, and a gesture verification model.

[0020] In an exemplary embodiment, the control and processing module comprises a multi-mode selection unit, a gesture recognition unit, a position sensing analysis unit, a human body region recognition unit, a 14-meridian recognition unit, a meridian mapping unit, a light effect control unit, and an achievement triggering unit. The multi-mode selection unit is configured to respond to a working mode of the touch screen and configure an instruction. The gesture recognition unit is configured to perform gesture verification and region / meridian recognition. The human body region recognition unit is configured to perform matching of a gesture position with a human body region model. The 14-meridian recognition unit is configured to perform matching of a gesture position with a 14-meridian model. The meridian mapping unit is configured to call a meridian mapping table. The light effect control unit is configured to generate RGB light effect control parameters. The achievement triggering unit is configured to trigger a corresponding overall light effect template in a 14-meridian mode.

[0021] It should be noted that, in the present document, the terms such as first and second, etc. are used only to distinguish one entity or operation from another, and do not necessarily require or imply any such actual relationship or order between such entities or operations. Also, the terms “comprises”, “comprising”, or any other variant thereof are intended to cover non-exclusive inclusions, so that a process, method, article, or apparatus that comprises a list of elements does not only include those elements, but also other elements not expressly listed, or other elements inherent in such process, method, article, or apparatus.

[0022] Although embodiments of the present application have been shown and described, it is to be understood that various modifications, substitutions, replacements, and variations can be made to these embodiments without departing from the principles and spirit of the present application, and the scope of the present application is defined by the appended claims and their equivalents.

Claims

1. A meridian interaction popular science method based on multi-modal interaction and RGB spectral mapping, characterized in that, Specifically comprising the following steps: S1, mode configuration: setting a global working mode through a touch screen, the global working mode including an interaction mode selection and a gesture recognition mode selection; The interaction mode selection includes a position sensor mode, a gesture recognition mode and a touch screen trigger mode; The gesture recognition mode selection includes a human body partition mode and a 14-meridian mode; S2, trigger signal receiving: receiving multi-source input signals, the multi-source input signals including a position sensing signal output by a position sensor, a gesture signal collected by an RGB-D camera and a touch screen area trigger signal output by a touch screen; When receiving the position sensing signal or the touch screen area trigger signal, a human body region or meridian is acquired and the process goes to S4; when receiving the gesture signal, the process goes to S3; S3, gesture verification and region / meridian recognition: detecting a user's hand posture and determining whether a preset condition is met, if the preset condition is met, matching the gesture position with a human body region model or a 14-meridian model based on a human body key point skeleton model to determine the corresponding human body region or meridian; S4, attribute matching and light effect parameter generation: according to the human body region or meridian, calling a pre-stored meridian mapping table to acquire the five-element attributes of the corresponding human body region associated meridian or target meridian, and generating an RGB light effect control parameter; S5, controlling the RGB human meridian spectrum screen to output a dynamic light effect based on the RGB light effect control parameter, and synchronously broadcasting the function of the corresponding associated meridian, the associated human body part and the TCM popular science knowledge.

2. The meridian interaction popularization method based on multi-modal interaction and RGB spectral mapping according to claim 1, characterized in that, The human body partition mode is used to divide the human body into head, face, neck, chest, abdomen, back, waist, hips, upper limbs, lower limbs and foot regions.

3. The meridian interaction popularization method based on multi-modal interaction and RGB spectral mapping according to claim 1, characterized in that, The preset condition is that the user's index finger is straightened, the remaining fingers are closed, and the distance between the fingers and the target region is within a preset threshold range.

4. The meridian interaction popularization method based on multi-modal interaction and RGB spectral mapping according to claim 1, characterized in that, The meridian mapping table contains the corresponding relationship between the human body region and the associated meridian, and the five-element attributes and the corresponding light effect color of the associated meridian are fixedly stored in the meridian mapping table.

5. The meridian interaction popularization method based on multi-modal interaction and RGB spectral mapping according to claim 1, characterized in that, The RGB light effect control parameter includes color, brightness, flow rate and pulse mode.

6. The meridian interaction popularization method based on multi-modal interaction and RGB spectral mapping according to claim 5, characterized in that, The color is generated based on the five-element attributes corresponding to the five-element theory of traditional Chinese medicine, wherein the corresponding relationship between the five-element attributes and the color is: gold-white, wood-green, water-dark blue and purple, fire-red, and earth-yellow.

7. The meridian interaction popularization method based on multi-modal interaction and RGB spectral mapping according to claim 1, characterized in that, In the 14-meridian mode, when multiple different meridians are continuously recognized, the corresponding overall light effect template is triggered: When three different meridians are recognized, the small cycle meridian loop light effect is triggered; When 14 meridians are recognized, the large cycle whole body meridian light effect is triggered.

8. A meridian interaction popularization system based on multi-modal interaction and RGB spectral mapping, applied to the meridian interaction popularization method based on multi-modal interaction and RGB spectral mapping in any one of claims 1 to 7, characterized in that, It includes an interactive input module, a control and processing module, a data storage module, a spectrum display module and a voice output module. 9.The meridian interaction popularization system based on multi-modal interaction and RGB spectral mapping of claim 8, wherein, The interactive input module includes a position sensor, an RGB-D camera and a touch screen, which are used to send multi-source input signals to the control and processing module; The control and processing module serves as an AI host, which is used to generate dynamic light effect instructions and voice broadcast instructions according to the multi-source input signals; The spectrum display module serves as an RGB human meridian spectrum screen, which includes a spectrum display module and an RGB addressing light belt, and is used to receive dynamic light effect instructions and output dynamic light effects; The voice output module is used as a sound box to receive voice broadcast instructions and synchronously broadcast functions of meridians, associated human body parts and TCM popular science knowledge; The data storage module is embedded in the control and processing module and is used to store a region model, a meridian mapping table and a five-element color table, the region model including a human body region model, a 14-meridian model and a gesture verification model.

10. The meridian interaction popularization system based on multi-modal interaction and RGB spectral mapping according to claim 9, characterized in that, The control and processing module includes a multi-mode selection unit, a gesture recognition unit, a position sensing analysis unit, a human body region recognition unit, a 14-meridian recognition unit, a meridian mapping unit, a light effect control unit and an achievement triggering unit; The multi-mode selection unit is used to respond to the working mode of the touch screen and configure instructions; The gesture recognition unit is used to perform gesture verification and region / meridian recognition; The human body region recognition unit is used to perform matching of gesture positions and a human body region model; The 14-meridian recognition unit is used to perform matching of gesture positions and a 14-meridian model; The meridian mapping unit is used to call a meridian mapping table; The light effect control unit is used to generate RGB light effect control parameters; The achievement triggering unit is used to trigger corresponding overall light effect templates in the 14-meridian mode.

Images