An intelligent screen interaction method and intelligent screen based on AR and sensing technology

Abstract

The application relates to the field of intelligent screen interaction, and particularly discloses an intelligent screen interaction method based on AR and sensing technology and an intelligent screen, which comprises intelligent screen intelligent starting, target personnel characteristic parameter sensing, target personnel action dynamic guidance, target personnel action monitoring, analysis, correction and target personnel action playback feedback. The application effectively makes up for the deficiency that the current middle-aged and elderly people excessively rely on their own Tai Chi learning experience for autonomous outdoor exercise, leading to a lack of communication with the outside world. Dynamic Tai Chi learning through the intelligent screen can enable the target personnel to intuitively feel the action learning conditions of other Tai Chi researchers in the network, and then intuitively feel the defects of their own Tai Chi actions, which is beneficial to steadily and scientifically and effectively improving the Tai Chi research level of the target personnel, reducing potential motion risks of the target personnel due to the insufficiency of action standardization, and being beneficial to maintaining the health of the target personnel.

Description

Technical Field

[0001] This invention relates to the field of smart screen interaction technology, and more specifically, to a smart screen interaction method and a smart screen based on AR and sensing technology. Background Technology

[0002] People are paying more and more attention to their health, and promoting national fitness has become a social focus. Nowadays, parks and squares and other open-air venues have gradually become the preferred places for mass exercise. The development of smart technology has added more fun and diversity to people's exercise. If technology and mass exercise can be combined in complex open-air venues, it can provide the public with a richer and more diverse exercise experience.

[0003] As the main group of people in outdoor sports venues, the middle-aged and elderly people are most suited to gentle and slow exercise. Tai Chi movements are gentle and can increase the flexibility and agility of the body, as well as improve the body's immunity and resistance. Many middle-aged and elderly people choose to exercise Tai Chi in parks with elegant environment and fresh air. In this regard, there are still some areas that need to be optimized, which are reflected in: (1) At present, most middle-aged and elderly people rely on their own Tai Chi learning experience to carry out subjective and independent outdoor exercise. However, over-reliance on their own experience will lead to insufficient communication with the outside world and an inability to intuitively feel the movement learning situation of other Tai Chi learners online. Not only can they not intuitively feel the defects of their own Tai Chi movements, but they also cannot steadily and scientifically improve their Tai Chi learning level. Although Tai Chi is a gentle and slow exercise, for some people with osteoporosis, if they cannot master the reasonable strength and standardization of Tai Chi movements, it will also lead to some potential exercise risks. As time goes by, it will aggravate the degree of joint damage, which is not conducive to maintaining the health of Tai Chi learners.

[0004] (2) In addition, some people without Tai Chi learning experience have an interest and enthusiasm for learning Tai Chi, but they cannot obtain Tai Chi learning courses that suit their physical condition. At the same time, most of them ask to learn and correct their movements from experienced Tai Chi learners. However, there are inevitable limitations. There are inevitable differences in the physical condition between the Tai Chi movement instructors and inexperienced Tai Chi learners. As a result, inexperienced Tai Chi learners cannot have a clear and intuitive comparison and adjustment of Tai Chi movements. The Tai Chi movement instructors cannot also find the differences in the range and strength of the learners' movements in detail, which increases the error of Tai Chi learning movements. This not only indirectly reduces the efficiency of Tai Chi learning for learners, but also fails to provide scientific and reasonable support and guarantee for the safety of Tai Chi movements for learners. Summary of the Invention

[0005] To overcome the shortcomings of the prior art, embodiments of the present invention provide a smart screen interaction method and a smart screen based on AR and sensing technology, which can effectively solve the problems involved in the prior art.

[0006] The objective of this invention can be achieved through the following technical solution: The first aspect of this invention provides a smart screen interaction method based on AR and sensing technology, including: S1, smart screen intelligent opening: based on the predefined function recognition area of ​​the smart screen, target personnel are screened out, and then voice recognition is performed on the target personnel, thereby controlling the smart screen to be intelligently opened.

[0007] S2. Target Personnel Characteristic Parameter Perception: Perceive the characteristic parameters of the target personnel and analyze the compatibility coefficient between the target personnel and each suitable virtual teaching character, and extract the specified virtual teaching character accordingly.

[0008] S3. Dynamic guidance of target personnel's movements: Obtain the Tai Chi teaching course selected by the target personnel through voice, and have a designated virtual teaching character provide dynamic guidance on the target personnel's Tai Chi movements.

[0009] S4. Monitoring, Analysis and Correction of Target Personnel's Movements: Monitor the Tai Chi movements of the target personnel, calculate the conformity coefficient of each joint of the target personnel's movements in each set teaching time period, and then provide guidance and correction for the movements of each joint of the target personnel in each set teaching time period.

[0010] S5. Target Personnel Movement Replay Feedback: Based on the movement compliance coefficient of each joint of the target personnel in each set teaching time period, the comprehensive compliance coefficient of the Tai Chi movement of the target personnel in each set teaching time period is calculated. Based on this, the Tai Chi movement of the target personnel is corrected according to their needs, and corresponding movement playback feedback is provided.

[0011] As a further design of the present invention, the specific screening process of the target personnel is as follows: based on the predefined functional recognition area of ​​the smart screen, the personnel entering the functional recognition area are subjected to human body perception to obtain each person in the functional recognition area, and the center point of the head contour of each person is identified and extracted as the reference position point of the corresponding person.

[0012] The center point of the lower edge contour of the smart screen is used as the reference point of the smart screen, and a straight line is drawn from it to the reference position point of each person in the functional recognition area to obtain the reference audiovisual line of each person in the functional recognition area.

[0013] Outline the edge lines of the functional recognition area in each direction, and extract the corresponding edge lines of the functional recognition area that are parallel to the lower edge outline of the smart screen. These are recorded as the parallel edge lines of the smart screen's functional recognition.

[0014] Connect the reference point of the smart screen to the parallel edge line of the function recognition with a vertical line to obtain the center horizontal audiovisual reference line of the function recognition area, and record the intersection of the connection as the center reference point of the parallel edge line of the function recognition of the smart screen.

[0015] The angle between the reference audiovisual line and the central horizontal audiovisual baseline for each person in the functional recognition area is extracted and recorded as the audiovisual deviation angle for each person in the functional recognition area. Then, the corresponding angle θ for the audiovisual deviation angle of each person in the functional recognition area is statistically analyzed. i .

[0016] Based on the center reference point of the parallel edge line of the function recognition of the smart screen, the audiovisual angle reference auxiliary point is located in the parallel edge line of the function recognition by a preset length to a set side. The reference auxiliary point is then connected with the reference point of the smart screen to obtain the intention audiovisual reference auxiliary line. The angle formed between the intention audiovisual reference auxiliary line and the center horizontal audiovisual reference line of the function recognition area is extracted and recorded as the reference intention adaptation audiovisual angle △θ0.

[0017] Extract the reference audiovisual line length L of each person in the recognition area. i And based on the reference audiovisual line length △L0 corresponding to the intention interaction of the smart screen's owner stored in the WEB cloud.

[0018] The comprehensive calculation function identifies the intentional interaction interest index β for each person in the recognition area. i .

[0019] Extract the personnel in the functional identification area corresponding to the maximum value of the intention interaction interest index, and record them as target personnel.

[0020] As a further design of the present invention, the intentional interaction interest index β corresponding to each person in the functional recognition area is... i The specific calculation formula is as follows: Where γ1 and γ2 are the intentional interaction interest compensation factors corresponding to the reference audiovisual line length and audiovisual deviation angle of the set personnel, respectively, e is a natural constant, and i is the number of each personnel, i = 1, 2, ..., k.

[0021] As a further design of the present invention, the matching coefficient between the target person and each adapted virtual teaching character is specifically calculated as follows: the characteristic parameters of the target person are perceived, including body shape, gender and age range, and then the median value of the target person's age range is extracted as the reference age OLD of the target person.

[0022] The gender of the target person is matched with the appropriate Tai Chi study courses for each gender stored in the WEB cloud, and the appropriate Tai Chi study courses for the target person are recorded as each candidate Tai Chi study course.

[0023] Extract the virtual teaching characters for each candidate Tai Chi study course and label them as suitable virtual teaching characters. Then, extract the age (OLD) of each suitable virtual teaching character. j and body shape and outline.

[0024] The body contours of the target person are superimposed on the body contours of each adapted virtual teaching character, and the overlapping area S is extracted. j .

[0025] Based on the predefined allowable deviation value △OLD0 for the age of the matching virtual teaching character and the minimum reference value S for the overlapping area of ​​the body contour, min .

[0026] The compatibility coefficient between the target personnel and each suitable virtual teaching character is calculated comprehensively. in and These represent the matching ratio weight factors corresponding to the pre-set age and body shape outline overlap area, respectively, and j is the number of each adapted virtual teaching character, j = 1, 2, ..., n.

[0027] As a further design of the present invention, the specific process of the designated virtual teaching character providing dynamic guidance on Tai Chi movements to the target person is as follows: the smart screen is divided into equal areas to obtain the target person's mapping area and the designated virtual teaching character's teaching area.

[0028] The system dynamically scans the target personnel and projects them onto the corresponding mapping area. It then extracts a designated virtual instructor and places him / her into the corresponding teaching area, whereby the designated virtual instructor provides synchronous and dynamic guidance to the target personnel on their Tai Chi movements.

[0029] As a further design of the present invention, the specific process of monitoring the Tai Chi movements of the target person is as follows: extract the Tai Chi teaching courses selected by the target person's voice, divide them into set teaching time intervals, and obtain each set teaching time period.

[0030] By identifying and locating each key point of the target person, and then monitoring the movement curves of each key point of the target person during each set teaching time period, the movement curves of each key point of the target person during each set teaching time period are obtained. Simultaneously, the movement curves of each key point of the specified virtual teaching character during each set teaching time period and the corresponding length △L are extracted. p d Then, the overlap length l of the target personnel's movement curves at corresponding key points during the designated teaching time period is compared with the curves of the target personnel's movement curves during each designated teaching time period. p d .

[0031] The system identifies the starting and ending points of each key point of the target personnel within each set teaching time period. It then extracts the time taken for each key point to travel from its starting point to its ending point within each set teaching time period, recording this as the actual movement time of each key point within that period. Finally, it extracts the length of the movement curve for each key point within each set teaching time period and calculates the movement speed (v) of each key point within that period. p d .

[0032] As a further design of the present invention, the action conformity coefficient of each joint of the target person in each set teaching time period is specifically calculated as follows: extract the movement speed ΔV of each joint of the specified virtual teaching character in each set teaching time period. p d Then, the movement conformity coefficient of each joint of the target personnel during each set teaching time period is calculated comprehensively. Where κ1 and κ2 represent the percentage of overlap length of the preset joint movement curves and the motion conformity correction factor corresponding to the joint movement speed, respectively; d is the number of each preset teaching time period, d = 1, 2, ..., f; and p is the number of each joint, p = 1, 2, ..., g.

[0033] As a further design of the present invention, the comprehensive conformity coefficient ψ of the Tai Chi movements of the target personnel during each set teaching time period is... d The specific calculation formula is as follows: Where g is the number of joints, υ p The preset action conformity influencing factor is the p-th joint point.

[0034] The second aspect of the present invention provides a smart screen based on AR and sensing technology, including: a smart screen intelligent opening module: used to screen out target personnel based on a predefined function recognition area of ​​the smart screen, and then perform voice recognition on the target personnel to intelligently control the opening of the smart screen.

[0035] Target Personnel Characteristic Parameter Perception Module: This module is used to perceive the characteristic parameters of target personnel and analyze the compatibility coefficient between target personnel and various suitable virtual teaching characters, thereby extracting the specified virtual teaching characters.

[0036] The target person's dynamic movement guidance module is used to obtain the Tai Chi teaching course selected by the target person's voice, and to provide dynamic guidance on the target person's Tai Chi movements by a designated virtual teaching character.

[0037] The target personnel movement monitoring, analysis and correction module is used to monitor the Tai Chi movements of the target personnel, calculate the movement conformity coefficient of each joint of the target personnel in each set teaching time period, and then provide guidance and correction for the movement of each joint of the target personnel in each set teaching time period.

[0038] The target personnel's movement playback feedback module is used to calculate the target personnel's overall Tai Chi movement compliance coefficient based on the movement compliance coefficient of each joint in each set teaching time period. Based on this, the module screens the target personnel's various needs to correct their Tai Chi movements and provides corresponding movement playback feedback.

[0039] Compared with the prior art, the embodiments of the present invention have at least the following advantages: (1) The present invention provides a smart screen interaction method and smart screen based on AR and sensing technology, which can realize the guidance and teaching of Tai Chi target learners outdoors, effectively making up for the lack of communication with the outside world caused by the over-reliance of middle-aged and elderly people on their own Tai Chi learning experience for independent outdoor exercise. Through the smart screen for dynamic Tai Chi learning, the target person can intuitively feel the movement learning situation of other Tai Chi researchers on the network, so that not only can the target person intuitively feel the defects of their own Tai Chi movements, but also the Tai Chi training level of the target person can be steadily and scientifically improved. By providing voice movement correction prompts to the target person, the target person can effectively master the reasonable strength and standardization of Tai Chi movements, reduce the potential movement risks caused by insufficient movement standardization, avoid aggravating the joint damage of the target person, and help maintain the physical health of the target person.

[0040] (2) This invention analyzes the compatibility coefficient between the target person and each suitable virtual teaching character, and then matches the target person with the designated virtual teaching character, so that the target person can obtain a Tai Chi learning course that suits their physical condition. This effectively makes up for the shortcomings of the current Tai Chi movement teaching output being low in teaching level due to the physical differences between the current Tai Chi movement output teacher and the inexperienced Tai Chi learner. In this way, the target person, with Tai Chi learning experience, can have intuitive and clear Tai Chi movement comparison and adjustment.

[0041] (3) This invention enables guidance and correction of the joint movements of the target personnel during each set teaching time period. It can meticulously identify the differences in the range and strength of the learner's movements. Through targeted voice correction prompts, it reduces the error of the target personnel's Tai Chi learning movements. It not only improves the efficiency of the target personnel's Tai Chi learning, but also provides scientific and reasonable support and guarantee for the safety of the target personnel's Tai Chi movements. Attached Figure Description

[0042] The present invention will be further described with reference to the accompanying drawings, but the embodiments in the drawings do not constitute any limitation on the present invention. For those skilled in the art, other drawings can be obtained based on the following drawings without creative effort.

[0043] Figure 1 This is a schematic diagram of the method steps of the present invention.

[0044] Figure 2 This is a schematic diagram of the connection of the smart screen association module of the present invention.

[0045] Figure 3 This is a schematic diagram of the scenario designed for this invention. Detailed Implementation

[0046] The technical solutions of the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of the present invention, and not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of the present invention.

[0047] Reference Figure 1 As shown, the first aspect of the present invention provides a smart screen interaction method based on AR and sensing technology, including: S1, smart screen intelligent opening: based on the predefined function recognition area of ​​the smart screen, target personnel are screened out, and then voice recognition is performed on the target personnel to control the smart screen to be intelligently opened.

[0048] It should be explained that the above-mentioned voice recognition of the target personnel is specifically as follows: the smart screen is named after the geographical name of the region. For example, if the geographical name of the area where the smart screen is placed is Xiamen, then the smart screen is named Xiaoxia. People can wake up Xiaoxia by voice. By recognizing the voice of the target personnel, the corresponding voice text of the target personnel is extracted, and the smart screen is intelligently turned on and controlled accordingly.

[0049] For example, specific wake-up voice texts include Hello Xiaoxia, Hi Xiaoxia, and Hello Xiaoxia.

[0050] Specifically, the screening process for the target personnel is as follows: based on the predefined functional recognition area of ​​the smart screen, human body perception is performed on the personnel entering the functional recognition area to obtain each person in the functional recognition area, and the center point of the head contour of each person is identified and extracted as the reference position point of the corresponding person.

[0051] The center point of the lower edge contour of the smart screen is used as the reference point of the smart screen, and a straight line is drawn from it to the reference position point of each person in the functional recognition area to obtain the reference audiovisual line of each person in the functional recognition area.

[0052] Outline the edge lines of the functional recognition area in each direction, and extract the corresponding edge lines of the functional recognition area that are parallel to the lower edge outline of the smart screen. These are recorded as the parallel edge lines of the smart screen's functional recognition.

[0053] Connect the reference point of the smart screen to the parallel edge line of the function recognition with a vertical line to obtain the center horizontal audiovisual reference line of the function recognition area, and record the intersection of the connection as the center reference point of the parallel edge line of the function recognition of the smart screen.

[0054] The angle between the reference audiovisual line and the central horizontal audiovisual baseline for each person in the functional recognition area is extracted and recorded as the audiovisual deviation angle for each person in the functional recognition area. Then, the corresponding angle θ for the audiovisual deviation angle of each person in the functional recognition area is statistically analyzed. i .

[0055] Based on the center reference point of the parallel edge line of the function recognition of the smart screen, the audiovisual angle reference auxiliary point is located in the parallel edge line of the function recognition by a preset length to a set side. The reference auxiliary point is then connected with the reference point of the smart screen to obtain the intention audiovisual reference auxiliary line. The angle formed between the intention audiovisual reference auxiliary line and the center horizontal audiovisual reference line of the function recognition area is extracted and recorded as the reference intention adaptation audiovisual angle △θ0.

[0056] Extract the reference audiovisual line length L of each person in the recognition area. i And based on the reference audiovisual line length △L0 corresponding to the intention interaction of the smart screen's owner stored in the WEB cloud.

[0057] The comprehensive calculation function identifies the intentional interaction interest index β for each person in the recognition area. i .

[0058] Extract the personnel in the functional identification area corresponding to the maximum value of the intention interaction interest index, and record them as target personnel.

[0059] Furthermore, the intentional interaction interest index β corresponding to each person in the functional recognition area. i The specific calculation formula is as follows: Where γ1 and γ2 are the intentional interaction interest compensation factors corresponding to the reference audiovisual line length and audiovisual deviation angle of the set personnel, respectively, e is a natural constant, and i is the number of each personnel, i = 1, 2, ..., k.

[0060] S2. Target Personnel Characteristic Parameter Perception: Perceive the characteristic parameters of the target personnel and analyze the compatibility coefficient between the target personnel and each suitable virtual teaching character, and extract the specified virtual teaching character accordingly.

[0061] It should be explained that the specific process of extracting the designated virtual teaching character is as follows: based on the compatibility coefficient between the target person and each suitable virtual teaching character, the suitable virtual teaching character corresponding to the maximum compatibility coefficient is extracted and recorded as the designated virtual teaching character.

[0062] Specifically, the matching coefficient between the target personnel and each adapted virtual teaching character is calculated as follows: the characteristic parameters of the target personnel are perceived, including body shape, gender and age range, and then the median value of the target personnel's age range is extracted as the reference age OLD of the target personnel.

[0063] It should be explained that the specific process of perceiving the age range of the target person is as follows: the facial image of the target person is scanned, and then a set of facial features of the target person is extracted and constructed through appearance feature algorithm. These features include facial features such as skin color, brightness and wrinkle texture. Then, the facial feature value of the target person is constructed, and according to the gender of the target person, it is matched with the facial feature value of the target person corresponding to various age ranges of predefined genders to extract the age range corresponding to the facial feature value of the target person.

[0064] The gender of the target person is matched with the appropriate Tai Chi study courses for each gender stored in the WEB cloud, and the appropriate Tai Chi study courses for the target person are recorded as each candidate Tai Chi study course.

[0065] Extract the virtual teaching characters for each candidate Tai Chi study course and label them as suitable virtual teaching characters. Then, extract the age (OLD) of each suitable virtual teaching character. j and body shape and outline.

[0066] The body contours of the target person are superimposed on the body contours of each adapted virtual teaching character, and the overlapping area S is extracted. j .

[0067] Based on the predefined allowable deviation value △OLD0 for the age of the matching virtual teaching character and the minimum reference value S for the overlapping area of ​​the body contour, min .

[0068] The compatibility coefficient between the target personnel and each suitable virtual teaching character is calculated comprehensively. in and These represent the matching ratio weight factors corresponding to the pre-set age and body shape outline overlap area, respectively, and j is the number of each adapted virtual teaching character, j = 1, 2, ..., n.

[0069] In a specific embodiment of the present invention, by analyzing the compatibility coefficient between the target person and each suitable virtual teaching character, a designated virtual teaching character is matched for the target person, enabling the target person to obtain a Tai Chi learning course that suits their physical condition. This effectively compensates for the current shortcomings of low teaching level caused by the physical differences between Tai Chi movement instructors and inexperienced Tai Chi learners. Furthermore, it enables the target person, with Tai Chi learning experience, to have intuitive and clear Tai Chi movement comparison and adjustment.

[0070] S3. Dynamic guidance of target personnel's movements: Obtain the Tai Chi teaching course selected by the target personnel through voice, and have a designated virtual teaching character provide dynamic guidance on the target personnel's Tai Chi movements.

[0071] Specifically, the process of having a designated virtual instructor provide dynamic guidance on Tai Chi movements to the target individual involves the following steps: (Refer to...) Figure 3 As shown, the smart screen is divided into equal areas to obtain the target personnel mapping area and the designated virtual teaching character teaching area.

[0072] The system dynamically scans the target personnel and projects them onto the corresponding mapping area. It then extracts a designated virtual instructor and places him / her into the corresponding teaching area, whereby the designated virtual instructor provides synchronous and dynamic guidance to the target personnel on their Tai Chi movements.

[0073] S4. Monitoring, Analysis and Correction of Target Personnel's Movements: Monitor the Tai Chi movements of the target personnel, calculate the conformity coefficient of each joint of the target personnel's movements in each set teaching time period, and then provide guidance and correction for the movements of each joint of the target personnel in each set teaching time period.

[0074] It should be explained that the above-mentioned guidance and correction of the joint movements of the target personnel in each set teaching time period is specifically as follows: the movement compliance coefficient of each joint of the target personnel in each set teaching time period is compared with the predefined corresponding joint movement compliance coefficient threshold. When the movement compliance coefficient of a certain joint of the target personnel in a certain set teaching time period is lower than the corresponding joint movement compliance coefficient threshold, then the joint of the target personnel in that set teaching time period is recorded as the joint requiring correction, and then the auxiliary guidance voice broadcast device is activated to provide guidance and correction prompts to the joint requiring correction of the target personnel.

[0075] The specific embodiments of this invention provide guidance and correction for the joint movements of target personnel during each set teaching time period. It can meticulously identify differences in the range and force of learners' movements, and reduce the error of Tai Chi learning movements through targeted voice correction prompts. This not only improves the efficiency of Tai Chi learning for target personnel, but also provides scientific and reasonable support and protection for the safety of Tai Chi movements.

[0076] As an example, the aforementioned voice prompt system provides guidance and correction prompts to the target person regarding their needs, with specific prompts including: pay attention to hand movements and adjust accordingly, and pay attention to the range of motion of the ankle joint.

[0077] Specifically, the process of monitoring the Tai Chi movements of the target personnel is as follows: extract the Tai Chi teaching courses selected by the target personnel's voice, divide them into set teaching time intervals, and obtain each set teaching time period.

[0078] It should be noted that the specific division method of the above-mentioned teaching time periods is as follows: each teaching time period is divided into progressively larger intervals of 5 seconds, including 0s to 5s, 5s to 10s, etc.

[0079] By identifying and locating each key point of the target person, and then monitoring the movement curves of each key point of the target person during each set teaching time period, the movement curves of each key point of the target person during each set teaching time period are obtained. Simultaneously, the movement curves of each key point of the specified virtual teaching character during each set teaching time period and the corresponding length △L are extracted. p d Then, the overlap length l of the target personnel's movement curves at corresponding key points during the designated teaching time period is compared with the curves of the target personnel's movement curves during each designated teaching time period. p d .

[0080] It should be added that the joints of the aforementioned target personnel include the shoulder joint, hip joint, wrist joint, elbow joint, and knee joint.

[0081] The system identifies the starting and ending points of each key point of the target personnel within each set teaching time period. It then extracts the time taken for each key point to travel from its starting point to its ending point within each set teaching time period, recording this as the actual movement time of each key point within that period. Finally, it extracts the length of the movement curve for each key point within each set teaching time period and calculates the movement speed (v) of each key point within that period. p d .

[0082] Specifically, the motion conformity coefficient of each joint of the target person during each set teaching time period is calculated as follows: extract the movement speed ΔV of each joint of the specified virtual teaching character during each set teaching time period. p d Then, the movement conformity coefficient of each joint of the target personnel during each set teaching time period is calculated comprehensively. Where κ1 and κ2 represent the percentage of overlap length of the preset joint movement curves and the motion conformity correction factor corresponding to the joint movement speed, respectively; d is the number of each preset teaching time period, d = 1, 2, ..., f; and p is the number of each joint, p = 1, 2, ..., g.

[0083] S5. Target Personnel Movement Replay Feedback: Based on the movement compliance coefficient of each joint of the target personnel in each set teaching time period, the comprehensive compliance coefficient of the Tai Chi movement of the target personnel in each set teaching time period is calculated. Based on this, the Tai Chi movement of the target personnel is corrected according to their needs, and corresponding movement playback feedback is provided.

[0084] It should be explained that the process of screening the target personnel's Tai Chi movements for correction and providing corresponding playback feedback is as follows: The overall compliance coefficient of the target personnel's Tai Chi movements in each set teaching time period is compared with the set overall compliance coefficient threshold. If the overall compliance coefficient of the target personnel's Tai Chi movements in a certain set teaching time period is lower than the overall compliance coefficient threshold, then the target personnel's Tai Chi movements in each set teaching time period are recorded as Tai Chi movements requiring correction. Then, the target personnel's Tai Chi movements requiring correction are counted and arranged in order. At the same time, the movement videos of the designated virtual teaching characters for the corresponding teaching time period are extracted. After the Tai Chi teaching is completed, the movements are played back synchronously on the smart screen in the corresponding order.

[0085] Specifically, the comprehensive conformity coefficient ψ of the target personnel's Tai Chi movements during each designated teaching time period. d The specific calculation formula is as follows: Where g is the number of joints, υ p The preset action conformity influencing factor is the p-th joint point.

[0086] In one specific embodiment, after the Tai Chi teaching is completed, the present invention stores the Tai Chi movements for correcting the target person's needs and the target person's learning video to the cloud of the smart screen, and creates a QR code for the cloud of the smart screen. The target person can use a mobile device to scan the code to log in to the cloud of the smart screen to view their Tai Chi movements for correcting their needs and the learning video.

[0087] Reference Figure 2 As shown, the first aspect of the present invention provides a smart screen based on AR and sensing technology, including: a smart screen intelligent opening module, a target person characteristic parameter sensing module, a target person dynamic action guidance module, a target person action monitoring, analysis and correction module, and a target person action playback feedback module.

[0088] The smart screen intelligent opening module is connected to the target personnel characteristic parameter sensing module, the target personnel characteristic parameter sensing module is connected to the target personnel dynamic action guidance module, the target personnel dynamic action guidance module is connected to the target personnel action monitoring, analysis and correction module, and the target personnel action monitoring, analysis and correction module is connected to the target personnel action playback feedback module.

[0089] The smart screen intelligent activation module is used to screen out target personnel based on the predefined function recognition area of ​​the smart screen, and then perform voice recognition on the target personnel to intelligently control the activation of the smart screen.

[0090] The target personnel characteristic parameter perception module is used to perceive the characteristic parameters of the target personnel and analyze the compatibility coefficient between the target personnel and each suitable virtual teaching character, thereby extracting the specified virtual teaching character.

[0091] The target person's dynamic action guidance module is used to acquire the Tai Chi teaching course selected by the target person's voice, and to provide dynamic guidance on the target person's Tai Chi movements by a designated virtual teaching character.

[0092] The target personnel movement monitoring, analysis and correction module is used to monitor the Tai Chi movements of the target personnel, calculate the movement conformity coefficient of each joint of the target personnel in each set teaching time period, and then guide and correct the movements of each joint of the target personnel in each set teaching time period.

[0093] The target personnel action playback feedback module is used to calculate the comprehensive compliance coefficient of the target personnel's Tai Chi movements in each set teaching time period based on the compliance coefficient of each joint of the target personnel's movements in each set teaching time period. Based on this, the module screens out the target personnel's various needs for correcting Tai Chi movements and provides corresponding action playback feedback.

[0094] In a specific embodiment of the present invention, a smart screen interaction method and a smart screen based on AR and sensing technology are provided. This enables outdoor guidance and teaching of Tai Chi to target learners, effectively compensating for the lack of communication with the outside world caused by the over-reliance of middle-aged and elderly people on their own Tai Chi learning experience for independent outdoor exercise. Through dynamic Tai Chi learning via the smart screen, the target learner can intuitively perceive the movement learning of other Tai Chi practitioners online. This not only allows the target learner to intuitively perceive their own Tai Chi movement defects, but also enables the target learner's Tai Chi level to be steadily and scientifically improved. By providing voice movement correction prompts to the target learner, the target learner can effectively master the reasonable strength and standardization of Tai Chi movements, reducing potential sports risks caused by insufficient movement standardization, avoiding aggravating the degree of joint damage, and helping to maintain the target learner's physical health.

[0095] The above description is merely an example and illustration of the structure of the present invention. Those skilled in the art can make various modifications or additions to the specific embodiments described, or use similar methods to replace them, as long as they do not deviate from the structure of the invention or exceed the scope defined by the present invention, they should all fall within the protection scope of the present invention.

Claims

1. A smart screen interaction method based on AR and sensing technology, characterized in that, include: S1. Smart Screen Intelligent Start-up: Based on the predefined function recognition area of ​​the smart screen, the target personnel are screened out, and then voice recognition is performed on the target personnel to intelligently control the smart screen to start up. S2. Target Personnel Characteristic Parameter Perception: Perceive the characteristic parameters of the target personnel and analyze the compatibility coefficient between the target personnel and each suitable virtual teaching character, and extract the specified virtual teaching character accordingly. S3. Dynamic guidance of target personnel's movements: Obtain the Tai Chi teaching course selected by the target personnel through voice, and have a designated virtual teaching character provide dynamic guidance on the target personnel's Tai Chi movements; S4. Monitoring, Analysis and Correction of Target Personnel's Movements: Monitor the Tai Chi movements of the target personnel, calculate the conformity coefficient of each joint of the target personnel's movements in each set teaching time period, and then provide guidance and correction for the movements of each joint of the target personnel in each set teaching time period. S5. Target Personnel Movement Replay Feedback: Based on the movement compliance coefficient of each joint of the target personnel in each set teaching time period, the comprehensive compliance coefficient of the Tai Chi movement of the target personnel in each set teaching time period is calculated. Based on this, the Tai Chi movement of the target personnel is corrected according to their needs, and corresponding movement playback feedback is provided. The specific screening process for the target personnel is as follows: Based on the predefined function recognition area of ​​the smart screen, and to perform human body perception on the people entering the function recognition area, the center point of the head contour of each person in the function recognition area is identified and extracted as the reference position point of the corresponding person. The center point of the lower edge contour of the smart screen is used as the reference point of the smart screen, and a straight line is drawn from it to the reference position point of each person in the functional recognition area to obtain the reference audiovisual line of each person in the functional recognition area. Outline the edge lines of the functional recognition area in each direction, and extract the corresponding edge lines of the functional recognition area that are parallel to the lower edge outline of the smart screen. These are recorded as the parallel edge lines of the smart screen's functional recognition. Connect the reference point of the smart screen to the parallel edge line of the function recognition with a vertical line to obtain the center horizontal audiovisual reference line of the function recognition area, and record the intersection of the connection as the center reference point of the parallel edge line of the function recognition of the smart screen. The angle between the reference audiovisual line and the central horizontal audiovisual baseline for each person within the functional recognition area is extracted and recorded as the audiovisual deviation angle for each person within the functional recognition area. Then, the corresponding angles of the audiovisual deviation angles for each person within the functional recognition area are statistically analyzed. ; Based on the center reference point of the parallel edge line of the smart screen's function recognition, a reference auxiliary point for the audiovisual angle is located on the parallel edge line of the function recognition by a preset length to one side. This reference auxiliary point is then connected to the reference point of the smart screen to obtain the intended audiovisual reference auxiliary line. The angle formed between the intended audiovisual reference auxiliary line and the center horizontal audiovisual baseline of the function recognition area is then extracted and recorded as the intended audiovisual angle. ; Extract the reference audiovisual line length of each person in the recognition area. Based on the reference audiovisual line length corresponding to the intended interaction of the smart screen's owner stored in the web cloud. ; The comprehensive calculation function identifies the intentional interaction interest index of each person in the recognition area. ; Extract the people in the functional recognition area corresponding to the maximum value of the intention interaction interest index, and record them as the target people; The intentional interaction interest index corresponding to each person in the functional recognition area. The specific calculation formula is as follows: ,in and These are the reference audiovisual line lengths and audiovisual deviation angles corresponding to the set personnel, respectively, representing the intentional interaction interest compensation factors, where e is a natural constant and i is the personnel's ID number. .

2. The smart screen interaction method based on AR and sensing technology according to claim 1, characterized in that: The compatibility coefficient between the target personnel and each suitable virtual teaching character is calculated as follows: The system perceives the characteristic parameters of the target personnel, including body shape, gender, and age range. It then extracts the median value of the target personnel's age range as a reference age. ; Match the gender of the target personnel with the appropriate study Tai Chi courses for each gender stored in the WEB cloud to obtain the appropriate study Tai Chi courses for the target personnel, and record them as each candidate study Tai Chi course. Extract the virtual teaching characters for each candidate Tai Chi study course and label them as suitable virtual teaching characters. Then, extract the age of each suitable virtual teaching character. and body shape outline; The body contours of the target personnel are superimposed on the body contours of each adapted virtual teaching character, and the overlapping area is extracted. ; Based on the predefined allowable deviation value for the age of the virtual teaching character. and the minimum value of the overlapping area of ​​body contours ; The compatibility coefficient between the target personnel and each suitable virtual teaching character is calculated comprehensively. ,in and These represent the weighting factors for the overlap area of ​​the preset age and body shape contours, respectively, and j is the ID of each adapted virtual teaching character. .

3. The smart screen interaction method based on AR and sensing technology according to claim 1, characterized in that: The process of having a designated virtual instructor provide dynamic guidance on Tai Chi movements to the target individual is as follows: The smart screen is divided into equal areas to obtain the target personnel mapping area and the designated virtual teaching character teaching area; The system dynamically scans the target personnel and projects them onto the corresponding mapping area. It then extracts a designated virtual instructor and places him / her into the corresponding teaching area, whereby the designated virtual instructor provides synchronous and dynamic guidance to the target personnel on their Tai Chi movements.

4. The smart screen interaction method based on AR and sensing technology according to claim 1, characterized in that: The specific process for monitoring the Tai Chi movements of the target personnel is as follows: Extract the Tai Chi teaching courses selected by the target personnel from their voice recordings, divide them into set teaching time intervals, and obtain each set teaching time period. By identifying and locating each key point of the target person, and then monitoring the movement curves of each key point of the target person during each set teaching time period, the movement curves of each key point of the target person during each set teaching time period are obtained. Simultaneously, the movement curves and corresponding lengths of each key point of the specified virtual teaching character during each set teaching time period are extracted. The curves are then compared with the movement curves of the target personnel's corresponding key points during the corresponding set teaching time periods to obtain the overlap length of the movement curves of the target personnel's key points during each set teaching time period. ; The system identifies the starting and ending points of each key point of the target personnel within each set teaching time period. It then extracts the time taken for each key point to travel from its starting point to its ending point within each set teaching time period, recording this as the actual movement time of each key point within that period. Finally, it extracts the length of the movement curve for each key point within each set teaching time period and calculates the movement speed of each key point within that period. .

5. The smart screen interaction method based on AR and sensing technology according to claim 4, characterized in that: The specific calculation process for the movement conformity coefficients of each joint of the target personnel during each set teaching time period is as follows: Extract the movement speed of each joint of a specified virtual teaching character during each set teaching time period. Then, the movement conformity coefficient of each joint of the target personnel during each set teaching time period is calculated comprehensively. ,in and These represent the percentage of overlap length of the preset joint movement curves and the motion conformity correction factor corresponding to the joint movement speed, respectively, where d is the number of each preset teaching time period. p is the number of each joint. .

6. The smart screen interaction method based on AR and sensing technology according to claim 5, characterized in that: The overall conformity coefficient of the target personnel's Tai Chi movements during each designated teaching time period The specific calculation formula is as follows: Where g is the number of joints, The preset action conformity influencing factor is the p-th joint point.

7. A smart screen based on AR and sensing technology, used to execute the smart screen interaction method based on AR and sensing technology as described in any one of claims 1-6, characterized in that: Smart screens based on AR and sensing technologies include: Smart screen intelligent opening module: It is used to screen out target personnel based on the predefined function recognition area of ​​the smart screen, and then perform voice recognition on the target personnel to intelligently control the opening of the smart screen. Target Personnel Characteristic Parameter Perception Module: This module is used to perceive the characteristic parameters of target personnel and analyze the compatibility coefficient between target personnel and various suitable virtual teaching characters, thereby extracting the specified virtual teaching characters. Target Personnel Dynamic Movement Guidance Module: This module is used to acquire the Tai Chi teaching course selected by the target personnel via voice, and to provide dynamic guidance on the Tai Chi movements to the target personnel by a designated virtual teaching character. Target Personnel Movement Monitoring, Analysis and Correction Module: Used to monitor the Tai Chi movements of target personnel, calculate the movement conformity coefficient of each joint of the target personnel in each set teaching time period, and then provide guidance and correction for the movement of each joint of the target personnel in each set teaching time period. The target personnel's movement playback feedback module is used to calculate the target personnel's overall Tai Chi movement compliance coefficient based on the movement compliance coefficient of each joint in each set teaching time period. Based on this, the module screens the target personnel's various needs to correct their Tai Chi movements and provides corresponding movement playback feedback.

Images