A body posture evaluation method, device, electronic equipment and program product

Abstract

The application discloses a body posture evaluation method and device, electronic equipment and program product, and belongs to the technical field of physical health testing. The method comprises the following steps: acquiring an image to be evaluated, inputting the image to be evaluated into an AI large model, and identifying the bone joint nodes of the human body in the image; obtaining a plurality of reference lines of the body in the image to be evaluated from the bone joint nodes, and then measuring the intersection angle or distance of the connecting lines of the plurality of reference lines and the corresponding bone joint nodes in the bone joint nodes, and obtaining the body posture evaluation results of different parts according to a preset judgment rule. In the application, an ordinary monocular camera is used to acquire front view, side view and back view images of the human body, the AI large model is used to identify the bone joint nodes of the human body, a plurality of reference lines are determined, the intersection angle or distance of the connecting lines of the plurality of reference lines and the corresponding bone joints in the bone joint nodes is measured, and the body posture evaluation results of 19 parts are obtained according to the built-in algorithm. The method does not need to be connected to a network, and can realize rapid, comprehensive and accurate offline detection.

Description

Technical Field

[0001] This invention relates to the field of physical health testing technology, and in particular to a method, device, electronic device, and program product for assessing body posture. Background Technology

[0002] Human posture is the static and dynamic external manifestation of human form and an important indicator of physical health. Human posture testing is an important component of physical health testing.

[0003] Current methods for measuring body posture mostly rely on coordinate grids and manual visual testing, lacking intelligent testing methods. Some devices currently employ computer vision recognition technology, such as using reflective dots (marks) on key body parts to identify bone joints and then making judgments. However, these are limited by the computing power of the devices and require network connectivity for computation. Furthermore, existing devices often depend on expensive binocular or 3D cameras to acquire planar and depth information for accurate judgments. This is highly detrimental to the large-scale promotion of these products.

[0004] Therefore, it is evident that the existing body posture testing methods described above still have inconveniences and shortcomings in terms of structure, methodology, and usage, and urgently require further improvement. The current industry urgently needs to improve the development of a new body posture testing method, device, electronic equipment, and program product that can more quickly and accurately identify various skeletal joints in the human body, and achieve rapid assessment of different body postures by comparing the lines connecting these joints with a baseline, while providing high accuracy and comprehensive evaluation results to offer more favorable data support for physical health testing. Summary of the Invention

[0005] The technical problem to be solved by the present invention is to provide a body posture assessment method that can more quickly and accurately identify the joints of the human body, and achieve rapid assessment of different body postures by comparing the lines connecting the joints with the baseline. The method provides high accuracy and comprehensive assessment, thus providing more favorable data support for physical health testing.

[0006] To address the aforementioned technical problems, this invention provides a body posture assessment method, comprising:

[0007] Acquire an image to be evaluated, including a frontal view image of the user;

[0008] The image to be evaluated is input into the MediaPipe large model, which identifies 15 bony joints of the human body in the image. The 15 bony joints include the nose, left ear, right ear, left shoulder, right shoulder, left anterior superior iliac spine, right anterior superior iliac spine, left knee, right knee, left ankle, right ankle, left heel, right heel, left big toe, and right big toe.

[0009] Multiple baselines of the body in the image to be evaluated are obtained from the identified bone joints, including the frontal longitudinal baseline, head horizontal line, shoulder horizontal line, hip horizontal line, knee horizontal line, and ankle horizontal line;

[0010] By measuring the angle or distance between the intersection of multiple baselines and the lines connecting the corresponding bone joints, and based on preset judgment rules, the body posture assessment results for different parts are obtained.

[0011] Further improvements include: the frontal longitudinal baseline is the vertical line perpendicular to the midpoint of the line connecting the left and right calcaneal joints; the head horizontal line is the horizontal line passing through the nasal joint; the shoulder horizontal line is the horizontal line passing through the right scapular joint; the hip horizontal line is the horizontal line passing through the right anterior superior iliac spine joint; the knee horizontal line is the horizontal line passing through the right knee joint; and the ankle horizontal line is the horizontal line passing through the right ankle joint.

[0012] A further improvement involves measuring the angle or distance between the intersections of multiple baselines and the lines connecting corresponding bone joint points, and then, based on preset judgment rules, obtaining body posture assessment results for different body parts. Specifically, this includes:

[0013] (1) Assessment of the tilt angle of the center of gravity: Connect the midpoint of the line connecting the left and right heel joints to the nasal joint, and measure the angle between the line and the longitudinal baseline of the front view. If the angle is within the predetermined range of ±5°, the tilt angle of the body center of gravity is determined to be normal. If the angle is outside the predetermined range and is positive, the body center of gravity is determined to be tilted to the left. If the angle is outside the predetermined range and is negative, the body center of gravity is determined to be tilted to the right.

[0014] (2) Neck tilt angle assessment: Connect the left ear bone joint point and the right ear bone joint point, and measure the angle between the connecting line and the horizontal line of the head. If the angle is within the predetermined range of ±2°, the neck tilt angle is determined to be normal. If the angle is outside the predetermined range and the left ear is lower, the head is determined to be tilted to the left. Otherwise, the head is determined to be tilted to the right.

[0015] (3) Assessment of neck rotation angle: Connect the left scapular joint point and the right scapular joint point, then connect the midpoint of the two shoulders to the nasal joint point, and measure the angle between the connecting line and the vertical line passing through the midpoint of the two shoulders. If the angle is within the predetermined range of ±5°, the neck rotation angle is considered normal. If the angle is outside the predetermined range and the nasal joint point is to the left of the vertical line passing through the midpoint of the two shoulders, the head is considered to rotate to the left. Otherwise, the head is considered to rotate to the right.

[0016] (4) Shoulder tilt angle assessment: Connect the left scapular joint point and the right scapular joint point, and measure the angle between the connecting line and the shoulder horizontal line. If the angle is within the predetermined range of ±2°, the shoulder tilt angle is determined to be normal. If the angle is outside the predetermined range and the left shoulder is lower, the right shoulder is determined to be higher. Otherwise, the left shoulder is determined to be higher.

[0017] (5) Hip tilt angle assessment: Connect the joint of the left anterior superior iliac spine and the joint of the right anterior superior iliac spine, and measure the angle between the connecting line and the hip horizontal line. If the angle is within the predetermined range of ±2°, the hip tilt angle is determined to be normal. If the angle is outside the predetermined range and the left anterior superior iliac spine is low, the right hip is determined to be high. Otherwise, the left hip is determined to be high.

[0018] (6) Leg shape assessment: Connect the right anterior superior iliac spine joint point and the right knee joint point, and measure the angle between the line connecting the right anterior superior iliac spine joint point and the right ankle joint point. If the angle is within the predetermined range of ±5°, the leg shape is judged to be normal. If the angle is outside the predetermined range and the right knee joint point is outward, it is judged to be O-shaped legs. Otherwise, it is judged to be X-shaped legs.

[0019] (7) Foot type assessment: Connect the left ankle joint point and the left big toe joint point, and measure the angle between the connecting line and the vertical line passing through the left ankle joint point. If the angle is within the predetermined range of 20~45°, the foot type is judged to be normal. If the angle is less than 20°, it is judged to be an in-toeing foot type. If the angle is greater than 45°, it is judged to be an out-toeing foot type.

[0020] Further improvements also include:

[0021] (8) Pelvic rotation assessment: Measure the distances from the left anterior superior iliac spine joint and the right anterior superior iliac spine joint to the longitudinal baseline in frontal view. If the two are equal, the pelvis is considered normal. If the two are not equal, and the distance from the left anterior superior iliac spine joint to the longitudinal baseline in frontal view is less than the distance from the right anterior superior iliac spine joint to the longitudinal baseline in frontal view, the pelvis is considered to be rotated to the left. Otherwise, the pelvis is rotated to the right.

[0022] (9) Left leg rotation assessment: Observe whether the joint of the left big toe is inside or outside the joint of the left knee. If it is outside the predetermined range inside the knee, the left leg is determined to be internally rotated. If it is outside the predetermined range outside the knee, the left leg is determined to be externally rotated.

[0023] (10) Right leg rotation assessment: Observe whether the joint of the right big toe is inside or outside the joint of the right knee. If it is outside the predetermined range inside, the right leg is determined to be internally rotated. If it is outside the predetermined range outside, the right leg is determined to be externally rotated.

[0024] In a further improvement, the image to be evaluated also includes a left-side view image of the user. The step of deriving body posture evaluation results for different body parts from the left-side view image specifically includes:

[0025] The left-side view image was input into the MediaPipe large model, and six bony joints of the human body in the image were identified, including: nose, left ear, left shoulder, left anterior superior iliac spine, left knee, and left ankle.

[0026] Multiple baselines for the body in the left-side view image are obtained from the identified bone joints, including the longitudinal baseline for the side view and the mid-axillary line; the longitudinal baseline for the side view is a vertical line passing through the bone joint of the left ankle, and the mid-axillary line is a vertical line passing through the bone joint of the left shoulder.

[0027] By measuring the angles or distances between the intersections of multiple baselines and the lines connecting corresponding joint points, and based on preset judgment rules, the body posture assessment results for different body parts are obtained, including:

[0028] (11) Assessment of body forward and backward tilt: Connect the left ear bone joint point and the left ankle bone joint point, and measure the angle between the connecting line and the longitudinal baseline of the side view. If the angle is within the predetermined range of ±5°, the body forward and backward tilt is determined to be normal. If the angle is outside the predetermined range and is positive, the body is determined to be forward tilted. If it is negative, the body is determined to be backward tilted.

[0029] (12) Head tilt assessment: Connect the left ear bone joint point and the nasal bone joint point, and measure the angle between the connecting line and the horizontal line. If the angle is within the predetermined range of ±2°, the head tilt is considered normal. If the angle is outside the predetermined range and the nasal bone joint point is low, the head is considered tilted forward. Otherwise, the head is tilted backward.

[0030] (13) Head protrusion assessment: If the left ear joint is within a predetermined distance range in front of the longitudinal baseline in lateral view, the head is determined not to be protruding; if it is outside the predetermined distance range, the head is determined to be protruding.

[0031] (14) Assessment of kyphosis: If the left shoulder joint is located in front of the longitudinal baseline in lateral view, it is judged as kyphosis with hunched shoulders.

[0032] (15) Assessment of pelvic tilt: If the joint of the left anterior superior iliac spine is located outside the predetermined distance range in front of the longitudinal baseline in lateral view, the pelvis is determined to be anteriorly tilted; if the joint of the left anterior superior iliac spine is located outside the predetermined distance range in back of the longitudinal baseline in lateral view, the pelvis is determined to be posteriorly tilted.

[0033] (16) Knee hyperextension angle assessment: Connect the left anterior superior iliac spine joint point with the left ankle joint point. If the left knee joint point is located outside the predetermined distance range in front of the line, it is determined to be a flexed leg. If the left knee joint point is located outside the predetermined distance range in the back of the line, it is determined to be a knee hyperextension.

[0034] In a further improvement, the image to be evaluated also includes a user's rear view image. The step of deriving body posture evaluation results for different body parts from the rear view image specifically includes:

[0035] The rear view image was input into the MediaPipe large model, and six bony joints of the human body in the image were identified, including: left knee, right knee, left ankle, right ankle, left heel, and right heel;

[0036] By comparing the coordinates of the obtained joint points with the angles formed by the lines connecting the corresponding joint points, and according to preset judgment rules, the body posture assessment results for different body parts are obtained, including:

[0037] (17) Leg length discrepancy assessment: Compare the longitudinal coordinates of the left knee joint and the right knee joint. If the longitudinal coordinate of the left knee joint is greater than the longitudinal coordinate of the right knee joint and is outside the predetermined range, the left leg is determined to be longer. If the longitudinal coordinate of the left knee joint is less than the longitudinal coordinate of the right knee joint and is outside the predetermined range, the right leg is determined to be longer.

[0038] (18) Assessment of left ankle tilt: Connect the left ankle joint and the left heel joint, and measure the angle between the line and the vertical line passing through the left ankle joint. If the angle is within the predetermined range of ±3°, the left ankle tilt is normal. If it is outside the predetermined range and the left heel joint is inside the left ankle joint, the left foot is judged to be inverted. Otherwise, it is judged to be everted.

[0039] (19) Assessment of right ankle tilt: Connect the right ankle joint and the right heel joint, and measure the angle between the line and the vertical line passing through the right ankle joint. If the angle is within the predetermined range of ±3°, the right ankle tilt is normal. If it is outside the predetermined range and the right heel joint is inside the right ankle joint, the right foot is judged to be inverted. Otherwise, it is judged to be everted.

[0040] As a further improvement of the present invention, the present invention also provides a human posture assessment device. This assessment device includes an image acquisition component and a control mechanism connected thereto. The image acquisition component employs a monocular camera, and the control mechanism includes:

[0041] Image receiving module: used to receive the image to be evaluated acquired by the image acquisition component;

[0042] The bone joint acquisition module is used to build a large MediaPipe model to identify human bone joints in the image to be evaluated.

[0043] A baseline determination module is used to obtain multiple baselines of the body in the image to be evaluated from the bone joint points;

[0044] The posture assessment module is used to measure the angle or distance between the intersection of multiple baselines and the lines connecting the corresponding joints in the joints, and to obtain the body posture assessment results for different parts of the body according to preset judgment rules.

[0045] A further improvement includes a display mechanism connected to the control mechanism for displaying and guiding posture adjustment instructions during human posture measurement.

[0046] As another improvement of the present invention, the present invention also provides an electronic device. The electronic device includes a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor, when executing the program, implements the steps of the human posture assessment method as described above.

[0047] As another improvement of the present invention, the present invention also provides a computer program product. The computer program product includes computer program instructions that, when executed by a processor, implement the steps of the human posture assessment method as described above.

[0048] With this design, the present invention has at least the following advantages:

[0049] This invention provides a body posture assessment method that acquires frontal, side, and rear views of the human body. Based on a large AI model, it identifies bony joints and vertebrae, deriving multiple baselines from these joints. By measuring the angles or distances between these baselines and the lines connecting corresponding bony joints, and according to preset judgment rules, it yields body posture assessment results for 19 body parts. This method utilizes a standard monocular camera and an open-source AI model, combined with built-in algorithms, requiring no internet connection or cloud support. It can quickly, comprehensively, and accurately provide assessment results for various body postures. Furthermore, the algorithm is simple, low-cost, and easy to promote and use. Attached Figure Description

[0050] The above is merely an overview of the technical solution of the present invention. In order to better understand the technical means of the present invention, the present invention will be further described in detail below with reference to the accompanying drawings and specific embodiments.

[0051] Figure 1 This is a schematic diagram of the body posture assessment device of the present invention.

[0052] Figure 2 This is a structural block diagram of the control mechanism in the body posture assessment device of the present invention.

[0053] Figure 3 This is a schematic diagram of the human skeletal joints obtained in the body posture assessment method of this invention. Detailed Implementation

[0054] Exemplary embodiments of the invention will now be described in more detail with reference to the accompanying drawings. While exemplary embodiments of the invention are shown in the drawings, it should be understood that the invention may be implemented in various forms and should not be limited to the embodiments set forth herein. Rather, these embodiments are provided so that a more thorough understanding of the invention will be achieved and that the full scope of the invention will be conveyed to those skilled in the art.

[0055] See attached document Figure 1As shown, the human posture assessment device in this embodiment includes a support 1 and a display mechanism 2 mounted on the support, an image acquisition component 3 mounted on the upper part of the display mechanism 2, and a control mechanism 4 connected to the display mechanism 2 and the image acquisition component 3.

[0056] In this embodiment, the image acquisition component 3 uses a monocular camera to acquire two-dimensional images of a human body standing in front of the support 1. The display mechanism 2 is used to display and guide posture adjustment instructions during human posture measurement, such as guiding the human body to face the image acquisition component from the front, side, or back to obtain frontal, side, and back views of the user.

[0057] See attached document Figure 2 As shown, the control mechanism 4 includes an image receiving module 41, a joint acquisition module 42, a baseline determination module 43, and a posture evaluation module 44. Among them,

[0058] Image receiving module 41 is used to receive the image to be evaluated acquired by the image acquisition component;

[0059] The bone joint acquisition module 42 is used to build a large MediaPipe model to identify human bone joints in the image to be evaluated.

[0060] The baseline determination module 43 is used to obtain multiple baselines of the body in the image to be evaluated from the bone joint points;

[0061] The posture assessment module 44 is used to measure the angle or distance between the intersection of multiple baselines and the lines connecting the corresponding bone joints in the bone joints, and to obtain the body posture assessment results for different parts according to preset judgment rules.

[0062] This embodiment, based on the body posture assessment method of the aforementioned body posture assessment device, includes the following steps:

[0063] S1. Obtain the image to be evaluated, which includes a frontal view image, a side view image, and a rear view image of the user;

[0064] S2. Input the image to be evaluated into an AI large-scale model, such as the MediaPipe large-scale model, which can identify 33 bony joints of the human body in the image. The 33 bony joints are shown in the attached figure. Figure 3As shown, the following are included: nose 0, inner corner of left eye 1, left eye 2, outer corner of left eye 3, inner corner of right eye 4, right eye 5, outer corner of right eye 6, left ear 7, right ear 8, left corner of mouth 9, right corner of mouth 10, left shoulder 11, right shoulder 12, left elbow 13, right elbow 14, left wrist 15, right wrist 16, left little finger 17, right little finger 18, left index finger 19, right index finger 20, left thumb 21, right thumb 22, left anterior superior iliac spine 23, right anterior superior iliac spine 24, left knee 25, right knee 26, left ankle 27, right ankle 28, left heel 29, right heel 30, left big toe 31, right big toe 32.

[0065] S3. Extract 15 bony joints from the frontal view image, such as nose 0, left ear 7, right ear 8, left shoulder 11, right shoulder 12, left anterior superior iliac spine 23, right anterior superior iliac spine 24, left knee 25, right knee 26, left ankle 27, right ankle 28, left heel 29, right heel 30, left big toe 31, and right big toe 32.

[0066] Multiple baselines for the body in a frontal view image are obtained from these 15 bony joints, including the frontal longitudinal baseline, head horizontal line, shoulder horizontal line, hip horizontal line, knee horizontal line, and ankle horizontal line. Specifically, the frontal longitudinal baseline is the vertical line perpendicular to the midpoint of the line connecting the left calcaneal joint point 29 and the right calcaneal joint point 30; the head horizontal line is the horizontal line passing through the nasal joint point 0; the shoulder horizontal line is the horizontal line passing through the right scapular joint point 12; the hip horizontal line is the horizontal line passing through the right anterior superior iliac spine joint point 24; the knee horizontal line is the horizontal line passing through the right knee joint point 26; and the ankle horizontal line is the horizontal line passing through the right ankle joint point 28.

[0067] S4. By measuring the angle or distance between the intersection of multiple baselines in the frontal view image and the line connecting the corresponding bone joints, the body posture assessment results for different parts are obtained according to the preset judgment rules.

[0068] This includes:

[0069] (1) Assessment of the tilt angle of the center of gravity: Connect the midpoint of the line connecting the left heel joint point 29 and the right heel joint point 30 with the nasal joint point 0, and measure the angle between the line and the aforementioned frontal longitudinal baseline. If the angle is within the predetermined range of ±5°, the tilt angle of the body center of gravity is determined to be normal; if the angle is outside the predetermined range and is positive, i.e. greater than 5°, the body center of gravity is determined to be tilted to the left; if the angle is outside the predetermined range and is negative, i.e. less than -5°, the body center of gravity is determined to be tilted to the right.

[0070] (2) Head tilt assessment: Connect the left ear bone joint point 7 and the right ear bone joint point 8, and measure the angle between the connecting line and the horizontal line of the head. If the angle is within the predetermined range of ±2°, the head tilt angle is determined to be normal. If the angle is outside the predetermined range and the left ear is lower, the head is determined to be tilted to the left. Otherwise, the head is determined to be tilted to the right.

[0071] (3) Assessment of neck rotation angle: Connect the left scapular joint point 11 and the right scapular joint point 12, and then connect the midpoint of the two shoulders to the nasal joint point 0. Measure the angle between the connecting line and the vertical line passing through the midpoint of the two shoulders. If the angle is within the predetermined range of ±5°, the neck rotation angle is considered normal. If the angle is outside the predetermined range and the nasal joint point 0 is to the left of the vertical line passing through the midpoint of the two shoulders, the head is considered to rotate to the left. Otherwise, the head is considered to rotate to the right.

[0072] (4) Shoulder tilt angle assessment: Connect the left scapular joint point 11 and the right scapular joint point 12, and measure the angle between the connecting line and the shoulder horizontal line. If the angle is within the predetermined range of ±2°, the shoulder tilt angle is considered normal. If the angle is outside the predetermined range and the left shoulder is lower, the right shoulder is considered higher. Otherwise, the left shoulder is considered higher.

[0073] (5) Hip tilt angle assessment: Connect the left anterior superior iliac spine joint point 23 and the right anterior superior iliac spine joint point 24, and measure the angle between the connecting line and the hip horizontal line. If the angle is within the predetermined range of ±2°, the hip tilt angle is determined to be normal. If the angle is outside the predetermined range and the left anterior superior iliac spine is low, the right hip is determined to be high. Otherwise, the left hip is determined to be high.

[0074] (6) Leg shape assessment: Connect the right anterior superior iliac spine joint point 24 and the right knee joint point 26, and measure the angle between this line and the line connecting the right anterior superior iliac spine joint point 24 and the right ankle joint point 28. If the angle is within the predetermined range of ±5°, the leg shape is judged to be normal. If the angle is outside the predetermined range and the right knee joint point 26 is outward, it is judged to be O-shaped legs. Otherwise, it is judged to be X-shaped legs.

[0075] (7) Foot type assessment: Connect the left ankle joint point 27 and the left big toe joint point 31, and measure the angle between the connecting line and the vertical line passing through the left ankle joint point 27. If the angle is within the predetermined range of 20~45°, the foot type is judged to be normal. If the angle is less than 20°, it is judged to be an in-toeing foot type. If the angle is greater than 45°, it is judged to be an out-toeing foot type.

[0076] (8) Pelvic rotation assessment: Measure the distances from the left anterior superior iliac spine joint point 23 and the right anterior superior iliac spine joint point 24 to the frontal longitudinal baseline. If the two are equal, the pelvis is considered normal. If the two are not equal, and the distance from the left anterior superior iliac spine joint point 23 to the frontal longitudinal baseline is less than the distance from the right anterior superior iliac spine joint point 24 to the frontal longitudinal baseline, the pelvis is considered to be rotated to the left. Otherwise, the pelvis is rotated to the right.

[0077] (9) Left leg rotation assessment: Observe whether the left big toe joint 31 is inside or outside the left knee joint 25. If it is outside the predetermined range inside, the left leg is determined to be internally rotated. If it is outside the predetermined range outside, the left leg is determined to be externally rotated.

[0078] In this evaluation step of the embodiment, the predetermined range setting rule is as follows: using a JPEG image of standard frontal view size (1276*960 pixels) as the standard, with a resolution of 72, it is divided into horizontal and vertical squares of 72*54, and distance is determined in units of squares. If the left big toe joint point 31 is observed to be outside one square inside the left knee joint point 25, the left leg is determined to be internally rotated; if the left big toe joint point 31 is observed to be outside one square outside the left knee joint point 25, the left leg is determined to be externally rotated.

[0079] (10) Right leg rotation assessment: Observe whether the right big toe joint 32 is inside or outside the right knee joint 26. If it is outside the predetermined range inside, the right leg is determined to be internally rotated. If it is outside the predetermined range outside, the right leg is determined to be externally rotated.

[0080] The rules for setting the predetermined range in this assessment step are the same as those for setting the left leg rotation assessment in (9). If the right big toe joint 32 is observed to be outside the 1 square inside the right knee joint 26, the right leg is determined to be internally rotated. If the right big toe joint 32 is observed to be outside the 1 square outside the right knee joint 26, the right leg is determined to be externally rotated.

[0081] S5. Extract 6 bony joints from the user's left-side facial image, such as nose 0, left ear 7, left shoulder 11, left anterior superior iliac spine 23, left knee 25, and left ankle 27.

[0082] Multiple baselines for the body in the lateral view image are obtained from these six bony joints, including the longitudinal baseline and the mid-axillary line. Specifically, the longitudinal baseline is a vertical line passing through the left ankle bony joint 27, and the mid-axillary line is a vertical line passing through the left shoulder bony joint 11.

[0083] S6. By measuring the angle or distance between the intersections of multiple baselines in the lateral view image and the lines connecting corresponding joint points, and based on preset judgment rules, the body posture assessment results for different body parts are obtained, including:

[0084] (11) Assessment of body tilt: Connect the left ear bone joint point 7 and the left ankle bone joint point 27, and measure the angle between the connecting line and the longitudinal baseline of the side view. If the angle is within the predetermined range of ±5°, the body tilt is considered normal. If the angle is outside the predetermined range and is positive, the body is considered to be tilted forward. If it is negative, the body is considered to be tilted backward.

[0085] (12) Head tilt assessment: Connect the left ear bone joint point 7 and the nasal bone joint point 0, and measure the angle between the connecting line and the horizontal line. If the angle is within the predetermined range of ±2°, the head tilt is considered normal. If the angle is outside the predetermined range and the nasal bone joint point is low, the head is considered tilted forward. Otherwise, the head is tilted backward.

[0086] (13) Head protrusion assessment: If the left ear bone joint 7 is within the predetermined distance range in front of the longitudinal baseline in lateral view, it is determined that the head is not protruding; if it is outside the predetermined distance range, it is determined that the head is protruding.

[0087] The rules for setting the predetermined range in this assessment step are the same as those for setting the left leg rotation assessment in (9). If the left ear bone joint point 7 is located outside the 1 square in front of the longitudinal baseline in the lateral view, then the head is judged to be forward.

[0088] (14) Kyphosis assessment: If the left shoulder joint point 11 is located in front of the longitudinal baseline in lateral view, it is judged as kyphosis.

[0089] (15) Assessment of pelvic tilt: If the joint point 23 of the left anterior superior iliac spine is located outside the predetermined distance range in front of the longitudinal baseline in lateral view, the pelvis is determined to be anteriorly tilted; if the joint point 23 of the left anterior superior iliac spine is located outside the predetermined distance range in the posterior part of the longitudinal baseline in lateral view, the pelvis is determined to be posteriorly tilted.

[0090] The rules for setting the predetermined range in this assessment step are the same as those for setting the left leg rotation assessment in (9). If the left anterior superior iliac spine joint 23 is located outside the first square of the longitudinal baseline in the lateral view, anterior pelvic tilt is determined. If the left anterior superior iliac spine joint 23 is located outside the first square of the longitudinal baseline in the lateral view, posterior pelvic tilt is determined.

[0091] (16) Knee hyperextension angle assessment: Connect the left anterior superior iliac spine joint 23 and the left ankle joint 27. If the left knee joint 25 is located outside the predetermined distance range in front of the line, it is determined to be a flexed leg. If the left knee joint 25 is located outside the predetermined distance range in the back of the line, it is determined to be a knee hyperextension.

[0092] The rules for setting the predetermined range in this assessment step are the same as those for setting the left leg rotation assessment in (9). If the left knee joint point 25 is located outside the first square of the line, it is determined to be a bent leg. If the left knee joint point 25 is located outside the first square of the line, it is determined to be a hyperextension of the knee.

[0093] S7. Extract 6 bone joint points from the user's back view image, such as left knee 25, right knee 26, left ankle 27, right ankle 28, left heel 29, and right heel 30.

[0094] S8. By comparing the obtained coordinates of the joint points and the angles between the lines connecting the corresponding joint points, and according to preset judgment rules, the body posture assessment results for different parts are obtained, including:

[0095] (17) Leg length discrepancy assessment: Compare the longitudinal coordinates of the left knee joint point 25 and the right knee joint point 26. If the longitudinal coordinate of the left knee joint point 25 is greater than the longitudinal coordinate of the right knee joint point 26 and is outside the predetermined range, the left leg is determined to be longer. If the longitudinal coordinate of the left knee joint point 25 is less than the longitudinal coordinate of the right knee joint point 26 and is outside the predetermined range, the right leg is determined to be longer.

[0096] The rules for setting the predetermined range in this assessment step are the same as those for setting the left leg rotation assessment in (9). If the ordinate of the left knee joint 25 is greater than the ordinate of the right knee joint 26 and is outside the first square, then the left leg length is determined. If the ordinate of the left knee joint 25 is less than the ordinate of the right knee joint 26 and is outside the first square, then the right leg length is determined.

[0097] (18) Assessment of left ankle tilt: Connect the left ankle joint 27 and the left heel joint 29, and measure the angle between the line connecting the two and the vertical line passing through the left ankle joint 27. If the angle is within the predetermined range of ±3°, the left ankle tilt is normal. If it is outside the predetermined range and the left heel joint 29 is inside the left ankle joint 27, the left foot is judged to be inverted. Otherwise, it is judged to be everted.

[0098] (19) Assessment of right ankle tilt: Connect the right ankle joint 28 and the right calcaneal joint 30, and measure the angle between the line connecting the two and the vertical line passing through the right ankle joint 28. If the angle is within the predetermined range of ±3°, the right ankle tilt is normal. If it is outside the predetermined range and the right calcaneal joint 30 is inside the right ankle joint 28, the right foot is judged to be inverted. Otherwise, the right foot is judged to be everted.

[0099] This embodiment also provides an electronic device. The electronic device includes a memory, a processor, and a computer program stored in the memory and executable on the processor. When the processor executes the program, it implements the steps of the human posture assessment method described above.

[0100] This embodiment also provides a computer program product. The computer program product includes computer program instructions that, when executed by a processor, implement the steps of the human posture assessment method described above.

[0101] In this embodiment of the invention, the processor can be an integrated circuit chip with signal processing capabilities. The processor can be a general-purpose processor, a digital signal processor (DSP), an application-specific integrated circuit (ASIC), a field-programmable gate array (FPGA), or other programmable logic devices, discrete gate or transistor logic devices, or discrete hardware components. It can implement or execute the methods, steps, and logic block diagrams disclosed in this embodiment of the invention. The general-purpose processor can be a microprocessor or any conventional processor. The steps of the methods disclosed in this embodiment of the invention can be directly implemented by a hardware decoding processor, or implemented by a combination of hardware and software modules in the decoding processor. The software modules can be located in random access memory, flash memory, read-only memory, programmable read-only memory, electrically erasable programmable memory, registers, or other mature storage media in the art. The processor reads information from the storage medium and, in conjunction with its hardware, completes the steps of the above methods. The storage medium can be memory, for example, volatile memory or non-volatile memory, or may include both volatile and non-volatile memory. Non-volatile memory can be read-only memory (ROM), programmable read-only memory (PROM), erasable programmable read-only memory (EPROM), electrically erasable programmable read-only memory (EEPROM), or flash memory. Volatile memory can be random access memory (RAM), which is used as an external cache. By way of example, but not limitation, many forms of RAM are available, such as Static Random Access Memory (SRAM), Dynamic Random Access Memory (DRAM), Synchronous DRAM (SDRAM), Double Data Rate SDRAM (DDRSDRAM), Enhanced Synchronous DRAM (ESDRAM), Synchlink DRAM (SLDRAM), and Direct Rambus RAM (DRRAM).The storage media described in the embodiments of this invention are intended to include, but are not limited to, these and any other suitable types of memory. Those skilled in the art will recognize that the functions described in the above examples can be implemented using a combination of hardware and software. When applied software, the corresponding functions can be stored in a computer-readable medium or transmitted as one or more instructions or code on a computer-readable medium. Computer-readable media include computer storage media and communication media, wherein communication media include any medium that facilitates the transmission of computer programs from one place to another. Storage media can be any available medium accessible to general-purpose or special-purpose computers. Although the invention has been described in detail above with general description and specific embodiments, modifications or improvements can be made to it, which will be apparent to those skilled in the art. Therefore, such modifications or improvements made without departing from the spirit of the invention are all within the scope of protection claimed by the invention.

[0102] The above description is merely a preferred embodiment of the present invention and is not intended to limit the present invention in any way. Any simple modifications, equivalent changes, or alterations made by those skilled in the art using the disclosed technical content shall fall within the protection scope of the present invention.

Claims

1. A method of body posture assessment, characterized by, include: Acquire an image to be evaluated, including a frontal view image of the user; The image to be evaluated is input into the MediaPipe large model, which identifies 15 bony joints of the human body in the image. The 15 bony joints include the nose, left ear, right ear, left shoulder, right shoulder, left anterior superior iliac spine, right anterior superior iliac spine, left knee, right knee, left ankle, right ankle, left heel, right heel, left big toe, and right big toe. Multiple baselines of the body in the image to be evaluated are obtained from the identified bone joints, including the frontal longitudinal baseline, head horizontal line, shoulder horizontal line, hip horizontal line, knee horizontal line, and ankle horizontal line; By measuring the angle or distance between the intersection of multiple baselines and the lines connecting the corresponding bone joints, and based on preset judgment rules, the body posture assessment results for different parts are obtained.

2. The body posture evaluation method according to claim 1, characterized by, The longitudinal baseline for frontal viewing is the vertical line perpendicular to the midpoint of the line connecting the left and right calcaneal joints; the head horizontal line is the horizontal line passing through the nasal joint; the shoulder horizontal line is the horizontal line passing through the right scapular joint; the hip horizontal line is the horizontal line passing through the right anterior superior iliac spine joint; the knee horizontal line is the horizontal line passing through the right knee joint; and the ankle horizontal line is the horizontal line passing through the right ankle joint.

3. The body posture evaluation method according to claim 2, characterized by, The method of measuring the angle or distance between the intersections of multiple baselines and the lines connecting corresponding bone joints, and obtaining body posture assessment results for different body parts according to preset judgment rules, specifically includes: (1) Assessment of the tilt angle of the center of gravity: Connect the midpoint of the line connecting the left and right heel joints to the nasal joint, and measure the angle between the line and the longitudinal baseline of the front view. If the angle is within the predetermined range of ±5°, the tilt angle of the body center of gravity is determined to be normal. If the angle is outside the predetermined range and is positive, the body center of gravity is determined to be tilted to the left. If the angle is outside the predetermined range and is negative, the body center of gravity is determined to be tilted to the right. (2) Neck tilt angle assessment: Connect the left ear bone joint point and the right ear bone joint point, and measure the angle between the connecting line and the horizontal line of the head. If the angle is within the predetermined range of ±2°, the neck tilt angle is determined to be normal. If the angle is outside the predetermined range and the left ear is lower, the head is determined to be tilted to the left. Otherwise, the head is determined to be tilted to the right. (3) Assessment of neck rotation angle: Connect the left scapular joint point and the right scapular joint point, then connect the midpoint of the two shoulders to the nasal joint point, and measure the angle between the connecting line and the vertical line passing through the midpoint of the two shoulders. If the angle is within the predetermined range of ±5°, the neck rotation angle is considered normal. If the angle is outside the predetermined range and the nasal joint point is to the left of the vertical line passing through the midpoint of the two shoulders, the head is considered to rotate to the left. Otherwise, the head is considered to rotate to the right. (4) Shoulder tilt angle assessment: Connect the left scapular joint point and the right scapular joint point, and measure the angle between the connecting line and the shoulder horizontal line. If the angle is within the predetermined range of ±2°, the shoulder tilt angle is determined to be normal. If the angle is outside the predetermined range and the left shoulder is lower, the right shoulder is determined to be higher. Otherwise, the left shoulder is determined to be higher. (5) Hip tilt angle assessment: Connect the joint of the left anterior superior iliac spine and the joint of the right anterior superior iliac spine, and measure the angle between the connecting line and the hip horizontal line. If the angle is within the predetermined range of ±2°, the hip tilt angle is determined to be normal. If the angle is outside the predetermined range and the left anterior superior iliac spine is low, the right hip is determined to be high. Otherwise, the left hip is determined to be high. (6) Leg shape assessment: Connect the right anterior superior iliac spine joint point and the right knee joint point, and measure the angle between the line connecting the right anterior superior iliac spine joint point and the right ankle joint point. If the angle is within the predetermined range of ±5°, the leg shape is judged to be normal. If the angle is outside the predetermined range and the right knee joint point is outward, it is judged to be O-shaped legs. Otherwise, it is judged to be X-shaped legs. (7) Foot type assessment: Connect the left ankle joint point and the left big toe joint point, and measure the angle between the connecting line and the vertical line passing through the left ankle joint point. If the angle is within the predetermined range of 20~45°, the foot type is judged to be normal. If the angle is less than 20°, it is judged to be an in-toeing foot type. If the angle is greater than 45°, it is judged to be an out-toeing foot type.

4. The body posture evaluation method according to claim 3, characterized by, Also includes: (8) Pelvic rotation assessment: Measure the distances from the left anterior superior iliac spine joint and the right anterior superior iliac spine joint to the longitudinal baseline in frontal view. If the two are equal, the pelvis is considered normal. If the two are not equal, and the distance from the left anterior superior iliac spine joint to the longitudinal baseline in frontal view is less than the distance from the right anterior superior iliac spine joint to the longitudinal baseline in frontal view, the pelvis is considered to be rotated to the left. Otherwise, the pelvis is rotated to the right. (9) Left leg rotation assessment: Observe whether the joint of the left big toe is inside or outside the joint of the left knee. If it is outside the predetermined range inside the knee, the left leg is determined to be internally rotated. If it is outside the predetermined range outside the knee, the left leg is determined to be externally rotated. (10) Right leg rotation assessment: Observe whether the joint of the right big toe is inside or outside the joint of the right knee. If it is outside the predetermined range inside, the right leg is determined to be internally rotated. If it is outside the predetermined range outside, the right leg is determined to be externally rotated.

5. The body posture evaluation method according to any one of claims 1 to 4, characterized in that, The image to be evaluated also includes a left-side view image of the user. The steps for deriving body posture evaluation results for different body parts from the left-side view image specifically include: The left-side view image was input into the MediaPipe large model, and six bony joints of the human body in the image were identified, including: nose, left ear, left shoulder, left anterior superior iliac spine, left knee, and left ankle. Multiple baselines for the body in the left-side view image are obtained from the identified bone joints, including the longitudinal baseline for the side view and the mid-axillary line; the longitudinal baseline for the side view is a vertical line passing through the bone joint of the left ankle, and the mid-axillary line is a vertical line passing through the bone joint of the left shoulder. By measuring the angles or distances between the intersections of multiple baselines and the lines connecting corresponding joint points, and based on preset judgment rules, the body posture assessment results for different body parts are obtained, including: (11) Assessment of body forward and backward tilt: Connect the left ear bone joint point and the left ankle bone joint point, and measure the angle between the connecting line and the longitudinal baseline of the side view. If the angle is within the predetermined range of ±5°, the body forward and backward tilt is determined to be normal. If the angle is outside the predetermined range and is positive, the body is determined to be forward tilted. If it is negative, the body is determined to be backward tilted. (12) Head tilt assessment: Connect the left ear bone joint point and the nasal bone joint point, and measure the angle between the connecting line and the horizontal line. If the angle is within the predetermined range of ±2°, the head tilt is considered normal. If the angle is outside the predetermined range and the nasal bone joint point is low, the head is considered tilted forward. Otherwise, the head is tilted backward. (13) Head protrusion assessment: If the left ear joint is within a predetermined distance range in front of the longitudinal baseline in lateral view, the head is determined not to be protruding; if it is outside the predetermined distance range, the head is determined to be protruding. (14) Assessment of kyphosis: If the left shoulder joint is located in front of the longitudinal baseline in lateral view, it is judged as kyphosis with hunched shoulders. (15) Assessment of pelvic tilt: If the joint of the left anterior superior iliac spine is located outside the predetermined distance range in front of the longitudinal baseline in lateral view, the pelvis is determined to be anteriorly tilted; if the joint of the left anterior superior iliac spine is located outside the predetermined distance range in back of the longitudinal baseline in lateral view, the pelvis is determined to be posteriorly tilted. (16) Knee hyperextension angle assessment: Connect the left anterior superior iliac spine joint point with the left ankle joint point. If the left knee joint point is located outside the predetermined distance range in front of the line, it is determined to be a flexed leg. If the left knee joint point is located outside the predetermined distance range in the back of the line, it is determined to be a knee hyperextension.

6. The body posture assessment method according to claim 5, characterized in that, The image to be evaluated also includes a user's rear view image. The steps for deriving body posture evaluation results for different body parts from the rear view image specifically include: The rear view image was input into the MediaPipe large model, and six bony joints of the human body in the image were identified, including: left knee, right knee, left ankle, right ankle, left heel, and right heel; By comparing the coordinates of the obtained joint points with the angles formed by the lines connecting the corresponding joint points, and according to preset judgment rules, the body posture assessment results for different body parts are obtained, including: (17) Leg length discrepancy assessment: Compare the longitudinal coordinates of the left knee joint and the right knee joint. If the longitudinal coordinate of the left knee joint is greater than the longitudinal coordinate of the right knee joint and is outside the predetermined range, the left leg is determined to be longer. If the longitudinal coordinate of the left knee joint is less than the longitudinal coordinate of the right knee joint and is outside the predetermined range, the right leg is determined to be longer. (18) Assessment of left ankle tilt: Connect the left ankle joint and the left heel joint, and measure the angle between the line and the vertical line passing through the left ankle joint. If the angle is within the predetermined range of ±3°, the left ankle tilt is normal. If it is outside the predetermined range and the left heel joint is inside the left ankle joint, the left foot is judged to be inverted. Otherwise, it is judged to be everted. (19) Assessment of right ankle tilt: Connect the right ankle joint and the right heel joint, and measure the angle between the line and the vertical line passing through the right ankle joint. If the angle is within the predetermined range of ±3°, the right ankle tilt is normal. If it is outside the predetermined range and the right heel joint is inside the right ankle joint, the right foot is judged to be inverted. Otherwise, it is judged to be everted.

7. A human posture assessment device, characterized in that, It includes an image acquisition component and a control mechanism connected thereto. The image acquisition component uses a monocular camera, and the control mechanism includes: Image receiving module: used to receive the image to be evaluated acquired by the image acquisition component; The bone joint acquisition module is used to build a large MediaPipe model to identify human bone joints in the image to be evaluated. A baseline determination module is used to obtain multiple baselines of the body in the image to be evaluated from the bone joint points; The posture assessment module is used to measure the angle or distance between the intersection of multiple baselines and the lines connecting the corresponding joints in the joints, and to obtain the body posture assessment results for different parts of the body according to preset judgment rules.

8. The body posture assessment device according to claim 7, characterized in that, It also includes a display mechanism connected to the control mechanism for displaying and guiding posture adjustment instructions during human posture measurement.

9. An electronic device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, characterized in that, When the processor executes the program, it implements the steps of the human posture assessment method as described in any one of claims 1 to 6.

10. A computer program product, characterized in that, The computer program product includes computer program instructions that, when executed by a processor, implement the steps of the human posture assessment method as described in any one of claims 1 to 6.

Images