A smart mirror for fitness that turns automatically

Abstract

The present invention relates to an automatically steerable fitness smart mirror for multiple people to exercise, comprising a mirror body, a display device, an image capture device, a motion comparison unit and a control unit. The display device is arranged at the rear of the mirror body and is used to display a coach image to guide the user to exercise. The image capture device defines an image capture area for capturing the motion images of the users located in the image capture area. The motion comparison unit is used to compare the motion images of the users captured by the image capture device with the coach image and obtain the motion consistency of each user. The control unit can control the mirror surface of the mirror body to rotate toward the user with the highest consistency according to the motion consistency of the users obtained by the motion comparison unit.

Description

Technical Field

[0001] The present invention relates to fitness-related equipment, and in particular to an automatically steerable fitness smart mirror which can guide a user to perform fitness exercises. Background Art

[0002] Nowadays, the trend of exercising is becoming more and more popular. However, due to the limited space for exercising in cities and the fact that outdoor exercise is often restricted by weather conditions, indoor fitness exercises are gradually becoming popular. Nowadays, a smart mirror on the market can allow athletes to follow the movements of the demonstration image in the mirror to perform fitness exercises. In other words, a demonstration image can be displayed on the mirror surface of the smart mirror, just like a fitness coach instructing students to exercise. The athlete can see himself and the demonstration image on the mirror surface at the same time, and perform fitness movements following the demonstration image, and can correct his movements instantly through the mirror image.

[0003] However, the above-mentioned smart mirrors are usually only used by a single user and the mirror angle will not automatically adjust according to the user's needs. If multiple users want to participate in the same fitness course and perform fitness exercises at the same time, they usually need to use multiple smart mirrors to connect simultaneously. Even if a single smart mirror can allow multiple users to view the coach's image in the mirror, because the mirror angle cannot be automatically rotated, usually only a specific user can see his or her own image in the mirror, which makes the use of smart mirrors relatively limited. Summary of the invention

[0004] In view of the above problems, the main purpose of the present invention is to provide an automatically turning smart fitness mirror that can be used by multiple people. The smart mirror has a mirror body that can automatically adjust the mirror surface to face a specific user based on the degree of consistency between the movements of multiple users in the image capture area and the image of the coach in the mirror.

[0005] To achieve the above-mentioned purpose, the present invention provides an automatically steerable fitness smart mirror for guiding multiple users to perform fitness exercises and for tracking and comparing movements. The smart mirror is characterized in that it comprises: a base frame; a mirror body, which is disposed on the base frame in a displaceable manner, and can allow the user in front of the mirror body to view the image reflected by the mirror surface; a display device, which is disposed behind the mirror body and is used to display a coach image to guide the user to perform exercises, and the coach image can penetrate the mirror body and be displayed on the mirror surface for the user to view; an image capture device, which is disposed on the base frame and fixedly mounted on the mirror body; An image capture area is used to capture the motion image of the user located in the image capture area; a motion comparison unit is used to compare the motion image of the user captured by the image capture device with the coach image and obtain the degree of consistency between the motion of each user and the motion of the coach image after comparison; a control unit is electrically connected to the motion comparison unit and is used to control the rotation of the mirror body to adjust the angle of the mirror surface. The control unit controls the mirror surface of the mirror body to rotate toward a specific user among the multiple users according to the degree of consistency of the motion of each user obtained by the motion comparison unit.

[0006] In the technical solution of the present invention, there is further a driving unit disposed between the base frame and the mirror body, wherein the driving unit is electrically connected to the control unit, and the driving unit is controlled by the control unit to drive the mirror body to rotate so that the mirror surface of the mirror body faces the specific user.

[0007] The motion comparison unit is used to compare and analyze the movements of the user in the image capture area with the movements of the coaching image, and determine the user with the highest degree of consistency. The control unit controls the mirror surface of the mirror body to rotate toward the user with the highest degree of consistency based on the analysis result of the motion comparison unit.

[0008] The motion comparison unit is used to compare and analyze the movements of the users in the image capture area with the movements of the coaching image, and determine the user with the lowest degree of consistency. The control unit controls the mirror surface of the mirror body to rotate toward the user with the lowest degree of consistency based on the analysis result of the motion comparison unit.

[0009] The motion comparison unit is used to determine the degree of consistency between the movement of the users in the image capture area and the movement of the coaching image, and obtain the motion score of each user. The motion comparison unit can determine the user with the highest score based on the motion score, and the control unit controls the mirror surface of the mirror body to rotate toward the user with the highest motion score based on the motion score.

[0010] The image capture device is used to dynamically capture the motion images of users located in the image capture area. When the motion comparison unit determines that the motion consistency of any user in the image capture area is higher than that of other users, the control unit will control the mirror body to rotate toward the user with the highest consistency. At this time, the user can see his or her own reflection and the coach's image on the mirror.

[0011] The mirror body can be deflected within a predetermined angle so that its mirror surface can rotate toward the specific user. When the mirror surface rotates toward the specific user, other users located in the image capture area can still see the coach image on the mirror surface and continue to exercise. At the same time, the motion comparison unit continues to compare the movement images of the users in the image capture area with the movements of the coach image.

[0012] The image capture device is a depth image camera, an optical camera, an infrared camera, a stereo camera, a somatosensory camera or a high-speed camera.

[0013] In order to achieve the above-mentioned purpose, the present invention also provides a method for a fitness smart mirror whose mirror surface can automatically turn towards a specific user, which is used to track and compare the movements of multiple users in an image capture area, and turn the mirror surface towards the specific user, characterized in that the method includes: capturing movement images of multiple users in an image capture area; tracking the movements of users located in the image capture area; comparing and analyzing the movement images of the users with a coach image to obtain comparison and analysis results of each user; according to the comparison and analysis results of each user, obtaining the degree of consistency between the movement of each user and the movement of the coach; and according to the degree of consistency of each user, automatically turning the mirror surface of the smart mirror towards the specific user.

[0014] The user with the highest matching degree is further determined, and the mirror surface of the smart mirror is rotated toward the user with the highest matching degree.

[0015] By adopting the above technical solution, the smart mirror for fitness provided by the present invention can provide multiple people with fitness exercises at the same time, and the mirror surface can automatically adjust the mirror angle according to the degree of fit of the user's movements, thereby increasing the interactivity between the smart mirror and the user. BRIEF DESCRIPTION OF THE DRAWINGS

[0016] Figure 1 1 is a schematic diagram of a preferred embodiment of a fitness smart mirror of the present invention, wherein the smart mirror can provide fitness exercises for multiple people;

[0017] Figure 2 Display the fitness smart mirror and its display interface of the preferred embodiment;

[0018] Figure 3 yes Figure 1 Block diagram of a smart mirror for fitness;

[0019] Figure 4 A flow chart for illustrating the method of automatically turning a fitness smart mirror toward a specific user according to the preferred embodiment. DETAILED DESCRIPTION

[0020] The present invention provides a smart mirror for fitness, which is used to display an action demonstration image or a coaching image to guide multiple people to perform fitness exercises. At the same time, the smart mirror can change the angle of its mirror surface according to the exercise scores of the participants, so that the mirror surface faces a specific user, such as the one with the highest exercise score, to increase the interactivity between the smart mirror and the user. The following embodiments are given to explain the structure and function of the present invention in detail in conjunction with the accompanying drawings.

[0021] See also Figure 1 and Figure 2 1 is a schematic diagram of a preferred embodiment of a fitness smart mirror 10 of the present invention, which comprises: a base frame 11 and a mirror body 12 installed in the base frame 11 and displaceable relative to the base frame 11, a display device 13 arranged behind the mirror body 12, an image capture device 20 arranged on the base frame 11, and a control unit 30. The base frame 11 is a vertical frame, which can be used for the smart mirror 10 to be fixed on a wall to keep it vertical, or directly lean against a wall or set on the ground; the mirror body 12 has a mirror surface 14 for the user in front of it to view its image 16 reflected by the mirror surface 14; the display device 13 is used to display a coach image 15 to guide the user to perform fitness exercises, and the coach image 15 can pass through the lens body 12 and be displayed on the mirror surface 14 for the user to watch, so that the user can follow the demonstration of the coach image 15 to perform fitness exercises, and can correct his own actions in real time through the mirror image 16.

[0022] See also Figure 1 The image capture device 20 defines an image capture area 21 in front of the smart mirror 10, and is used to capture the motion image of the user located in the image capture area 21. In the preferred embodiment, the smart mirror 10 can provide multiple people with fitness exercises at the same time, such as Figure 1The image capture area 21 shows that there are three users, namely the first user U1, the second user U2 and the third user U3, who are doing fitness exercises in front of the smart mirror 10 at the same time. The three users U1, U2 and U3 can all see the coach image 15 on the mirror surface 14 of the mirror body 12, and follow the movements of the coach image 15 to do fitness exercises. However, due to the size and angle of the mirror surface 14, usually only one user can fully see his or her own image in the mirror. In the preferred embodiment, the mirror body 12 can deflect left and right within a deflection angle relative to the base frame 11 along a longitudinal axis V, for example, between 0 and 10 degrees, wherein the angle of the mirror surface 14 of the mirror body 12 can be controlled by the control unit 30 so that the mirror surface 14 faces a specific user, for example, the third user U3, so that the third user U3 can not only see the coach image 15 in the mirror, but also clearly see his or her own image 16, such as Figure 2 shown.

[0023] like Figure 1 As shown, the smart mirror 10 further has an image processing unit 31, a motion comparison unit 32 and a driving unit 40, which are electrically connected to the control unit 30 respectively. The image capture device 20 can detect and obtain images, including images of multiple users. The image processing unit 31 is used to receive the user images captured by the image capture device 20 and perform preliminary analysis to obtain motion information of each user, such as depth information of the image, the user's motion trajectory, information of each node of the body, etc.; the motion comparison unit 32 is used to compare and analyze the user image captured by the image capture device 20 with the coach image. The motion comparison unit 32 can compare and analyze the motion information of multiple users analyzed by the image processing unit 31 with the motion information of the coach image respectively to provide analysis results for each user, such as comparing and analyzing the motion trajectory of each user with the motion trajectory of the coach image to obtain the degree of consistency between the motion of each user and the motion of the coach image after comparison, such as Figure 2 The driving unit 40 is disposed between the base frame 11 and the mirror body 12 and is controlled by the control unit 30 to drive the mirror body 12 to rotate relative to the base frame 11 so that the mirror surface 14 of the mirror body 12 faces a specific user. The driving unit 40 is an electric motor, such as a driving device such as a stepping motor. The electric motor is an application of conventional technology and is not the main invention subject of the present invention and is not limited here.

[0024] In this preferred embodiment, the coach image can be a coach image of an online fitness course, or a coach image of a fitness course built into the smart mirror 10. The image capture device 20 can be an image capture device such as a depth image camera, an optical camera, an infrared camera, a stereo camera, a somatosensory camera, or a high-speed camera. The image capture device is a known prior art and is not the main invention subject of the present invention, and is not limited here. The control unit 30 is electrically connected to the motion comparison unit 32 and the drive unit 40, and is used to control the mirror body 12 to rotate relative to the base frame 11 along the longitudinal axis V to adjust the deflection angle of the mirror surface 14. The control unit 30 can control the mirror surface 14 of the mirror body 12 to face a specific user based on the degree of consistency of the movements of individual users obtained by the motion comparison unit 32.

[0025] The smart mirror 10 of the present invention can provide multiple people with fitness exercises at the same time, such as Figure 1 and Figure 2 As shown, when a fitness course begins, multiple users U1-U3 located in the image capture area 21 in front of the smart mirror 10 can exercise following the demonstration movements of the fitness coach image 15, and the image capture device 20 of the smart mirror 10 can dynamically capture the fitness movements of the users, and the movement comparison unit 32 determines the consistency of the movements of each user with the movements of the coach image 15. By determining the consistency of the movements of each user, an instant consistency score can be generated in a dynamic movement scoring area 17 of the mirror surface 14, such as Figure 2 The action score of this embodiment is presented in the form of percentage, for example Figure 2 The display mirror 14 shows in the dynamic action scoring area 17 that the first user U1 has a matching degree of 78%, the second user U2 has a matching degree of 75%, and the third user U3 has a matching degree of 82%. The image capture device 20 and the action comparison unit 32 capture and compare the matching degree of the user's motion with the motion of the coach image 15 in real time. Therefore, the action score is a dynamic and real-time score. During the fitness process, it will change with the correctness and matching degree of each user's fitness action. The action score (or matching degree) can be obtained by calculating through the control unit 30 of the smart mirror 10, or the relevant motion data of the user can be uploaded to a cloud server for calculation and then sent back to the smart mirror 10. In addition, the action comparison unit 32 can be set in the cloud server in addition to the smart mirror 10, and is not limited here.

[0026] In this preferred embodiment, the motion comparison unit 32 can determine the user with the highest motion score or the highest degree of consistency among the multiple users located in the image capture area 21 according to the motion scores or the degree of consistency. The control unit 30 then controls the mirror surface 14 of the mirror body 12 to rotate toward the user with the highest motion score or the highest degree of consistency according to the analysis result of the motion comparison unit 32. Figure 2 As shown, the smart mirror 10 shows that the third user U3 has the highest matching degree of 82% among the three. The control unit 30 can then control the driving unit 40 to drive the mirror body 12 to deflect so that the mirror surface 14 of the mirror body 12 faces the third user U3. Figure 1 As shown, the third user U3 is allowed to see the coach image 15 and his own mirror image 16 on the mirror 14 at the same time. Because the action matching degree is a dynamic score, when the mirror 14 is facing a specific user, other users can still see the demonstration action of the coach image 15 in the mirror and continue to follow the coach image 15 to move. The user can improve the matching degree of his own action by adjusting the accuracy of his own action. When his action matching degree is higher than the user with the highest original matching degree, the mirror 14 will turn to the new user with the highest action matching degree. In this way, multiple users located in the image capture area 21 can increase the fun of multi-person training and the interactivity with the smart mirror 10 through competition among each other.

[0027] In this preferred embodiment, the image capture area 21 is a fixed area, that is, the image capture area 21 will not change due to the rotation of the mirror body 12. Therefore, the user originally located in the image capture area 21 will not leave the image capture area 21 due to the deflection of the angle of the mirror 14. In other words, the image capture device 20 can still continue to capture and track the user in the image capture area 21.

[0028] See also Figure 3 , is a block diagram of a preferred embodiment of the fitness smart mirror 10 of the present invention for guiding multiple users to perform fitness exercises and adjusting the mirror angle to face a specific user. The smart mirror 10 can provide N users (users 1 to N shown in the figure) with the image of the coach 15 in the mirror to perform fitness exercises in the image capture area 21. During the exercise, the image capture device 20 captures the motion images of the users in the image capture area 21, and then the image processing unit 31 performs image analysis to obtain the motion information and data of each user. The motion information (e.g., motion trajectory) of the N users is compared and analyzed with the motion of the coach image 15 by the motion comparison unit 32 to obtain the degree of consistency between the motion of each user and the motion of the coach image 15. The control unit 30 can control the driving unit 40 to drive the mirror body 12 to rotate the mirror surface 14 toward a specific user, for example, toward the user with the highest degree of consistency in motion, according to the analysis result of the motion comparison unit 32.

[0029] See also Figure 4, used to illustrate the method flow 50 of the preferred embodiment of the present invention for automatically turning the fitness smart mirror 10 to a specific user. First, N users follow the coach image 15 in the mirror to perform fitness exercises in the image capture area 21. Step 51, the image capture device 20 captures the images of the N users in the image capture area 21; Step 52, track the movements of the N users in the image capture area 21; Step 53, the movement comparison unit 32 compares the movements of the N users with the movements of the coach image 15 and obtains the consistency of each user; Finally, Step 54, determine the user with the highest consistency, and turn the mirror surface 14 of the smart mirror 10 toward the user, so that the user with the highest movement consistency can see the coach image 15 and his own mirror image 16 in the mirror at the same time.

[0030] In other preferred embodiments, the motion comparison unit 32 can also determine the user with the lowest motion consistency among the multiple users in the image capture area 21 according to the motion score or consistency, and control the control unit 30 to control the driving unit 40 to drive the mirror surface 14 of the mirror body 12 to rotate toward the user with the lowest motion consistency, so that the user with the lowest consistency can see his own image on the mirror surface 14, and correct his own motion in time to make it consistent with the demonstration motion of the coach image, so as to improve his own motion consistency. Different from the previous preferred embodiment, the mirror surface of the smart mirror is automatically turned to the user with the highest motion consistency. In this preferred embodiment, the mirror surface of the smart mirror is automatically turned to the user with the lowest motion consistency, so as to achieve the purpose of reminder, so that the user with the lowest consistency can correct his own motion instantly through the mirror image.

[0031] The above embodiments are only for explaining the technical means of the present invention and are not intended to be limiting. Any equivalent modifications of the present invention should be regarded as within the protection scope of the present invention.

Claims

1. An automatically steerable fitness smart mirror for guiding multiple users to perform fitness exercises and to track and compare their movements. The smart mirror is characterized in that Contains: a base frame; A mirror body, which is disposed on the base frame in a displaceable manner, and can allow the user in front of the mirror body to view the image reflected by the mirror surface; a display device, disposed at the rear of the mirror body, for displaying a coaching image to guide the user to exercise, wherein the coaching image can penetrate the mirror body and be displayed on the mirror surface for the user to watch; an image capturing device, disposed on the base frame and defining an image capturing area, for capturing a motion image of a user located in the image capturing area; an action comparison unit, for comparing the motion image of the user captured by the image capture device with the coach image and obtaining the degree of consistency between the motion of each user and the motion of the coach image; A control unit is electrically connected to the motion comparison unit, and is used to control the rotation of the mirror body to adjust the angle of the mirror surface. The control unit controls the mirror surface of the mirror body to rotate toward a specific user among the multiple users based on the consistency of the movements of each user obtained by the motion comparison unit; wherein the mirror body can deflect within a predetermined angle so that its mirror surface can rotate toward the specific user, and when the mirror surface rotates toward the specific user, other users in the image capture area can still see the coach image on the mirror surface and continue to exercise, and at the same time, the motion comparison unit continues to compare the movement images of the users in the image capture area with the movements of the coach image.

2. The automatically steerable fitness smart mirror as claimed in claim 1, characterized in that: There is further a driving unit disposed between the base and the mirror body, the driving unit being electrically connected to the control unit, the driving unit being controlled by the control unit to drive the mirror body to rotate so that the mirror surface of the mirror body faces the specific user.

3. The automatically steerable fitness smart mirror as claimed in claim 1, characterized in that: The motion comparison unit is used to compare and analyze the movements of the user in the image capture area with the movements of the coaching image, and determine the user with the highest degree of consistency. The control unit controls the mirror surface of the mirror body to rotate toward the user with the highest degree of consistency based on the analysis result of the motion comparison unit.

4. The automatically steerable fitness smart mirror as claimed in claim 1, characterized in that: The motion comparison unit is used to compare and analyze the movements of the users in the image capture area with the movements of the coaching image, and determine the user with the lowest degree of consistency. The control unit controls the mirror surface of the mirror body to rotate toward the user with the lowest degree of consistency based on the analysis result of the motion comparison unit.

5. The automatically steerable fitness smart mirror as claimed in claim 1, characterized in that: The motion comparison unit is used to determine the degree of consistency between the movement of the users in the image capture area and the movement of the coaching image, and obtain the motion score of each user. The motion comparison unit can determine the user with the highest score based on the motion score, and the control unit controls the mirror surface of the mirror body to rotate toward the user with the highest motion score based on the motion score.

6. The automatically steerable fitness smart mirror as claimed in claim 1, characterized in that: The image capture device is used to dynamically capture the motion images of users located in the image capture area. When the motion comparison unit determines that the motion consistency of any user in the image capture area is higher than that of other users, the control unit will control the mirror body to rotate toward the user with the highest consistency. At this time, the user can see his or her own reflection and the coach's image on the mirror.

7. The automatically steerable fitness smart mirror as claimed in claim 1, characterized in that: The image capture device is a depth image camera, an optical camera, an infrared camera, a stereo camera, a somatosensory camera or a high-speed camera.

8. A method for a fitness smart mirror whose mirror surface can automatically turn to a specific user, which is used to track and compare the movements of multiple users in an image capture area and turn the mirror surface to the specific user, characterized in that The method includes: Capturing an image to capture motion images of multiple users in the area; Tracking the movement of a user within the image capture area; Comparing and analyzing the action image of the user with a coach image to obtain comparison and analysis results of each user; According to the comparison and analysis results of each user, the degree of consistency between the movements of each user and the movements of the coach is obtained; According to the degree of fit of each user, the mirror surface of the smart mirror is automatically turned toward the specific user; when the mirror surface is turned toward the specific user, other users in the image capture area can still see the coach image on the mirror surface and continue to exercise, and at the same time, the movement images of the users in the image capture area are continuously compared with the movements of the coach image.

9. The method of claim 8 wherein the mirror surface of a fitness smart mirror can automatically turn toward a specific user, characterized in that: The user with the highest matching degree is further determined, and the mirror surface of the smart mirror is rotated toward the user with the highest matching degree.

Images