Motion guidance device

By adjusting image processing parameters and mirror display in real time, the problem of unbalanced image and mirror visibility of motion guidance devices under different ambient brightness conditions has been solved. This enables clear display of images of guides and users in various environments and allows users to adjust viewing priority as needed.

CN116665493BActive Publication Date: 2026-03-24QIAOSHAN FITNESS EQUIP (SHANGHAI) CO LTD
View PDF 7 Cites 0 Cited by

Patent Information

Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2022-04-15
Publication Date
2026-03-24

AI Technical Summary

Technical Problem

Existing motion guidance devices struggle to maintain a balanced visual contrast between the image and the mirror image under varying ambient brightness, impacting the user experience and failing to allow users to adjust the viewing priority of the image and mirror image according to their individual needs.

Method used

The system uses a camera to capture real-time images of the user and displays them in a mirrored manner. Combined with an ambient light sensor, it adjusts image processing parameters such as brightness, transparency, and contrast to maintain a stable contrast between the guide's image and the user's image under different ambient light conditions. It also allows users to adjust image parameters to meet their individual needs.

Benefits of technology

It ensures that users can clearly view both the guide image and the user image simultaneously under various ambient brightness conditions, and allows adjustment of the visibility contrast between the image and the mirror as needed, improving the user experience and flexibility.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN116665493B_ABST
    Figure CN116665493B_ABST
Patent Text Reader

Abstract

The present invention relates to a motion guiding device, in which a display device is controlled by a control unit to display an image, in which a guide image and a user image are simultaneously presentable, the guide image demonstrating a fitness exercise, and the user image being derived from live images continuously taken by a camera device from the direction of the image to the direction of the user and being presented in a mirror image. The control unit is capable of adjusting image parameters such as brightness, transparency, contrast, etc. of at least one of the guide image and the user image depending on the ambient brightness, and the adjustment of the guide image is not identical to the adjustment of the user image. The guide image and the user image can be presentable superimposed, and the user can adjust the relative transparency of both depending on the situation.
Need to check novelty before this filing date? Find Prior Art

Description

TECHNICAL FIELD

[0001] The present invention relates to a sports training device, and in particular to a device for guiding a user to perform a fitness exercise using an image. BACKGROUND

[0002] U.S. Patent No. 10,828,551 discloses a device for guiding a user to perform a fitness exercise using an image (hereinafter referred to as a sports guiding device). The sports guiding device mainly comprises a half-mirror and a liquid crystal display panel arranged behind the half-mirror. A user positioned in front of the half-mirror can simultaneously see a mirror image formed by the mirror reflection of light rays and an image displayed by the liquid crystal display panel penetrating the mirror from behind the half-mirror, which is called a "smart mirror" nowadays. Thus, when guiding the user to perform a fitness exercise, the user can watch and imitate the movement actions demonstrated by a coach (guide) in the image, and at the same time, can check his own movement actions in the mirror image and correct himself by directly comparing with the demonstration image. From the user's point of view, the image is superimposed on the mirror image like a semi-transparent image, and the image of the guide and the mirror image of the user are usually superimposed in the central region of the mirror.

[0003] Generally speaking, when performing a fitness exercise using the sports guiding device, the visibility of the image and the mirror image should maintain a proper contrast relationship, so that the user can simultaneously and clearly watch the superimposed image and mirror image. However, this contrast relationship will change with the light conditions of the use environment, and when the environment is too bright or too dark, the contrast relationship may be significantly unbalanced, which will affect the use experience. For example, when the environment brightness is relatively high (extreme conditions such as direct sunlight in a room), because the half-mirror reflects the brighter light in front of it, the image behind it appears relatively light, and the mirror image reflected by the mirror is as bright as the real environment, so the visibility of the mirror image is significantly higher than that of the image, which makes the user unable to clearly recognize the content of the image. On the contrary, when the environment brightness is relatively low (extreme conditions such as dim or dark room), because the pupil naturally dilates, the image displayed by the liquid crystal display panel appears relatively bright, and the mirror image reflected by the mirror is as dim as the real environment, so the visibility of the image is significantly higher than that of the mirror image, which makes the user unable to clearly watch his own mirror image. Of course, even if it is not an extreme condition of very bright or very dark, the change of the environment brightness within a general range will also change the visibility of one of the image and the mirror image relative to the other, which is not the phenomenon expected by the user.

[0004] If the screen brightness automatic adjustment function commonly equipped in recent years' smart phones or tablet computers is applied to the above-mentioned exercise guiding device, i.e. an ambient light sensor is arranged to sense the ambient brightness, and the brightness of the image picture is automatically adjusted (e.g. the brightness of the backlight module light source of the liquid crystal display panel is adjusted) according to the sensed ambient brightness, although the brightness of the image picture can be matched with the ambient brightness at any time, and the visibility of the image picture can be improved by increasing the screen brightness in a brighter environment, and the eye fatigue can be reduced by decreasing the screen brightness in a darker environment, etc., this still cannot completely solve the above-mentioned problems, because, unlike the smart phones or tablet computers which only need to consider the influence of the screen brightness on the user's viewing of the image picture, in the above-mentioned exercise guiding device, adjusting the screen brightness can basically only control the visibility of the image picture behind the mirror, and cannot control the visibility of the mirror image formed by the light rays in front of the mirror. In other words, the user can well view the image picture in various ambient brightness, but this does not mean that the user can also well view the mirror image (sometimes it may even be the opposite), at least it cannot guarantee that the visibility of the image picture and the mirror image maintains a predetermined contrast relationship.

[0005] Another deficiency of the above-mentioned exercise guiding device is that according to individual needs, the user may want to focus on or only view the image of the guide in some situations, and relatively does not need or does not need to view the mirror image of himself; on the contrary, according to individual needs, the user may want to focus on or only view the mirror image of himself in some situations, and relatively does not need or does not need to view the image of the guide (instead, only follows the voice guidance of the guide to perform the fitness exercise); the similar exercise guiding devices in the prior art basically cannot meet the above-mentioned needs. Of course, by creating a dim indoor environment and / or increasing the screen brightness to fade the mirror image, or by creating a bright indoor environment and / or decreasing the screen brightness to fade the image picture, the practicability and practical effect are low. SUMMARY

[0006] In view of the above-mentioned problems, the main purpose of the present application is to provide an exercise guiding device which can allow the user to simultaneously view the image of a guide demonstrating a fitness exercise and the image of the user reflecting the real situation, so that the fitness exercise can be imitated and self-inspected, wherein in various ambient brightness, the exercise guiding device can allow the user to simultaneously well view the image of the guide and the image of the user, and the contrast relationship between the visibility of the image of the guide and the image of the user will not be obviously changed due to the change of the ambient brightness.

[0007] Another object of the present application is to provide a motion guiding device, which can allow a user to simultaneously view a guide image of a demonstrator performing a fitness exercise and a user image reflecting the user in real time, so that the user can imitate the fitness exercise and self-inspect. In the motion guiding device, the user can adjust the contrast between the visibility of the guide image and the user image, so that the contrast imbalance caused by the ambient brightness can be corrected, or the contrast imbalance can be intentionally adjusted to a specific contrast imbalance, so that the user can more focusedly view one of the guide image and the user image, preferably, even one of the guide image and the user image can be invisible, so that the user can separately view the other one.

[0008] To achieve the above objects, the present application provides a motion guiding device, which can guide a user to perform a fitness exercise. The motion guiding device comprises a guide data obtaining device, which can obtain a guide image of a demonstrator performing the fitness exercise; a display device, which can display an image frame on a display surface; and a control unit, which is electrically connected to the guide data obtaining device and the display device, can receive corresponding data of the guide image obtained by the guide data obtaining device, and can control the content of the image frame displayed by the display device.

[0009] When guiding the user to perform the fitness exercise, the control unit can control the guide image to be displayed in the image frame, so that the user located in front of the display surface can view the guide image and imitate the fitness exercise. The motion guiding device further comprises a camera device, which can continuously capture a live image from the direction of the display surface to the direction of the user. The control unit is electrically connected to the camera device, can receive corresponding data of the live image captured by the camera device. When guiding the user to perform the fitness exercise, the control unit can control the first image and the second image to be simultaneously displayed in the image frame. The first image comprises the guide image, and the second image comprises a user image from the live image and is presented in a mirror image manner. The control unit can perform corresponding image processing on the content of the image frame according to the brightness of the environment where the motion guiding device is located. The image processing comprises adjusting at least one image parameter of at least one of the first image and the second image, and all adjustments performed on the first image are inconsistent with all adjustments performed on the second image. The image parameters include but are not limited to brightness, transparency, contrast, sharpness, hue, lightness, chroma, gain value, gamma value, color temperature, and color balance. Moreover, all adjustments performed on the first image are inconsistent with all adjustments performed on the second image.

[0010] The control unit can appropriately control the position and size of the user image in the image screen, so that the user watches the user image similar to watching his / her own mirror image through a mirror.

[0011] The motion guiding device further comprises an instruction receiving interface capable of receiving instructions from the user; the control unit is electrically connected to the instruction receiving interface and can adjust the image parameters, position or size of at least one of the first image and the second image in response to specific instructions.

[0012] The first image and the second image at least partially overlap, and the overlapping part simultaneously displays both images in a semi-transparent manner.

[0013] The motion guiding device further comprises an instruction receiving interface capable of receiving instructions from the user; the control unit is electrically connected to the instruction receiving interface and can adjust the transparency of at least one of the first image and the second image in response to specific instructions.

[0014] The transparency of the first image and the second image can be adjusted in at least five stages from completely opaque to completely transparent, and the decrease in the transparency of one of the first image and the second image is accompanied by an increase in the transparency of the other; when one of the first image and the second image is completely opaque, the other is completely transparent; the motion guiding device further comprises a loudspeaker, and the control unit can control the sound content emitted by the loudspeaker, including guiding voice matched with the guide image.

[0015] When the control unit determines that the brightness of the environment where the motion guiding device is located becomes brighter and performs the image processing, the image processing includes reducing the transparency of the first image and increasing the transparency of the second image; when the control unit determines that the brightness of the environment where the motion guiding device is located becomes darker and performs the image processing, the image processing includes increasing the transparency of the first image and reducing the transparency of the second image.

[0016] When the control unit determines that the brightness of the environment where the motion guiding device is located becomes brighter and performs the image processing, the image processing includes increasing the brightness of at least the first image of the first image and the second image, and the increase in the brightness of the first image is greater than the increase in the brightness of the second image; when the control unit determines that the brightness of the environment where the motion guiding device is located becomes darker and performs the image processing, the image processing includes reducing the brightness of at least the first image of the first image and the second image, and the decrease in the brightness of the first image is greater than the decrease in the brightness of the second image.

[0017] The motion guide device further comprises an ambient light sensing device capable of sensing the light illumination of the location; the control unit is electrically connected with the ambient light sensing device, capable of receiving the corresponding signal of the light illumination sensed by the ambient light sensing device, and capable of judging the brightness of the environment where the motion guide device is located according to the light illumination.

[0018] The control unit is capable of judging the brightness of the environment where the motion guide device is located according to the brightness of the live image. BRIEF DESCRIPTION OF DRAWINGS

[0019] Figure 1 is a block diagram of a motion guide device and related external devices of a preferred embodiment of the present application;

[0020] Figure 2 is a perspective view of the appearance of a motion guide device of a preferred embodiment of the present application;

[0021] Figure 3 is a front view of a motion guide device of a preferred embodiment of the present application in use, wherein an exemplary image screen content is shown;

[0022] Figure 4 schematic Figure 3 The image screen content shown comprises a first image and a second image overlapped;

[0023] Figures 5a to 5e schematic Figure 3 Under the image screen layout form shown, different stages of image processing are shown, in which the transparency of the first image and the second image is adjusted in a way that one increases while the other decreases;

[0024] Figures 6a to 6c schematic Figure 3 Under the image screen layout form shown, different stages of image processing are shown, in which the transparency of the first image is adjusted while the transparency of the second image remains unchanged;

[0025] Figures 7a to 7c schematic Figure 3 Under the image screen layout form shown, different stages of image processing are shown, in which the transparency of the second image is adjusted while the transparency of the first image remains unchanged;

[0026] Figures 8a to 8c schematic

[0027] Figures 9a to 9c schematic Figure 3The image layout shown illustrates different stages of image processing, where the brightness of the first and second images is adjusted respectively.

[0028] Figures 10a to 10c This illustration shows different stages of image processing under another image layout form of the present invention, demonstrating that the brightness of the first image and the second image are adjusted respectively.

[0029] Figure 11 This invention presents the differences between the image processing method based on ambient brightness and other methods. Detailed Implementation

[0030] The structure and effects of the present invention will now be described in detail with reference to the following embodiments and accompanying drawings.

[0031] First, such as Figure 1 As shown, the right half illustrates the main constituent units of a motion guidance device 1 according to a preferred embodiment of the present invention, while the left half shows the connection relationship between the user 2 of the motion guidance device 1 and related external devices. The arrows represent the transmission direction of data, signals, or commands. The motion guidance device 1 mainly includes a display device 20 for displaying images, a speaker device 30 for emitting sound, a storage device 40 for storing electronic data, a communication device 50 for bidirectional communication with the outside world, a camera device 60 for capturing on-site images, an ambient light sensor 70 for sensing ambient light, and a control unit 80 for managing all the above devices.

[0032] The control unit 80 is similar to the central processing unit (CPU) in a typical computer device, which serves as the computing and control hub. It forms electrical connections (usually wired, but possibly wireless) with the display device 20, speaker device 30, storage device 40, communication device 50, camera device 60, and ambient light sensor 70, respectively. It can control these devices via electrical signals and / or send and receive data or signals with them; the specific relationships will be explained in detail later. In this invention, a key function of the control unit 80 is to perform real-time digital image processing on the electronic images displayed on the display device 20. Therefore, it may actually include a graphics processing unit (GPU) or graphics processing core specializing in this function, as well as dedicated image random access memory (VRAM).

[0033] In terms of physical appearance, the motion guiding device 1 of a preferred embodiment of the present invention is as follows: Figure 2As shown, there is a frame assembly 10 as the device skeleton and housing, which is composed of a base frame 11 and a movable frame 12. The base frame 11 can be stably erected on the ground (such as the indoor floor), and the movable frame 12 is a vertical flat shell, which is pivoted on the base frame 11 according to a corresponding left-right axial rotation axis A, can rotate within a predetermined angle range according to the rotation axis A, and a positioning mechanism (provided on the back of the movable frame 12, not visible in the figure) is arranged between the movable frame 12 and the base frame 11 to determine whether the movable frame 12 can rotate. The user can position the movable frame 12 at the desired angle by operating the positioning mechanism, for example, to keep it vertical to the ground or to keep it inclined backward by a predetermined angle. The specific structure and operation of the positioning mechanism, as well as the angle adjustment function of the movable frame 12, are not substantially related to the technical means for solving the technical problems of the present application, so they are not described in detail in this case. If necessary, please refer to the applicant's other Chinese utility model patent application also named "exercise guiding device" (application number: 202121730156.7).

[0034] The display device 20, the speaker device 30, the storage device 40, the communication device 50, the camera device 60, the ambient light sensing device 70, and the control unit 80 are all installed on the movable frame 12. The configuration and function of each device are described in sequence as follows:

[0035] The display device 20 is specifically a flat panel display, such as a liquid crystal display, a plasma display, an organic light-emitting diode display, etc., which is installed in the flat space of the movable frame 12, only the display surface (screen surface) 21 is exposed in the central front of the movable frame 12 like being framed. The display surface 21 has a large-sized visual area, for example, a screen with a diagonal length of 43 inches or more, and is a wide screen or an ultra-wide screen, the longitudinal length is significantly greater than the transverse width, and the transverse width is preferably more than 50 cm. Moreover, the display device 20 (flat panel display) has a high-definition (HD) or ultra-high-definition (Ultra HD) display specification, which can display detailed and smooth images. The control unit 80 can control the display of the display device 20 on the display surface 21 (such as the image, text, etc. displayed on the display surface 21) according to the user's operation, and the display device 20 can also be used as a touch screen to receive the user's operation. Figure 3The content of the image frame 22 is similar in nature to the frame displayed on a computer screen controlled by a computer host. In order to allow a user standing in front of the display surface 21 to view the image frame 22 clearly, the display surface 21 (and the transparent plastic or glass layer in front of it, if any) should avoid mirror effect, i.e. the user should not see a bright color image of himself / herself when facing the display surface 21. In fact, the screen surface of a general flat panel display usually has a certain degree of anti-reflective effect, such as a surface-coated diffusive plastic layer or a glass layer with anti-reflective coating, to reduce the impact of light reflection on the viewing of the image.

[0036] In other possible embodiments of the present application (no figure), the display device is specifically a projector or a laser television, which can project an image frame on a wall, a projection screen or other vertical surface (as the display surface) for a user standing in front of the display surface to view.

[0037] The speaker device 30 is installed at the bottom, sides or other appropriate positions inside the space of the movable frame 12, and can emit sound to the outside through the speaker holes (not shown in the figure) on the front or sides of the movable frame 12. The control unit 80 can control the sound content emitted by the speaker device 30, which is similar in nature to the control of the sound emitted by an external speaker by a computer host.

[0038] The storage device 40 is specifically one or a combination of random access memory (RAM), hard disk (HDD), solid state disk (SSD), rewritable compact disc, memory card, USB flash drive and other types of computer data storage. The control unit 80 can read the data stored in the storage device 40 for use, and write data into the storage device 40 for saving or temporary storage. Unlike the main memory and registers that can be included in the control unit 80 (similar to a central processing unit), the storage device 40 is mainly used as a mass storage. The present application focuses on accessing guide data for guiding users to perform fitness exercises, such as multimedia content and related data of various exercise courses.

[0039] The communication device 50 can be a Bluetooth module, a Wi-Fi module, an Ethernet module, or the like. The control unit 80 can communicate with external devices via the communication device 50, including forming a communication connection with a portable device 92 (e.g., a smartphone, a smartwatch, a tablet, a notebook, or the like) of the user 2, and forming a communication connection with an external computer network 94 (including a local area network (LAN), a wide area network (WAN), and the Internet). The control unit 80 can transmit data or instructions to and from the portable device 92 of the user 2, download data from a local or remote database 96, and upload data to the database 96 via the communication device 50. In addition, the local exercise guidance device 1 can form a communication connection with another remote exercise guidance device via the Internet.

[0040] Through the above communication function, the user 2 can use the portable device 92 to issue various instructions to the exercise guidance device 1. For example, to select an exercise course, the control unit 80 can transmit menu data to the portable device 92 of the user 2 via the communication device 50, or the portable device 92 can download synchronized menu data from the database 96 via the computer network 94, so that the user 2 can select an exercise course in a specific application program of the portable device 92, and the corresponding instructions are transmitted to the control unit 80 via the communication device 50. The communication device 50 forms an instruction receiving interface of the exercise guidance device 1, which can receive instructions from the user 2 and process them by the control unit 80. In other embodiments (not shown), the exercise guidance device 1 can have a control panel, a touch screen, a voice recognition system, or a gesture recognition system as an instruction receiving interface, so that the user can issue instructions by pressing keys, touching, voice control, or gesture control.

[0041] It must be stated that the specific techniques of control and communication between the control unit 80 and other devices do not belong to the scope of the invention, and the relevant parts can be directly applied to suitable existing technologies. Figure 1 The arrows between the blocks in the figure only simply indicate the direction of data or signal transmission, and do not represent the physical or logical data bus connection method or network topology. In fact, other intermediate devices can be required.

[0042] In the preferred embodiment, the communication device 50 and / or the storage device 40 form a guide data obtaining device of the exercise guiding apparatus 1, which can obtain a guide data for guiding a user to perform an exercise, the guide data including a guide person image showing how to perform the exercise, and usually also including a guide voice accompanying the guide person image. The control unit 80 can receive the guide data obtained by the guide data obtaining device, including the corresponding data of the guide person image and the guide voice. For example, the control unit 80 can receive the guide data obtained by the communication device 50 from an external source (e.g. the database 96 or the portable device 92 of the user 2), and / or the aforementioned guide data taken out from the recording medium of the storage device 40, under the control of the control unit 80.

[0043] The photographing device 60 (at least its lens) is installed at the top center of the movable frame 12, and under the control of the control unit 80, can continuously take a high-quality and high-frame-rate live image in front of the exercise guiding apparatus 1 (i.e. in the direction of the user being guided to perform the exercise), for example, the image resolution can reach 1080p or even 4K, and the frame rate per second can reach 60fps or higher. Based on the appropriate setting of the shooting angle and focal length, the user standing in front of the display surface 21 at a predetermined distance (e.g. 2 to 3 meters) will become the central subject of the live image. Preferably, the lens pitch angle of the photographing device 60 can be adjusted so that the user can be properly aimed in various conditions (e.g. different angles of the movable frame 12, different distances of the user, different body positions of the user, etc.). As mentioned earlier, the present application can also use the method of projecting the image onto the wall surface (as the display surface), in which case the photographing device is also configured to shoot the user from the direction of the display surface to the direction of the user, that is, to shoot the user in the direction generally opposite to the direction in which the user watches the image. The control unit 80 can receive the corresponding data of the aforementioned live image taken by the photographing device 60 in real time. In addition to using the aforementioned live image as part of the display content of the image, the control unit 80 can also use specific image recognition technology to recognize the position, posture, action and specific gestures (for issuing instructions) of the user from the live image.

[0044] The ambient light sensing device 70 is installed at the top of the movable frame 12, and can sense the light illuminance of the location, that is, the intensity of the light shining on the front of the movable frame 12. The control unit 80 can receive the corresponding signal of the light illuminance sensed by the ambient light sensing device 70, and can determine the brightness of the environment where the exercise guiding apparatus 1 is located according to the aforementioned light illuminance.

[0045] The above is the basic structure of the exercise guidance device 1 of the preferred embodiment, and the operation mode thereof in use will be described as follows. Depending on the use state and use process of the exercise guidance device 1, the image frame 22 displayed by the display device 20 can have completely different content structures, such as a start-up frame, a standby frame, a frame for allowing the user to select an exercise course, a frame for guiding the user to perform a fitness exercise, a frame for presenting the exercise result of the user, and the like. Figure 3 A front view of the exercise guidance device 1 is shown when guiding the user to perform a fitness exercise, and the content of the image frame 22 shown therein is an illustrative frame simplified and abstractly represented. Figure 4 The layer structure of the image frame 22 is presented. As shown in Figure 3 and Figure 4 When guiding the user to perform a fitness exercise, the control unit 80 can be controlled to cause the first image 23 and the second image 25 to be simultaneously displayed in the image frame 22, the first image 23 is superimposed on the second image 25, and the superimposed part simultaneously displays the first image 23 and the second image 25 in a semi-transparent manner. Regarding the semi-transparent superimposition of images, a simple example is given by using the color principle of "subtractive color mixing": assuming that the first image 23 is yellow and the second image 25 is cyan, the superimposed part will basically present green, and when the transparency of the yellow first image 23 with respect to the cyan second image 25 is higher than 50% (or the opacity is lower than 50%), the superimposed part will present green with a cyan bias, i.e., the color of the second image, and vice versa. In the prior art, in addition to "alpha compositing", there are "screen-door transparency", fast alternating display, and the like. Here, "semi-transparent" does not mean that the transparency or opacity of the image is exactly 50% (Note: in the field of digital image processing, the value of the transparency or opacity of the image is 0 to 1), in fact, the state between complete opacity and complete transparency (invisible) can also be called "semi-transparent".

[0046] The first image 23 includes a guide image 24 from the aforementioned guide data, which demonstrates the aforementioned exercise movements in a dynamic manner for the user to imitate, possibly a real person (trainer) image in a pre-recorded video or live video, or a computer animation of a human character made in advance or calculated in real time using computer-generated imagery technology. The corresponding data of the guide image 24 can be completely stored in the storage device 40 inside the device, or can be from outside the device, such as a local or remote database 96, fed to the exercise guide device 1 in a streaming manner via the computer network 94. The control unit 80 sequentially obtains image data and performs real-time image processing to make the guide image 24 appear in the image screen 22 and play smoothly, so that the user basically feels no image delay. The first image 23 can also include a first background image (not shown in Figure 3 and Figure 4 ) as the background of the guide image 24, such as the real background of the aforementioned trainer demonstrating the exercise movements, or an image-processed virtual background, which is usually black or a single color to highlight the guide image 24 and forms a rectangular range overlapping the second image 25. If the guide image 24 appearing in the image screen 22 is processed by “image matting”, i.e. the first image 23 does not have the aforementioned first background image, the guide image 24 is directly overlapped on the second image 25 in its human form. The first image 23 can also include images in symbolic form (Note: refer to the applicant's Chinese Patent Application No. 202010836985.7 / US Patent Application No. 17 / 394,408) for movement prompting tracks and movement evaluation, etc. for guiding the user to perform the correct movements, Figure 3 and Figure 4 (not shown in

[0047] While the control unit 80 controls the display device 20 to display the guide image 24, it will also control the speaker device 30 to play the aforementioned guide voice matched with the guide image 24, such as the explanation of the movement, timely reminders of the places to pay attention to, the count of repeated movements, words of encouragement for the user, etc. Generally, if the guide image 24 comes from a real person (trainer) image in a pre-recorded video or live video, the control unit 80 will control the speaker device 30 to synchronously play the voice content of the trainer leading the exercise movements, i.e. the live voice recorded on the spot. The aforementioned guide voice can also be post-dubbed or artificial voice.

[0048] On the other hand, the second image 25 includes a user image 26 from the aforementioned live image and presented in a mirror image manner for the user to view his / her current action posture. For example, when the user faces the display surface 21 of the display device 20 and raises his / her right hand, because the camera 60 continuously takes the live image from the direction of the display surface 21 to the direction of the user, a front image of the user raising the right hand is taken, and the control unit 80 immediately performs a mirror image processing of left-right inversion on the received live image and causes the display device 20 to display the user image 26 (in this case, a front image of the user raising the left hand) generated through the aforementioned mirror image processing in the image frame 22. Thus, from the user's point of view, the user image 26 in the image frame 22 in front of the eyes is as if facing the user face to face and reflecting the user's current posture. Preferably, the control unit 80 can appropriately control the position and size of the user image 26 in the image frame 22 so that the user facing the display surface 21 to view the user image 26 is similar to viewing his / her mirror image through a mirror. Based on different optical imaging manners, the live image raw data (e.g., data on an imaging device such as a CCD or CMOS that can constitute an image) taken by the camera 60 can originally be a mirror image opposite to the actual scene in terms of left and right, that is, the control unit 80 does not need to perform the aforementioned mirror image processing to obtain the required user image 26. In fact, the user image 26 can not be a full-body image of the user, for example, corresponding to a standing user, the user image 26 only shows the part above the user's calves. The above phenomenon can be the result of implementation selection (e.g., using a smaller display device 20), but can also be a problem of the relative position of the user. Preferably, the control unit 80 can determine the position of the user relative to the camera 60 from the aforementioned live image by using specific image recognition technology, and if necessary, require the user to move forward, backward, left or right with visual and / or audio messages to obtain a better user image 26.

[0049] Considering the user's intuition of imitating the guide image 24 to perform the fitness exercise, the guide image 24 displayed in the image frame 22 usually presents a full-body front posture, that is, as if facing the user facing the image frame 22 face to face, so that when the guide image 24 raises the left hand, the user is induced to raise the right hand, and the user image 26 of the user raising the right hand seen in the image frame 22 will be similar to the guide image 24, including facing the same and having similar postures, facilitating the user to compare the differences and correct himself / herself. Of course, the guide image 24 demonstrates the fitness exercise for the user to imitate, and depending on the movement action and the demonstration part, it is not necessarily always necessary to present a full-body front posture.

[0050] The second image 25 can further include a second background image 27 ( Figure 3 andFigure 4 not shown; see Figure 9a ), which is usually the real background of the user's exercise site, i.e. the scenery behind the user when the camera 60 captures the live image in the direction of the user. If the second image 25 has the aforementioned real background as the background of the user image 26 (i.e. the second background image 27), it is naturally that the second background image 27 is also presented in a mirror image, which means that the control unit 80 presents the second image 25 in the image frame 22, which contains the user image 26 reflecting the live user and the second background image 27 reflecting the live environment, by using the live image (if necessary, a rectangular range is cropped and mirror processing is performed) captured by the camera 60, and the control unit 80 can appropriately control the position and size of the second image 25 in the image frame 22, so that the user looks at the second image 25 facing the display surface 21, which is similar to looking at oneself and the surroundings through a mirror. The control unit 80 can perform image processing such as softening, fading or blurring on the second background image 27 in the second image 25 to highlight the user image 26 in between. If the user image 26 presented in the image frame 22 is processed by "de-back", i.e. the second image 25 does not have the second background image 27, the user image 26 is directly presented on the background color (which can be black or colorless) of the image frame 22 in the shape of the user.

[0051] Preferably, the position and size of the first image 23 and the second image 25 in the image frame 22 can be selected or adjusted by the user according to personal preferences. In practice, the user can send the corresponding signal of the relevant instruction to the communication device 50 (as an instruction receiving interface) by the portable device 92, or issue the relevant instruction by means of keys, touch, voice control or gesture control, and the control unit 80 will respond to specific instructions to switch or adjust the position or size of at least one of the first image 23 and the second image 25. For example, the user can select the layout of the image frame 22 as shown in Figure 3 , i.e. the guide image 24 (representing the first image 23) and the user image 26 (representing the second image 25) roughly occupy most of the area of the image frame 22, wherein the size of the user image 26 is controlled to be similar to the mirror image in the real mirror, and the size of the guide image 24 is slightly smaller than or overlaps the user image 26 semi-transparently; or the user can select the layout of the image frame 22 as shown in Figure 8aThe layout of the image frame 22 is shown such that the selected one of the instructor image 24 (representing the first image 23) and the user image 26 (representing the second image 25) occupies most of the area of the image frame 22 roughly in the center, and the other is shown in a significantly smaller size in a specific or selected corner. The two images 24, 26 have a small overlapping area and are staggered from each other for easy viewing, especially for the larger image in the middle.

[0052] When the user is guided to perform the fitness exercise, in addition to the first image 23 and the second image 25, some auxiliary information about the progress of the exercise course is also shown in the image frame 22, such as the current exercise section name 28, the remaining time of the current exercise section 29, and the like. The auxiliary information can be displayed separately from the first image 23 and the second image 25, or can be overlaid on them in a semi-transparent or opaque manner, such as being overlaid on the second background image 27 that fills the entire image frame 22. Depending on the implementation choice, the auxiliary information can belong to the first image 23, or in other words, all the display contents in the image frame 22 except the second image 25, including those overlaid or not overlaid with the second image 25, belong to the first image 23.

[0053] For example, Figures 5a to 5e For example, the transparency of the first image (represented by the instructor image 24 in the figure) and the second image (represented by the user image 26 in the figure) in the aforementioned image frame can be adjusted by the user according to personal needs, so that one is relatively obvious and the other is relatively not obvious or even invisible. A typical or standard use condition is as follows: Figure 5c For example, the transparency of the instructor image 24 and the user image 26 is 50% (note: here it is assumed that the user image 26 is displayed on the background color of the image frame with a transparency of 50%, and the instructor image 24 is overlaid on the user image 26 with a transparency of 50%). Generally, the user can simultaneously watch the instructor image 24 and the user image 26 well. If the user wants to focus more on watching the instructor image 24 demonstrating the fitness exercise, and relatively less on watching the user image 26 reflecting the live situation of the user, the transparency of the instructor image 24 can be adjusted to a lower level, for example, from the standard 50% to 25%, and at the same time, the transparency of the user image 26 is adjusted to a higher level, for example, from 50% to 75%, so that the visibility of the instructor image 24 is relatively increased and the visibility of the user image 26 is relatively decreased, as follows: Figure 5dillustrated. Conversely, if the user wants to focus more on the user image 26 and less on the guide image 24, the transparency of the user image 26 can be adjusted moderately lower, for example, from the standard 50% to 25%, while the transparency of the guide image 24 is adjusted correspondingly higher, for example, from 50% to 75%, so that the visibility of the user image 26 is relatively increased and the visibility of the guide image 24 is relatively decreased, as shown in Fig. 2B. Figure 5b illustrated. Further, the user can also adjust the transparency of the user image 26 to the highest 100%, i.e. fully transparent (invisible), while the transparency of the guide image 24 is adjusted correspondingly to the lowest 0%, i.e. fully opaque, so that the guide image 24 can be viewed alone, as shown in Fig. 2D. Figure 5e illustrated. Further, the user can also adjust the transparency of the user image 26 to the highest 100%, i.e. fully transparent (invisible), while the transparency of the guide image 24 is adjusted correspondingly to the lowest 0%, i.e. fully opaque, so that the guide image 24 can be viewed alone, as shown in Fig. 2D. Figure 5a illustrated. Because the loudspeaker 30 continues to play the aforementioned guiding voice, even when the guide image 24 in the image frame 22 is less apparent or even invisible, the user can still follow the guiding voice to perform the fitness exercise, i.e. so-called "audio coaching", similar to the way of performing a radio exercise.

[0054] Figures 5a to 5e The transparencies of the guide image 24 and the user image 26 can be adjusted in five stages between fully opaque and fully transparent, i.e. the respective transparencies can be 0%, 25%, 50%, 75% or 100%, with an adjustment step of 25%. Of course, depending on the implementation choice, the aforementioned transparencies can be adjusted more finely, for example, by only 10%, 5% or 1% per stage.

[0055] In the above adjustment manner, the transparencies of the guide image 24 (representing the first image 23) and the user image 26 (representing the second image 25) are adjusted in a complementary manner, i.e. the transparency of one is reduced while the transparency of the other is increased, for example, when the guide image 24 becomes less transparent, the user image 26 becomes more transparent, and vice versa. In practice, the user only needs to issue an instruction to adjust the transparency of one of the first image 23 and the second image 25 higher or lower, and the control unit 80 will increase or decrease the transparency of the specified one while reducing or increasing the transparency of the other in response to the aforementioned instruction.

[0056] As Figures 6a to 6cFor example, the transparency of the guide image 24 in Figure 6a , Figure 6b and Figure 6c is 75%, 50% and 25% respectively, while the transparency of the user image 26 remains 50%.

[0057] Similarly, as shown in Figures 7a to 7c , the motion guidance device 1 of the preferred embodiment can also provide an adjustment mode that allows the user to adjust the transparency of the second image (represented by the user image 26 in the figure) alone without changing the transparency of the first image (represented by the guide image 24 in the figure), for example, the transparency of the user image 26 in Figure 7a , Figure 7b and Figure 7c is 25%, 50% and 75% respectively, while the transparency of the guide image 24 remains 50%.

[0058] Referring to Figures 8a to 8c , under this image screen layout, a typical or standard use condition can be as shown in Figure 8b , where the transparency of the larger user image 26 (or guide image 24, omitted hereafter) in the middle and the smaller guide image 24 (or user image 26, omitted hereafter) in the corner is about 30% and 60% respectively (Note: here it is assumed that the larger user image 26 in the middle is displayed on the background color of the image screen with a transparency of about 30%, and the smaller guide image 24 in the corner is overlaid on the user image 26 with a transparency of about 60%). As shown in Figure 8a , when the transparency of the larger user image 26 in the middle is adjusted to the lowest 0%, i.e. completely opaque relative to the aforementioned background color, the smaller guide image 24 in the corner still has a certain visibility, for example, a transparency of about 80%. As shown in Figure 8c , when the transparency of the smaller guide image 24 in the corner is adjusted to a preset lower limit, for example, about 20%, the larger user image 26 in the middle still has considerable visibility, for example, a transparency of about 45%. It can be found that although the transparency of the guide image 24 (representing the first image 23) and the user image 26 (representing the second image 25) is adjusted in a way of this increases and that decreases, the increase and decrease of the transparency of each other is not a linear relationship.

[0059] In fact, when the environment where the motion guiding device 1 is located is brighter, the user image 26 (and the second background image 27) from the live image in the image frame 22 can be brighter due to the brighter environment, and vice versa, when the environment where the motion guiding device 1 is located is darker, the user image 26 (and the second background image 27) can be dimmer due to the darker environment. The user can adjust the transparency of at least one of the first image 23 and the second image 25 according to the brightness of the environment to present the contrast relationship of the visibility of the first image 23 and the second image 25 in a state of personal preference. For example, assuming that the user feels that the transparency of the first image 23 and the second image 25 is 50% each under a reference brightness of the environment, and the contrast relationship is the best, when the environment becomes brighter, the user can slightly lower the transparency of the first image 23 to, for example, 45% or 40%, and / or slightly increase the transparency of the second image 25 to, for example, 55% or 60%, that is, make the first image 23 more obvious and the second image 25 less obvious, to correct the contrast imbalance of the second image 25 corresponding to the brighter environment when the environment becomes brighter. Of course, the difference before and after the foregoing correction is purely subjective.

[0060] The motion guiding device 1 of the preferred embodiment can also be set in an automatic adjustment mode. When the control unit 80 determines that the brightness of the environment where the motion guiding device 1 is located becomes brighter, it automatically reduces the transparency of the first image 23 and increases the transparency of the second image 25, that is, relatively increases the visibility of the first image 23 and relatively reduces the visibility of the second image 25 (corresponding to the brighter environment when the environment becomes brighter). Conversely, when the control unit 80 determines that the brightness of the environment where the motion guiding device 1 is located becomes darker, it automatically increases the transparency of the first image 23 and reduces the transparency of the second image 25, that is, relatively reduces the visibility of the first image 23 and relatively increases the visibility of the second image 25 (corresponding to the darker environment when the environment becomes darker). The control unit 80 determines the brightness of the environment where the motion guiding device 1 is located according to the light intensity sensed by the ambient light sensing device 70. In other embodiments, the control unit 80 determines the brightness of the environment where the motion guiding device 1 is located according to the brightness of the live image taken by the camera 60, and can also make a comprehensive determination according to the light intensity and the brightness of the live image.

[0061] In addition to adjusting the transparency of the first image 23 and the second image 25 to change the contrast relationship of the visibility of the two images, the visibility of one of the images can also be relatively increased or reduced by adjusting the image parameters such as brightness, contrast, sharpness, hue, lightness, chroma, gain value, gamma value, color temperature, and color balance. The relative increase in visibility means that one of the first image 23 and the second image 25 in the image frame 22 is more obvious and noticeable than the other, for example, the image is more intense, brighter, and clearer. Figures 6a to 6cthe brightness, contrast, sharpness, lightness and / or chroma of the guide image 24 alone (imagine the guide image 24 is represented by a white circle in the image 22, and the user image 26 is represented by a black circle in the image 22) can make the guide image 24 more apparent relative to the user image 26, and vice versa, lowering the above-mentioned image parameters can make the guide image 24 less apparent. Figure 6a When the ambient brightness is higher than the reference ambient brightness, the brightness of the image 22 can be increased, and vice versa. Figure 6c When the ambient brightness is higher than the reference ambient brightness, the brightness of the image 22 can be increased, and vice versa.

[0062] The above-mentioned adjustment of the image parameters to change the visibility of the image can be performed by the user according to his / her preference and the ambient brightness, and the control unit 80 can respond to the user's instruction to perform the corresponding image processing on the content of the image 22. Alternatively, the control unit 80 can automatically perform the appropriate image processing according to the ambient brightness, so that the visibility of the first image 23 and the second image 25 in the image 22 can remain in a predetermined contrast relationship, or at least not change significantly due to the change of the ambient brightness. For example, when the ambient brightness is higher or becomes higher, the contrast relationship between the first image 23 and the second image 25 changes because the visibility of the second image 25 is increased accordingly, so the control unit 80 can adjust at least one image parameter of at least one of the first image 23 and the second image 25 to relatively increase the visibility of the first image 23 and relatively decrease the visibility of the second image 25. Conversely, when the ambient brightness is lower or becomes lower, the contrast relationship between the first image 23 and the second image 25 changes because the visibility of the second image 25 is decreased accordingly, so the control unit 80 can adjust at least one image parameter of at least one of the first image 23 and the second image 25 to relatively decrease the visibility of the first image 23 and relatively increase the visibility of the second image 25. When the control unit 80 performs the image processing, all adjustments made to the first image 23 and all adjustments made to the second image 25 are not consistent to cause the visibility of the first image 23 and the second image 25 to change relatively.

[0063] Figures 9a to 9c The brightness of the image 22 under different ambient brightness is shown. Under a reference ambient brightness, such as the ambient brightness of a room with a light source, the brightness of the image 22 can be a preset value or a value after automatic adjustment by the system, or a value after manual adjustment by the user. Figure 9b As shown, the overall brightness of the image 22 is suitable for viewing, and the brightness of the first image (represented by the guide image 24 in the figure) and the second image (i.e. the user image 26 and the second background image 27) can be a preset value or a value after automatic adjustment by the system, or a value after manual adjustment by the user, so that the contrast relationship between the visibility of the two images can be in a state preferred by the user. When the ambient brightness is higher (extreme conditions such as direct sunlight in a room), such as Figure 9aFor illustration, the brightness of both the first image and the second image (and possibly other parts not belonging to the first and second images, omitted hereafter) in the image frame is moderately increased to enhance the visibility of the image frame. When the ambient brightness is low (extreme conditions such as dim or dark room), the brightness of the image frame is increased to a level that is still comfortable to the eyes of the user. For example, the brightness of the image frame is increased to a level that is 50% higher than the ambient brightness. Figure 9c For illustration, the brightness of both the first image and the second image in the image frame is moderately decreased to reduce eye strain while maintaining the visibility of the image frame.

[0064] Figures 10a to 10c For illustration, the brightness of the image frame is changed under different ambient brightness, but the image frame has a different layout, in which the first image (represented by the guide image 24 in the figure) is located on the right half of the frame, and the second image (i.e. the user image 26 and the second background image 27) is located on the left half of the frame, and the two images do not overlap.

[0065] In the above-mentioned embodiments, the control unit 80 adjusts the brightness of the first image and the second image according to the ambient brightness (including automatic adjustment according to the ambient brightness, and corresponding adjustment according to the ambient brightness in response to the user's instruction to increase or decrease the brightness of the frame), and does not simultaneously increase or decrease the brightness of the first image and the second image by the same magnitude, but respectively adjusts the brightness of the first image and the second image to maintain the contrast relationship between the visibility of the first image and the second image, i.e. the change in ambient brightness only makes the image frame appear brighter or darker as a whole, and there is no feeling that one of the first image and the second image becomes relatively brighter or darker. Figures 9a to 9c Figures 10a to 10c For illustration, the brightness of the image frame is changed under different ambient brightness, but the image frame has a different layout, in which the first image (represented by the guide image 24 in the figure) is located on the right half of the frame, and the second image (i.e. the user image 26 and the second background image 27) is located on the left half of the frame, and the two images do not overlap.

[0066] Figure 11 For illustration, the brightness of the image frame is changed under different ambient brightness, but the image frame has a different layout, in which the first image (represented by the guide image 24 in the figure) is located on the right half of the frame, and the second image (i.e. the user image 26 and the second background image 27) is located on the left half of the frame, and the two images do not overlap.

[0067] For illustration, the brightness of the image frame is changed under different ambient brightness, but the image frame has a different layout, in which the first image (represented by the guide image 24 in the figure) is located on the right half of the frame, and the second image (i.e. the user image 26 and the second background image 27) is located on the left half of the frame, and the two images do not overlap. Figure 11 ​The top column illustrates that, assuming the control unit 80 does not perform corresponding image processing on the content of the image screen 22 based on the brightness of the environment in which the motion guidance device 1 is located, the brightness contrast between the guide image 24 (representing the first image 23) and the user image 26 (representing the second image 25) in the image screen 22 will differ under different ambient brightness levels. This is because the user image 26 comes from live footage captured by the camera device 60 at the usage location. The brighter the environment, the brighter the unprocessed user image 26 will be; conversely, the darker the environment, the darker the unprocessed user image 26 will be. However, the guide image 24 comes from pre-prepared image data or real-time footage from a remote location, and its brightness is not affected by the brightness of the user's environment. Therefore, assuming the motion guidance device 1 is at a reference ambient brightness level (e.g., ...), the brightness contrast will be different. Figure 11 (At the center of the horizontal axis), the brightness contrast between the user image 26 and the guide image 24 in image screen 22 is a brightness balance state preferred by the user (Note: For ease of explanation, the brightness contrast is temporarily represented as 100:100. The higher the value of each, the brighter the image, and the lower the value, the darker the image. Here, it is only to express that the brightness of the user image 26 and the guide image 24 are at a certain level, and the measurement standard and unit are not the focus); when the environment becomes brighter (such as... Figure 11 (At the left end of the horizontal axis), the user image 26 should brighten accordingly, while the brightness of the guide image 24 should remain unchanged. The brightness contrast between the two deviates from the aforementioned brightness balance state (Note: For example, from 100:100 to 200:100, the former becomes relatively brighter and the latter relatively darker); similarly, when the environment darkens (such as... Figure 11 (On the right end of the horizontal axis), the user image 26 should be darkened accordingly, while the brightness of the guide image 24 remains unchanged. The brightness contrast between the two deviates from the aforementioned brightness balance state (Note: For example, from 100:100 to 50:100, the former becomes relatively darker and the latter relatively brighter). Of course, there is another basic problem with the image brightness not being adjusted according to the ambient brightness: the image brightness that is suitable for viewing under the reference ambient brightness (for example, the guide image whose brightness is always maintained at 100) may appear insufficient in brighter environments and excessively bright in darker environments.

[0068] like Figure 11The middle column shows that if the screen brightness automatic adjustment method commonly used in general smartphones or tablets is directly used, when the environment becomes brighter or darker, the control unit 80 automatically adjusts the brightness of the image 22 as a whole (for example, adjusts the luminance of the light source of the backlight module of the display device 20) according to the preset function relationship. Although this can improve the overall visibility of the image 22 in a brighter environment and reduce eye fatigue in a darker environment, the brightness contrast between the guide image 24 (representing the first image 23) and the user image 26 (representing the second image 25) in the image 22 will be different in different ambient brightness. Taking the same ambient brightness change as an example, assuming that when the motion guide device 1 is in a reference ambient brightness, the brightness contrast between the user image 26 and the guide image 24 in the image 22 (for example, 100:100) is the preferred brightness balance state of the user; when the environment becomes brighter, because the brightness contrast between the user image 26 and the guide image 24 (for example, 200:100, the former has become brighter corresponding to the brighter environment) has deviated from the aforementioned brightness balance state before the control unit 80 adjusts the brightness of the image 22 according to the ambient brightness, after the brightness of the image 22 is adjusted as a whole (i.e., the user image 26 and the guide image 24 are simultaneously adjusted to the same brightness), the brightness contrast between the user image 26 and the guide image 24 (for example, the brightness is adjusted to 400:200) is still the same unbalanced state, the former is relatively brighter, and the latter is relatively dimmer. Similarly, when the environment becomes darker, because the brightness contrast between the user image 26 and the guide image 24 (for example, 50:100, the former has become dimmer corresponding to the dimmer environment) has deviated from the aforementioned brightness balance state before the control unit 80 adjusts the brightness of the image 22 according to the ambient brightness, after the brightness of the image 22 is adjusted as a whole (i.e., the user image 26 and the guide image 24 are simultaneously adjusted to the same brightness), the brightness contrast between the user image 26 and the guide image 24 (for example, the brightness is adjusted to 25:50) is still the same unbalanced state, the former is relatively dimmer, and the latter is relatively brighter.

[0069] As Figure 11The bottom row of the table illustrates that, in a specific operation mode of the motion guiding device 1 of the preferred embodiment, the control unit 80 adjusts the brightness of the first image 23 and the second image 25 in the image screen 22 according to the ambient brightness, so that the brightness contrast between the guide image 24 (representing the first image 23) and the user image 26 (representing the second image 25) remains the same or substantially unchanged under different ambient brightness. Taking the same ambient brightness variation as an example, assume that when the motion guiding device 1 is under a reference ambient brightness, the brightness contrast between the user image 26 and the guide image 24 in the image screen 22 (e.g. 100:100) is the brightness balance state preferred by the user; when the ambient brightness increases, the control unit 80 respectively increases the brightness of the user image 26 and the guide image 24 to a corresponding level according to a preset function relationship, wherein the brightness increase amplitude of the guide image 24 (e.g. from 100 to 220 before adjustment) is greater than the brightness increase amplitude of the user image 26 (e.g. from 200 to 220 before adjustment), so that the brightness contrast between the user image 26 and the guide image 24 after adjustment (e.g. 220:220) remains the original brightness balance state; similarly, when the ambient brightness decreases, the control unit 80 respectively decreases the brightness of the user image 26 and the guide image 24 to a corresponding level according to a preset function relationship, wherein the brightness decrease amplitude of the guide image 24 (e.g. from 100 to 45 before adjustment) is greater than the brightness decrease amplitude of the user image 26 (e.g. from 50 to 45 before adjustment), so that the brightness contrast between the user image 26 and the guide image 24 after adjustment (e.g. 45:45) remains the original brightness balance state. Thus, when the ambient brightness increases, the brightness of the first image 23 and the second image 25 in the image screen 22 is respectively brighter than that under the reference ambient brightness, so as to maintain the visibility of the images; when the ambient brightness decreases, the brightness of the first image 23 and the second image 25 is respectively dimmer than that under the reference ambient brightness, so as to make the viewing more comfortable, and under various ambient brightness, the brightness contrast between the first image 23 and the second image 25 can maintain the brightness balance state preferred by the user, so that the user will not feel that one of the images is relatively brighter or dimmer than the other.

[0070] Another adjustment mode is that when the environment becomes brighter, the control unit 80 does not adjust the brightness of the second image 25 / user image 26 (e.g. maintains 200, which has been correspondingly brightened due to the environment becoming brighter), but only moderately increases the brightness of the first image 23 / guide image 24 (e.g. from 100 before adjustment to 200), so that the brightness of the first image 23 and the second image 25 after adjustment is equal, maintaining the brightness balance state; similarly, when the environment becomes darker, the control unit 80 does not adjust the brightness of the second image 25 / user image 26 (e.g. maintains 50, which has been correspondingly darkened due to the environment becoming darker), but only moderately decreases the brightness of the first image 23 / guide image 24 (e.g. from 100 before adjustment to 50), so that the brightness of the first image 23 and the second image 25 after adjustment is equal, maintaining the brightness balance state.

[0071] It must be noted that, Figure 11 In the above, the gray scale and brightness values of all the tiles represent the brightness levels of the images displayed by the display device 20, not the brightness levels perceived by the user's eyes, that is, in reality, the user should feel that the image with a brightness of 100 viewed in a darker environment is brighter than the same image with a brightness of 100 viewed in a brighter environment, but Figure 11 In the above, the presentation and notation of image brightness do not take into account the above-mentioned visual factors; regardless of whether the user views images with the same brightness of 100 in a brighter environment and in a darker environment, the difference in brightness perception, we can determine that the user will feel that the brightness levels of the user image 26 and the guide image 24 are the same, i.e. in a brightness balance state, when viewing them simultaneously at any environmental brightness with the same brightness of 100 (or the same brightness of 220, the same brightness of 45, etc.), and the user will feel that the brightness levels of the user image 26 and the guide image 24 are different, i.e. deviating from the brightness balance state, when viewing them simultaneously at any environmental brightness with different brightness of 200 and 100 (or 50 and 100, 400 and 200, etc.).

[0072] In the above, Figure 11 In the above, the user image (left half of the tile) and the guide image (right half of the tile) in each tile are presented side by side, but such presentation is only for the convenience of presenting the brightness contrast between the two, in fact, the above-mentioned brightness contrast change phenomenon can occur when the first image and the second image are presented side by side as shown in Figures 10a to 10c , or can occur when the first image and the second image are semi-transparently overlaid as shown in Figures 9a to 9c .

[0073] The "real-time" concept mentioned in the preferred embodiments is basically "soft real time" with relatively loose time constraints. For example, in the case of the taking, processing, and displaying of the user image 26, as long as the user does not substantially perceive a significant delay between the user image 26 in the image frame 22 and the actual situation in terms of results, and even if a single frame of the image frame 22 occasionally exceeds the rated time (e.g., 1 / 60 second) in image processing and display, only a momentary delay in the content of the image frame 22 is caused, which is still within an acceptable range.

Claims

1. A motion guidance device capable of guiding a user to perform a fitness exercise; the motion guidance device comprising: A guidance data acquisition device is capable of acquiring an image of a guide demonstrating the fitness exercise; A display device that can display an image on a display surface; A control unit is electrically connected to the guidance data acquisition device and the display device, and is capable of receiving corresponding data of the guide image acquired by the guidance data acquisition device, and controlling the content of the image screen displayed by the display device; When guiding the user to perform the fitness exercise, the control unit can control the display of the guide's image on the screen so that the user in front of the display can watch and imitate the fitness exercise. Its features are: The motion guidance device also includes a camera device that can continuously capture a live image from the direction of the display surface toward the direction of the user; the control unit is electrically connected to the camera device and can receive corresponding data of the live image captured by the camera device. When guiding the user to perform the fitness exercise, the control unit can control the simultaneous display of a first image and a second image on the image screen. The first image includes the image of the guide, and the second image includes a user image from the real-time live video and presented in a mirrored manner. The control unit can perform corresponding image processing on the content of the image screen according to the brightness of the environment where the motion guidance device is located. The image processing includes adjusting at least one image parameter of at least one of the first image and the second image. Moreover, all adjustments made to the first image are inconsistent with all adjustments made to the second image. The image parameters include, but are not limited to, the image's brightness, transparency, contrast, sharpness, hue, lightness, chroma, gain value, gamma value, color temperature, and color balance.

2. The motion guiding device as described in claim 1, characterized in that: The control unit can appropriately control the position and size of the user image in the image screen, so that the user views the user image as if viewing their own reflection through a mirror.

3. The motion guiding device as described in claim 1, characterized in that: The motion guidance device also includes an instruction receiving interface that can receive instructions from the user; the control unit is electrically connected to the instruction receiving interface and can respond to specific instructions by adjusting the image parameters, position, or size of at least one of the first image and the second image respectively.

4. The motion guiding device as described in claim 1, characterized in that: The first image and the second image overlap at least partially, and the overlapping portion is displayed simultaneously in a semi-transparent manner.

5. The motion guiding device as described in claim 4, characterized in that: The motion guidance device also includes an instruction receiving interface that can receive instructions from the user; the control unit is electrically connected to the instruction receiving interface and can adjust the transparency of at least one of the first image and the second image in response to a specific instruction.

6. The motion guiding device as described in claim 5, characterized in that: The transparency of the first image and the second image can be adjusted in at least five stages between completely opaque and completely transparent. Moreover, a decrease in the transparency of one of the first image and the second image occurs in conjunction with an increase in the transparency of the other. When one of the first image and the second image is completely opaque, the other is completely transparent. The motion guidance device also includes a speaker, and the control unit can control the sound content emitted by the speaker, including guiding voice accompanying the guide image.

7. The motion guiding device as described in claim 4, characterized in that: When the control unit determines that the brightness of the environment in which the motion guidance device is located has increased and performs the image processing, the image processing includes reducing the transparency of the first image and increasing the transparency of the second image; when the control unit determines that the brightness of the environment in which the motion guidance device is located has decreased and performs the image processing, the image processing includes increasing the transparency of the first image and decreasing the transparency of the second image.

8. The motion guiding device as described in claim 1 or 4, characterized in that: When the control unit determines that the brightness of the environment in which the motion guidance device is located has increased and performs the image processing, the image processing includes increasing the brightness of at least the first image and the second image, and the increase in brightness of the first image is greater than the increase in brightness of the second image; when the control unit determines that the brightness of the environment in which the motion guidance device is located has decreased and performs the image processing, the image processing includes decreasing the brightness of at least the first image and the second image, and the decrease in brightness of the first image is greater than the decrease in brightness of the second image.

9. The motion guiding device as described in claim 1, characterized in that: The motion guidance device also includes an ambient light sensor, which can sense the illuminance of the location; the control unit is electrically connected to the ambient light sensor, can receive the corresponding signal of the illuminance sensed by the ambient light sensor, and can determine the brightness of the environment in which the motion guidance device is located based on the illuminance.

10. The motion guiding device as described in claim 1 or 9, characterized in that: The control unit can determine the brightness of the environment in which the motion guidance device is located based on the brightness of the live video.

Citation Information

Patent Citations

  • Fitness equipment

    CN114078190B

  • Motion guiding device

    CN215691547U

  • Reflective video display apparatus for interactive training and demonstration and methods of using same

    US10828551B2

  • Image processing method, image processing device and electronic device

    CN104333698A

  • Photosensitive display system and operation method of photosensitive display system

    CN105609059A