Motion effect information detection method, head-mounted display device and readable storage medium

Abstract

The present invention discloses a method for detecting exercise effect information, a head-mounted display device, and a readable storage medium. The method comprises: obtaining ambient temperature, ambient humidity, and the target user's forehead temperature and forehead humidity; determining a corresponding exercise intensity compensation value set based on the ambient temperature and ambient humidity; and determining the target user's exercise effect information based on the forehead temperature, forehead humidity, and exercise intensity compensation value set. By applying the exercise effect information detection method of the present invention to a head-mounted display device, users can monitor their own exercise effects while using the head-mounted display device to play various sports games. The determined exercise effect information eliminates interference from different environmental factors and different user physical factors, thereby reflecting the user's actual exercise effects, such as fitness and fat loss, and helping the user improve their body shape and health.

Description

Technical Field

[0001] The present invention relates to the field of smart wearable technology, and in particular to a motion effect information detection method, a head-mounted display device, and a computer-readable storage medium. Background Art

[0002] In recent years, wearable devices including AR (Augmented Reality) glasses, VR (Virtual Reality) glasses, smart watches, smart bracelets, etc. have been sought after and chosen by more and more users.

[0003] Currently, most wearable devices on the market use various motion sensors (such as 3-axis accelerometers, gyroscopes, GPS navigation, etc.) to identify the user's motion status, thereby determining the user's exercise effect, such as the user's recent weight loss effect, the energy consumed in this exercise, etc. However, this method of determining the user's exercise effect only through motion sensors has the problem of inaccurate exercise effects, especially due to the influence of external environmental factors and the different physiques of different users. Different external environments and different user physiques will produce different exercise effects, resulting in the user being unable to accurately grasp the actual fitness, weight loss and other exercise effects produced by each exercise. Summary of the Invention

[0004] The main purpose of the present invention is to provide a motion effect information detection method, a head-mounted display device and a computer-readable storage medium, aiming to solve the problem that wearable devices only determine the user's motion effect through motion sensors, and the determined motion effect is not accurate enough.

[0005] To achieve the above object, the present invention provides a motion effect information detection method, which includes the following steps:

[0006] Obtaining ambient temperature, ambient humidity, and the target user's forehead temperature and forehead humidity;

[0007] determining a corresponding exercise intensity compensation value set according to the ambient temperature and the ambient humidity;

[0008] The exercise effect information of the target user is determined according to the forehead temperature, the forehead humidity, and the exercise intensity compensation value set.

[0009] Optionally, the exercise intensity compensation value set includes a forehead temperature change compensation value, a forehead humidity change compensation value, and an exercise duration compensation value;

[0010] The step of determining a corresponding set of exercise intensity compensation values according to the ambient temperature and the ambient humidity includes:

[0011] Determining the corresponding forehead temperature change compensation value according to the ambient temperature;

[0012] determining a corresponding forehead humidity change compensation value according to the ambient temperature and the ambient humidity;

[0013] A corresponding exercise duration compensation value is determined according to the ambient temperature and the ambient humidity.

[0014] Optionally, the step of determining the target user's exercise effect information based on the forehead temperature, the forehead humidity, and the exercise intensity compensation value set includes:

[0015] determining a forehead temperature change value according to the forehead temperature, and determining a forehead humidity change value according to the forehead humidity;

[0016] The exercise effect information of the target user is determined according to the forehead temperature, the forehead humidity, the forehead temperature change value, the forehead humidity change value and the exercise intensity compensation value set.

[0017] Optionally, the exercise effect information includes an energy consumption value; and the step of determining the target user's exercise effect information based on the forehead temperature, the forehead humidity, the forehead temperature change value, the forehead humidity change value, and the exercise intensity compensation value set includes:

[0018] determining a corrected forehead temperature change value according to the forehead temperature change value and the forehead temperature change compensation value;

[0019] determining a corrected forehead humidity change value according to the forehead humidity change value and the forehead humidity change compensation value;

[0020] determining an exercise duration of the target user according to the forehead temperature or the forehead humidity, and determining a corrected exercise duration according to the exercise duration and the exercise duration compensation value;

[0021] The energy consumption value of the target user is determined according to the corrected forehead temperature change value, the corrected forehead humidity change value, and the corrected exercise duration.

[0022] Optionally, the motion effect information detection method further includes:

[0023] Acquire current facial information and historical facial information of the target user, and compare the current facial information with the historical facial information to determine facial contour change information of the target user;

[0024] The exercise effect information of the target user is determined according to the facial contour change information.

[0025] Optionally, the motion effect information detection method further includes:

[0026] The current body fat percentage and the historical body fat percentage of the target user are obtained, and the current body fat percentage and the historical body fat percentage are compared to determine the exercise effect information of the target user.

[0027] Optionally, the exercise effect information detection method is applied to a head-mounted display device, the head-mounted display device comprising: a first temperature and humidity sensor, a second temperature and humidity sensor; the forehead temperature comprises forehead temperature, and the forehead humidity comprises forehead humidity;

[0028] The step of obtaining the ambient temperature, ambient humidity, and forehead temperature and forehead humidity of the target user includes:

[0029] The ambient temperature and humidity are acquired through the first temperature and humidity sensor, and the forehead temperature and humidity of the target user are acquired through the second temperature and humidity sensor.

[0030] In addition, to achieve the above-mentioned purpose, the present invention further provides a motion effect information detection device, the motion effect information detection device comprising:

[0031] The human body sensing module is used to obtain the ambient temperature, ambient humidity, and forehead temperature and humidity of the target user;

[0032] The motion recognition module is used to determine a corresponding motion intensity compensation value set according to the ambient temperature and the ambient humidity; and to determine the motion effect information of the target user according to the forehead temperature, the forehead humidity and the motion intensity compensation value set.

[0033] In addition, to achieve the above-mentioned purpose, the present invention also provides a head-mounted display device, including a processor, a storage unit, and a motion effect information detection program stored on the storage unit and executable by the processor, wherein when the motion effect information detection program is executed by the processor, the steps of the motion effect information detection method described above are implemented.

[0034] Optionally, the head-mounted display device includes a forehead support, binocular lenses, a camera, a bioelectrical impedance sensor, a first temperature and humidity sensor, and a second temperature and humidity sensor; wherein the camera is arranged between the binocular lenses; the bioelectrical impedance sensor is arranged in the middle of the forehead support; the second temperature and humidity sensor is arranged adjacent to the bioelectrical impedance sensor on the forehead support;

[0035] The camera is used to obtain facial information of the target user;

[0036] The bioelectrical impedance sensor is used to obtain the body fat percentage of the target user;

[0037] The first temperature and humidity sensor is used to obtain ambient temperature and humidity;

[0038] The second temperature and humidity sensor is used to obtain the forehead temperature and forehead humidity of the target user.

[0039] The present invention also provides a computer-readable storage medium, on which a motion effect information detection program is stored. When the motion effect information detection program is executed by a processor, the steps of the motion effect information detection method described above are implemented.

[0040] The exercise effect information detection method in the technical solution of the present invention fully takes into account the impact of the temperature and humidity of the external environment on the user's exercise effect, and takes into account that the same exercise will produce different exercise intensities and exercise effects for users with different physiques. Based on the fact that the user's forehead temperature and sweating amount are different under different exercise intensities, and the exercise intensity is directly proportional to the forehead temperature, forehead temperature change and sweating amount, and the forehead temperature and forehead temperature change can reflect the user's continuous exercise time, and the user's forehead humidity and forehead humidity change can reflect the user's sweating amount, this application combines the ambient temperature, ambient humidity and the target user's forehead temperature and forehead humidity, and determines the corresponding exercise intensity compensation value set according to the ambient temperature and ambient humidity of the external environment. In combination, the exercise intensity compensation value set is used to compensate and correct the forehead temperature change value corresponding to the forehead temperature, and the forehead humidity change value corresponding to the forehead humidity is compensated and corrected, so that the user's actual body temperature and the amount of sweat caused by exercise can be determined more accurately in various temperature and humidity external environments. Regardless of the user's height, weight, or physique, the two parameters of the user's actual body temperature and exercise sweat can reflect the actual exercise effects of users of all physiques, including the actual energy consumed in this exercise, so that users of all physiques can accurately grasp the real situation and effect of this exercise in different external environments, and then make adjustments to subsequent exercise and diet, so that users can exercise and eat more scientifically and reasonably, which is beneficial to the user's health.

[0041] By applying the motion effect information detection method of the present invention to head-mounted display devices such as VR glasses, users can monitor their own motion effects while playing various sports games, thereby not only increasing users' interest in exercise and increasing the duration of users' exercise persistence, achieving better fitness and weight loss effects during sports games, but also enhancing users' stickiness to the use of head-mounted display devices. These effects and functions are not available in current head-mounted display devices. BRIEF DESCRIPTION OF THE DRAWINGS

[0042] Figure 1 A schematic diagram of the structure of the hardware operating environment of the head-mounted display device involved in the embodiment of the present invention;

[0043] Figure 2 1 is a flow chart of a first embodiment of a method for detecting motion effect information according to the present invention;

[0044] Figure 3 This is a detailed flow chart of step S20 involved in an embodiment of the motion effect information detection method of the present invention;

[0045] Figure 4 Schematic diagram of a detailed flow chart of step S30 involved in an embodiment of a method for detecting motion effect information of the present invention;

[0046] Figure 5 This is a detailed flow chart of step S32 involved in an embodiment of the motion effect information detection method of the present invention;

[0047] Figure 6 A simplified schematic diagram of the structure of the head-mounted display device of the present invention;

[0048] Figure 7 Schematic diagram of the framework structure of the motion effect information detection device of the present invention.

[0049] Description of Figure Numbers:

[0050] Label name Label name 1 forehead support 2 Binocular lenses 3 Camera 4 Bioelectrical impedance sensor 5 Second temperature and humidity sensor

[0051] The purpose, features and advantages of the present invention will be further described with reference to the accompanying drawings and in conjunction with the embodiments. DETAILED DESCRIPTION

[0052] It should be understood that the specific embodiments described herein are only used to explain the present invention and are not intended to limit the present invention.

[0053] An embodiment of the present invention provides a head-mounted display device. The head-mounted display device may be a mixed reality (MR) device (e.g., MR glasses or an MR helmet), an augmented reality (AR) device (e.g., AR glasses or an AR helmet), a virtual reality (VR) device (e.g., VR glasses or a VR helmet), an extended reality (XR) device, or any combination thereof, and other intelligent head-mounted display devices, without limitation.

[0054] like Figure 1 As shown, Figure 1 Schematic diagram of the hardware operating environment of the head-mounted display device involved in the embodiment of the present invention.

[0055] like Figure 1 As shown, the head-mounted display device may include: a processor 1001, such as a CPU, a network interface 1004, a user interface 1003, a storage unit 1005, and a communication bus 1002. The communication bus 1002 is used to realize the connection and communication between these components. The user interface 1003 may include a display (Display), an input unit such as a control panel, and the user interface 1003 may optionally include a standard wired interface and a wireless interface. The network interface 1004 may optionally include a standard wired interface and a wireless interface (such as a WIFI interface). The storage unit 1005 may be a high-speed RAM storage unit or a stable storage unit (non-volatile memory), such as a disk storage unit. The storage unit 1005 may optionally be a storage device independent of the aforementioned processor 1001. The storage unit 1005, which is a computer storage medium, may include a motion effect information detection program.

[0056] Those skilled in the art will understand that Figure 1 The hardware structure shown in the figure does not constitute a limitation of the device, and may include more or fewer components than shown in the figure, or combine certain components, or arrange the components differently.

[0057] Continue to refer to Figure 1 , Figure 1 The storage unit 1005 as a computer-readable storage medium may include an operating system, a user interface module, a network communication module, and a motion effect information detection program.

[0058] exist Figure 1 In the example, the network communication module is mainly used to connect to the server and perform data communication with the server; and the processor 1001 can call the motion effect information detection program stored in the storage unit 1005 and perform the following operations:

[0059] Obtaining ambient temperature, ambient humidity, and the target user's forehead temperature and forehead humidity;

[0060] determining a corresponding exercise intensity compensation value set according to the ambient temperature and the ambient humidity;

[0061] The exercise effect information of the target user is determined according to the forehead temperature, the forehead humidity, and the exercise intensity compensation value set.

[0062] Furthermore, the processor 1001 may call the motion effect information detection program stored in the memory 1005 and further perform the following operations:

[0063] Determining the corresponding forehead temperature change compensation value according to the ambient temperature;

[0064] determining a corresponding forehead humidity change compensation value according to the ambient temperature and the ambient humidity;

[0065] The corresponding exercise duration compensation value is determined according to the ambient temperature and the ambient humidity.

[0066] Furthermore, the processor 1001 may call the motion effect information detection program stored in the memory 1005 and further perform the following operations:

[0067] determining a forehead temperature change value according to the forehead temperature, and determining a forehead humidity change value according to the forehead humidity;

[0068] The exercise effect information of the target user is determined according to the forehead temperature, the forehead humidity, the forehead temperature change value, the forehead humidity change value and the exercise intensity compensation value set.

[0069] Furthermore, the processor 1001 may call the motion effect information detection program stored in the memory 1005 and further perform the following operations:

[0070] determining a corrected forehead temperature change value according to the forehead temperature change value and the forehead temperature change compensation value;

[0071] determining a corrected forehead humidity change value according to the forehead humidity change value and the forehead humidity change compensation value;

[0072] determining an exercise duration of the target user according to the forehead temperature or the forehead humidity, and determining a corrected exercise duration according to the exercise duration and the exercise duration compensation value;

[0073] The energy consumption value of the target user is determined according to the corrected forehead temperature change value, the corrected forehead humidity change value, and the corrected exercise duration.

[0074] Furthermore, the processor 1001 may call the motion effect information detection program stored in the memory 1005 and further perform the following operations:

[0075] Acquire current facial information and historical facial information of the target user, and compare the current facial information with the historical facial information to determine facial contour change information of the target user;

[0076] The exercise effect information of the target user is determined according to the facial contour change information.

[0077] Furthermore, the processor 1001 may call the motion effect information detection program stored in the memory 1005 and further perform the following operations:

[0078] The current body fat percentage and the historical body fat percentage of the target user are obtained, and the current body fat percentage and the historical body fat percentage are compared to determine the exercise effect information of the target user.

[0079] Furthermore, the processor 1001 may call the motion effect information detection program stored in the memory 1005 and further perform the following operations:

[0080] When the operating state of the head mounted display device is a worn state, obtaining current facial information of the target user;

[0081] If the preset facial database includes facial information that matches the current facial information, the step of obtaining the ambient temperature, ambient humidity, and forehead temperature and forehead humidity of the target user is performed.

[0082] In one embodiment, reference may be made to Figure 6 , Figure 6 The figure is a simplified schematic diagram of the structure of the head-mounted display device of the present invention. As shown in the figure, the head-mounted display device also includes a forehead support 1, binocular lenses 2, a camera 3, a bioelectrical impedance sensor 4, a first temperature and humidity sensor (not shown), and a second temperature and humidity sensor 5. The camera 3 is disposed between the binocular lenses 2, with the lens of the camera 3 located on the side closest to the human face. The specific location of the camera 3 is not limited. The bioelectrical impedance sensor 4 is disposed in the middle of the forehead support 1, but can also be disposed at other locations on the forehead support 1, ensuring that the bioelectrical impedance sensor 4 is in close contact with the user's forehead when the user wears the head-mounted display device. The second temperature and humidity sensor 5 is disposed adjacent to the bioelectrical impedance sensor 4 on the forehead support 1. The specific location of the first temperature and humidity sensor on the head-mounted display device is not limited and can be disposed on any side of the head-mounted display device away from the user, such as on the outside of the temples of VR glasses. It is necessary to ensure that the first temperature and humidity sensor is not affected by the temperature and humidity of the human body when detecting ambient temperature and humidity.

[0083] The camera 3 is used to obtain facial information of the target user;

[0084] The bioelectrical impedance sensor 4 is used to obtain the body fat percentage of the target user and can also obtain the water content in the skin of the target user;

[0085] The first temperature and humidity sensor is used to obtain ambient temperature and humidity;

[0086] The second temperature and humidity sensor 5 is used to obtain the forehead temperature and forehead humidity of the target user.

[0087] The head-mounted display device of the present invention can, based on the above-mentioned structures, help users monitor and grasp their exercise effect information while playing sports games, thereby increasing their interest in using the head-mounted display device for exercise and consciously increasing their exercise time, thereby improving their physical health through the head-mounted display device, giving the head-mounted display device the function of exercise monitoring, and at the same time increasing users' stickiness to the use of the head-mounted display device product and improving the economic benefits brought by the head-mounted display device.

[0088] Based on the hardware structure of the head-mounted display device described above, various embodiments of the motion effect information detection method of the present invention are proposed.

[0089] An embodiment of the present invention provides a motion effect information detection method.

[0090] Please refer to Figure 2 , Figure 2 1 is a flow chart of a first embodiment of a motion effect information detection method according to the present invention. In the first embodiment of the present invention, the motion effect information detection method is applied to a head-mounted display device. The motion effect information detection method includes the following steps:

[0091] Step S10, obtaining the ambient temperature, ambient humidity, and forehead temperature and forehead humidity of the target user;

[0092] In this embodiment, the first temperature and humidity sensor of the head-mounted display device can detect and obtain the ambient temperature and humidity of the external environment according to a preset sampling period. At the same time, the second temperature and humidity sensor of the head-mounted display device can detect and obtain the forehead temperature and humidity of the target user according to the same sampling period. When the target user wears the head-mounted display device, the second temperature and humidity sensor will be close to or close to the target user's forehead, so that more accurate forehead temperature and humidity can be obtained. The reason for collecting and obtaining the target user's forehead temperature and humidity is that during exercise, the temperature on the forehead can more accurately reflect the target user's actual body temperature. Since the forehead is the part of the human body that is most likely to sweat during exercise, by obtaining the humidity on the forehead, the actual amount of sweating of the target user can be more accurately determined. The more sweating and the more frequent sweating, the corresponding forehead humidity will be greater, and the amplitude of the change in forehead humidity from the beginning of wearing the head-mounted display device for exercise will also be greater.

[0093] In addition, the exercise effect information detection method of the present invention can also be applied to sports wearable devices such as smart watches and smart bracelets. It is only necessary to set the first temperature and humidity sensor and the second temperature and humidity sensor such as the above-mentioned head-mounted display device on the sports wearable device such as the smart watch, and obtain the temperature and humidity of the environment and the temperature and humidity of the user's skin respectively. No further details will be given here.

[0094] In one embodiment, before step S10, the method further includes:

[0095] Step a: when the operating state of the head mounted display device is in a worn state, obtaining current facial information of the target user;

[0096] When the head-mounted display device detects the wearing operation of the target user through one or more methods (such as human body capacitance, infrared detection, acceleration posture sensing, head-mounted display device power-on instructions, etc.), it is determined that the operating state of the head-mounted display device is the worn state. Then, when the user has put on the head-mounted display device, the current facial information of the target user, that is, the facial information, is obtained through the camera of the head-mounted display device. Specifically, when the operating state of the head-mounted display device is the worn state, the user can be reminded by voice to look forward or look at the camera, so as to obtain complete facial information and improve the accuracy and efficiency of face recognition.

[0097] Step b: If the preset facial database includes facial information that matches the current facial information, the step of obtaining the ambient temperature, ambient humidity, and forehead temperature and forehead humidity of the target user is performed.

[0098] A preset facial database can be established and stored in the memory of the head-mounted display device, including the facial information of each user that has been collected and recorded. Based on face recognition technology, facial information in the facial database that matches the current facial information can be determined, thereby identifying a specific target user, and then executing steps S10 to S30. In this way, the exercise data of the target user can be recorded each time based on the identification of the target user, so that different exercise methods and diet methods can be recommended for different target users, which is convenient for the target user to grasp his or her own exercise data.

[0099] In one embodiment, if the preset facial database does not include facial information that matches the current facial information, this indicates that the target user is new to the head-mounted display device, and a separate information profile needs to be created for the new user in the facial database, allowing the new user to easily query and analyze the data and results of each exercise. Furthermore, upon identifying the target user as a new user, the user may be prompted to enter basic information such as gender, age, height, and weight. This allows the head-mounted display device system to provide more professional exercise guidance based on the target user's exercise data, thereby helping the user improve their health.

[0100] Step S20, determining a corresponding exercise intensity compensation value set according to the ambient temperature and the ambient humidity;

[0101] It is relatively easy to understand that different ambient temperatures and ambient humidity will affect the actual intensity of the user's exercise to varying degrees. For example, in an external environment with a high ambient temperature, the user's exercise intensity will be higher when running 800 meters compared to an external environment with a low ambient temperature, and the energy consumed will be more. This is one of the main reasons why it is easier to get tired when exercising in a high temperature environment. Ambient humidity will also have a certain impact on the user's exercise intensity. When the ambient humidity is relatively high, sweat evaporates more slowly, and the body's heat is also lost more slowly, so the effect of fitness and fat loss will be worse than when the ambient humidity is relatively low. The present invention is aware of the impact of ambient temperature and humidity on exercise effects, so it compensates and corrects the assessment of the user's exercise intensity based on ambient temperature and humidity, thereby obtaining a more realistic exercise intensity for the user, that is, a more accurate and reliable actual amount of calories consumed by the user during exercise.

[0102] In one embodiment, the exercise intensity compensation value set includes a forehead temperature change compensation value, a forehead humidity change compensation value, and an exercise duration compensation value;

[0103] Please refer to Figure 3 , the step S20 comprises:

[0104] Step S21, determining the corresponding forehead temperature change compensation value according to the ambient temperature;

[0105] In this embodiment, the ambient temperature and the corresponding forehead temperature variation compensation value are directly proportional. That is, the higher the ambient temperature, the larger the corresponding forehead temperature variation compensation value, and vice versa. The reason for this proportional relationship is that, considering that the higher the ambient temperature, the user's forehead temperature is generally higher when they first wear the head-mounted display device, so the forehead temperature does not change much during exercise. Therefore, it is necessary to increase the forehead variation compensation value to compensate for the forehead temperature variation value, reflecting the user's actual body temperature increase. Conversely, the lower the ambient temperature, the greater the forehead temperature variation, so it is necessary to decrease the forehead variation compensation value to compensate for the forehead temperature variation value, reflecting the user's actual body temperature increase.

[0106] Furthermore, a preset standard temperature can be set, such as 26°C, without limitation. In an external environment at the preset standard temperature, the forehead temperature change compensation value can be 0. For an ambient temperature less than the preset standard temperature, the forehead temperature change compensation value can be a negative number. For an ambient temperature greater than the preset standard temperature, the forehead temperature change compensation value can be a positive number. Forehead temperature change compensation values corresponding to different ambient temperatures can be set based on actual needs or customized based on experimental results based on different algorithms for calculating exercise energy expenditure. For example, if the ambient temperature is 13°C, which is within the set interval [5, 15], the forehead temperature change compensation value corresponding to this set interval is -3°C.

[0107] Step S22, determining the corresponding forehead humidity change compensation value according to the ambient temperature and the ambient humidity;

[0108] During exercise, the ambient temperature and humidity of the external environment significantly influence perspiration, and sweat production is directly related to actual exercise intensity, and therefore, calorie expenditure. By considering these two factors, the forehead humidity compensation value can be determined by consulting a preset curve between the ambient temperature and humidity and the forehead humidity compensation value.

[0109] Step S23: determining the corresponding exercise duration compensation value according to the ambient temperature and the ambient humidity.

[0110] For the same sports and exercise time, the corresponding calories consumed are different under different ambient temperatures and ambient humidity. Within a certain temperature range, such as [0,36℃], when the ambient temperature is high, the calories consumed are relatively high, and the exercise time can be increased; when the ambient temperature is low, the calories consumed are relatively low, and the exercise time can be decreased; when the ambient humidity is high, the calories consumed are relatively low, and the exercise time can be decreased; when the ambient humidity is low, the calories consumed are relatively high, and the exercise time can be increased. Taking into account the combined effects of the two factors of ambient temperature and ambient humidity, in order to unify the standard exercise time, the exercise time change compensation value can be determined by querying the preset ambient temperature and humidity-exercise time compensation value change curve after confirming the ambient temperature and humidity.

[0111] In this embodiment, the influence of the external environmental temperature and humidity factors on the exercise intensity can be comprehensively considered, so as to further determine and unify the actual exercise effect of the user.

[0112] Step S30 : determining the exercise effect information of the target user according to the forehead temperature, the forehead humidity, and the exercise intensity compensation value set.

[0113] By comparing the forehead temperature obtained in each sampling period with the initial forehead temperature when the user just puts on the head-mounted display device, the forehead temperature change value of the target user can be determined. Similarly, the forehead humidity change value of the target user can also be determined, and the exercise time of the target user can be determined by the forehead temperature or forehead humidity. It should be noted that the forehead temperature change value here is the forehead temperature obtained in each sampling period relative to the initial forehead temperature when the user just puts on the head-mounted display device (that is, the operating state of the head-mounted display device is the worn state), and the forehead humidity change value is also relative to the initial forehead humidity when the user just puts on the head-mounted display device.

[0114] The forehead temperature change value, forehead humidity change value and exercise duration are compensated and corrected through the set of exercise intensity compensation values. Combined with the compensated forehead temperature change value, compensated forehead humidity change value and compensated exercise duration, the target user's exercise intensity can be rated and the energy value (calories) consumed in this exercise and other exercise effect information can be determined through a preset calorie consumption algorithm or directly according to the three parameters of the compensated forehead temperature change value, compensated forehead humidity change value and compensated exercise duration. This exercise effect information can be output through voice and / or screen display to remind the user of some situations of this exercise, and the user can also be given some exercise and diet suggestions accordingly.

[0115] The exercise effect information detection method in the technical solution of the present invention fully takes into account the impact of the temperature and humidity of the external environment on the user's exercise effect, and takes into account that the same exercise will produce different exercise intensities and exercise effects for users with different physiques. Based on the fact that the user's forehead temperature and sweating amount are different under different exercise intensities, and the exercise intensity is directly proportional to the forehead temperature, forehead temperature change and sweating amount, and the forehead temperature and forehead temperature change can reflect the user's continuous exercise time, and the user's forehead humidity and forehead humidity change can reflect the user's sweating amount, this application combines the ambient temperature, ambient humidity and the target user's forehead temperature and forehead humidity, and determines the corresponding exercise intensity compensation value set according to the ambient temperature and ambient humidity of the external environment. In combination, the exercise intensity compensation value set is used to compensate and correct the forehead temperature change value corresponding to the forehead temperature, and the forehead humidity change value corresponding to the forehead humidity is compensated and corrected, so that the user's actual body temperature and the amount of sweat caused by exercise can be determined more accurately in various temperature and humidity external environments. Regardless of the user's height, weight, or physique, the two parameters of the user's actual body temperature and exercise sweat can reflect the actual exercise effects of users of all physiques, including the actual energy consumed in this exercise, so that users of all physiques can accurately grasp the real situation and effect of this exercise in different external environments, and then make adjustments to subsequent exercise and diet, so that users can exercise and eat more scientifically and reasonably, which is beneficial to the user's health.

[0116] By applying the motion effect information detection method of the present invention to head-mounted display devices such as VR glasses, users can monitor their own motion effects while playing various sports games, thereby not only increasing users' interest in exercise and increasing the duration of users' exercise persistence, achieving better fitness and weight loss effects during sports games, but also enhancing users' stickiness to the use of head-mounted display devices. These effects and functions are not available in current head-mounted display devices.

[0117] Please refer to Figure 4 Based on the above embodiments, in one embodiment, step S30 includes:

[0118] Step S31, determining a forehead temperature change value according to the forehead temperature, and determining a forehead humidity change value according to the forehead humidity;

[0119] By comparing the forehead temperature obtained in each sampling period with the initial forehead temperature when the user just puts on the head-mounted display device, the forehead temperature change value of the target user can be determined. Similarly, by comparing the forehead humidity obtained in each sampling period with the initial forehead humidity when the user just puts on the head-mounted display device, the forehead humidity change value of the target user can be determined. In this way, multiple forehead temperature change values and multiple forehead humidity change values can be obtained.

[0120] Step S32: determining the target user's exercise effect information based on the forehead temperature, the forehead humidity, the forehead temperature change value, the forehead humidity change value, and the exercise intensity compensation value set.

[0121] The user's exercise duration can be determined based on the forehead temperature or forehead humidity. It's easy to understand that during exercise, the user's forehead temperature will be a certain degree higher than the temperature when the head-mounted display device is first put on, so the user's exercise duration can be determined based on this. Similarly, the user's exercise duration can also be determined based on the forehead humidity. Of course, if the head-mounted display device is equipped with a motion sensor, the user's exercise duration can also be determined using the motion sensor. The exercise intensity compensation value set includes a forehead temperature change compensation value, a forehead humidity change compensation value, and an exercise duration compensation value. These values can be used to compensate for the forehead temperature change value, the forehead humidity change value, and the exercise duration, respectively, to determine and output exercise effect information such as calories consumed, exercise intensity, equivalent exercise duration, sweat volume, and body temperature change during exercise. Exercise effect information such as recommended exercise methods and diet patterns can also be output, helping users develop good exercise habits and benefiting their health.

[0122] Please refer to Figure 5 In one embodiment, the exercise effect information includes an energy consumption value;

[0123] The step S32 includes:

[0124] Step S320, determining a corrected forehead temperature change value according to the forehead temperature change value and the forehead temperature change compensation value;

[0125] The forehead temperature change value and the forehead temperature change compensation value may be added together to obtain a corrected forehead temperature change value.

[0126] Step S321, determining a corrected forehead humidity change value according to the forehead humidity change value and the forehead humidity change compensation value;

[0127] Similarly, the forehead humidity change value and the forehead humidity change compensation value may be added together to obtain a corrected forehead humidity change value.

[0128] Step S322: determining the target user's exercise duration according to the forehead temperature or the forehead humidity, and determining a corrected exercise duration according to the exercise duration and the exercise duration compensation value;

[0129] As mentioned above, the target user's exercise duration can be determined based on the forehead temperature or the forehead humidity. Specifically, it can be determined in each sampling period whether the difference between the forehead temperature and the initial forehead temperature is greater than a preset temperature difference threshold. The preset temperature difference threshold can be set according to actual needs, such as 1.5°C. If the difference is greater than the preset temperature difference threshold, it indicates that the user is still exercising, thereby continuously recording the user's exercise duration. It can also be determined in each sampling period whether the difference between the forehead humidity and the initial forehead humidity is greater than a preset humidity difference threshold. The preset humidity difference threshold can be set according to actual needs, such as 20% relative humidity. If it is greater than the preset humidity difference threshold, it indicates that the user is still sweating and exercising, thereby continuously recording the user's exercise duration.

[0130] After the exercise duration is obtained, the exercise duration is added to the exercise duration compensation value to obtain the corrected exercise duration.

[0131] Step S323 : determining the energy consumption value of the target user according to the corrected forehead temperature change value, the corrected forehead humidity change value, and the corrected exercise duration.

[0132] In combination with the corrected (compensated) forehead temperature change value, the corrected forehead humidity change value, and the corrected exercise duration, the target user's exercise intensity can be rated and the energy value (calories) consumed in this exercise and other exercise effect information can be determined through a preset calorie consumption algorithm or directly according to the three parameters of the compensated forehead temperature change value, the compensated forehead humidity change value, and the compensated exercise duration. The preset calorie consumption algorithm can be expressed as K = S (a T + b H), where K represents the energy consumption value, T represents the corrected forehead temperature change value, H represents the corrected forehead humidity change value, and S represents the corrected exercise duration, and a and b represent different weight values respectively. It is necessary to explain the above-mentioned calorie consumption algorithm K=S·(a·T+b·H) that when the forehead temperature change value and the forehead humidity change value do not change, the exercise time is continuously accumulated. In the same timing stage, when at least one of the forehead temperature change value and the forehead humidity change value changes, another timing stage is entered. For example, from 0 to 20 seconds, the forehead temperature change value and the forehead humidity change value are unchanged, and the energy consumption value K1 of this 0 to 20 second timing stage is obtained. At 21 seconds, one or both of the forehead temperature change value and the forehead humidity change value change and the changed forehead temperature change value and the forehead humidity change value change are maintained until 50 seconds, then 21 seconds to 50 seconds is another timing stage to obtain the energy consumption value K2, and so on. When the target user finishes the exercise, the total energy consumption value is K1+K2+K3+...+Kn.

[0133] Through this embodiment of the present invention, the interference of the external environment and the physical factors of different users is eliminated. From the three perspectives of body temperature, sweat volume and exercise duration, the user's actual exercise intensity and consumed calories can be directly reflected, thereby obtaining a more accurate energy consumption value, which is convenient for users to understand the actual effect after each exercise, and thus improve exercise or diet methods to improve health.

[0134] Based on the above embodiments, in one embodiment, the motion effect information detection method further includes:

[0135] Acquire current facial information and historical facial information of the target user, and compare the current facial information with the historical facial information to determine facial contour change information of the target user;

[0136] The exercise effect information of the target user is determined according to the facial contour change information.

[0137] In this embodiment, after the camera in the head-mounted display device obtains the current facial information of the target user, it can not only be used to identify the user's identity, but also, after determining the identity of the target user, the current facial information of the target user can be compared with the historical facial information. The historical facial information can be the facial information collected when the target user used the head-mounted display device last time. Specifically, the facial contour information in the current facial information is compared with the facial contour information in the historical facial information to obtain the facial contour change information of the target user. The various facial contour information here can be determined by the proportion of the face (facial) image to the complete image collected by the camera. For example, the last proportion was 80%, and the current proportion is 78%, indicating that the user's fitness and fat loss are effective, and the facial contour change information can be determined as -2%. Of course, the facial image area can also be directly determined after collecting the user's face, and the facial image area can be used as facial information. I will not go into details here.

[0138] Based on the facial contour change information, if the user's facial contour has decreased, while outputting the facial contour change information as exercise effect information, it can also output and remind the user that the previous exercise was effective, and the user can maintain the previous exercise intensity to continue fitness and weight loss. It can also recommend some advanced exercise and diet and other exercise effect information to the user. If the user's facial contour remains unchanged or increases, it can also output and remind the user that the previous exercise effect was not good, and then recommend the user to try other exercise and diet methods and other exercise effect information, thereby helping the user to scientifically improve their body shape and health.

[0139] Based on the above embodiments, in one embodiment, the motion effect information detection method further includes:

[0140] The current body fat percentage and the historical body fat percentage of the target user are obtained, and the current body fat percentage and the historical body fat percentage are compared to determine the exercise effect information of the target user.

[0141] The target user's body fat rate can be directly detected by the bioelectrical impedance sensor of the head-mounted display device. The current body fat rate of the target user is compared with the historical body fat rate (which can be the body fat rate of the target user detected last time). If the current body fat rate is lower than the historical body fat rate, it means that the user's exercise has achieved a good fitness and fat reduction effect. The user can be output and reminded of the change in body fat rate, and exercise effect information such as the previous exercise intensity prompt can be output and reminded, thereby encouraging the target user to continue exercising according to the original effective exercise method and continuously improve their body shape and health. If the current body fat rate is greater than or equal to the historical body fat rate, the user can be output and reminded that the previous exercise effect was not good, and other exercise methods can be recommended to the user, and the user can be reminded to eat a reasonable diet and other exercise effect information to help the user improve exercise and diet in a timely manner and develop in a healthier way.

[0142] In one embodiment, the current skin moisture content of the target user can also be obtained through a bioelectrical impedance sensor, and the current skin moisture content is compared with the historical skin moisture content. If the current skin moisture content is less than the historical skin moisture content, exercise effect information such as drinking water and eating more vegetables, fruits and other high-water and high-nutrition foods can be output and reminded to the user.

[0143] In addition, refer to Figure 7 , Figure 7 The present invention also provides a motion effect information detection device, the motion effect information detection device comprising:

[0144] The human body sensing module A10 is used to obtain the ambient temperature, ambient humidity, and the forehead temperature and humidity of the target user;

[0145] The motion identification module A20 is used to determine the corresponding motion intensity compensation value set according to the ambient temperature and the ambient humidity; and to determine the motion effect information of the target user according to the forehead temperature, the forehead humidity and the motion intensity compensation value set.

[0146] Optionally, the motion recognition module A20 is further configured to:

[0147] Determining the corresponding forehead temperature change compensation value according to the ambient temperature;

[0148] determining a corresponding forehead humidity change compensation value according to the ambient temperature and the ambient humidity;

[0149] Determining the corresponding exercise duration compensation value according to the ambient temperature and the ambient humidity. Optionally, the exercise recognition module A20 is further configured to:

[0150] determining a forehead temperature change value according to the forehead temperature, and determining a forehead humidity change value according to the forehead humidity;

[0151] The exercise effect information of the target user is determined according to the forehead temperature, the forehead humidity, the forehead temperature change value, the forehead humidity change value and the exercise intensity compensation value set.

[0152] Optionally, the motion recognition module A20 is further configured to:

[0153] determining a corrected forehead temperature change value according to the forehead temperature change value and the forehead temperature change compensation value;

[0154] determining a corrected forehead humidity change value according to the forehead humidity change value and the forehead humidity change compensation value;

[0155] determining an exercise duration of the target user according to the forehead temperature or the forehead humidity, and determining a corrected exercise duration according to the exercise duration and the exercise duration compensation value;

[0156] The energy consumption value of the target user is determined according to the corrected forehead temperature change value, the corrected forehead humidity change value, and the corrected exercise duration.

[0157] Optionally, the human body sensing module A10 is further used to:

[0158] Acquire current facial information and historical facial information of the target user, and compare the current facial information with the historical facial information to determine facial contour change information of the target user;

[0159] The exercise effect information of the target user is determined according to the facial contour change information.

[0160] Optionally, the human body sensing module A10 is further used to:

[0161] The current body fat percentage and the historical body fat percentage of the target user are obtained, and the current body fat percentage and the historical body fat percentage are compared to determine the exercise effect information of the target user.

[0162] Optionally, the human body sensing module A10 is further used to:

[0163] When the operating state of the head mounted display device is a worn state, obtaining current facial information of the target user;

[0164] If the preset facial database includes facial information that matches the current facial information, the step of obtaining the ambient temperature, ambient humidity, and forehead temperature and forehead humidity of the target user is performed.

[0165] The specific implementation of the motion effect information detection device of the present invention is basically the same as the various embodiments of the above-mentioned motion effect information detection method, and will not be repeated here.

[0166] In addition, the present invention further provides a computer-readable storage medium having a motion effect information detection program stored thereon, wherein when the motion effect information detection program is executed by a processor, the steps of the motion effect information detection method described above are implemented.

[0167] The method implemented when the motion effect information detection program is executed can refer to the various embodiments of the motion effect information detection method of the present invention, and will not be described in detail here.

[0168] It will be understood by those skilled in the art that embodiments of the present invention may be provided as methods, systems, or computer program products. Thus, the present invention may take the form of an entirely hardware embodiment, an entirely software embodiment, or an embodiment combining software and hardware. Furthermore, the present invention may take the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to magnetic disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code.

[0169] The present invention is described with reference to flowcharts and / or block diagrams of methods, devices (systems), and computer program products according to embodiments of the present invention. It should be understood that each process and / or block in the flowcharts and / or block diagrams, as well as combinations of processes and / or blocks in the flowcharts and / or block diagrams, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing device to produce a machine, so that the instructions executed by the processor of the computer or other programmable data processing device generate instructions for implementing the processes in the flowcharts and / or block diagrams. Figure 1 a process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.

[0170] These computer program instructions may also be stored in a computer-readable storage unit that can direct a computer or other programmable data processing device to operate in a specific manner, so that the instructions stored in the computer-readable storage unit produce an article of manufacture comprising an instruction device, which implements the process Figure 1 a process or multiple processes and / or boxes Figure 1 The function specified in one or more boxes.

[0171] These computer program instructions can also be loaded onto a computer or other programmable data processing device so that a series of operational steps are executed on the computer or other programmable device to produce a computer-implemented process, thereby providing the instructions executed on the computer or other programmable device for implementing the process. Figure 1 a process or multiple processes and / or boxes Figure 1 The steps for the function specified in one or more boxes.

[0172] It should be noted that in the claims, any reference signs placed between parentheses shall not be construed as limiting the claims. The word "comprising" does not exclude the presence of components or steps not listed in the claim. The word "a" or "an" preceding a component does not exclude the presence of a plurality of such components. The invention can be implemented by means of hardware comprising several different components and by means of a suitably programmed computer. In a unit claim enumerating several means, several of these means may be embodied by one and the same item of hardware. The use of the words first, second, third etc. does not indicate any order. These words may be interpreted as names.

[0173] Although the preferred embodiments of the present invention have been described, those skilled in the art may make additional changes and modifications to these embodiments once they have learned the basic creative concept. Therefore, the appended claims are intended to be interpreted as including the preferred embodiments and all changes and modifications that fall within the scope of the present invention.

[0174] The above description is only a preferred embodiment of the present invention and does not limit the patent scope of the present invention. All equivalent structural transformations made by using the contents of the present invention description and drawings under the inventive concept of the present invention, or direct / indirect application in other related technical fields are included in the patent protection scope of the present invention.

Claims

1. A motion effect information detection method, characterized in that: The motion effect information detection method is applied to a head-mounted display device; the method comprises the following steps: Obtaining ambient temperature, ambient humidity, and the target user's forehead temperature and forehead humidity; determining a corresponding exercise intensity compensation value set according to the ambient temperature and the ambient humidity; determining the target user's exercise effect information according to the forehead temperature, the forehead humidity, and the exercise intensity compensation value set; The exercise intensity compensation value set includes a forehead temperature change compensation value, a forehead humidity change compensation value, and an exercise duration compensation value; The step of determining a corresponding set of exercise intensity compensation values according to the ambient temperature and the ambient humidity includes: Determining the corresponding forehead temperature change compensation value according to the ambient temperature; determining a corresponding forehead humidity change compensation value according to the ambient temperature and the ambient humidity; The corresponding exercise duration compensation value is determined according to the ambient temperature and the ambient humidity.

2. The method for detecting motion effect information according to claim 1, wherein: The step of determining the target user's exercise effect information based on the forehead temperature, the forehead humidity, and the exercise intensity compensation value set includes: determining a forehead temperature change value according to the forehead temperature, and determining a forehead humidity change value according to the forehead humidity; The exercise effect information of the target user is determined according to the forehead temperature, the forehead humidity, the forehead temperature change value, the forehead humidity change value and the exercise intensity compensation value set.

3. The motion effect information detection method according to claim 2, wherein: The exercise effect information includes an energy consumption value; and the step of determining the exercise effect information of the target user based on the forehead temperature, the forehead humidity, the forehead temperature change value, the forehead humidity change value, and the exercise intensity compensation value set includes: determining a corrected forehead temperature change value according to the forehead temperature change value and the forehead temperature change compensation value; determining a corrected forehead humidity change value according to the forehead humidity change value and the forehead humidity change compensation value; determining an exercise duration of the target user according to the forehead temperature or the forehead humidity, and determining a corrected exercise duration according to the exercise duration and the exercise duration compensation value; The energy consumption value of the target user is determined according to the corrected forehead temperature change value, the corrected forehead humidity change value, and the corrected exercise duration.

4. The motion effect information detection method according to claim 1, wherein: The motion effect information detection method further includes: Acquire current facial information and historical facial information of the target user, and compare the current facial information with the historical facial information to determine facial contour change information of the target user; The exercise effect information of the target user is determined according to the facial contour change information.

5. The motion effect information detection method according to claim 1, wherein: The motion effect information detection method further includes: The current body fat percentage and the historical body fat percentage of the target user are obtained, and the current body fat percentage and the historical body fat percentage are compared to determine the exercise effect information of the target user.

6. The method for detecting motion effect information according to claim 1, wherein: Before the step of obtaining the ambient temperature, ambient humidity, and forehead temperature and forehead humidity of the target user, the method further includes: When the operating state of the head mounted display device is a worn state, obtaining current facial information of the target user; If the preset facial database includes facial information that matches the current facial information, the step of obtaining the ambient temperature, ambient humidity, and forehead temperature and forehead humidity of the target user is performed.

7. A head-mounted display device, characterized in that: The head-mounted display device includes a processor, a storage unit, and a motion effect information detection program stored in the storage unit and executable by the processor, wherein when the motion effect information detection program is executed by the processor, the steps of the motion effect information detection method according to any one of claims 1 to 6 are implemented.

8. The head-mounted display device according to claim 7, wherein: The head-mounted display device further includes a forehead support, binocular lenses, a camera, a bioelectrical impedance sensor, a first temperature and humidity sensor, and a second temperature and humidity sensor; wherein the camera is arranged between the binocular lenses; the bioelectrical impedance sensor is arranged in the middle of the forehead support; the second temperature and humidity sensor is arranged adjacent to the bioelectrical impedance sensor on the forehead support; The camera is used to obtain facial information of the target user; The bioelectrical impedance sensor is used to obtain the body fat percentage of the target user; The first temperature and humidity sensor is used to obtain ambient temperature and humidity; The second temperature and humidity sensor is used to obtain the forehead temperature and forehead humidity of the target user.

9. A computer-readable storage medium, characterized in that The computer-readable storage medium stores a motion effect information detection program, wherein when the motion effect information detection program is executed by a processor, the steps of the motion effect information detection method according to any one of claims 1 to 6 are implemented.

Images