Control method for head-mounted display device, head-mounted display device and storage medium

Abstract

This invention discloses a control method for a head-mounted display device, the head-mounted display device itself, and a storage medium. The method includes: acquiring posture angle data of the head-mounted display device and pressure data of the contact portion of the head-mounted display device, wherein the contact portion is configured to contact the user's head when the head-mounted display device is worn on the user's head; determining state information based on the posture angle data and the pressure data, wherein the state information characterizes the user's fatigue risk; and controlling the operation of the head-mounted display device based on the state information. This invention aims to reduce the user's fatigue risk and improve user comfort during the use of head-mounted display devices.

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of head-mounted display devices, in particular to a control method of a head-mounted display device, a head-mounted display device and a storage medium. BACKGROUND

[0002] In use, a head-mounted display device (such as a virtual reality device or an augmented display device) needs to be worn on the head of a user. When the posture of the head of the user is incorrect or the wearing state of the device on the head of the user is inappropriate, it is easy to cause fatigue of the user in the process of viewing a display section, and affect the comfort of the user. SUMMARY

[0003] The main purpose of the present application is to provide a control method of a head-mounted display device, a head-mounted display device and a storage medium, which aims to reduce the risk of fatigue of a user in the use of a head-mounted display device and improve the comfort of the user.

[0004] To achieve the above purpose, the present application provides a control method of a head-mounted display device, which comprises the following steps:

[0005] Obtaining posture angle data of the head-mounted display device and pressure data of an abutting portion of the head-mounted display device, the abutting portion being arranged to abut the head of a user when the head-mounted display device is worn on the head of the user;

[0006] Determining state information according to the posture angle data and the pressure data; the state information representing the risk of fatigue of the user;

[0007] Controlling the head-mounted display device to operate according to the state information.

[0008] Optionally, the state information comprises head posture information of the head of the user, and the step of controlling the head-mounted display device to operate according to the state information comprises:

[0009] When the head posture information comprises that the head of the user deviates from a preset posture and lasts for a preset time length, controlling the head-mounted display device to move a display picture.

[0010] Optionally, the step of controlling the head-mounted display device to move the display picture comprises:

[0011] Determining a deviating direction of the head of the user relative to the preset posture;

[0012] Determining a direction opposite to the deviating direction as a moving direction;

[0013] Controlling the head-mounted display device to move the display picture according to the moving direction.

[0014] Optionally, the state information comprises tightness information between the head-mounted display device and the user's head, and the step of controlling the head-mounted display device according to the state information comprises:

[0015] When the tightness information is target information, outputting prompt information;

[0016] The target information represents that the tightness state between the user's head and the head-mounted display device deviates from a comfortable state.

[0017] Optionally, the step of outputting prompt information when the tightness information is target information comprises:

[0018] When the tightness information is first information, outputting first prompt information;

[0019] When the tightness information is second information, outputting second prompt information;

[0020] The first information represents that the relaxation between the user's head and the head-mounted display device deviates from a comfortable state, and the second information represents that the tightness between the user's head and the head-mounted display device deviates from a comfortable state.

[0021] Optionally, the abutting portion comprises a first abutting portion and a second abutting portion, the first abutting portion is arranged to abut the front side of the user's head, and the second abutting portion is arranged to abut the back side of the user's head, the pressure data comprises a first pressure value corresponding to the first abutting portion and a second pressure value corresponding to the second abutting portion, and the step of determining state information according to the attitude angle data and the pressure data comprises:

[0022] Determining the state information according to the attitude angle data, the first pressure value, and the second pressure value.

[0023] Optionally, a reference axis is defined as a horizontal axis line between the first abutting portion and the second abutting portion corresponding to a preset attitude, the attitude angle data comprises an angle offset value and an offset direction of a line between the first abutting portion and the second abutting portion relative to the reference axis, the state information comprises head attitude information, and the step of determining the state information according to the attitude angle data, the first pressure value, and the second pressure value comprises:

[0024] When the angle offset value is greater than a first preset angle, and the first pressure value and the second pressure value satisfy a target condition corresponding to the offset direction, determining that the head attitude information comprises that the user's head deviates from the preset attitude;

[0025] When the angle offset value is less than or equal to the first preset angle, or when the angle offset value is greater than the first preset angle and the first pressure value and the second pressure value do not satisfy the target condition corresponding to the offset direction, it is determined that the head posture information includes that the user's head is in the preset posture.

[0026] Optionally, the reference axis is defined as a horizontal axis on which a line between the first abutting portion and the second abutting portion corresponding to the preset posture is located, the posture angle data includes an angle offset value of the line between the first abutting portion and the second abutting portion relative to the reference axis, the state information includes tightness information between the head-mounted display device and the user's head, and the step of determining the state information according to the posture angle data, the first pressure value and the second pressure value includes:

[0027] When the angle offset value is less than or equal to the second preset angle and at least one of the first pressure value and the second pressure value is outside the preset pressure interval, it is determined that the target information is the tightness information, which represents that the tightness state between the user's head and the head-mounted display device deviates from the comfortable state.

[0028] Optionally, the target information includes first information or second information, and the step of determining that the target information is the tightness information when the angle offset value is less than or equal to the second preset angle and at least one of the first pressure value and the second pressure value is outside the preset pressure interval includes:

[0029] When the angle offset value is less than or equal to the second preset angle and both the first pressure value and the second pressure value are greater than the upper limit value of the preset pressure interval, it is determined that the first information is the tightness information.

[0030] When the angle offset value is less than or equal to the second preset angle and at least one of the first pressure value and the second pressure value is less than the lower limit value of the preset pressure interval, it is determined that the tightness information is the tightness information.

[0031] The preset pressure interval is an interval corresponding to the comfortable state, the first information represents that the relaxation degree between the user's head and the head-mounted display device deviates from the comfortable state, and the second information represents that the tightness degree between the user's head and the head-mounted display device deviates from the comfortable state.

[0032] In addition, in order to achieve the above-mentioned purpose, the application further provides a head-mounted display device, which comprises:

[0033] An abutting portion, which is arranged to abut against the user's head when the head-mounted display device is worn on the user's head.

[0034] An attitude sensor is used to detect attitude angle data of a head-mounted display device;

[0035] A pressure detection module is provided on the supporting part, and the pressure detection module is used to detect the pressure data of the supporting part;

[0036] A control device, wherein the attitude sensor and the pressure detection module are both connected to the control device, the control device comprising: a memory, a processor, and a control program for the head-mounted display device stored in the memory and executable on the processor, wherein the control program for the head-mounted display device, when executed by the processor, implements the steps of the control method for the head-mounted display device as described in any of the preceding claims.

[0037] In addition, to achieve the above objectives, this application also proposes a storage medium storing a control program for a head-mounted display device, wherein the control program for the head-mounted display device, when executed by a processor, implements the steps of the control method for the head-mounted display device as described in any of the preceding claims.

[0038] This invention proposes a control method for a head-mounted display device. This method combines the posture angle data of the head-mounted display device and the pressure data of the ground contact portion of the head-mounted display device that is in contact with the user's head to identify state information that characterizes the user's fatigue risk. Based on this state information, the operation of the head-mounted display device is controlled, which can ensure that the operation of the head-mounted display device can be adjusted to adapt to the user's fatigue risk, thereby reducing the user's fatigue risk during the use of the head-mounted display device and improving user comfort. Attached Figure Description

[0039] Figure 1 This is a schematic diagram of the structure of an embodiment of the head-mounted display device of the present invention;

[0040] Figure 2 This is a schematic diagram of the hardware structure involved in the operation of an embodiment of the head-mounted display device of the present invention;

[0041] Figure 3 This is a flowchart illustrating an embodiment of the control method for a head-mounted display device according to the present invention;

[0042] Figure 4 This is a flowchart illustrating another embodiment of the control method for the head-mounted display device of the present invention;

[0043] Figure 5 for Figure 4 A detailed flowchart of step S31;

[0044] Figure 6 This is a flowchart illustrating another embodiment of the control method for the head-mounted display device of the present invention;

[0045] Figure 7 This is a flowchart illustrating another embodiment of the control method for the head-mounted display device of the present invention.

[0046] The realization of the objective, functional features and advantages of the present invention will be further explained in conjunction with the embodiments and with reference to the accompanying drawings. Detailed Implementation

[0047] It should be understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.

[0048] This invention provides a head-mounted display device. The head-mounted display device can be a head-mounted device that displays information based on virtual reality technology or augmented reality technology. The head-mounted display device may include display glasses or a display helmet, etc.

[0049] In this embodiment of the invention, reference is made to Figure 1 and Figure 2 The head-mounted display device includes a main body, an attitude sensor 1, a pressure detection module 2, and a control device 3. Both the attitude sensor 1 and the pressure detection module 2 are located on the main body. Both the attitude sensor 1 and the pressure detection module 2 are connected to the control device 3.

[0050] Attitude sensor 1 is used to detect attitude angle data of the head-mounted display device. Attitude angle data includes acceleration data and angular velocity data. In this embodiment, attitude sensor 1 is an inertial sensor, which includes an accelerometer and an angular velocity sensor. In other embodiments, attitude sensor 1 may also be other types of sensors that detect attitude angle data.

[0051] The main body includes a support frame and a display device mounted on the support frame. The support frame has a supporting portion, which is configured to abut against the user's head when the head-mounted display device is worn on the user's head. A pressure detection module 2 is disposed on the supporting portion, and the pressure detection module 2 is used to detect pressure data of the supporting portion. The pressure detection module 2 may include one or more pressure sensors. The supporting portion can be configured to abut against any position on the user's head, such as the front, left, right, and / or back side.

[0052] Specifically, in this embodiment, referring to Figure 1The abutment portion includes a first abutment portion 41 and a second abutment portion 42. The first abutment portion 41 is configured to abut against the front side of the user's head (e.g., forehead), and the second abutment portion 42 is configured to abut against the back side of the user's head (e.g., back of the head). The pressure detection module 2 includes a first pressure sensor 21 and a second pressure sensor 22. The first pressure sensor 21 is disposed on the first abutment portion 41 and is used to detect a first pressure value, which characterizes the magnitude of the pressure exerted by the user's head on the first abutment portion 41 when it abuts against the front side of the user's head. The second pressure sensor 22 is disposed on the second abutment portion 42 and is used to detect a second pressure value, which characterizes the magnitude of the pressure exerted by the user's head on the second abutment portion 42 when it abuts against the back side of the user's head.

[0053] Furthermore, in this embodiment, referring to Figure 1 A preset plane is defined by the midpoint of the line connecting the first pressure sensor 21 and the second pressure sensor 22, and a plane perpendicular to this line. The attitude sensor 1 is positioned on this preset plane. Furthermore, the first pressure sensor 21, the second pressure sensor 22, and the attitude angle data sensor are arranged coplanarly. Based on this, the accuracy of the state information characterizing user fatigue risk determined based on the data detected by the pressure detection module 2 and the attitude sensor 1 can be effectively improved.

[0054] In this embodiment of the invention, reference is made to Figure 2 The control device 3 of the head-mounted display device includes a processor 1001 (e.g., CPU), a memory 1002, a timer 1003, etc. The components in the control device 3 are connected via a communication bus. The memory 1002 can be a high-speed RAM or a stable, non-volatile memory, such as a disk drive. Optionally, the memory 1002 can also be a storage device independent of the aforementioned processor 1001.

[0055] Those skilled in the art will understand that Figure 2 The device structure shown does not constitute a limitation on the device and may include more or fewer components than shown, or combine certain components, or have different component arrangements.

[0056] like Figure 2 As shown, the memory 1002, which serves as a storage medium, may include a control program for a head-mounted display device. Figure 2 In the device shown, the processor 1001 can be used to call the control program of the head-mounted display device stored in the memory 1002 and execute the relevant steps of the control method of the head-mounted display device in the following embodiments.

[0057] This invention also provides a control method for a head-mounted display device, applied to the aforementioned head-mounted display device.

[0058] Reference Figure 3 This application proposes an embodiment of a control method for a head-mounted display device. In this embodiment, the control method for the head-mounted display device includes:

[0059] Step S10: Obtain the attitude angle data of the head-mounted display device and the pressure data of the abutting part of the head-mounted display device, wherein the abutting part is configured to abut against the user's head when the head-mounted display device is worn on the user's head;

[0060] The attitude angle data specifically represents the angles characteristic of the current attitude of the head-mounted display device. Specifically, a reference plane on the head-mounted display device can be preset, and the angle between the reference plane and the preset plane can be used as the attitude angle data. In this embodiment, the preset plane is a horizontal plane. In other embodiments, the preset plane can also be a vertical plane.

[0061] Attitude angle data can be specifically detected by the attitude sensor mentioned above. Attitude angle data can be the attitude angle value detected at a target duration (e.g., the current moment), or it can include multiple attitude angle values ​​detected within the target duration (e.g., the preset duration at the current moment).

[0062] The pressure data specifically refers to characteristic data that characterizes the magnitude of the pressure experienced by the contact part. Specifically, the pressure experienced by the contact part can be considered as the pressure exerted on the user's head when the head-mounted display device is worn on the user's head.

[0063] The pressure data can be specifically detected through the pressure detection module described above. The pressure data can be the pressure value detected at a target duration (e.g., the current moment), and the attitude angle data can also include multiple pressure values ​​detected within the target duration (e.g., the preset duration at the current moment).

[0064] Furthermore, step S10 can be performed when the head-mounted display device is in the powered-on state.

[0065] Furthermore, when the pressure value detected by the pressure detection module on the head-mounted display device is greater than the preset pressure value (indicating that the head-mounted display device is in a wearing state), step S10 is executed.

[0066] Step S20: Determine the state information based on the attitude angle data and the pressure data;

[0067] The status information represents the user's fatigue risk;

[0068] The status information may specifically include the head posture information of the user's head worn by the head-mounted display device and / or the tightness information between the user's head and the head-mounted display device.

[0069] Different attitude angle data and different pressure data correspond to different state information. Specifically, a correspondence between attitude angle data, pressure data, and state information can be established in advance. This correspondence can include calculation formulas, mapping tables, etc. Based on this correspondence, the state information corresponding to the current attitude angle data and pressure data can be determined.

[0070] Specifically, at least two angle intervals corresponding to the attitude angle can be pre-divided, and at least two pressure intervals corresponding to the contact pressure can be pre-divided. The correspondence between the angle intervals, pressure intervals and status information can be established, and the status information corresponding to the angle interval where the attitude angle data is located and the pressure interval where the pressure data is located can be determined as the status information characterizing the fatigue risk of the user currently wearing the head-mounted display device.

[0071] In addition, different state information can be represented by different feature values. Therefore, a calculation formula between attitude angle data, pressure data and feature values ​​can be established in advance. By substituting the current attitude angle data and pressure data into the calculation formula, the state information corresponding to the calculated feature value can be determined as the state information representing the fatigue risk of the user currently wearing the head-mounted display device.

[0072] Step S30: Control the operation of the head-mounted display device according to the status information.

[0073] Different status information corresponds to different operating parameters of the head-mounted display device. These operating parameters are specifically designed to reduce the risk of user fatigue. Specifically, these operating parameters may include control parameters for the display screen, on / off control parameters, prompt operation parameters, and / or vibration operation parameters of the head-mounted display device.

[0074] Specifically, when the status information indicates a high risk of user fatigue, the head-mounted display device can be controlled to output audio prompts, display prompts, and / or vibrate to remind the user to rest or adjust their posture. Alternatively, when the status information indicates a high risk of user fatigue, the head-mounted display device can be controlled to turn off. Or, when the status information indicates a low risk of user fatigue, the head-mounted display device can be controlled to remain on.

[0075] This invention proposes a control method for a head-mounted display device. This method combines the posture angle data of the head-mounted display device and the pressure data of the ground contact portion of the head-mounted display device that is in contact with the user's head to identify state information that characterizes the user's fatigue risk. Based on this state information, the operation of the head-mounted display device is controlled, which can ensure that the operation of the head-mounted display device can be adjusted to adapt to the user's fatigue risk, thereby reducing the user's fatigue risk during the use of the head-mounted display device and improving user comfort.

[0076] Furthermore, based on the above embodiments, another embodiment of the control method for the head-mounted display device of this application is proposed. In this embodiment, the state information includes the head posture information of the user's head, referring to... Figure 4 Step S30 includes:

[0077] Step S31: When the head posture information includes the user's head deviating from a preset posture for a preset duration, control the head-mounted display device to move and display the screen.

[0078] The preset posture is specifically a pre-set posture that is comfortable or unsuitable for the user's head. In this embodiment, the preset posture is the posture of the user's head when the central axis of the user's head is parallel to the vertical direction, that is, the user's head is in an upright posture. In other embodiments, the preset posture can also be a posture set by the user according to their own situation.

[0079] The preset duration can be a pre-set fixed duration or a duration set by the user. The attitude angle data and pressure data mentioned above can be data continuously monitored within the preset duration.

[0080] The movement of the displayed image on a head-mounted display device can be in a preset fixed direction, or it can be determined based on the direction of deviation of the user's head relative to a preset posture. Specifically, the direction of movement of the displayed image and the direction of deviation are different; the direction of movement can be opposite to the direction of deviation, or the direction of movement can be set at an angle to the direction of deviation.

[0081] In this embodiment, when the user's head deviates from the preset posture and continues for a preset duration through the analysis of posture angle data and pressure data, it indicates that the user's fatigue risk is high when viewing the display screen while the head deviates from the preset posture. At this time, controlling the head-mounted display device to move the display screen is beneficial for the user's head to move with the movement of the display screen, and will not be fixed in an uncomfortable state for a long time, thereby improving the user's head mobility, effectively reducing the user's fatigue risk and improving user comfort.

[0082] Furthermore, in this embodiment, referring to Figure 5 The step of controlling the head-mounted display device to move the displayed image includes:

[0083] Step S311: Determine the deviation direction of the user's head relative to the preset posture;

[0084] The specific direction of deviation can be determined by analyzing attitude angle and pressure data. Alternatively, it can be determined by acquiring images captured by an external camera on the head-mounted display device.

[0085] Step S312: Determine the direction opposite to the deviation direction as the moving direction;

[0086] For example, if the deviation direction is downward relative to the preset posture (e.g., the user looks down), the movement direction is upward; if the deviation direction is upward relative to the preset posture (e.g., the user looks up), the movement direction is downward; if the deviation direction is left relative to the preset posture (e.g., the user tilts their head to the left), the movement direction is right; if the deviation direction is right relative to the preset posture (e.g., the user tilts their head to the right), the movement direction is left.

[0087] Step S313: Control the head-mounted display device to move and display the screen according to the moving direction.

[0088] The display screen can move at a speed lower than the preset speed to avoid excessive movement speed affecting the user's viewing experience.

[0089] Specifically, during the movement of the displayed screen, the process can return to step S10. After step S20, when the head posture information includes the user's head being in a preset posture, the head-mounted display device is controlled to stop moving the displayed screen.

[0090] In this embodiment, by guiding the user's head to move in the opposite direction of the display screen, the user's head can follow the movement and move closer to the preset posture, thereby reducing the risk of fatigue caused by the user deviating too much from the preset posture and effectively improving user comfort.

[0091] Furthermore, based on any of the above embodiments, another embodiment of the control method for the head-mounted display device of this application is proposed. In this embodiment, the state information includes the tightness information between the head-mounted display device and the user's head, referring to... Figure 6 Step S30 includes:

[0092] Step S32: When the tightness information is the target information, output a prompt message; the target information indicates that the tightness state between the user's head and the head-mounted display device deviates from the comfortable state.

[0093] The notification information may include notifications in the form of sound, images, lights, text and / or vibration.

[0094] The prompts can be pre-set fixed information; or, different prompts can correspond to different tightness levels represented by the target information, and the corresponding prompts can be determined by the tightness level represented by the target information.

[0095] In this embodiment, when the tightness information is a first type of information, a first prompt is output; when the tightness information is a second type of information, a second prompt is output; wherein, the first type of information indicates that the relaxation between the user's head and the head-mounted display device deviates from a comfortable state, and the second type of information indicates that the tightness between the user's head and the head-mounted display device deviates from a comfortable state.

[0096] Specifically, the first piece of information indicates that the head-mounted display device on the user's head is too loose, which makes it easy for the head-mounted display device to shift relative to the user's head during use, causing the displayed image to be out of sync with the eyes. This can lead to eye fatigue and dizziness if the user watches for a long time. The second piece of information indicates that the head-mounted display device on the user's head is too tight, which can affect blood circulation in the head for a long time and increase the risk of fatigue when watching the display.

[0097] Specifically, the first prompt message is used to remind the user to increase the tightness between the user's head and the head-mounted display device, for example, reminding the user to adjust the head-mounted display device to be tighter; the second prompt message is used to remind the user to increase the looseness between the user's head and the head-mounted display device, for example, reminding the user to adjust the head-mounted display device to be looser.

[0098] In this embodiment, when the tightness between the user's head and the head-mounted display device does not meet the user's comfort requirements, a prompt message is output. This allows the user to adjust the tightness promptly based on the prompt message, effectively reducing the risk of user fatigue due to improper tightness and thus improving user comfort. In fact, different prompt messages are output for different tightness states represented by the target information, ensuring that the user can promptly and accurately understand the direction of tightness adjustment based on the prompt message, effectively reducing the risk of fatigue during subsequent use of the device and improving user comfort.

[0099] In other embodiments, regardless of whether the target information represents excessive relaxation or excessive tension, the same prompt can be entered, allowing the user to identify whether it needs to be looser or tighter.

[0100] Furthermore, based on any of the above embodiments, another embodiment of the control method for the head-mounted display device of this application is proposed. In this embodiment, the abutting portion includes a first abutting portion and a second abutting portion. The first abutting portion is configured to abut against the front side of the user's head, and the second abutting portion is configured to abut against the rear side of the user's head. The pressure data includes a first pressure value corresponding to the first abutting portion and a second pressure value corresponding to the second abutting portion. Figure 7 Step S20 includes:

[0101] Step S23: Determine the state information based on the attitude angle data, the first pressure value, and the second pressure value.

[0102] Specifically, the tightness information between the head-mounted display device and the user's head and / or the head posture information of the user's head can be determined based on the posture angle data, the first pressure value, and the second pressure value.

[0103] Based on the posture angle data, the target conditions (such as quantitative and / or magnitude relationships) that the first and second pressure values ​​must meet are determined. The matching status of the first and second pressure values ​​with the target conditions determines the state information. The magnitude and / or quantitative relationships accurately reflect the coordination status between different positions of the user's head and the head-mounted display device. Alternatively, the status information can be calculated by substituting the posture angle data, the first pressure value, and the second pressure value into a calculation formula. The state information corresponding to this value is then used as the current status information representing the user's fatigue risk.

[0104] Furthermore, during the acquisition of pressure data, first and second pressure values ​​corresponding to different times can be obtained, resulting in more than one set of sub-pressure data. Each set of sub-pressure data includes a first pressure value and a corresponding second pressure value detected at that time. Based on this, state information can be determined according to attitude angle data, more than one first pressure value, and more than one second pressure value.

[0105] In this embodiment, the first pressure value and the second pressure value can accurately reflect the coordination between the user's head at different positions and the head-mounted display device. Different coordination results in different fatigue risks for the user during device use. Therefore, combining posture angle data, the first pressure value, and the second pressure value to determine the status information is beneficial to further improve the accuracy of the status information, thereby achieving precise control of the operation of the head-mounted display device based on the status information, effectively reducing the user's fatigue risk, and improving user comfort.

[0106] Furthermore, in this embodiment, the reference axis is defined as the horizontal axis containing the line connecting the first abutment and the second abutment corresponding to the preset posture. The posture angle data includes the angular offset value and / or offset direction of the line connecting the first abutment and the second abutment relative to the reference axis. Based on this, the head posture information and the state information, including the tightness information between the head-mounted display device and the user's head, can be determined in the following ways:

[0107] In one implementation, the state information includes head posture information, the posture angle data includes an angle offset value and an angle offset direction, and step S23 includes:

[0108] When the angle offset value is greater than a first preset angle, and the first pressure value and the second pressure value satisfy the target condition corresponding to the offset direction, the head posture information is determined to include the user's head deviating from the preset posture; when the angle offset value is less than or equal to the first preset angle, or when the angle offset value is greater than the first preset angle, and the first pressure value and the second pressure value do not satisfy the target condition corresponding to the offset direction, the head posture information is determined to include the user's head being in the preset posture.

[0109] Different offset directions result in different target conditions. Target conditions specifically include the magnitude and / or quantity relationship that the first and second pressure values ​​must satisfy.

[0110] The first preset angle can be a fixed value set in advance, or it can be determined based on the user type or the type of content currently displayed on the screen. Specifically, the first preset angle is a critical angle value used to distinguish whether the user is at risk of fatigue.

[0111] For example, when the offset direction is downward, the target conditions include that the first pressure value is greater than the second pressure value and the pressure deviation between the first pressure value and the second pressure value is greater than a preset value; when the offset direction is upward, the target conditions include that the first pressure value is less than the second pressure value and the pressure deviation between the first pressure value and the second pressure value is greater than a preset value; when the offset direction is to the left or right (that is, when the connecting line is perpendicular to the reference axis), the target conditions include that the pressure deviation between the first pressure value and the second pressure value is less than or equal to a preset value.

[0112] In this embodiment, an angle offset value greater than a first preset angle indicates that the user's head may be significantly deviating from the preset posture. If the first and second pressure values ​​meet the target conditions, it effectively verifies that the user's head is indeed deviating from the preset posture, leading to a significant fatigue risk; therefore, it can be determined that the user's head is deviating from the preset posture. Conversely, if the first and second pressure values ​​do not meet the target conditions, it can be considered that the possibility of the user deviating from the preset posture is low, and the possibility of user fatigue risk is small; therefore, it can be determined that the user's head is not deviating from the preset posture. Furthermore, if the angle offset value is less than or equal to the first preset angle, it indicates that the user's head is close to the preset posture and there is no deviation; therefore, it can be determined that the user's head is not deviating from the preset posture. Based on this, this embodiment combines posture angle data and pressure data from different positions to identify the user's head posture from multiple dimensions, thereby effectively improving the accuracy of head posture information. This enables precise control of the head-mounted display device's operation based on state information, effectively reducing user fatigue risk and improving user comfort.

[0113] In another implementation, the status information includes the tightness information between the head-mounted display device and the user's head, the posture angle data includes an angle offset value, and step S23 includes:

[0114] When the angle offset value is less than or equal to the second preset angle, and at least one of the first pressure value and the second pressure value is outside the preset pressure range, the target information is determined to be the tightness information, and the target information represents the deviation of the tightness state between the user's head and the head-mounted display device from the comfortable state.

[0115] The second preset angle is specifically a critical angle value used to distinguish whether the user's head is in a preset posture.

[0116] The preset pressure range is the range corresponding to the comfort state. Specifically, the preset pressure range is the target pressure range that the first and second pressure values ​​need to be reached when the user wears the head-mounted display device without any risk of fatigue. In this embodiment, the preset pressure range is a pressure range with an upper limit and a lower limit. In other embodiments, the preset pressure range may also be a pressure range with a lower limit but no upper limit.

[0117] Specifically, if the first pressure value is greater than the upper limit of the preset pressure range, it indicates that the front of the user's head is too tight against the head-mounted display device; if the second pressure value is greater than the upper limit of the preset pressure range, it indicates that the back of the user's head is too tight against the head-mounted display device; if the first pressure value is less than the lower limit of the preset pressure range, it indicates that the front of the user's head is too loose against the head-mounted display device; and if the second pressure value is greater than the lower limit of the preset pressure range, it indicates that the back of the user's head is too loose against the head-mounted display device.

[0118] An angle offset value less than or equal to a second preset angle indicates that the user's head is in a preset posture and the first and second contact parts are parallel. In this state, the tightness is determined based on the first and second pressure values ​​to determine if it deviates from a comfortable state. This helps avoid the influence of incorrect user head posture on the first and second pressure values, ensuring accurate analysis of tightness information based on these values. Furthermore, the tightness information is determined by combining the relationship between the pressure values ​​at different positions of the user's head and the preset pressure range. If any pressure value at any position falls outside the preset pressure range, the tightness between the user's head and the head-mounted display device is considered to deviate from a comfortable state. This helps ensure that the tightness at different positions of the user's head is appropriate during use of the head-mounted display device, effectively reducing user fatigue risk and improving user comfort.

[0119] Furthermore, in this embodiment, the target information includes first information or second information. The step of determining the target information as the tightness information when the angle offset value is less than or equal to the second preset angle, and at least one of the first pressure value and the second pressure value is outside the preset pressure range, includes:

[0120] When the angle offset value is less than or equal to the second preset angle, and both the first pressure value and the second pressure value are greater than the upper limit of the preset pressure range, the first information is determined to be the tightness information;

[0121] When the angle offset value is less than or equal to the second preset angle, and at least one of the first pressure value and the second pressure value is less than the lower limit of the preset pressure range, the tightness information is determined;

[0122] The preset pressure range is the range corresponding to the comfort state. The first information represents the degree of relaxation between the user's head and the head-mounted display device that deviates from the comfort state, and the second information represents the degree of tension between the user's head and the head-mounted display device that deviates from the comfort state.

[0123] In this embodiment, by means of the above method, the loose or tight fit between the user's head and the head-mounted display device at different positions can be accurately distinguished by combining posture angle data and pressure values ​​at different positions. This is beneficial for subsequent control of the head-mounted display device to perform differentiated operation based on the first and second information, so as to effectively reduce the risk of user fatigue and effectively improve user comfort.

[0124] Furthermore, based on any of the above embodiments, in this embodiment, when the head-mounted display device is in the on state and switches from the unworn state to the worn state, the status information can be determined to include tightness information; when the head-mounted display device is in the on state and the wearing time is longer than a preset time, the status information can be determined to include head posture information.

[0125] In other embodiments, the status information may also include both tension information and head posture information.

[0126] Furthermore, this embodiment of the invention also proposes a storage medium storing a control program for a head-mounted display device. When the control program for the head-mounted display device is executed by a processor, it implements the relevant steps of any embodiment of the control method for the head-mounted display device described above.

[0127] It should be noted that, in this document, the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or system that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or system. Unless otherwise specified, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the process, method, article, or system that includes that element.

[0128] The sequence numbers of the above embodiments of the present invention are for descriptive purposes only and do not represent the superiority or inferiority of the embodiments.

[0129] Through the above description of the embodiments, those skilled in the art can clearly understand that the methods of the above embodiments can be implemented by means of software plus necessary general-purpose hardware platforms. Of course, they can also be implemented by hardware, but in many cases the former is a better implementation method. Based on this understanding, the technical solution of the present invention, in essence, or the part that contributes to the prior art, can be embodied in the form of a software product. This computer software product is stored in a storage medium (such as ROM / RAM, magnetic disk, optical disk) as described above, and includes several instructions to cause a terminal device (which may be a mobile phone, computer, server, head-mounted display device, or network device, etc.) to execute the methods described in the various embodiments of the present invention.

[0130] The above are merely preferred embodiments of the present invention and do not limit the scope of the patent. Any equivalent structural or procedural transformations made based on the description and drawings of the present invention, or direct or indirect applications in other related technical fields, are similarly included within the scope of patent protection of the present invention.

Claims

1. A control method of a head-mounted display device, characterized by, The control method of the head-mounted display device comprises the following steps: Obtaining attitude angle data of the head-mounted display device and pressure data of an abutting portion of the head-mounted display device, the abutting portion being arranged to abut against a user's head when the head-mounted display device is worn on the user's head, the abutting portion comprising a first abutting portion and a second abutting portion, the first abutting portion being arranged to abut against the front side of the user's head, and the second abutting portion being arranged to abut against the back side of the user's head, the pressure data comprising a first pressure value corresponding to the first abutting portion and a second pressure value corresponding to the second abutting portion; Determining state information according to the attitude angle data, the first pressure value, and the second pressure value; Wherein, a reference axis is defined as a horizontal axis line between the first abutting portion and the second abutting portion corresponding to a preset posture, the attitude angle data comprises an angle offset value and an offset direction of the line between the first abutting portion and the second abutting portion relative to the reference axis, and the state information comprises head posture information, the step of determining the state information according to the attitude angle data, the first pressure value, and the second pressure value comprises: When the angle offset value is greater than a first preset angle, and the first pressure value and the second pressure value satisfy a target condition corresponding to the offset direction, determining that the head posture information comprises that the user's head deviates from the preset posture; When the angle offset value is less than or equal to the first preset angle, or when the angle offset value is greater than the first preset angle, and the first pressure value and the second pressure value do not satisfy the target condition corresponding to the offset direction, determining that the head posture information comprises that the user's head is in the preset posture; Controlling the head-mounted display device to operate according to the state information. 2.The control method of a head-mounted display device of claim 1, wherein, The state information comprises head posture information of the user's head, and the step of controlling the head-mounted display device to operate according to the state information comprises: When the head posture information comprises that the user's head deviates from the preset posture and lasts for a preset time length, controlling the head-mounted display device to move the display picture.

3. The control method of a head-mounted display device according to claim 2, wherein The step of controlling the head-mounted display device to move the display picture comprises: Determining a deviation direction of the user's head relative to the preset posture; Determining a direction opposite to the deviation direction as a moving direction; Controlling the head-mounted display device to move the display picture according to the moving direction.

4. A control method of a head-mounted display device, characterized by, The control method of the head-mounted display device comprises the following steps: Obtaining attitude angle data of the head-mounted display device and pressure data of an abutting portion of the head-mounted display device, the abutting portion being arranged to abut against a user's head when the head-mounted display device is worn on the user's head, the abutting portion comprising a first abutting portion and a second abutting portion, the first abutting portion being arranged to abut against the front side of the user's head, and the second abutting portion being arranged to abut against the back side of the user's head, the pressure data comprising a first pressure value corresponding to the first abutting portion and a second pressure value corresponding to the second abutting portion; Determining state information according to the attitude angle data, the first pressure value, and the second pressure value; The definition reference axis is a horizontal axis of a line between the first abutting part and the second abutting part corresponding to the preset posture; the posture angle data includes an angle offset value of the line between the first abutting part and the second abutting part relative to the reference axis, and the state information includes tightness information between the head-mounted display device and the user's head; the step of determining the state information according to the posture angle data, the first pressure value and the second pressure value includes: When the angle offset value is less than or equal to a second preset angle, and at least one of the first pressure value and the second pressure value is outside a preset pressure interval, the target information is determined as the tightness information, and the target information represents that the tightness state between the user's head and the head-mounted display device deviates from a comfortable state; The head-mounted display device is controlled to operate according to the state information.

5. The control method of a head-mounted display device according to claim 4, wherein The target information includes first information or second information, and the step of determining the target information as the tightness information when the angle offset value is less than or equal to the second preset angle, and at least one of the first pressure value and the second pressure value is outside the preset pressure interval includes: When the angle offset value is less than or equal to the second preset angle, and the first pressure value and the second pressure value are both greater than an upper limit value of the preset pressure interval, the first information is determined as the tightness information; When the angle offset value is less than or equal to the second preset angle, and at least one of the first pressure value and the second pressure value is less than a lower limit value of the preset pressure interval, the second information is determined as the tightness information; The preset pressure interval is an interval corresponding to the comfortable state, the first information represents that the relaxation degree between the user's head and the head-mounted display device deviates from the comfortable state, and the second information represents that the tightness degree between the user's head and the head-mounted display device deviates from the comfortable state.

6. The control method of a head-mounted display device according to claim 5, wherein The step of controlling the head-mounted display device to operate according to the state information includes: When the tightness information is the first information, first prompt information is outputted; When the tightness information is the second information, second prompt information is outputted.

7. A head-mounted display device, comprising: The head-mounted display device includes: An abutting part arranged to abut against a user's head when the head-mounted display device is worn on the user's head, the abutting part including a first abutting part arranged to abut against the front side of the user's head and a second abutting part arranged to abut against the back side of the user's head; A posture sensor for detecting posture angle data of the head-mounted display device; A pressure detection module arranged in the abutting part, the pressure detection module being configured to detect pressure data of the abutting part, the pressure data including a first pressure value corresponding to the first abutting part and a second pressure value corresponding to the second abutting part; A control device, the posture sensor and the pressure detection module are connected with the control device, the control device comprises: a memory, a processor and a head-mounted display device control program stored in the memory and executable on the processor, the head-mounted display device control program is executed by the processor to realize the steps of the head-mounted display device control method in any one of claims 1 to 6.

8. A storage medium, characterized by The storage medium has a head-mounted display device control program stored thereon, and the head-mounted display device control program is executed by the processor to realize the steps of the head-mounted display device control method in any one of claims 1 to 6.

Images