Head-mounted display device, display method and apparatus, device and medium

Abstract

The present application belongs to the technical field of computers. Disclosed in the present application are a head-mounted display device, a display method and apparatus, a device and a medium. The head-mounted display device (100) comprises: a sensor (110), which is located at the back of the head of a user, is electrically connected to a processor (120), and is configured to sense a parameter and send the sensed parameter to the processor (120); and the processor (120), which is configured to determine the posture of the user on the basis of the sensed parameter, and when the posture of the user changes from a first posture to a second posture, move a window displayed by the head-mounted display device (100) from a first position to a second position adapted to the second posture, the first position being a position adapted to the first posture.

Description

Head-mounted display devices, display methods, apparatus, equipment and media

[0001] Cross-references to related applications

[0002] This application claims priority to Chinese Patent Application No. 202510121465.0, filed on January 24, 2025, entitled “Head-mounted display device, display method, apparatus, device and medium”, the entire contents of which are incorporated herein by reference. Technical Field

[0003] This application belongs to the field of computer technology, and specifically relates to a head-mounted display device, display method, apparatus, device, and medium. Background Technology

[0004] With the development of Extended Reality (XR) devices, users have increasingly higher requirements for XR devices.

[0005] In related technologies, adjusting the display window of an XR device relies on manual operation by the user, which is not convenient. Summary of the Invention

[0006] The purpose of this application is to provide a head-mounted display device, display method, apparatus, device, and medium that can automatically detect the user's posture and automatically move the window displayed on the head-mounted display device to a position that matches the user's posture, without requiring manual operation by the user, thus making it more convenient.

[0007] In a first aspect, embodiments of this application provide a head-mounted display device, including:

[0008] The sensor, located at the back of the user's head, is electrically connected to the processor and is used to collect sensing parameters and send the sensing parameters to the processor;

[0009] The processor is used to determine the user's posture based on sensing parameters, and when the user's posture changes from a first posture to a second posture, it moves the window displayed by the head-mounted display device from a first position to a second position adapted to the second posture, where the first position is the position adapted to the first posture.

[0010] Secondly, embodiments of this application provide a display method applied to a head-mounted display device, the method comprising:

[0011] The sensor collects the sensing parameters from the head-mounted display device's sensors, which are located at the back of the user's head.

[0012] Determine the user's posture based on sensor parameters;

[0013] When the user's posture changes from the first posture to the second posture, the window displayed on the head-mounted display device is moved from the first position to the second position that is adapted to the second posture. The first position is the position adapted to the first posture.

[0014] Thirdly, embodiments of this application provide a display device applied to a head-mounted display device, the device comprising:

[0015] The acquisition module is used to acquire the sensing parameters collected by the sensors of the head-mounted display device, which are located at the back of the user's head.

[0016] The determination module is used to determine the user's posture based on sensing parameters;

[0017] The movement module is used to move the window displayed on the head-mounted display device from a first position to a second position adapted to the second posture when the user's posture changes from a first posture to a second posture. The first position is the position adapted to the first posture.

[0018] Fourthly, embodiments of this application provide an electronic device including a processor and a memory, the memory storing programs or instructions executable on the processor, the programs or instructions, when executed by the processor, implementing the steps of the method described in the first aspect.

[0019] Fifthly, embodiments of this application provide a readable storage medium on which a program or instructions are stored, which, when executed by a processor, implement the steps of the method described in the first aspect.

[0020] In a sixth aspect, embodiments of this application provide a chip, the chip including a processor and a communication interface, the communication interface being coupled to the processor, the processor being used to run programs or instructions to implement the method as described in the first aspect.

[0021] In a seventh aspect, embodiments of this application provide a computer program product stored in a storage medium, which is executed by at least one processor to implement the method described in the first aspect.

[0022] In this embodiment, a sensor located at the back of the user's head can collect sensing parameters. The processor can determine the user's posture based on these parameters, and when the user's posture changes from a first posture to a second posture, the window displayed on the head-mounted display device is moved from a first position adapted to the first posture to a second position adapted to the second posture. In this way, the head-mounted display device can automatically detect the user's posture and automatically move the window displayed on the head-mounted display device to a position adapted to the user's posture, without requiring manual operation from the user, making it more convenient. Attached Figure Description

[0023] Figure 1 is a schematic diagram of the structure of a head-mounted display device according to an exemplary embodiment;

[0024] Figure 2 is a second schematic diagram of the structure of a head-mounted display device according to an exemplary embodiment;

[0025] Figure 3 is a flowchart illustrating one of the display methods according to an exemplary embodiment;

[0026] Figure 4 is a second flowchart illustrating a display method according to an exemplary embodiment;

[0027] Figure 5 is a structural block diagram of a display device according to an exemplary embodiment;

[0028] Figure 6 is a structural block diagram of an electronic device according to an exemplary embodiment;

[0029] Figure 7 is a schematic diagram of the hardware structure of an electronic device that implements an embodiment of this application. Detailed Implementation

[0030] The technical solutions of the embodiments of this application will be clearly described below with reference to the accompanying drawings. Obviously, the described embodiments are only some, not all, of the embodiments of this application. All other embodiments obtained by those skilled in the art based on the embodiments of this application are within the scope of protection of this application.

[0031] The terms "first," "second," etc., used in the specification and claims of this application are used to distinguish similar objects and not to describe a specific order or sequence. It should be understood that such use of data can be interchanged where appropriate so that embodiments of this application can be implemented in orders other than those illustrated or described herein, and the objects distinguished by "first," "second," etc., are generally of the same class and the number of objects is not limited; for example, a first object can be one or more. Furthermore, in the specification and claims, "and / or" indicates at least one of the connected objects, and the character " / " generally indicates that the preceding and following objects are in an "or" relationship.

[0032] To facilitate understanding of the solutions in this application, some terms involved in the embodiments of this application will be explained first.

[0033] XR devices: This term describes technologies that combine the real world and virtual environments, including virtual reality, augmented reality, and mixed reality. Virtual reality fully immerses the user in a virtual environment, augmented reality overlays virtual elements onto the real environment, and mixed reality embeds virtual objects into the real world. XR is a collective term encompassing the overall concept of these technologies.

[0034] Inertial Measurement Unit (IMU): An IMU sensor is a sensor that integrates an accelerometer and a gyroscope to measure the linear acceleration and angular velocity of an object. IMU sensors are commonly used in aircraft, automobiles, drones, motion tracking devices, and virtual reality to obtain information about the attitude, position, and motion of objects.

[0035] Simultaneous Localization and Mapping (SLAM) refers to the process by which a robot uses sensors to locate itself in its environment and create a map of that environment.

[0036] Head-mounted displays (HMDs) are devices worn on the head and positioned in front of the eyes, typically used for experiences such as virtual reality (VR) and augmented reality (AR). HMDs usually consist of a display, tracking sensors, and lenses, allowing users to see virtual images or augmented reality content. With HMDs, users can immerse themselves in virtual environments or observe the overlay of virtual objects in the real world.

[0037] As the background technology shows, with the development of XR devices, users have increasingly higher requirements for XR devices.

[0038] In related technologies, adjusting the display window of an XR device relies on manual operation by the user, which is not convenient.

[0039] This application provides a head-mounted display device, display method, apparatus, device, and medium. A sensor located at the back of the user's head can collect sensing parameters. A processor can determine the user's posture based on these sensing parameters. When the user's posture changes from a first posture to a second posture, the window displayed on the head-mounted display device is moved from a first position adapted to the first posture to a second position adapted to the second posture. In this way, the head-mounted display device can automatically detect the user's posture and automatically move the window displayed on the head-mounted display device to a position adapted to the user's posture, without requiring manual operation by the user, making it more convenient.

[0040] The head-mounted display device, display method, apparatus, device, and medium provided in this application will be described in detail below with reference to the accompanying drawings and through specific embodiments and application scenarios.

[0041] The display method provided in this application can be applied to scenarios where users wear head-mounted display devices.

[0042] The display method provided in this application embodiment can be executed by a head-mounted display device or the processor of the head-mounted display device.

[0043] The head-mounted display device provided in the embodiments of this application will be described in detail below with reference to Figure 1.

[0044] Figure 1 is a schematic diagram of the structure of a head-mounted display device according to an exemplary embodiment.

[0045] As shown in Figure 1, the head-mounted display device 100 may include a sensor 110 and a processor 120.

[0046] The sensor 110 can be located at the back of the user's head, can be electrically connected to the processor 120, and can be used to collect sensing parameters and send the sensing parameters to the processor 120.

[0047] The processor 120 can be used to determine the user's posture based on sensing parameters, and when the user's posture changes from a first posture to a second posture, move the window displayed by the head-mounted display device 100 from a first position to a second position adapted to the second posture.

[0048] The content displayed on the head-mounted display (HMD) of an XR device should change according to the user's posture and head movements. Therefore, predicting the user's posture and adjusting the displayed content accordingly can improve the user experience. Currently, the industry uses posture sensors such as IMUs and environmental localization technologies such as SLAM to sense head movements. This allows for real-time detection of the user's head movements, providing XR devices with basic spatial and motion data. However, HMDs have certain limitations in sensing; they cannot detect whether the user is lying down. When a user wearing a HMD lies down, they need to manually drag the window displayed on the HMD into their field of vision to see it, which is inconvenient.

[0049] Here, the second posture can be a lying position, and the first posture can be any posture other than lying down, that is, a non-lying position.

[0050] The first position can be a position that suits the first posture. The second position can be a position that suits the lying position.

[0051] The position that is adapted to the posture can be the position in the center of the user's field of vision when the user is in that posture.

[0052] Specifically, the state of the back of a user's head differs depending on whether they are in a lying or non-lying position. Therefore, based on the sensing parameters collected by sensors located at the back of the head, it can be determined whether the user's posture has changed from other postures to a lying position. When a user changes from other postures to a lying position, the window can be moved to a position that adapts to the lying position in order to keep the window within the user's field of vision.

[0053] Therefore, the sensor located at the back of the user's head can collect sensing parameters. The processor can determine the user's posture based on these parameters, and when the user's posture changes from a first posture to a second posture, the window displayed on the head-mounted display device is moved from a first position adapted to the first posture to a second position adapted to the second posture. In this way, the head-mounted display device can automatically detect the user's posture and automatically move the window displayed on the head-mounted display device to a position adapted to the user's posture, without requiring manual operation from the user, making it more convenient.

[0054] In some implementations, the head-mounted display device may include a main structure and a soft strap. The main structure may house a camera, a posture sensor, a display, and lenses. The posture sensor may be a gyroscope.

[0055] In some embodiments, the sensing parameters may include pressure and / or light intensity, as shown in FIG2. The sensors may include: pressure sensor 111 and / or light sensor 112.

[0056] Among them, the pressure sensor 111 can be electrically connected to the processor and can be used to collect pressure;

[0057] The light sensor 112 can be electrically connected to the processor and can be used to collect light intensity.

[0058] Here, both the pressure sensor 111 and the light sensor 112 can be located inside the strap.

[0059] Specifically, when the user is wearing the head-mounted display device, the pressure sensor 111 can collect the pressure on the back of the user's head, and the light sensor 112 can collect the light intensity on the back of the user's head.

[0060] In this way, when a user wears a head-mounted display, the pressure sensor can collect the pressure on the back of the user's head, and the light sensor can collect the light intensity on the back of the user's head. The user's posture can be determined more accurately by combining the pressure and light intensity on the back of the user's head.

[0061] It should be noted that the aforementioned implementing entities do not constitute a limitation on this application.

[0062] The display method provided in the embodiments of this application will be described in detail below with reference to Figure 3.

[0063] Figure 3 is a flowchart illustrating a display method according to an exemplary embodiment.

[0064] As shown in Figure 3, the display method may include the following steps:

[0065] Step 310: Obtain the sensing parameters collected by the sensors of the head-mounted display device.

[0066] Here, with the user wearing the head-mounted display, the sensor is located at the back of the user's head. The sensed parameters can be used to determine the user's posture.

[0067] Step 320: Determine the user's posture based on the sensing parameters.

[0068] Specifically, based on the sensing parameters, it can be determined whether the user's posture has changed from the first posture to the second posture.

[0069] In some implementations, the sensing parameters may include pressure and / or light intensity, and step 320 may include:

[0070] If the sensing parameters meet the preset conditions, the user's posture is determined to change from the first posture to the second posture.

[0071] Furthermore, if the sensing parameters do not meet the preset conditions, it can be determined that the user's posture has not changed to the second posture.

[0072] Here, when the user is wearing the head-mounted display, the pressure can be the pressure on the back of the user's head, and the light intensity can be the light intensity on the back of the user's head.

[0073] The pressure at the back of the user's head can determine whether the back of the head is under force and the magnitude of that force. The light intensity at the back of the user's head can determine whether the back of the user's head is in contact with an object.

[0074] The preset conditions may include pressure within a first preset range and / or light intensity within a second preset range.

[0075] Specifically, when the sensing parameters include pressure, if the pressure is within a first preset range, it can be determined that the user's posture has changed to the second posture; if the pressure is not within the first preset range, it can be determined that the user's posture has not changed to the second posture.

[0076] If the light intensity is within the second preset range when the sensing parameters include light intensity, it can be determined that the user's posture has changed to the second posture; if the light intensity is not within the second preset range, it can be determined that the user's posture has not changed to the second posture.

[0077] When the sensing parameters include pressure and light intensity, if the pressure is within a first preset range and the light intensity is within a second preset range, it can be determined that the user's posture has changed to the second posture; if the pressure is not within the first preset range and / or the light intensity is not within the second preset range, it can be determined that the user's posture has not changed to the second posture.

[0078] Both the first and second preset ranges can be set according to actual needs.

[0079] For example, F = 0 kPa can be considered as no force on the back of the user's head, 0 kPa < F ≤ 10 kPa can be considered as a small force on the back of the user's head, and F > 10 kPa can be considered as a large force on the back of the user's head. Therefore, the first preset range can be F > 10 kPa, where 10 kPa can be determined based on the weight of the head. F is the pressure.

[0080] If L > 50 lux, it can be considered that the back of the user's head is not in contact with any object; if L ≤ 50 lux, it can be considered that the back of the user's head is in contact with an object. Therefore, the second preset range can be L ≤ 50 lux. L is the light intensity.

[0081] In some examples, when the sensing parameters include pressure and light intensity, if the pressure is greater than 10 kPa and the light intensity is less than or equal to 50 lux, it can be determined that the user's posture has changed to a lying position; if the pressure is less than or equal to 10 kPa and / or the light intensity is greater than 50 lux, it can be determined that the user's posture has not changed to a lying position.

[0082] In this way, when a user wears a head-mounted display, the pressure on the back of the user's head and the light intensity on the back of the user's head can be used to more accurately determine whether the user's posture has changed to the second posture.

[0083] In some implementations, step 320 may include:

[0084] Obtain the pitch angle of the head-mounted display;

[0085] The user's posture is determined based on the sensor parameters and pitch angle.

[0086] Here, the pitch angle of the head-mounted display can be collected using an attitude sensor.

[0087] The pitch angle of the head-mounted display is different when the user is in the first posture and the second posture. Therefore, it is possible to determine whether the user's posture has changed from the first posture to the second posture based on the pitch angle of the head-mounted display.

[0088] Therefore, by further determining the user's posture based on the pitch angle in addition to pressure and / or light intensity, the accuracy of determining the user's posture can be improved.

[0089] In some implementations, determining the user's posture based on sensing parameters and pitch angle may include:

[0090] If the sensing parameters meet the preset conditions and the pitch angle is within the third preset range, the user's posture is determined to change from the first posture to the second posture.

[0091] Furthermore, if the sensing parameters do not meet the preset conditions and / or the pitch angle is not within the third preset range, it can be determined that the user's posture has not changed to the second posture.

[0092] Here, the specific circumstances under which the sensing parameters meet the preset conditions can be found in the above embodiments, and will not be repeated here.

[0093] The third preset range can be set according to actual needs.

[0094] For example, -30°<A≤30° can be considered as the user looking straight ahead, 30°<A≤90° can be considered as the user looking up, and -90°≤A≤-30° can be considered as the user looking down. Therefore, the third preset range can be 30°<A≤90°, where A is the pitch angle.

[0095] In some examples, when the sensing parameters include pressure and light intensity, if the pressure is greater than 10 kPa, the light intensity is less than or equal to 50 lux, and 30° < pitch angle ≤ 90°, it can be determined that the user's posture has changed to a lying position; otherwise, it can be determined that the user's posture has not changed to a lying position.

[0096] In this way, the user's posture can be determined based on both the sensing parameters and the pitch angle, further improving the accuracy of determining the user's posture.

[0097] Step 330: When the user's posture changes from the first posture to the second posture, the window displayed by the head-mounted display device is moved from the first position to the second position that is adapted to the second posture.

[0098] Here, the first position can be a position that is adapted to the first posture.

[0099] For example, when a user changes from another posture to a lying position, the window can be moved upwards to place the window in the user's center of vision.

[0100] In some embodiments, moving the window displayed by the head-mounted display device from a first position to a second position adapted to the second posture may include:

[0101] The distance the window needs to move is determined based on the pitch angle of the head-mounted display.

[0102] Move the window by that distance so that it moves from the first position to the second position.

[0103] Here, the pitch angle of the head-mounted display can be collected using an attitude sensor.

[0104] Specifically, the distance the window needs to move can be calculated using the formula: d = k × A + C. Here, d is the distance the window needs to move, A is the tilt angle of the head-mounted display, k is a preset coefficient, and C is a preset constant.

[0105] In this way, the distance the window needs to move can be accurately determined based on the tilt angle of the head-mounted display device, so as to ensure that the window moves to a position that matches the user's posture.

[0106] Therefore, the sensor located at the back of the user's head can collect sensing parameters. The processor can determine the user's posture based on these parameters, and when the user's posture changes from a first posture to a second posture, the window displayed on the head-mounted display device is moved from a first position adapted to the first posture to a second position adapted to the second posture. In this way, the head-mounted display device can automatically detect the user's posture and automatically move the window displayed on the head-mounted display device to a position adapted to the user's posture, without requiring manual operation from the user, making it more convenient.

[0107] In some embodiments, after step 320, the method may further include:

[0108] When the user's posture changes from the first posture to the second posture, and the head-mounted display shows multimedia information, the multimedia information is enlarged and displayed.

[0109] Here, multimedia information can be video or images.

[0110] For example, if the user's posture changes to a lying position, and the head-mounted display device is showing a video or an image from a photo album, it can switch to a giant screen mode to magnify the display of the video or the image from the photo album so that the user can watch it immersively.

[0111] In this way, multimedia information can be automatically enlarged and displayed when the user changes from the first posture to the second posture, so that the user can watch immersively without the need for manual operation.

[0112] XR devices need to perform real-time scanning and algorithm calculations of the surrounding environment during use. The power consumption of related sensors and the real-time operation of algorithms in the central processing unit (CPU) and graphics processing unit (GPU) will significantly increase the power consumption of XR devices, shorten the usage time of XR devices, and reduce the user experience.

[0113] Based on this, in some embodiments, after step 320, the method may further include:

[0114] When the user's posture changes from the first posture to the second posture, the target sensor is put into sleep mode.

[0115] Here, the target sensor can be a sensor that is not used when the user is in the second posture. The target sensor may include sensors for acquiring spatial data and / or sensors for acquiring motion data.

[0116] When the user's posture changes to the second posture, it can be assumed that the aforementioned target sensor will not be used for a period of time, and therefore the aforementioned target sensor can be controlled to go into sleep mode.

[0117] For example, when the user's posture changes to a lying position, the low-power mode of the head-mounted display can be automatically activated, and target sensors associated with spatial computing and / or motion, such as depth cameras, LiDAR, and / or grayscale cameras, can be put into sleep mode, thereby reducing the power consumption of the head-mounted display at the hardware level.

[0118] In this way, when the user's posture changes to the second posture, controlling the sensors used to collect spatial data and / or the sensors used to collect motion data to go into sleep mode can reasonably reduce the hardware power consumption of the head-mounted display device. This allows for a more intelligent balance between device performance, experience, and battery life, extending the usage time of the head-mounted display device and improving the user experience.

[0119] Furthermore, in some embodiments, after step 320, the method may further include:

[0120] When the user's posture changes from the first posture to the second posture, the control processor stops executing the target algorithm.

[0121] Here, the target algorithm can be an algorithm that is not used when the user is in the second pose. The target algorithm can include algorithms related to the target sensor mentioned above.

[0122] Processors may include CPUs and / or GPUs.

[0123] If the user's posture changes to the second posture, it can be assumed that the target algorithm will not be used for a period of time. Therefore, the processor can be controlled to stop executing the target algorithm.

[0124] For example, after the target sensor is put into hibernation, the processor can be controlled to stop executing algorithms related to the target sensor, such as SLAM spatial calculation, safe zone and / or automatic modeling algorithms, thereby reducing the CPU and GPU load of the XR device and reducing the power consumption of the XR device from the software level.

[0125] Thus, when the user's posture changes to the second posture, the control processor stops executing the algorithms related to the aforementioned target sensors. This can reasonably reduce the processor power consumption of the head-mounted display, thereby enabling a more intelligent balance between device performance, experience, and battery life, extending the usage time of the head-mounted display, and improving the user experience.

[0126] To better describe the entire solution, based on the above embodiments, a specific example is given as shown in Figure 4. The display method may include steps 401-405, which will be explained in detail below.

[0127] Step 401: Obtain the pressure, light intensity, and pitch angle collected by the sensors of the head-mounted display device.

[0128] Step 402: Determine whether the pressure is within the first preset range, the light intensity is within the second preset range, and the pitch angle is within the third preset range.

[0129] If yes, proceed to step 403; otherwise, return to step 401.

[0130] Step 403: Determine that the user's posture has changed to a lying position.

[0131] Step 404: Determine the distance the window displayed on the head-mounted display needs to move based on the pitch angle.

[0132] Step 405: Move the window by that distance, and control the target sensor to sleep, and control the processor to stop executing the target algorithm related to the target sensor.

[0133] In this embodiment, pressure sensors and light sensors can detect the user's head-leaning behavior, while posture sensors and cameras can predict and evaluate the user's posture and head movements. Through comprehensive processing and analysis of the states and values ​​of the pressure, light, and posture sensors, the system can detect, identify, and analyze the user's head-leaning behavior while the user is wearing the head-mounted display, thereby dynamically adjusting the virtual display content to enhance the user's virtual reality experience. Furthermore, based on the user's actual movements and behaviors, and predictions of those movements, the system can dynamically adjust the displayed content to achieve a more immersive virtual reality experience, providing the user with a more realistic and fluid visual experience.

[0134] Specifically, by combining multiple sensors to comprehensively predict the user's current state and behavioral patterns, the displayed content is adjusted accordingly to enhance the user's virtual reality experience. Based on the user's actual actions and behaviors, and predictions of those actions, the displayed content is dynamically adjusted to match the user's posture, thereby providing a more comfortable and immersive virtual reality experience and a more realistic and smooth visual experience. Based on the user's leaning, movie-watching, and other behavioral patterns, specific algorithms are frequency-reduced or energy-saving, lowering the overall power consumption of the device and improving battery life, system performance, and component lifespan. In short, the embodiments of this application can improve the intelligence and adaptability of virtual reality devices, bringing users a more comfortable, convenient, and personalized virtual reality experience.

[0135] The display method provided in this application can be executed by a display device. This application uses a display device executing the display method as an example to illustrate the display device provided in this application.

[0136] Based on the same inventive concept, this application also provides a display device. The display device provided in the embodiment of this application will be described in detail below with reference to FIG5.

[0137] Figure 5 is a structural block diagram of a display device according to an exemplary embodiment.

[0138] As shown in Figure 5, the display device 500 can be applied to a head-mounted display device, and the display device 500 may include:

[0139] The acquisition module 501 is used to acquire the sensing parameters collected by the sensor of the head-mounted display device, the sensor being located at the back of the user's head;

[0140] The determination module 502 is used to determine the user's posture based on the sensing parameters;

[0141] The moving module 503 is used to move the window displayed by the head-mounted display device from a first position to a second position adapted to the second posture when the user's posture changes from a first posture to a second posture. The first position is the position adapted to the first posture.

[0142] The display device 500 described above will now be described in detail, as follows:

[0143] In one embodiment, the sensing parameters include pressure and / or light intensity, and the determining module 502 may include:

[0144] The first determining submodule is used to determine that the user's posture changes from a first posture to a second posture when the sensing parameters meet preset conditions. The preset conditions include the pressure parameter being within a first preset range and / or the light intensity being within a second preset range.

[0145] In one embodiment, the determining module 502 may include:

[0146] The first acquisition submodule is used to acquire the pitch angle of the head-mounted display device;

[0147] The second determination submodule is used to determine the user's posture based on the sensing parameters and pitch angle.

[0148] In one embodiment, the second determining submodule may include:

[0149] The determining unit is used to determine the user's posture from the first posture to the second posture when the sensing parameters meet the preset conditions and the pitch angle is within the third preset range.

[0150] In one embodiment, the moving module 503 may include:

[0151] The third determination submodule is used to determine the distance the window needs to move based on the pitch angle of the head-mounted display device;

[0152] The move submodule is used to move the window a distance so that the window moves from a first position to a second position.

[0153] In one embodiment, the display device 500 may further include:

[0154] The display module is used to enlarge and display multimedia information when the user's posture changes from the first posture to the second posture and the head-mounted display device is displaying multimedia information.

[0155] In one embodiment, the display device 500 may further include:

[0156] The sleep module is used to control the target sensors when the user's posture changes from a first posture to a second posture. The target sensors include sensors for acquiring spatial data and / or sensors for acquiring motion data.

[0157] Therefore, the sensor located at the back of the user's head can collect sensing parameters. The processor can determine the user's posture based on these parameters, and when the user's posture changes from a first posture to a second posture, the window displayed on the head-mounted display device is moved from a first position adapted to the first posture to a second position adapted to the second posture. In this way, the head-mounted display device can automatically detect the user's posture and automatically move the window displayed on the head-mounted display device to a position adapted to the user's posture, without requiring manual operation from the user, making it more convenient.

[0158] The display device in this application embodiment can be an electronic device or a component within an electronic device, such as an integrated circuit or a chip. The electronic device can be a terminal or other devices besides a terminal. For example, the electronic device can be a mobile phone, tablet computer, laptop computer, PDA, in-vehicle electronic device, mobile internet device (MID), augmented reality (AR) / virtual reality (VR) device, robot, wearable device, ultra-mobile personal computer (UMPC), netbook, or personal digital assistant (PDA), etc. It can also be a server, network attached storage (NAS), personal computer (PC), television set (TV), ATM, or self-service machine, etc. This application embodiment does not specifically limit the scope of the device.

[0159] The display device in this application embodiment can be a device with an operating system. This operating system can be Android, iOS, or other possible operating systems; this application embodiment does not specifically limit the specific operating system used.

[0160] The display device provided in this application embodiment can implement the various processes implemented in the method embodiment of Figures 3-4 and achieve the same technical effect. To avoid repetition, it will not be described again here.

[0161] In some embodiments, as shown in FIG6, this application embodiment also provides an electronic device 600, including a processor 601 and a memory 602. The memory 602 stores a program or instructions that can run on the processor 601. When the program or instructions are executed by the processor 601, they implement the various steps of the above-described display method embodiment and can achieve the same technical effect. To avoid repetition, they will not be described again here.

[0162] It should be noted that the electronic devices in the embodiments of this application include the mobile electronic devices and non-mobile electronic devices described above.

[0163] Figure 7 is a schematic diagram of the hardware structure of an electronic device that implements an embodiment of this application.

[0164] The electronic device 700 includes, but is not limited to, components such as: radio frequency unit 701, network module 702, audio output unit 703, input unit 704, sensor 705, display unit 706, user input unit 707, interface unit 708, memory 709, and processor 710.

[0165] Those skilled in the art will understand that the electronic device 700 may also include a power supply (such as a battery) for powering various components. The power supply can be logically connected to the processor 710 through a power management system, thereby enabling functions such as charging, discharging, and power consumption management through the power management system. The electronic device structure shown in Figure 7 does not constitute a limitation on the electronic device. The electronic device may include more or fewer components than shown, or combine certain components, or have different component arrangements, which will not be elaborated here.

[0166] The processor 710 is used to acquire the sensing parameters collected by the sensors of the head-mounted display device, which are located at the back of the user's head.

[0167] Determine the user's posture based on sensor parameters;

[0168] When the user's posture changes from the first posture to the second posture, the window displayed on the head-mounted display device is moved from the first position to the second position adapted to the second posture, where the first position is the position adapted to the first posture.

[0169] Therefore, the sensor located at the back of the user's head can collect sensing parameters. The processor can determine the user's posture based on these parameters, and when the user's posture changes from a first posture to a second posture, the window displayed on the head-mounted display device is moved from a first position adapted to the first posture to a second position adapted to the second posture. In this way, the head-mounted display device can automatically detect the user's posture and automatically move the window displayed on the head-mounted display device to a position adapted to the user's posture, without requiring manual operation from the user, making it more convenient.

[0170] In some embodiments, the processor 710 is further configured to determine that the user's posture changes from a first posture to a second posture when the sensing parameters meet preset conditions, the preset conditions including pressure parameters being within a first preset range and / or light intensity being within a second preset range.

[0171] In this way, when a user wears a head-mounted display, the pressure on the back of the user's head and the light intensity on the back of the user's head can be used to more accurately determine whether the user's posture has changed to the second posture.

[0172] In some embodiments, the processor 710 is further configured to acquire the pitch angle of the head-mounted display device;

[0173] The user's posture is determined based on the sensor parameters and pitch angle.

[0174] Therefore, by further determining the user's posture based on the pitch angle in addition to pressure and / or light intensity, the accuracy of determining the user's posture can be improved.

[0175] In some embodiments, the processor 710 is further configured to determine that the user's posture changes from a first posture to a second posture when the sensing parameters meet preset conditions and the pitch angle is within a third preset range.

[0176] In this way, the user's posture can be determined based on both the sensing parameters and the pitch angle, further improving the accuracy of determining the user's posture.

[0177] In some embodiments, the processor 710 is further configured to determine the distance the window needs to be moved based on the pitch angle of the head-mounted display device;

[0178] Move the window by that distance so that it moves from the first position to the second position.

[0179] In this way, the distance the window needs to move can be accurately determined based on the tilt angle of the head-mounted display device, so as to ensure that the window moves to a position that matches the user's posture.

[0180] In some embodiments, the display unit 706 is configured to enlarge and display multimedia information when the user's posture changes from a first posture to a second posture and the head-mounted display device displays multimedia information.

[0181] In this way, multimedia information can be automatically enlarged and displayed when the user changes from the first posture to the second posture, so that the user can watch immersively without the need for manual operation.

[0182] In some embodiments, the processor 710 is further configured to control the target sensor to go into sleep mode when the user's posture changes from a first posture to a second posture. The target sensor includes a sensor for acquiring spatial data and / or a sensor for acquiring motion data.

[0183] In this way, when the user's posture changes to the second posture, controlling the sensors used to collect spatial data and / or the sensors used to collect motion data to go into sleep mode can reasonably reduce the hardware power consumption of the head-mounted display device. This allows for a more intelligent balance between device performance, experience, and battery life, extending the usage time of the head-mounted display device and improving the user experience.

[0184] It should be understood that, in this embodiment, the input unit 704 may include a graphics processing unit (GPU) 7041 and a microphone 7042. The GPU 7041 processes image data of still images or videos obtained by an image capture device (such as a camera) in video capture mode or image capture mode. The display unit 706 may include a display panel 7061, which may be configured in the form of a liquid crystal display, an organic light-emitting diode, or the like. The user input unit 707 includes at least one of a touch panel 7071 and other input devices 7072. The touch panel 7071 is also called a touch screen. The touch panel 7071 may include a touch detection device and a touch controller. Other input devices 7072 may include, but are not limited to, physical keyboards, function keys (such as volume control buttons, power buttons, etc.), trackballs, mice, and joysticks, which will not be described in detail here.

[0185] The memory 709 can be used to store software programs and various data. The memory 709 may primarily include a first storage area for storing programs or instructions and a second storage area for storing data. The first storage area may store the operating system, application programs or instructions required for at least one function (such as sound playback, image playback, etc.). Furthermore, the memory 709 may include volatile memory or non-volatile memory, or both. The non-volatile memory may be read-only memory (ROM), programmable read-only memory (PROM), erasable programmable read-only memory (EPROM), electrically erasable programmable read-only memory (EEPROM), or flash memory. Volatile memory can be random access memory (RAM), static random access memory (SRAM), dynamic random access memory (DRAM), synchronous dynamic random access memory (SDRAM), double data rate synchronous dynamic random access memory (DDRSDRAM), enhanced synchronous dynamic random access memory (ESDRAM), synchronous link dynamic random access memory (SLDRAM), and direct memory bus RAM (DRRAM). The memory 709 in the embodiments of this application includes, but is not limited to, these and any other suitable types of memory.

[0186] Processor 710 may include one or more processing units; in some embodiments, processor 710 integrates an application processor and a modem processor, wherein the application processor mainly handles operations involving the operating system, user interface, and applications, and the modem processor mainly handles wireless communication signals, such as a baseband processor. It is understood that the modem processor may also not be integrated into processor 710.

[0187] This application also provides a readable storage medium storing a program or instructions. When the program or instructions are executed by a processor, they implement the various processes of the above-described display method embodiments and achieve the same technical effect. To avoid repetition, they will not be described again here.

[0188] The processor is the processor in the electronic device described in the above embodiments. The readable storage medium includes computer-readable storage media, such as computer read-only memory, random access memory, magnetic disk, or optical disk.

[0189] This application embodiment also provides a chip, which includes a processor and a communication interface. The communication interface is coupled to the processor. The processor is used to run programs or instructions to implement the various processes of the above-described display method embodiments and can achieve the same technical effect. To avoid repetition, it will not be described again here.

[0190] It should be understood that the chip mentioned in the embodiments of this application may also be referred to as a system-on-a-chip, system chip, chip system, or system-on-a-chip, etc.

[0191] This application provides a computer program product that is stored in a storage medium and executed by at least one processor to implement the various processes shown in the above-described method embodiments, and can achieve the same technical effects. To avoid repetition, it will not be described again here.

[0192] It should be noted that, in this document, the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or apparatus. Without further limitations, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the process, method, article, or apparatus that includes that element. Furthermore, it should be noted that the scope of the methods and apparatuses in the embodiments of this application is not limited to performing functions in the order shown or discussed, but may also include performing functions substantially simultaneously or in the reverse order, depending on the functions involved. For example, the described methods may be performed in a different order than described, and various steps may be added, omitted, or combined. Additionally, features described with reference to certain examples may be combined in other examples.

[0193] Through the above description of the embodiments, those skilled in the art can clearly understand that the methods of the above embodiments can be implemented by means of software plus necessary general-purpose hardware platforms. Of course, they can also be implemented by hardware, but in many cases the former is a better implementation method. Based on this understanding, the technical solution of this application, in essence, or the part that contributes to the prior art, can be embodied in the form of a computer software product. This computer software product is stored in a storage medium (such as ROM / RAM, magnetic disk, optical disk) and includes several instructions to cause a terminal (which may be a mobile phone, computer, server, or network device, etc.) to execute the methods described in the various embodiments of this application.

[0194] The embodiments of this application have been described above with reference to the accompanying drawings. However, this application is not limited to the specific embodiments described above. The specific embodiments described above are merely illustrative and not restrictive. Those skilled in the art can make many other forms under the guidance of this application without departing from the spirit and scope of the claims, and all of these forms are within the protection scope of this application.

Images