Head display equipment, display method, device, equipment and medium

Abstract

The invention discloses head-mounted display equipment, a display method and device, equipment and a medium, and belongs to the technical field of computers. The head display device comprises a sensor which is located at the rear pillow part of a user, is electrically connected with a processor and is used for sensing parameters and sending the sensed parameters to the processor; the processor is used for determining the posture of the user based on the sensing parameters and moving a window displayed by the head display equipment from a first position to a second position matched with the second posture under the condition that the posture of the user is changed from the first posture to the second posture, and the first position is the position matched with the first posture.

Description

Technical Field

[0001] The present application belongs to the field of computer technology, and specifically relates to a head-mounted display device, display method, apparatus, equipment and medium. Background Art

[0002] With the development of Extended Reality (XR) devices, users' requirements for XR devices are getting higher and higher.

[0003] In the related art, the adjustment of the display window of the XR device depends on manual operation of the user, which is not convenient enough. Summary of the invention

[0004] The purpose of the embodiments of the present application is to provide a head-mounted display device, display method, apparatus, equipment and medium, which can automatically detect the posture of the user and automatically move the window displayed by the head-mounted display device to a position adapted to the user posture according to the user's posture, without the need for manual operation by the user, which is more convenient.

[0005] In a first aspect, an embodiment of the present application provides a head mounted display device, including:

[0006] The sensor is located at the back of the user's head and is electrically connected to the processor, and is used to collect sensing parameters and send the sensing parameters to the processor;

[0007] The processor is used to determine the user's posture based on the sensing parameters, and when the user's posture changes from a first posture to a second posture, move the window displayed by the head display device from a first position to a second position adapted to the second posture, wherein the first position is a position adapted to the first posture.

[0008] In a second aspect, an embodiment of the present application provides a display method, which is applied to a head display device, and the method includes:

[0009] Obtaining sensing parameters collected by a sensor of a head-mounted display device, where the sensor is located at the back of the user's head;

[0010] determining a user's posture based on the sensing parameters;

[0011] When the user's posture changes from a first posture to a second posture, the window displayed by the head display device is moved from a first position to a second position adapted to the second posture, and the first position is a position adapted to the first posture.

[0012] In a third aspect, an embodiment of the present application provides a display device, which is applied to a head-mounted display device, and the device includes:

[0013] An acquisition module is used to acquire sensing parameters collected by a sensor of a head display device, where the sensor is located at the back of the user's head;

[0014] A determination module, used to determine the user's posture based on the sensing parameters;

[0015] The moving module is used to move the window displayed by the head display device from a first position to a second position adapted to the second posture when the user's posture changes from a first posture to a second posture, and the first position is a position adapted to the first posture.

[0016] In a fourth aspect, an embodiment of the present application provides an electronic device, which includes a processor and a memory, wherein the memory stores programs or instructions that can be run on the processor, and when the program or instructions are executed by the processor, the steps of the method described in the first aspect are implemented.

[0017] In a fifth aspect, an embodiment of the present application provides a readable storage medium, on which a program or instruction is stored, and when the program or instruction is executed by a processor, the steps of the method described in the first aspect are implemented.

[0018] In a sixth aspect, an embodiment of the present application provides a chip, comprising a processor and a communication interface, wherein the communication interface is coupled to the processor, and the processor is used to run a program or instruction to implement the method described in the first aspect.

[0019] In a seventh aspect, an embodiment of the present application provides a computer program product, which is stored in a storage medium and is executed by at least one processor to implement the method described in the first aspect.

[0020] In the embodiment of the present application, the sensor located at the back of the user's head can collect sensing parameters, and the processor can determine the user's posture based on the sensing parameters, and when the user's posture changes from a first posture to a second posture, the window displayed by the head display device is moved from a first position adapted to the first posture to a second position adapted to the second posture. In this way, the head display device can automatically detect the user's posture, and according to the user's posture, automatically move the window displayed by the head display device to a position adapted to the user's posture, without the need for manual operation by the user, which is more convenient. BRIEF DESCRIPTION OF THE DRAWINGS

[0021] Figure 1 is one of the structural schematic diagrams of a head-mounted display device according to an exemplary embodiment;

[0022] Figure 2 is a second structural schematic diagram of a head-mounted display device according to an exemplary embodiment;

[0023] Figure 3 is one of the flowchart diagrams of a display method according to an exemplary embodiment;

[0024] Figure 4is a second flowchart diagram of a display method according to an exemplary embodiment;

[0025] Figure 5 is a structural block diagram of a display device according to an exemplary embodiment;

[0026] Figure 6 is a structural block diagram of an electronic device according to an exemplary embodiment;

[0027] Figure 7 A schematic diagram of the hardware structure of an electronic device to implement an embodiment of the present application. DETAILED DESCRIPTION

[0028] The following will be combined with the drawings in the embodiments of the present application to clearly describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, rather than all the embodiments. All other embodiments obtained by ordinary technicians in this field based on the embodiments in the present application belong to the scope of protection of this application.

[0029] The terms "first", "second", etc. in the specification and claims of the present application are used to distinguish similar objects, and are not used to describe a specific order or sequence. It should be understood that the data used in this way can be interchangeable under appropriate circumstances, so that the embodiments of the present application can be implemented in an order other than those illustrated or described here, and the objects distinguished by "first", "second", etc. are generally of one type, and the number of objects is not limited. For example, the first object can be one or more. In addition, "and / or" in the specification and claims represents at least one of the connected objects, and the character " / " generally indicates that the objects associated with each other are in an "or" relationship.

[0030] In order to facilitate understanding of the solutions of the present application, some terms involved in the embodiments of the present application are first explained.

[0031] XR devices: used to describe technologies that combine the real world and virtual environments, including virtual reality, augmented reality, and mixed reality. Virtual reality allows users to fully immerse themselves in a virtual environment, augmented reality overlays virtual elements onto the real environment, and mixed reality embeds virtual objects in the real world. XR is a general term that covers the overall concept of these technologies.

[0032] Inertial Measurement Unit sensor (IMU): An IMU sensor is a sensor that integrates an accelerometer and a gyroscope to measure the linear acceleration and angular velocity of an object. IMU sensors are commonly used in aircraft, automobiles, drones, sports tracking devices, and virtual reality to obtain the attitude, position, and motion information of an object.

[0033] Simultaneous Localization and Mapping (SLAM): refers to the process by which a robot uses sensors to self-locate in an environment and draw a map of the environment.

[0034] Head-mounted display: refers to a device that is worn on the head and placed in front of the eyes, usually used for experiences such as virtual reality and augmented reality. Head-mounted display devices usually consist of displays, tracking sensors and lenses, which allow users to see virtual images or augmented reality content. Through head-mounted display devices, users can immerse themselves in virtual environments or observe the superposition of virtual objects in the real world.

[0035] As mentioned in the background technology, with the development of XR devices, users have higher and higher requirements for XR devices.

[0036] In the related art, the adjustment of the display window of the XR device depends on manual operation of the user, which is not convenient enough.

[0037] The embodiments of the present application provide a head display device, a display method, an apparatus, a device and a medium. A sensor located at the back of the user's head can collect sensing parameters, and a processor can determine the user's posture based on the sensing parameters, and when the user's posture changes from a first posture to a second posture, the window displayed by the head display device is moved from a first position adapted to the first posture to a second position adapted to the second posture. In this way, the head display device can automatically detect the user's posture, and according to the user's posture, automatically move the window displayed by the head display device to a position adapted to the user's posture, without the need for manual operation by the user, which is more convenient.

[0038] In the following, in conjunction with the accompanying drawings, the head display device, display method, apparatus, equipment and medium provided in the embodiments of the present application are described in detail through specific embodiments and their application scenarios.

[0039] The display method provided in the embodiment of the present application can be applied to application scenarios where a user wears a head-mounted display device.

[0040] The display method provided in the embodiment of the present application can be executed by a head-mounted display device or a processor of the head-mounted display device.

[0041] Combine the following Figure 1 The head display device provided in the embodiment of the present application is described in detail.

[0042] Figure 1 It is a schematic structural diagram of a head-mounted display device according to an exemplary embodiment.

[0043] like Figure 1As shown, the head display device 100 may include: a sensor 110 and a processor 120.

[0044] The sensor 110 may be located at the back of the user's head, may be electrically connected to the processor 120, and may be used to collect sensing parameters and send the sensing parameters to the processor 120;

[0045] The processor 120 can be used to determine the user's posture based on the sensing parameters, and when the user's posture changes from a first posture to a second posture, move the window displayed by the head display device 100 from a first position to a second position adapted to the second posture.

[0046] The display content of the head-mounted display device of the XR device should change with the user's posture and head movement. Therefore, predicting the user's posture and adjusting the display content accordingly can improve the user experience. The industry currently uses posture sensors such as IMU and environmental positioning technologies such as SLAM to perceive head movement. This can sense the movement of the user's head in real time and provide basic data on space and movement for XR devices. However, the head-mounted display device has certain limitations in perception and cannot detect whether the user is in a lying position. After the user wearing the head-mounted display device lies down, if he wants to see the window displayed by the head-mounted display device, the user needs to manually operate and drag the window into the field of view, which is not convenient enough.

[0047] Here, the second posture may be a lying posture, and the first posture may be any posture except the lying posture, that is, a non-lying posture.

[0048] The first position may be a position adapted to the first posture. The second position may be a position adapted to the lying position.

[0049] The position adapted to the posture may be a position located in the central field of vision of the user when the user is in the posture.

[0050] Specifically, the state of the back of the head is different when the user is in a lying position and a non-lying position. Therefore, based on the sensing parameters collected by the sensor located at the back of the head, it can be determined whether the user's posture changes from other postures to a lying position. When the user changes from other postures to a lying position, in order to make the window within the user's field of vision, the window can be moved to a position suitable for the lying position.

[0051] Thus, the sensor located at the back of the user's head can collect sensing parameters, and the processor can determine the user's posture based on the sensing parameters, and when the user's posture changes from the first posture to the second posture, the window displayed by the head display device is moved from the first position adapted to the first posture to the second position adapted to the second posture. In this way, the head display device can automatically detect the user's posture, and automatically move the window displayed by the head display device to the position adapted to the user's posture according to the user's posture, without the need for manual operation by the user, which is more convenient.

[0052] In some embodiments, the head display device may include a main structure and a soft strap. The main structure may be provided with a camera, a posture sensor, a display, and a lens. The posture sensor may be a gyroscope.

[0053] In some embodiments, the sensing parameters may include pressure and / or light intensity, such as Figure 2 As shown, the above-mentioned sensors may include: a pressure sensor 111 and / or an optical sensor 112 .

[0054] Wherein, the pressure sensor 111 may be electrically connected to the processor and may be used to collect pressure;

[0055] The light sensor 112 may be electrically connected to the processor and may be used to collect light intensity.

[0056] Here, both the pressure sensor 111 and the light sensor 112 may be disposed inside the strap.

[0057] Specifically, when the user wears the head-mounted display device, the pressure sensor 111 can collect the pressure at the back of the user's head, and the light sensor 112 can collect the light intensity at the back of the user's head.

[0058] In this way, when the user wears the head-mounted display device, the pressure at the back of the user's head can be collected through the pressure sensor, and the light intensity at the back of the user's head can be collected through the light sensor. The user's posture can be determined more accurately through the pressure and light intensity at the back of the user's head.

[0059] It should be noted that the above-mentioned execution entities do not constitute a limitation on this application.

[0060] Combine the following Figure 3 The display method provided in the embodiment of the present application is described in detail.

[0061] Figure 3 The figure is a flow chart of a display method according to an exemplary embodiment.

[0062] like Figure 3 As shown, the display method may include the following steps:

[0063] Step 310: Acquire sensing parameters collected by sensors of the head mounted display device.

[0064] Here, when the user wears the head display device, the sensor is located at the back of the user's head. The sensing parameters can be used to determine the user's posture.

[0065] Step 320: Determine the user's posture based on the sensing parameters.

[0066] Specifically, based on the sensing parameters, it can be determined whether the user's posture changes from the first posture to the second posture.

[0067] In some embodiments, the sensing parameter may include pressure and / or light intensity, and step 320 may include:

[0068] When the sensing parameters meet the preset conditions, it is determined that the user's posture changes from the first posture to the second posture.

[0069] In addition, when the sensing parameter does not meet the preset condition, it can be determined that the user's posture has not changed to the second posture.

[0070] Here, when the user wears the head-mounted display device, the pressure may be the pressure at the back of the user's head, and the light intensity may be the light intensity at the back of the user's head.

[0071] Based on the pressure on the back of the user's head, it can be determined whether the back of the user's head is under force and the magnitude of the force. Based on the light intensity on the back of the user's head, it can be determined whether the back of the user's head is in contact with an object.

[0072] The preset conditions may include the pressure being within a first preset range and / or the light intensity being within a second preset range.

[0073] Specifically, when the sensing parameter includes pressure, if the pressure is within a first preset range, it can be determined that the user's posture has changed to the second posture; if the pressure is not within the first preset range, it can be determined that the user's posture has not changed to the second posture.

[0074] When the sensing parameter includes light intensity, if the light intensity is within the second preset range, it can be determined that the user's posture has changed to the second posture; if the light intensity is not within the second preset range, it can be determined that the user's posture has not changed to the second posture.

[0075] When the sensing parameters include pressure and light intensity, if the pressure is within a first preset range and the light intensity is within a second preset range, it can be determined that the user's posture has changed to the second posture; if the pressure is not within the first preset range and / or the light intensity is not within the second preset range, it can be determined that the user's posture has not changed to the second posture.

[0076] The first preset range and the second preset range can both be set according to actual needs.

[0077] For example, F=0kPa can be considered that the user's occipital region is not subjected to force, 0kPa<F≤10kPa can be considered that the user's occipital region is subjected to less force, and F>10kPa can be considered that the user's occipital region is subjected to greater force. Therefore, the first preset range can be F>10kPa, and 10kPa can be determined based on the weight of the head. F is pressure.

[0078] If L>50lux, it can be considered that the back of the user's head is not in contact with any object, and if L≤50lux, it can be considered that the back of the user's head is in contact with an object. Therefore, the second preset range can be L≤50lux. L is the light intensity.

[0079] In some examples, when the sensing parameters include pressure and light intensity, if the pressure is greater than 10 kPa and the light intensity is less than or equal to 50 lux, it can be determined that the user's posture has changed to a lying position; if the pressure is less than or equal to 10 kPa and / or the light intensity is greater than 50 lux, it can be determined that the user's posture has not changed to a lying position.

[0080] In this way, when the user wears the head display device, it is possible to more accurately determine whether the user's posture has changed to the second posture through the pressure on the back of the user's head and the light intensity on the back of the user's head.

[0081] In some implementations, step 320 may include:

[0082] Get the pitch angle of the head display device;

[0083] Based on the sensing parameters and pitch angle, the user's posture is determined.

[0084] Here, the pitch angle of the head display device can be collected through the posture sensor.

[0085] When the user is in the first posture and the second posture, the pitch angles of the head display device are different, so it can be determined based on the pitch angle of the head display device whether the user's posture changes from the first posture to the second posture.

[0086] In this way, the user's posture is determined based on the pressure and / or light intensity and further based on the pitch angle, which can improve the accuracy of determining the user's posture.

[0087] In some implementations, determining the user's posture based on the sensing parameters and the pitch angle may include:

[0088] When the sensing parameter meets the preset condition and the pitch angle is within a third preset range, it is determined that the user's posture changes from the first posture to the second posture.

[0089] In addition, when the sensing parameter does not satisfy the preset condition and / or the pitch angle is not within the third preset range, it can be determined that the user's posture has not changed to the second posture.

[0090] Here, the specific situation in which the sensing parameters meet the preset conditions can be referred to the above embodiments, which will not be described in detail here.

[0091] The third preset range can be set according to actual needs.

[0092] Exemplarily, -30°<A≤30° can be considered that the user is looking straight ahead, 30°<A≤90° can be considered that the user is looking up, and -90°≤A≤-30° can be considered that the user is looking down. Therefore, the third preset range can be 30°<A≤90°, where A is the pitch angle.

[0093] In some examples, when the sensing parameters include pressure and light intensity, if the pressure is greater than 10 kPa, the light intensity is less than or equal to 50 lux, and the pitch angle is 30°<90°, it can be determined that the user's posture has changed to a lying position; otherwise, it can be determined that the user's posture has not changed to a lying position.

[0094] In this way, the user's posture can be determined based on the sensing parameters and the pitch angle, further improving the accuracy of determining the user's posture.

[0095] Step 330: When the user's posture changes from the first posture to the second posture, the window displayed by the head display device is moved from the first position to a second position adapted to the second posture.

[0096] Here, the first position may be a position adapted to the first posture.

[0097] Exemplarily, when the user changes from other postures to a lying posture, the window may be moved upwards in order to locate the window within the user's central field of vision.

[0098] In some embodiments, moving the window displayed by the head mounted display device from the first position to the second position adapted to the second posture may include:

[0099] Determine the distance the window needs to move based on the pitch angle of the head display device;

[0100] The window is moved by the distance so that the window moves from the first position to the second position.

[0101] Here, the pitch angle of the head display device can be collected through the posture sensor.

[0102] Specifically, the distance the window needs to move can be calculated by the formula: d = k × A + C, where d is the distance the window needs to move, A is the pitch angle of the head display device, k is a preset coefficient, and C is a preset constant.

[0103] In this way, the distance the window needs to move can be accurately determined based on the pitch angle of the head display device to ensure that the window moves to a position that matches the user's posture.

[0104] Thus, the sensor located at the back of the user's head can collect sensing parameters, and the processor can determine the user's posture based on the sensing parameters, and when the user's posture changes from the first posture to the second posture, the window displayed by the head display device is moved from the first position adapted to the first posture to the second position adapted to the second posture. In this way, the head display device can automatically detect the user's posture, and automatically move the window displayed by the head display device to the position adapted to the user's posture according to the user's posture, without the need for manual operation by the user, which is more convenient.

[0105] In some implementations, after step 320, the method may further include:

[0106] When the user's posture changes from the first posture to the second posture and the head display device displays multimedia information, the multimedia information is magnified and displayed.

[0107] Here, the multimedia information may be a video or an image.

[0108] For example, when it is determined that the user's posture has changed to a lying position, if the head display device displays an image in a video or an album, it can switch to giant screen mode to enlarge and display the image in the video or album to facilitate immersive viewing for the user.

[0109] In this way, when the user's posture changes from the first posture to the second posture, the multimedia information can be automatically enlarged and displayed, so that the user can watch it immersively without the need for manual operation by the user.

[0110] During use, XR devices need to perform real-time scanning and algorithm calculations on the surrounding environment. The power consumption of related sensors and the real-time running of algorithms of the central processing unit (CPU) and graphics processing unit (GPU) will significantly increase the power consumption of XR devices, shorten the use time of XR devices, and reduce the user experience.

[0111] Based on this, in some implementations, after step 320, the method may further include:

[0112] When the user's posture changes from the first posture to the second posture, the target sensor is controlled to sleep.

[0113] Here, the target sensor may be a sensor that is not used when the user is in the second posture. The target sensor may include a sensor for collecting spatial data and / or a sensor for collecting motion data.

[0114] When the user's posture changes to the second posture, it can be considered that the target sensor will not be used in the next period of time, so the target sensor can be controlled to sleep.

[0115] For example, when the user's posture changes to a lying position, the low power consumption mode of the head display device can be automatically turned on, and target sensors associated with spatial computing and / or motion, such as a depth camera, a lidar and / or a grayscale camera, can be put into hibernation, thereby reducing the power consumption of the head display device from a hardware level.

[0116] In this way, when the user's posture changes to the second posture, the sensor used to collect spatial data and / or the sensor used to collect motion data can be controlled to sleep, which can reasonably reduce the hardware power consumption of the head-mounted display device, thereby more intelligently adjusting the balance between device performance, experience and battery life, extending the use time of the head-mounted display device and improving the user experience.

[0117] In addition, in some embodiments, after step 320, the method may further include:

[0118] When the user's posture changes from the first posture to the second posture, the control processor stops executing the target algorithm.

[0119] Here, the target algorithm may be an algorithm that is not used when the user is in the second posture. The target algorithm may include an algorithm related to the target sensor.

[0120] The processor may include a CPU and / or a GPU.

[0121] When the user's posture changes to the second posture, it can be considered that the target algorithm will not be used in the next period of time, so the processor can be controlled to stop executing the target algorithm.

[0122] Exemplarily, after the above-mentioned target sensor is put into sleep mode, the processor can also be controlled to stop executing algorithms related to the above-mentioned target sensor, such as: SLAM spatial calculation, safety zone and / or automatic modeling algorithms, thereby reducing the operating load of the CPU and GPU of the XR device and reducing the power consumption of the XR device from the software level.

[0123] In this way, when the user's posture changes to the second posture, the control processor stops executing the algorithm related to the above-mentioned target sensor, which can reasonably reduce the processor power consumption of the head-mounted display device, thereby being able to more intelligently adjust the balance between device performance, experience and battery life, extend the use time of the head-mounted display device, and improve user experience.

[0124] In order to better describe the entire solution, based on the above embodiments, a specific example is given. Figure 4 As shown, the display method may include steps 401 to 405, which are explained in detail below.

[0125] Step 401, obtaining the pressure, light intensity and pitch angle collected by the sensor of the head display device.

[0126] Step 402, determining whether the pressure is within a first preset range, the light intensity is within a second preset range, and the pitch angle is within a third preset range.

[0127] If yes, execute step 403; if no, return to execute step 401.

[0128] Step 403: determine that the user's posture changes to a lying position.

[0129] Step 404: determine a distance that the window displayed by the head mounted display device needs to move based on the pitch angle.

[0130] Step 405 , moving the window by the distance, controlling the target sensor to sleep, and controlling the processor to stop executing the target algorithm related to the target sensor.

[0131] In the embodiment of the present application, the leaning behavior of the user's head can be detected by the pressure sensor and the light sensor, and the posture sensor and the camera can be used to predict and evaluate the posture and head movement of the user. Through the comprehensive processing and analysis of the states and values ​​of the pressure sensor, the light sensor and the posture sensor, the leaning behavior of the user's head can be detected, identified and analyzed while the user is wearing the head display device, so as to dynamically adjust the virtual display content to enhance the user's virtual reality experience. It is also possible to dynamically adjust the display content according to the user's actual actions and behaviors, as well as the prediction of the user's actions and behaviors, to achieve a more immersive virtual reality experience, and bring a more realistic and smooth visual experience to the user.

[0132] Specifically, by combining multiple sensors to comprehensively predict the user's current state and behavior pattern, the corresponding adjustment of the displayed content is achieved to enhance the user's virtual reality experience; according to the user's actual actions and behaviors, as well as the prediction of the user's actions and behaviors, the displayed content is dynamically adjusted to match the user's posture, thereby providing a more comfortable and immersive virtual reality experience, bringing the user a more realistic and smooth visual experience; according to the user's behavior patterns such as leaning on or watching movies, the specific algorithm is down-clocked or energy-saving, reducing the overall energy consumption of the device, improving battery life, system performance and component life. In short, the embodiments of the present application can improve the intelligence and adaptability of virtual reality devices, and bring users a more comfortable, convenient and personalized virtual reality experience.

[0133] The display method provided in the embodiment of the present application can be executed by a display device. In the embodiment of the present application, the display method is executed by a display device as an example to illustrate the display device provided in the embodiment of the present application.

[0134] Based on the same inventive concept, the present application also provides a display device. Figure 5 The display device provided in the embodiment of the present application is described in detail.

[0135] Figure 5 is a structural block diagram of a display device according to an exemplary embodiment.

[0136] like Figure 5 As shown, the display device 500 can be applied to a head display device, and the display device 500 can include:

[0137] An acquisition module 501 is used to acquire sensing parameters collected by a sensor of a head display device, where the sensor is located at the back of the user's head;

[0138] A determination module 502, configured to determine a user's posture based on the sensing parameters;

[0139] The moving module 503 is used to move the window displayed by the head display device from a first position to a second position adapted to the second posture when the user's posture changes from a first posture to a second posture, and the first position is a position adapted to the first posture.

[0140] The display device 500 is described in detail below, as follows:

[0141] In one embodiment, the sensing parameter includes pressure and / or light intensity, and the determination module 502 may include:

[0142] The first determination submodule is used to determine that the user's posture changes from the first posture to the second posture when the sensing parameter meets the preset conditions, and the preset conditions include that the pressure parameter is within the first preset range and / or the light intensity is within the second preset range.

[0143] In one embodiment, the determination module 502 may include:

[0144] The first acquisition submodule is used to acquire the pitch angle of the head display device;

[0145] The second determination submodule is used to determine the user's posture based on the sensing parameters and the pitch angle.

[0146] In one embodiment, the second determining submodule may include:

[0147] The determination unit is used to determine that the user's posture changes from the first posture to the second posture when the sensing parameter meets the preset condition and the pitch angle is within a third preset range.

[0148] In one embodiment, the moving module 503 may include:

[0149] A third determination submodule is used to determine the distance the window needs to move based on the pitch angle of the head display device;

[0150] The moving submodule is used to move the window by a distance so that the window moves from a first position to a second position.

[0151] In one embodiment, the display device 500 may further include:

[0152] The display module is used to enlarge and display the multimedia information when the user's posture changes from the first posture to the second posture and the head display device displays the multimedia information.

[0153] In one embodiment, the display device 500 may further include:

[0154] The sleep module is used to control the target sensor when the user's posture changes from the first posture to the second posture. The target sensor includes a sensor for collecting spatial data and / or a sensor for collecting motion data.

[0155] Thus, the sensor located at the back of the user's head can collect sensing parameters, and the processor can determine the user's posture based on the sensing parameters, and when the user's posture changes from the first posture to the second posture, the window displayed by the head display device is moved from the first position adapted to the first posture to the second position adapted to the second posture. In this way, the head display device can automatically detect the user's posture, and automatically move the window displayed by the head display device to the position adapted to the user's posture according to the user's posture, without the need for manual operation by the user, which is more convenient.

[0156] The display device in the embodiment of the present application can be an electronic device or a component in the electronic device, such as an integrated circuit or a chip. The electronic device can be a terminal or other devices other than a terminal. Exemplarily, the electronic device can be a mobile phone, a tablet computer, a laptop computer, a PDA, a vehicle-mounted electronic device, a mobile Internet device (Mobile Internet Device, MID), an augmented reality (augmented reality, AR) / virtual reality (virtual reality, VR) device, a robot, a wearable device, an ultra-mobile personal computer (ultra-mobile personal computer, UMPC), a netbook or a personal digital assistant (personal digital assistant, PDA), etc., and can also be a server, a network attached storage (Network Attached Storage, NAS), a personal computer (personal computer, PC), a television (television, TV), a teller machine or a self-service machine, etc., which is not specifically limited in the embodiment of the present application.

[0157] The display device in the embodiment of the present application may be a device having an operating system. The operating system may be an Android operating system, an iOS operating system, or other possible operating systems, which are not specifically limited in the embodiment of the present application.

[0158] The display device provided in the embodiment of the present application can achieve Figure 3-4 The various processes implemented in the method embodiment achieve the same technical effect and will not be described again here to avoid repetition.

[0159] In some embodiments, Figure 6 As shown, an embodiment of the present application also provides an electronic device 600, including a processor 601 and a memory 602, wherein the memory 602 stores programs or instructions that can be executed on the processor 601, and when the program or instructions are executed by the processor 601, the various steps of the above-mentioned display method embodiment are implemented, and the same technical effect can be achieved. To avoid repetition, they are not described here.

[0160] It should be noted that the electronic devices in the embodiments of the present application include the mobile electronic devices and non-mobile electronic devices mentioned above.

[0161] Figure 7 A schematic diagram of the hardware structure of an electronic device to implement an embodiment of the present application.

[0162] The electronic device 700 includes but is not limited to: a radio frequency unit 701, a network module 702, an audio output unit 703, an input unit 704, a sensor 705, a display unit 706, a user input unit 707, an interface unit 708, a memory 709, and a processor 710.

[0163] Those skilled in the art will appreciate that the electronic device 700 may also include a power source (such as a battery) for supplying power to each component, and the power source may be logically connected to the processor 710 through a power management system, thereby implementing functions such as managing charging, discharging, and power consumption management through the power management system. Figure 7 The electronic device structure shown in the figure does not constitute a limitation on the electronic device. The electronic device may include more or fewer components than shown in the figure, or combine certain components, or arrange the components differently, which will not be described in detail here.

[0164] The processor 710 is used to obtain sensing parameters collected by a sensor of the head display device, where the sensor is located at the back of the user's head;

[0165] determining a user's posture based on the sensing parameters;

[0166] When the user's posture changes from a first posture to a second posture, the window displayed by the head display device is moved from a first position to a second position adapted to the second posture, and the first position is a position adapted to the first posture.

[0167] Thus, the sensor located at the back of the user's head can collect sensing parameters, and the processor can determine the user's posture based on the sensing parameters, and when the user's posture changes from the first posture to the second posture, the window displayed by the head display device is moved from the first position adapted to the first posture to the second position adapted to the second posture. In this way, the head display device can automatically detect the user's posture, and automatically move the window displayed by the head display device to the position adapted to the user's posture according to the user's posture, without the need for manual operation by the user, which is more convenient.

[0168] In some embodiments, the processor 710 is further used to determine that the user's posture changes from a first posture to a second posture when the sensing parameters meet preset conditions, and the preset conditions include that the pressure parameter is within a first preset range and / or the light intensity is within a second preset range.

[0169] In this way, when the user wears the head display device, it is possible to more accurately determine whether the user's posture has changed to the second posture through the pressure on the back of the user's head and the light intensity on the back of the user's head.

[0170] In some embodiments, the processor 710 is further configured to obtain a pitch angle of the head display device;

[0171] Based on the sensing parameters and pitch angle, the user's posture is determined.

[0172] In this way, the user's posture is determined based on the pressure and / or light intensity and further based on the pitch angle, which can improve the accuracy of determining the user's posture.

[0173] In some embodiments, the processor 710 is further configured to determine that the user's posture changes from the first posture to the second posture when the sensing parameter meets a preset condition and the pitch angle is within a third preset range.

[0174] In this way, the user's posture can be determined based on the sensing parameters and the pitch angle, further improving the accuracy of determining the user's posture.

[0175] In some embodiments, the processor 710 is further configured to determine a distance that the window needs to move based on a pitch angle of the head display device;

[0176] The window is moved by the distance so that the window moves from the first position to the second position.

[0177] In this way, the distance the window needs to move can be accurately determined based on the pitch angle of the head display device to ensure that the window moves to a position that matches the user's posture.

[0178] In some embodiments, the display unit 706 is used to enlarge and display the multimedia information when the user's posture changes from the first posture to the second posture and the head display device displays the multimedia information.

[0179] In this way, when the user's posture changes from the first posture to the second posture, the multimedia information can be automatically enlarged and displayed, so that the user can watch it immersively without the need for manual operation by the user.

[0180] In some embodiments, the processor 710 is further used to control the target sensor to sleep when the user's posture changes from the first posture to the second posture, and the target sensor includes a sensor for collecting spatial data and / or a sensor for collecting motion data.

[0181] In this way, when the user's posture changes to the second posture, the sensor used to collect spatial data and / or the sensor used to collect motion data can be controlled to sleep, which can reasonably reduce the hardware power consumption of the head-mounted display device, thereby more intelligently adjusting the balance between device performance, experience and battery life, extending the use time of the head-mounted display device and improving the user experience.

[0182] It should be understood that in the embodiment of the present application, the input unit 704 may include a graphics processor (Graphics Processing Unit, GPU) 7041 and a microphone 7042, and the graphics processor 7041 processes the image data of the static picture or video obtained by the image capture device (such as a camera) in the video capture mode or the image capture mode. The display unit 706 may include a display panel 7061, and the display panel 7061 may be configured in the form of a liquid crystal display, an organic light emitting diode, etc. The user input unit 707 includes a touch panel 7071 and at least one of other input devices 7072. The touch panel 7071 is also called a touch screen. The touch panel 7071 may include two parts: a touch detection device and a touch controller. Other input devices 7072 may include, but are not limited to, a physical keyboard, function keys (such as volume control keys, switch keys, etc.), a trackball, a mouse, and a joystick, which will not be repeated here.

[0183] The memory 709 can be used to store software programs and various data. The memory 709 may mainly include a first storage area for storing programs or instructions and a second storage area for storing data, wherein the first storage area may store an operating system, an application program or instructions required for at least one function (such as a sound playback function, an image playback function, etc.), etc. In addition, the memory 709 may include a volatile memory or a non-volatile memory, or the memory 709 may include both volatile and non-volatile memories. Among them, the non-volatile memory may be a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), or a flash memory. The volatile memory may be a random access memory (RAM), a static random access memory (SRAM), a dynamic random access memory (DRAM), a synchronous dynamic random access memory (SDRAM), a double data rate synchronous dynamic random access memory (DDRSDRAM), an enhanced synchronous dynamic random access memory (ESDRAM), a synchronous link dynamic random access memory (SLDRAM) and a direct memory bus random access memory (DRRAM). The memory 709 in the embodiment of the present application includes but is not limited to these and any other suitable types of memory.

[0184] The processor 710 may include one or more processing units; in some embodiments, the processor 710 integrates an application processor and a modem processor, wherein the application processor mainly processes operations related to an operating system, a user interface, and application programs, and the modem processor mainly processes wireless communication signals, such as a baseband processor. It is understandable that the modem processor may not be integrated into the processor 710.

[0185] An embodiment of the present application also provides a readable storage medium, on which a program or instruction is stored. When the program or instruction is executed by a processor, each process of the above-mentioned display method embodiment is implemented, and the same technical effect can be achieved. To avoid repetition, it will not be repeated here.

[0186] The processor is the processor in the electronic device described in the above embodiment. The readable storage medium includes a computer readable storage medium, such as a computer read-only memory, a random access memory, a magnetic disk or an optical disk.

[0187] An embodiment of the present application further provides a chip, which includes a processor and a communication interface, wherein the communication interface is coupled to the processor, and the processor is used to run programs or instructions to implement the various processes of the above-mentioned display method embodiment, and can achieve the same technical effect. To avoid repetition, it will not be repeated here.

[0188] It should be understood that the chip mentioned in the embodiments of the present application can also be called a system-level chip, a system chip, a chip system or a system-on-chip chip, etc.

[0189] An embodiment of the present application provides a computer program product, which is stored in a storage medium. The program product is executed by at least one processor to implement the various processes of the above-mentioned display method embodiment and can achieve the same technical effect. To avoid repetition, it will not be repeated here.

[0190] It should be noted that, in this article, the terms "comprise", "include" or any other variant thereof are intended to cover non-exclusive inclusion, so that the process, method, article or device including a series of elements includes not only those elements, but also includes other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, the elements defined by the sentence "comprise one..." do not exclude the presence of other identical elements in the process, method, article or device including the element. In addition, it should be pointed out that the scope of the methods and devices in the embodiments of the present application is not limited to performing functions in the order shown or discussed, and may also include performing functions in a substantially simultaneous manner or in reverse order according to the functions involved, for example, the described method may be performed in an order different from that described, and various steps may also be added, omitted, or combined. In addition, the features described with reference to certain examples may be combined in other examples.

[0191] Through the description of the above implementation methods, those skilled in the art can clearly understand that the above-mentioned embodiment methods can be implemented by means of software plus a necessary general hardware platform, and of course by hardware, but in many cases the former is a better implementation method. Based on such an understanding, the technical solution of the present application, or the part that contributes to the prior art, can be embodied in the form of a computer software product, which is stored in a storage medium (such as ROM / RAM, a disk, or an optical disk), and includes a number of instructions for a terminal (which can be a mobile phone, a computer, a server, or a network device, etc.) to execute the methods described in each embodiment of the present application.

[0192] The embodiments of the present application are described above in conjunction with the accompanying drawings, but the present application is not limited to the above-mentioned specific implementation methods. The above-mentioned specific implementation methods are merely illustrative and not restrictive. Under the guidance of the present application, ordinary technicians in this field can also make many forms without departing from the purpose of the present application and the scope of protection of the claims, all of which are within the protection of the present application.

Claims

1. A head mounted display device, characterized in that: include: A sensor, located at the back of the user's head, electrically connected to the processor, and used to collect sensing parameters and send the sensing parameters to the processor; The processor is used to determine the user's posture based on the sensing parameters, and when the user's posture changes from a first posture to a second posture, move the window displayed by the head display device from a first position to a second position adapted to the second posture, and the first position is a position adapted to the first posture.

2. The head mounted display device according to claim 1, characterized in that: The sensing parameter includes pressure and / or light intensity; the sensor includes: A pressure sensor, electrically connected to the processor, for collecting the pressure; and / or, A light sensor is electrically connected to the processor and is used to collect the light intensity.

3. A display method, characterized in that: Applied to a head-mounted display device, the method comprises: Acquire sensing parameters collected by a sensor of the head display device, where the sensor is located at the back of the user's head; determining the user's posture based on the sensing parameters; When the user's posture changes from a first posture to a second posture, the window displayed by the head display device is moved from a first position to a second position adapted to the second posture, and the first position is a position adapted to the first posture.

4. The method according to claim 3, characterized in that The sensing parameters include pressure and / or light intensity, and determining the user's posture based on the sensing parameters includes: When the sensing parameter satisfies a preset condition, it is determined that the user's posture changes from the first posture to the second posture, and the preset condition includes that the pressure parameter is within a first preset range and / or the light intensity is within a second preset range.

5. The method according to claim 4, characterized in that The determining the user's posture based on the sensing parameters comprises: Obtaining the pitch angle of the head display device; Based on the sensing parameters and the pitch angle, a posture of the user is determined.

6. The method according to claim 5, characterized in that The determining the user's posture based on the sensing parameter and the pitch angle includes: When the sensing parameter satisfies the preset condition and the pitch angle is within a third preset range, it is determined that the user's posture changes from the first posture to the second posture.

7. The method according to any one of claims 3 to 6, characterized in that: The step of moving the window displayed by the head mounted display device from a first position to a second position adapted to the second posture comprises: Determining a distance that the window needs to move based on a pitch angle of the head display device; The window is moved by the distance so that the window moves from the first position to the second position.

8. The method according to any one of claims 3 to 6, characterized in that: The method further comprises: When the user's posture changes from the first posture to the second posture and the head display device displays multimedia information, the multimedia information is enlarged and displayed.

9. The method according to any one of claims 3 to 6, characterized in that: The method further comprises: When the posture of the user changes from the first posture to the second posture, a target sensor is controlled to be dormant, wherein the target sensor includes a sensor for collecting spatial data and / or a sensor for collecting motion data.

10. A display device, characterized in that: Applied to head-mounted display devices, including: An acquisition module, used for acquiring sensing parameters collected by a sensor of the head display device, wherein the sensor is located at the back of the user's head; a determination module, configured to determine the user's posture based on the sensing parameters; A moving module is used to move the window displayed by the head display device from a first position to a second position adapted to the second posture when the user's posture changes from a first posture to a second posture, and the first position is a position adapted to the first posture.

11. The device according to claim 10, characterized in that The sensing parameter includes pressure and / or light intensity, and the determination module includes: The first determination submodule is used to determine that the user's posture changes from the first posture to the second posture when the sensing parameter meets a preset condition, and the preset condition includes that the pressure parameter is within a first preset range and / or the light intensity is within a second preset range.

12. The device according to claim 11, characterized in that The determination module comprises: A first acquisition submodule is used to acquire the pitch angle of the head display device; The second determination submodule is used to determine the user's posture based on the sensing parameter and the pitch angle.

13. The device according to claim 12, characterized in that The second determining submodule includes: A determination unit is configured to determine that the user's posture changes from the first posture to the second posture when the sensing parameter satisfies the preset condition and the pitch angle is within a third preset range.

14. The device according to any one of claims 10 to 13, characterized in that The mobile module comprises: A third determination submodule, configured to determine a distance that the window needs to move based on a pitch angle of the head display device; The moving submodule is used to move the window by the distance so that the window moves from the first position to the second position.

15. The device according to any one of claims 10 to 13, characterized in that The device also includes: The display module is used for amplifying and displaying the multimedia information when the posture of the user changes from the first posture to the second posture and the head display device displays the multimedia information.

16. The device according to any one of claims 10 to 13, characterized in that The device also includes: The sleep module is used to control the target sensor to sleep when the user's posture changes from the first posture to the second posture. The target sensor includes a sensor for collecting spatial data and / or a sensor for collecting motion data.

17. An electronic device, characterized in that: It comprises a processor and a memory, wherein the memory stores a program or instruction that can be run on the processor, and when the program or instruction is executed by the processor, the steps of the display method according to any one of claims 3 to 9 are implemented.

18. A readable storage medium, characterized in that: The readable storage medium stores a program or instruction, and when the program or instruction is executed by the processor, the steps of the display method according to any one of claims 3 to 9 are implemented.

Images