VR display method, device, electronic device, and readable storage medium

Abstract

The application discloses a VR display method and device, electronic equipment and readable storage medium, and belongs to the VR technical field. The method comprises the following steps: in the case that the time length of the head of a user deviating from a first posture reaches a preset time length is detected, a focus area of the user on a VR picture is determined; the display position of the focus area is kept unchanged, and the non-focus area of the VR picture except the focus area is controlled to move along a first direction until it is detected that the head of the user is in the first posture; wherein the first direction is opposite to a second direction, and the second direction is the deviating direction of the head of the user relative to the first posture; wherein the first posture is a correct guide posture of wearing a VR device.

Description

Technical Field

[0001] This application belongs to the field of VR technology, specifically relating to a VR display method, device, electronic device, and readable storage medium. Background Technology

[0002] With the rapid development of the electronics industry, the application of virtual reality (VR) devices is becoming increasingly widespread.

[0003] For VR device users, because VR devices can provide a deeply immersive virtual reality experience, users may maintain the same posture for a long time, such as looking up or down, due to being immersed in the virtual content displayed by the VR device. As a result, VR device users may experience neck discomfort due to incorrect posture when using VR devices. Summary of the Invention

[0004] The purpose of this application is to provide a VR display method, device, electronic device, and readable storage medium that can solve the problem of neck discomfort that may occur to users of VR devices due to incorrect posture when using VR devices.

[0005] In a first aspect, embodiments of this application provide a VR display method, which includes: when the duration of time during which the user's head deviates from a first posture reaches a preset duration, determining the focus area of ​​the user on the VR screen of the VR device; keeping the display position of the focus area unchanged, and controlling the non-focus area in the VR screen other than the focus area to move along a first direction until the user's head is detected to be in the first posture; wherein, the first direction is opposite to the second direction, the second direction is the deviation direction of the user's head relative to the first posture, and the first posture is the correct guidance posture for wearing the VR device.

[0006] Secondly, embodiments of this application provide a VR display device, which may include a detection module, a determination module, and a control module. The determination module is used to determine the focus area of ​​the user on the VR screen of the VR device when the detection module detects that the user's head has deviated from a first posture for a preset duration. The control module is used to maintain the display position of the focus area unchanged and control the non-focus areas in the VR screen, excluding the focus area, to move along a first direction until the detection module detects that the user's head is in the first posture. The first direction is opposite to the second direction, where the second direction is the direction of deviation of the user's head relative to the first posture, and the first posture is the correct guidance posture for wearing the VR device.

[0007] Thirdly, embodiments of this application provide an electronic device including a processor and a memory, wherein the memory stores programs or instructions executable on the processor, and the programs or instructions, when executed by the processor, implement the steps of the method described in the first aspect.

[0008] Fourthly, embodiments of this application provide a readable storage medium on which a program or instructions are stored, which, when executed by a processor, implement the steps of the method described in the first aspect.

[0009] Fifthly, embodiments of this application provide a chip, the chip including a processor and a communication interface, the communication interface being coupled to the processor, the processor being used to run programs or instructions to implement the method as described in the first aspect.

[0010] In a sixth aspect, embodiments of this application provide a computer program product stored in a storage medium, which is executed by at least one processor to implement the method described in the first aspect.

[0011] In this embodiment, if the user's head deviates from the first posture for a preset duration, the focus area of ​​the user on the VR screen of the VR device can be determined; the display position of the focus area remains unchanged, and the non-focus areas in the VR screen other than the focus area are controlled to move along a first direction until the user's head is detected to be in the first posture; wherein, the first direction is determined by a first head posture; wherein, the first posture is the correct guidance posture for wearing the VR device. Through this solution, during the user's use of the VR device, since the display position of the user's focus area on the VR screen can remain unchanged when the user's head deviates from the first posture for a long time, and the non-focus areas are controlled to move in the opposite direction of the deviation direction (i.e., the first direction), the user's head can be reflexively moved in the first direction along with the non-focus areas, thus allowing the user's head to return to the first posture, thereby avoiding neck discomfort caused by incorrect posture when using the VR device. Attached Figure Description

[0012] Figure 1 This is one of the illustrations of a user wearing a VR device;

[0013] Figure 2 This is one of the diagrams illustrating the relationship between a user's eyes and the VR screen displayed on the VR device when the user is wearing it.

[0014] Figure 3 This is the second illustration of a user wearing a VR device;

[0015] Figure 4This is the second illustration showing the relationship between a user's eyes and the VR screen displayed on the VR device when the user is wearing it.

[0016] Figure 5 This is a flowchart illustrating the VR display method provided in an embodiment of this application;

[0017] Figure 6 This is one of the interface diagrams illustrating the application of the VR display method provided in this embodiment;

[0018] Figure 7 This is a second schematic diagram of the interface for the VR display method provided in this application embodiment;

[0019] Figure 8 This is a schematic diagram of the structure of the VR display device provided in the embodiments of this application;

[0020] Figure 9 This is one of the structural schematic diagrams of the electronic device provided in the embodiments of this application;

[0021] Figure 10 This is the second schematic diagram of the structure of the electronic device provided in the embodiments of this application. Detailed Implementation

[0022] The technical solutions of the embodiments of this application will be clearly described below with reference to the accompanying drawings. Obviously, the described embodiments are only some, not all, of the embodiments of this application. All other embodiments obtained by those skilled in the art based on the embodiments of this application are within the scope of protection of this application.

[0023] The terms "first," "second," etc., used in the specification and claims of this application are used to distinguish similar objects and not to describe a specific order or sequence. It should be understood that such use of data can be interchanged where appropriate so that embodiments of this application can be implemented in orders other than those illustrated or described herein, and the objects distinguished by "first," "second," etc., are generally of the same class and the number of objects is not limited; for example, a first object can be one or more. Furthermore, in the specification and claims, "and / or" indicates at least one of the connected objects, and the character " / " generally indicates that the preceding and following objects are in an "or" relationship.

[0024] The VR display method, apparatus, electronic device, and readable storage medium provided in this application will be described in detail below with reference to the accompanying drawings and through specific embodiments and application scenarios.

[0025] Currently, when users use VR devices, Figure 1 This is a diagram illustrating the relationship between the user's head and the VR device when the user's head is in the initial position. Figure 2As shown, when the user's head is in the first posture, the user's eyes are looking directly at the VR screen displayed on the VR device.

[0026] With the development of VR technology, VR devices can usually adapt to multiple display methods, such as the High Definition Multimedia Interface (HDM) display method 1 proposed by Apple. Under this display method 1, the VR screen displayed by the VR device will adjust the display position according to the position of the user's head.

[0027] Furthermore, in display mode 1, such as Figure 3 and Figure 4 As shown, when a user looks up, the VR screen changes its display position according to the user's head posture; that is, when the user looks up, the VR screen also displays upwards. However, if a user remains in a head-up position for an extended period, it can lead to neck fatigue if the user is immersed in the current experience and maintains this posture for too long. Over time, this can cause cervical spine problems and other health issues.

[0028] Therefore, how to correct the user's head posture during the use of VR devices to avoid neck discomfort is an urgent problem to be solved.

[0029] Specifically, in the VR display method provided in this application embodiment, when the duration of time during which the user's head deviates from the first posture reaches a preset duration, the focus area of ​​the user on the VR screen is determined; and the display position of the focus area remains unchanged, while the non-focus area in the VR screen other than the focus area is controlled to move along a first direction until the user's head is detected to be in the first posture; wherein, the first direction is opposite to the second direction, and the second direction is the direction of deviation of the user's head relative to the first posture; the first posture is the correct guidance posture for wearing the VR device. Thus, since the display position of the non-focus area in the VR screen can be automatically adjusted when the user's head is detected to deviate from the first posture for a long time, such as in a head-up, head-down, head-tilt, or head-up posture, the user's neck angle can be adjusted through conditioned reflex, thereby avoiding neck discomfort caused by using the VR device and improving the user's experience of using the VR device.

[0030] This application provides a VR display method. Figure 5 This application provides a possible flowchart illustrating a VR display method according to an embodiment. Figure 5 As shown, the VR display method provided in this application embodiment may include the following steps 501 and 502. The following illustration uses a VR device executing this method as an example.

[0031] Step 501: When the VR device detects that the user's head has deviated from the first posture for a preset duration, it determines the user's focus area on the VR screen of the VR device.

[0032] The first posture is the correct and guided posture for wearing VR devices, and can be referred to as the comfortable posture for wearing VR devices.

[0033] The first posture in this application embodiment may include: a horizontal posture with the user standing and looking straight ahead, a posture with the target facing upward while lying down, and a posture with the head tucked in while riding a bicycle, etc.

[0034] Specifically, when the first posture is a horizontal posture with the user standing and looking straight ahead, the first posture is defined as the posture of the user's head when the user's head symmetry line coincides with the user's body symmetry line. The user's head symmetry line can be represented by the user's facial symmetry line.

[0035] Understandably, VR devices can first identify the user's current situation, such as standing, lying down, sitting, or riding a bicycle; based on the situation, they can determine whether the user's head has deviated from the initial posture.

[0036] Optionally, the VR device can use any method in the existing technology to identify the user's environment. For example, it can determine whether the user is standing, lying down, or sitting based on the relative position of the VR device to the ground, sky, plants, buildings, or ceiling. Alternatively, the VR device can determine whether the user is riding a bicycle based on the movement speed of the VR device.

[0037] Optionally, the VR device can detect whether the user's head deviates from the first posture in any possible way available in the prior art. For example, it can detect whether the user's head deviates from the first posture by detecting the angle or distance between the user's head and body, or the angle between the user's head and the horizontal plane. The specific method can be determined according to actual usage needs, and this application embodiment does not limit it.

[0038] It is understandable that VR devices can intermittently detect whether the user's head deviates from the first posture. If the user's head is detected to deviate from the first posture, the device will continue to monitor the duration of the deviation, that is, the duration the user maintains in each deviation posture, such as the duration the user looks down. When the duration of the user in a deviation posture reaches a preset duration, the VR device can determine the user's focus area in the VR screen.

[0039] In this embodiment, the VR screen is the screen displayed by the VR device.

[0040] In this embodiment, the user's focus area on the VR screen is specifically the area where the user's eyes are focused on the VR screen.

[0041] Optionally, the preset duration can be either the default duration of the VR device or a user-defined duration.

[0042] Optionally, the preset duration can be any possible duration such as 30 seconds, 1 minute, 5 minutes, or 10 minutes.

[0043] Optionally, step 501 can be implemented through steps 501a and 501b below.

[0044] Step 501a: When the VR device detects that the user's head has deviated from the first posture for a preset duration, it acquires an image of the user's eyes.

[0045] Step 501b: The VR device determines the user's focus area in the VR screen based on the eye feature information in the eye image.

[0046] Alternatively, the VR device can capture images of the user's eyes using a visible light camera or an infrared camera within the VR device.

[0047] Optionally, the VR device can determine the user's gaze direction based on eye feature information in the eye image, so that the VR device can determine the area in the VR screen located in that gaze direction as the user's focus area.

[0048] Optionally, the eye feature information may include the location information of the pupil in the eye image.

[0049] It should be noted that the method for VR devices to determine the user's gaze direction based on eye images can refer to existing technologies, such as inputting eye images into a gaze direction training model to output the user's gaze direction.

[0050] Of course, in practice, eye images can also be directly input into the gaze region training model to output information indicating the user's focus area in the VR screen.

[0051] Thus, since the eye feature information in the eye image can indicate the user's gaze direction, the user's focus area in the VR screen can be accurately determined based on the eye feature information.

[0052] The following explanation uses the first posture—a horizontal posture where the user is standing and looking straight ahead—as an example to illustrate how VR devices can detect whether the user's head deviates from the first posture. Specifically, it will be explained using possible implementations 1 and 2.

[0053] The first possible approach:

[0054] Normally, when a user's head is in the first posture, their eyes are looking straight ahead, i.e., level. Therefore, by observing the position of the pupils in the eye image, it can be determined whether the user's head has deviated from the first posture.

[0055] Specifically, VR devices can capture images of the user's eyes using their cameras, and determine whether the user's head has deviated from a first posture based on a comparison between the pupil position information in the image and preset pupil position information. The preset pupil position information indicates the position of the pupil in the eye image when the user's head is in the first posture.

[0056] For example, if the pupil position information in the eye image is located above the preset pupil position, it means that the user's head is shifted upward relative to the first posture, that is, the user's head is in a head-up posture.

[0057] If the pupil position information in the eye image is located below the preset pupil position, it indicates that the user's head is shifted downwards relative to the first posture, meaning the user's head is in a head-down posture.

[0058] If the pupil position information in the eye image is located to the left of the preset pupil position, it means that the user's head is turned to the left relative to the first posture, that is, the user's head is in a posture of turning to the left.

[0059] If the pupil position information in the eye image is located to the right of the preset pupil position, it indicates that the user's head is turned to the right relative to the first posture, that is, the user's head is in a posture of turning to the right.

[0060] Of course, in actual implementation, VR devices can also determine the angle between the line connecting the user's eyes and the horizontal plane based on the user's eye image, and determine whether the user is in a head-tilting posture, such as tilting their head to the left or to the right.

[0061] The second possible way

[0062] Optionally, the VR device can acquire the motion parameters of the user's head and, based on these motion parameters, determine whether the user's head has deviated from the initial posture. These motion parameters may include: the user's head motion angle, the user's head motion speed, the user's head motion acceleration, and the user's head motion trajectory.

[0063] Optionally, the VR device can obtain the motion parameters of the user's head through a speed sensor in the VR device, such as an accelerometer (G-sensor) or a velocity sensor; and based on the motion parameters, determine whether the user's head is deviating from the first posture.

[0064] The motion parameters of the user's head may include at least one of the following: motion speed, motion acceleration, and motion trajectory.

[0065] For example, the VR device can obtain the motion trajectory of the user's head protection through motion trajectory. If the end position of the motion trajectory is offset upward relative to the position of the user's head when it is in the first posture, it means that the user's head is offset upward relative to the first posture, that is, the user's head is in the head-up posture. Then, the VR device can continue to detect the duration for which the user's head is held at the end position of the trajectory through the gyroscope. If the duration is greater than a preset duration, the VR device can determine the user's focus area in the VR screen.

[0066] Optionally, step 501 above can be implemented through step 501c below.

[0067] Step 501c: When the VR device detects that the user's head has deviated from the first posture for a preset duration and the user is in a state of fatigue, it determines the user's focus area on the VR screen.

[0068] Optionally, in one approach, the VR device can acquire the user's blink frequency and determine whether the user is fatigued based on the blink frequency. If the user's blink frequency is greater than a preset blink frequency, it is determined that the user is in a fatigued state. The user's blink frequency can be determined by acquiring multiple images of the user's eyes.

[0069] Alternatively, in another approach, the VR device can determine the user's current eye-opening level by collecting images of the user's eyes. If the eye-opening level of multiple users is less than or equal to a preset eye-opening level, then the user is determined to be in a state of fatigue. The user's eye-opening level can be represented by the distance between the user's upper and lower eyelids; the smaller the distance between the upper and lower eyelids, the less open the user's eyes are.

[0070] Of course, in practical implementation, VR devices can identify the fatigue index of a user's eye muscles by collecting images of the user's eyes. If the fatigue index of the user's eye muscles is greater than or equal to a preset index, it is determined that the user is in a state of fatigue. For methods of identifying the fatigue index of a user's eye muscles based on eye images, please refer to the relevant descriptions in the prior art.

[0071] Thus, since VR devices can determine the user's focus area in the VR screen only when the user's head deviates from the initial posture and the user is in a fatigued posture, the VR device can correct the user's posture when using the VR device only after determining that the user is already tired. Therefore, it can respect the user's usage habits to a greater extent and avoid damage to the user's cervical spine.

[0072] Step 502: The VR device keeps the display position of the focused area unchanged and controls the non-focused areas in the VR screen to move along the first direction until the user's head is detected to be in the first posture.

[0073] The first direction is opposite to the second direction, and the second direction is the direction in which the user's head deviates from the first posture.

[0074] Optionally, the first direction can be an upward, downward, leftward, or rightward direction relative to the first posture.

[0075] In this embodiment, when the non-focused area moves along the first direction, the user's head follows the movement of the non-focused area along the first direction due to a conditioned reflex. The VR device can detect the user's head posture during the head movement. When the user's head is detected to be in the first posture, the device controls the non-focused area to stop moving along the first direction, thereby guiding the user's head to stop moving and keeping the user's head in the first posture. This can prevent excessive fatigue of the user's neck or cervical spine during the use of the VR device.

[0076] In the VR display method provided in this application embodiment, during the user's use of the VR device, since the user's focused area on the VR screen can remain unchanged when the user's head is deviated from the first posture for a long time, and the non-focused area is controlled to move in the opposite direction of the deviation direction (i.e., the first direction), the user's head can be made to follow the non-focused area to move in the first direction due to conditioned reflex. In this way, the user's head can be restored to the first posture, thereby avoiding the discomfort of the user's cervical spine caused by incorrect posture when using the VR device.

[0077] Optionally, after step 501 above, the VR display method provided in this application embodiment may further include step 503 below.

[0078] Step 503: During the process of controlling the non-focused area in the VR screen to move along the first direction, the VR device controls the non-focused area in the VR screen to be in a blurred state.

[0079] For example, suppose the VR device determines the user's focus area on the VR screen as follows: Figure 6 If the area inside the dashed circle is shown in (b), then the VR device can blur the area outside the dashed circle and control the area outside the dashed circle to move along the first direction.

[0080] Thus, since blurring the non-focused area allows the user's gaze to focus more on the focused area, keeping the non-focused area in a blurred state while controlling its movement along the first direction can further increase the probability that the user's head will follow the movement of the non-focused area. This improves the success rate of correcting the user's posture when using the VR device.

[0081] Optionally, after step 502 above, the VR display method provided in this application embodiment may further include step 504 below.

[0082] Step 504: The VR device controls the non-focused area in the VR screen to move along the second direction until the non-focused area is in the first display position;

[0083] In this embodiment, the first display position is the display position before the non-focused area moves along the first direction.

[0084] Wherein, the first moving speed of the non-focused region along the first direction is greater than the second moving speed of the non-focused region along the second direction.

[0085] It can be understood that the VR device can control the non-focused area to move along a first direction at a first moving speed until the user's head is detected to be in a first posture; then the VR device can control the non-focused area to move along a second direction at a second moving speed until it returns to the display position before moving along the first direction.

[0086] Optionally, to ensure that the user is looking directly at the focal area, the VR device can update the display position of the focal area after the user's head is in the first pose, such as updating the display position of the focal area to be directly in front of the user's head.

[0087] Thus, since the non-focused area can be controlled to move at a small speed along the second direction after detecting that the user's head is in the first posture, it can slowly return to its display position before moving along the first direction without causing the user's head to move, thereby obtaining a complete VR image and improving the display effect of the VR image. In this way, by correcting the user's head posture, it ensures that the user can view a better VR image and improves the user experience.

[0088] The following uses a user scenario where the user is standing or sitting as an example to illustrate the VR display method provided in this application embodiment.

[0089] Example 1, such as Figure 6 As shown, when a user lowers their head for a preset duration, the VR screen on the VR device will adjust its display accordingly, gradually raising the VR screen until the VR device is horizontal, and then displaying it in full screen. This helps the user return from a lowered posture to a horizontal one, protecting their cervical spine. Specifically:

[0090] (1) As Figure 6 As shown in (a), users experience fatigue from looking down for extended periods while using VR.

[0091] (2) Figure 6As shown in (b), the VR device detects the user's focus area at this time through infrared or camera. That is, the image in the dashed circle is the user's focus area. At this time, the VR automatically blurs the background outside the focus area to keep the image inside the circle from being distorted.

[0092] (3) Figure 6 As shown in (c), the VR device can control the blurred background image to move upwards while the image within the circle remains unchanged; due to conditioned reflexes, the user's head posture follows the upward rotation of the blurred image.

[0093] When the VR device detects that the user's head is level, it controls the background image to stop moving upwards so that the user's head remains level.

[0094] (4) Figure 6 As shown in (d), in order to restore the VR screen to a complete screen, the VR device can continue to control the blurred background image to move downwards at a slow speed until the blurred background image and the image inside the circle are stitched together to form a complete VR screen.

[0095] (5) Figure 6 As shown in (e), the VR device removes the background blur and resumes normal viewing.

[0096] As can be understood, Example 1 above illustrates the process of the VR device correcting the user's head posture after the user lowers their head. In actual implementation, after the user raises their head, the VR screen of the VR device adjusts according to the user's head posture, i.e., as shown above. Figure 4 As shown, when the user raises their head, the VR screen on the VR device also faces upwards. However, if the user maintains this head-up angle for an extended period, it can lead to neck strain and, over time, cervical spondylosis and other health problems. Therefore, the VR device uses its camera (such as an infrared camera or a natural light camera) to determine the user's current focus area. Then, the VR device can automatically adjust the VR screen display. Specifically, the non-focused area in the VR screen gradually moves towards the bottom of the VR device, causing the user's eyes to follow downwards, which in turn moves the user's head downwards. Once the head is in a horizontal position, the VR screen returns to full-screen display.

[0097] Example 2: The VR display method provided in this application embodiment can also be applied to scenarios where the user tilts or turns their head. When it is detected that the user is tilting or turning their head and has been immersed in the scene for a certain period of time, the VR device automatically helps the user adjust, keeping the focused area of ​​the screen stationary while the areas outside the focused area move in the corresponding direction. Specifically:

[0098] like Figure 7As shown in (a), when the user's head is tilted to the right, the VR device determines the user's focus area on the VR screen as the area within the dashed circle.

[0099] like Figure 7 As shown in (b), the VR device blurs the image area outside the dashed circle while keeping the image inside the dashed circle from being distorted.

[0100] like Figure 7 As shown in (c), the VR device controls the blurred screen area to move to the left at a speed of 1, while keeping the display position of the screen area within the dotted circle unchanged, to prompt the user to turn their head to the left; until the user's head is detected to be in the first posture, the blurred screen area is controlled to stop moving to the left.

[0101] like Figure 7 As shown in (d), the VR device can control the blurred image to move to the right at a speed of 2, where the speed of 2 is much smaller than the speed of 1; until the blurred image is aligned with the pixels in the dashed circle (i.e., restored to the display position before moving to the left), so as to stitch together a complete VR display image.

[0102] like Figure 7 As shown in (e), the VR device can stop the display area outside the dashed circle to restore the VR image to normal display.

[0103] Thus, the VR display method provided in this application embodiment achieves neck angle adjustment for the user through automatic VR screen adjustment, thereby protecting the user's neck and improving the user experience.

[0104] The VR display method provided in this application can be executed by a VR display device. This application uses a VR display device executing the method as an example to illustrate the VR display device provided in this application.

[0105] This application provides a VR display device. Figure 8 This application provides a possible structural schematic diagram of a VR display device according to an embodiment of the present application, such as... Figure 8 As shown, the VR display device 80 provided in this application embodiment may include: a detection module 81, a determination module 82, and a control module 83. The determination module 82 is used to determine the focus area of ​​the user on the VR screen of the VR device when the detection module 81 detects that the user's head has deviated from the first posture for a preset duration;

[0106] The control module 83 is used to keep the display position of the focus area unchanged and control the non-focus area in the VR screen to move along the first direction until the detection module 81 detects that the user's head is in the first posture.

[0107] The first direction is opposite to the second direction, and the second direction is the direction in which the user's head deviates from the first posture; the first posture is the correct guiding posture for wearing the VR device.

[0108] In one possible implementation, the control module 83 is also used to control the non-focused region to be in a blurred posture during the process of controlling the non-focused region to move along the first direction.

[0109] In one possible implementation, the control module 83 is further configured to control the non-focused area to move along the second direction after the detection module 81 detects that the user's head is in the first posture, until the non-focused area is in the first display position, the first display position being the display position before the non-focused area moves along the first direction;

[0110] The first moving speed of the non-focused region along the first direction is greater than the second moving speed of the non-focused region along the second direction.

[0111] In one possible implementation, the determining module 82 is specifically used to determine the user's focus area on the VR screen when the detection module 81 detects that the user's head has deviated from the first posture for a preset duration and the user is in a fatigued posture.

[0112] In one possible implementation, the determining module 82 is specifically used to acquire the user's eye image; based on the eye feature information in the eye image, the focusing area of ​​the user in the VR screen is determined.

[0113] In the VR display device provided in this application embodiment, during the user's use of the VR device, since the user's focused area on the VR screen can remain unchanged when the user's head is deviated from the first posture for a long time, and the non-focused area is controlled to move in the opposite direction of the deviation direction (i.e., the first direction), the user's head can be made to follow the non-focused area to move in the first direction due to conditioned reflex. In this way, the user's head can be restored to the first posture, thereby avoiding the discomfort of the user's cervical spine caused by incorrect posture when using the VR device.

[0114] The VR display device in this application embodiment can be an electronic device or a component within an electronic device, such as an integrated circuit or a chip. The electronic device can be a terminal or other devices besides a terminal. For example, the electronic device can be a mobile phone, tablet computer, laptop computer, PDA, in-vehicle electronic device, mobile internet device (MID), augmented reality (AR) / virtual reality (VR) device, robot, wearable device, ultra-mobile personal computer (UMPC), netbook, or personal digital assistant (PDA), etc. It can also be a server, network attached storage (NAS), personal computer (PC), television set (TV), ATM, or self-service machine, etc. This application embodiment does not specifically limit the scope of the device.

[0115] The VR display device in this application embodiment can be a device with an operating system. This operating system can be Android, iOS, or other possible operating systems; this application embodiment does not specifically limit the specific operating system used.

[0116] The VR display device provided in this application embodiment can achieve... Figures 5 to 7 The various processes implemented in the method implementation examples will not be described again here to avoid repetition.

[0117] Optionally, such as Figure 9 As shown, this application embodiment also provides an electronic device 900, including a processor 901 and a memory 902. The memory 902 stores a program or instructions that can run on the processor 901. When the program or instructions are executed by the processor 901, they implement the various steps of the above-described VR display method embodiment and can achieve the same technical effect. To avoid repetition, they will not be described again here.

[0118] It should be noted that the electronic devices in the embodiments of this application include mobile electronic devices and non-mobile electronic devices.

[0119] Figure 10 A schematic diagram of the hardware structure of an electronic device to implement an embodiment of this application.

[0120] The electronic device 1000 includes, but is not limited to, components such as: radio frequency unit 1001, network module 1002, audio output unit 1003, input unit 1004, sensor 1005, display unit 1006, user input unit 1007, interface unit 1008, memory 1009, and processor 1010.

[0121] Those skilled in the art will understand that the electronic device 1000 may also include a power supply (such as a battery) for supplying power to various components. The power supply may be logically connected to the processor 1010 through a power management system, thereby enabling functions such as managing charging, discharging, and power consumption through the power management system. Figure 10 The electronic device structure shown does not constitute a limitation on the electronic device. The electronic device may include more or fewer components than shown, or combine certain components, or have different component arrangements, which will not be elaborated here.

[0122] The processor 1010 is used to determine the user's focus area on the VR screen when the duration of detection of the user's head deviating from the first posture reaches a preset duration.

[0123] The processor 1010 is used to keep the display position of the focused area unchanged and control the non-focused area in the VR screen to move along the first direction until the user's head is detected to be in the first posture; wherein, the first direction is opposite to the second direction, and the second direction is the deviation direction of the user's head relative to the first posture; wherein, the first posture is the correct guidance posture for wearing the VR device.

[0124] In one possible implementation, the processor 1010 is also used to control the non-focused region to be in a blurred posture while controlling the non-focused region to move along the first direction.

[0125] In one possible implementation, the processor 1010 is further configured to control the non-focused area to move along the second direction after detecting that the user's head is in the first posture, until the non-focused area is in the first display position, the first display position being the display position before the non-focused area moves along the first direction;

[0126] The first moving speed of the non-focused region along the first direction is greater than the second moving speed of the non-focused region along the second direction.

[0127] In one possible implementation, the processor 1010 is specifically used to determine the user's focus area on the VR screen when it detects that the user's head has deviated from the first posture for a preset duration and the user is in a fatigued posture.

[0128] In one possible implementation, the processor 1010 is specifically used to acquire the user's eye image; based on the eye feature information in the eye image, it determines the user's focus area in the VR screen.

[0129] In the electronic device provided in this application embodiment, during the user's use of the VR device, since the user's focused area on the VR screen can remain unchanged when the user's head is deviated from the first posture for a long time, and the non-focused area is controlled to move in the opposite direction of the deviation direction (i.e., the first direction), the user's head can be made to follow the non-focused area to move in the first direction due to conditioned reflex. In this way, the user's head can be restored to the first posture, thereby avoiding the discomfort of the user's cervical spine caused by incorrect posture when using the VR device.

[0130] It should be understood that, in this embodiment, the input unit 1004 may include a graphics processing unit (GPU) 10041 and a microphone 10042. The GPU 10041 processes image data of still images or videos obtained by an image capture device (such as a camera) in video capture mode or image capture mode. The display unit 1006 may include a display panel 10061, which may be configured in the form of a liquid crystal display, an organic light-emitting diode, or the like. The user input unit 1007 includes a touch panel 10071 and at least one of other input devices 10072. The touch panel 1071 is also called a touch screen. The touch panel 10071 may include a touch detection device and a touch controller. Other input devices 10072 may include, but are not limited to, physical keyboards, function keys (such as volume control buttons, power buttons, etc.), trackballs, mice, and joysticks, which will not be described in detail here.

[0131] The memory 1009 can be used to store software programs and various data. The memory 1009 may primarily include a first storage area for storing programs or instructions and a second storage area for storing data. The first storage area may store the operating system, application programs or instructions required for at least one function (such as sound playback, image playback, etc.). Furthermore, the memory 1009 may include volatile memory or non-volatile memory, or both. The non-volatile memory may be read-only memory (ROM), programmable read-only memory (PROM), erasable programmable read-only memory (EPROM), electrically erasable programmable read-only memory (EEPROM), or flash memory. Volatile memory can be random access memory (RAM), static random access memory (SRAM), dynamic random access memory (DRAM), synchronous dynamic random access memory (SDRAM), double data rate synchronous dynamic random access memory (DDRSDRAM), enhanced synchronous dynamic random access memory (ESDRAM), synchronous link dynamic random access memory (SLDRAM), and direct memory bus RAM (DRRAM). The memory 109 in the embodiments of this application includes, but is not limited to, these and any other suitable types of memory.

[0132] The processor 1010 may include one or more processing units; optionally, the processor 1010 integrates an application processor and a modem processor, wherein the application processor mainly handles operations involving the operating system, user interface, and applications, and the modem processor mainly handles wireless communication signals, such as a baseband processor. It is understood that the aforementioned modem processor may also not be integrated into the processor 1010.

[0133] This application also provides a readable storage medium storing a program or instructions. When the program or instructions are executed by a processor, they implement the various processes of the above-described VR display method embodiments and achieve the same technical effects. To avoid repetition, they will not be described again here.

[0134] The processor is the processor in the electronic device described in the above embodiments. The readable storage medium includes computer-readable storage media, such as computer read-only memory (ROM), random access memory (RAM), magnetic disk, or optical disk.

[0135] This application embodiment also provides a chip, which includes a processor and a communication interface. The communication interface is coupled to the processor. The processor is used to run programs or instructions to implement the various processes of the above-described VR display method embodiments and can achieve the same technical effect. To avoid repetition, it will not be described again here.

[0136] It should be understood that the chip mentioned in the embodiments of this application may also be referred to as a system-on-a-chip, system chip, chip system, or system-on-a-chip, etc.

[0137] This application provides a computer program product, which is stored in a storage medium and executed by at least one processor to implement the various processes of the VR display method embodiments described above, and can achieve the same technical effect. To avoid repetition, it will not be described again here.

[0138] It should be noted that, in this document, the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or apparatus. Without further limitations, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the process, method, article, or apparatus that includes that element. Furthermore, it should be noted that the scope of the methods and apparatuses in the embodiments of this application is not limited to performing functions in the order shown or discussed, but may also include performing functions substantially simultaneously or in the reverse order, depending on the functions involved. For example, the described methods may be performed in a different order than described, and various steps may be added, omitted, or combined. Additionally, features described with reference to certain examples may be combined in other examples.

[0139] Through the above description of the embodiments, those skilled in the art can clearly understand that the methods of the above embodiments can be implemented by means of software plus necessary general-purpose hardware platforms. Of course, they can also be implemented by hardware, but in many cases the former is a better implementation method. Based on this understanding, the technical solution of this application, in essence, or the part that contributes to the prior art, can be embodied in the form of a computer software product. This computer software product is stored in a storage medium (such as ROM / RAM, magnetic disk, optical disk) and includes several instructions to cause a terminal (which may be a mobile phone, computer, server, or network device, etc.) to execute the methods described in the various embodiments of this application.

[0140] The embodiments of this application have been described above with reference to the accompanying drawings. However, this application is not limited to the specific embodiments described above. The specific embodiments described above are merely illustrative and not restrictive. Those skilled in the art can make many other forms under the guidance of this application without departing from the spirit and scope of the claims, and all of these forms are within the protection scope of this application.

Claims

1. A virtual reality (VR) display method, characterized in that, The method includes: If the user's head deviates from the first posture for a preset duration, determine the user's focus area on the VR screen of the VR device; Keep the display position of the focused area unchanged, and control the non-focused areas in the VR screen other than the focused area to move along the first direction until the user's head is detected to be in the first posture; Wherein, the first direction is opposite to the second direction, and the second direction is the direction in which the user's head deviates from the first posture; The first posture is the correct guided posture for wearing the VR device; After detecting that the user's head is in the first pose, the method further includes: Control the non-focused area to move along the second direction until the non-focused area is at a first display position, the first display position being the display position of the non-focused area before it moves along the first direction; Wherein, the first moving speed of the non-focused region along the first direction is greater than the second moving speed of the non-focused region along the second direction.

2. The method according to claim 1, characterized in that, The method further includes: During the process of controlling the non-focused region to move along the first direction, the non-focused region is controlled to be in a blurred state.

3. The method according to claim 1, characterized in that, The step of determining the user's focus area on the VR screen of the VR device when the duration of detection of the user's head deviating from the first posture reaches a preset duration includes: If the user's head deviates from the first posture for a preset duration and the user is in a state of fatigue, the user's focus area on the VR screen is determined.

4. The method according to claim 1, characterized in that, Determining the user's focus area on the VR screen of the VR device includes: Obtain the user's eye image; Based on the eye feature information in the eye image, the user's focus area on the VR screen is determined.

5. A VR display device, characterized in that, The device includes: a detection module, a determination module, and a control module; The determining module is used to determine the focus area of ​​the user on the VR screen of the VR device when the detection module detects that the user's head has deviated from the first posture for a preset duration. The control module is used to keep the display position of the focused area unchanged, and control the non-focused area in the VR screen other than the focused area to move along the first direction until the detection module detects that the user's head is in the first posture; Wherein, the first direction is opposite to the second direction, and the second direction is the direction in which the user's head deviates from the first posture; Wherein, the first posture is the correct guided posture of the VR device; The control module is also configured to, after the detection module detects that the user's head is in the first posture, control the non-focused area to move along the second direction until the non-focused area is in the first display position, the first display position being the display position of the non-focused area before it moves along the first direction. Wherein, the first moving speed of the non-focused region along the first direction is greater than the second moving speed of the non-focused region along the second direction.

6. The apparatus according to claim 5, characterized in that, The control module is also used to control the non-focused region to be in a blurred posture while controlling the non-focused region to move along the first direction.

7. The apparatus according to claim 5, characterized in that, The determining module is specifically used to determine the user's focus area on the VR screen when the detection module detects that the user's head has deviated from the first posture for a preset duration and the user is in a state of fatigue.

8. The apparatus according to claim 5, characterized in that, The determining module is specifically used to acquire the user's eye image; and based on the eye feature information in the eye image, to determine the user's focus area on the VR screen.

9. An electronic device, characterized in that, It includes a processor and a memory, the memory storing a program or instructions that can run on the processor, the program or instructions being executed by the processor to implement the steps of the VR display method as described in any one of claims 1 to 4.

10. A readable storage medium, characterized in that, The readable storage medium stores a program or instructions that, when executed by a processor, implement the steps of the VR display method as described in any one of claims 1 to 4.

Images