A display method of a VR scene and a VR device
By detecting changes in user posture and automatically adjusting the display mode of the VR device, the problem of poor display effect when the user's posture changes is solved, thus improving the user experience.
Patent Information
- Application Number
- CN202410537835.4
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2024-04-30
- Publication Date
- 2025-12-05
- Estimated Expiration
- 2044-04-30
AI Technical Summary
In existing VR devices, the fixed origin tracking mode when the user's posture changes results in poor display quality and a poor user experience. Furthermore, users need to manually adjust the mode, which interrupts the experience.
By detecting the user's VR headset height at specified intervals, the system automatically determines changes in posture and prompts the user to switch display modes, including origin tracking mode and viewpoint, and adjusts the target display mode according to the posture.
It enables automatic adjustment of the VR scene display mode based on the user's posture, improving the display effect and user experience, and avoiding interruptions caused by manual adjustment.
Smart Images

Figure CN119420889B_ABST
Abstract
Description
TECHNICAL FIELD
[0001] The present application relates to the virtual reality technical field, and particularly relates to a VR scene display method and a VR device. BACKGROUND
[0002] In a VR (Virtual Reality) application, the posture of a user is very important. Generally, the posture of the user is divided into two types: a sitting posture and a standing posture. The posture of the user is generally achieved in cooperation with a point tracking function. A developer sets different point tracking modes in a game engine according to actual needs of an application.
[0003] However, no matter which VR device, a floor point mode and a head-mounted display point mode are generally provided. If the floor point mode is selected, the height of a camera of the VR device is the same as the height of a player, and the standing posture of the user is suitable for use. If the head-mounted display point mode is selected, the height of the camera of the VR device is fixed, and the sitting posture of the user is suitable for use. However, the point tracking mode of the application is generally fixed and unchanged, and if the posture of the user changes and the point tracking mode does not change, the display effect is poor. A small part of the application provides a setting page for the user to set the point tracking mode. However, if the user wants to stand and sit alternately, the user has to interrupt the current use, enter the setting page, and adjust the point tracking mode by himself, which leads to poor user experience. SUMMARY
[0004] The present application provides a VR scene display method and a VR device, which are used for automatically switching a corresponding display mode based on a change in a posture state of a user in a VR scene, and improve the display effect and user experience.
[0005] In a first aspect, an embodiment of the present application provides a VR scene display method, and the method comprises the following steps.
[0006] Every first specified time length, a current VR head-mounted display height of the user and a VR head-mounted display height corresponding to a previous specified time length are used to determine a current posture state of the user, wherein the posture state is a standing posture state or a non-standing posture state.
[0007] If the current posture state of the user is different from the posture state determined in the previous specified time length, the user is prompted whether to switch a display mode, wherein the display mode comprises a point tracking mode and a view angle.
[0008] If a request for switching the display mode sent by the user is received, a target display mode is obtained based on the current posture state of the user, wherein the target display mode comprises a target point tracking mode and a target view angle.
[0009] adjust the current origin tracking mode to the target origin tracking mode, and display the VR scene using the target perspective.
[0010] The second aspect of the present application provides a VR device, comprising a processor and a memory, the processor and the memory are connected through a bus;
[0011] The memory stores a computer program, and the processor is configured to execute the following operations based on the computer program:
[0012] Every first specified time length, using the user's current VR headset height and the VR headset height corresponding to the last specified time length, determine the user's current posture state, wherein the posture state is a standing posture state or a non-standing posture state;
[0013] If the user's current posture state is different from the posture state determined in the last specified time length, prompt the user whether to switch the display mode, wherein the display mode includes an origin tracking mode and a perspective;
[0014] If a request to switch the display mode sent by the user is received, obtain a target display mode based on the user's current posture state, wherein the target display mode includes a target origin tracking mode and a target perspective;
[0015] Adjust the current origin tracking mode to the target origin tracking mode, and display the VR scene using the target perspective.
[0016] According to the third aspect of the present application, a computer storage medium is provided, which stores a computer program for executing the method of the first aspect.
[0017] In the above embodiments of the present application, every specified time length, using the user's current VR headset height and the VR headset height corresponding to the last specified time length, determine the user's current posture state; if the user's current posture state is different from the posture state determined in the last specified time length, prompt the user whether to switch the display mode, wherein the display mode includes an origin tracking mode and a perspective; if a request to switch the display mode sent by the user is received, obtain a target origin tracking mode and a target perspective based on the user's current posture state; adjust the current origin tracking mode to the target origin tracking mode, and display the VR scene using the target perspective. Thus, in the embodiments of the present application, by confirming the change of the posture state by the user, different origin tracking modes are automatically and dynamically set, the perspective of the user is adjusted, the user watches in the VR scene with the best perspective matching the current posture state, and the display effect of the VR scene and the user experience are improved. Attached Figure Description
[0018] To more clearly illustrate the technical solutions in the embodiments of this application or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.
[0019] Figure 1 An exemplary illustration shows one of the application scenarios provided in the embodiments of this application;
[0020] Figure 2 The second example illustration shows a schematic diagram of an application scenario provided in an embodiment of this application;
[0021] Figure 3 An exemplary schematic diagram of one of the VR scene display methods provided in an embodiment of this application is shown;
[0022] Figure 4 An exemplary schematic diagram of the display mode switching interface provided in an embodiment of this application is shown;
[0023] Figure 5 One of the schematic diagrams from a user's perspective provided in an embodiment of this application is illustrated by way of example;
[0024] Figure 6 The second schematic diagram, provided by an embodiment of this application, illustrates a user's perspective.
[0025] Figure 7 The second schematic flowchart of the VR scene display method provided in the embodiment of this application is illustrated by example;
[0026] Figure 8 The third example illustrates a flowchart of a VR scene display method provided in an embodiment of this application.
[0027] Figure 9 The fourth example illustrates a flowchart of a VR scene display method provided in an embodiment of this application.
[0028] Figure 10 An exemplary schematic diagram of a VR scene display device provided in an embodiment of this application is shown;
[0029] Figure 11 An exemplary hardware structure diagram of a VR device provided in an embodiment of this application is shown. Detailed Implementation
[0030] In order to make the purposes, the embodiments and the advantages of the present application more clear, the following will combine the drawings in the exemplary embodiments of the present application to make a clear and complete description of the exemplary embodiments of the present application. Obviously, the described exemplary embodiments are only a part of the embodiments of the present application, but not all the embodiments.
[0031] Based on the exemplary embodiments described in the present application, all the other embodiments obtained by those skilled in the art without making creative efforts are within the scope of the claims of the present application. In addition, although the disclosure in the present application is introduced according to one or more examples, it should be understood that each aspect of the disclosure can also constitute a complete embodiment.
[0032] It should be noted that the brief description of the terms in the present application is only for the convenience of understanding the subsequently described embodiments, but is not intended to limit the embodiments of the present application. Unless otherwise specified, these terms should be understood according to their ordinary and general meanings.
[0033] The terms "first", "second", and the like in the specification of the present application and the above drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the data thus used can be interchanged under appropriate circumstances, so that the embodiments of the present application described herein can be implemented in an order other than those illustrated or described herein. In addition, the terms "include" and "have" and any variations thereof are intended to cover but not exclusive inclusion, for example, a product or device including a series of components does not necessarily limit to the clearly listed components, but can include other components not clearly listed or inherent to these products or devices.
[0034] The term "module" used in the present application refers to any known or later developed hardware, software, firmware, artificial intelligence, fuzzy logic or a combination of hardware or / and software code capable of performing functions related to the element.
[0035] The idea of the embodiments of the present application is summarized as follows.
[0036] At present, the origin tracking mode of the application is generally fixed and unchanged. If the user's posture changes and the origin tracking mode does not change, it will result in poor display effect. There is a small part of the application that provides the user to enter the setting page of the application to set the origin tracking mode. However, if the user wants to stand for a while and sit for a while, the user has to interrupt the current use and enter the setting page to adjust the origin tracking mode by himself, resulting in poor user experience.
[0037] Existing technologies often suffer from poor display quality and user experience in VR scenes. This application provides a VR scene display method. By periodically adjusting the user's current VR headset height against the height determined at the previous specified time interval, the method determines the user's current posture. If the user's current posture differs from the posture determined at the previous specified time interval, the user is prompted to switch display modes. These display modes include an origin tracking mode and a viewing angle. If a user requests a switch, a target origin tracking mode and a target viewing angle are determined based on the user's current posture. The current origin tracking mode is then adjusted to the target origin tracking mode, and the VR scene is displayed using the target viewing angle. Therefore, this application automatically and dynamically sets different origin tracking modes and adjusts the user's viewing angle based on the user's confirmation of posture changes, allowing the user to view the VR scene from the optimal perspective matching their current posture, thus improving the display quality and user experience.
[0038] Before introducing the VR scene display method in this application, the technical terms in the embodiments of this application will be explained first:
[0039] Floor Origin Mode: The floor is used as the origin of the coordinate system corresponding to the VR device system.
[0040] Headset Origin Mode: The VR headset worn by the user is used as the origin of the system's coordinate system.
[0041] like Figure 1 As shown, an application scenario of a VR scene display method is described, which includes a VR device 110, a server 120, and a memory 130.
[0042] In one possible application scenario, every first specified time interval, server 120 determines the user's current posture state by comparing the user's current VR headset height with the VR headset height corresponding to the previous specified time interval stored in memory 130. The posture state can be either standing or non-standing. If the user's current posture state differs from the posture state determined at the previous specified time interval, server 120 prompts the user via VR device 110 whether a display mode switch is required. The display mode includes origin tracking mode and viewpoint. If server 120 receives a request from the user to switch display modes, it obtains a target origin tracking mode and a target viewpoint based on the user's current posture state. The server then adjusts VR device 110 from its current origin tracking mode to the target origin tracking mode and displays the VR scene using the target viewpoint.
[0043] like Figure 2As shown, another application scenario is shown, which includes the VR device 110 and the memory 130. Wherein, the VR device 110 uses the current VR head-mounted height of the user and the VR head-mounted height corresponding to the last specified time period in the memory 130 to determine the current posture state of the user every first specified time period, wherein the posture state is a standing posture state or a non-standing posture state; the VR device 110 prompts the user whether to switch the display mode if the current posture state of the user is different from the posture state determined in the last specified time period, wherein the display mode includes the origin tracking mode and the perspective; if the request for switching the display mode sent by the user is received, the target origin tracking mode and the target perspective are obtained based on the current posture state of the user; the current origin tracking mode is adjusted to the target origin tracking mode, and the VR scene is displayed using the target perspective.
[0044] Wherein, Figure 1 The server 120 in the memory 130 can interact with the VR device 110 and the memory 130 through the communication network, and Figure 2 The VR device 110 and the memory 130 in the communication network can interact with each other through the communication network, and the communication mode of the communication network can be divided into wireless communication mode or wired communication mode.
[0045] For example, the server 120 can access the network through the cellular mobile communication technology, and communicate with the VR device 110 and the memory 130, respectively, wherein the cellular mobile communication technology includes the fifth generation mobile communication (5th Generation Mobile Networks, 5G) technology.
[0046] Optionally, the server 120 can access the network through the short-range wireless communication mode, and communicate with the VR device 110 and the memory 130, respectively, wherein the short-range wireless communication mode includes the wireless fidelity (Wireless Fidelity, Wi-Fi) technology.
[0047] Wherein, only a single VR device 110, a single server 120 and a memory 130 are described in the description of the present application, but those skilled in the art should understand that the VR device 110, the server 120 and the memory 130 shown are intended to represent the operation of the VR device 110, the server 120 and the memory 130 involved in the technical solution of the present application. Rather than implying a limitation on the number, type or location of the VR device 110, the server 120 and the memory 130. It should be noted that if additional modules are added to the illustrated environment or individual modules are removed therefrom, the underlying concept of the example embodiments of the present application will not change.
[0048] It should be noted that the display method of the VR scene provided in the present application is not only applicable to the application scenarios shown in Figure 1 and Figure 2 , but also applicable to any display device of the VR scene.
[0049] The display method of the VR scene in the exemplary embodiments of the present application will be described below in combination with the above-described application scenarios, with reference to the accompanying drawings. It should be noted that the above-described application scenarios are only shown for the purpose of facilitating the understanding of the method and principle of the present application, and the embodiments of the present application are not limited in this respect.
[0050] Next, the display method of the VR scene in the embodiments of the present application will be introduced. As shown in Figure 3 , it is a flowchart of the display method of the VR scene, which can include the following steps:
[0051] Step 301: every first specified time interval, determining the current posture state of the user by using the current VR headset height of the user and the VR headset height corresponding to the previous specified time interval, wherein the posture state is a standing posture state or a non-standing posture state;
[0052] The first specified time interval in the embodiments of the present application can be 0.1 seconds and 1 second, etc. The specific value of the first specified time interval in the embodiments of the present application can be set according to the actual situation, and the embodiments of the present application do not limit the specific value of the first specified time interval.
[0053] The determination of the current posture state of the user in the embodiments of the present application can include the following two cases:
[0054] Case 1: if the current VR headset height is the first acquired VR headset height, the first height set in advance is determined as the VR headset height corresponding to the previous specified time interval.
[0055] Step 301 is specifically implemented as: if the current VR headset height of the user is less than the VR headset height corresponding to the previous specified time interval, it is determined that the current posture state of the user is the non-standing posture state; or, if the current VR headset height of the user is not less than the VR headset height corresponding to the previous specified time interval, it is determined that the current posture state of the user is the standing posture state.
[0056] It should be noted that the first height in the embodiments of the present application can be set according to the specific actual situation, and the embodiments of the present application do not limit the specific value of the first height.
[0057] Case 2: if the current VR headset height is not the first acquired VR headset height;
[0058] Step 301 can be specifically implemented as follows: Based on the user's current VR headset height and the VR headset height corresponding to the previous specified duration, obtain the height change amount; if the height change amount is greater than a specified threshold, and the posture state corresponding to the previous specified duration is the standing posture mode, then determine that the user's current posture state is the non-standing posture state; or, if the height change amount is greater than the specified threshold, and the posture state corresponding to the previous specified duration is the non-standing posture mode, then determine that the user's current posture state is the standing posture state; or, if the height change amount is not greater than the specified threshold, and the posture state corresponding to the previous specified duration is the standing posture mode, then determine that the user's current posture state is the standing posture state; or, if the height change amount is not greater than the specified threshold, and the posture state corresponding to the previous specified duration is the non-standing posture mode, then determine that the user's current posture state is the non-standing posture state.
[0059] In this embodiment, the difference between the current VR headset height and the VR headset height corresponding to the previous specified duration is determined as the height change. Furthermore, the specified threshold in this embodiment can be set according to specific circumstances, and this embodiment does not limit the specific value of the specified threshold.
[0060] It's important to note that when a user is seated (not standing) and at a relatively high height—meaning the VR headset height when the user is standing is no greater than a specified threshold than the VR headset height when the user is not standing—the VR device's origin tracking mode remains unchanged. For example, if the user changes from a standing to a non-standing position, continuing to view the scene using the origin tracking mode corresponding to the standing position will not result in a poor display. However, if the user changes from a non-standing to a standing position and the VR device still uses the origin tracking mode corresponding to the non-standing position, the user will not be able to view the entire scene at their actual height. In this case, the user needs to make a change in height (e.g., jump or manually lift the VR device) to trigger a display mode switching notification.
[0061] Step 302: If the user's current posture state is different from the posture state determined in the previous specified time period, then prompt the user whether they need to switch the display mode, wherein the display mode includes origin tracking mode and viewpoint;
[0062] like Figure 4 The image shows a schematic of the display mode switching interface. As can be seen, when switching display modes, the user needs to confirm whether they want to switch. If the user wants to switch, they click the "OK" button. If the user does not want to switch modes, they click the "Cancel" button.
[0063] In an embodiment, if a request to cancel the display mode switching sent by the user is received, the VR scene is displayed based on the current display mode.
[0064] If the current origin tracking mode is the floor origin mode, the target view angle is obtained based on the current VR headset height of the user every second specified time length. That is, the target view angle changes with the change of the user height. If the current origin tracking mode is the headset origin mode, the target view angle is obtained based on the target height of the user, wherein the target height is the height when the posture state of the user is first acquired as the standing posture state or a pre-set standard height.
[0065] The way of determining the target view angle and the target height in the embodiment of the application is the same as in step 303, and the embodiment of the application will not be described here. The second specified time length in the embodiment of the application can be the same as the first specified time length, or can be different. The specific value can be set according to the actual situation, and the specific value of the second specified time length is not limited in the embodiment of the application.
[0066] Next, the scene in which the user may need to cancel the display mode switching is introduced and described as follows:
[0067] Scenario one: The scenario of viewing a decoration design scheme through a VR device is taken as an example to illustrate the present scheme, and the user needs to crouch down to view the details of the decoration design scheme.
[0068] (1) The user crouches down from standing (i.e., standing posture state → non-standing posture state)
[0069] At this time, the system will have a prompt pop-up window to remind the user whether to switch the display mode (i.e., switch to the display mode corresponding to the non-standing posture state). At this time, the user only needs to click "No" before the countdown of the pop-up window, and at this time, the entire origin tracking mode will not change, and the user will see the content in the scene with the crouching view angle.
[0070] (2) The user crouches down from sitting (i.e., non-standing posture state → non-standing posture state)
[0071] At this time, because the height of the headset is lowered, the system will not prompt the user to switch the display mode. Since the origin tracking mode at this time is the headset origin mode, and the view angle of the user at this time is not a real view angle of crouching down, but a view angle of lowering the height of the headset with the system default height. If the user thinks that the view angle cannot reflect the real feeling, the user can stand up to switch to the standing posture and then crouch down again to update to the real view angle for viewing.
[0072] Scenario two: The height of the user is lower than the height of an ordinary adult (for example, a child)
[0073] If the real height of the user is less than the first height set by the system, when the user enters the application in a standing posture state for the first time, since the initial default origin tracking mode of the system is the floor origin mode, but since the real height of the user is less than the first height, the system will appear a prompt box for display mode switching. At this time, the user only needs to click "No" before the prompt box counts down, so as not to switch the origin tracking mode, and watch the entire scene of the item in the view angle corresponding to the real height of the user.
[0074] In the embodiment of the application, the origin tracking mode in the VR scene for the first time is the floor origin mode.
[0075] Step 303: If the request for display mode switching sent by the user is received, the target display mode is obtained based on the current posture state of the user.
[0076] The target display mode in the embodiment of the application includes a target origin tracking mode and a target view angle, and the target origin tracking mode is a floor origin mode or a head-mounted display origin mode.
[0077] In one embodiment, step 303 can be specifically implemented in the following two ways:
[0078] Way one: If the current posture state of the user is a sitting posture state, it is determined that the target origin tracking mode is a head-mounted display origin mode, and the target view angle is obtained by using the target height of the user, wherein the target height is the height when the posture state of the user is first acquired as a standing posture state or a standard height set in advance.
[0079] In one embodiment, the target height of the user is obtained in the following way:
[0080] If the height when the posture state of the user is in a standing posture state is not currently acquired, the standard height is determined as the target height. If the height when the posture state of the user is in a standing posture state is currently acquired, the height when the posture state of the user is first acquired as a standing posture state is determined as the target height.
[0081] In one embodiment, the target view angle is obtained in the following way: the target view angle corresponding to the target height is determined by using the corresponding relationship between the height set in advance and the view angle.
[0082] Way two: If the current posture state of the user is a standing posture mode, it is determined that the target origin tracking mode is a floor origin mode, and the target view angle is obtained by using the current VR head-mounted display height of the user every second specified time length.
[0083] In one embodiment, the target view angle is obtained by determining the target view angle corresponding to the current height of the VR head set of the user by using the preset correspondence between height and view angle.
[0084] For example, if the user originally uses the VR device in a standing state, but the user then watches in a sitting state, and the user cancels the display mode switching, the user still watches in the floor origin mode, and the target view angle changes with the adjustment of the height of the user, that is, the entire view angle becomes lower. Figure 5 As shown in FIG. 6, it is the view angle corresponding to the user standing in the floor origin mode, and when the user watches in a sitting state and the user cancels the display mode switching, as shown in FIG. 7, the view angle of the VR device becomes lower with the lower height of the user. Figure 6
[0085] Step 304: Adjust the current origin tracking mode to the target origin tracking mode, and display the VR scene by using the target view angle.
[0086] Next, the display method of the VR scene in the embodiments of the present application will be introduced in combination with specific scenes. One scene is that the user enters the VR scene in a standing state, and then switches to a non-standing state. Another scene is that the user enters the VR scene in a non-standing state, and then switches to a standing state.
[0087] As shown in FIG. 8, it is the flowchart corresponding to the scene that the user enters the VR scene in a standing state, and then switches to a non-standing state. Specifically, it can include the following steps: Figure 7
[0088] Step 701: When the user enters the VR scene, obtain the current height of the VR head set of the user;
[0089] Step 702: Compare the current height of the VR head set of the user with the preset first height, determine that the current height of the VR head set of the user is higher than the preset first height, obtain that the current posture state of the user is the standing state, and determine the current height of the VR head set of the user as the height when the posture state of the user is first determined to be the standing state.
[0090] Since the origin tracking mode when first entering the VR scene is the floor display mode, and the current posture state of the user is the standing state, the origin tracking mode remains unchanged in the floor display mode at this time.
[0091] Step 703: Every specified time length, compare the current VR headset height of the user with the last obtained VR headset height, determine whether the current VR headset height of the user is less than the last obtained VR headset height, if yes, execute step 704, if not, return to execute step 703;
[0092] Step 704: Prompt the user whether to switch the display mode;
[0093] Step 705: If the request of the user to switch the display mode is received, determine that the target origin tracking mode is the headset origin mode, and obtain the target view angle by using the height when the posture state of the user is the standing posture state for the first time;
[0094] Step 706: Adjust the current origin tracking mode to the headset origin mode, and display the VR scene by using the target view angle.
[0095] As shown in Figure 8 , the flow chart corresponding to the scene in which the user enters the VR scene in a non-standing posture state and then switches to a standing posture state. Specifically, it can include the following steps:
[0096] Step 801: When the user enters the VR scene, obtain the current VR headset height of the user;
[0097] Step 802: Compare the current VR headset height of the user with the first height set in advance, determine that the current VR headset height of the user is less than the first height set in advance, and obtain that the current posture state of the user is the non-standing posture state;
[0098] Step 803: Prompt the user whether to switch the display mode;
[0099] Step 804: If the request of the user to switch the display mode is received, determine that the target origin tracking mode is the headset origin mode, and obtain the target view angle by using the standard height set in advance;
[0100] Step 805: Adjust the current origin tracking mode to the headset origin mode, and display the VR scene by using the target view angle;
[0101] Step 806: Every specified time length, obtain the height change amount according to the current VR headset height of the user and the VR headset height corresponding to the last specified time length;
[0102] Step 807: If the height change amount is greater than a specified threshold, determine that the current posture state of the user is the standing posture state;
[0103] Step 808: prompting the user whether to switch the display mode;
[0104] Step 809: if the request of switching the display mode sent by the user is received, determining that the target origin tracking mode is a floor origin mode, and obtaining the target view angle by using the current VR head set height of the user;
[0105] Step 810: adjusting the current origin tracking mode to the floor origin mode, and displaying the VR scene by using the target view angle.
[0106] The embodiments of the present application can also be applied to a scene in which multiple users use the VR device alternately, for example, after user A watches the VR scene in the VR device, the VR device is handed over to user B for watching. The embodiments of the present application are described by taking the case that the height difference between user A and user B is not greater than a specified threshold value. The following cases are mainly included:
[0107] (1) user A watches the VR scene by using the VR device in a standing state, and hands over the VR device to user B in a standing state for continuing to watch:
[0108] When user A is standing, the origin tracking mode of the VR device is in the floor origin mode. At this time, the view angle is watched by using the view angle corresponding to the current VR head set height of user A. When user A hands over the VR device to user B, since user A and user B are both in a standing state, and the height difference between user A and user B is not greater than the specified threshold value, the origin tracking mode is not switched at this time. The VR device will automatically adapt to the height difference between user A and user B, and user B will continue to watch by using the view angle corresponding to the current VR head set height of user B.
[0109] (2) user A watches the VR scene by using the VR device in a sitting state, and hands over the VR device to user B in a sitting state for continuing to watch:
[0110] When user A is sitting, the VR device is in the head set origin mode. At this time, user A watches by using the view angle corresponding to the pre-set standard height or the height when the posture state of user A is first acquired as a standing state. When user A hands over the VR device to user B, since user A and user B are both sitting, the height difference between user A and user B will not be greater than the specified threshold value, so the display mode of the VR device will not change. User B continues to watch by using the view angle corresponding to the pre-set standard height or the height when the posture state of user A is first acquired as a standing state.
[0111] (3) user A watches the VR scene by using the VR device in a standing state, and hands over the VR device to user B in a sitting state for continuing to watch:
[0112] When the user A stands, the VR device is in the floor origin mode, and the view angle is the view angle corresponding to the current VR head-mounted display height of the user A. When the user A hands over the VR device to the user B, the VR device detects that the height change amount is greater than a specified threshold, and prompts the user B to switch the display mode. When the user B agrees to switch the display mode, the display mode is switched to the head-mounted display origin mode, and the user B views in the view angle corresponding to the height when the first acquired posture state of the user A is the standing posture state.
[0113] (4) The user A uses the VR device to view the VR scene while sitting, and hands over the VR device to the user B who stands to continue viewing:
[0114] When the user A sits, the VR device is in the head-mounted display origin mode. At this time, the user A views in the view angle corresponding to the pre-set standard height. When the user A hands over the VR device to the user B, the VR device detects that the height change amount is greater than a specified threshold, and prompts the user B to switch the display mode. When the user B agrees to switch the display mode, the origin tracking mode is switched to the floor origin mode, and the user B continues to view in the view angle corresponding to the current VR head-mounted display height of the user B.
[0115] In order to further understand the method in the present application, as shown in Figure 9 The flowchart of the display method of the VR scene in the present application can include the following steps:
[0116] Step 901: Every first specified time length, the current VR head-mounted display height of the user is acquired.
[0117] Step 902: It is judged whether the current VR head-mounted display height is the first acquired VR head-mounted display height. If yes, step 903 is executed, and if no, step 906 is executed.
[0118] Step 903: It is judged whether the current VR head-mounted display height of the user is less than a pre-set first height. If yes, step 904 is executed, and if no, step 905 is executed.
[0119] Step 904: It is determined that the current posture state of the user is the non-standing posture state.
[0120] Step 905: It is determined that the current posture state of the user is the standing posture state.
[0121] Step 906: According to the current VR head-mounted display height of the user and the VR head-mounted display height corresponding to the last specified time length, the height change amount is obtained.
[0122] Step 907: It is judged whether the height change amount is greater than a specified threshold. If yes, step 908 or step 909 is executed, and if no, step 910 or step 911 is executed.
[0123] Step 908: If the posture state corresponding to the previous specified duration is the standing posture mode, then determine that the user's current posture state is the non-standing posture state;
[0124] Step 909: If the posture state corresponding to the previous specified duration is the non-standing posture mode, then determine that the user's current posture state is the standing posture state;
[0125] Step 910: If the posture state corresponding to the previous specified duration is the standing posture mode, then determine that the user's current posture state is the standing posture state;
[0126] Step 911: If the posture state corresponding to the previous specified duration is the non-standing posture mode, then determine that the user's current posture state is the non-standing posture state;
[0127] Step 912: When the user's current posture is a non-standing posture, the target origin tracking mode is determined to be the head display origin mode, and the target viewpoint is obtained using the user's target height. The current origin tracking mode is then adjusted to the head display origin mode, and the VR scene is displayed using the target viewpoint.
[0128] The target height is the height when the user's posture is first obtained as a standing posture or a pre-set standard height.
[0129] Step 913: When the user's current posture is in standing mode, the target origin tracking mode is determined to be floor origin mode. Every second specified time interval, the target viewpoint is obtained using the user's current VR headset height. The current origin tracking mode is then adjusted to floor origin mode, and the VR scene is displayed using the target viewpoint.
[0130] Based on the same inventive concept, the VR scene display method described above can also be implemented by a VR scene display device. The effect of this VR scene display device is similar to that of the aforementioned method, and will not be described again here.
[0131] Figure 10 This is a schematic diagram of the structure of a VR scene display device according to an embodiment of the present disclosure.
[0132] like Figure 10 As shown, the VR scene display device 1000 disclosed herein may include a posture state determination module 1010, a prompting module 1020, a target display mode determination module 1030, and a display module 1040.
[0133] The posture state determination module 1010 is configured to determine a current posture state of the user by using a current VR head-mounted display height of the user and a VR head-mounted display height corresponding to a previous specified time length every first specified time length, wherein the posture state is a standing posture state or a non-standing posture state.
[0134] The prompt module 1020 is configured to prompt the user whether the display mode needs to be switched if the current posture state of the user is different from the posture state determined in the previous specified time length, wherein the display mode includes a point tracking mode and a view angle.
[0135] The target display mode determination module 1030 is configured to obtain a target display mode based on the current posture state of the user if a request for switching the display mode sent by the user is received, wherein the target display mode includes a target point tracking mode and a target view angle.
[0136] The display module 1040 is configured to adjust a current point tracking mode to the target point tracking mode and display the VR scene by using the target view angle.
[0137] In one embodiment, if the current VR head-mounted display height is a first acquired VR head-mounted display height, a first height set in advance is determined as the VR head-mounted display height corresponding to the previous specified time length.
[0138] The posture state determination module 1010 is specifically configured to:
[0139] If the current VR head-mounted display height of the user is less than the VR head-mounted display height corresponding to the previous specified time length, it is determined that the current posture state of the user is the non-standing posture state; or,
[0140] If the current VR head-mounted display height of the user is not less than the VR head-mounted display height corresponding to the previous specified time length, it is determined that the current posture state of the user is the standing posture state.
[0141] In one embodiment, if the current VR head-mounted display height is a non-first acquired VR head-mounted display height.
[0142] The posture state determination module 1010 is specifically configured to:
[0143] According to the current VR head-mounted display height of the user and the VR head-mounted display height corresponding to the previous specified time length, a height change amount is obtained.
[0144] If the height change amount is greater than a specified threshold value and the posture state corresponding to the previous specified time length is the standing posture mode, it is determined that the current posture state of the user is the non-standing posture state; or,
[0145] if the height change amount is greater than the specified threshold and the posture state corresponding to the last specified time length is the non-standing posture mode, determining that the current posture state of the user is the standing posture state; or
[0146] if the height change amount is not greater than the specified threshold and the posture state corresponding to the last specified time length is the standing posture mode, determining that the current posture state of the user is the standing posture state; or
[0147] if the height change amount is not greater than the specified threshold and the posture state corresponding to the last specified time length is the non-standing posture mode, determining that the current posture state of the user is the non-standing posture state.
[0148] In an embodiment, the target display mode includes a target origin tracking mode and a target view angle, and the target origin tracking mode is a floor origin mode or a head-mounted device origin mode.
[0149] The target display mode determination module 1030 is specifically configured to:
[0150] if the current posture state of the user is the sitting posture state, determining that the target origin tracking mode is the head-mounted device origin mode, and obtaining the target view angle by using a target height of the user, wherein the target height is a height when the posture state of the user is first acquired as the standing posture state or a standard height set in advance; or
[0151] if the current posture state of the user is the standing posture mode, determining that the target origin tracking mode is the floor origin mode, and obtaining the target view angle by using a current VR head-mounted device height of the user every second specified time length.
[0152] In an embodiment, the target display mode determination module 1030 performs the obtaining the target view angle by using the target height of the user is specifically configured to:
[0153] obtaining a target view angle corresponding to the target height by using a preset corresponding relationship between heights and view angles;
[0154] The target display mode determination module 1030 performs the obtaining the target view angle by using the current VR head-mounted device height of the user is specifically configured to:
[0155] obtaining a target view angle corresponding to the current VR head-mounted device height of the user by using a preset corresponding relationship between heights and view angles.
[0156] In an embodiment, the apparatus further includes:
[0157] a target height determination module 1050 configured to obtain the target height of the user by:
[0158] If the height of the user in the standing posture state is not currently acquired, the standard height is determined as the target height; or,
[0159] If the height of the user in the standing posture state is currently acquired, the height of the user in the standing posture state is determined as the target height.
[0160] In one embodiment, the display module 1040 is further configured to:
[0161] If the request of canceling the display mode switching sent by the user is received, the VR scene is displayed based on the current display mode.
[0162] After introducing the VR scene display method and device according to one of the exemplary embodiments of the present application, next, the VR device according to another exemplary embodiment of the present application is introduced.
[0163] Those skilled in the art can understand that various aspects of the present application can be implemented as a system, a method or a program product. Therefore, various aspects of the present application can be embodied as a complete hardware embodiment, a complete software embodiment (including firmware, microcode, etc.), or an embodiment combining hardware and software aspects, which can be collectively referred to as "circuitry", "module" or "system".
[0164] In some possible embodiments, the VR device according to the present application can include at least one processor and at least one computer storage medium. The computer storage medium stores program codes which, when executed by the processor, cause the processor to perform the steps in the VR scene display method according to various exemplary embodiments of the present application described above in the specification. For example, the processor can perform steps 301-304 as shown in Figure 3
[0165] The VR device 1100 according to this embodiment of the present application will be described below with reference to Figure 11 Figure 11 The VR device 1100 is only an example and should not impose any limitation on the functions and use range of the embodiments of the present application.
[0166] As shown in Figure 11 The VR device 1100 is in the form of a general VR device. The components of the VR device 1100 can include but are not limited to the above-mentioned at least one processor 1101, the above-mentioned at least one computer storage medium 1102, and a bus 1103 connecting different system components including the computer storage medium 1102 and the processor 1101.
[0167] Bus 1103 represents one or more of several possible bus structures, including a computer storage bus or computer storage bus controller, a peripheral bus, a processor bus, or a local bus using any of a variety of bus architectures.
[0168] Computer storage media 1102 can include read-only computer storage media in the form of volatile computer storage media, such as random access computer storage media (RAM) 1121 and / or cache memory computer storage media 1122, and further can include read-only computer storage media (ROM) 1123.
[0169] Computer storage media 1102 can also include program / utility 1125 having a set of programs / modules 1124, including but not limited to, operating systems, one or more application programs, other program modules, and program data, each of which can implement aspects of a network environment, and each or a combination thereof.
[0170] VR device 1100 can also communicate with one or more external devices 1104 such as a keyboard, a pointing device, etc.; and a device that enables a user to interact with VR device 1100 and / or any devices (e.g., routers, modems, etc.) that enable VR device 1100 to communicate with one or more other VR devices. Such communication can occur via Input / Output (I / O) interface(s) 1105. Still yet, VR device 1100 can communicate with one or more networks, such as a local area network (LAN), a wide area network (WAN), and / or the Internet, through network adapter 1106. As depicted, network adapter 1106 communicates with the other components of VR device 1100 via bus 1103. It should be appreciated that although not shown, other hardware and / or software modules could be used in conjunction with VR device 1100. Such as, but not limited to, microcode, device drivers, redundant processing units, external disk drive arrays, RAID systems, tape drives, and data archival storage systems, etc.
[0171] In some possible embodiments, each aspect of the method for displaying a VR scene provided by the present application can also be implemented in the form of a program product, which includes program codes for causing a computer device to execute the steps of the method for displaying a VR scene according to various exemplary embodiments of the present application described above in the specification when the program product is run on the computer device.
[0172] Obviously, many modifications and variations of the present application are possible in light of the above teachings. It is, therefore, to be understood that within the scope of the appended claims and their equivalents, the application can be practiced otherwise than as specifically described.
Claims
1. A method of displaying a VR scene, the method comprising: The method comprises: Every first specified time length, using the current VR headset height of the user and the VR headset height corresponding to the last specified time length, determining the current posture state of the user, wherein the posture state is a standing posture state or a non-standing posture state; If the current posture state of the user is different from the posture state determined in the last specified time length, prompting the user whether to switch the display mode, wherein the display mode comprises an origin tracking mode and a visual angle; If a request for switching the display mode sent by the user is received, obtaining a target display mode based on the current posture state of the user, wherein the target display mode comprises a target origin tracking mode and a target visual angle; Adjusting the current origin tracking mode to the target origin tracking mode, and displaying the VR scene by using the target visual angle.
2. The method of claim 1, wherein, If the current VR headset height is the first acquired VR headset height, determining a first height set in advance as the VR headset height corresponding to the last specified time length; The method comprises: If the current VR headset height of the user is less than the VR headset height corresponding to the last specified time length, determining the current posture state of the user as the non-standing posture state; Or, If the current VR headset height of the user is not less than the VR headset height corresponding to the last specified time length, determining the current posture state of the user as the standing posture state.
3. The method of claim 1, wherein, If the current VR headset height is not the first acquired VR headset height; The method comprises: According to the current VR headset height of the user and the VR headset height corresponding to the last specified time length, obtaining a height change amount; If the height change amount is greater than a specified threshold value, and the posture state corresponding to the last specified time length is the standing posture state, determining the current posture state of the user as the non-standing posture state; or, If the height change amount is greater than the specified threshold value, and the posture state corresponding to the last specified time length is the non-standing posture state, determining the current posture state of the user as the standing posture state; or, If the height change amount is not greater than the specified threshold value, and the posture state corresponding to the last specified time length is the standing posture state, determining the current posture state of the user as the standing posture state; or, If the height change amount is not greater than the specified threshold value, and the posture state corresponding to the last specified time length is the non-standing posture state, determining the current posture state of the user as the non-standing posture state.
4. The method of claim 1, wherein, The method comprises: If the current posture state of the user is a sitting posture state, determining the target origin tracking mode as a headset origin mode, and obtaining the target visual angle by using the target height of the user, wherein the target height is the height when the posture state of the user is first acquired as a standing posture state or a standard height set in advance; or, If the current posture state of the user is a standing posture state, it is determined that the target origin tracking mode is a floor origin mode, and the target view angle is obtained by using the current VR head-mounted display height of the user every second specified time length.
5. The method of claim 4, wherein, The target view angle obtained by using the target height of the user comprises: A target view angle corresponding to the target height is determined by using a pre-set corresponding relationship between height and view angle. The target view angle obtained by using the current VR head-mounted display height of the user comprises: A target view angle corresponding to the current VR head-mounted display height of the user is determined by using a pre-set corresponding relationship between height and view angle.
6. The method according to claim 4 or 5, characterized in that, The target height of the user is obtained in the following manner: If the height of the user in the standing posture state is not currently obtained, the standard height is determined as the target height; or, If the height of the user in the standing posture state is currently obtained, the height of the user in the standing posture state obtained for the first time is determined as the target height.
7. The method of claim 1, wherein, The method further comprises: If the request for canceling the display mode switching sent by the user is received, the VR scene is displayed based on the current display mode.
8. A VR device, comprising: The processor and the memory are connected through a bus; The memory stores a computer program, and the processor is configured to execute the following operations based on the computer program: Every first specified time length, the current posture state of the user is determined by using the current VR head-mounted display height of the user and the VR head-mounted display height corresponding to the last specified time length, wherein the posture state is a standing posture state or a non-standing posture state; If the current posture state of the user is different from the posture state determined in the last specified time length, it is prompted whether the user needs to switch the display mode, wherein the display mode comprises an origin tracking mode and a view angle; If the request for switching the display mode sent by the user is received, a target display mode is obtained based on the current posture state of the user, wherein the target display mode comprises a target origin tracking mode and a target view angle; The current origin tracking mode is adjusted to the target origin tracking mode, and the VR scene is displayed by using the target view angle.
9. The VR device of claim 8, wherein, If the current VR head-mounted display height is the VR head-mounted display height obtained for the first time, a pre-set first height is determined as the VR head-mounted display height corresponding to the last specified time length; The processor executes the determination of the current posture state of the user by using the current VR head-mounted display height of the user and the VR head-mounted display height corresponding to the last specified time length, and is specifically configured to: If the current VR head-mounted display height of the user is less than the VR head-mounted display height corresponding to the last specified time length, it is determined that the current posture state of the user is the non-standing posture state; Or, If the current VR head-mounted display height of the user is not less than the VR head-mounted display height corresponding to the last specified time length, it is determined that the current posture state of the user is the standing posture state.
10. The VR device of claim 8, wherein, If the current VR head-mounted display height is a non-first obtained VR head-mounted display height; The processor is configured to determine the current posture state of the user by using the current VR headset height of the user and the VR headset height corresponding to a previous specified time length, specifically configured to: obtain a height change amount according to the current VR headset height of the user and the VR headset height corresponding to the previous specified time length; if the height change amount is greater than a specified threshold, and the posture state corresponding to the previous specified time length is the standing posture state, determine that the current posture state of the user is the non-standing posture state; or, if the height change amount is greater than the specified threshold, and the posture state corresponding to the previous specified time length is the non-standing posture state, determine that the current posture state of the user is the standing posture state; or, if the height change amount is not greater than the specified threshold, and the posture state corresponding to the previous specified time length is the standing posture state, determine that the current posture state of the user is the standing posture state; or, if the height change amount is not greater than the specified threshold, and the posture state corresponding to the previous specified time length is the non-standing posture state, determine that the current posture state of the user is the non-standing posture state.
Citation Information
Patent Citations
Animation data processing method and device, program product, medium and electronic equipment
CN114332317A
Method for generating image to be displayed on head tracking type virtual reality head mounted display and image generation device
US20170076503A1