Method and device for displaying in virtual scene, equipment and storage medium
By dynamically adjusting the display area size and content display style in the virtual scene, the user experience problem caused by the fixed display area size in the XR virtual scene is solved, and an immersive experience that is more in line with user habits is achieved.
Patent Information
- Application Number
- CN202310524695.2
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2023-05-10
- Publication Date
- 2024-11-12
AI Technical Summary
In extended reality (XR) virtual scenes, the traditional display area size is fixed, resulting in poor visibility of the display area when the user's viewing angle changes, affecting the user experience.
By determining the user's viewpoint description information in the virtual scene, the size of the display area and the content display style are dynamically adjusted to adapt to the user's viewpoint changes.
Improves user experience, ensures that the content always conforms to the user's interaction habits in virtual scenes, and enhances the immersive experience.
Smart Images

Figure CN118939106A_ABST
Abstract
Description
Technical Field
[0001] Example embodiments of the present disclosure generally relate to the field of computers, and more particularly, to methods, devices, apparatuses, and computer-readable storage media for displaying in a virtual scene. Background Art
[0002] Extended Reality (XR) has been widely studied and applied. XR integrates virtual content and real scenes by combining hardware devices and a variety of technical means to provide users with a unique sensory experience. XR includes, for example, Virtual Reality (VR), Augmented Reality (AR), Mixed Reality (MR), etc. VR is a virtual world that uses computers to simulate three-dimensional space, providing users with an immersive experience in vision, hearing, touch, etc. AR allows the real environment and virtual objects to be superimposed in the same space in real time and exist at the same time. MR is a new visualization environment that integrates the real world and the virtual world, where objects in the physical real world scene coexist with objects in the virtual world in real time.
[0003] Therefore, XR-based virtual scenes can be used to provide users with an immersive interactive experience. Summary of the invention
[0004] In a first aspect of the present disclosure, a method for displaying in a virtual scene is provided. The method comprises: determining viewpoint description information associated with a user's viewpoint in the virtual scene, the viewpoint comprising an expected viewpoint or a real-time viewpoint of the user; determining size information of a display area in the virtual scene based on the viewpoint description information; and determining a display style of content in the display area based on the size information.
[0005] In a second aspect of the present disclosure, a device for displaying in a virtual scene is provided. The device includes: a description information determination module configured to determine viewpoint description information associated with a user's viewpoint in the virtual scene, the viewpoint including the user's expected viewpoint or real-time viewpoint; a size information determination module configured to determine size information of a display area in the virtual scene based on the viewpoint description information; and a display style determination module configured to determine a display style of content in the display area based on the size information.
[0006] In a third aspect of the present disclosure, an electronic device is provided. The device includes at least one processing unit; and at least one memory, the at least one memory is coupled to the at least one processing unit and stores instructions for execution by the at least one processing unit. When the instructions are executed by the at least one processing unit, the device executes the method of the first aspect.
[0007] In a fourth aspect of the present disclosure, a computer-readable storage medium is provided, wherein a computer program is stored on the computer-readable storage medium, and the computer program can be executed by a processor to implement the method of the first aspect.
[0008] It should be understood that the contents described in the summary of the present invention are not intended to limit the key features or important features of the embodiments of the present disclosure, nor are they intended to limit the scope of the present disclosure. Other features of the present disclosure will become easily understood through the following description. BRIEF DESCRIPTION OF THE DRAWINGS
[0009] The above and other features, advantages and aspects of the embodiments of the present disclosure will become more apparent with reference to the following detailed description in conjunction with the accompanying drawings. In the accompanying drawings, the same or similar reference numerals represent the same or similar elements, wherein:
[0010] Figure 1 Schematic diagrams showing a number of example environments in which embodiments of the present disclosure can be implemented;
[0011] Figure 2A and Figure 2B shows an example virtual scene according to some embodiments of the present disclosure;
[0012] Figure 3A and Figure 3B A schematic diagram showing determining size information according to some embodiments of the present disclosure is shown;
[0013] Figure 4 A schematic diagram showing a process of displaying in a virtual scene according to some embodiments of the present disclosure;
[0014] Figure 5 A block diagram showing an apparatus for displaying in a virtual scene according to some embodiments of the present disclosure; and
[0015] Figure 6 A block diagram of a device capable of implementing various embodiments of the present disclosure is shown. DETAILED DESCRIPTION
[0016] It is understandable that before using the technical solutions disclosed in the embodiments of the present disclosure, the types, scope of use, usage scenarios, etc. of the personal information involved in the present disclosure should be informed to the user and the user's authorization should be obtained in an appropriate manner in accordance with relevant laws and regulations.
[0017] For example, in response to receiving an active request from a user, a prompt message is sent to the user to clearly prompt the user that the operation requested to be performed will require obtaining and using the user's personal information. Thus, the user can autonomously choose whether to provide personal information to software or hardware such as an electronic device, application, server, or storage medium that performs the operation of the technical solution of the present disclosure according to the prompt message.
[0018] As an optional but non-limiting implementation, in response to receiving an active request from the user, the prompt information may be sent to the user in the form of a pop-up window, in which the prompt information may be presented in text form. In addition, the pop-up window may also carry a selection control for the user to choose "agree" or "disagree" to provide personal information to the electronic device.
[0019] It is understandable that the above notification and the process of obtaining user authorization are merely illustrative and do not constitute a limitation on the implementation of the present disclosure. Other methods that meet the relevant laws and regulations may also be applied to the implementation of the present disclosure.
[0020] It is understandable that the data involved in this technical solution (including but not limited to the data itself, the acquisition or use of the data) shall comply with the requirements of relevant laws, regulations and relevant provisions.
[0021] Embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. Although certain embodiments of the present disclosure are shown in the accompanying drawings, it should be understood that the present disclosure can be implemented in various forms and should not be construed as being limited to the embodiments set forth herein. On the contrary, these embodiments are provided to provide a more thorough and complete understanding of the present disclosure. It should be understood that the drawings and embodiments of the present disclosure are only for exemplary purposes and are not intended to limit the scope of protection of the present disclosure.
[0022] It should be noted that the titles of any sections / subsections provided herein are not restrictive. Various embodiments are described throughout this article, and any type of embodiment may be included under any section / subsection. In addition, the embodiments described in any section / subsection may be combined in any manner with any other embodiments described in the same section / subsection and / or different sections / subsections.
[0023] In the description of the embodiments of the present disclosure, the term "including" and similar terms should be understood as open inclusion, that is, "including but not limited to". The term "based on" should be understood as "based at least in part on". The term "one embodiment" or "the embodiment" should be understood as "at least one embodiment". The term "some embodiments" should be understood as "at least some embodiments". Other explicit and implicit definitions may be included below. The terms "first", "second", etc. may refer to different or the same objects. Other explicit and implicit definitions may be included below.
[0024] As used herein, the term "model" can learn the association between the corresponding input and output from the training data, so that after the training is completed, the corresponding output can be generated for a given input. The generation of the model can be based on machine learning technology. Deep learning is a machine learning algorithm that processes inputs and provides corresponding outputs by using multiple layers of processing units. In this article, "model" may also be referred to as "machine learning model", "machine learning network" or "network", which are used interchangeably in this article. A model may also include different types of processing units or networks.
[0025] As used herein, a "unit", "operating unit" or "subunit" may consist of a machine learning model or network of any suitable structure. As used herein, a group of elements or similar expressions may include one or more such elements. For example, a "group of convolutional units" may include one or more convolutional units.
[0026] In an XR-based virtual scene, some content may be presented through a display area. Such a display area may be referred to as a display block or a patch, for example. Traditionally, in an XR-based virtual scene, such a display area is usually configured to have a fixed display size in the display area.
[0027] However, when the user's perspective changes in the virtual scene, the visibility of such a display area relative to the user will change, which may cause the user's experience of obtaining the content in the display area to deteriorate. For example, when the user is far away from such a display area, such display content may not be effectively obtained because the distance is too far.
[0028] The embodiments of the present disclosure provide a solution for displaying in a virtual scene. According to various embodiments of the present disclosure, viewpoint description information associated with a user's viewpoint in a virtual scene can be determined, wherein the viewpoint includes an expected viewpoint or a real-time viewpoint of the user. Further, the size information of a display area in the virtual scene can be determined based on the viewpoint description information. Accordingly, the display style of content in the display area can be determined based on the size information.
[0029] It should be understood that the point of sight represents the virtual viewing position of the user in the virtual scene, which may correspond to the position of the user's eyes in the virtual scene, or the position of a virtual camera in the virtual scene corresponding to the picture generation, for example.
[0030] Based on this approach, the embodiments of the present disclosure can adaptively determine the size of the display area according to the user's real-time viewpoint or expected viewpoint in the virtual scene, and accordingly determine the display style of the content in the display area according to the size. Thus, the embodiments of the present disclosure can adaptively determine the display style of the content in the virtual scene according to the user's viewpoint, thereby better conforming to the user's interaction habits and improving the user experience.
[0031] Example Environment
[0032] Figure 1 A schematic diagram of an example environment 100 in which embodiments of the present disclosure can be implemented is shown. In the environment 100, a user 140 may wear an XR device 110. The XR device 110 communicates with a computing device 120 to construct a virtual scene for the user 140 or merge virtual content with a real scene.
[0033] In some embodiments, the environment 110 also includes other users (not shown in the figure), for example, other users can wear corresponding XR devices, and can communicate with the XR device 110 or the computing device 120 by wire or wireless communication, thereby building a common virtual scene for multiple users without restricting the users to be in the same physical space. In this disclosure, users are also referred to as operators. Virtual scenes constructed based on VR technology, and scenes that integrate virtual content and real scenes based on AR technology or MR technology are collectively referred to as virtual scenes 130.
[0034] The XR device 110 may be a head-mounted or wearable near-eye display device, such as a head-mounted display, smart glasses, etc., supporting technologies such as VR, AR, and MR. The XR device 110 may include an image generation component and an optical display component for constructing a virtual scene 130 and displaying virtual objects in a monocular or binocular field of view. Virtual objects may include three-dimensional virtual objects and / or two-dimensional virtual objects. Virtual objects are, for example, display blocks in a virtual scene 130. In some examples, a display block may be a two-dimensional window without thickness, which is used to load content such as web pages and documents. In some examples, a display block is also referred to as a "facet."
[0035] In some embodiments, the computing device 120 may be a separate device capable of communicating with the XR device 110 and / or other image capture devices, such as a server, computing node, etc. for image or data processing, or may be integrated with the XR device 110 and / or other image capture devices. In some embodiments, the computing device 120 may be implemented as an XR device 110, that is, in this case, the XR device 110 may implement all functions of the computing device 120. It should be understood that the above description of the computing device 120 is merely exemplary and non-restrictive, and the computing device 120 may be implemented as a variety of forms, structures or categories of devices, and the embodiments of the present disclosure are not limited thereto.
[0036] It should be understood that the structure and functionality of environment 100 are described for exemplary purposes only and does not imply any limitation on the scope of the present disclosure.
[0037] Some example embodiments of the present disclosure will be described below with continued reference to the accompanying drawings.
[0038] Sample virtual scene
[0039] Figure 2A and Figure 2B An example virtual scene 200 according to some embodiments of the present disclosure is shown. Such a virtual scene 200 may be, for example, Figure 1 Provided by the XR device 110 shown in .
[0040] like Figure 2A As shown, the XR device 110 can, for example, provide a virtual scene 200. Such a virtual scene 205 may include a VR scene, an AR scene, or an MR scene.
[0041] As shown in the figure, the virtual scene 200 may include a display area 220 for displaying content 230. Such content 230 may include any appropriate content, examples of which may include but are not limited to: text content, image content, graphic content, video content, etc.
[0042] Exemplarily, such a display area 220 may be provided in association with a virtual desktop 215 in the virtual scene 200. Such a virtual desktop may be constructed corresponding to a physical desktop in a real environment, for example, to provide users with an experience similar to real desktop office work.
[0043] In some embodiments, such a display area 220 may be presented as a planar display area, such as a flat display area or a curved display area. In some embodiments, such a display area 220 may be displayed in a user-specific display domain (also referred to as a private domain), which makes such a display area 220 invisible to other users in the virtual scene 200, for example.
[0044] On the contrary, the virtual scene 200 may also include content displayed in a public display domain (also referred to as a public domain), for example. Such content is visible to all users of the virtual scene 200 .
[0045] In the private domain, by providing the user with a display area in which the content display style is determined according to the viewpoint, the implementation of the present disclosure can avoid interference of such personalized display on other users.
[0046] Continue to refer Figure 2A In the virtual scene 200, each user may have a corresponding viewpoint 210. Such a viewpoint may be determined based on the position of the XR device 110 worn by the user, and may be dynamically determined by, for example, an appropriate view tracking technology (e.g., eye tracking, head tracking, etc.). The present disclosure is not intended to limit the manner in which the viewpoint 210 is determined.
[0047] Figure 2B The virtual scene 200 is shown from another perspective. Figure 2B As shown, in some scenarios, the display area 220 may be, for example, at a certain angle relative to the reference plane 240 (e.g., the virtual desktop 215, or the horizontal plane of the virtual scene). This enables the user to obtain an effect similar to that of a real display when viewing such a display area 220, thereby improving the user's interactive experience.
[0048] The following will be combined Figure 3A and Figure 3B The process of determining the size information of the display area 220 will be described below.
[0049] Determination of the size information of the display area
[0050] Figure 3A and Figure 3B A schematic diagram of determining size information according to some embodiments of the present disclosure is shown. Figure 3A A side view showing an example of determining dimensional information; Figure 3B A top view of an example of determining sizing information is shown.
[0051] First reference Figure 3A As shown in the figure, the XR device 110 may first determine the viewpoint description information associated with the user's viewpoint 210. Such a viewpoint 210 may include, for example, the user's real-time viewpoint, for example, changing as the user moves in the virtual scene. Alternatively, such a viewpoint 210 may include, for example, the user's expected viewpoint, for example, which may be determined based on the user's body shape information (e.g., height, arm length). This allows users of different body shapes to have different expected viewpoints in the virtual scene.
[0052] In some embodiments, the viewpoint description information may indicate a first distance of the viewpoint to a reference plane associated with the display area.
[0053] In some embodiments, viewpoint 210 is a real-time viewpoint, and XR device 110 may accordingly determine a first distance from viewpoint 210 to a reference plane associated with display area 220 (which may be parallel to reference plane 240 and the same as or different from reference plane 240 ).
[0054] For example, Figure 2A As an example, when the distance between the bottom of the display area 220 and the reference plane 240 is less than a threshold, the reference plane 240, for example, may be determined as the reference plane associated with the display area 220. As another example, if the distance between the bottom of the display area 220 and the reference plane 240 is greater than or equal to a threshold, the XR device 110 may determine the reference plane associated with the display area 220 based on the bottom of the display area 220, for example.
[0055] by Figure 3A As an example, the XR device 110 may determine a vertical distance (as shown in the figure) from the viewpoint 210 to the horizontal plane where the lower end position 310 of the display area 220 is located. In some embodiments, the viewpoint 210 may include, for example, a real-time viewpoint of a user, and the XR device may determine the vertical distance based on the position of the real-time viewpoint and the position of the lower end position 310.
[0056] In some embodiments, the viewpoint 210 is an expected viewpoint, and the XR device 110 may obtain body shape information associated with the user, and determine, based on the body shape information, a first distance from the viewpoint 210 to a reference plane associated with the display area 220. It should be understood that the body shape information of the user is obtained with the knowledge and permission of the user, and may be based on real-time measurement or configuration information of the user, for example.
[0057] Exemplarily, the XR device 110 may obtain the height information of the user, and determine, according to the height information, a first distance from the expected viewpoint to a reference plane associated with the display area 220. For example, the XR device 110 may determine the first distance according to a preset ratio of the height of the user.
[0058] Additionally, the viewpoint description information may further indicate a second distance between the viewpoint and the display area in a preset direction, wherein the preset direction is parallel to the reference plane.
[0059] In some embodiments, the viewpoint 210 is a real-time viewpoint, and the XR device 110 may also determine a second distance between the viewpoint 210 and the display area 220 in a preset direction based on the viewpoint 210, wherein the preset direction is parallel to the reference plane. For example, the XR device 110 may determine the distance between the viewpoint 210 and the lower end position 310 of the display area 220 in the horizontal direction (as shown in the figure, distance b).
[0060] In some embodiments, the viewpoint 210 is an expected viewpoint. The XR device 110 may, for example, obtain body shape information associated with the user and determine a second distance between the viewpoint 210 and the display area 220 in a preset direction based on the body shape information.
[0061] Exemplarily, the XR device 110 may obtain the arm length information of the user, and determine the second distance from the expected viewpoint to the display area 220 in the preset direction according to the arm length information. For example, the XR device 110 may set the arm length of the user as the second distance.
[0062] Accordingly, the straight-line distance from the viewpoint 210 to the lower end position 310 of the display area 220 can be expressed as
[0063] In some embodiments, as described above, the display area 220 may be at a certain angle to the reference plane 240, which may be represented as follows: Figure 3A The first angle 350 in the image display device 100 is a first angle 350. Such a first angle 350 may be, for example, a preset angle (eg, 60 degrees), which may conform to the viewing habits of the user, and may be user-configurable.
[0064] In some embodiments, XR device 110 may also determine a second angle, where the second angle indicates a preset vertical field of view range of the user. Figure 3A As shown, such a preset vertical field of view range may be represented as a second angle 340. The second angle 340 may be a preset angle value (eg, 60 degrees), which may conform to the user's habit of viewing content, and may be user-configurable.
[0065] Furthermore, the angle 330 can be obtained, for example, by trigonometric functions, which can be expressed as tan -1 (a / b). Accordingly, the angle 360 can be determined as (the first angle 350+the angle 330-the second angle 340).
[0066] Further, the XR device 110 may determine that the maximum length of the display area 220 in the vertical direction (for example, that is, the maximum length H from the lower endpoint 310 to the upper endpoint 320) may be expressed as:
[0067]
[0068] Wherein, a represents the first distance, b represents the second distance, θ1 represents the first angle, and θ2 represents the second angle.
[0069] In some embodiments, after determining the maximum length (eg, maximum length H) of the display area 220 in the first direction, the XR device 110 may further determine the display length of the display area 220 in the first direction based on the maximum length.
[0070] In some embodiments, the XR device 110 may directly determine the maximum length as the actual display length of the display area 220 in the first direction, so that the size of the display area 220 can be adaptively determined according to the viewpoint 210 .
[0071] In some embodiments, the XR device 110 may also determine a preset length of the display area 220 in the first direction. The XR device 110 may determine a third distance from the display area to the reference plane (e.g., the distance from the upper endpoint 320 of the display area 220 to the horizontal axis) based on the first distance a from the viewpoint to the reference plane, so that the third distance is less than the first distance, for example, this may make the upper edge of the display area 220 not exceed the height of the viewpoint 210. By setting the upper edge of the display area 220 not to exceed the height of the viewpoint 210, the embodiments of the present disclosure can reduce the interference of the display area with the user viewing other content in the virtual environment.
[0072] Further, the XR device 110 may also determine a preset length of the display area 220 in the first direction based on the third distance and the first angle 350 of the display area 220 .
[0073] Further, the XR device 110 may determine the actual display length of the display area 220 based on a comparison between the preset length and the maximum length. For example, if the preset length is less than the maximum length, the actual display length of the display area 220 may be determined as the preset length. On the contrary, if the preset length is greater than the maximum length, the actual display length of the display area 220 may be determined as the maximum length. In this way, the embodiments of the present disclosure can also ensure that the presentation of the display area can meet the configuration requirements for its size during design.
[0074] In some embodiments, the XR device 110 may also determine a display length (also referred to as a display width) of the display area in the second direction based on the second distance and a preset third angle, wherein the third angle indicates a preset horizontal field of view of the user. Figure 3B As shown, the preset horizontal field of view range may be represented as a third angle 390. The third angle 390 may be a preset angle value (eg, 60 degrees), which may conform to the user's habit of viewing content and may be user-configurable.
[0075] Further, the XR device 110 may be based on the second distance (eg, Figure 3B The distance b) and the third angle (e.g., Figure 3B The display length L of the display area 220 in the second direction (eg, the horizontal direction) (ie, the distance between the left endpoint 370 and the right endpoint 380) is determined by:
[0076]
[0077] Wherein, b represents the second distance, and θ3 represents the third angle.
[0078] Based on the process introduced above, the embodiments of the present disclosure can dynamically determine the size information of the display area according to the user's viewing angle, thereby better meeting the user's viewing habits and improving the user's interactive experience.
[0079] Display style determination based on size
[0080] In some embodiments, after determining the size information of the display area 220 , the XR device 110 may also determine the display style of the content 230 in the display area 220 accordingly according to the size information.
[0081] In some embodiments, such a display style may include a layout of the content 230. For example, when it is determined that the display area 220 has a larger display size, the display area 220 may be arranged with more windows (for example, from the preset 3 windows to 4 or more).
[0082] In addition, such a layout may also indicate the distribution form of the content 230. For example, the XR device 110 may determine whether the content 230 in the display area 220 is distributed horizontally, vertically, or in other appropriate distribution forms according to the length and width information.
[0083] In some embodiments, such a display style may include the display size of elements in the content 230. For example, the display style may indicate the font size of the text, the image size, the icon size, etc. in the content 230 to adapt to the determined size of the determined display area.
[0084] In some embodiments, XR device 110 may perform static display area determination based on an initial viewpoint or a default viewpoint of the user.
[0085] In some embodiments, XR device 110 may also track updates to the user's viewpoint and adjust the size of the display area and / or the style of the content in the display area according to the updated viewpoint.
[0086] Specifically, the XR device 110 may determine an updated viewpoint of the user, and based on the updated viewpoint, determine updated size information of the display area, and may determine an updated display style of the content in the display area based on the updated size information.
[0087] In some embodiments, such an update may be performed in real time, or may be performed at a predetermined period. In some embodiments, the XR device 110 may present a display area with updated size information and / or content with an updated display style in real time.
[0088] In some embodiments, the XR device 110 may perform an update of the display in the virtual scene based on the updated size information and / or the updated display style only when the user's field of view is not focused on the display area 200 .
[0089] In some embodiments, the XR device 110 may also determine the degree of change of the size information of the display area based on the updated viewpoint. Further, only when it is determined that the degree of change exceeds a threshold value, the XR device 110 determines the updated display style of the content in the display area. Thus, the embodiments of the present disclosure can reduce the update frequency of the display style, thereby reducing the computing cost and possible interference to the user.
[0090] Example Process
[0091] Figure 4 4 is a flowchart of a process 400 for displaying in a virtual scene according to some embodiments of the present disclosure. The process 400 may be implemented at the computing device 120. Figure 1 Process 400 is described.
[0092] like Figure 4 As shown, at block 410 , computing device 120 determines viewpoint description information associated with a user's viewpoint in a virtual scene, including an intended viewpoint or a real-time viewpoint of the user.
[0093] In block 420 , the computing device 120 determines size information of a display area in the virtual scene based on the viewpoint description information.
[0094] In block 430 , computing device 120 determines a display style of the content in the display area based on the size information.
[0095] In some embodiments, the viewpoint includes an expected viewpoint, and determining viewpoint description information associated with the expected viewpoint of the user in the virtual scene includes: obtaining body shape information associated with the user; and determining viewpoint description information associated with the expected viewpoint based on the body shape information.
[0096] In some embodiments, the body shape description information indicates at least the length of a predetermined body part of the user.
[0097] In some embodiments, the viewpoint description information indicates at least: a first distance from the viewpoint to a reference plane associated with the display area; and a second distance from the viewpoint to the display area in a preset direction, the preset direction being parallel to the reference plane.
[0098] In some embodiments, determining the size information of the display area based on the viewpoint description information includes: determining the size information of the display area based on the first distance and the second distance indicated by the viewpoint description information.
[0099] In some embodiments, the display area is at a first angle relative to the user's field of view, and determining the size information of the display area based on the first distance and the second distance includes: determining the maximum length of the display area in the first direction based on the first distance, the second distance and the first angle.
[0100] In some embodiments, determining the maximum length of the display area in the first direction based on the first distance, the second distance, and the first angle includes: determining the second angle, the second angle indicating a preset vertical field of view of the user; and determining the maximum length of the display area in the first direction based on the first distance, the second distance, the first angle, and the second angle.
[0101] In some embodiments, determining the size information of the display area further includes: determining a preset length of the display area in the first direction; and determining a display length of the display area in the first direction based on a comparison between the preset length and the maximum length.
[0102] In some embodiments, determining a preset length of the display area in the first direction includes: determining a third distance from the display area to a reference plane based on the first distance, such that the third distance is less than the first distance; and determining a preset length of the display area in the first direction based on the third distance and a first angle of the display area.
[0103] In some embodiments, determining the size information of the display area includes: determining a display length of the display area in the second direction based on the second distance and a preset third angle, the third angle indicating a preset horizontal field of view of the user.
[0104] In some embodiments, process 400 also includes presenting the content in the display area according to the style in a display domain specific to the user.
[0105] In some embodiments, the viewpoint includes a real-time viewpoint, and process 400 further includes: determining an updated viewpoint of the user in the virtual environment; and determining an updated display style of the content in the display area based on the updated viewpoint.
[0106] In some embodiments, determining an updated display style of content in the display area includes: determining a degree of change in size information of the display area based on an updated viewpoint; and determining an updated display style of content in the display area in response to the degree of change exceeding a threshold.
[0107] In some embodiments, the display style includes the layout of the content and / or the display size of elements in the content.
[0108] Example devices and equipment
[0109] Figure 5 A schematic structural block diagram of an apparatus 500 for displaying in a virtual scene according to some embodiments of the present disclosure is shown. The apparatus 500 may be implemented as or included in a computing device 120. Each module / component in the apparatus 500 may be implemented by hardware, software, firmware, or any combination thereof.
[0110] As shown in the figure, the device 500 includes a description information determination module 510, which is configured to determine viewpoint description information associated with the user's viewpoint in the virtual scene, the viewpoint including the user's expected viewpoint or real-time viewpoint; a size information determination module 520, which is configured to determine the size information of the display area in the virtual scene based on the viewpoint description information; and a display style determination module 530, which is configured to determine the display style of the content in the display area based on the size information.
[0111] In some embodiments, the viewpoint includes an expected viewpoint, and the description information determination module 510 is further configured to: obtain body shape information associated with the user; and determine viewpoint description information associated with the expected viewpoint based on the body shape information.
[0112] In some embodiments, the body shape description information indicates at least the length of a predetermined body part of the user.
[0113] In some embodiments, the viewpoint description information indicates at least: a first distance from the viewpoint to a reference plane associated with the display area; and a second distance from the viewpoint to the display area in a preset direction, the preset direction being parallel to the reference plane.
[0114] In some embodiments, the size information determination module 520 is further configured to determine the size information of the display area based on the first distance and the second distance indicated by the viewpoint description information.
[0115] In some embodiments, the display area is at a first angle relative to the user's field of view, and the size information determination module 520 is further configured to determine a maximum length of the display area in the first direction based on the first distance, the second distance, and the first angle.
[0116] In some embodiments, the size information determination module 520 is further configured to: determine a second angle, the second angle indicating a preset vertical field of view of the user; and determine a maximum length of the display area in the first direction based on the first distance, the second distance, the first angle and the second angle.
[0117] In some embodiments, the size information determination module 520 is further configured to: determine a preset length of the display area in the first direction; and determine a display length of the display area in the first direction based on a comparison between the preset length and the maximum length.
[0118] In some embodiments, the size information determination module 520 is further configured to: determine a third distance from the display area to the reference plane based on the first distance, so that the third distance is smaller than the first distance; and determine a preset length of the display area in the first direction based on the third distance and the first angle of the display area.
[0119] In some embodiments, the size information determination module 520 is further configured to determine a display length of the display area in the second direction based on the second distance and a preset third angle, where the third angle indicates a preset horizontal field of view of the user.
[0120] In some embodiments, the apparatus 500 further comprises a content in-presentation module configured to present the content in the display area according to a style in a display domain specific to the user.
[0121] In some embodiments, the viewpoint includes a real-time viewpoint, and the apparatus 500 further includes an update module configured to: determine an updated viewpoint of the user in the virtual environment; and determine an updated display style of the content in the display area based on the updated viewpoint.
[0122] In some embodiments, the update module is further configured to: determine the degree of change of the size information of the display area based on the update viewpoint; and determine an updated display style of the content in the display area in response to the degree of change exceeding a threshold.
[0123] In some embodiments, the display style includes the layout of the content and / or the display size of elements in the content.
[0124] Figure 6 A block diagram illustrating a computing device 600 in which one or more embodiments of the present disclosure may be implemented is shown. It should be understood that Figure 6 The computing device 600 shown is merely exemplary and should not constitute any limitation on the functionality and scope of the embodiments described herein. Figure 6 The computing device 600 shown may be used to implement Figure 1 A computing device 120 is provided.
[0125] like Figure 6As shown, computing device 600 is in the form of a general-purpose computing device. Components of computing device 600 may include, but are not limited to, one or more processors or processing units 610, memory 620, storage device 630, one or more communication units 640, one or more input devices 650, and one or more output devices 660. Processing unit 610 may be an actual or virtual processor and is capable of performing various processes according to a program stored in memory 620. In a multi-processor system, multiple processing units execute computer executable instructions in parallel to increase the parallel processing capabilities of computing device 600.
[0126] The computing device 600 typically includes a plurality of computer storage media. Such media may be any accessible media that is accessible to the computing device 600, including but not limited to volatile and non-volatile media, removable and non-removable media. The memory 620 may be a volatile memory (e.g., registers, caches, random access memory (RAM)), a non-volatile memory (e.g., a read-only memory (ROM), an electrically erasable programmable read-only memory (EEPROM), flash memory), or some combination thereof. The storage device 630 may be a removable or non-removable medium, and may include a machine-readable medium, such as a flash drive, a disk, or any other medium, which may be capable of being used to store information and / or data (e.g., training data for training) and may be accessed within the computing device 600.
[0127] The computing device 600 may further include additional removable / non-removable, volatile / non-volatile storage media. Figure 6 As shown in , a disk drive for reading or writing from a removable, non-volatile disk (e.g., a "floppy disk") and an optical drive for reading or writing from a removable, non-volatile optical disk may be provided. In these cases, each drive may be connected to the bus (not shown) by one or more data media interfaces. The memory 620 may include a computer program product 625 having one or more program modules that are configured to perform various methods or actions of various embodiments of the present disclosure.
[0128] The communication unit 640 enables communication with other computing devices via a communication medium. Additionally, the functions of the components of the computing device 600 can be implemented in a single computing cluster or multiple computing machines that can communicate via a communication connection. Therefore, the computing device 600 can operate in a networked environment using a logical connection with one or more other servers, a network personal computer (PC), or another network node.
[0129] Input device 650 may be one or more input devices, such as a mouse, keyboard, trackball, etc. Output device 660 may be one or more output devices, such as a display, speaker, printer, etc. Computing device 600 may also communicate with one or more external devices (not shown) through communication unit 640 as needed, such as storage devices, display devices, etc., communicate with one or more devices that allow a user to interact with computing device 600, or communicate with any device that allows computing device 600 to communicate with one or more other computing devices (e.g., a network card, a modem, etc.). Such communication may be performed via an input / output (I / O) interface (not shown).
[0130] According to an exemplary implementation of the present disclosure, a computer-readable storage medium is provided, on which computer-executable instructions are stored, wherein the computer-executable instructions are executed by a processor to implement the method described above. According to an exemplary implementation of the present disclosure, a computer program product is also provided, which is tangibly stored on a non-transitory computer-readable medium and includes computer-executable instructions, and the computer-executable instructions are executed by a processor to implement the method described above.
[0131] Various aspects of the present disclosure are described herein with reference to the flowcharts and / or block diagrams of the methods, devices, equipment, and computer program products implemented according to the present disclosure. It should be understood that each box in the flowchart and / or block diagram and the combination of each box in the flowchart and / or block diagram can be implemented by computer-readable program instructions.
[0132] These computer-readable program instructions can be provided to a processing unit of a general-purpose computer, a special-purpose computer, or other programmable data processing device, thereby producing a machine, so that when these instructions are executed by the processing unit of the computer or other programmable data processing device, a device that implements the functions / actions specified in one or more boxes in the flowchart and / or block diagram is generated. These computer-readable program instructions can also be stored in a computer-readable storage medium, and these instructions cause the computer, programmable data processing device, and / or other equipment to work in a specific manner, so that the computer-readable medium storing the instructions includes a manufactured product, which includes instructions for implementing various aspects of the functions / actions specified in one or more boxes in the flowchart and / or block diagram.
[0133] Computer-readable program instructions can be loaded onto a computer, other programmable data processing apparatus, or other device so that a series of operational steps are performed on the computer, other programmable data processing apparatus, or other device to produce a computer-implemented process, so that the instructions executed on the computer, other programmable data processing apparatus, or other device implement the functions / actions specified in one or more boxes in the flowchart and / or block diagram.
[0134] The flow chart and block diagram in the accompanying drawings show the possible architecture, function and operation of the system, method and computer program product according to multiple implementations of the present disclosure. In this regard, each square box in the flow chart or block diagram can represent a part of a module, program segment or instruction, and a part of a module, program segment or instruction includes one or more executable instructions for realizing the logical function of the specification. In some implementations as replacements, the function marked in the square box can also occur in a sequence different from that marked in the accompanying drawings. For example, two continuous square boxes can actually be executed substantially in parallel, and they can sometimes be executed in reverse order, depending on the functions involved. It should also be noted that each square box in the block diagram and / or flow chart, and the combination of the square boxes in the block diagram and / or flow chart can be realized by a special hardware-based system that performs the function or action of the specification, or can be realized by a combination of special hardware and computer instructions.
[0135] The above descriptions of various implementations of the present disclosure are exemplary, non-exhaustive, and not limited to the disclosed implementations. Many modifications and variations will be apparent to those of ordinary skill in the art without departing from the scope and spirit of the described implementations. The selection of terms used herein is intended to best explain the principles of the implementations, practical applications, or improvements to the technology in the market, or to enable other persons of ordinary skill in the art to understand the various implementations disclosed herein.
Claims
1. A display method in a virtual scene, comprising: Determining viewpoint description information associated with a viewpoint of a user in a virtual scene, the viewpoint comprising an expected viewpoint or a real-time viewpoint of the user; Determining size information of a display area in the virtual scene based on the viewpoint description information; and Based on the size information, a display style of the content in the display area is determined.
2. The method of claim 1, wherein the viewpoint comprises the expected viewpoint, and determining the viewpoint description information associated with the expected viewpoint of the user in the virtual scene comprises: Obtaining body shape information associated with the user; as well as Based on the body shape information, the viewpoint description information associated with the expected viewpoint is determined. 3 . The method according to claim 2 , wherein the body shape description information at least indicates the length of a predetermined body part of the user.
4. The method according to claim 1, wherein the view description information at least indicates: a first distance of the viewpoint to a reference plane associated with the display area; and A second distance between the viewpoint and the display area in a preset direction, where the preset direction is parallel to the reference plane.
5. The method according to claim 4, wherein determining the size information of the display area based on the viewpoint description information comprises: The size information of the display area is determined based on the first distance and the second distance indicated by the viewpoint description information.
6. The method according to claim 5, wherein the display area is at a first angle relative to the user's field of view, and determining the size information of the display area based on the first distance and the second distance comprises: Based on the first distance, the second distance, and the first angle, a maximum length of the display area in a first direction is determined.
7. The method according to claim 6, wherein determining the maximum length of the display area in the first direction based on the first distance, the second distance and the first angle comprises: determining a second angle, the second angle indicating a preset vertical field of view of the user; as well as The maximum length of the display area in the first direction is determined based on the first distance, the second distance, the first angle, and the second angle.
8. The method according to claim 6, wherein determining the size information of the display area further comprises: Determining a preset length of the display area in the first direction; as well as Based on a comparison between the preset length and the maximum length, a display length of the display area in the first direction is determined.
9. The method according to claim 8, wherein determining the preset length of the display area in the first direction comprises: Based on the first distance, determining a third distance from the display area to the reference plane, such that the third distance is smaller than the first distance; as well as The preset length of the display area in the first direction is determined based on the third distance and the first angle of the display area.
10. The method according to claim 5, wherein determining the size information of the display area comprises: Based on the second distance and a preset third angle, a display length of the display area in the second direction is determined, and the third angle indicates a preset horizontal field of view range of the user.
11. The method according to claim 1, further comprising: In a display domain specific to the user, the content is presented in the display area according to the style.
12. The method of claim 1, wherein the viewpoint comprises a real-time viewpoint, the method further comprising: determining an updated viewpoint of the user in the virtual environment; as well as Based on the update viewpoint, an update display style of the content in the display area is determined.
13. The method according to claim 12, wherein determining an updated display style of the content in the display area comprises: Determining a degree of change in size information of the display area based on the update viewpoint; as well as In response to the degree of change exceeding a threshold, an updated display style of the content in the display area is determined. The method according to claim 1 , wherein the display style comprises a layout of the content and / or a display size of an element in the content.
15. A device for displaying in a virtual scene, comprising: A description information determination module, configured to determine viewpoint description information associated with a user's viewpoint in a virtual scene, the viewpoint including an expected viewpoint or a real-time viewpoint of the user; A size information determination module, configured to determine size information of a display area in the virtual scene based on the viewpoint description information; as well as The display style determination module is configured to determine the display style of the content in the display area based on the size information.
16. An electronic device, comprising: at least one processing unit; as well as At least one memory, the at least one memory being coupled to the at least one processing unit and storing instructions for execution by the at least one processing unit, the instructions causing the electronic device to perform the method according to any one of claims 1 to 14 when executed by the at least one processing unit.
17. A computer-readable storage medium having a computer program stored thereon, wherein the computer program can be executed by a processor to implement the method according to any one of claims 1 to 14.
