Rendering method and device of three-dimensional scene, electronic device, and readable storage medium

By determining the storage status of the rendered material in the virtual reality scene and obtaining the three-dimensional model of the target material rendering, the problem of the long loading time of the virtual reality scene is solved, and faster rendering and loading effects are achieved.

CN114387376BActive Publication Date: 2025-02-21BEIJING YOUZHUJU NETWORK TECH CO LTD
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
CN202210055916.1
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2022-01-18
Publication Date
2025-02-21
Estimated Expiration
2042-01-18

AI Technical Summary

Technical Problem

During the display process of virtual reality scenes, the rendering time of the three-dimensional model when the user switches to roam the observation points, resulting in the loading time of the virtual reality scene being too long, and the user cannot view the virtual reality scene of the target house in time.

Method used

By receiving input to switch roaming observation points, the storage status of the rendering material is determined, and the target rendering material is obtained according to this status to render the observation points in the three-dimensional model, displaying the virtual reality scene.

Benefits of technology

It effectively reduces the rendering time of the three-dimensional model, reduces the time when users wait for loading the virtual reality scene, and ensures that users can view the virtual reality scenes of the target observation point in a timely manner.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN114387376B_ABST
    Figure CN114387376B_ABST
Patent Text Reader

Abstract

The present application proposes a rendering method and device for a three-dimensional scene, an electronic device, and a readable storage medium. The rendering method for a three-dimensional scene includes: receiving a first input for switching a roaming observation point of a three-dimensional model from a first observation point to a second observation point, and determining the storage status of a rendering material; determining a target rendering material for rendering the second observation point of the three-dimensional model according to the storage status of the rendering material, and rendering the second observation point in the three-dimensional model according to the target rendering material; and displaying a virtual reality scene of the second observation point in response to the first input. When the above method receives a first input for switching the roaming observation point of the three-dimensional model, the method obtains the corresponding target rendering material according to the storage status of the rendering material to render the three-dimensional model, which can effectively reduce the rendering time of the three-dimensional model, thereby reducing the time the user waits for the virtual reality scene to be loaded, and ensuring that the user can view the virtual reality scene of the target observation point in time.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application relates to the field of image processing technology, and in particular to a method and device for rendering a three-dimensional scene, an electronic device, and a readable storage medium. Background Art

[0002] With the development of science and technology, virtual reality scenes are increasingly used in the real estate field, such as VR house viewing. Displaying a house through a virtual reality scene allows users to more clearly and intuitively understand the internal structural layout and functional division of the house.

[0003] Currently, the virtual reality scene can be displayed by roaming in a 3D model. However, in the display process of the above virtual reality scene, when the user switches the roaming observation point, the rendering time of the 3D model is long, so that the loading time of the virtual reality scene is too long, and the user cannot view the virtual reality scene of the target house in time. Summary of the invention

[0004] The purpose of the embodiments of the present application is to provide a three-dimensional scene rendering method and device, an electronic device, and a readable storage medium, which can solve the problem that the rendering time of the three-dimensional model is long when switching roaming observation points, thereby making the loading time of the virtual reality scene too long and the user cannot view the virtual reality scene of the target house in time.

[0005] In a first aspect, an embodiment of the present application provides a method for rendering a three-dimensional scene, and the method for rendering a three-dimensional scene includes: receiving a first input to switch a roaming observation point of a three-dimensional model from a first observation point to a second observation point, and determining a storage status of a rendering material; according to the storage status of the rendering material, determining a target rendering material for rendering the second observation point of the three-dimensional model, and rendering the second observation point in the three-dimensional model according to the target rendering material; and in response to the first input, displaying a virtual reality scene of the second observation point.

[0006] In a second aspect, an embodiment of the present application provides a rendering device for a three-dimensional scene, and the rendering device for the three-dimensional scene includes: a receiving unit, used to receive a first input for switching a roaming observation point of a three-dimensional model from a first observation point to a second observation point; a processing unit, used to determine a storage status of a rendering material; the processing unit is also used to determine a target rendering material for rendering the second observation point of the three-dimensional model based on the storage status of the rendering material, and render the second observation point in the three-dimensional model based on the target rendering material; a display unit, used to display a virtual reality scene of the second observation point in response to the first input.

[0007] In a third aspect, an embodiment of the present application provides an electronic device, comprising: a memory on which programs or instructions are stored; and a processor for implementing the steps of the three-dimensional scene rendering method of the first aspect mentioned above when executing the programs or instructions.

[0008] In a fourth aspect, an embodiment of the present application provides a readable storage medium having a program or instruction stored thereon, which, when executed by a processor, implements the steps of the method for rendering a three-dimensional scene as described in the first aspect above.

[0009] In the embodiment of the present application, when a first input is received to switch the roaming observation point of the three-dimensional model from the first observation point to the second observation point, the storage state of the rendering material is determined, and then the target rendering material for rendering the second observation point of the three-dimensional model is determined according to the storage state of the rendering material, and the second observation point in the three-dimensional model is rendered according to the target rendering material to display the virtual reality scene of the second observation point. In this way, according to the storage state of the rendering material, the corresponding target rendering material is obtained to render the three-dimensional model, which can effectively reduce the rendering time of the three-dimensional model, thereby reducing the time for the user to wait for the loading of the virtual reality scene, and ensuring that the user can view the virtual reality scene of the target observation point in time. BRIEF DESCRIPTION OF THE DRAWINGS

[0010] Figure 1 One of the flowcharts of the method for rendering a three-dimensional scene according to an embodiment of the present application is shown;

[0011] Figure 2 A second flowchart of a method for rendering a three-dimensional scene according to an embodiment of the present application is shown;

[0012] Figure 3 A third flowchart of a method for rendering a three-dimensional scene according to an embodiment of the present application is shown;

[0013] Figure 4 A fourth flowchart of a method for rendering a three-dimensional scene according to an embodiment of the present application is shown;

[0014] Figure 5 A fifth flowchart of a method for rendering a three-dimensional scene according to an embodiment of the present application is shown;

[0015] Figure 6 A schematic block diagram showing a three-dimensional scene rendering device according to an embodiment of the present application;

[0016] Figure 7 A schematic block diagram of an electronic device according to an embodiment of the present application is shown;

[0017] Figure 8 A schematic block diagram of a server according to an embodiment of the present application is shown;

[0018] Fig. 9 A schematic diagram of the hardware structure of an electronic device according to an embodiment of the present application is shown. DETAILED DESCRIPTION

[0019] The following will be combined with the drawings in the embodiments of the present application to clearly describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, rather than all the embodiments. All other embodiments obtained by ordinary technicians in this field based on the embodiments in the present application belong to the scope of protection of this application.

[0020] The terms "first", "second", etc. in the specification and claims of the present application are used to distinguish similar objects, and are not used to describe a specific order or sequence. It should be understood that the data used in this way can be interchangeable under appropriate circumstances, so that the embodiments of the present application can be implemented in an order other than those illustrated or described here, and the objects distinguished by "first", "second", etc. are generally of one type, and the number of objects is not limited. For example, the first object can be one or more. In addition, "and / or" in the specification and claims represents at least one of the connected objects, and the character " / " generally indicates that the objects associated with each other are in an "or" relationship.

[0021] The following is combined with Figures 1 to 9 , the three-dimensional scene rendering method and device, electronic device, and readable storage medium provided in the embodiments of the present application are described in detail through specific embodiments and their application scenarios.

[0022] The technical solution of the method for rendering a three-dimensional scene provided in the embodiment of the present application may be implemented by a device for rendering a three-dimensional scene, which may be determined according to actual use requirements and is not limited in the embodiment of the present application. In order to more clearly describe the method for rendering a three-dimensional scene provided in the embodiment of the present application, the following method embodiment uses the method for rendering a three-dimensional scene as an example to illustrate the method.

[0023] like Figure 1 As shown, in an embodiment of the present application, a method for rendering a three-dimensional scene is provided, comprising the following steps S102 to S110:

[0024] Step S102: receiving a first input for switching a roaming observation point of a three-dimensional model from a first observation point to a second observation point.

[0025] It can be understood that when the virtual reality scene of a house is displayed through three-dimensional model roaming, the display interface of the three-dimensional model will include multiple roaming observation points. Different roaming observation points correspond to different three-dimensional scenes. Users can view the three-dimensional scenes at different locations of the house by switching different roaming observation points.

[0026] That is, the first observation point indicates the three-dimensional scene at the first position, and the second observation point indicates the three-dimensional scene at the second position. By switching the roaming observation point of the three-dimensional model from the first observation point to the second observation point, the display position of the three-dimensional scene is switched from the first position to the second position.

[0027] Furthermore, the first input is an input operation of the user on a target observation point (i.e., a second observation point) in the three-dimensional model display interface, and the target observation point corresponds to the three-dimensional scene at the target position. The three-dimensional scene rendering device receives and responds to the user's first input operation, switches the display position of the three-dimensional scene from the first position to the second position, that is, displays the three-dimensional scene of the three-dimensional model at the second position.

[0028] Specifically, the first input may be a user's touch input to the target observation point (ie, the second observation point) in the three-dimensional model display interface. The touch input may be a single-click input, a double-click input, a long-press input, etc., and is not specifically limited here.

[0029] Step S104, determining the storage status of the rendering material.

[0030] Specifically, when the first input is received to switch the roaming observation point of the three-dimensional model from the first observation point to the second observation point, the storage status of the rendering material is determined, that is, whether the rendering material of the three-dimensional model of the second observation point is stored in the local storage interval, that is, the loading status of the rendering material of the three-dimensional model of the second observation point is determined.

[0031] Among them, the above-mentioned rendering material has an association relationship with the second observation point, and the rendering material is a panoramic image of the house corresponding to the three-dimensional model of the second observation point. Specifically, when the rendering material (i.e., the panoramic image of the house corresponding to the three-dimensional model of the second observation point) is stored in the local storage interval, the rendering material can be named according to the name keyword of the second observation point to establish an association relationship between the rendering material and the second observation point. Based on the above-mentioned association relationship, when the first input of switching the roaming observation point of the three-dimensional model from the first observation point to the second observation point is received, it is determined whether the rendering material associated with the second observation point is stored in the local storage interval.

[0032] Specifically, the above-mentioned panoramic image of the house is an image obtained by shooting, or the above-mentioned panoramic image of the house is an image obtained by synthesizing multiple images, which is not specifically limited here.

[0033] Step S106: determining a target rendering material for rendering a second observation point of the three-dimensional model according to the storage status of the rendering material.

[0034] Specifically, it is determined whether the local storage interval stores rendering materials associated with the second observation point. If the local storage interval stores rendering materials associated with the second observation point, the rendering materials associated with the second observation point are directly retrieved from the local storage interval as target selected rendering materials. If the local storage interval does not contain rendering materials associated with the second observation point, the rendering materials associated with the second observation point are loaded from the cloud storage interval as target selected rendering materials.

[0035] Step S108: Rendering a second observation point in the three-dimensional model according to the target rendering material.

[0036] The target rendering material is associated with the second observation point, and the target rendering material is a panoramic image of the house corresponding to the three-dimensional model of the second observation point.

[0037] Specifically, after obtaining the panoramic image of the house corresponding to the three-dimensional model of the second observation point, the three-dimensional model of the second observation point is rendered according to the obtained panoramic image of the house to display the virtual reality scene of the three-dimensional model at the second observation point, that is, to display the three-dimensional scene of the house at the second position.

[0038] Step S110: In response to the first input, display the virtual reality scene of the second observation point.

[0039] Specifically, the three-dimensional model of the second observation point is rendered by using a panoramic image of the house corresponding to the three-dimensional model of the second observation point to obtain a rendered three-dimensional model of the second observation point, and then the virtual reality scene corresponding to the second observation point is displayed through the rendered three-dimensional model.

[0040] The rendering method of the above-mentioned three-dimensional scene provided in the embodiment of the present application, when receiving the first input to switch the roaming observation point of the three-dimensional model from the first observation point to the second observation point, determines the storage state of the rendering material, and then determines the target rendering material for rendering the second observation point of the three-dimensional model according to the storage state of the rendering material, and renders the second observation point in the three-dimensional model according to the target rendering material to display the virtual reality scene of the second observation point. In this way, according to the storage state of the rendering material, the corresponding target rendering material is obtained to render the three-dimensional model, which can effectively reduce the rendering time of the three-dimensional model, thereby reducing the time for the user to wait for the loading of the virtual reality scene, and ensuring that the user can view the virtual reality scene of the target observation point in time.

[0041] In the embodiments of the present application, further, Figure 2 As shown, the above step S106 may specifically include the following steps S106a and S106b:

[0042] Step S106a: when it is determined that the first rendering material has been stored in the material database, the first rendering material is determined as the target rendering material.

[0043] The material database is a local database, the first rendering material is associated with the second observation point, and the first rendering material is a panoramic image of the house corresponding to the three-dimensional model of the second observation point.

[0044] Specifically, when it is determined that the first rendering material associated with the second observation point is stored in the local database (i.e., the material database), that is, when it is determined that the panoramic image of the house corresponding to the three-dimensional model of the second observation point is in a loaded state, the panoramic image is directly called as the target rendering material to render the three-dimensional model of the second observation point, thereby obtaining a virtual reality scene of the three-dimensional model at the second observation point.

[0045] Specifically, the material database stores rendering materials of multiple roaming observation points, and different rendering materials contain different identification information to distinguish the multiple rendering materials, wherein the identification information contains keyword information corresponding to the roaming observation point to establish a corresponding relationship between the rendering material and the roaming observation point. After receiving the first input, the electronic device identifies the identification information of the multiple rendering materials in the material database in response to the first input to determine whether the material database stores the rendering material associated with the second observation point (i.e., the first rendering material). If it is determined that the first rendering material exists in the material database, the first rendering material is determined as the target rendering material for rendering the three-dimensional model of the second observation point.

[0046] Step S106b: when it is determined that the first rendering material is not stored in the material database, request the cloud server to load the second rendering material, and determine the second rendering material as the target rendering material.

[0047] Specifically, when it is determined that the first rendering material associated with the second observation point does not exist in the local database (i.e., the material database), that is, when it is determined that the panoramic image of the house corresponding to the three-dimensional model of the second observation point has not been loaded, the second rendering material stored in the cloud server is obtained, and the three-dimensional model of the second observation point is rendered using the second rendering material as the target rendering material, thereby obtaining a virtual reality scene of the three-dimensional model at the second observation point.

[0048] The second rendering material is associated with the second observation point, and the second rendering material is a panoramic image of the house corresponding to the three-dimensional model of the second observation point.

[0049] Specifically, a material loading request is sent to the cloud server to request loading of a second rendering material, the second rendering material sent by the cloud server is received, and the second rendering material is used as a target rendering material to render the three-dimensional model of the second observation point, thereby obtaining a virtual reality scene of the three-dimensional model at the second observation point.

[0050] Furthermore, after receiving the second rendering material sent by the cloud server, the second rendering material is named according to the name keyword of the second observation point to establish a correspondence between the second rendering material and the second observation point, and then the second rendering material is stored in the above-mentioned material database so that the second rendering material can be directly called to render the three-dimensional model next time.

[0051] Furthermore, a resolution of the second rendering material is smaller than a resolution of the first rendering material.

[0052] It is understandable that the resolution of the rendering material is inversely proportional to the quality of the rendering material, the quality of the rendering material is proportional to the quality of the virtual reality scene, and the quality of the virtual reality scene is proportional to the rendering time of the 3D model. In other words, the higher the resolution of the rendering material, the longer it takes to render the 3D model using the rendering material, and the lower the resolution of the rendering material, the shorter the time it takes to render the 3D model using the rendering material.

[0053] In addition, the resolution of the rendering material is inversely proportional to the quality of the rendering material, and the quality of the rendering material is proportional to the loading time of the rendering material. Therefore, the higher the resolution of the rendering material, the longer it takes to load the rendering material, and the lower the resolution of the rendering material, the shorter the time it takes to load the rendering material.

[0054] Therefore, the resolution of the second rendering material is smaller than that of the first rendering material. When the second rendering material is loaded from the cloud server as the target rendering material to render the three-dimensional model of the second observation point, the time for loading the rendering material and the time for rendering the three-dimensional model can be further reduced.

[0055] In the above-mentioned embodiment provided by the present application, when it is determined that the panoramic image of the house corresponding to the three-dimensional model of the second observation point is in a loaded state, the panoramic image is directly retrieved as the target rendering material to render the three-dimensional model of the second observation point. When it is determined that the panoramic image of the house corresponding to the three-dimensional model of the second observation point has not been loaded, the low-resolution panoramic image of the house corresponding to the three-dimensional model of the second observation point is downloaded from the cloud server to render the three-dimensional model of the second observation point. In this way, rendering the three-dimensional model by obtaining rendering materials from different storage locations according to the loading status of the rendering materials can effectively reduce the rendering time of the three-dimensional model, thereby reducing the time for users to wait for the virtual reality scene to load, and ensuring that the user can view the virtual reality scene of the target observation point in time. In addition, downloading the low-resolution panoramic image of the house from the cloud server to render the three-dimensional model of the second observation point can further reduce the time for loading the rendering materials and the time for rendering the three-dimensional model.

[0056] In the embodiments of the present application, further, Figure 3 As shown, the above step S106a may specifically include the following steps S106a1 to S106a3:

[0057] Step S106a1, traversing the name information of multiple rendering materials stored in the material database.

[0058] Among them, multiple rendering materials are materials loaded before entering the three-dimensional model. Specifically, multiple rendering materials are panoramic images of houses corresponding to the three-dimensional models of each roaming observation point. The storage formats of multiple rendering materials are different, and multiple rendering materials all contain identification information, which is used to indicate the storage format of each rendering material.

[0059] The identification information includes name information, and the name information includes the name keyword of the observation point matched by the rendering material. Specifically, when the rendering material is stored in the material database, the rendering material can be named according to the name keyword of the roaming observation point corresponding to the rendering material to establish a matching relationship between the rendering material and the roaming observation point. Based on the matching relationship, after receiving the first input, the name information of the multiple rendering materials stored in the material database is traversed to find the rendering material associated with the second observation point, that is, to find the house panoramic image corresponding to the three-dimensional model of the second observation point.

[0060] Step S106a2: determining that a first rendering material among the plurality of rendering materials contains a name keyword of the second observation point, that the first rendering material has been stored in the material database.

[0061] Specifically, after receiving the above-mentioned first input, the name information of multiple rendering materials stored in the material database is traversed. When the name information of the first rendering material among the multiple rendering materials contains the name keyword of the second observation point, it is determined that the first rendering material is the rendering material associated with the second observation point, that is, it is determined that a panoramic image of the house corresponding to the three-dimensional model of the second observation point is stored in the material database.

[0062] Step S106a3: determine the first rendering material as the target rendering material.

[0063] Specifically, according to the name information of each rendering material, when the rendering material corresponding to the second observation point (i.e., the first rendering material) is found in the material database, the first rendering material is used as the target rendering material, and then the first rendering material is directly retrieved from the material database to render the three-dimensional model of the second observation point, so as to display the virtual reality scene of the three-dimensional model at the second observation point, that is, to display the three-dimensional scene of the target house at the second position.

[0064] In the above embodiment provided by the present application, according to the name information of multiple rendering materials in the material database, the rendering material (i.e., the first rendering material) corresponding to the second observation point is retrieved from the material database to render the three-dimensional model of the second observation point, so as to display the virtual reality scene of the three-dimensional model at the second observation point. In this way, the first rendering material associated with the second observation point is directly retrieved from the material database according to the name information to render the three-dimensional model, which ensures the accuracy of the target rendering material retrieval and reduces the rendering time of the three-dimensional model, thereby reducing the time for the user to wait for the virtual reality scene to be loaded, and ensuring that the user can view the virtual reality scene of the target house in a timely manner.

[0065] In the embodiments of the present application, further, Figure 4 As shown, after the above request to the cloud server to load the second rendering material, the above three-dimensional scene rendering method further includes the following steps S112 and S114:

[0066] Step S112, determining the loading time of the second rendering material.

[0067] Step S114: when the loading time is longer than the first preset time, display or play the first preset information in the virtual reality scene at the second observation point.

[0068] Specifically, when it is determined that the first rendering material associated with the second observation point does not exist in the local database (i.e., the material database), a material loading request is sent to the cloud server to load the second rendering material, and the loading time of the second rendering material is further determined. When the loading time of the second rendering material is greater than the first preset time, the first preset information is displayed or played in the virtual reality scene of the second observation point.

[0069] The first preset duration can be 1 second, 2 seconds, 3 seconds, 5 seconds, etc. The specific value of the first preset duration can be set according to actual conditions and is not specifically limited here. When the loading time of the second rendering material exceeds the first preset duration, the first preset information is displayed or played on the virtual reality scene display interface of the second observation point.

[0070] Furthermore, the first preset information is used to indicate that the virtual reality scene of the second observation point is in the loading process.

[0071] Specifically, the first preset information is one of text information, picture information or video information. The first preset information can be a static picture, a dynamic picture or a video clip. The specific form of the first preset information can be set according to actual conditions and is not specifically limited here. By displaying or playing the first preset information on the display interface of the virtual reality scene at the second observation point, the user is reminded that the second rendering material is being loaded, that is, the user is reminded that the virtual reality scene at the second observation point is being loaded.

[0072] In addition, the first preset information may also include the remaining loading time of the second rendering material.

[0073] In the above-mentioned embodiment provided by the present application, when the second rendering material is loaded from the cloud server, if the loading time of the second rendering material is greater than the first preset time, the first preset information is displayed or played in the virtual reality scene display interface of the second observation point to remind the user that the second rendering material of the second observation point is being loaded, that is, to remind the user that the virtual reality scene of the second observation point is being loaded.

[0074] In the embodiments of the present application, further, Figure 5 As shown, when the target rendering material is the second rendering material, after displaying the virtual reality scene of the second observation point, the above three-dimensional scene rendering method further includes the following steps S116 and S118:

[0075] Step S116: Request the cloud server to load the third rendering material.

[0076] Step S118: re-render the second observation point in the three-dimensional model according to the third rendering material, and update the virtual reality scene displaying the second observation point.

[0077] The resolution of the third rendering material is greater than the resolution of the second rendering material.

[0078] Specifically, if the house panoramic image corresponding to the 3D model of the second observation point has not been loaded, a material loading request is sent to the cloud server to obtain a second rendering material with a lower resolution stored in the cloud server to render the 3D model of the second observation point. After obtaining the virtual reality scene of the 3D model at the second observation point, a material loading request is sent to the cloud server again to obtain a third rendering material with a higher resolution stored in the cloud server to perform a second rendering on the 3D model of the second observation point.

[0079] It is understandable that the resolution of the rendering material is inversely proportional to the quality of the rendering material, and the quality of the rendering material is directly proportional to the quality (clarity) of the virtual reality scene. That is, the higher the resolution of the rendering material, the higher the quality (clarity) of the virtual reality scene obtained by rendering the 3D model with the rendering material, and the lower the resolution of the rendering material, the lower the quality (clarity) of the virtual reality scene obtained by rendering the 3D model with the rendering material.

[0080] Therefore, the resolution of the third rendering material is greater than the resolution of the second rendering material. After the three-dimensional model of the second observation point is rendered by the second rendering material to obtain a virtual reality scene with a lower definition, the three-dimensional model of the second observation point is rendered again by the third rendering material to obtain a virtual reality scene with a higher definition. During the display of the virtual reality scene of the second observation point, the virtual reality scene with a lower definition is loaded first, so as to realize automatic switching between the low-definition virtual reality scene and the high-definition virtual reality scene.

[0081] In the above embodiment provided by the present application, after the three-dimensional model of the second observation point is rendered by low-resolution rendering materials to obtain a virtual reality scene with low definition, the three-dimensional model of the second observation point is rendered again by high-resolution rendering materials to obtain a virtual reality scene with high definition. In this way, during the display of the virtual reality scene of the second observation point, the transition is made through the virtual reality scene with low definition, and the virtual reality scene with low definition is loaded first, which reduces the rendering time of the three-dimensional model, thereby reducing the time for the user to wait for the loading of the virtual reality scene, and ensures that the user can view the virtual reality scene of the target observation point in time.

[0082] In the embodiment of the present application, further, the resolution of the third rendering material and the resolution of the first rendering material are within the same preset range.

[0083] It is understandable that the resolution of the rendering material is inversely proportional to the quality of the rendering material, and the quality of the rendering material is directly proportional to the quality (clarity) of the virtual reality scene.

[0084] Therefore, the resolution of the third rendering material is within the same preset range as the resolution of the first rendering material, and the quality (clarity) of the virtual reality scene obtained by rendering the three-dimensional model using the first rendering material is similar to the quality (clarity) of the virtual reality scene obtained by rendering the three-dimensional model using the third rendering material.

[0085] In the above-mentioned embodiment provided by the present application, the resolution of the third rendering material and the resolution of the first rendering material are within the same preset range, and during the display process of the virtual reality scene, the consistency of the display clarity of the virtual reality scene at each roaming observation point is ensured.

[0086] The 3D scene rendering method provided in the embodiment of the present application can be executed by a 3D scene rendering device. In the embodiment of the present application, a 3D scene rendering method performed by a 3D scene rendering device is taken as an example to illustrate the 3D scene rendering device provided in the embodiment of the present application.

[0087] like Figure 6 As shown, in an embodiment of the present application, a three-dimensional scene rendering device 600 is proposed, and the three-dimensional scene rendering device 600 includes:

[0088] The receiving unit 602 is used to receive a first input for switching a roaming observation point of the three-dimensional model from a first observation point to a second observation point;

[0089] The processing unit 604 is used to determine the storage status of the rendering material;

[0090] The processing unit 604 is further configured to determine a target rendering material for rendering a second observation point of the three-dimensional model according to a storage state of the rendering material, and render the second observation point in the three-dimensional model according to the target rendering material;

[0091] The display unit 606 is used to display the virtual reality scene of the second observation point in response to the first input.

[0092] In the above-mentioned three-dimensional scene rendering device 600 provided in the embodiment of the present application, when the receiving unit 602 receives the first input for switching the roaming observation point of the three-dimensional model from the first observation point to the second observation point, the processing unit 604 determines the storage state of the rendering material, and then determines the target rendering material for rendering the second observation point of the three-dimensional model according to the storage state of the rendering material, and renders the second observation point in the three-dimensional model according to the target rendering material, so as to display the virtual reality scene of the second observation point through the display unit 606. In this way, according to the storage state of the rendering material, the corresponding target rendering material is obtained to render the three-dimensional model, which can effectively reduce the rendering time of the three-dimensional model, thereby reducing the time for the user to wait for the loading of the virtual reality scene, and ensuring that the user can view the virtual reality scene of the target observation point in time.

[0093] In the embodiment of the present application, optionally, the processing unit 604 can be specifically used to: when it is determined that the first rendering material has been stored in the material database, determine the first rendering material as the target rendering material; when it is determined that the first rendering material is not stored in the material database, request the cloud server to load the second rendering material, and determine the second rendering material as the target rendering material; wherein the first rendering material is associated with the second observation point, and the resolution of the second rendering material is less than the resolution of the first rendering material.

[0094] In the embodiment of the present application, when the processing unit 604 determines that the panoramic image of the house corresponding to the three-dimensional model of the second observation point is in a loaded state, the processing unit 604 directly retrieves the panoramic image as the target rendering material to render the three-dimensional model of the second observation point. When it is determined that the panoramic image of the house corresponding to the three-dimensional model of the second observation point has not been loaded, the processing unit 604 downloads the low-resolution panoramic image of the house corresponding to the three-dimensional model of the second observation point from the cloud server to render the three-dimensional model of the second observation point. In this way, rendering the three-dimensional model by obtaining rendering materials from different storage locations according to the loading status of the rendering materials can effectively reduce the rendering time of the three-dimensional model, thereby reducing the time for the user to wait for the virtual reality scene to be loaded, and ensuring that the user can view the virtual reality scene of the target observation point in time. In addition, downloading the low-resolution panoramic image of the house from the cloud server to render the three-dimensional model of the second observation point can further reduce the time for loading the rendering materials and the time for rendering the three-dimensional model.

[0095] In an embodiment of the present application, optionally, the processing unit 604 can be specifically used to: traverse the name information of multiple rendering materials stored in the material database, wherein the multiple rendering materials are materials loaded before entering the three-dimensional model, and the name information includes the name keywords of the observation points matched by the rendering materials; based on the first rendering material among the multiple rendering materials containing the name keywords of the second observation point, determine that the first rendering material has been stored in the material database; and determine the first rendering material as the target rendering material.

[0096] In the embodiment of the present application, the processing unit 604 retrieves the rendering material (i.e., the first rendering material) corresponding to the second observation point from the material database according to the name information of the plurality of rendering materials in the material database to render the three-dimensional model of the second observation point, so as to display the virtual reality scene of the three-dimensional model at the second observation point. In this way, the first rendering material associated with the second observation point is directly retrieved from the material database according to the name information to render the three-dimensional model, which ensures the accuracy of the target rendering material retrieval and reduces the rendering time of the three-dimensional model, thereby reducing the time for the user to wait for the loading of the virtual reality scene, and ensuring that the user can view the virtual reality scene of the target house in a timely manner.

[0097] In an embodiment of the present application, optionally, the processing unit 604 is also used to determine the loading time of loading the second rendering material; the display unit 606 is also used to display or play the first preset information in the virtual reality scene of the second observation point when the loading time is greater than the first preset time.

[0098] In the embodiment of the present application, when loading the second rendering material from the cloud server, the processing unit 604 determines the loading time of the second rendering material. When the loading time of the second rendering material is greater than the first preset time, the display unit 606 displays or plays the first preset information in the virtual reality scene display interface of the second observation point to remind the user that the second rendering material of the second observation point is being loaded, that is, to remind the user that the virtual reality scene of the second observation point is being loaded.

[0099] In an embodiment of the present application, optionally, when the target rendering material is the second rendering material, the processing unit 604 is further used to: request the cloud server to load a third rendering material, the resolution of the third rendering material is greater than the resolution of the second rendering material, and re-render the second observation point in the three-dimensional model according to the third rendering material; the display unit 606 is further used to: update the virtual reality scene displaying the second observation point.

[0100] In the embodiment of the present application, after the three-dimensional model of the second observation point is rendered by low-resolution rendering materials to obtain a virtual reality scene with low definition, the three-dimensional model of the second observation point is rendered again by high-resolution rendering materials to obtain a virtual reality scene with high definition. In this way, during the display of the virtual reality scene of the second observation point, the transition is performed through the virtual reality scene with low definition, and the virtual reality scene with low definition is loaded first, which reduces the rendering time of the three-dimensional model, thereby reducing the time for the user to wait for the loading of the virtual reality scene, and ensures that the user can view the virtual reality scene of the target observation point in time.

[0101] In the embodiment of the present application, optionally, the resolution of the third rendering material and the resolution of the first rendering material are within the same preset range.

[0102] In the embodiment of the present application, the resolution of the third rendering material is within the same preset range as the resolution of the first rendering material. During the display of the virtual reality scene, the consistency of the display clarity of the virtual reality scene at each roaming observation point is ensured.

[0103] The rendering device of the three-dimensional scene in the embodiment of the present application can be an electronic device, or a component in the electronic device, such as an integrated circuit or a chip. The electronic device can be a terminal, or it can be other devices other than the terminal. Exemplarily, the electronic device can be a mobile phone, a tablet computer, a laptop computer, a PDA, a car electronic device, a mobile Internet device (Mobile Internet Device, MID), an augmented reality (augmented reality, AR) / virtual reality (virtual reality, VR) device, a robot, a wearable device, an ultra-mobile personal computer (ultra-mobile personal computer, UMPC), a netbook or a personal digital assistant (personal digital assistant, PDA), etc., and can also be a server, a network attached storage (Network Attached Storage, NAS), a personal computer (personal computer, PC), a television (television, TV), a teller machine or a self-service machine, etc., which is not specifically limited in the embodiment of the present application.

[0104] The 3D scene rendering device in the embodiment of the present application may be a device having an operating system. The operating system may be an Android operating system, an iOS operating system, or other possible operating systems, which are not specifically limited in the embodiment of the present application.

[0105] The three-dimensional scene rendering device provided in the embodiment of the present application can achieve the above Figures 1 to 5 To avoid repetition, the various processes implemented in the method embodiment will not be described again here.

[0106] Alternatively, if Figure 7 As shown, in an embodiment of the present application, an electronic device 700 is provided, including a memory 702 and a processor 704, wherein the memory 702 stores programs or instructions, and the processor 704 implements the various steps of the above-mentioned three-dimensional scene rendering method embodiment when executing the above-mentioned programs or instructions, and can achieve the same technical effect, which will not be described again here to avoid repetition.

[0107] Alternatively, if Figure 8 As shown, an embodiment of the present application further provides a server 800, which includes a processor 802 and a memory 804. The memory 804 stores a program or input that can be run on the processor 802. When the program or input is executed by the processor 802, the various steps of the above-mentioned method embodiment are implemented, and the same technical effect can be achieved. To avoid repetition, it will not be repeated here.

[0108] It should be noted that the electronic devices in the embodiments of the present application include the above-mentioned mobile electronic devices and non-mobile electronic devices.

[0109] Fig. 9 A schematic diagram of the hardware structure of an electronic device to implement an embodiment of the present application.

[0110] The electronic device 900 includes but is not limited to: a radio frequency unit 901, a network module 902, an audio output unit 903, an input unit 904, a sensor 905, a display unit 906, a user input unit 907, an interface unit 908, a memory 909, and a processor 910 and other components.

[0111] Those skilled in the art will appreciate that the electronic device 900 may also include a power source (such as a battery) for supplying power to each component, and the power source may be logically connected to the processor 910 through a power management system, thereby implementing functions such as managing charging, discharging, and power consumption management through the power management system. Fig. 9 The electronic device structure shown in the figure does not constitute a limitation on the electronic device. The electronic device may include more or fewer components than shown in the figure, or combine certain components, or arrange the components differently, which will not be described in detail here.

[0112] The user input unit 907 is used to receive a first input for switching the roaming observation point of the three-dimensional model from a first observation point to a second observation point.

[0113] Processor 910 is used to determine the storage status of the rendering material.

[0114] The processor 910 is further configured to determine, according to a storage state of the rendering material, a target rendering material for rendering a second observation point of the three-dimensional model, and render the second observation point in the three-dimensional model according to the target rendering material.

[0115] The display unit 906 is used to display the virtual reality scene of the second observation point in response to the first input.

[0116] The electronic device 900 provided in the embodiment of the present application, when the user input unit 907 receives the first input for switching the roaming observation point of the three-dimensional model from the first observation point to the second observation point, determines the storage state of the rendering material through the processor 910, and then determines the target rendering material for rendering the second observation point of the three-dimensional model according to the storage state of the rendering material, and renders the second observation point in the three-dimensional model according to the target rendering material, so as to display the virtual reality scene of the second observation point through the display unit 906. In this way, the rendering of the three-dimensional model by obtaining the corresponding target rendering material according to the storage state of the rendering material can effectively reduce the rendering time of the three-dimensional model, thereby reducing the time for the user to wait for the loading of the virtual reality scene, and ensuring that the user can view the virtual reality scene of the target observation point in time.

[0117] Optionally, the processor 910 can be specifically used to: when it is determined that the first rendering material has been stored in the material database, determine the first rendering material as the target rendering material; when it is determined that the first rendering material has not been stored in the material database, request the cloud server to load the second rendering material, and determine the second rendering material as the target rendering material; wherein the first rendering material is associated with the second observation point, and the resolution of the second rendering material is smaller than the resolution of the first rendering material.

[0118] In the embodiment of the present application, when the processor 910 determines that the panoramic image of the house corresponding to the three-dimensional model of the second observation point is in a loaded state, the processor 910 directly retrieves the panoramic image as the target rendering material to render the three-dimensional model of the second observation point. When it is determined that the panoramic image of the house corresponding to the three-dimensional model of the second observation point has not been loaded, the processor 910 downloads the low-resolution panoramic image of the house corresponding to the three-dimensional model of the second observation point from the cloud server to render the three-dimensional model of the second observation point. In this way, rendering the three-dimensional model by obtaining rendering materials from different storage locations according to the loading status of the rendering materials can effectively reduce the rendering time of the three-dimensional model, thereby reducing the time for the user to wait for the virtual reality scene to be loaded, and ensuring that the user can view the virtual reality scene of the target observation point in time. In addition, downloading the low-resolution panoramic image of the house from the cloud server to render the three-dimensional model of the second observation point can further reduce the time for loading the rendering materials and the time for rendering the three-dimensional model.

[0119] Optionally, the processor 910 can be specifically used to: traverse the name information of multiple rendering materials stored in the material database, wherein the multiple rendering materials are materials loaded before entering the three-dimensional model, and the name information includes the name keywords of the observation points matched by the rendering materials; based on the first rendering material among the multiple rendering materials containing the name keywords of the second observation point, determine that the first rendering material has been stored in the material database; and determine the first rendering material as the target rendering material.

[0120] In the embodiment of the present application, the processor 910 retrieves the rendering material (i.e., the first rendering material) corresponding to the second observation point from the material database according to the name information of the plurality of rendering materials in the material database to render the three-dimensional model of the second observation point, so as to display the virtual reality scene of the three-dimensional model at the second observation point. In this way, the first rendering material associated with the second observation point is directly retrieved from the material database according to the name information to render the three-dimensional model, which ensures the accuracy of the target rendering material retrieval and reduces the rendering time of the three-dimensional model, thereby reducing the time for the user to wait for the virtual reality scene to be loaded, and ensuring that the user can view the virtual reality scene of the target house in a timely manner.

[0121] Optionally, the processor 910 is further used to determine the loading time of loading the second rendering material; the display unit 906 is further used to display or play the first preset information in the virtual reality scene of the second observation point when the loading time is greater than the first preset time.

[0122] In the embodiment of the present application, when loading the second rendering material from the cloud server, the processor 910 determines the loading time of the second rendering material. When the loading time of the second rendering material is greater than the first preset time, the display unit 906 displays or plays the first preset information in the virtual reality scene display interface of the second observation point to remind the user that the second rendering material of the second observation point is being loaded, that is, to remind the user that the virtual reality scene of the second observation point is being loaded.

[0123] Optionally, when the target rendering material is the second rendering material, the processor 910 is also used to request the cloud server to load a third rendering material, the resolution of the third rendering material is greater than the resolution of the second rendering material, and the second observation point in the three-dimensional model is re-rendered according to the third rendering material; the display unit 906 is also used to update the virtual reality scene displaying the second observation point.

[0124] In the embodiment of the present application, after the three-dimensional model of the second observation point is rendered by low-resolution rendering materials to obtain a virtual reality scene with low definition, the three-dimensional model of the second observation point is rendered again by high-resolution rendering materials to obtain a virtual reality scene with high definition. In this way, during the display of the virtual reality scene of the second observation point, the transition is performed through the virtual reality scene with low definition, and the virtual reality scene with low definition is loaded first, which reduces the rendering time of the three-dimensional model, thereby reducing the time for the user to wait for the loading of the virtual reality scene, and ensures that the user can view the virtual reality scene of the target observation point in time.

[0125] Optionally, a resolution of the third rendering material and a resolution of the first rendering material are within the same preset range.

[0126] In the embodiment of the present application, the resolution of the third rendering material is within the same preset range as the resolution of the first rendering material. During the display of the virtual reality scene, the consistency of the display clarity of the virtual reality scene at each roaming observation point is ensured.

[0127] It should be understood that in the embodiment of the present application, the input unit 904 may include a graphics processor (Graphics Processing Unit, GPU) 9041 and a microphone 9042, and the graphics processor 9041 processes the image data of the static picture or video obtained by the image capture device (such as a camera) in the video capture mode or the image capture mode. The display unit 906 may include a display panel 9061, and the display panel 9061 may be configured in the form of a liquid crystal display, an organic light emitting diode, etc. The user input unit 907 includes a touch panel 9071 and at least one of other input devices 9072. The touch panel 9071 is also called a touch screen. The touch panel 9071 may include two parts: a touch detection device and a touch controller. Other input devices 9072 may include, but are not limited to, a physical keyboard, function keys (such as volume control keys, switch keys, etc.), a trackball, a mouse, and a joystick, which will not be repeated here.

[0128] The memory 909 can be used to store software programs and various data. The memory 909 may mainly include a first storage area for storing programs or instructions and a second storage area for storing data, wherein the first storage area may store an operating system, an application program or instructions required for at least one function (such as a sound playback function, an image playback function, etc.), etc. In addition, the memory 909 may include a volatile memory or a non-volatile memory, or the memory 909 may include both volatile and non-volatile memories. Among them, the non-volatile memory may be a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), or a flash memory. The volatile memory may be a random access memory (RAM), a static random access memory (SRAM), a dynamic random access memory (DRAM), a synchronous dynamic random access memory (SDRAM), a double data rate synchronous dynamic random access memory (DDRSDRAM), an enhanced synchronous dynamic random access memory (ESDRAM), a synchronous link dynamic random access memory (SLDRAM) and a direct memory bus random access memory (DRRAM). The memory 909 in the embodiment of the present application includes but is not limited to these and any other suitable types of memory.

[0129] The processor 910 may include one or more processing units; optionally, the processor 910 integrates an application processor and a modem processor, wherein the application processor mainly processes operations related to an operating system, a user interface, and application programs, and the modem processor mainly processes wireless communication signals, such as a baseband processor. It is understandable that the modem processor may not be integrated into the processor 910.

[0130] An embodiment of the present application also provides a readable storage medium on which a program or instruction is stored. When the program or instruction is executed by a processor, the various steps of the three-dimensional scene rendering method in the above embodiment are implemented, and the same technical effect can be achieved. To avoid repetition, it will not be repeated here.

[0131] The processor is the processor in the electronic device in the above embodiment. The readable storage medium includes a computer readable storage medium, such as a computer read-only memory ROM, a random access memory RAM, a magnetic disk or an optical disk.

[0132] An embodiment of the present application further provides a chip, which includes a processor and a communication interface, wherein the communication interface and the processor are coupled, and the processor is used to run programs or instructions to implement the various processes of the above-mentioned three-dimensional scene rendering method embodiment, and can achieve the same technical effect. To avoid repetition, it will not be repeated here.

[0133] It should be understood that the chip mentioned in the embodiments of the present application can also be called a system-level chip, a system chip, a chip system or a system-on-chip chip, etc.

[0134] An embodiment of the present application provides a computer program product, which is stored in a storage medium. The program product is executed by at least one processor to implement the various processes of the above-mentioned three-dimensional scene rendering method embodiment, and can achieve the same technical effect. To avoid repetition, it will not be repeated here.

[0135] It should be noted that, in this article, the terms "comprise", "include" or any other variant thereof are intended to cover non-exclusive inclusion, so that the process, method, article or device including a series of elements includes not only those elements, but also includes other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, the elements defined by the sentence "comprise one..." do not exclude the presence of other identical elements in the process, method, article or device including the element. In addition, it should be pointed out that the scope of the methods and devices in the embodiments of the present application is not limited to performing functions in the order shown or discussed, and may also include performing functions in a substantially simultaneous manner or in reverse order according to the functions involved, for example, the described method may be performed in an order different from that described, and various steps may also be added, omitted, or combined. In addition, the features described with reference to certain examples may be combined in other examples.

[0136] Through the description of the above implementation methods, those skilled in the art can clearly understand that the above-mentioned embodiment methods can be implemented by means of software plus a necessary general hardware platform, and of course by hardware, but in many cases the former is a better implementation method. Based on such an understanding, the technical solution of the present application, or the part that contributes to the prior art, can be embodied in the form of a computer software product, which is stored in a storage medium (such as ROM / RAM, a disk, or an optical disk), and includes a number of instructions for a terminal (which can be a mobile phone, a computer, a server, or a network device, etc.) to execute the methods of each embodiment of the present application.

[0137] The embodiments of the present application are described above in conjunction with the accompanying drawings, but the present application is not limited to the above-mentioned specific implementation methods. The above-mentioned specific implementation methods are merely illustrative and not restrictive. Under the guidance of the present application, ordinary technicians in this field can also make many forms without departing from the purpose of the present application and the scope of protection of the claims, all of which are within the protection of the present application.

Claims

1. A method for rendering a three-dimensional scene, characterized in that: The rendering method of the three-dimensional scene comprises: receiving a first input for switching a roaming observation point of the three-dimensional model from a first observation point to a second observation point, and determining a storage state of a rendering material; Determining, according to a storage state of the rendering material, a target rendering material for rendering a second observation point of the three-dimensional model, and rendering the second observation point in the three-dimensional model according to the target rendering material; In response to the first input, displaying a virtual reality scene of the second observation point; Determining, according to the storage state of the rendering material, a target rendering material for rendering a second observation point of the three-dimensional model, specifically includes: When it is determined that the first rendering material has been stored in the material database, determining the first rendering material as the target rendering material; When it is determined that the first rendering material is not stored in the material database, requesting a cloud server to load a second rendering material, and determining the second rendering material as the target rendering material; The first rendering material is associated with the second observation point, and a resolution of the second rendering material is smaller than a resolution of the first rendering material.

2. The method for rendering a three-dimensional scene according to claim 1, characterized in that: When it is determined that the first rendering material has been stored in the material database, determining the first rendering material as the target rendering material specifically includes: Traversing name information of a plurality of rendering materials stored in the material database, wherein the plurality of rendering materials are materials loaded before entering the three-dimensional model, and the name information includes name keywords of observation points matched by the rendering materials; Determining that the first rendering material among the plurality of rendering materials contains the name keyword of the second observation point has been stored in the material database; The first rendering material is determined as the target rendering material.

3. The method for rendering a three-dimensional scene according to claim 1, characterized in that: After requesting the cloud server to load the second rendering material, the method further includes: Determining a loading time for loading the second rendering material; When the loading time is longer than the first preset time, the first preset information is displayed or played in the virtual reality scene at the second observation point.

4. The method for rendering a three-dimensional scene according to claim 3, characterized in that: The first preset information is used to indicate that the virtual reality scene of the second observation point is in the loading process.

5. The method for rendering a three-dimensional scene according to claim 1, characterized in that: When the target rendering material is the second rendering material, after displaying the virtual reality scene of the second observation point, the method further includes: Requesting the cloud server to load a third rendering material, where a resolution of the third rendering material is greater than a resolution of the second rendering material; The second observation point in the three-dimensional model is re-rendered according to the third rendering material, and the virtual reality scene displaying the second observation point is updated.

6. The method for rendering a three-dimensional scene according to claim 5, characterized in that: The resolution of the third rendering material is within the same preset range as the resolution of the first rendering material.

7. A three-dimensional scene rendering device, characterized in that: The rendering device of the three-dimensional scene comprises: A receiving unit, configured to receive a first input for switching a roaming observation point of the three-dimensional model from a first observation point to a second observation point; A processing unit for determining a storage status of a rendered material; The processing unit is further used to determine a target rendering material for rendering a second observation point of the three-dimensional model according to a storage state of the rendering material, and render the second observation point in the three-dimensional model according to the target rendering material; A display unit, configured to display a virtual reality scene of the second observation point in response to the first input; The processing unit is further configured to, when it is determined that the first rendering material has been stored in the material database, determine the first rendering material as the target rendering material; when it is determined that the first rendering material has not been stored in the material database, request a cloud server to load a second rendering material, and determine the second rendering material as the target rendering material; wherein the first rendering material is associated with the second observation point, and a resolution of the second rendering material is smaller than a resolution of the first rendering material.

8. An electronic device, characterized in that: include: A memory on which programs or instructions are stored; A processor, configured to implement the steps of the three-dimensional scene rendering method as described in any one of claims 1 to 6 when executing the program or instruction.

9. A readable storage medium having a program or instruction stored thereon, characterized in that: When the program or instruction is executed by a processor, the steps of the three-dimensional scene rendering method according to any one of claims 1 to 6 are implemented.

Citation Information

Patent Citations

  • Media component switching method and device, storage medium and electronic equipment

    CN113377455A

  • Immersive Media Metrics for Virtual Reality Content With Multiple Viewpoints

    US20200382796A1