Scene rendering method, scene rendering device, electronic device and readable storage medium

By detecting the terminal network signal strength and selecting the quality of adaptive three-dimensional material, the problem of long loading time for virtual reality scenes in weak network environments is solved, and efficient rendering and timely viewing effects are achieved in different network environments.

CN114332328BActive Publication Date: 2025-02-21BEIJING YOUZHUJU NETWORK TECH CO LTD
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
CN202111676579.X
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2021-12-31
Publication Date
2025-02-21
Estimated Expiration
2041-12-31

AI Technical Summary

Technical Problem

When the user terminal has poor network speed or fluctuations in the network, it takes a long time to load the virtual reality scene, resulting in the user being unable to view the model in time.

Method used

By detecting the network signal strength of the terminal, selecting the quality of three-dimensional material that is suitable for the current network environment, rendering through cloud in a strong network environment, and rendering virtual reality scenes through terminal in a weak network environment.

Benefits of technology

It improves the timeliness of users to view virtual reality scenes, reduces the time when users wait for loading the scenes, and ensures the clarity and fluency of virtual reality scenes under different network environments.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN114332328B_ABST
    Figure CN114332328B_ABST
Patent Text Reader

Abstract

The present application discloses a scene rendering method, a scene rendering device, an electronic device and a readable storage medium. The scene rendering method includes: in response to a virtual reality scene rendering input, determining the intensity range of the current network signal strength of the terminal; selecting a target three-dimensional material in a three-dimensional material library according to the intensity range of the current network signal strength, wherein the material quality of the target three-dimensional material is associated with the intensity range; when the current network signal strength is within a first intensity range, sending a rendering instruction to a server, and receiving a virtual reality scene sent back by the server, wherein the virtual reality scene is associated with the target three-dimensional material; when the current network signal strength is within a second intensity range, downloading the target three-dimensional material, and rendering the virtual reality scene with the target three-dimensional material; wherein the minimum value in the first intensity range is greater than the maximum value in the second intensity range.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application belongs to the field of virtual reality technology, and specifically relates to a scene rendering method, a scene rendering device, an electronic device and a readable storage medium. Background Art

[0002] In the prior art, the virtual reality interactive scene requires the terminal to render the virtual reality scene in real time according to the user's operation instructions, and the rendered materials are usually stored in the cloud.

[0003] When the network speed of the user terminal is poor or the network fluctuates, it takes a long time for the user terminal to load the material, resulting in the user being unable to view the model in time. Summary of the invention

[0004] The purpose of the embodiments of the present application is to provide a scene rendering method, a scene rendering device, an electronic device and a readable storage medium, which improves the timeliness of users viewing virtual reality scenes and reduces the time users wait for scenes to load.

[0005] In a first aspect, an embodiment of the present application provides a scene rendering method, including: in response to a virtual reality scene rendering input, determining an intensity range of a current network signal strength of a terminal; selecting a target three-dimensional material in a three-dimensional material library according to the intensity range of the current network signal strength, wherein the material quality of the target three-dimensional material is associated with the intensity range; when the current network signal strength is within a first intensity range, sending a rendering instruction to a server, and receiving a virtual reality scene transmitted back by the server, wherein the virtual reality scene is associated with the target three-dimensional material; when the current network signal strength is within a second intensity range, downloading the target three-dimensional material, and rendering the virtual reality scene using the target three-dimensional material; wherein the minimum value in the first intensity range is greater than the maximum value in the second intensity range.

[0006] In a second aspect, an embodiment of the present application provides a scene rendering device, including: a determination module, used to determine the intensity range of the current network signal strength of the terminal in response to a virtual reality scene rendering input; a selection module, used to select a target three-dimensional material in a three-dimensional material library according to the intensity range of the current network signal strength, and the material quality of the target three-dimensional material is associated with the intensity range; a sending module, used to send a rendering instruction to a server when the current network signal strength is within a first intensity range; a receiving module, used to receive a virtual reality scene sent back by the server, and the virtual reality scene is associated with the target three-dimensional material; a downloading module, used to download the target three-dimensional material when the current network signal strength is within a second intensity range, and render the virtual reality scene through the target three-dimensional material; a rendering module, used to render the virtual reality scene through the target three-dimensional material; wherein the minimum value in the first intensity range is greater than the maximum value in the second intensity range.

[0007] In a third aspect, an embodiment of the present application provides an electronic device, which includes a processor and a memory, wherein the memory stores programs or instructions that can be run on the processor, and when the programs or instructions are executed by the processor, the steps of the scene rendering method of the first aspect are implemented.

[0008] In a fourth aspect, an embodiment of the present application provides a readable storage medium, on which a program or instruction is stored, and when the program or instruction is executed by a processor, the steps of the scene rendering method of the first aspect are implemented.

[0009] In an embodiment of the present application, before the user views the virtual reality scene, the network signal strength of the terminal is detected, and target three-dimensional materials of different material qualities are selected according to the network signal strength to render the virtual reality scene. When the terminal network environment is good, the virtual reality scene is rendered by a high-quality material model to improve the clarity and accuracy of the virtual reality scene, and when the terminal network environment is poor, the virtual reality scene is rendered by a low-quality material model, which can ensure that the user can view the virtual reality scene in time and avoid the user waiting for a long time to load the scene. The embodiment of the present application adjusts the clarity and accuracy of the rendered virtual reality scene according to the network status of the terminal, thereby improving the timeliness of the user viewing the virtual reality scene and reducing the time the user waits for the scene to load. And when the terminal is in a strong network environment, the virtual reality scene is rendered by cloud rendering, which improves the clarity and smoothness of the virtual reality scene rendering. When the terminal is in a weak network environment, the virtual reality scene is rendered by terminal rendering, which ensures the timeliness of the user viewing the virtual reality scene. BRIEF DESCRIPTION OF THE DRAWINGS

[0010] Figure 1 One of the flow diagrams of the scene rendering method provided in an embodiment of the present application is shown;

[0011] Figure 2 The second flowchart of the scene rendering method provided in the embodiment of the present application is shown;

[0012] Figure 3 The third flowchart of the scene rendering method provided in the embodiment of the present application is shown;

[0013] Figure 4 A fourth flow chart of the scene rendering method provided in an embodiment of the present application is shown;

[0014] Figure 5 A fifth flow chart of the scene rendering method provided in an embodiment of the present application is shown;

[0015] Figure 6A structural block diagram of a scene rendering device provided in an embodiment of the present application is shown;

[0016] Figure 7 A structural block diagram of an electronic device provided in an embodiment of the present application is shown;

[0017] Figure 8 A schematic diagram of the hardware structure of an electronic device according to an embodiment of the present application is shown. DETAILED DESCRIPTION

[0018] The following will be combined with the drawings in the embodiments of the present application to clearly describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, rather than all the embodiments. All other embodiments obtained by ordinary technicians in this field based on the embodiments in the present application belong to the scope of protection of this application.

[0019] The terms "first", "second", etc. in the specification and claims of the present application are used to distinguish similar objects, and are not used to describe a specific order or sequence. It should be understood that the data used in this way can be interchangeable under appropriate circumstances, so that the embodiments of the present application can be implemented in an order other than those illustrated or described here, and the objects distinguished by "first", "second", etc. are generally of one type, and the number of objects is not limited. For example, the first object can be one or more. In addition, "and / or" in the specification and claims represents at least one of the connected objects, and the character " / " generally indicates that the objects associated with each other are in an "or" relationship.

[0020] The following is combined with Figures 1 to 8 , the scene rendering method, scene rendering device, electronic device and readable storage medium provided in the embodiments of the present application are described in detail through specific embodiments and their application scenarios.

[0021] In an embodiment of the present application, a scene rendering method is provided. Figure 1 FIG. 1 shows one of the flow charts of the scene rendering method provided in an embodiment of the present application, such as Figure 1 As shown, the scene rendering method includes:

[0022] Step 102, in response to the virtual reality scene rendering input, determining a strength range of the current network signal strength of the terminal;

[0023] Step 104 , selecting a target 3D material in the 3D material library according to the strength range of the current network signal strength; wherein the material quality of the target 3D material is associated with the strength range.

[0024] It is understandable that the higher the quality of the target 3D material, the higher the quality of the virtual reality scene rendered by the target 3D material, and the more network resources are required to transmit the target 3D material or the virtual reality scene. The lower the quality of the target 3D material, the lower the quality of the virtual reality scene rendered by the target 3D material, and the fewer network resources are required to transmit the target 3D material or the virtual reality scene.

[0025] Step 106: Display the virtual reality scene according to the target three-dimensional material.

[0026] The intensity range includes a first intensity range and a second intensity range, and the minimum value in the first intensity range is greater than the maximum value in the second intensity range, that is, the first intensity range is greater than the second intensity range.

[0027] Before displaying the virtual reality scene, it is necessary to render the virtual display scene according to the target three-dimensional material. Specifically, when the current network signal strength is within the first strength range, a rendering instruction is sent to the server, and the virtual reality scene transmitted back by the server is received;

[0028] When the current network signal strength is within the second strength range, downloading the target three-dimensional material, and rendering the virtual reality scene by using the target three-dimensional material;

[0029] The minimum value in the first intensity range is greater than the maximum value in the second intensity range.

[0030] In an embodiment of the present application, a user sends a virtual display scene rendering input to an electronic device, and the terminal sends a rendering request to the server, and the terminal detects the current network signal strength. The target three-dimensional material in the three-dimensional material library is selected according to the intensity range of the network signal strength. The three-dimensional material library in the server stores image materials and model materials, and the server can adjust the material quality of the image materials and model materials. When the network signal strength is high, it is determined that the current network speed of the terminal is fast, and the virtual reality scene can be rendered with the target three-dimensional material with high material quality. When the network signal strength is low, it is determined that the current network speed of the terminal is slow, and the virtual reality scene needs to be rendered with low-quality target three-dimensional materials.

[0031] Different rendering methods are selected according to the current network signal strength of the terminal to render the virtual reality scene. Specifically, the rendering methods include terminal rendering and cloud rendering. Among them, terminal rendering is that the terminal downloads the target 3D material to the terminal locally for rendering and display. Cloud rendering is that the server directly renders the target 3D material and transmits the rendering result back to the terminal in the form of a video stream for display.

[0032] When using cloud rendering, if the network signal strength is low, the virtual reality scene displayed on the terminal will be stuck, affecting the user's viewing experience. When using terminal rendering, the rendering time is related to the performance of the terminal. When the terminal performance is insufficient, the terminal rendering method will affect the rendering speed, resulting in low rendering efficiency, causing users to be unable to view the virtual reality scene in time.

[0033] The embodiment of the present application selects different rendering methods to render the virtual reality scene according to the current network signal strength of the terminal, thereby ensuring a high rendering effect under different network environments.

[0034] If the current network signal strength is within the first strength range, the terminal is determined to be in a strong network environment. If the current network signal strength is within the second strength range, the terminal is determined to be in a weak network environment. When the terminal is in a strong network environment, the terminal sends a rendering instruction to the server. The server models and renders the target three-dimensional material in response to the rendering instruction to obtain a virtual reality scene, and transmits the virtual reality scene back to the terminal so that the terminal displays the virtual reality scene. When the terminal is in a weak network environment, the terminal downloads the target three-dimensional material to the terminal locally, models and renders the target three-dimensional material locally, and displays the obtained virtual reality scene.

[0035] Rendering methods include cloud rendering and terminal rendering. When the terminal is in a strong network environment, the virtual reality scene is rendered through cloud rendering. Due to the strong network signal strength, the terminal is only used for the real virtual reality scene. The rendering process is executed by the server, which improves the efficiency of the terminal's real virtual reality scene. It does not need to occupy the terminal's operating resources, ensuring the smoothness and efficiency of the virtual reality scene display. When the terminal is in a weak network environment, the virtual reality scene is rendered through terminal rendering. Due to the weak network signal strength, after the terminal completes the download of the target three-dimensional material, the terminal renders the virtual reality scene locally, avoiding the problem of virtual reality scene reality freeze caused by cloud rendering in a weak network environment.

[0036] Exemplarily, when the network signal strength is within the first strength range, the target three-dimensional material of the first material quality is selected, and when the network signal strength is within the second strength range, the target three-dimensional material of the second material quality is selected. Among them, the minimum value in the first strength range is greater than the maximum value in the second strength range, and the first material quality is greater than the second material quality. When it is detected that the network signal strength is within the first strength range (the network environment is good), it is determined that the network speed of the current terminal is fast, and the target three-dimensional material of the first material quality (high quality) can be selected to render the virtual reality scene to obtain a high-quality virtual reality scene, and the high-quality virtual reality scene is displayed on the display screen of the terminal. When it is detected that the network signal is within the second strength range (the network environment is poor), it is determined that the network speed of the current terminal is slow, so the target three-dimensional material of the second material quality (low quality) is selected to render the virtual display scene.

[0037] In some embodiments, the accuracy of the virtual reality scene rendered by the server is higher than the accuracy of the virtual reality scene rendered by the terminal.

[0038] In these embodiments, the terminal is in a strong network environment, and the server obtains a virtual reality scene by rendering a high-quality target three-dimensional material. The terminal is only used to receive and display the virtual reality scene sent back by the server, which improves the clarity and fluency of the virtual reality scene. When the terminal is in a weak network environment, the server converts the high-quality target three-dimensional material into a low-quality target three-dimensional material, and the server sends the low-quality target three-dimensional material back to the terminal. The terminal obtains a virtual reality scene by rendering the low-quality target three-dimensional material, and displays a low-quality virtual reality scene, so that in a weak network environment, the terminal displays a low-quality virtual reality scene, ensuring the timeliness of the user viewing the virtual reality scene. It is worth noting that the virtual display scene can be rendered by the target three-dimensional material by the terminal, or by the server. When the terminal performs the above rendering step, it is necessary to download the target three-dimensional material to the terminal locally, render the target three-dimensional material locally, and display the rendered virtual reality scene. When the server performs the above rendering step, the server sends the rendered virtual reality scene back to the terminal so that the terminal displays the rendered virtual reality scene.

[0039] In an embodiment of the present application, before the user views the virtual reality scene, the network signal strength of the terminal is detected, and target three-dimensional materials of different material qualities are selected according to the network signal strength to render the virtual reality scene. When the terminal network environment is good, the virtual reality scene is rendered by a high-quality material model to improve the clarity and accuracy of the virtual reality scene, and when the terminal network environment is poor, the virtual reality scene is rendered by a low-quality material model, which can ensure that the user can view the virtual reality scene in time and avoid the user waiting for a long time to load the scene. The embodiment of the present application adjusts the clarity and accuracy of the rendered virtual reality scene according to the network status of the terminal, thereby improving the timeliness of the user viewing the virtual reality scene and reducing the time the user waits for the scene to load. And when the terminal is in a strong network environment, the virtual reality scene is rendered by cloud rendering, which improves the clarity and smoothness of the virtual reality scene rendering. When the terminal is in a weak network environment, the virtual reality scene is rendered by terminal rendering, which ensures the timeliness of the user viewing the virtual reality scene.

[0040] In some embodiments, when a user conducts a VR (virtual reality) house viewing, after selecting the house to be viewed, the mobile phone detects the current network signal strength. If it is detected that the mobile phone is in a weak network environment, a low-quality model request is sent to the server to select a target 3D material with lower material quality. The server sends the low-quality target 3D material to the mobile phone, and the mobile phone renders the virtual reality scene with the high-quality target 3D material and displays the virtual reality scene.

[0041] It is worth noting that a 3D material library is stored in the server, and the 3D material library includes image materials and model materials, and the image materials and model materials stored in the 3D material library are all high-quality materials. When the server receives a request for low-quality target 3D materials sent by the terminal, the server can reduce the resolution of the image materials and can also reduce the surface of the model materials, thereby generating low-quality image materials and model materials, ensuring that the low-quality image materials and model materials correspond to the high-quality image materials and model materials in the 3D material library. The low-quality virtual reality scene rendered by the terminal differs from the high-quality virtual reality scene only in clarity, ensuring that the low-quality virtual reality scene will not have distortion problems.

[0042] In some embodiments of the present application, the target three-dimensional material includes an image material and a model material. According to the strength range of the current network signal strength, the target three-dimensional material in the three-dimensional material library is selected, including:

[0043] When the current network signal strength is within a first strength range, selecting an image material with a first resolution and a model material with a first precision;

[0044] When the current network signal strength is within the second strength range, an image material with a second resolution and a model material with a second precision are selected.

[0045] The minimum value in the first intensity range is greater than the maximum value in the second intensity range, the first resolution is greater than the second resolution, and the first precision is greater than the second precision.

[0046] In the embodiment of the present application, the target three-dimensional material includes an image material and a model material. Before rendering the target three-dimensional material, the image material is set on the model material by mapping to obtain a three-dimensional model, and the three-dimensional model is rendered to obtain a virtual reality scene. Among them, the material quality of the target three-dimensional material includes the resolution of the image material and the precision of the model material. The higher the resolution of the image material, the greater the network occupancy during the transmission of the image material. The more faces of the model material and the higher the precision of the model material, the greater the network occupancy during the transmission of the model material. When the network signal strength is in different intensity ranges, image materials of different resolutions and model materials of different precisions are selected. When the minimum value in the first intensity range is greater than the maximum value in the second intensity range, and the current network signal strength is in the first intensity range, it is determined that the current network environment of the terminal is good, and when the current network signal strength is in the second intensity range, it is determined that the current network environment of the terminal is poor. When it is detected that the current network environment of the terminal is good, the image material of the first resolution (high-quality image material) and the model material of the first precision (high-quality model material) are selected. When it is detected that the current network environment of the terminal is poor, the image material of the second resolution (low-quality image material) and the model material of the second precision (low-quality model material) are selected.

[0047] In some embodiments, during the VR house viewing process, when the virtual reality scene is rendered through the terminal, if the terminal's network environment is detected to be poor, low-resolution image materials and low-precision model materials are selected, and the terminal downloads the low-resolution image materials and low-precision model materials, thereby shortening the download time. This improves the efficiency of users viewing virtual reality scenes in a weak network environment.

[0048] In some other embodiments, during the VR house viewing process, when the server is selected to render the virtual reality scene, if the terminal's network environment is detected to be poor, the server models and renders low-resolution image materials and low-precision model materials, and transmits them back to the terminal through video streaming technology, so that the terminal can realize the virtual reality scene. The video stream obtained by the server by rendering the low-quality model has a small network occupancy, and there will be no jamming during the viewing process, which improves the user's viewing experience.

[0049] The embodiment of the present application grades the network signal strength of the terminal by setting a first intensity range and a second intensity range, and sets image materials and model materials of different material qualities corresponding to the first intensity range and the second intensity range, thereby facilitating the selection of image materials and model materials according to the network signal strength of the current terminal.

[0050] In some embodiments of the present application, Figure 2 FIG. 2 shows a second flow chart of the scene rendering method provided in an embodiment of the present application. Figure 2 As shown, after rendering the virtual reality scene according to the target three-dimensional material, it also includes:

[0051] Step 202, determining the change of the current network signal strength;

[0052] Step 204: Update the virtual reality scene according to the change in the current network signal strength.

[0053] In the embodiment of the present application, the network signal strength of the terminal is continuously detected, and when it is detected that the signal strength has changed, the target three-dimensional material is reselected, and the rendered virtual reality scene is updated. Specifically, when it is detected that the terminal has changed from a weak network environment to a strong network environment, the high-quality target three-dimensional material corresponding to the low-quality virtual reality scene rendered is downloaded, and then modeling and rendering are performed using the high-quality target three-dimensional material to obtain a high-quality virtual reality scene, and the low-quality virtual reality scene is replaced with a high-quality virtual reality scene, thereby completing the update of the virtual reality scene.

[0054] In the process of rendering the virtual reality scene, the embodiment of the present application continuously detects the network signal strength of the terminal, and when the network signal strength changes, reselects the target three-dimensional material in the three-dimensional material library, and renders the virtual reality scene according to the reselected target three-dimensional material. This ensures that the terminal can display the virtual reality scene in a timely manner when the terminal is in a weak network environment, and can timely re-download high-quality target three-dimensional materials when the terminal is in a strong network environment to update the virtual reality scene.

[0055] In some embodiments of the present application, Figure 3 The third flow chart of the scene rendering method provided in the embodiment of the present application is shown as follows: Figure 3 As shown, the virtual reality scene is updated according to the change of the current network signal strength, including:

[0056] Step 302: when the current network signal strength increases from the second strength range to the first strength range, re-download the image material of the first resolution and the model material of the first precision;

[0057] Step 304: Update the virtual reality scene according to the image material with the first resolution and the model material with the first precision.

[0058] In the embodiment of the present application, it is detected that the current network signal strength increases from a lower first intensity range to a second intensity range, and it is determined that the terminal enters a strong network environment from a weak network environment. At this time, the image materials and model materials required for the virtual reality scene are re-downloaded, and the re-downloaded image materials and model materials are image materials of the first resolution (high-quality image materials) and model materials of the first precision (high-quality model materials). Modeling and rendering are performed using the image materials of the first resolution and the model materials of the first precision to obtain an updated virtual reality scene. When the terminal switches from a weak network environment to a strong network environment, the virtual reality scene can be re-modeled and rendered.

[0059] In some embodiments, when the user is viewing a house through VR, if the terminal is in a weak network environment when viewing the virtual reality scene of the initial viewpoint, the terminal will download low-resolution image materials and low-precision model materials, and set the first-resolution image materials on the first-precision model materials by mapping to obtain a three-dimensional model, and render the three-dimensional model to obtain the virtual reality scene of the initial viewpoint. When the user continues to observe the virtual reality scene of the above viewpoint, it is detected that the terminal enters a strong network environment, and the terminal re-downloads the high-resolution image materials and high-precision model materials corresponding to the viewpoint, and re-renders the virtual reality scene of the viewpoint, and switches to display the re-rendered virtual reality scene, so that the user can view the clear virtual reality scene in time.

[0060] The embodiment of the present application continuously detects the current network signal strength, and updates the low-quality virtual reality scene when the current network signal strength changes from the first strength range to the second strength range. When the user is observing the low-quality virtual reality scene, if the strength of the network signal increases, the low-quality virtual reality scene displayed on the terminal is promptly replaced with a high-quality virtual reality scene, and the clarity and accuracy of the user's viewing of the virtual reality scene is guaranteed while ensuring that the user can view the virtual reality scene in a timely manner.

[0061] In some embodiments of the present application, Figure 4 FIG. 4 shows a flow chart of a scene rendering method provided in an embodiment of the present application. Figure 4 As shown, updating the virtual reality scene according to the image material of the first resolution and the model material of the first precision includes:

[0062] Step 402, rendering the image material of the first resolution and the model material of the first precision to obtain an updated virtual reality scene, and deleting the virtual reality scene before the update;

[0063] Step 404: display the updated virtual reality scene.

[0064] In the embodiment of the present application, when it is detected that the network environment in which the terminal is located switches from a weak network environment to a strong network environment, the image material of the first resolution and the model material of the first precision are downloaded again. Then, by rendering the image material of the first resolution and the model material of the first precision, an updated virtual reality scene can be obtained, and the quality of the updated virtual reality scene is higher than the quality of the virtual reality scene before the update. At this time, the control terminal displays the updated virtual reality scene to replace the virtual reality scene before the update obtained by rendering the image material of the second resolution and the model material of the second precision, and deletes the virtual reality scene before the update.

[0065] After detecting that the network environment has changed from a weak network environment to a strong network environment, the embodiment of the present application renders the downloaded high-quality three-dimensional material to obtain an updated virtual reality scene (a high-quality virtual reality scene), and then displays the updated virtual display scene, so that the user can view the high-definition virtual reality scene as soon as possible when the network environment improves. The virtual reality scene before the update (a low-quality virtual reality scene) is deleted in time to avoid occupying the terminal memory resources for a long time.

[0066] In some embodiments of the present application, Figure 5 FIG. 5 shows a flow chart of a scene rendering method provided in an embodiment of the present application. Figure 5 As shown, determining the strength range of the current network signal strength of the terminal includes:

[0067] Step 502, timing the downloading time of the preset resource;

[0068] Among them, the preset resource can be selected as a loading map, that is, a loading map that the terminal needs to download before rendering the virtual reality scene.

[0069] Step 504: Determine the strength range of the current network signal strength of the terminal according to the download duration.

[0070] In the embodiment of the present application, before rendering the virtual reality scene, the terminal will download preset resources such as preview images from the server. The download time of the current resource downloaded by the terminal is timed, and the strength range of the current network signal strength of the terminal can be detected according to the download time of the current resource.

[0071] It is understandable that the data volume of the preset resource is a fixed value, so the current network environment of the terminal can be accurately judged according to the downloading time of downloading the preset resource.

[0072] In the embodiment of the present application, before starting to render the virtual reality scene, the terminal is controlled to download the preset resource, and the download time of the terminal downloading the preset resource is timed. The signal strength of the current network environment can be accurately determined according to the download time. While ensuring the accuracy of obtaining the current network signal strength, the step of obtaining the current network signal strength is simplified.

[0073] In some embodiments, when the terminal is downloading the target three-dimensional material from the server, or downloading the video stream of the virtual reality scene, the download duration is timed, and the change state of the current network signal strength is determined based on the download duration.

[0074] In some embodiments of the present application, determining the strength range of the current network signal strength of the terminal according to the download duration includes:

[0075] Determining that the current network signal strength is within a first strength range based on the download duration being less than a preset duration;

[0076] Based on the download duration being greater than the preset duration, it is determined that the current network signal strength is within a second strength range.

[0077] In the implementation of this application, when it is detected that the download duration is less than the preset duration, it is determined that the current network signal is strong, and the current network signal strength is determined to be in the first strength range. When it is detected that the download duration is greater than the preset duration, it is determined that the current network signal is weak, and the current network signal strength is determined to be in the second strength range.

[0078] In the implementation of the present application, by comparing the download duration with the preset duration, the strength range of the current network signal strength can be accurately determined, thereby further improving the accuracy of network signal strength detection.

[0079] The scene rendering method provided in the embodiment of the present application can be executed by a scene rendering device. In the embodiment of the present application, a method for a scene rendering device to perform model rendering is taken as an example to illustrate the scene rendering device provided in the embodiment of the present application.

[0080] In some embodiments of the present application, a scene rendering device is provided. Figure 6 The structural block diagram of the scene rendering device provided by the embodiment of the present application is shown as follows: Figure 6 As shown, the scene rendering device 600 includes:

[0081] A determination module 602 is used to determine a strength range of a current network signal strength of a terminal in response to a virtual reality scene rendering input;

[0082] A selection module 604 is used to select a target 3D material in the 3D material library according to the strength range of the current network signal strength, wherein the material quality of the target 3D material is associated with the strength range;

[0083] A sending module 606, configured to send a rendering instruction to a server when the current network signal strength is within a first strength range;

[0084] A receiving module 608 is used to receive a virtual reality scene sent back by the server, where the virtual reality scene is associated with the target three-dimensional material;

[0085] A download module 610, configured to download a target 3D material and render a virtual reality scene using the target 3D material when the current network signal strength is within a second strength range;

[0086] The rendering module 612 is used to render the virtual reality scene using the target three-dimensional material.

[0087] The minimum value in the first intensity range is greater than the maximum value in the second intensity range.

[0088] In an embodiment of the present application, before the user views the virtual reality scene, the network signal strength of the terminal is detected, and target three-dimensional materials of different material qualities are selected according to the network signal strength to render the virtual reality scene. When the terminal network environment is good, the virtual reality scene is rendered by a high-quality material model to improve the clarity and accuracy of the virtual reality scene, and when the terminal network environment is poor, the virtual reality scene is rendered by a low-quality material model, which can ensure that the user can view the virtual reality scene in time and avoid the user waiting for a long time to load the scene. The embodiment of the present application adjusts the clarity and accuracy of the rendered virtual reality scene according to the network status of the terminal, thereby improving the timeliness of the user viewing the virtual reality scene and reducing the time the user waits for the scene to load. And when the terminal is in a strong network environment, the virtual reality scene is rendered by cloud rendering, which improves the clarity and smoothness of the virtual reality scene rendering. When the terminal is in a weak network environment, the virtual reality scene is rendered by terminal rendering, which ensures the timeliness of the user viewing the virtual reality scene.

[0089] In some embodiments of the present application, the selection module 604 is further configured to select an image material of a first resolution and a model material of a first precision when the current network signal strength is within a first strength range;

[0090] The selection module 604 is further configured to select an image material of a second resolution and a model material of a second precision when the current network signal strength is within a second strength range.

[0091] The minimum value in the first intensity range is greater than the maximum value in the second intensity range, the first resolution is greater than the second resolution, and the first precision is greater than the second precision.

[0092] The embodiment of the present application grades the network signal strength of the terminal by setting a first intensity range and a second intensity range, and sets image materials and model materials of different material qualities corresponding to the first intensity range and the second intensity range, thereby facilitating the selection of image materials and model materials according to the network signal strength of the current terminal.

[0093] In some embodiments of the present application, the determination module 602 is further used to determine a change in the current network signal strength;

[0094] The scene rendering device 600 further includes:

[0095] The update module is used to update the virtual reality scene according to the changes in the current network signal strength.

[0096] In the process of rendering the virtual reality scene, the embodiment of the present application continuously detects the network signal strength of the terminal, and when the network signal strength changes, reselects the target three-dimensional material in the three-dimensional material library, and renders the virtual reality scene according to the reselected target three-dimensional material. This ensures that the terminal can display the virtual reality scene in a timely manner when the terminal is in a weak network environment, and can timely re-download high-quality target three-dimensional materials when the terminal is in a strong network environment to update the virtual reality scene.

[0097] In some embodiments of the present application, the update module is further used to re-download the image material of the first resolution and the model material of the first precision when the current network signal strength increases from the second strength range to the first strength range;

[0098] The updating module is further used to update the virtual reality scene according to the image material of the first resolution and the model material of the first precision.

[0099] The embodiment of the present application continuously detects the current network signal strength, and updates the low-quality virtual reality scene when the current network signal strength changes from the first strength range to the second strength range. When the user is observing the low-quality virtual reality scene, if the strength of the network signal increases, the low-quality virtual reality scene displayed on the terminal is promptly replaced with a high-quality virtual reality scene, and the clarity and accuracy of the user's viewing of the virtual reality scene is guaranteed while ensuring that the user can view the virtual reality scene in a timely manner.

[0100] In some embodiments of the present application, the rendering module 612 is further configured to render the image material of the first resolution and the model material of the first precision to obtain an updated virtual reality scene, and delete the virtual reality scene before the update;

[0101] The scene rendering device 600 comprises:

[0102] The display module is also used to display the updated virtual reality scene. After detecting that the network environment has changed from a weak network environment to a strong network environment, the embodiment of the present application obtains the updated virtual reality scene (high-quality virtual reality scene) by rendering the downloaded high-quality three-dimensional material, and then displays the updated virtual display scene, so that the user can view the high-definition virtual reality scene as soon as possible when the network environment improves. And the virtual reality scene before the update (low-quality virtual reality scene) is deleted in time to avoid occupying the terminal memory resources for a long time.

[0103] In some embodiments of the present application, the scene rendering device further includes:

[0104] A timing module, used to time the downloading time of a preset resource;

[0105] The determination module 602 is further configured to determine a strength range of the current network signal strength of the terminal according to the download duration.

[0106] In the embodiment of the present application, before starting to render the virtual reality scene, the terminal is controlled to download the preset resource, and the download time of the terminal downloading the preset resource is timed. The signal strength of the current network environment can be accurately determined according to the download time. While ensuring the accuracy of obtaining the current network signal strength, the step of obtaining the current network signal strength is simplified.

[0107] In some embodiments of the present application, the determination module 602 is further configured to determine that the current network signal strength is within a first strength range based on the download duration being less than a preset duration;

[0108] The determination module 602 is further configured to determine that the current network signal strength is within a second strength range based on the download duration being greater than a preset duration.

[0109] In the implementation of the present application, by comparing the download duration with the preset duration, the strength range of the current network signal strength can be accurately determined, thereby further improving the accuracy of network signal strength detection.

[0110] The scene rendering device in the embodiment of the present application can be an electronic device, or a component in the electronic device, such as an integrated circuit or a chip. The electronic device can be a terminal, or other devices other than a terminal. Exemplarily, the electronic device can be a mobile phone, a tablet computer, a laptop computer, a PDA, a vehicle-mounted electronic device, a mobile Internet device (Mobile Internet Device, MID), an augmented reality (augmented reality, AR) / virtual reality (virtual reality, VR) device, a robot, a wearable device, an ultra-mobile personal computer (ultra-mobile personal computer, UMPC), a netbook or a personal digital assistant (personal digital assistant, PDA), etc., and can also be a server, a network attached storage (Network Attached Storage, NAS), a personal computer (personal computer, PC), a television (television, TV), a teller machine or a self-service machine, etc., which is not specifically limited in the embodiment of the present application.

[0111] The scene rendering device in the embodiment of the present application may be a device having an operating system. The operating system may be an Android operating system, an iOS operating system, or other possible operating systems, which are not specifically limited in the embodiment of the present application.

[0112] The scene rendering device provided in the embodiment of the present application can implement each process implemented in the above method embodiment, and will not be described again here to avoid repetition.

[0113] Alternatively, if Figure 7 As shown, an embodiment of the present application also provides an electronic device 700, which includes a processor 702 and a memory 704. The memory 704 stores programs or instructions that can be executed on the processor 702. When the program or instructions are executed by the processor 702, the various steps of the above-mentioned method embodiment are implemented and the same technical effect can be achieved. To avoid repetition, they are not described here.

[0114] It should be noted that the electronic devices in the embodiments of the present application include the above-mentioned mobile electronic devices and non-mobile electronic devices.

[0115] Figure 8 A schematic diagram of the hardware structure of an electronic device to implement an embodiment of the present application.

[0116] The electronic device 800 includes but is not limited to: a radio frequency unit 801, a network module 802, an audio output unit 803, an input unit 804, a sensor 805, a display unit 806, a user input unit 807, an interface unit 808, a memory 809, and a processor 810 and other components.

[0117] Those skilled in the art will appreciate that the electronic device 800 may also include a power source (such as a battery) for supplying power to each component, and the power source may be logically connected to the processor 810 through a power management system, thereby implementing functions such as managing charging, discharging, and power consumption management through the power management system. Figure 8 The electronic device structure shown in the figure does not constitute a limitation on the electronic device. The electronic device may include more or fewer components than shown in the figure, or combine certain components, or arrange the components differently, which will not be described in detail here.

[0118] The processor 810 is used to determine the strength range of the current network signal strength of the terminal in response to the virtual reality scene rendering input;

[0119] The processor 810 is used to select a target 3D material in the 3D material library according to the strength range of the current network signal strength, wherein the material quality of the target 3D material is associated with the strength range;

[0120] The network module 802 is used to send a rendering instruction to the server when the current network signal strength is within a first strength range;

[0121] The network module 802 is used to receive the virtual reality scene sent back by the server, where the virtual reality scene is associated with the target three-dimensional material;

[0122] The network module 802 is used to download the target three-dimensional material and render the virtual reality scene by using the target three-dimensional material when the current network signal strength is within the second strength range;

[0123] The processor 810 is configured to render a virtual reality scene using target three-dimensional materials.

[0124] The minimum value in the first intensity range is greater than the maximum value in the second intensity range.

[0125] In an embodiment of the present application, before the user views the virtual reality scene, the network signal strength of the terminal is detected, and target three-dimensional materials of different material qualities are selected according to the network signal strength to render the virtual reality scene. When the terminal network environment is good, the virtual reality scene is rendered by a high-quality material model to improve the clarity and accuracy of the virtual reality scene, and when the terminal network environment is poor, the virtual reality scene is rendered by a low-quality material model, which can ensure that the user can view the virtual reality scene in time and avoid the user waiting for a long time to load the scene. The embodiment of the present application adjusts the clarity and accuracy of the rendered virtual reality scene according to the network status of the terminal, thereby improving the timeliness of the user viewing the virtual reality scene and reducing the time the user waits for the scene to load. And when the terminal is in a strong network environment, the virtual reality scene is rendered by cloud rendering, which improves the clarity and smoothness of the virtual reality scene rendering. When the terminal is in a weak network environment, the virtual reality scene is rendered by terminal rendering, which ensures the timeliness of the user viewing the virtual reality scene.

[0126] Further, the processor 810 is configured to select an image material of a first resolution and a model material of a first precision when the current network signal strength is within a first strength range;

[0127] Processor 810 is used to select image material with a second resolution and model material with a second precision when the current network signal strength is within a second strength range.

[0128] The minimum value in the first intensity range is greater than the maximum value in the second intensity range, the first resolution is greater than the second resolution, and the first precision is greater than the second precision.

[0129] The embodiment of the present application grades the network signal strength of the terminal by setting a first intensity range and a second intensity range, and sets image materials and model materials of different material qualities corresponding to the first intensity range and the second intensity range, thereby facilitating the selection of image materials and model materials according to the network signal strength of the current terminal.

[0130] Furthermore, the processor 810 is used to update the virtual reality scene according to changes in the current network signal strength.

[0131] In the process of rendering the virtual reality scene, the embodiment of the present application continuously detects the network signal strength of the terminal, and when the network signal strength changes, reselects the target three-dimensional material in the three-dimensional material library, and renders the virtual reality scene according to the reselected target three-dimensional material. This ensures that the terminal can display the virtual reality scene in a timely manner when the terminal is in a weak network environment, and can timely re-download high-quality target three-dimensional materials when the terminal is in a strong network environment to update the virtual reality scene.

[0132] Further, the processor 810 is configured to re-download the image material of the first resolution and the model material of the first precision when the current network signal strength increases from the second strength range to the first strength range;

[0133] Processor 810 is used to update the virtual reality scene according to the image material with the first resolution and the model material with the first precision.

[0134] The embodiment of the present application continuously detects the current network signal strength, and updates the low-quality virtual reality scene when the current network signal strength changes from the first strength range to the second strength range. When the user is observing the low-quality virtual reality scene, if the strength of the network signal increases, the low-quality virtual reality scene displayed on the terminal is promptly replaced with a high-quality virtual reality scene, and the clarity and accuracy of the user's viewing of the virtual reality scene is guaranteed while ensuring that the user can view the virtual reality scene in a timely manner.

[0135] Further, the processor 810 is used to render the image material with the first resolution and the model material with the first precision to obtain an updated virtual reality scene, and delete the virtual reality scene before the update;

[0136] The display unit 806 is used to display the updated virtual reality scene. After detecting that the network environment is converted from a weak network environment to a strong network environment, the embodiment of the present application obtains the updated virtual reality scene (high-quality virtual reality scene) by rendering the downloaded high-quality three-dimensional material, and then displays the updated virtual display scene, so that the user can view the high-definition virtual reality scene as soon as possible when the network environment improves. And the virtual reality scene before the update (low-quality virtual reality scene) is deleted in time to avoid occupying the terminal memory resources for a long time.

[0137] Further, the processor 810 is used to time the downloading time of the preset resource;

[0138] The processor 810 is used to determine the strength range of the current network signal strength of the terminal according to the download duration.

[0139] In the embodiment of the present application, before starting to render the virtual reality scene, the terminal is controlled to download the preset resource, and the download time of the terminal downloading the preset resource is timed. The signal strength of the current network environment can be accurately determined according to the download time. While ensuring the accuracy of obtaining the current network signal strength, the step of obtaining the current network signal strength is simplified.

[0140] Further, the processor 810 is configured to determine that the current network signal strength is within a first strength range based on the download duration being less than a preset duration;

[0141] The processor 810 is configured to determine that the current network signal strength is within a second strength range based on the download duration being greater than a preset duration.

[0142] In the implementation of the present application, by comparing the download duration with the preset duration, the strength range of the current network signal strength can be accurately determined, thereby further improving the accuracy of network signal strength detection.

[0143] It should be understood that in the embodiment of the present application, the input unit 804 may include a graphics processor (Graphics Processing Unit, GPU) 8041 and a microphone 8042, and the graphics processor 8041 processes the image data of the static picture or video obtained by the image capture device (such as a camera) in the video capture mode or the image capture mode. The display unit 806 may include a display panel 8061, and the display panel 8061 may be configured in the form of a liquid crystal display, an organic light emitting diode, etc. The user input unit 807 includes a touch panel 8071 and at least one of other input devices 8072. The touch panel 8071 is also called a touch screen. The touch panel 8071 may include two parts: a touch detection device and a touch controller. Other input devices 8072 may include, but are not limited to, a physical keyboard, function keys (such as volume control keys, switch keys, etc.), a trackball, a mouse, and a joystick, which will not be repeated here.

[0144] The memory 809 can be used to store software programs and various data. The memory 809 may mainly include a first storage area for storing programs or instructions and a second storage area for storing data, wherein the first storage area may store an operating system, an application program or instructions required for at least one function (such as a sound playback function, an image playback function, etc.), etc. In addition, the memory 809 may include a volatile memory or a non-volatile memory, or the memory 809 may include both volatile and non-volatile memories. Among them, the non-volatile memory may be a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), or a flash memory. The volatile memory may be a random access memory (RAM), a static random access memory (SRAM), a dynamic random access memory (DRAM), a synchronous dynamic random access memory (SDRAM), a double data rate synchronous dynamic random access memory (DDRSDRAM), an enhanced synchronous dynamic random access memory (ESDRAM), a synchronous link dynamic random access memory (SLDRAM) and a direct memory bus random access memory (DRRAM). The memory 809 in the embodiment of the present application includes but is not limited to these and any other suitable types of memory.

[0145] The processor 810 may include one or more processing units; optionally, the processor 810 integrates an application processor and a modem processor, wherein the application processor mainly processes operations related to an operating system, a user interface, and application programs, and the modem processor mainly processes wireless communication signals, such as a baseband processor. It is understandable that the modem processor may not be integrated into the processor 810.

[0146] An embodiment of the present application also provides a readable storage medium, on which a program or instruction is stored. When the program or instruction is executed by a processor, each process of the above-mentioned scene rendering method embodiment is implemented, and the same technical effect can be achieved. To avoid repetition, it will not be repeated here.

[0147] The processor is the processor in the electronic device in the above embodiment. The readable storage medium includes a computer readable storage medium, such as a computer read-only memory ROM, a random access memory RAM, a magnetic disk or an optical disk.

[0148] An embodiment of the present application further provides a chip, which includes a processor and a communication interface, wherein the communication interface and the processor are coupled, and the processor is used to run programs or instructions to implement the various processes of the above-mentioned method embodiment, and can achieve the same technical effect. To avoid repetition, it will not be repeated here.

[0149] It should be understood that the chip mentioned in the embodiments of the present application can also be called a system-level chip, a system chip, a chip system or a system-on-chip chip, etc.

[0150] An embodiment of the present application provides a computer program product, which is stored in a storage medium. The program product is executed by at least one processor to implement the various processes of the above-mentioned scene rendering method embodiment and can achieve the same technical effect. To avoid repetition, it will not be repeated here.

[0151] It should be noted that, in this article, the terms "comprise", "include" or any other variant thereof are intended to cover non-exclusive inclusion, so that the process, method, article or device including a series of elements includes not only those elements, but also includes other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, the elements defined by the sentence "comprise one..." do not exclude the presence of other identical elements in the process, method, article or device including the element. In addition, it should be pointed out that the scope of the methods and devices in the embodiments of the present application is not limited to performing functions in the order shown or discussed, and may also include performing functions in a substantially simultaneous manner or in reverse order according to the functions involved, for example, the described method may be performed in an order different from that described, and various steps may also be added, omitted, or combined. In addition, the features described with reference to certain examples may be combined in other examples.

[0152] Through the description of the above implementation methods, those skilled in the art can clearly understand that the above-mentioned embodiment methods can be implemented by means of software plus a necessary general hardware platform, and of course by hardware, but in many cases the former is a better implementation method. Based on such an understanding, the technical solution of the present application, or the part that contributes to the prior art, can be embodied in the form of a computer software product, which is stored in a storage medium (such as ROM / RAM, a disk, or an optical disk), and includes a number of instructions for a terminal (which can be a mobile phone, a computer, a server, or a network device, etc.) to execute the methods of each embodiment of the present application.

[0153] The embodiments of the present application are described above in conjunction with the accompanying drawings, but the present application is not limited to the above-mentioned specific implementation methods. The above-mentioned specific implementation methods are merely illustrative and not restrictive. Under the guidance of the present application, ordinary technicians in this field can also make many forms without departing from the purpose of the present application and the scope of protection of the claims, all of which are within the protection of the present application.

Claims

1. A scene rendering method, characterized in that: include: In response to the virtual reality scene rendering input, determining a strength range of a current network signal strength of the terminal; selecting a target three-dimensional material in a three-dimensional material library according to the strength range of the current network signal strength, wherein the material quality of the target three-dimensional material is associated with the strength range; When the current network signal strength is within a first strength range, sending a rendering instruction to a server, and receiving a virtual reality scene sent back by the server, wherein the virtual reality scene is associated with the target three-dimensional material; When the current network signal strength is within a second strength range, downloading target three-dimensional material, and rendering the virtual reality scene by using the target three-dimensional material; The minimum value in the first intensity range is greater than the maximum value in the second intensity range.

2. The scene rendering method according to claim 1, characterized in that: The target three-dimensional material includes an image material and a model material, and the selecting the target three-dimensional material in the three-dimensional material library according to the strength range of the current network signal strength includes: When the current network signal strength is within a first strength range, selecting the image material with a first resolution and the model material with a first precision; When the current network signal strength is within a second strength range, selecting the image material with a second resolution and the model material with a second precision; The first resolution is greater than the second resolution, and the first precision is greater than the second precision.

3. The scene rendering method according to claim 2, characterized in that: After rendering the virtual reality scene according to the target three-dimensional material, the method further includes: Determine a change in the current network signal strength; The virtual reality scene is updated according to the change of the current network signal strength.

4. The scene rendering method according to claim 3, characterized in that: The updating of the virtual reality scene according to the change of the current network signal strength includes: When the current network signal strength increases from within the second strength range to within the first strength range, re-downloading the image material of the first resolution and the model material of the first precision; The virtual reality scene is updated according to the image material of the first resolution and the model material of the first precision.

5. The scene rendering method according to claim 4, characterized in that: Updating the virtual reality scene according to the image material of the first resolution and the model material of the first precision includes: rendering the image material of the first resolution and the model material of the first precision to obtain the updated virtual reality scene, and deleting the virtual reality scene before the update; The updated virtual reality scene is displayed.

6. The scene rendering method according to any one of claims 1 to 5, characterized in that: The determining the strength range of the current network signal strength of the terminal includes: Timing download preset resource download duration; According to the download duration, a strength range of the current network signal strength of the terminal is determined.

7. The scene rendering method according to claim 6, characterized in that: The determining, according to the download duration, a strength range of the current network signal strength of the terminal includes: Based on the download duration being less than a preset duration, determining that the current network signal strength is within the first strength range; Based on the downloading duration being greater than a preset duration, it is determined that the current network signal strength is within the second strength range.

8. A scene rendering device, characterized in that: include: A determination module, configured to determine a strength range of a current network signal strength of a terminal in response to a virtual reality scene rendering input; A selection module, configured to select a target three-dimensional material in a three-dimensional material library according to the strength range of the current network signal strength, wherein the material quality of the target three-dimensional material is associated with the strength range; A sending module, configured to send a rendering instruction to a server when the current network signal strength is within a first strength range; A receiving module, configured to receive a virtual reality scene transmitted back by the server, wherein the virtual reality scene is associated with the target three-dimensional material; A download module, configured to download a target three-dimensional material when the current network signal strength is within a second strength range, and render the virtual reality scene using the target three-dimensional material; A rendering module, used for rendering the virtual reality scene using the target three-dimensional material; The minimum value in the first intensity range is greater than the maximum value in the second intensity range.

9. An electronic device, characterized in that: include: A memory on which programs or instructions are stored; A processor, configured to implement the steps of the scene rendering method according to any one of claims 1 to 7 when executing the program or instruction.

10. A readable storage medium having a program or instruction stored thereon, characterized in that: When the program or instruction is executed by a processor, the steps of the scene rendering method according to any one of claims 1 to 7 are implemented.

Citation Information

Patent Citations

  • Data integration platform for virtual reality server

    CN113709520A

  • Methods and Systems for Minimizing Pixel Data Transmission in a Network-Based Virtual Reality Media Delivery Configuration

    US20170316607A1