Model rendering method, rendering device, terminal, server and storage medium

Abstract

The present application discloses a model rendering method, a rendering device, a terminal, a server and a storage medium, and belongs to the field of virtual reality technology. The model rendering method includes: generating model editing information in response to a user's editing input for a first model; sending the model editing information to a server so that the server edits a second model according to the model editing information, and the server sends first image data and second image data; receiving and displaying the first image data and second image data sent by the server; wherein the first image data and the second image data are image data rendered according to the second model before and after editing.

Description

Technical Field

[0001] The present application belongs to the field of virtual reality technology, and specifically relates to a model rendering method, a rendering device, a terminal, a server and a storage medium. Background Art

[0002] Virtual reality technology simulates a virtual environment to give people a sense of environmental immersion. VR house viewing allows users to intuitively view the interior of the house and improve their house viewing experience.

[0003] In the prior art, users can implement virtual decoration by editing a three-dimensional model of a house. However, due to the performance limitations of user terminals, it is difficult for users to view the models before and after the virtual decoration at the same time. Summary of the invention

[0004] The purpose of the embodiments of the present application is to provide a model rendering method, rendering device, terminal, server and storage medium, so that the server can render the second model before and after editing at the same viewing angle, and the terminal can display the models before and after editing on the same screen at the same viewing angle.

[0005] In a first aspect, an embodiment of the present application provides a model rendering method, comprising: generating model editing information in response to a user's editing input for a first model; sending the model editing information to a server so that the server edits a second model according to the model editing information, and causes the server to send first image data and second image data; receiving and displaying the first image data and second image data sent by the server; wherein the first image data and the second image data are image data rendered according to the second model before and after editing.

[0006] In second aspect, an embodiment of the present application provides a model rendering method, including: receiving model editing information sent by a terminal; editing a second model according to the model editing information; sending first image data and second image data to the terminal, so that the terminal receives and displays the first image data and second image data sent by the server; wherein the first image data and the second image data are image data rendered according to the second model before and after editing.

[0007] In a third aspect, an embodiment of the present application provides a model rendering device, comprising: a generation module, used to generate model editing information in response to a user's editing input for a first model; a first sending module, used to send the model editing information to a server, so that the server edits the second model according to the model editing information, and causes the server to send first image data and second image data; a first receiving module, used to receive the first image data and second image data sent by the server; a display module, used to display the first image data and second image data sent by the server; wherein the first image data and the second image data are image data rendered according to the second model before and after editing.

[0008] In a fourth aspect, an embodiment of the present application provides a model rendering device, comprising: a second receiving module, used to receive model editing information sent by a terminal; an editing module, used to edit a second model according to the model editing information; a second sending module, used to send first image data and second image data to the terminal, so that the terminal receives and displays the first image data and second image data sent by the server; wherein the first image data and the second image data are image data rendered according to the second model before and after editing.

[0009] In a fifth aspect, an embodiment of the present application provides a terminal comprising a processor and a memory, wherein the memory stores a program or input that can be run on the processor, and when the program or input is executed by the processor, the steps of the rendering method of the model of the first aspect are implemented.

[0010] In a sixth aspect, an embodiment of the present application provides a server, which is an electronic device including a processor and a memory, wherein the memory stores a program or input that can be run on the processor, and when the program or input is executed by the processor, the steps of the rendering method of the model in the second aspect are implemented.

[0011] In a seventh aspect, an embodiment of the present application provides a readable storage medium, on which a program or input is stored, and when the program or input is executed by a processor, the steps of the model rendering method of the first aspect and the second aspect are implemented.

[0012] The embodiment of the present application sends the initial observation angle information to the server through the terminal, so that the server can render the second model before and after editing at the same angle, and the terminal can display the model before and after editing on the same screen with the same angle. It is ensured that when the terminal displays the first image data and the second image data on the same screen, both can be displayed at the same angle, which improves the contrast effect of the user viewing the image data. BRIEF DESCRIPTION OF THE DRAWINGS

[0013] Figure 1 One of the flow diagrams of the model rendering method provided in the embodiment of the present application is shown;

[0014] Figure 2 The second flowchart of the method for rendering a model provided in an embodiment of the present application is shown;

[0015] Figure 3 The third flowchart of the method for rendering a model provided in an embodiment of the present application is shown;

[0016] Figure 4 A fourth flowchart of the method for rendering a model provided in an embodiment of the present application is shown;

[0017] Figure 5 A fifth flow chart of the method for rendering a model provided in an embodiment of the present application is shown;

[0018] Figure 6 A sixth flow chart of the method for rendering a model provided in an embodiment of the present application is shown;

[0019] Figure 7 FIG7 shows a flow chart of a method for rendering a model provided in an embodiment of the present application;

[0020] Figure 8 FIG8 is a flow chart of a method for rendering a model provided in an embodiment of the present application;

[0021] Fig. 9 One of the structural block diagrams of the rendering device of the model provided in the embodiment of the present application is shown;

[0022] Fig.10 The second structural block diagram of the rendering device of the model provided in the embodiment of the present application is shown;

[0023] Fig.11 A structural block diagram of a terminal provided in an embodiment of the present application is shown;

[0024] Fig.12 A structural block diagram of a server provided in an embodiment of the present application is shown;

[0025] Fig.13 A schematic diagram of the hardware structure of an electronic device according to an embodiment of the present application is shown. DETAILED DESCRIPTION

[0026] The following will be combined with the drawings in the embodiments of the present application to clearly describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, rather than all the embodiments. All other embodiments obtained by ordinary technicians in this field based on the embodiments in the present application belong to the scope of protection of this application.

[0027] The terms "first", "second", etc. in the specification and claims of the present application are used to distinguish similar objects, and are not used to describe a specific order or sequence. It should be understood that the data used in this way can be interchangeable under appropriate circumstances, so that the embodiments of the present application can be implemented in an order other than those illustrated or described here, and the objects distinguished by "first", "second", etc. are generally of one type, and the number of objects is not limited. For example, the first object can be one or more. In addition, "and / or" in the specification and claims represents at least one of the connected objects, and the character " / " generally indicates that the objects associated with each other are in an "or" relationship.

[0028] The following is combined with Figures 1 to 13 , the model rendering method, model rendering device, electronic device and readable storage medium provided in the embodiments of the present application are described in detail through specific embodiments and their application scenarios.

[0029] In an embodiment of the present application, a method for rendering a model is provided. Figure 1 One of the flow charts of the rendering method of the model provided in the embodiment of the present application is shown, such as Figure 1 As shown, the rendering method of the model includes:

[0030] Step 102, generating model editing information in response to a user's editing input for the first model;

[0031] Step 104, sending the model editing information to the server, so that the server edits the second model according to the model editing information, and the server sends the first image data and the second image data;

[0032] Step 106: Receive and display the first image data and the second image data sent by the server.

[0033] The first image data and the second image data are image data rendered according to the second model before and after editing.

[0034] The three-dimensional scene display method provided in the embodiment of the present application is applied to a terminal, and the terminal can be selected as a mobile phone, a tablet computer, a laptop computer, a PDA, an in-vehicle electronic device, a mobile Internet device, etc. When the terminal displays the first model, the terminal records the editing input performed by the user to generate model editing information, and the terminal sends the model editing information to the server. When the server receives the model editing information, the server renders the second model before starting to edit the second model stored in the server to obtain the first image data. The server then edits the second model stored in the server according to the model editing information. After the editing is completed, the server renders the edited second model to obtain the second image data. The server sends the first image data and the second image data to the terminal. After receiving the first image data and the second image data, the terminal can simultaneously display the first image data and the second image data on the same screen.

[0035] The first model corresponds to the second model, the first model is a low-quality model, and the second model is a high-quality model, that is, the first model has a lower precision, and the second model has a higher precision. The user edits the first model with lower precision on the terminal, and sends the model editing information to the server, and the server edits the second model with higher precision, thereby reducing the resource usage of the terminal editing model.

[0036] Specifically, when the user needs to compare and view the three-dimensional model before and after editing, the user sends the model editing information to the server, edits the second model through the server, and renders the second model before and after editing through the server, and transmits the rendered first image data and second image data back to the terminal. The user can view the first image data and second image data rendered by the model before and after editing without the terminal rendering the model.

[0037] For example, during a VR (virtual reality) house viewing process, a user can virtually decorate the three-dimensional model of a second-hand house being viewed. The terminal side and the server side store the corresponding first model and second model, respectively. When a user needs to compare the before and after decoration, the user virtually decorates the first model so that the terminal obtains the corresponding model editing information. The terminal sends the model editing information to the server. The server virtually decorates the second model through the model editing information, and transmits the rendered first image data and second image data before and after decoration back to the terminal for display on the same screen.

[0038] In an embodiment of the present application, by rendering the second model before and after editing on the server side, first image data and second image data corresponding to before and after editing can be obtained, and the first image data and the second image data are displayed on the same screen through the terminal, thereby achieving the goal of not requiring the terminal to render the model, reducing the amount of terminal resources occupied during VR house viewing, and improving the efficiency of displaying image data before and after editing.

[0039] In some embodiments of the present application, before sending the model editing information to the server, it also includes: sending initial observation perspective information to the server, so that the server renders the second model before and after editing according to the initial perspective information to obtain the first image data and the second image data.

[0040] In the embodiment of the present application, the terminal sends the model editing information to the server, so that before the server edits the second model according to the model editing information, the initial observation angle information of the second model needs to be sent to the server. After receiving the initial observation angle information, the server can render the second model before editing according to the initial observation angle information to obtain the first image data, and render the edited second model according to the initial observation angle information to obtain the second image data with the same angle as the first image data.

[0041] Before the server renders the second model, it is necessary to determine the rendering angle for rendering the second model. The user performs the initial viewing angle setting input on the first model stored in the terminal, and the terminal can obtain the initial observation viewing angle information. The terminal sends the initial observation viewing angle information to the server, so that the server renders the second model before and after editing respectively according to the initial observation viewing angle information, thereby obtaining the first image data and the second image data corresponding to the second model before and after editing under the same viewing angle. When the terminal displays the first image data and the second image data on the same screen, the image of the second model rendered under the same viewing angle can be viewed.

[0042] The embodiment of the present application sends the initial observation perspective information to the server through the terminal, so that the server can render the second model before and after editing at the same perspective, ensuring that when the terminal displays the first image data and the second image data on the same screen, both can be displayed at the same perspective, thereby improving the contrast effect of the user viewing the image data.

[0043] In some embodiments of the present application, Figure 2 The second flow chart of the rendering method of the model provided in the embodiment of the present application is shown as follows: Figure 2 As shown, after receiving and displaying the first image data and the second image data sent by the server, it also includes:

[0044] Step 202, determining viewing angle adjustment information in response to viewing angle adjustment input for first image data;

[0045] Step 204, sending the viewing angle adjustment information to the server, so that the server sends the third image data and the fourth image data according to the viewing angle adjustment information;

[0046] Step 206, receiving and displaying the third image data and the fourth image data;

[0047] The third image data and the fourth image data are image data rendered according to the second model before and after editing.

[0048] In an embodiment of the present application, when the terminal receives a user's perspective adjustment input for the first image data, it is determined that the user needs to adjust the rendering angle of the second model. The terminal sends perspective adjustment information corresponding to the perspective adjustment input to the server. After receiving the perspective adjustment information, the server adjusts the rendering angle of the second model to obtain the target observation perspective. Under the target observation perspective, the server renders the second model before and after editing to obtain third image data and fourth image data, wherein the third image data and the fourth image data are image data obtained by rendering the second model before and after editing, respectively.

[0049] Specifically, when the user receives the first image data and the second image data, that is, the rendered images of the second model before and after editing have been displayed on the terminal. At this time, when the user needs to adjust the display viewing angle of the second model, the user directly performs viewing angle adjustment input on the first image data, and the terminal transmits the viewing angle adjustment information corresponding to the viewing angle adjustment input to the server, so that the server can determine the target rendering angle after adjusting the viewing angle. The server renders the second model before and after editing again through the target rendering angle to obtain the third image data and the fourth image data of the updated viewing angle, so that the user can adjust the corresponding image data before and after editing displayed on the same screen with the same viewing angle.

[0050] The embodiment of the present application receives the user's perspective adjustment input and sends the perspective adjustment information to the server, so that the server can adjust the rendering angle of the second model according to the perspective adjustment information, and re-render the second model according to the adjusted rendering angle, thereby enabling the terminal to adjust the same perspective of the image data before and after editing.

[0051] In some embodiments of the present application, the accuracy of the second model is higher than the accuracy of the first model.

[0052] In an embodiment of the present application, the accuracy of the second model stored in the server is higher than the accuracy of the first model stored in the terminal. The accuracy of the first model stored in the terminal is set to be lower, which reduces the operating resources required for editing the first model in the terminal. The accuracy of the second model stored in the server is set to be higher, which can improve the clarity of the first image data and the second image data obtained by rendering the second model, and ensure the clarity of the three-dimensional scene of the second model before and after editing when the user views it in the terminal.

[0053] The embodiment of the present application sets the accuracy of the second model stored in the server to be greater than the accuracy of the first model stored in the terminal, thereby ensuring the editing efficiency of the first model by the terminal while improving the clarity of the first image data and the second image data rendered by the server.

[0054] In some embodiments of the present application, Figure 3 The third flow chart of the rendering method of the model provided in the embodiment of the present application is shown as follows: Figure 3 As shown, in response to the user's editing input for the first model, model editing information is generated, including:

[0055] Step 302, determining modeling material information and material location information according to the editing input;

[0056] Step 304: Generate model editing information based on the modeling material information and the material location information.

[0057] In the embodiment of the present application, a three-dimensional editor is provided in the terminal, and the user can edit the first model stored in the terminal through the three-dimensional editor. In the process of the user editing the first model, the terminal can record the editing input performed by the user to obtain model editing information. Among them, the model editing information includes modeling material information and material location information. The terminal can record the modeling material information of the three-dimensional material found by the user in the modeling material library, as well as the material location information in the process of combining the three-dimensional material for modeling.

[0058] The server stores a material library corresponding to the modeling material library in the terminal, wherein the material library stored in the server is a high-poly material library, and the material library stored in the terminal is a low-poly material library. After receiving the model editing information, the server searches for the corresponding high-quality modeling material in the high-poly material library according to the modeling material information in the model editing information, and then configures the high-quality modeling material in the second model according to the material position information in the model editing information, thereby completing the editing operation on the second model.

[0059] It can be understood that by recording the user's editing input for the first model, the modeling materials used by the user in the editing process of the first model and the configuration location of the modeling materials can be determined. Therefore, the server can find the corresponding high-quality modeling materials based on the modeling material information, and configure the high-quality modeling materials to the second model based on the material location information.

[0060] The embodiment of the present application records the editing input of the user on the terminal to the first model to obtain the corresponding modeling material information and material location information, and then edits the second model in the server through the modeling material information and material location information, so that the server edits the second model according to the editing input of the user in the terminal.

[0061] In an embodiment of the present application, a method for rendering a model is provided. Figure 4 A fourth flow chart of the method for rendering a model provided in an embodiment of the present application is shown. Figure 4 As shown, the rendering method of the model includes:

[0062] Step 402, receiving model editing information sent by the terminal;

[0063] Step 404, editing the second model according to the model editing information;

[0064] Step 406, sending the first image data and the second image data to the terminal, so that the terminal receives and displays the first image data and the second image data sent by the server;

[0065] The first image data and the second image data are image data rendered according to the second model before and after editing.

[0066] The three-dimensional scene display method provided in the embodiment of the present application is applied to a server. When the terminal displays the first model, the terminal records the editing input performed by the user to generate model editing information, and the terminal sends the model editing information to the server. When the server receives the model editing information, the server renders the second model before starting to edit the second model stored in the server to obtain the first image data. The server then edits the second model stored in the server according to the model editing information. After the editing is completed, the server renders the edited second model to obtain the second image data. The server sends the first image data and the second image data to the terminal. After receiving the first image data and the second image data, the terminal can simultaneously display the first image data and the second image data on the same screen.

[0067] The first model corresponds to the second model, the first model is a low-quality model, and the second model is a high-quality model, that is, the first model has a lower precision, and the second model has a higher precision. The user edits the first model with lower precision on the terminal, and sends the model editing information to the server, and the server edits the second model with higher precision, thereby reducing the resource usage of the terminal editing model.

[0068] Specifically, when the user needs to compare and view the three-dimensional model before and after editing, the user sends the model editing information to the server, edits the second model through the server, and renders the second model before and after editing through the server, and transmits the rendered first image data and second image data back to the terminal. The user can view the first image data and second image data rendered by the model before and after editing without the terminal rendering the model.

[0069] For example, during a VR (virtual reality) house viewing process, a user can virtually decorate the three-dimensional model of a second-hand house being viewed. The terminal side and the server side store the corresponding first model and second model, respectively. When a user needs to compare the before and after decoration, the user virtually decorates the first model so that the terminal obtains the corresponding model editing information. The terminal sends the model editing information to the server. The server virtually decorates the second model through the model editing information, and transmits the rendered first image data and second image data before and after decoration back to the terminal for display on the same screen.

[0070] In an embodiment of the present application, by rendering the second model before and after editing on the server side, first image data and second image data corresponding to before and after editing can be obtained, and the first image data and the second image data are displayed on the same screen through the terminal, thereby achieving the goal of not requiring the terminal to render the model, reducing the amount of terminal resources occupied during VR house viewing, and improving the efficiency of displaying image data before and after editing.

[0071] In some embodiments of the present application, Figure 5 FIG. 5 shows a flow chart of a rendering method of a model provided in an embodiment of the present application, such as Figure 5 As shown, editing the second model according to the model editing information includes:

[0072] Step 502, determining modeling material information and material location information according to the model editing information;

[0073] Step 504: edit the second model according to the modeling material information and the material position information.

[0074] In the embodiment of the present application, a material library corresponding to the modeling material library in the terminal is stored in the server, wherein the material library stored in the server is a high-poly material library, and the material library stored in the terminal is a low-poly material library. After receiving the model editing information, the server searches for the corresponding high-quality modeling material in the high-poly material library according to the modeling material information in the model editing information, and then configures the high-quality modeling material in the second model according to the material position information in the model editing information, thereby completing the editing operation on the second model.

[0075] The terminal is provided with a 3D editor, and the user can edit the first model stored in the terminal through the 3D editor. In the process of the user editing the first model, the terminal can record the editing input performed by the user to obtain model editing information. The model editing information includes modeling material information and material location information. The terminal can record the modeling material information of the 3D material found by the user in the modeling material library, as well as the material location information in the process of combining the 3D materials for modeling.

[0076] It can be understood that by recording the user's editing input for the first model, the modeling materials used by the user in the editing process of the first model and the configuration location of the modeling materials can be determined. Therefore, the server can find the corresponding high-quality modeling materials based on the modeling material information, and configure the high-quality modeling materials to the second model based on the material location information.

[0077] The embodiment of the present application records the editing input of the user on the terminal to the first model to obtain the corresponding modeling material information and material location information, and then edits the second model in the server through the modeling material information and material location information, so that the server edits the second model according to the editing input of the user in the terminal.

[0078] Among them, the accuracy of the second model is higher than the accuracy of the first model.

[0079] In an embodiment of the present application, the accuracy of the second model stored in the server is higher than the accuracy of the first model stored in the terminal. The accuracy of the first model stored in the terminal is set to be lower, which reduces the operating resources required for editing the first model in the terminal. The accuracy of the second model stored in the server is set to be higher, which can improve the clarity of the first image data and the second image data obtained by rendering the second model, and ensure the clarity of the three-dimensional scene of the second model before and after editing when the user views it in the terminal.

[0080] The embodiment of the present application sets the accuracy of the second model stored in the server to be greater than the accuracy of the first model stored in the terminal, thereby ensuring the editing efficiency of the first model by the terminal while improving the clarity of the first image data and the second image data rendered by the server.

[0081] In some embodiments of the present application, Figure 6 The sixth flow chart of the rendering method of the model provided in the embodiment of the present application is shown, as shown in FIG. Figure 6 As shown, according to the modeling material information and the material position information, the second model is edited, including:

[0082] Step 602, searching for target modeling material in the modeling material library according to the modeling material information;

[0083] Step 604: configure the target modeling material into the second model according to the material position information.

[0084] In an embodiment of the present application, after receiving the model editing information, the server searches for the corresponding high-quality target modeling material in the high-poly material library according to the modeling material information in the model editing information, and then configures the high-quality target modeling material in the second model according to the material position information in the model editing information, thereby completing the editing operation on the second model.

[0085] The server in the embodiment of the present application can find the corresponding target modeling material in the modeling material library in the server according to the modeling material information, and complete the modeling on the server side by configuring the target modeling material in the second model according to the material location information.

[0086] In some embodiments of the present application, Figure 7 FIG. 7 shows a flow chart of a rendering method of a model provided in an embodiment of the present application, such as Figure 7 As shown, before sending the first image data and the second image data to the terminal, the method further includes:

[0087] Step 702, receiving initial observation viewing angle information sent by the terminal;

[0088] Step 704, determining a first rendering angle of the second model before and after editing according to the initial observation perspective information;

[0089] Step 706: Render the second model before and after editing according to the first rendering angle to obtain first image data and second image data.

[0090] In the embodiment of the present application, after receiving the initial observation angle information, the server can determine the first rendering angle used to render the second model before and after editing. After determining the first rendering angle, the server renders the second model before and after editing at the first rendering angle.

[0091] Specifically, after the server determines the first rendering angle according to the initial observation perspective information, before starting to edit the second model, the second model before editing is rendered according to the first rendering angle to obtain the first image data. After the second model is edited, the edited second model is also rendered according to the same first rendering angle to obtain the second image data. The server sends the first image data and the second image data to the terminal, so that the terminal can view and display the first image data and the second image data corresponding to the second model before editing and after editing at the same perspective.

[0092] The embodiment of the present application sends the initial observation perspective information to the server through the terminal, so that the server can render the second model before and after editing at the same perspective, ensuring that when the terminal displays the first image data and the second image data on the same screen, both can be displayed at the same perspective, thereby improving the contrast effect of the user viewing the image data.

[0093] In some embodiments of the present application, Figure 8 FIG8 shows a flow chart of a rendering method of a model provided in an embodiment of the present application. Figure 8 As shown, after sending the first image data and the second image data to the terminal, the method further includes:

[0094] Step 802, receiving viewing angle adjustment information sent by the terminal;

[0095] Step 804, adjusting the first rendering angle according to the viewing angle adjustment information to obtain a second rendering angle;

[0096] Step 806: Render the second model before and after editing according to the second rendering angle to obtain third image data and fourth image data.

[0097] In the embodiment of the present application, after receiving the viewing angle adjustment information sent by the terminal, the server adjusts the first rendering angle for rendering the second model to obtain the second rendering angle. At the second rendering angle, the server renders the second model before and after editing again to obtain third image data and fourth image data, wherein the third image data and the fourth image data are image data obtained by rendering the second model before and after editing, respectively.

[0098] When the terminal receives the user's perspective adjustment input for the first image data, it determines that the user needs to adjust the rendering angle of the second model. The terminal sends perspective adjustment information corresponding to the perspective adjustment input to the server.

[0099] Specifically, when the user receives the first image data and the second image data, that is, the rendered images of the second model before and after editing have been displayed on the terminal. At this time, when the user needs to adjust the display viewing angle of the second model, the user directly performs viewing angle adjustment input on the first image data, and the terminal transmits the viewing angle adjustment information corresponding to the viewing angle adjustment input to the server, so that the server can determine the target rendering angle after adjusting the viewing angle. The server renders the second model before and after editing again through the target rendering angle to obtain the third image data and the fourth image data of the updated viewing angle, so that the user can adjust the corresponding image data before and after editing displayed on the same screen with the same viewing angle.

[0100] The embodiment of the present application receives the user's perspective adjustment input and sends the perspective adjustment information to the server, so that the server can adjust the rendering angle of the second model according to the perspective adjustment information, and re-render the second model according to the adjusted rendering angle, thereby enabling the terminal to adjust the same perspective of the image data before and after editing.

[0101] The model rendering method provided in the embodiment of the present application can be executed by a model rendering device. In the embodiment of the present application, the model rendering device provided in the embodiment of the present application is described by taking the model rendering method executed by the model rendering device as an example.

[0102] In some embodiments of the present application, a rendering device for a model is provided. Fig. 9 One of the structural block diagrams of the rendering device of the model provided in the embodiment of the present application is shown, Fig. 9 As shown, the rendering device 900 of the model includes:

[0103] A generating module 902, configured to generate model editing information in response to a user's editing input for the first model;

[0104] The first sending module 904 is used to send the model editing information to the server, so that the server edits the second model according to the model editing information, and sends the first image data and the second image data.

[0105] A first receiving module 906, configured to receive first image data and second image data sent by a server;

[0106] A display module 908, configured to display the first image data and the second image data sent by the server;

[0107] The first image data and the second image data are image data rendered according to the second model before and after editing.

[0108] In an embodiment of the present application, by rendering the second model before and after editing on the server side, first image data and second image data corresponding to before and after editing can be obtained, and the first image data and the second image data are displayed on the same screen through the terminal, thereby achieving the goal of not requiring the terminal to render the model, reducing the amount of terminal resources occupied during VR house viewing, and improving the efficiency of displaying image data before and after editing.

[0109] In some embodiments of the present application, the first sending module 904 is also used to send initial observation perspective information to the server, so that the server renders the second model before and after editing according to the initial perspective information to obtain the first image data and the second image data.

[0110] The embodiment of the present application sends the initial observation perspective information to the server through the terminal, so that the server can render the second model before and after editing at the same perspective, ensuring that when the terminal displays the first image data and the second image data on the same screen, both can be displayed at the same perspective, thereby improving the contrast effect of the user viewing the image data.

[0111] In some embodiments of the present application, the model rendering device 900 further includes:

[0112] a determination module, configured to determine viewing angle adjustment information in response to a viewing angle adjustment input for the first image data;

[0113] A first sending module 904, configured to send viewing angle adjustment information to a server, so that the server sends the third image data and the fourth image data according to the viewing angle adjustment information;

[0114] A first receiving module 906, configured to receive and display the third image data and the fourth image data;

[0115] The third image data and the fourth image data are image data rendered according to the second model before and after editing.

[0116] The embodiment of the present application receives the user's perspective adjustment input and sends the perspective adjustment information to the server, so that the server can adjust the rendering angle of the second model according to the perspective adjustment information, and re-render the second model according to the adjusted rendering angle, thereby enabling the terminal to adjust the same perspective of the image data before and after editing.

[0117] In some embodiments of the present application, the accuracy of the second model is higher than the accuracy of the first model.

[0118] The embodiment of the present application sets the accuracy of the second model stored in the server to be greater than the accuracy of the first model stored in the terminal, thereby ensuring the editing efficiency of the first model by the terminal while improving the clarity of the first image data and the second image data rendered by the server.

[0119] In some embodiments of the present application, the determination module is further used to determine modeling material information and material position information according to the editing input;

[0120] The generating module 902 is further used to generate model editing information according to the modeling material information and the material position information.

[0121] The embodiment of the present application records the editing input of the user on the terminal to the first model to obtain the corresponding modeling material information and material location information, and then edits the second model in the server through the modeling material information and material location information, so that the server edits the second model according to the editing input of the user in the terminal.

[0122] In some embodiments of the present application, a rendering device for a model is provided. Fig.10 The second structural block diagram of the rendering device of the model provided in the embodiment of the present application is shown as follows: Fig.10 As shown, the rendering device 1000 of the model includes:

[0123] The second receiving module 1002 is used to receive model editing information sent by the terminal;

[0124] An editing module 1004, configured to edit the second model according to the model editing information;

[0125] The second sending module 1006 is used to send the first image data and the second image data to the terminal, so that the terminal receives and displays the first image data and the second image data sent by the server;

[0126] The first image data and the second image data are image data rendered according to the second model before and after editing.

[0127] In an embodiment of the present application, by rendering the second model before and after editing on the server side, first image data and second image data corresponding to before and after editing can be obtained, and the first image data and the second image data are displayed on the same screen through the terminal, thereby achieving the goal of not requiring the terminal to render the model, reducing the amount of terminal resources occupied during VR house viewing, and improving the efficiency of displaying image data before and after editing.

[0128] In some embodiments of the present application, the model rendering device 1000 further includes:

[0129] A determination module, used to determine modeling material information and material location information according to model editing information;

[0130] The editing module 1004 is further used to edit the second model according to the modeling material information and the material position information.

[0131] The embodiment of the present application records the editing input of the user on the terminal to the first model to obtain the corresponding modeling material information and material location information, and then edits the second model in the server through the modeling material information and material location information, so that the server edits the second model according to the editing input of the user in the terminal.

[0132] In some embodiments of the present application, the model rendering device 1000 further includes:

[0133] A search module, used to search for target modeling materials in a modeling material library according to modeling material information;

[0134] The configuration module is used to configure the target modeling material into the second model according to the material position information.

[0135] The server in the embodiment of the present application can find the corresponding target modeling material in the modeling material library in the server according to the modeling material information, and complete the modeling on the server side by configuring the target modeling material in the second model according to the material location information.

[0136] In some embodiments of the present application, the second receiving module 1002 is further configured to receive initial observation viewing angle information sent by the terminal;

[0137] The determination module is further used to determine a first rendering angle of the second model before and after editing according to the initial observation angle information;

[0138] The rendering module is used to render the second model before and after editing according to a first rendering angle to obtain first image data and second image data.

[0139] The embodiment of the present application sends the initial observation perspective information to the server through the terminal, so that the server can render the second model before and after editing at the same perspective, ensuring that when the terminal displays the first image data and the second image data on the same screen, both can be displayed at the same perspective, thereby improving the contrast effect of the user viewing the image data.

[0140] In some embodiments of the present application, the second receiving module 1002 is further configured to receive viewing angle adjustment information sent by the terminal;

[0141] The model rendering device 1000 further includes:

[0142] An adjustment module, configured to adjust the first rendering angle according to the viewing angle adjustment information to obtain a second rendering angle;

[0143] The rendering module is further used to render the second model before and after editing according to the second rendering angle to obtain third image data and fourth image data.

[0144] The embodiment of the present application receives the user's perspective adjustment input and sends the perspective adjustment information to the server, so that the server can adjust the rendering angle of the second model according to the perspective adjustment information, and re-render the second model according to the adjusted rendering angle, thereby enabling the terminal to adjust the same perspective of the image data before and after editing.

[0145] The rendering device of the model in the embodiment of the present application can be an electronic device, or a component in the electronic device, such as an integrated circuit or a chip. The electronic device can be an electronic device, or it can be other devices other than the electronic device. Exemplarily, the electronic device can be a mobile phone, a tablet computer, a laptop computer, a PDA, a car electronic device, a mobile Internet device (Mobile Internet Device, MID), an augmented reality (augmented reality, AR) / virtual reality (virtual reality, VR) device, a robot, a wearable device, an ultra-mobile personal computer (ultra-mobile personal computer, UMPC), a netbook or a personal digital assistant (personal digital assistant, PDA), etc., and can also be a server, a network attached storage (Network Attached Storage, NAS), a personal computer (personal computer, PC), a television (television, TV), a teller machine or a self-service machine, etc., which is not specifically limited in the embodiment of the present application.

[0146] The rendering device of the model in the embodiment of the present application may be a device having an operating system. The operating system may be an Android operating system, an iOS operating system, or other possible operating systems, which are not specifically limited in the embodiment of the present application.

[0147] The model rendering device provided in the embodiment of the present application can implement each process implemented in the above method embodiment. To avoid repetition, it will not be repeated here.

[0148] Alternatively, if Fig.11As shown, an embodiment of the present application also provides a terminal 1100, which includes a processor 1102 and a memory 1104. The memory 1104 stores a program or input that can be run on the processor 1102. When the program or input is executed by the processor 1102, the various steps of the above-mentioned method embodiment are implemented, and the same technical effect can be achieved. To avoid repetition, it will not be repeated here.

[0149] Alternatively, if Fig.12 As shown, an embodiment of the present application further provides a server 1200, and the server 1200 includes a processor 1202 and a memory 1204, and the memory 1204 stores a program or input that can be run on the processor 1202. When the program or input is executed by the processor 1202, the various steps of the above-mentioned method embodiment are implemented, and the same technical effect can be achieved. To avoid repetition, it will not be repeated here.

[0150] It should be noted that the electronic devices in the embodiments of the present application include mobile electronic devices and non-mobile electronic devices.

[0151] Fig.13 A schematic diagram of the hardware structure of an electronic device to implement an embodiment of the present application.

[0152] The electronic device 1300 includes but is not limited to: a radio frequency unit 1301, a network module 1302, an audio output unit 1303, an input unit 1304, a sensor 1305, a display unit 1306, a user input unit 1307, an interface unit 1308, a memory 1309, and a processor 1310 and other components.

[0153] Those skilled in the art will appreciate that the electronic device 1300 may also include a power source (such as a battery) for supplying power to each component, and the power source may be logically connected to the processor 1310 through a power management system, thereby implementing functions such as managing charging, discharging, and power consumption management through the power management system. Fig.13 The electronic device structure shown in the figure does not constitute a limitation on the electronic device. The electronic device may include more or fewer components than shown in the figure, or combine certain components, or arrange the components differently, which will not be described in detail here.

[0154] The processor 1310 is configured to generate model editing information in response to a user's editing input for the first model;

[0155] The network module 1302 is used to send the model editing information to the server, so that the server edits the second model according to the model editing information, and sends the first image data and the second image data.

[0156] The network module 1302 is used to receive the first image data and the second image data sent by the server;

[0157] A display unit 1306, configured to display the first image data and the second image data sent by the server;

[0158] The first image data and the second image data are image data rendered according to the second model before and after editing.

[0159] In an embodiment of the present application, by rendering the second model before and after editing on the server side, first image data and second image data corresponding to before and after editing can be obtained, and the first image data and the second image data are displayed on the same screen through the terminal, thereby achieving the goal of not requiring the terminal to render the model, reducing the amount of terminal resources occupied during VR house viewing, and improving the efficiency of displaying image data before and after editing.

[0160] Furthermore, the network module 1302 is used to send initial observation perspective information to the server, so that the server renders the second model before and after editing according to the initial perspective information to obtain the first image data and the second image data.

[0161] The embodiment of the present application sends the initial observation perspective information to the server through the terminal, so that the server can render the second model before and after editing at the same perspective, ensuring that when the terminal displays the first image data and the second image data on the same screen, both can be displayed at the same perspective, thereby improving the contrast effect of the user viewing the image data.

[0162] Further, the processor 1310 is configured to determine viewing angle adjustment information in response to a viewing angle adjustment input for the first image data;

[0163] The network module 1302 is used to send the viewing angle adjustment information to the server, so that the server sends the third image data and the fourth image data according to the viewing angle adjustment information;

[0164] The network module 1302 is used to receive and display the third image data and the fourth image data;

[0165] The third image data and the fourth image data are image data rendered according to the second model before and after editing.

[0166] The embodiment of the present application receives the user's perspective adjustment input and sends the perspective adjustment information to the server, so that the server can adjust the rendering angle of the second model according to the perspective adjustment information, and re-render the second model according to the adjusted rendering angle, thereby enabling the terminal to adjust the same perspective of the image data before and after editing.

[0167] Furthermore, the accuracy of the second model is higher than that of the first model.

[0168] The embodiment of the present application sets the accuracy of the second model stored in the server to be greater than the accuracy of the first model stored in the terminal, thereby ensuring the editing efficiency of the first model by the terminal while improving the clarity of the first image data and the second image data rendered by the server.

[0169] Further, the processor 1310 is used to determine modeling material information and material position information according to the editing input;

[0170] The processor 1310 is used to generate model editing information according to the modeling material information and the material position information.

[0171] The embodiment of the present application records the editing input of the user on the terminal to the first model to obtain the corresponding modeling material information and material location information, and then edits the second model in the server through the modeling material information and material location information, so that the server edits the second model according to the editing input of the user in the terminal.

[0172] It should be understood that in the embodiment of the present application, the input unit 1304 may include a graphics processor (Graphics Processing Unit, GPU) 13041 and a microphone 13042, and the graphics processor 13041 processes the image data of the static picture or video obtained by the image capture device (such as a camera) in the video capture mode or the image capture mode. The display unit 1306 may include a display panel 13061, and the display panel 13061 may be configured in the form of a liquid crystal display, an organic light emitting diode, etc. The user input unit 1307 includes a touch panel 13071 and at least one of other input devices 13072. The touch panel 13071 is also called a touch screen. The touch panel 13071 may include two parts: a touch detection device and a touch controller. Other input devices 13072 may include, but are not limited to, a physical keyboard, function keys (such as volume control keys, switch keys, etc.), a trackball, a mouse, and a joystick, which will not be repeated here.

[0173] The memory 1309 can be used to store software programs and various data. The memory 1309 may mainly include a first storage area for storing programs or inputs and a second storage area for storing data, wherein the first storage area may store an operating system, an application program or input required for at least one function (such as a sound playback function, an image playback function, etc.), etc. In addition, the memory 1309 may include a volatile memory or a non-volatile memory, or the memory 1309 may include both volatile and non-volatile memories. Among them, the non-volatile memory may be a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), or a flash memory. The volatile memory may be a random access memory (RAM), a static random access memory (SRAM), a dynamic random access memory (DRAM), a synchronous dynamic random access memory (SDRAM), a double data rate synchronous dynamic random access memory (DDRSDRAM), an enhanced synchronous dynamic random access memory (ESDRAM), a synchronous link dynamic random access memory (SLDRAM) and a direct memory bus random access memory (DRRAM). The memory 1309 in the embodiment of the present application includes but is not limited to these and any other suitable types of memory.

[0174] The processor 1310 may include one or more processing units; optionally, the processor 1310 integrates an application processor and a modem processor, wherein the application processor mainly processes operations related to an operating system, a user interface, and application programs, and the modem processor mainly processes wireless communication signals, such as a baseband processor. It is understandable that the modem processor may not be integrated into the processor 1310.

[0175] An embodiment of the present application also provides a readable storage medium, on which a program or input is stored. When the program or input is executed by a processor, the various processes of the rendering method embodiment of the above-mentioned model are implemented, and the same technical effect can be achieved. To avoid repetition, it will not be repeated here.

[0176] The processor is the processor in the electronic device in the above embodiment. The readable storage medium includes a computer readable storage medium, such as a computer read-only memory ROM, a random access memory RAM, a magnetic disk or an optical disk.

[0177] An embodiment of the present application further provides a chip, which includes a processor and a communication interface, wherein the communication interface and the processor are coupled, and the processor is used to run programs or inputs to implement the various processes of the above-mentioned method embodiment, and can achieve the same technical effect. To avoid repetition, it will not be repeated here.

[0178] It should be understood that the chip mentioned in the embodiments of the present application can also be called a system-level chip, a system chip, a chip system or a system-on-chip chip, etc.

[0179] An embodiment of the present application provides a computer program product, which is stored in a storage medium. The program product is executed by at least one processor to implement the various processes of the rendering method embodiment of the above-mentioned model, and can achieve the same technical effect. To avoid repetition, it will not be repeated here.

[0180] It should be noted that, in this article, the terms "comprise", "include" or any other variant thereof are intended to cover non-exclusive inclusion, so that the process, method, article or device including a series of elements includes not only those elements, but also includes other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, the elements defined by the sentence "comprise one..." do not exclude the presence of other identical elements in the process, method, article or device including the element. In addition, it should be pointed out that the scope of the methods and devices in the embodiments of the present application is not limited to performing functions in the order shown or discussed, and may also include performing functions in a substantially simultaneous manner or in reverse order according to the functions involved, for example, the described method may be performed in an order different from that described, and various steps may also be added, omitted, or combined. In addition, the features described with reference to certain examples may be combined in other examples.

[0181] Through the description of the above implementation methods, those skilled in the art can clearly understand that the above-mentioned embodiment methods can be implemented by means of software plus a necessary general hardware platform, and of course by hardware, but in many cases the former is a better implementation method. Based on such an understanding, the technical solution of the present application, or the part that contributes to the prior art, can be embodied in the form of a computer software product, which is stored in a storage medium (such as ROM / RAM, a disk, or an optical disk), and includes a number of inputs to enable an electronic device (which can be a mobile phone, a computer, a server, or a network device, etc.) to execute the methods of each embodiment of the present application.

[0182] The embodiments of the present application are described above in conjunction with the accompanying drawings, but the present application is not limited to the above-mentioned specific implementation methods. The above-mentioned specific implementation methods are merely illustrative and not restrictive. Under the guidance of the present application, ordinary technicians in this field can also make many forms without departing from the purpose of the present application and the scope of protection of the claims, all of which are within the protection of the present application.

Claims

1. A rendering method of a model, characterized in that: include: In response to a user's editing input for the first model, generating model editing information; Sending the model editing information to a server, so that the server edits the second model according to the model editing information, and the server sends the first image data and the second image data; receiving and displaying the first image data and the second image data sent by the server; The first image data and the second image data are image data rendered according to the second model before and after editing, and the first image data and the second image data are displayed on the same screen; The step of generating model editing information in response to the user's editing input for the first model comprises: Determining modeling material information and material position information according to the editing input; Generate the model editing information according to the modeling material information and the material position information; Before sending the model editing information to the server, the method further includes: Sending initial observation angle information to the server, so that the server renders the second model before and after editing according to the initial observation angle information to obtain the first image data and the second image data; The accuracy of the second model is higher than the accuracy of the first model.

2. The rendering method of the model according to claim 1, characterized in that: After receiving and displaying the first image data and the second image data sent by the server, the method further includes: In response to a perspective adjustment input for the first image data, determining perspective adjustment information; Sending the viewing angle adjustment information to a server, so that the server sends the third image data and the fourth image data according to the viewing angle adjustment information; receiving and displaying the third image data and the fourth image data; The third image data and the fourth image data are image data rendered according to the second model before and after editing.

3. A rendering method of a model, characterized in that: include: receiving model editing information of the first model sent by the terminal; Editing the second model according to the model editing information; Sending the first image data and the second image data to the terminal, so that the terminal receives and displays the first image data and the second image data sent by the server; The first image data and the second image data are image data rendered according to the second model before and after editing, and the first image data and the second image data are displayed on the same screen; The editing of the second model according to the model editing information includes: Determining modeling material information and material location information according to the model editing information; Editing the second model according to the modeling material information and the material position information; Before sending the first image data and the second image data to the terminal, the method further includes: Receiving initial observation viewing angle information sent by the terminal; Determining a first rendering angle of the second model before and after editing according to the initial observation perspective information; Rendering the second model before and after editing according to the first rendering angle to obtain the first image data and the second image data; The accuracy of the second model is higher than the accuracy of the first model.

4. The rendering method of the model according to claim 3, characterized in that: The editing of the second model according to the modeling material information and the material position information includes: Searching for target modeling material in a modeling material library according to the modeling material information; The target modeling material is configured into the second model according to the material position information.

5. The rendering method of the model according to claim 3 or 4, characterized in that: After sending the first image data and the second image data to the terminal, the method further includes: Receiving viewing angle adjustment information sent by the terminal; Adjusting the first rendering angle according to the viewing angle adjustment information to obtain a second rendering angle; The second model before and after editing is rendered according to the second rendering angle to obtain third image data and fourth image data.

6. A rendering device for a model, characterized in that: include: A generating module, configured to generate model editing information in response to a user's editing input for the first model; A first sending module is used to send the model editing information to a server, so that the server edits the second model according to the model editing information, and sends the first image data and the second image data. A first receiving module, configured to receive the first image data and the second image data sent by the server; A display module, used for displaying the first image data and the second image data sent by the server; The first image data and the second image data are image data rendered according to the second model before and after editing, and the first image data and the second image data are displayed on the same screen; The step of generating model editing information in response to the user's editing input for the first model comprises: Determining modeling material information and material position information according to the editing input; Generate the model editing information according to the modeling material information and the material position information; The first sending module is further used to send initial observation angle information to the server, so that the server renders the second model before and after editing according to the initial observation angle information to obtain the first image data and the second image data; The accuracy of the second model is higher than the accuracy of the first model.

7. A rendering device for a model, characterized in that: include: A second receiving module, used for receiving model editing information of the first model sent by the terminal; An editing module, used for editing the second model according to the model editing information; A second sending module, used for sending the first image data and the second image data to the terminal, so that the terminal receives and displays the first image data and the second image data sent by the server; The first image data and the second image data are image data rendered according to the second model before and after editing, and the first image data and the second image data are displayed on the same screen; The editing of the second model according to the model editing information includes: Determining modeling material information and material location information according to the model editing information; Editing the second model according to the modeling material information and the material position information; The second receiving module is further used to receive initial observation viewing angle information sent by the terminal; a determination module, configured to determine a first rendering angle of the second model before and after editing according to the initial observation angle information; a rendering module, configured to render the second model before and after editing according to the first rendering angle to obtain the first image data and the second image data; The accuracy of the second model is higher than the accuracy of the first model.

8. A terminal, characterized in that: include: A memory on which programs or instructions are stored; A processor is used to implement the steps of the model rendering method as described in claim 1 or 2 when executing the program or instruction.

9. A server, characterized in that: include: A memory on which programs or instructions are stored; A processor, configured to implement the steps of the model rendering method as described in any one of claims 3 to 5 when executing the program or instruction.

10. A readable storage medium having a program or instruction stored thereon, characterized in that: When the program or instruction is executed by a processor, the steps of the model rendering method according to any one of claims 1 to 5 are implemented.

Images