Rendering method, client, server and computing device for virtual scene

Abstract

The embodiment of the present invention discloses a rendering method for a virtual scene, including: creating a patch object corresponding to a model object in the virtual scene; obtaining an image of the model object; mapping the patch object based on the image; and configuring the position and posture of the patch object so that the patch object always faces a virtual camera in the virtual scene. The embodiment of the present invention also discloses a corresponding client, a server, a system and a computing device.

Description

Technical Field

[0001] The present invention relates to the field of three-dimensional visualization technology, and in particular to a rendering method, a client, a server and a computing device for a virtual scene. Background Art

[0002] Web-based virtual reality technology (WEB 3D) is produced with the development of the Internet and virtual reality (VirtualReality) technology. Its purpose is to build virtual 3D scenes on the Internet so that people can understand real objects more clearly. With the rapid development of technologies such as HTML5 and WEBGL, WEB 3D technology has gradually matured. At present, Web 3D technology has been widely used in e-commerce, education, entertainment and other fields.

[0003] The basic principle of virtual reality technology is to pre-build a set of 3D models in the computing device to form a 3D scene. However, the existing 3D model file formats are numerous and have poor compatibility, and the display results may be different on different clients. In addition, due to the large amount of file data, the loading time is too slow, affecting the user experience. Its rendering requires a lot of GPU computing, so in the browser, especially the mobile terminal browser, there may be obvious performance problems such as flash back, reduced frame rate, severe device heating, and increased power consumption.

[0004] Therefore, a more advanced rendering scheme for virtual scenes is desired. Summary of the invention

[0005] To this end, an embodiment of the present invention provides a rendering method, a client, a server and a computing device for a virtual scene, in an effort to solve or at least alleviate the above problems.

[0006] According to one aspect of an embodiment of the present invention, a rendering method for a virtual scene is provided, comprising: creating a patch object corresponding to a model object in the virtual scene; acquiring an image of the model object; mapping the patch object based on the image; and configuring a position and posture of the patch object so that the patch object always faces a virtual camera in the virtual scene.

[0007] Optionally, in the method according to the present invention, obtaining the image of the model object includes: obtaining a link address of the image of the model object; and downloading the image of the model object based on the link address.

[0008] Optionally, in the method according to the present invention, mapping the patch object based on the image includes: using the image as a material map of the patch object.

[0009] According to another aspect of an embodiment of the present invention, a rendering method for a virtual scene is provided, comprising: creating a model object in the virtual scene; configuring the model object so as to render the model object; generating an image of the model object based on the rendered model object; and storing the image of the model object in association with the model object.

[0010] Optionally, in the method according to the present invention, configuring the model object includes at least one of the following: adjusting the material of the model object; setting the texture of the model object; adjusting the lighting of the model object; setting the camera parameters of the model object; and adjusting the rendering parameters of the model object.

[0011] Optionally, the method according to the present invention further includes: receiving an image acquisition request sent by a client, the image acquisition request indicating acquisition of an image of the model object; and returning the image of the model object to the client in response to the image acquisition request.

[0012] Optionally, the method according to the present invention further comprises: if there is no image of the model object, sending the model object to the client.

[0013] According to another aspect of an embodiment of the present invention, a client is provided, which is suitable for presenting a virtual scene and includes: an object creation module, suitable for creating a patch object corresponding to a model object in the virtual scene; an image acquisition module, suitable for acquiring an image of the model object; and an object configuration module, suitable for mapping the patch object based on the image; and also suitable for configuring the position and posture of the patch object so that the patch object always faces the virtual camera in the virtual scene.

[0014] According to another aspect of an embodiment of the present invention, a server is provided, comprising: an object creation module, adapted to create a model object corresponding to a virtual scene; an object configuration module, adapted to configure the model object so as to render the model object; an image generation module, adapted to generate an image of the model object based on the rendered model object; and an image storage module, adapted to store the image of the model object in association with the model object.

[0015] According to another aspect of the embodiments of the present invention, a rendering system is provided, including: a client according to the embodiments of the present invention; and a server according to the embodiments of the present invention.

[0016] According to another aspect of an embodiment of the present invention, a computing device is provided, comprising: one or more processors; a memory; and one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, and the one or more programs include instructions for executing a method according to an embodiment of the present invention.

[0017] According to the rendering scheme for virtual scenes of the embodiments of the present invention, a patch object is created and an image is used as a material map of the patch object to replace the model object for display in the virtual scene. It has good browser compatibility and eliminates the browser's parsing and compatibility operations on various model files. Moreover, compared with traditional model files, image files are small and load quickly, especially in the case of poor network connection, providing a better user experience. In addition, performance can be optimized and the number of model faces can be reduced, thereby reducing the high amount of calculations caused by rendering. The real-time rendering process can also be omitted, saving CPU computing power, slowing down heating, and reducing battery power consumption.

[0018] The above description is only an overview of the technical solution of the embodiment of the present invention. In order to more clearly understand the technical means of the embodiment of the present invention, it can be implemented in accordance with the contents of the specification. In order to make the above and other purposes, features and advantages of the embodiment of the present invention more obvious and easy to understand, the specific implementation method of the embodiment of the present invention is specifically listed below. BRIEF DESCRIPTION OF THE DRAWINGS

[0019] To achieve the above and related purposes, certain illustrative aspects are described herein in conjunction with the following description and accompanying drawings, which indicate various ways in which the principles disclosed herein can be practiced, and all aspects and their equivalents are intended to fall within the scope of the claimed subject matter. The above and other purposes, features and advantages of the present disclosure will become more apparent by reading the following detailed description in conjunction with the accompanying drawings. Throughout the present disclosure, the same reference numerals generally refer to the same parts or elements.

[0020] Figure 1 A schematic diagram of a rendering system 100 according to an embodiment of the present invention is shown;

[0021] Figure 2 A schematic diagram of a computing device 200 according to an embodiment of the present invention is shown;

[0022] Figure 3 A flowchart of a method 300 for rendering a virtual scene according to an embodiment of the present invention is shown;

[0023] Figure 4 A schematic diagram of a virtual scene according to an embodiment of the present invention is shown;

[0024] Figure 5 A flowchart of a method 500 for rendering a virtual scene according to an embodiment of the present invention is shown;

[0025] Figure 6 A schematic diagram showing an image of a model object according to an embodiment of the present invention;

[0026] Figure 7A schematic diagram showing a client 120 according to an embodiment of the present invention; and

[0027] Figure 8 A schematic diagram of a server 140 according to an embodiment of the present invention is shown. DETAILED DESCRIPTION

[0028] The exemplary embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. Although the exemplary embodiments of the present disclosure are shown in the accompanying drawings, it should be understood that the present disclosure can be implemented in various forms and should not be limited by the embodiments set forth herein. On the contrary, these embodiments are provided to enable a more thorough understanding of the present disclosure and to fully convey the scope of the present disclosure to those skilled in the art.

[0029] Figure 1 FIG. 1 is a schematic diagram of a rendering system 100 according to an embodiment of the present invention. Figure 1 As shown, the rendering system 100 may include a client 120 and a server 140. In other implementations, the rendering system 100 may include different and / or additional modules.

[0030] The client 120 may render a virtual two-dimensional and / or three-dimensional scene and its model objects to present to the user. The server 140 may store data related to the virtual scene and communicate with the client 120 via the network 160, for example, sending the model objects related to the virtual scene to the client 120. The network 160 may include wired and / or wireless communication paths.

[0031] According to an embodiment of the present invention, each component (client, server, etc.) in the above rendering system 100 can be implemented by a computing device 200 as described below.

[0032] Figure 2 FIG. 2 shows a schematic diagram of a computing device 200 according to an embodiment of the present invention. Figure 2 As shown, in a basic configuration 202, computing device 200 typically includes a system memory 206 and one or more processors 204. A memory bus 208 may be used for communication between processor 204 and system memory 206.

[0033] Depending on the desired configuration, the processor 204 can be any type of processor, including but not limited to: a microprocessor (μP), a microcontroller (μC), a digital information processor (DSP), or any combination thereof. The processor 204 can include one or more levels of cache such as a primary cache 210 and a secondary cache 212, a processor core 214, and registers 216. An example processor core 214 can include an arithmetic logic unit (ALU), a floating point unit (FPU), a digital signal processing core (DSP core), or any combination thereof. An example memory controller 218 can be used with the processor 204, or in some implementations, the memory controller 218 can be an internal part of the processor 204.

[0034] Depending on the desired configuration, system memory 206 may be any type of memory, including but not limited to: volatile memory (such as RAM), non-volatile memory (such as ROM, flash memory, etc.), or any combination thereof. System memory 206 may include an operating system 220, one or more applications 222, and program data 224. In some implementations, application 222 may be arranged to execute instructions on the operating system by one or more processors 204 using program data 224.

[0035] The computing device 200 may also include an interface bus 240 that facilitates communication from various interface devices (e.g., output devices 242, peripheral interfaces 244, and communication devices 246) to the basic configuration 202 via the bus / interface controller 230. Example output devices 242 include a graphics processing unit 248 and an audio processing unit 250. They can be configured to facilitate communication with various external devices such as a display or speakers via one or more A / V ports 252. Example peripheral interfaces 244 may include a serial interface controller 254 and a parallel interface controller 256, which may be configured to facilitate communication with external devices such as input devices (e.g., keyboards, mice, pens, voice input devices, touch input devices) or other peripherals (e.g., printers, scanners, etc.) via one or more I / O ports 258. Example communication devices 246 may include a network controller 260, which may be arranged to facilitate communication with one or more other computing devices 262 via a network communication link via one or more communication ports 264.

[0036] A network communication link can be an example of a communication medium. Communication media can generally be embodied as computer-readable instructions, data structures, program modules in a modulated data signal such as a carrier wave or other transmission mechanism, and can include any information delivery medium. A "modulated data signal" can be a signal in which one or more of its data sets or its changes can be carried out in a manner that encodes information in the signal. As non-limiting examples, communication media can include wired media such as a wired network or a dedicated line network, and various wireless media such as sound, radio frequency (RF), microwave, infrared (IR) or other wireless media. The term computer-readable medium used herein can include both storage media and communication media.

[0037] The computing device 200 can be implemented as a server, such as a database server, an application server, a WEB server, etc., or as a personal computer including a desktop computer and a notebook computer. Of course, the computing device 200 can also be implemented as at least a part of a small-sized portable (or mobile) electronic device.

[0038] In an embodiment according to the present invention, the computing device 200 may be implemented as a client 120 and / or a server 140, and is configured to execute the rendering method 300 and / or 400 for a virtual scene according to an embodiment of the present invention. The application 222 of the computing device 200 includes a plurality of instructions for executing the rendering method 300 and / or 400 for a virtual scene according to an embodiment of the present invention, and the program data 224 may also store the configuration data of the rendering system 100 and other contents.

[0039] Figure 3 The flowchart of a rendering method 300 for a virtual scene according to an embodiment of the present invention is shown. The rendering method 300 is suitable for being executed in the client 120.

[0040] like Figure 3 As shown, the rendering method 300 starts at step S310. In step S310, a patch object corresponding to the model object is created in the virtual scene. Generally, a model object includes a plurality of vertices, and a plurality of adjacent vertices constitute a patch, and the patch contains a normal representing its direction. Creating a patch object instead of a traditional model object can reduce the amount of rendering calculation (because the number of vertices and faces is significantly reduced).

[0041] Then, in step S320, the image of the model object corresponding to the patch object is obtained. In some embodiments, the link address of the image of the model object can be obtained, and then the image of the model object is downloaded based on the link address. For example, a request can be made to the server 140 to obtain the link address of the image of the model object.

[0042] Compared with traditional model files, image files are small and load quickly, especially when the network connection is poor, the loading time is significantly reduced.

[0043] Then, in step S330, the above-mentioned patch object is mapped based on the image of the model object. That is, the image of the model object is used as the material map of the patch object to load the patch object. The generation process of the image of the model object will be described later.

[0044] Then, in step S340, the position and posture of the patch object are configured so that the patch object always faces the virtual camera in the virtual scene. Usually, there is one or more virtual cameras in the virtual scene, and the positions of these virtual cameras in the scene can be controlled by the user through external devices such as a mouse and a keyboard. In this way, when the user operates the external device, the virtual camera object in the virtual scene will move and rotate accordingly. The computing device performs real-time rendering through the position of the virtual camera, and obtains a series of rapidly switched screen images, so that the user feels like roaming in the virtual scene from a first-person perspective.

[0045] The virtual scene rendered by the rendering method 300 according to the embodiment of the present invention can be as follows: Figure 4 As shown, obviously, its presentation effect is similar to the presentation effect of loading complex model objects in traditional solutions.

[0046] The following is an introduction to the process of generating images of model objects.

[0047] Figure 5 The flowchart of a rendering method 500 for a virtual scene according to an embodiment of the present invention is shown. The rendering method 500 is suitable for being executed in the server 140 .

[0048] like Figure 5 As shown, the rendering method 500 starts at step S510. In step S510, a model object in a virtual scene may be created.

[0049] Then, in step 520, the model object is configured so as to render the model object. In some embodiments, the model object may be configured as follows, or any combination of the following configurations: adjusting the material of the model object; setting the texture of the model object; adjusting the lighting of the model object; setting the camera parameters of the model object; adjusting the rendering parameters of the model object (e.g., anti-aliasing, DMC sampling, global illumination sampling, etc.).

[0050] Then, in step S530, an image of the model object may be generated based on the rendered model object, such as Figure 6 As shown. The image can be in any format, such as PNG, JPG, etc.

[0051] According to an embodiment of the present invention, an image acquisition request sent by the client 120 may also be received, the image acquisition request indicating acquisition of an image of a model object. Then, in response to the image acquisition request, the requested image of the model object is returned to the client 120 for rendering by the client.

[0052] If no image of the model object is found, the model object (eg, the complete file of the model object) may be sent to the client 120 .

[0053] Figure 7 FIG. 1 is a schematic diagram of a client 120 according to an embodiment of the present invention. Figure 7 As shown, an object creation module 710 , an image acquisition module 720 and an object configuration module 730 .

[0054] The object creation module 710 is adapted to create a patch object corresponding to the model object in the virtual scene, and the image acquisition module 720 is adapted to acquire an image of the model object. The object configuration module 730 is connected to the image acquisition module 720, and is adapted to map the patch object based on the image of the model object, and is also adapted to configure the position and posture of the patch object so that the patch object always faces the virtual camera in the virtual scene.

[0055] For detailed processing logic and implementation process of each module in the client 120, please refer to the above combined Figure 1-Figure 6 The relevant descriptions of the rendering methods 300 and 500 are not repeated here.

[0056] Figure 8 FIG. 1 is a schematic diagram of a server 140 according to an embodiment of the present invention. Figure 8 As shown, the server 140 may include an object creation module 810 , an object configuration module 820 , an image generation module 830 , and an image storage module 840 .

[0057] The object creation module 810 is adapted to create a model object in a virtual scene. The object configuration module 820 is adapted to configure the model object so as to render the model object. The image generation module 830 is connected to the object configuration module 820 and is adapted to generate an image of the model object based on the rendered model object. The image storage module 840 is connected to the image generation module 830 and is adapted to store the image of the model object in association with the model object.

[0058] For detailed processing logic and implementation process of each module in the server 140, please refer to the above combined Figure 1-Figure 6 The relevant descriptions of the rendering methods 300 and 500 are not repeated here.

[0059] In summary, according to the rendering scheme for virtual scenes in an embodiment of the present invention, a patch object is created and an image is used as a material map of the patch object to replace the model object for display in the virtual scene. It has good browser compatibility and eliminates the browser's parsing and compatibility operations on various model files. Moreover, compared with traditional model files, image files are small and load quickly, especially in the case of poor network connection, providing a better user experience. In addition, performance can be optimized and the number of model faces can be reduced, thereby reducing the high amount of calculations caused by rendering. The real-time rendering process can also be omitted, saving CPU computing power, slowing down heating, and reducing battery consumption.

[0060] The various techniques described herein may be implemented in combination with hardware or software, or a combination thereof. Thus, the method and apparatus of the embodiments of the present invention, or certain aspects or portions of the method and apparatus of the embodiments of the present invention, may be in the form of program codes (i.e., instructions) embedded in a tangible medium, such as a removable hard disk, a USB flash drive, a floppy disk, a CD-ROM, or any other machine-readable storage medium, wherein when the program is loaded into a machine such as a computer and executed by the machine, the machine becomes a device for practicing the embodiments of the present invention.

[0061] In the case where the program code is executed on a programmable computer, the computing device generally includes a processor, a storage medium readable by the processor (including volatile and non-volatile memory and / or storage elements), at least one input device, and at least one output device. The memory is configured to store the program code; the processor is configured to execute the method of the embodiment of the present invention according to the instructions in the program code stored in the memory.

[0062] By way of example and not limitation, readable media include readable storage media and communication media. Readable storage media stores information such as computer readable instructions, data structures, program modules or other data. Communication media generally embody computer readable instructions, data structures, program modules or other data in a modulated data signal such as a carrier wave or other transmission mechanism, and include any information transfer medium. Any combination of the above is also included within the scope of readable media.

[0063] In the description provided herein, algorithms and displays are not inherently related to any particular computer, virtual system or other device. Various general purpose systems can also be used together with the examples of the embodiments of the present invention. According to the above description, it is obvious that the structure required for constructing such systems. In addition, the embodiments of the present invention are not directed to any specific programming language either. It should be understood that various programming languages ​​can be utilized to implement the content of the embodiments of the present invention described herein, and the above description of specific languages ​​is for the purpose of disclosing the implementation methods of the embodiments of the present invention.

[0064] In the description provided herein, a large number of specific details are described. However, it is understood that the embodiments of the embodiments of the present invention can be practiced without these specific details. In some instances, well-known methods, structures and techniques are not shown in detail so as not to obscure the understanding of this description.

[0065] Similarly, it should be understood that in order to streamline the present disclosure and aid in understanding one or more of the various inventive aspects, in the above description of exemplary embodiments of embodiments of the present invention, the various features of embodiments of the present invention are sometimes grouped together into a single embodiment, figure, or description thereof. However, this disclosed method should not be interpreted as reflecting the following intention: that the claimed embodiments of the present invention require more features than the features explicitly recited in each claim. More specifically, as reflected in the claims below, inventive aspects lie in less than all the features of the single embodiment disclosed above. Therefore, the claims that follow the specific embodiment are hereby expressly incorporated into the specific embodiment, with each claim itself as a separate embodiment of an embodiment of the present invention.

[0066] The present invention may also include: B6. The method as described in B1 further includes: receiving an image acquisition request sent by a client, the image acquisition request indicating acquisition of an image of the model object; and in response to the image acquisition request, returning the image of the model object to the client. B7. The method as described in B6 further includes: if the image of the model object does not exist, sending the model object to the client.

[0067] Those skilled in the art will appreciate that the modules or units or components of the devices in the examples disclosed herein may be arranged in the devices described in the embodiment, or alternatively may be located in one or more devices different from the devices in the examples. The modules in the foregoing examples may be combined into one module or may be divided into multiple submodules.

[0068] Those skilled in the art will appreciate that the modules in the devices in the embodiments may be adaptively changed and arranged in one or more devices different from the embodiments. The modules or units or components in the embodiments may be combined into one module or unit or component, and in addition they may be divided into a plurality of submodules or subunits or subcomponents. Except that at least some of such features and / or processes or units are mutually exclusive, all features disclosed in this specification (including the accompanying claims, abstracts and drawings) and all processes or units of any method or device disclosed in this manner may be combined in any combination. Unless otherwise expressly stated, each feature disclosed in this specification (including the accompanying claims, abstracts and drawings) may be replaced by an alternative feature providing the same, equivalent or similar purpose.

[0069] In addition, those skilled in the art will appreciate that, although some embodiments described herein include certain features included in other embodiments but not other features, the combination of features of different embodiments is meant to be within the scope of embodiments of the present invention and to form different embodiments. For example, in the claims below, any one of the claimed embodiments may be used in any combination.

[0070] In addition, some of the above-described embodiments are described herein as a combination of methods or method elements that can be implemented by a processor of a computer system or by other devices that perform the above-described functions. Therefore, a processor with necessary instructions for implementing the above-described methods or method elements forms a device for implementing the methods or method elements. In addition, the elements described herein of the device embodiments are examples of devices that are used to implement the functions performed by the elements for the purpose of implementing the invention.

[0071] As used herein, unless otherwise specified, the use of ordinal numbers "first," "second," "third," etc. to describe common objects merely indicates that different instances of similar objects are involved, and is not intended to imply that the objects so described must have a given order in time, space, order, or in any other manner.

[0072] Although embodiments of the present invention have been described according to a limited number of embodiments, it will be apparent to those skilled in the art, with the benefit of the above description, that other embodiments may be envisioned within the scope of the embodiments of the present invention thus described. In addition, it should be noted that the language used in this specification is selected primarily for readability and teaching purposes, rather than for explaining or limiting the subject matter of the embodiments of the present invention. Therefore, many modifications and variations will be apparent to those of ordinary skill in the art without departing from the scope and spirit of the appended claims. With respect to the scope of the embodiments of the present invention, the disclosure of the embodiments of the present invention is illustrative and not restrictive, and the scope of the embodiments of the present invention is defined by the appended claims.

Claims

1. A method for rendering a virtual scene, the method being suitable for execution in a client, the client being communicatively connected to a server, the method include: Creating a patch object corresponding to the model object in the virtual scene; Acquire an image of the model object from the server; Based on the image, mapping the patch object; Configuring the position and posture of the patch object so that when the virtual camera is controlled to move or rotate, the patch object always faces the virtual camera in the virtual scene; The steps of generating the image in the server include: Create model objects in virtual scenes; configuring the model object so as to render the model object; Based on the rendered model object, an image of the model object is generated.

2. The method according to claim 1, in, Acquiring the image of the model object from the server includes: Obtaining a link address of an image of the model object; The image of the model object is downloaded based on the link address.

3. The method according to claim 1, in, Mapping the patch object based on the image includes: The image is used as a material map for the patch object.

4. A rendering method for a virtual scene, include: Creating a model object in the virtual scene; configuring the model object so as to render the model object; Based on the rendered model object, generating an image of the model object; storing the image of the model object in association with the model object; receiving an image acquisition request sent by a client, wherein the image acquisition request indicates acquiring an image of the model object; In response to the image acquisition request, the image of the model object is returned to the client, so that the client can map a patch object corresponding to the model object in the virtual scene based on the image, and configure the position and posture of the patch object so that when the virtual camera is controlled to move or rotate, the patch object always faces the virtual camera in the virtual scene.

5. The method according to claim 4, in, Configuring the model object includes at least one of the following: Adjusting the material of the model object; Setting a texture of the model object; adjusting the lighting of the model object; Setting the camera parameters of the model object; Adjust the rendering parameters of the model object.

6. The method according to claim 4, further comprising: include: If the image of the model object does not exist, the model object is sent to the client.

7. A client, connected to the server for communication, suitable for presenting a virtual scene, and include: An object creation module, adapted to create a patch object corresponding to the model object in a virtual scene; An image acquisition module, adapted to acquire an image of the model object from the server; An object configuration module, adapted to map the patch object based on the image; and further adapted to configure the position and posture of the patch object so that when the virtual camera is controlled to move or rotate, the patch object always faces the virtual camera in the virtual scene; The steps of generating the image in the server include: Create model objects in a virtual scene; configuring the model object so as to render the model object; Based on the rendered model object, an image of the model object is generated.

8. A server, communicating with a client, include: An object creation module, adapted to create a model object corresponding to a virtual scene; An object configuration module, adapted to configure the model object so as to render the model object; An image generation module, adapted to generate an image of the model object based on the rendered model object; An image storage module is adapted to store the image of the model object in association with the model object, and is also adapted to receive an image acquisition request sent by a client, wherein the image acquisition request indicates acquiring the image of the model object, and in response to the image acquisition request, returns the image of the model object to the client, so that the client maps a patch object corresponding to the model object created in a virtual scene based on the image, and configures the position and posture of the patch object so that when the virtual camera is controlled to move or rotate, the patch object always faces the virtual camera in the virtual scene.

9. A rendering system, include: The client according to claim 7; as well as The server as claimed in claim 8.

10. A computing device, include: one or more processors; and Memory; One or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, the one or more programs comprising instructions for executing any one of the methods according to claims 1-6.

11. A readable storage medium storing a program, the program comprising instructions, which when executed by a computing device, causes the computing device to perform any one of the methods of claims 1-6.

Images