Rendering picture generation method, controller, storage medium and augmented reality equipment

Abstract

The invention relates to the technical field of virtual reality rendering, particularly provides a rendering picture generation method, a controller, a storage medium and augmented reality equipment, and aims to solve the problem of how to provide rendering pictures for multiple wearable equipment to save cost and avoid insufficient computing power when the augmented reality equipment comprises the multiple wearable equipment. In order to achieve the purpose, the virtual scene is rendered through a main renderer of a first processor, the rendering middle frame with the field angle larger than the field angle of the wearable device is obtained, the rendering picture of each wearable device is obtained according to the rendering middle frame and the orientation of each wearable device, the rendering middle frame is obtained only through one-time rendering, and the rendering efficiency is improved. According to the embodiment of the invention, the rendering intermediate frame is adjusted, and the rendering picture of each wearable device is obtained, so that the process of performing multi-view rendering on each wearable device can be avoided, and the computing power consumption is effectively reduced on the premise of ensuring the effect of the rendering picture of each wearable device.

Description

Technical Field

[0001] The present application relates to the field of virtual reality rendering technology, and specifically provides a rendering picture generation method, a controller, a storage medium, and an extended reality device. Background Art

[0002] In the prior art, if it is necessary to generate display images for multiple wearable devices, multiple hosts are often required to render for each wearable device, which is often very costly. However, if only a single host is used to provide rendering images for multiple wearable devices, insufficient computing power is often encountered.

[0003] Accordingly, the art needs a new rendering picture generation solution to solve the above problems. Summary of the invention

[0004] In order to overcome the above-mentioned defects, the present application is proposed to provide a solution or at least partially solve the problem of how to provide rendering images for multiple wearable devices, save costs and avoid insufficient computing power when the extended reality device includes multiple wearable devices.

[0005] In a first aspect, the present application provides a rendering screen generation method, the method is applied to a first processor, the first processor is communicatively connected with a plurality of wearable devices; the plurality of wearable devices correspond to the same virtual scene; the method comprises:

[0006] Rendering the virtual scene through a main renderer of the first processor to obtain a rendered intermediate frame; the field of view of the rendered intermediate frame is greater than the field of view of a single wearable device;

[0007] The rendered intermediate frame is sent to each wearable device connected to the first processor to generate a rendered image for the wearable device.

[0008] In a technical solution of the above-mentioned rendering picture generation method, the rendering of the virtual scene by the main renderer of the first processor to obtain a rendering intermediate frame includes:

[0009] A plurality of virtual cameras are arranged in the virtual scene; the viewing angle of each virtual camera is different from the viewing angles of other virtual cameras;

[0010] The virtual scene is rendered by the main renderer according to the contents of different perspectives captured by the virtual camera to obtain the rendered intermediate frame.

[0011] In a technical solution of the above-mentioned rendering picture generation method, the obtaining of the rendering intermediate frame includes:

[0012] The virtual scene is rendered with a 180-degree field of view to obtain the rendered intermediate frame.

[0013] In a technical solution of the above-mentioned rendering picture generation method, the obtaining of the rendering intermediate frame includes:

[0014] Obtaining the field of view angle of the rendered intermediate frame according to the union of the field of view angles of the wearable device;

[0015] Rendering is performed according to the field of view of the rendered intermediate frame to obtain the rendered intermediate frame.

[0016] In a technical solution of the above rendering picture generation method, the method further includes:

[0017] When the rendered picture is a movie viewing picture, the curtain in the virtual scene is set to a concave arc shape.

[0018] In a second aspect, a rendering picture generation method is provided, the method being applied to a wearable device, the wearable device being communicatively connected to a first processor; the method comprising:

[0019] Obtaining a rendering intermediate frame sent by the first processor;

[0020] Based on the rendered intermediate frame and the orientation of the wearable device, a rendered picture of the wearable device is obtained.

[0021] In a technical solution of the above-mentioned rendering picture generation method, before obtaining the rendering picture of the wearable device based on the rendering intermediate frame and the orientation of the wearable device, the method further includes:

[0022] The rendered intermediate frame is stored in an input buffer of the wearable device.

[0023] In a technical solution of the above rendering screen generation method, obtaining the rendering screen of each wearable device includes:

[0024] According to the orientation of the wearable device, asynchronous time warping is performed on the rendering intermediate frame to achieve frame interpolation of the rendering intermediate frame and obtain a rendering picture of the wearable device.

[0025] In a third aspect, a controller is provided, comprising at least one second processor and at least one memory, wherein the memory is suitable for storing multiple program codes, and the program codes are suitable for being loaded and run by the second processor to execute the rendering screen generation method described in any one of the technical solutions of the above-mentioned rendering screen generation method.

[0026] In a fourth aspect, a computer-readable storage medium is provided, wherein a plurality of program codes are stored in the computer-readable storage medium, wherein the program codes are suitable for being loaded and run by a processor to execute the rendering screen generation method described in any one of the technical solutions of the above-mentioned rendering screen generation method.

[0027] In a fifth aspect, an extended reality device is provided, comprising a first processor, a plurality of wearable devices and the controller described in the above controller technical solution, wherein the plurality of wearable devices are all communicatively connected to the first processor.

[0028] Solution 1. A rendering picture generation method, characterized in that the method is applied to a first processor, the first processor is communicatively connected to a plurality of wearable devices; the plurality of wearable devices correspond to the same virtual scene; the method comprises:

[0029] Rendering the virtual scene through a main renderer of the first processor to obtain a rendered intermediate frame; the field of view of the rendered intermediate frame is greater than the field of view of a single wearable device;

[0030] The rendered intermediate frame is sent to each wearable device connected to the first processor to generate a rendered image for the wearable device.

[0031] Solution 2. The rendering screen generation method according to Solution 1 is characterized in that:

[0032] The step of rendering the virtual scene by the main renderer of the first processor to obtain a rendered intermediate frame includes:

[0033] A plurality of virtual cameras are arranged in the virtual scene; the viewing angle of each virtual camera is different from the viewing angles of other virtual cameras;

[0034] The virtual scene is rendered by the main renderer according to the contents of different perspectives captured by the virtual camera to obtain the rendered intermediate frame.

[0035] Solution 3. The rendering screen generation method according to Solution 2 is characterized in that:

[0036] The obtaining of the rendered intermediate frame comprises:

[0037] The virtual scene is rendered with a 180-degree field of view to obtain the rendered intermediate frame.

[0038] Solution 4. The rendering screen generation method according to Solution 2 is characterized in that:

[0039] The obtaining of the rendered intermediate frame comprises:

[0040] Obtaining the field of view angle of the rendered intermediate frame according to the union of the field of view angles of the wearable device;

[0041] Rendering is performed according to the field of view of the rendered intermediate frame to obtain the rendered intermediate frame.

[0042] Solution 5. The method for generating a rendering image according to any one of Solutions 1 to 4, characterized in that the method further comprises:

[0043] When the rendered picture is a movie viewing picture, the curtain in the virtual scene is set to a concave arc shape.

[0044] Solution 6. A rendering image generation method, characterized in that the method is applied to a wearable device, and the wearable device is communicatively connected to a first processor; the method comprises:

[0045] Obtaining a rendering intermediate frame sent by the first processor;

[0046] Based on the rendered intermediate frame and the orientation of the wearable device, a rendered picture of the wearable device is obtained.

[0047] Solution 7. The rendering screen generation method according to Solution 6 is characterized in that:

[0048] Before obtaining a rendering picture of the wearable device based on the rendering intermediate frame and the orientation of the wearable device, the method further includes:

[0049] The rendered intermediate frame is stored in an input buffer of the wearable device.

[0050] Solution 8. The rendering screen generation method according to Solution 6 is characterized in that:

[0051] The obtaining of the rendering image of each wearable device includes:

[0052] According to the orientation of the wearable device, asynchronous time warping is performed on the rendering intermediate frame to achieve frame interpolation of the rendering intermediate frame and obtain a rendering picture of the wearable device.

[0053] A scheme controller comprises at least one second processor and at least one memory, wherein the memory is suitable for storing multiple program codes, and is characterized in that the program code is suitable for being loaded and run by the second processor to execute the rendering screen generation method described in any one of schemes 1 to 5.

[0054] Solution 10. A controller comprising at least one second processor and at least one memory, wherein the memory is suitable for storing multiple program codes, and wherein the program codes are suitable for being loaded and run by the second processor to execute the rendering screen generation method described in any one of Solutions 6 to 8.

[0055] Solution 11. A computer-readable storage medium storing a plurality of program codes, wherein the program codes are suitable for being loaded and run by a processor to execute the rendering screen generation method described in any one of Solutions 1 to 9.

[0056] Solution 12. An extended reality device, characterized in that the extended reality device includes a first processor, multiple wearable devices and the controller described in Solution 9, the multiple wearable devices are all communicatively connected to the first processor, and the wearable devices include the controller described in Solution 10.

[0057] The above one or more technical solutions of this application have at least one or more of the following Beneficial effects:

[0058] In the technical solution for implementing the present application, the present application renders the virtual scene through the main renderer of the first processor, obtains a rendering intermediate frame with a field of view greater than the field of view of the wearable device, and obtains a rendering screen of each wearable device according to the rendering intermediate frame and the orientation of each wearable device. Through the above configuration, the present application only needs to perform one rendering to obtain a rendering intermediate frame corresponding to the same virtual scene for multiple wearable devices sharing a first processor, and then adjust the rendering intermediate frame based on the orientation of each wearable device to obtain a rendering screen of each wearable device, which can avoid the process of rendering multiple perspectives for each wearable device separately, and effectively reduce computing power consumption and costs while ensuring the effect of the rendering screen of each wearable device. BRIEF DESCRIPTION OF THE DRAWINGS

[0059] The disclosure of the present application will become easier to understand with reference to the accompanying drawings. It is easy for those skilled in the art to understand that these drawings are only for illustrative purposes and are not intended to limit the scope of protection of the present application. Among them:

[0060] Figure 1 It is a flowchart of the main steps of a method for generating a rendering picture according to an embodiment of the present application;

[0061] Figure 2 It is a flowchart of the main steps of obtaining a rendered intermediate frame according to an implementation of an embodiment of the present application. DETAILED DESCRIPTION

[0062] Some embodiments of the present application are described below with reference to the accompanying drawings. Those skilled in the art should understand that these embodiments are only used to explain the technical principles of the present application and are not intended to limit the protection scope of the present application.

[0063] In the description of the present application, "module" and "processor" may include hardware, software or a combination of the two. A module may include hardware circuits, various suitable sensors, communication ports, memory, and may also include software parts, such as program code, or a combination of software and hardware. The processor may be a central processing unit, a microprocessor, an image processor, a digital signal processor or any other suitable processor. The processor has data and / or signal processing functions. The processor may be implemented in software, hardware or a combination of the two. Non-temporary computer-readable storage media include any suitable medium that can store program code, such as a disk, a hard disk, an optical disk, a flash memory, a read-only memory, a random access memory, etc. The term "A and / or B" means all possible combinations of A and B, such as only A, only B or A and B. The term "at least one A or B" or "at least one of A and B" has a similar meaning to "A and / or B" and may include only A, only B or A and B. The singular terms "one" and "the" may also include plural forms.

[0064] The relevant user personal information that may be involved in the various embodiments of this application is strictly in accordance with the requirements of laws and regulations, following the principles of legality, legitimacy and necessity, based on the reasonable purposes of business scenarios, to process the personal information that users actively provide during the use of products / services or generated due to the use of products / services, as well as the personal information obtained with the user's authorization.

[0065] The user personal information processed by this application will vary depending on the specific product / service scenario, and shall be based on the specific scenario in which the user uses the product / service, and may involve the user's account information, device information, driving information, vehicle information or other related information. This application will treat the user's personal information and its processing with a high degree of diligence.

[0066] This application attaches great importance to the security of user personal information and has taken reasonable and feasible security protection measures that meet industry standards to protect user information and prevent personal information from being accessed, disclosed, used, modified, damaged or lost without authorization.

[0067] Here we first explain some terms involved in this application.

[0068] Extended Reality (XR) refers to the combination of reality and virtuality through computers to create a virtual environment for human-computer interaction. It is also a general term for various technologies such as AR, VR, and MR.

[0069] AR (Augmented Reality) is augmented reality technology.

[0070] VR (Virtual Reality) is virtual reality technology.

[0071] MR (Mixed Reality) is a mixed reality technology.

[0072] Asynchronous Timewarp (ATW) is a technique for generating intermediate frames in a thread (called the ATW thread) that runs in parallel with the rendering thread.

[0073] EYE BUFFER: Usually refers to the 2D intermediate buffer content used by ATW for further frame supplement during the rendering process of extended reality, which is rendered by the main renderer from the 3D virtual scene according to the viewing angle into a 2D picture.

[0074] GPU (Graphics Processing Unit) is a hardware device specifically used to process graphics and image data. It is mainly responsible for tasks such as graphics rendering, image processing and computing.

[0075] Field of View (FOV) is used to indicate the angle between the edges of the display and the line connecting the eyes.

[0076] UNITY is a real-time 3D interactive content creation and operation platform.

[0077] In an example of an application scenario of the present application, in the automotive field or when multiple people use wearable devices together in the same fixed area, multiple wearable devices are used to render the content of the same virtual scene, such as a scene where four people in a car watch the same movie at the same time.

[0078] See attached Figure 1 , Figure 1 FIG. 1 is a flow chart of the main steps of a method for generating a rendering screen according to an embodiment of the present application. Figure 1 As shown, the rendering screen generation method in the embodiment of the present application is applied to an extended reality device, the extended reality device includes a first processor and multiple wearable devices, the multiple wearable devices are all connected to the first processor in communication; the multiple wearable devices correspond to the same virtual scene. The rendering screen generation method mainly includes the following steps S101-step S102.

[0079] Step S101: a main renderer of a first processor renders a virtual scene to obtain a rendered intermediate frame; a field of view of the rendered intermediate frame is greater than a field of view of a single wearable device.

[0080] In this embodiment, the virtual scene can be rendered by the main renderer of the first processor to obtain a rendered intermediate frame, and the field of view of the rendered intermediate frame is greater than the field of view of a single wearable device. That is, the virtual scene is rendered by the main renderer to produce a rendered intermediate frame with a larger field of view. The wearable device is a visual wearable device, that is, a wearable device for viewing a picture constructed based on a virtual scene.

[0081] In one implementation, the first processor may be a GPU.

[0082] In one implementation, the first processor is a processor based on an ARM architecture.

[0083] In one implementation, the wearable device may be XR glasses, an XR helmet, etc.

[0084] Step S102: the first processor sends the rendered intermediate frame to each wearable device connected to the first processor.

[0085] In this embodiment, the generated rendering intermediate frame can be sent to each wearable device.

[0086] Step S103: Each wearable device obtains the rendered intermediate frame sent by the first processor.

[0087] In this embodiment, the wearable device can obtain the rendered intermediate frame sent by the first processor.

[0088] Step S104: the wearable device obtains a rendering picture of the wearable device based on the rendered intermediate frame and the orientation of each wearable device.

[0089] In this embodiment, the rendering intermediate frame can be adjusted according to the orientation of each wearable device, such as supplementing the rendering intermediate frame, so as to ensure the effect of the rendering picture of each wearable device and obtain the rendering picture of each wearable device.

[0090] In one implementation, the orientation of the wearable device may be acquired based on IMU (Inertial Measurement Unit) data of the wearable device.

[0091] Based on the above steps S101-S104, the embodiment of the present application renders the virtual scene through the main renderer of the first processor, obtains a rendering intermediate frame with a field of view greater than the field of view of the wearable device, and obtains a rendering screen of each wearable device according to the rendering intermediate frame and the orientation of each wearable device. Through the above configuration, the embodiment of the present application only needs to perform one rendering to obtain a rendering intermediate frame corresponding to the same virtual scene for multiple wearable devices sharing a first processor, and then adjust the rendering intermediate frame based on the orientation of each wearable device to obtain a rendering screen of each wearable device, which can avoid the process of rendering multiple perspectives for each wearable device separately, and effectively reduce computing power consumption and costs while ensuring the effect of the rendering screen of each wearable device.

[0092] Step S101 and step S104 are further described below.

[0093] In one implementation of the present application, please refer to the attached Figure 2 , Figure 2 FIG. 1 is a flow chart of the main steps of obtaining a rendered intermediate frame according to an implementation of an embodiment of the present application. Figure 2 As shown, step S101 may further include the following steps S1011 and S1012:

[0094] Step S1011: multiple virtual cameras are set in the virtual scene; the viewing angle of each virtual camera is different from the viewing angles of other virtual cameras.

[0095] In this implementation, multiple virtual cameras may be set in the virtual scene. The virtual cameras have different viewing angles and can render contents of multiple viewing angles for the virtual scene.

[0096] In one implementation, the virtual scene may be a scene built based on the unity SDK.

[0097] Step S1012: Rendering the virtual scene according to the contents of different perspectives captured by the virtual camera through the main renderer to obtain a rendered intermediate frame.

[0098] In this implementation, the main renderer may render the virtual scene according to the contents of different perspectives captured by the virtual camera, thereby obtaining a rendered intermediate frame.

[0099] In one implementation, a 180-degree field of view rendering may be performed on the virtual scene to obtain a rendered intermediate frame.

[0100] In another implementation, the field of view angle of the rendered intermediate frame can be obtained according to the union of the field of view angles of the wearable device, and rendering can be performed according to the field of view angle of the rendered intermediate frame to obtain the rendered intermediate frame.

[0101] In one implementation of the embodiment of the present application, after obtaining the rendered intermediate frame, the rendered intermediate frame can be stored in the input buffer of the wearable device, so as to obtain the rendered screen of each wearable device according to the rendered intermediate frame.

[0102] In one implementation, the input buffer may be an Eye Buffer of XR glasses.

[0103] In one implementation of the embodiment of the present application, step S104 may be further configured as follows:

[0104] For each wearable device, asynchronous time warping is performed on the rendered intermediate frames according to the orientation of the wearable device, so as to interpolate the rendered intermediate frames and obtain the rendered image of the wearable device.

[0105] In one implementation, when the rendered image is a movie viewing image, the screen in the virtual scene can be set to a concave arc shape. This allows the parallax of each wearable device facing the screen to be basically consistent, so when applying asynchronous time warping to fill in the intermediate frames, only fine-tuning is required to eliminate distortion and obtain the rendered image of each wearable device.

[0106] The following is an example of an extended reality device consisting of a vehicle-mounted NBOX and four XR glasses to illustrate the rendering screen generation method of the present application.

[0107] The extended reality device can use the vehicle-mounted NBOX (Entertainment Enhanced Host) as the computing center, that is, the first processor - GPU. Four DP (DisplayPort) display interfaces are derived from the NBOX, and the rendering images corresponding to the IMU data of the XR glasses are output to the four XR glasses respectively. In the virtual scene built based on the UNITY space, the content that the four XR glasses actually need to render is the same. Multiple virtual cameras will be set up in the UNITY space, and the virtual cameras will adjust the viewing angle according to the actual position of the XR glasses.

[0108] For an extended reality device consisting of a vehicle-mounted NBOX and four XR glasses, the application scenario is that four people wear XR glasses to watch the same video or movie together, so the direction of the XR glasses is the curtain. At this time, the virtual scene can be rendered with a 180-degree field of view, or the union of the field of view of the four XR glasses can be rendered to obtain the rendered intermediate frame, and the rendered intermediate frame can be saved in the Eye Buffer of the XR glasses. In this way, only one rendering is required for the GPU for four XR glasses. Each XR glass can apply the ATW technology to fill in the frame based on the rendered intermediate frame to obtain the rendered picture of each XR glass.

[0109] Furthermore, the curtain in the virtual scene can be set to a concave arc shape, so that the parallax of each XR glasses is basically consistent, and only the ATW technology needs to be fine-tuned to eliminate the distortion of the rendered image.

[0110] It should be pointed out that although the various steps in the above embodiments are described in a specific order, those skilled in the art can understand that in order to achieve the effect of the present application, different steps do not have to be executed in such an order. They can be executed simultaneously (in parallel) or in other orders. These changes are within the scope of protection of the present application.

[0111] It is understood by those skilled in the art that all or part of the processes in the method for implementing the above-mentioned embodiment of the present application can also be completed by instructing the relevant hardware through a computer program, and the computer program can be stored in a computer-readable storage medium. When the computer program is executed by the processor, the steps of each of the above-mentioned method embodiments can be implemented. Among them, the computer program includes computer program code, and the computer program code can be in source code form, object code form, executable file or some intermediate form. The computer-readable storage medium may include: any entity or device, medium, U disk, mobile hard disk, disk, optical disk, computer memory, read-only memory, random access memory, electric carrier signal, telecommunication signal and software distribution medium that can carry the computer program code. It should be noted that the content contained in the computer-readable storage medium can be appropriately increased or decreased according to the requirements of legislation and patent practice in the jurisdiction. For example, in some jurisdictions, according to legislation and patent practice, computer-readable storage media do not include electric carrier signals and telecommunication signals.

[0112] Furthermore, the present application also provides a controller. In a controller embodiment according to the present application, the controller includes a second processor and a memory, the memory can be configured to store a program for executing the rendering screen generation method of the above method embodiment, and the processor can be configured to execute the program in the memory, which includes but is not limited to the program for executing the rendering screen generation method of the above method embodiment. For ease of explanation, only the parts related to the embodiment of the present application are shown. For specific technical details not disclosed, please refer to the method part of the embodiment of the present application. The controller can be a controller device formed by various electronic devices.

[0113] It should be noted that the first processor and the second processor in the present application may be the same processor or different processors. If the computing power of the first processor is sufficient, the first processor can also realize the functions of the second processor.

[0114] In an embodiment of the present application, the controller may be a controller device formed by various electronic devices. In some possible implementations, the controller may include multiple memories and multiple second processors. The program for executing the rendering screen generation method of the above-mentioned method embodiment can be divided into multiple subprograms, and each subprogram can be loaded and run by the second processor to execute different steps of the rendering screen generation method of the above-mentioned method embodiment. Specifically, each subprogram can be stored in different memories, respectively, and each second processor can be configured to execute programs in one or more memories to jointly implement the rendering screen generation method of the above-mentioned method embodiment, that is, each second processor executes different steps of the rendering screen generation method of the above-mentioned method embodiment, to jointly implement the rendering screen generation method of the above-mentioned method embodiment.

[0115] The plurality of second processors may be second processors deployed on the same device. For example, the controller may be a high-performance device composed of a plurality of second processors, and the plurality of second processors may be second processors configured on the high-performance device. In addition, the plurality of second processors may also be second processors deployed on different devices. For example, the controller may be a server cluster, and the plurality of second processors may be second processors on different servers in the server cluster.

[0116] Furthermore, the present application also provides a computer-readable storage medium. In a computer-readable storage medium embodiment according to the present application, the computer-readable storage medium may be configured to store a program for executing the rendering screen generation method of the above-mentioned method embodiment, and the program may be loaded and run by the processor to implement the above-mentioned rendering screen generation method. For ease of explanation, only the parts related to the embodiment of the present application are shown. For specific technical details not disclosed, please refer to the method part of the embodiment of the present application. The computer-readable storage medium may be a memory device formed by various electronic devices. Optionally, the computer-readable storage medium in the embodiment of the present application is a non-temporary computer-readable storage medium.

[0117] Furthermore, the present application also provides an extended reality device. In an extended reality device embodiment according to the present application, the extended reality device includes a first processor and a plurality of wearable devices, and a controller in a controller embodiment. The plurality of wearable devices are all in communication connection with the first processor.

[0118] In one implementation, the first processor may be a vehicle-mounted NBOX, and the vehicle-mounted NBOX may be communicatively connected with at least one electronic control unit of the vehicle.

[0119] Further, it should be understood that since the setting of each module is only for illustrating the functional units of the device of the present application, the physical devices corresponding to these modules may be the processor itself, or a part of the software in the processor, a part of the hardware, or a part of the combination of software and hardware. Therefore, the number of each module in the figure is only schematic.

[0120] It is understood by those skilled in the art that each module in the device can be adaptively split or merged. Such splitting or merging of specific modules will not cause the technical solution to deviate from the principle of the present application, and therefore, the technical solutions after splitting or merging will fall within the protection scope of the present application.

[0121] So far, the technical solutions of the present application have been described in conjunction with the preferred embodiments shown in the accompanying drawings. However, it is easy for those skilled in the art to understand that the protection scope of the present application is obviously not limited to these specific embodiments. Without departing from the principles of the present application, those skilled in the art can make equivalent changes or substitutions to the relevant technical features, and the technical solutions after these changes or substitutions will fall within the protection scope of the present application.

Claims

1. A method for generating a rendering image, characterized in that: The method is applied to a first processor, wherein the first processor is communicatively connected to a plurality of wearable devices; The multiple wearable devices correspond to the same virtual scene; the method comprises: Rendering the virtual scene through a main renderer of the first processor to obtain a rendered intermediate frame; the field of view of the rendered intermediate frame is greater than the field of view of a single wearable device; The rendered intermediate frame is sent to each wearable device connected to the first processor to generate a rendered image for the wearable device.

2. The rendering picture generation method according to claim 1, characterized in that: The step of rendering the virtual scene by the main renderer of the first processor to obtain a rendered intermediate frame includes: A plurality of virtual cameras are arranged in the virtual scene; the viewing angle of each virtual camera is different from the viewing angles of other virtual cameras; The virtual scene is rendered by the main renderer according to the contents of different perspectives captured by the virtual camera to obtain the rendered intermediate frame.

3. The rendering picture generation method according to claim 2, characterized in that: The obtaining of the rendered intermediate frame comprises: The virtual scene is rendered with a 180-degree field of view to obtain the rendered intermediate frame.

4. The method for generating a rendering image according to claim 2, wherein: The obtaining of the rendered intermediate frame comprises: Obtaining the field of view angle of the rendered intermediate frame according to the union of the field of view angles of the wearable device; Rendering is performed according to the field of view of the rendered intermediate frame to obtain the rendered intermediate frame.

5. The method for generating a rendering image according to any one of claims 1 to 4, characterized in that: The method further comprises: When the rendered picture is a movie viewing picture, the curtain in the virtual scene is set to a concave arc shape.

6. A rendering picture generation method, characterized in that: The method is applied to a wearable device, wherein the wearable device is communicatively connected to a first processor; the method comprises: Obtaining a rendering intermediate frame sent by the first processor; Based on the rendered intermediate frame and the orientation of the wearable device, a rendered picture of the wearable device is obtained.

7. The method for generating a rendering image according to claim 6, wherein: Before obtaining a rendering picture of the wearable device based on the rendering intermediate frame and the orientation of the wearable device, the method further includes: The rendered intermediate frame is stored in an input buffer of the wearable device.

8. The method for generating a rendering image according to claim 6, wherein: The obtaining of the rendering image of each wearable device includes: According to the orientation of the wearable device, asynchronous time warping is performed on the rendering intermediate frame to achieve frame interpolation of the rendering intermediate frame and obtain a rendering picture of the wearable device.

9. A controller comprising at least one second processor and at least one memory, wherein the memory is suitable for storing a plurality of program codes, characterized in that: The program code is suitable for being loaded and run by the second processor to execute the rendering picture generation method according to any one of claims 1 to 5.

10. A controller comprising at least one second processor and at least one memory, wherein the memory is suitable for storing a plurality of program codes, characterized in that: The program code is suitable for being loaded and run by the second processor to execute the rendering picture generation method according to any one of claims 6 to 8.

Images