Display control method, real-time rendering system and storage medium

Abstract

The embodiment of the invention provides a display control method, a real-time rendering system and a storage medium, is applied to the real-time rendering system, and relates to the technical field of film and television virtualization. The method comprises the following steps: processing current displacement data under the condition of receiving the current displacement data to obtain mobile data; the current displacement data is generated after the displacement detection system detects the displacement of the motion device, and the current displacement data is sent to the real-time rendering system. The obtained movement data is used for representing the movement degree of the movement device, and the display content of the frame image of the current frame in the display screen is adjusted according to the movement data, so that the display content of the frame image of the current frame is synchronized with the movement direction of the movement device. By adopting the technical scheme, the real scene linkage of the curtain wall and the rotary table can be realized, so that the requirement of shooting scene change can be met, and the purposes of creation freedom degree and shooting efficiency of virtual manufacturing can be realized.

Description

TECHNICAL FIELD

[0001] The embodiment of the present disclosure relates to the field of film and television virtual technology, and particularly relates to a display control method, a real-time rendering system and a storage medium. BACKGROUND

[0002] In film and television virtual production, in order to facilitate the entry and exit of personnel, the curtain wall is usually designed in an open manner. The curtain wall is fixed and used to display a virtual picture, and then a real scene is carried by a fixed table, and a camera is placed on the fixed table, and then the camera shoots the real scene of the table and the virtual scene of the curtain wall. This will cause a problem that, since the curtain wall and the table are fixed, the camera can only shoot part of the picture and the real scene composed of the table. In shooting a reverse shot, a traditional solution is generally to turn the whole real scene or to shoot by borrowing a position, however, the former is too time-consuming and laborious, and the latter affects the picture presentation effect. This restricts the creation freedom and shooting efficiency of virtual production.

[0003] Therefore, there is an urgent need for a display control method, which can make the curtain wall and the real scene of the turntable interact, and in the case of interaction between the curtain wall and the real scene of the turntable, since the display picture in the curtain wall is real-time changed with the turntable, the demand for shooting different scenes and different angles can be met, and the purpose of creation freedom and shooting efficiency of virtual production can be achieved. SUMMARY

[0004] In order to solve the above technical problems or at least partially solve the above technical problems, the embodiment of the present disclosure provides a display control method, a real-time rendering system and a storage medium.

[0005] The first aspect of the embodiment of the present disclosure provides a display control method, characterized in that the method is applied to a real-time rendering system, and the method comprises:

[0006] In the case of receiving current displacement data, the current displacement data is processed to obtain movement data; wherein the current displacement data is generated by a displacement detection system according to the displacement of a motion device detected, and the current displacement data is sent to the real-time rendering system; the displacement is generated in a physical position after the motion device moves; the movement data is used to represent the degree of motion of the motion device;

[0007] According to the movement data, the display content of the current frame picture frame image in the display screen is adjusted, so that the display content of the current frame picture frame image is synchronized with the motion direction of the motion device; wherein the display screen is fixedly arranged.

[0008] The second aspect of the embodiment of the present disclosure provides a real-time rendering system, which comprises:

[0009] The master server is configured to process the current displacement data to obtain movement data when the current displacement data is received, wherein the current displacement data is generated by a displacement detection system according to the displacement of the motion device, and the current displacement data is sent to the real-time rendering system; the displacement is generated in a physical position after the motion device moves; and the movement data is used to represent the degree of motion of the motion device.

[0010] The rendering node cluster is configured to adjust the display content of a current frame image in a display screen according to the movement data, so that the display content of the current frame image is synchronized with the motion direction of the motion device; and the display screen is fixedly arranged.

[0011] A third aspect of the embodiments of the present disclosure provides a computer readable storage medium, the storage medium storing a computer program, and when the computer program is executed by a processor, the method of the first aspect can be implemented.

[0012] The embodiments of the present disclosure provide a display control method applied to a real-time rendering system, the method comprising: processing current displacement data to obtain movement data when the current displacement data is received; the current displacement data is generated by a displacement detection system according to the displacement of a motion device, and the current displacement data is sent to the real-time rendering system. The movement data obtained above is used to represent the degree of motion of the motion device, and the display content of a current frame image in a display screen is adjusted according to the movement data, so that the display content of the current frame image is synchronized with the motion direction of the motion device. By using the technical solution, the real scene linkage of the curtain wall and the turntable can be realized, thereby meeting the demand of shooting different scenes and different angles, and realizing the purpose of virtual production creation freedom and shooting efficiency. BRIEF DESCRIPTION OF DRAWINGS

[0013] The accompanying drawings, which are incorporated into and form part of the specification, illustrate embodiments consistent with the present disclosure and, together with the specification, serve to explain the principles of the present disclosure.

[0014] In order to more clearly illustrate the technical solutions in the embodiments of the present disclosure or the prior art, the accompanying drawings needed to be used in the embodiments or prior art description will be briefly introduced. Obviously, for those skilled in the art, other drawings can also be obtained from these drawings without creative labor.

[0015] Figure 1a A schematic diagram of a shooting process of a related technology is shown;

[0016] Figure 1bA schematic diagram of a circular arc display screen is shown.

[0017] Figure 2 A schematic diagram of a linear display screen is shown.

[0018] Figure 3 A schematic diagram of a display control method is shown.

[0019] Figure 4 A schematic diagram of a display control method is shown.

[0020] Figure 5 A schematic diagram of a real-time rendering system is shown. DETAILED DESCRIPTION

[0021] In order to more clearly understand the above-mentioned purposes, features and advantages of the present disclosure, the solutions of the present disclosure will be further described below. It should be noted that the embodiments of the present disclosure and the features in the embodiments can be combined with each other without conflict.

[0022] In the following description, many specific details are set forth in order to provide a thorough understanding of the present disclosure, but the present disclosure can also be implemented in other ways different from those described herein; obviously, the embodiments in the description are only some of the embodiments of the present disclosure, not all the embodiments.

[0023] In virtual production of films and television, the curtain wall is usually designed in a circular arc shape, and can also be designed in a linear shape. In the related art, since the display screen is fixed, the table carrying the real scene is also fixed, and therefore, when shooting, only the combination of the display screen and the real scene can be shot, that is, only part of the scene can be shot. For details, see Figure 1a A schematic diagram of a shooting process of a related art is shown. From Figure 1a It can be seen that the camera can only shoot part of the area, and the real scene area selected by the rectangular frame cannot be shot. Therefore, in order to be able to shoot the real scene carried on the table, the table carrying the real scene needs to be rotated. However, when the table is rotated, the picture in the display screen also needs to be changed, and therefore, a method is needed to make the real scene carried by the table and the picture in the display screen synchronous, otherwise the scene will appear disordered.

[0024] Figure 1b A schematic diagram of a circular arc display screen is shown. The view angle of the camera is within the range of the display screen, and the picture displayed by the display screen can be normally shot. Since the running device carries the real scene, the picture displayed by the display screen is also changing, and therefore, with the change of the running device and the content displayed by the display screen, the shooting area of the camera is also changing, and therefore, the shooting of multiple angles and multiple scenes can be met.Figure 2 A schematic diagram of a linear display screen is shown. From Figure 2 It can be seen that the linear motion device is variable, and the content displayed by the display screen is also variable, and then the shooting area of the camera is also variable along with the changes of the motion device and the content displayed by the display screen.

[0025] Therefore, for the synchronous changes of the motion device and the content displayed by the display screen, a display control method is provided in the embodiment. Specifically, refer to Figure 3 Figure 3 A flowchart of a display control method provided by the embodiment of the present disclosure is shown. The method is applied to a real-time rendering system, and the method comprises the following steps:

[0026] S301, in the case of receiving current displacement data, processing the current displacement data to obtain movement data; wherein the current displacement data is generated by a displacement detection system according to the displacement of the motion device detected, and the current displacement data is sent to the real-time rendering system; the displacement is generated in the physical position after the motion device moves; the movement data is used to represent the degree of motion of the motion device.

[0027] In one example, if the motion device is annular, the current displacement data is angular displacement data; if the motion device is rectangular, the current displacement data is linear displacement data.

[0028] In one example, the motion device is equipped with a real scene.

[0029] In the embodiment, the current displacement data can be angular displacement data or linear displacement data. Specifically, the motion device moves to generate displacement in the physical position, and then the displacement detection system detects the displacement and generates the current displacement data according to the displacement, and then the displacement detection system sends the current displacement data to the real-time rendering system. After the real-time rendering system receives the current displacement data, the current displacement data is processed to obtain movement data, which is used to describe the degree of motion of the motion device.

[0030] S302, adjusting the display content of the current frame picture frame image in the display screen according to the movement data, so that the display content of the current frame picture frame image is synchronized with the motion direction of the motion device; wherein the display screen is fixedly arranged.

[0031] ​In one example, since the movement data can describe the extent of the motion device motion, it is equivalent to adjusting the display content of the current frame picture frame image in the display screen through the extent of the motion device motion, and further making the display content of the current frame picture frame image synchronized with the motion direction and speed of the motion device. In the embodiment, since the display screen is fixedly arranged, by adjusting the display content of the current frame picture frame image of the display screen, the content displayed by the display screen is synchronized with the motion device, and the synchronous rotation of the real scene and the display content of the current frame picture frame image is realized.

[0032] The display control method provided by the embodiment of the present disclosure is applied to a real-time rendering system, and the method comprises: processing current displacement data to obtain movement data when the current displacement data is received; the current displacement data is generated by a displacement detection system according to the displacement of a motion device detected by the displacement detection system, and the current displacement data is sent to the real-time rendering system. The movement data obtained above is used to represent the extent of the motion device motion, and the display content of the current frame picture frame image in the display screen is adjusted according to the movement data, so that the display content of the current frame picture frame image is synchronized with the motion direction of the motion device. By adopting the technical solution, since the display content of the current frame picture frame image is synchronized with the motion of the motion device, the real scene of the motion device and the real scene of the motion device can be linked. When the real scene carried by the motion device and the picture displayed by the display screen are both moved, a scene composed of the real scene at different angles and the corresponding display picture can be photographed, and the demand for photographing different scenes and different angles can be met, and the purpose of creating freedom and photographing efficiency of virtual production can be achieved.

[0033] Figure 4 A flowchart of a display control method provided by an embodiment of the present disclosure is shown. The method is applied to a real-time rendering system, and the method comprises:

[0034] S401, determining an average displacement speed based on the current displacement data, the last displacement data and the standard time length; wherein the last displacement data is displacement data generated by the motion device in a physical position in a last standard time length; and the standard time length is a movement period of the motion device set in advance.

[0035] In one example, in order to compare clearly, it is assumed that the current displacement data is a0, the last displacement data is a n , and the standard time length is array_t, which is a movement period of the motion device set in advance.

[0036] In the embodiment, in the initialization stage, the target smooth window number sequence length is set as n, and n is a positive integer. The displacement data buffer sequence array_a is set as an empty sequence, and the sequence length is 0. The standard time length sequence array_t is set as an empty sequence, and the sequence length is 0.

[0037] If the lengths of array_a and array_t are equal to n:

[0038] Let a1=a0, a2=a1,..., a n-1 =a n-2 , a n =a n-1 , and array_a is [a1, a2, a3,..., a n ].

[0039] Let t1=t0, t2=t1,..., t n-1 =t n-2 , t n =t n-1 , and array_t is [t1, t2, t3,..., t n ].

[0040] In the ∑array_t time period, the average displacement speed

[0041] S402, adjust the average displacement speed based on the speed correction amount to obtain a corrected displacement speed; wherein the speed correction amount is determined by the current displacement data and the predicted displacement data of the current frame image.

[0042] In one example, the speed correction amount is used to adjust the situation that the display content of the current frame image cannot match the motion device due to sudden acceleration or sudden deceleration of the motion device.

[0043] In one example, the speed correction amount is determined by the current displacement data and the predicted displacement data of the current frame image, including:

[0044] The speed correction amount is determined by the difference between the current displacement data and the predicted displacement data of the current frame image.

[0045] In one example, in order to compare clearly, set the predicted displacement data of the current frame image as f, the corrected displacement speed as v', the speed correction amount as z, and the current displacement data as a0, then v'=v+z, z=a0-f.

[0046] In one example, the predicted displacement data of the current frame image is determined by the average displacement speed, the frame change duration, and the displacement data of the previous frame image.

[0047] In one example, the average displacement speed is v, the frame change duration is t1, and the displacement data of the previous frame image is a, then f=a+v·t1, and v'=v+a0-(a+v·t1).

[0048] S403, generating displacement data of the current frame picture frame image according to the corrected displacement velocity, the frame change duration and the displacement data of the previous frame picture frame image; wherein the displacement data of the current frame picture frame image is equal to the movement data; and the frame change duration is a duration from displaying the previous frame picture frame image to displaying the current frame picture frame image.

[0049] In one example, the displacement data of the current frame picture frame image is a', the frame change duration is t1, and the displacement data of the previous frame picture frame image is a, then a' = a + v' t1.

[0050] S404, adjusting display content of the current frame picture frame image in the display screen according to the displacement data of the current frame picture frame image, so as to synchronize the display content of the current frame picture frame image with the movement direction of the movement device; wherein the display screen is fixedly arranged.

[0051] In one example, adjusting the display content of the current frame picture frame image in the display screen according to the displacement data of the current frame picture frame image comprises:

[0052] rendering an extrinsic frustum picture according to the displacement data of the current frame picture frame image, a position of an extrinsic frustum viewpoint and a shape, size, position and orientation of a virtual screen; wherein the virtual screen is configured in the real-time rendering system; and the virtual screen is used to simulate the display screen.

[0053] rendering an intrinsic frustum picture according to a position of a camera viewpoint, a relative position between the camera and the virtual screen.

[0054] generating the display content of the current frame picture frame image according to the extrinsic frustum picture and the intrinsic frustum picture.

[0055] In a rendering node cluster of the real-time rendering system, relevant data of a virtual scene is stored. In the virtual scene, a virtual screen is placed, which is a 1:1 modeling virtual screen with the same shape, size, curvature and other parameters as the display screen. When each frame is rendered by the rendering node, the following processes are performed:

[0056] rendering an extrinsic frustum picture according to the displacement data of the current frame picture frame image, a position of an extrinsic frustum viewpoint and a shape, size, position and orientation of a virtual screen; wherein the virtual screen is configured in the real-time rendering system; and the virtual screen is used to simulate the display screen.

[0057] rendering an intrinsic frustum picture according to a position of a camera viewpoint, a relative position between the camera and the virtual screen.

[0058] generating the display content of the current frame picture frame image according to the extrinsic frustum picture and the intrinsic frustum picture.

[0059] So when the virtual screen rotates, the rendering node renders the content of the outer view frustum picture and the inner view frustum picture according to the new screen angle, at which time the virtual scene rotation occurs in the display screen.

[0060] The rotation center of the virtual screen in the embodiment is the rotation center of the motion device. In this way, it can be ensured that the virtual scene in the display screen rotates synchronously when the real scene turntable rotates, and no position difference occurs.

[0061] S405, send the display content of the current frame picture frame image to the display screen; the display screen is configured to receive the display content of the current frame picture frame image and display the same.

[0062] In one example, the display screen displays the display content of the current frame picture frame image after receiving the same.

[0063] The display control method provided by the embodiment of the present disclosure is applied to a real-time rendering system, and the method comprises the following steps: determining an average displacement speed based on current displacement data, previous displacement data and a standard time length, adjusting the average displacement speed based on a speed correction amount to obtain a corrected displacement speed, and generating displacement data of a current frame picture frame image according to the corrected displacement speed, a frame change time length and displacement data of a previous frame picture frame image. The display content of the current frame picture frame image in the display screen is adjusted according to the displacement data of the current frame picture frame image. According to the technical solution, the main control server of the rendering system dynamically corrects the virtual scene motion parameters according to the feedback data, and the synchronous motion of the virtual scene and the real scene is realized.

[0064] Figure 5 is a structural schematic diagram of a real-time rendering system provided by the embodiment of the present disclosure. As shown in the figure, the real-time rendering system 50 comprises: Figure 5

[0065] The main control server 501 is configured to process the current displacement data to obtain movement data when the current displacement data is received; wherein the current displacement data is generated by the displacement detection system according to the displacement of the motion device detected, and the current displacement data is sent to the real-time rendering system; the displacement is generated in the physical position after the motion device moves; and the movement data is used to represent the degree of motion of the motion device.

[0066] The rendering node cluster 502 is configured to adjust the display content of the current frame picture frame image in the display screen according to the movement data, so that the display content of the current frame picture frame image is synchronized with the motion direction of the motion device; wherein the display screen is fixedly arranged.

[0067] In one example, the main control server 501 is configured to:

[0068] ​determine an average displacement speed based on the current displacement data, previous displacement data and a standard time length, wherein the previous displacement data is displacement data generated by the motion device in a physical position in a previous standard time length, and the standard time length is a moving period of the motion device preset in advance;

[0069] adjust the average displacement speed based on the speed correction amount to obtain a corrected displacement speed, wherein the speed correction amount is determined by the current displacement data and predicted displacement data of the current frame image of the frame;

[0070] generate displacement data of the current frame image of the frame based on the corrected displacement speed, the frame change time length and displacement data of a previous frame image of the frame, wherein the displacement data of the current frame image of the frame is equal to the movement data, and the frame change time length is a time length for the display screen to display the previous frame image of the frame to the current frame image of the frame.

[0071] In one example, the speed correction amount is determined by the current displacement data and predicted displacement data of the current frame image of the frame, comprising:

[0072] The speed correction amount is determined by a difference between the current displacement data and the predicted displacement data of the current frame image of the frame.

[0073] In one example, the predicted displacement data of the current frame image of the frame is determined by the average displacement speed, the frame change time length and the displacement data of the previous frame image of the frame.

[0074] In one example, the rendering node cluster 502 is configured to adjust display content of the current frame image of the frame in the display screen according to the displacement data of the current frame image of the frame.

[0075] In one example, the rendering node cluster 502 is configured to:

[0076] render an extraneous view frustum image according to the displacement data of the current frame image of the frame, a position of a view frustum point and a shape, size, position and orientation of a virtual screen, wherein the virtual screen is configured in a real-time rendering system, and the virtual screen is used to simulate the display screen;

[0077] render an internal view frustum image according to a camera view point position and a relative position between the camera and the virtual screen;

[0078] generate the display content of the current frame image of the frame according to the extraneous view frustum image and the internal view frustum image.

[0079] In one example, the master server 501 is configured to: send the display content of the current frame image of the frame to the display screen, and the display screen is configured to receive and display the display content of the current frame image of the frame.

[0080] In one example, the real-time rendering system 50 comprises: if the motion device is ring-shaped, the current displacement data is angular displacement data; if the motion device is rectangular, the current displacement data is linear displacement data.

[0081] The real-time rendering system provided by the embodiment can execute the method of any of the above embodiments, and has similar implementation manners and beneficial effects, which will not be described here again.

[0082] It should be noted that the computer readable medium described above in the disclosure can be a computer readable signal medium or a computer readable storage medium or any combination of the two. The computer readable storage medium may, for example, but is not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or component, or any combination of the above. More specific examples of computer readable storage media can include, but are not limited to, an electrical connection having one or more wires, a portable computer diskette, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In the disclosure, the computer readable storage medium can be any tangible medium containing or storing a program that can be used by or in conjunction with an instruction execution system, device or component. In the disclosure, the computer readable signal medium can include a data signal carried in a baseband or as a part of a carrier wave, which carries computer readable program code. Such a propagated data signal can take various forms, including but not limited to an electromagnetic signal, an optical signal or any suitable combination of the above. The computer readable signal medium can also be any computer readable medium other than the computer readable storage medium, which can send, propagate or transmit a program for use by or in conjunction with an instruction execution system, device or component. The program code contained in the computer readable medium can be transmitted by any suitable medium, including but not limited to a wire, a cable, an RF (radio frequency) or the like, or any suitable combination of the above.

[0083] In some embodiments, the client, server can communicate using any currently known or future developed network protocol, such as HTTP (HyperText Transfer Protocol), and can be interconnected with any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include local area networks ("LANs"), wide area networks ("WANs"), the Internet, and peer-to-peer networks (e.g., ad hoc peer-to-peer networks), as well as any currently known or future developed networks.

[0084] The computer readable medium described above can be included in the electronic device described above; alternatively, the computer readable medium can exist as a separate entity, which is not incorporated in the electronic device.

[0085] Computer program code for carrying out operations of the present disclosure can be written in any of one or more programming languages, including object oriented programming languages such as Java, Smalltalk, C++ or the like, conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code can execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the latter scenario, the remote computer can be connected to the user's computer through any type of network, including a local area network (LAN) or a wide area network (WAN), or the connection can be made to an external computer (for example, through the Internet using an Internet Service Provider).

[0086] The flow diagrams and the block diagrams in the drawings are illustrations of architectures, functionalities, and operations of possible implementations of systems, methods, and computer program products according to various embodiments of the present disclosure. In this regard, each block in the flow diagrams or block diagrams can represent a module, a segment, or a portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that in some alternative implementations, the functions noted in the block can occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently or the blocks may

[0087] The units described in the embodiments of the present disclosure can be implemented by hardware, software, or a combination thereof. In some cases, the names of the units do not constitute a limitation on the units themselves.

[0088] The functions described in this description above can be implemented in part or in whole by one or more hardware logic components. For example, and without limitation, illustrative types of hardware logic components that can be used include Field-programmable Gate Arrays (FPGAs), Program-specific Integrated Circuits (ASICs), Program-specific Standard Products (ASSPs), System-on-a-chip systems (SOCs), Complex Programmable Logic Devices (CPLDs), etc.

[0089] In the context of this disclosure, a machine-readable medium can be a tangible medium that contains or stores a program for use by or in connection with an instruction execution system, apparatus, or device. The machine-readable medium can be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium can include but is not limited to an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any suitable combination of the foregoing. More specific examples of the machine-readable storage medium would include a lined- up electrical connection, a portable computer diskette, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or Flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

[0090] The embodiments of the present disclosure further provide a computer readable storage medium, and the computer program is stored in the storage medium. When the computer program is executed by a processor, the method of any of the above embodiments can be implemented, and the execution manner and beneficial effects are similar, which will not be repeated here.

[0091] It should be noted that, in this document, relational terms such as "first" and "second", and the like can be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Moreover, the terms "comprises", "comprising", or any other variations thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but can include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without more limitations, an element defined by the statement "comprising a" does not exclude the existence of additional identical elements in the process, method, article, or apparatus that includes the element.

[0092] The above merely provides specific embodiments of the present disclosure, enabling those skilled in the art to understand or implement the present disclosure. Various modifications to these embodiments will be apparent to those skilled in the art, and the general principles defined herein can be implemented in other embodiments without departing from the spirit or scope of the present disclosure. Therefore, the present disclosure will not be limited to these embodiments herein, but will conform to the widest scope consistent with the principles and novel features disclosed herein.

Claims

1. A display control method characterized by comprising: Applied to a real-time rendering system, the method comprises: In the case of receiving current displacement data, the current displacement data is processed to obtain movement data; wherein the current displacement data is generated by the displacement detection system according to the displacement of the motion device detected, and the current displacement data is sent to the real-time rendering system; the displacement is generated in the physical position after the motion device moves; the movement data is used to represent the degree of motion of the motion device; According to the movement data, the display content of the current frame picture frame image in the display screen is adjusted, so that the display content of the current frame picture frame image is synchronized with the motion direction of the motion device; wherein the display screen is fixedly arranged.

2. The method of claim 1, wherein, The current displacement data is processed to obtain movement data, including: Based on the current displacement data, the last displacement data and the standard time length, the average displacement speed is determined; wherein the last displacement data is the displacement data generated in the physical position by the motion device in the last standard time length; the standard time length is the moving period of the motion device set in advance; Based on the speed correction amount, the average displacement speed is adjusted to obtain the corrected displacement speed; wherein the speed correction amount is determined by the current displacement data and the predicted displacement data of the current frame picture frame image; According to the corrected displacement speed, the frame change time length and the displacement data of the last frame picture frame image, the displacement data of the current frame picture frame image is generated; wherein the displacement data of the current frame picture frame image is equal to the movement data; the frame change time length is the time length from displaying the last frame picture frame image to displaying the current frame picture frame image in the display screen.

3. The method of claim 2, wherein, The speed correction amount is determined by the difference between the current displacement data and the predicted displacement data of the current frame picture frame image. The predicted displacement data of the current frame picture frame image is determined by the average displacement speed, the frame change time length and the displacement data of the last frame picture frame image.

4. The method of claim 3, wherein, According to the movement data, the display content of the picture frame image in the display screen is adjusted, including:

5. The method of claim 2, wherein, According to the displacement data of the current frame picture frame image, the display content of the current frame picture frame image in the display screen is adjusted. According to the displacement data of the current frame picture frame image, the display content of the current frame picture frame image in the display screen is adjusted, including:

6. The method of claim 5, wherein, According to the displacement data of the current frame picture frame image, the shape, size, position and orientation of the virtual screen, the outer view cone view is rendered; wherein the virtual screen is configured in the real-time rendering system; the virtual screen is used to simulate the display screen; According to the camera viewpoint position, the relative position of the camera and the virtual screen, the inner view cone view is rendered; According to the outer view cone view and the inner view cone view, the display content of the current frame picture frame image is generated. After adjusting the display content of the current frame picture frame image in the display screen according to the displacement data of the current frame picture frame image, the method further comprises:

7. The method of claim 5, wherein, ​ The display content of the current frame picture frame image is sent to the display screen; the display screen is configured to receive the display content of the current frame picture frame image and display the same.

8. The method of claim 1, wherein, The method further comprises: If the motion device is ring-shaped, the current displacement data is angular displacement data; If the motion device is rectangular, the current displacement data is linear displacement data.

9. A real-time rendering system, characterized in that The system comprises: A master server configured to, upon receiving current displacement data, process the current displacement data to obtain movement data; wherein the current displacement data is generated by a displacement detection system according to a detected displacement of a motion device, and the current displacement data is sent to the real-time rendering system; the displacement is generated in a physical position after the motion device moves; the movement data is configured to represent a degree of motion of the motion device; A rendering node cluster configured to adjust display content of a current frame picture frame image in a display screen according to the movement data, so that the display content of the current frame picture frame image is synchronized with a motion direction of the motion device; wherein the display screen is fixedly arranged.

10. A computer-readable storage medium, characterized in that, The storage medium has a computer program stored therein, and when the computer program is executed by a processor, the method according to any one of claims 1-8 is implemented.

Images