Picture display method and apparatus, device, storage medium, and program product

Abstract

The present application relates to a picture display method and apparatus, a device, a storage medium, and a program product. The method comprises: on the basis of motion sensing data collected by a cloud virtual reality (VR) terminal in the initial stage of motion, performing prediction processing on the motion of the cloud VR terminal to obtain predicted motion data; and controlling a display apparatus of the cloud VR terminal to display a target cloud VR picture determined on the basis of the predicted motion data. The method can avoid the problem of picture freezing to a certain extent.

Description

Screen display method, device, equipment, storage medium and program product

[0001] This application claims priority to the Chinese patent application filed with the China Patent Office on September 28, 2023, with application number 202311283951X, and application name “Screen display method, device, equipment, storage medium and program product”, all contents of which are incorporated by reference into this application. Technical Field

[0002] The present application relates to the field of virtual reality technology, and in particular to a screen display method, apparatus, device, storage medium, and program product. Background Art

[0003] Currently, the combination of VR (Virtual Reality) technology and cloud services has gained widespread application. Generally speaking, this combination of VR technology and cloud services is referred to as cloud VR. In cloud VR, a cloud server can obtain cloud VR images and send them to a cloud VR terminal, which then displays the cloud VR content based on the cloud VR images.

[0004] However, in cloud VR terminals, screen freezes often occur. Currently, how to solve this problem has become an urgent issue to be solved.

[0005] Summary of the Invention

[0006] Based on this, it is necessary to provide a screen display method, device, equipment, storage medium and program product that can avoid screen freeze problems to a certain extent in response to the above technical problems.

[0007] In a first aspect, the present application provides a method for displaying a picture in a cloud VR terminal, the method comprising:

[0008] Based on the motion sensor data collected by the cloud virtual reality VR terminal in the initial stage of movement, the movement of the cloud VR terminal is predicted and processed to obtain predicted motion data; and the display device of the cloud VR terminal is controlled to display the target cloud VR picture determined based on the predicted motion data.

[0009] In one embodiment, controlling the display device of the cloud VR terminal to display a target cloud VR screen determined based on the predicted motion data includes: determining screen offset data based on the predicted motion data, wherein the screen offset data is used to characterize the offset of the cloud VR screen caused by the motion predicted by the cloud VR terminal; sending the screen offset data to a cloud server to instruct the cloud server to adjust the current screen capture range based on the screen offset data, and intercepting and processing the original cloud VR image based on the adjusted screen capture range to obtain and return a first cloud VR image, so that the cloud VR terminal can display the target cloud VR screen on the display device based on the first cloud VR image.

[0010] In one embodiment, determining the picture offset data based on the predicted motion data includes: converting the predicted motion data from the coordinate system corresponding to the cloud VR terminal to the image coordinate system corresponding to the original cloud VR image to obtain the picture offset data.

[0011] In one of the embodiments, the method further includes: when it is determined based on the picture offset data that the movement of the cloud VR terminal is caused by unconscious movement of the user, not performing picture adjustment processing.

[0012] In one of the embodiments, the method further includes: when it is determined according to the picture offset data that the offset of the cloud VR picture is less than a first offset threshold, determining that the movement of the cloud VR terminal is caused by unconscious movement of the user.

[0013] In one embodiment, the method further includes: when it is determined according to the picture offset data that the movement of the cloud VR terminal is not caused by unconscious movement of the user, determining according to the picture offset data whether the offset of the cloud VR picture is greater than a second offset threshold; when it is determined according to the picture offset data that the offset of the cloud VR picture is greater than the second offset threshold, executing the step of sending the picture offset data to the cloud server.

[0014] In one of the embodiments, the method further includes: when it is determined based on the picture offset data that the offset of the cloud VR picture is less than or equal to the second offset threshold, not executing the step of sending the picture offset data to the cloud server.

[0015] In one embodiment, the display device includes a first display screen corresponding to the left eye and a second display screen corresponding to the right eye, and the method further includes: without executing the step of sending the picture offset data to the cloud server, receiving a second cloud VR image obtained by the cloud server intercepting and processing the original cloud VR image based on the current screen capture range; determining the target cloud VR picture according to the second cloud VR image, wherein the target cloud VR picture includes a first left-eye cloud VR picture and a first right-eye cloud VR picture; displaying the first left-eye cloud VR picture on the first display screen, and displaying the first right-eye cloud VR picture on the second display screen.

[0016] In one embodiment, determining the target cloud VR picture according to the second cloud VR image includes: determining the target cloud VR picture according to the second cloud VR image and the picture offset data.

[0017] In one embodiment, the display device includes a first display screen corresponding to the left eye and a second display screen corresponding to the right eye, and the method further includes: determining the target cloud VR picture based on the first cloud VR image, wherein the target cloud VR picture includes a second left-eye cloud VR picture and a second right-eye cloud VR picture; displaying the second left-eye cloud VR picture on the first display screen, and displaying the second right-eye cloud VR picture on the second display screen.

[0018] In one embodiment, based on the motion sensor data collected by the cloud virtual reality (VR) terminal in the initial stage of movement, the movement of the cloud VR terminal is predicted and processed to obtain predicted motion data, including: inputting the motion sensor data into a pre-trained motion prediction model to predict the movement of the cloud VR terminal using the motion prediction model; and obtaining the predicted motion data based on the output of the motion prediction model.

[0019] In one embodiment, the method further includes: obtaining real motion data of the cloud VR terminal after the cloud VR terminal finishes moving; and optimizing the motion prediction model according to the real motion data.

[0020] In one embodiment, the motion prediction model is tuned according to the real motion data, including: when the gap between the real motion data and the predicted motion data is greater than a preset gap threshold, the motion prediction model is tuned according to the real motion data.

[0021] In one embodiment, the initial stage of the movement includes: a preset time period after the cloud VR terminal is detected to start moving.

[0022] In one embodiment, the preset duration is less than or equal to 5 milliseconds.

[0023] In a second aspect, a screen display method is provided, the method comprising:

[0024] Receive picture offset data, wherein the picture offset data is obtained based on the predicted motion data obtained after predicting the motion of the cloud VR terminal based on motion sensor data collected by the cloud VR terminal in the initial stage of the motion, and the picture offset data is used to characterize the offset of the cloud VR picture caused by the motion predicted by the cloud VR terminal; adjust the current screen capture range according to the picture offset data, and intercept the original cloud VR image according to the adjusted screen capture range to obtain and return a first cloud VR image, so that the cloud VR terminal can display the target cloud VR picture on the display device according to the first cloud VR image.

[0025] In one embodiment, the current screen capture range is adjusted according to the screen offset data, and the original cloud VR image is intercepted according to the adjusted screen capture range, including: adjusting the screen center point corresponding to the current screen capture range according to the screen offset data; and intercepting the original cloud VR image based on the adjusted screen center point and the screen interception size.

[0026] In one embodiment, the screen capture size is determined according to the screen display range of the cloud VR terminal.

[0027] In a third aspect, the present application further provides a screen display device for a cloud VR terminal, the device comprising:

[0028] A prediction module is used to predict the movement of the cloud virtual reality (VR) terminal based on the motion sensor data collected by the cloud VR terminal in the early stage of movement to obtain predicted motion data;

[0029] A control module is used to control the display device of the cloud VR terminal to display the target cloud VR picture determined based on the predicted motion data.

[0030] In one embodiment, the control module is specifically used to: determine picture offset data based on the predicted motion data, where the picture offset data is used to characterize the offset of the cloud VR picture caused by the motion predicted by the cloud VR terminal; send the picture offset data to the cloud server to instruct the cloud server to adjust the current screen capture range according to the picture offset data, and intercept and process the original cloud VR image according to the adjusted screen capture range to obtain and return a first cloud VR image, so that the cloud VR terminal can display the target cloud VR picture on the display device according to the first cloud VR image.

[0031] In one embodiment, the control module is specifically configured to convert the predicted motion data from a coordinate system corresponding to the cloud VR terminal to an image coordinate system corresponding to the original cloud VR image to obtain the image offset data.

[0032] In one embodiment, the control module is further configured to: when it is determined based on the picture offset data that the movement of the cloud VR terminal is caused by unconscious movement of the user, not perform picture adjustment processing.

[0033] In one embodiment, the control module is further configured to: when it is determined based on the screen offset data that the offset of the cloud VR screen is less than a first offset threshold, determine that the movement of the cloud VR terminal is caused by unconscious movement of the user.

[0034] In one embodiment, the control module is further used to: when it is determined according to the picture offset data that the movement of the cloud VR terminal is not caused by unconscious movement of the user, determine according to the picture offset data whether the offset of the cloud VR picture is greater than a second offset threshold; when it is determined according to the picture offset data that the offset of the cloud VR picture is greater than the second offset threshold, execute the step of sending the picture offset data to the cloud server.

[0035] In one embodiment, the control module is further configured to: when it is determined based on the picture offset data that the offset of the cloud VR picture is less than or equal to the second offset threshold, not execute the step of sending the picture offset data to the cloud server.

[0036] In one embodiment, the display device includes a first display screen corresponding to the left eye and a second display screen corresponding to the right eye, and the control module is specifically configured to: receive a second cloud VR image obtained by the cloud server intercepting and processing the original cloud VR image based on the current screen capture range without executing the step of sending the picture offset data to the cloud server; determine the target cloud VR picture based on the second cloud VR image, wherein the target cloud VR picture includes a first left-eye cloud VR picture and a first right-eye cloud VR picture; display the first left-eye cloud VR picture on the first display screen, and display the first right-eye cloud VR picture on the second display screen.

[0037] In one embodiment, the control module is specifically configured to determine the target cloud VR image based on the second cloud VR image and the image offset data.

[0038] In one embodiment, the display device includes a first display screen corresponding to the left eye and a second display screen corresponding to the right eye, and the control module is specifically used to: determine the target cloud VR picture based on the first cloud VR image, wherein the target cloud VR picture includes a second left-eye cloud VR picture and a second right-eye cloud VR picture; display the second left-eye cloud VR picture on the first display screen, and display the second right-eye cloud VR picture on the second display screen.

[0039] In one embodiment, the prediction module is specifically used to: input the motion sensing data into a pre-trained motion prediction model to use the motion prediction model to predict the motion of the cloud VR terminal; and obtain the predicted motion data based on the output of the motion prediction model.

[0040] In one embodiment, the prediction module is further used to: obtain real motion data of the cloud VR terminal after the cloud VR terminal finishes moving; and tune the motion prediction model according to the real motion data.

[0041] In one embodiment, the prediction module is further configured to: when a gap between the actual motion data and the predicted motion data is greater than a preset gap threshold, perform tuning processing on the motion prediction model according to the actual motion data.

[0042] In one embodiment, the initial stage of the movement includes: a preset time period after the cloud VR terminal is detected to start moving.

[0043] In one embodiment, the preset duration is less than or equal to 5 milliseconds.

[0044] In a fourth aspect, the present application further provides a screen display device, comprising:

[0045] a receiving module, configured to receive screen offset data, wherein the screen offset data is obtained by predicting the motion of the cloud VR terminal based on motion sensor data collected by the cloud VR terminal in an early stage of motion, and the predicted motion data is obtained based on the predicted motion data, and the screen offset data is used to represent the offset of the cloud VR screen caused by the predicted motion of the cloud VR terminal;

[0046] The interception module is used to adjust the current screen capture range according to the screen offset data, and intercept the original cloud VR image according to the adjusted screen capture range to obtain and return a first cloud VR image, so that the cloud VR terminal can display the target cloud VR image on the display device according to the first cloud VR image.

[0047] In one embodiment, the capture module is specifically used to: adjust the picture center point corresponding to the current screen capture range according to the picture offset data; and capture the original cloud VR image based on the adjusted picture center point and the picture capture size.

[0048] In one embodiment, the screen capture size is determined according to the screen display range of the cloud VR terminal.

[0049] In a fifth aspect, the present application further provides a computer device. The computer device includes a memory and a processor, the memory stores a computer program, and the processor implements any of the steps described in the first aspect or any of the steps described in the second aspect when executing the computer program.

[0050] In a sixth aspect, the present application further provides a computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, implements any of the steps described in the first aspect or any of the steps described in the second aspect.

[0051] In a seventh aspect, the present application further provides a computer program product, comprising a computer program that, when executed by a processor, implements any of the steps described in the first aspect or any of the steps described in the second aspect.

[0052] The above-mentioned screen display method, device, equipment, storage medium and program product collect motion sensor data in the initial stage of the cloud VR terminal movement, and predict the movement of the cloud VR terminal based on the motion sensor data to obtain predicted motion data, and then control the display device of the cloud VR terminal to display the target cloud VR screen determined based on the predicted motion data. In this way, when the cloud VR terminal moves, it is not necessary to wait until the cloud VR terminal movement ends before obtaining the cloud VR screen based on the motion data of the cloud VR terminal, and then the cloud VR screen is displayed by the display device of the cloud VR terminal. Instead, at the initial stage of the cloud VR terminal movement, the movement of the cloud VR terminal is predicted based on the collected motion sensor data, and then the target cloud VR screen is determined based on the predicted motion data, and then the target cloud VR screen is displayed by the display device of the cloud VR terminal. Therefore, the display delay of the cloud VR screen can be greatly reduced, thereby avoiding screen freeze to a certain extent. BRIEF DESCRIPTION OF THE DRAWINGS

[0053] FIG1 is a diagram showing an application environment of a screen display method according to an embodiment;

[0054] FIG2 is a diagram showing an application environment of a screen display method according to an embodiment;

[0055] FIG3 is a schematic flow chart of a screen display method in one embodiment;

[0056] FIG4 is a schematic flow chart of a screen display method in one embodiment;

[0057] FIG5 is a schematic flow chart of a screen display method in one embodiment;

[0058] FIG6 is a schematic flow chart of a screen display method in one embodiment;

[0059] FIG7 is a schematic flow chart of a screen display method in one embodiment;

[0060] FIG8 is a schematic flow chart of a screen display method in one embodiment;

[0061] FIG9 is a schematic flow chart of a screen display method in one embodiment;

[0062] FIG10 is a structural block diagram of a picture display device according to an embodiment;

[0063] FIG11 is a structural block diagram of a picture display device according to an embodiment;

[0064] FIG12 is a diagram showing the internal structure of a computer device in one embodiment.

[0065] FIG13 is a diagram showing the internal structure of a computer device in one embodiment. DETAILED DESCRIPTION

[0066] In order to make the purpose, technical solutions and advantages of this application more clear, the following further describes this application in detail with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain this application and are not intended to limit this application.

[0067] At present, the combination of VR technology and cloud services has been widely used. Generally speaking, the combination of VR technology and cloud services can be called cloud VR. At present, cloud VR technology has been widely used in animation, games and other applications.

[0068] In cloud VR technology, cloud VR images are generally obtained by a cloud server, and after encoding and streaming, the cloud VR images are sent to a cloud VR terminal so that the cloud VR terminal can display the cloud VR screen based on the cloud VR images.

[0069] In actual applications, in order to provide users with an immersive experience, generally speaking, the cloud VR image displayed by the cloud VR terminal must change with the movement of the cloud VR terminal. For example, if the user wearing the cloud VR terminal turns his head to the left, the cloud VR terminal will move with the user's head movement. At this time, the cloud VR image displayed by the cloud VR terminal needs to be offset accordingly to match the user's field of view after turning his head to the left.

[0070] Typically, after a cloud VR terminal completes an exercise, it sends its motion data to the cloud server. Based on the motion data, the cloud server retrieves the cloud VR image to be sent to the cloud VR terminal, which then displays the cloud VR image. Throughout this process, the cloud VR image display latency includes: 1. The motion latency of the cloud VR terminal completing the exercise; 2. The latency of the cloud VR terminal reporting the motion data; 3. The latency of the cloud server acquiring the cloud VR image based on the motion data; and 4. The latency of the cloud server sending the cloud VR image to the cloud VR terminal.

[0071] Due to the large display delay, in actual applications, cloud VR terminals often experience screen freezes or delayed display, which can cause users to experience motion sickness in severe cases.

[0072] In view of this, an embodiment of the present application provides a screen display method, which can greatly reduce the display delay of the cloud VR screen, thereby avoiding the problems of screen freeze and screen display lag to a certain extent, and thus avoiding motion sickness in users to a certain extent.

[0073] Please refer to Figure 1, which shows the application environment involved in the screen display method provided in the embodiment of the present application. As shown in Figure 1, the application environment includes a cloud VR terminal 101 and a cloud server 102, wherein a communication connection is established between the cloud VR terminal 101 and the cloud server 102. The cloud VR terminal 101 can be a device such as VR glasses, and the cloud server 102 can be implemented as an independent server or a server cluster composed of multiple servers.

[0074] Please refer to Figure 2, which shows another application environment involved in the screen display method provided in an embodiment of the present application. As shown in Figure 2, the application environment includes a cloud VR terminal 101, an edge controller 103, and a cloud server 102, wherein the cloud VR terminal 101 establishes a communication connection with the edge controller 103, and the edge controller 103 establishes a communication connection with the cloud server 102. In one embodiment, the cloud VR terminal 101 and the cloud server 102 may also establish a communication connection. The edge controller 103 may be a server or a computer device. For example, the computer device may be a mobile phone, a laptop computer, etc.

[0075] In one embodiment, as shown in FIG3 , a screen display method is provided. The execution subject of the screen display method can be a cloud VR terminal or an edge controller. The embodiment of the present application only uses the cloud VR terminal as an example for description, and includes the following steps:

[0076] Step 301: The cloud VR terminal predicts the movement of the cloud VR terminal based on the motion sensor data collected by the cloud VR terminal in the initial stage of the movement to obtain predicted motion data.

[0077] In an optional embodiment of the present application, the cloud VR terminal may have built-in motion sensors such as a gyroscope, a gravimeter, a magnetometer, a camera, etc., and the motion of the cloud VR terminal may be detected by the motion sensor.

[0078] In an optional embodiment of the present application, the motion sensor in the cloud VR terminal can detect the movement of the cloud VR terminal in real time after detecting that the cloud VR terminal has started to move, thereby collecting motion sensor data of the cloud VR terminal in the early stages of movement. In one embodiment, the motion sensor data can include sensor data on six degrees of freedom, for example, the motion sensor data can include rotation direction data, rotation speed data, rotation angle data, etc.

[0079] It should be noted that the moment when the cloud VR terminal begins to move refers to the moment when the sensor data measured by the motion sensor begins to change. The initial stage of the cloud VR terminal movement can be within a preset time period after the moment when the cloud VR terminal begins to move. In one embodiment, the preset time period can be less than or equal to 5 milliseconds.

[0080] In one implementation, after the cloud VR terminal collects motion sensor data in the early stage of movement, the cloud VR terminal itself can predict and process its own movement based on the motion sensor data, thereby obtaining predicted motion data.

[0081] The system can predict its own motion based on the motion sensing data to obtain predicted motion data.

[0082] In another implementation, after collecting motion sensor data in the initial stage of movement, the cloud VR terminal can report the motion sensor data to the edge controller, and the edge controller predicts and processes the movement of the cloud VR terminal based on the motion sensor data to obtain predicted motion data.

[0083] In one embodiment, the predicted motion data may include moving direction prediction data, moving distance prediction data, moving angle prediction data, etc. The embodiment of the present application does not specifically limit the content included in the predicted motion data.

[0084] Step 302: The cloud VR terminal controls the display device of the cloud VR terminal to display the target cloud VR picture determined based on the predicted motion data.

[0085] After obtaining the predicted motion data, the cloud server can obtain the cloud VR image that needs to be sent to the cloud VR terminal based on the predicted motion data, and the cloud VR terminal can display the target cloud VR screen based on the cloud VR image.

[0086] In related technologies, after a cloud VR terminal finishes exercising, it sends its own motion data to a cloud server. The cloud server then obtains a cloud VR image based on the motion data sent by the cloud VR terminal, and the cloud VR terminal displays the cloud VR screen based on the cloud VR image.

[0087] Therefore, in the related art, the cloud VR screen needs to be displayed after the cloud VR terminal movement is completed, while in the technical solution provided in the embodiment of the present application, the target cloud VR screen is determined based on the predicted motion data, and the predicted motion data is obtained based on the motion sensor data collected by the cloud VR terminal in the initial stage of the movement. Therefore, in the technical solution provided in the embodiment of the present application, the target cloud VR screen can be displayed after the initial stage of the cloud VR terminal movement. Assuming that a certain movement of the cloud VR terminal takes 2 seconds, then in the related art, the cloud VR screen needs to be displayed after the movement takes 2 seconds to end, while in the embodiment of the present application, the target cloud VR screen can be displayed after the initial stage of the cloud VR terminal movement (5 milliseconds).

[0088] Therefore, the technical solution provided in the embodiment of the present application can greatly reduce the display delay of the target cloud VR screen, thereby avoiding the problems of screen freeze and screen display lag to a certain extent, thereby avoiding motion sickness in users to a certain extent.

[0089] It should be pointed out that, in one implementation, the cloud server can directly send the cloud VR image obtained based on the predicted motion data to the cloud VR terminal, so that the cloud VR terminal can display the target cloud VR screen based on the cloud VR image sent by the cloud server.

[0090] In another implementation, the cloud server can send a cloud VR image obtained based on the predicted motion data to the edge controller, and the edge controller forwards the cloud VR image sent by the cloud server to the cloud VR terminal, so that the cloud VR terminal can display the target cloud VR screen according to the cloud VR image sent by the cloud server.

[0091] In this embodiment, motion sensor data is collected at the initial stage of the cloud VR terminal's movement, and the movement of the cloud VR terminal is predicted and processed based on the motion sensor data to obtain predicted motion data. Then, the display device of the cloud VR terminal is controlled to display the target cloud VR picture determined based on the predicted motion data. In this way, when the cloud VR terminal is moving, it is not necessary to wait until the cloud VR terminal has finished moving before obtaining the cloud VR picture based on the motion data of the cloud VR terminal and then having the display device of the cloud VR terminal display the cloud VR picture. Instead, at the initial stage of the cloud VR terminal's movement, the movement of the cloud VR terminal is predicted and processed based on the collected motion sensor data, and then the target cloud VR picture is determined based on the predicted motion data, and then the display device of the cloud VR terminal displays the target cloud VR picture. Therefore, the display delay of the cloud VR picture can be greatly reduced, thereby avoiding screen freezes to a certain extent.

[0092] Please refer to Figure 4, which shows a technical process for obtaining a target cloud VR image. As shown in Figure 4, the technical process includes the following steps:

[0093] Step 401: The cloud VR terminal determines the image offset data based on the predicted motion data.

[0094] As mentioned above, to provide users with an immersive experience, the cloud VR image displayed by the cloud VR terminal generally needs to change with the movement of the cloud VR terminal. In other words, the movement of the cloud VR terminal will cause the cloud VR image to be displayed to shift relative to the currently displayed cloud VR image.

[0095] Therefore, in an embodiment of the present application, after obtaining the predicted motion data, the picture offset data can be determined based on the predicted motion data, wherein the picture offset data is used to characterize the offset of the cloud VR picture caused by the motion predicted by the cloud VR terminal.

[0096] In one implementation, the predicted motion data may be converted from a coordinate system corresponding to the cloud VR terminal to an image coordinate system corresponding to the original cloud VR image to obtain image offset data.

[0097] For example, in the case where the predicted motion data includes movement direction prediction data, the predicted movement direction can be converted from the coordinate system corresponding to the cloud VR terminal to the image coordinate system corresponding to the original cloud VR image, thereby obtaining the picture offset direction in the picture offset data. In the case where the predicted motion data includes movement distance prediction data, the predicted movement distance can be converted from the coordinate system corresponding to the cloud VR terminal to the image coordinate system corresponding to the original cloud VR image, thereby obtaining the picture offset distance in the picture offset data. In the case where the predicted motion data includes movement angle prediction data, the predicted movement angle can be converted from the coordinate system corresponding to the cloud VR terminal to the image coordinate system corresponding to the original cloud VR image, thereby obtaining the picture offset angle in the picture offset data.

[0098] It should be pointed out that the original cloud VR image can refer to a full-frame cloud VR image or a panoramic cloud VR image. The cloud VR image sent by the cloud server is generally captured from the original cloud VR image based on the screen capture range. In other words, the cloud VR image sent by the cloud server is generally part of the original cloud VR image.

[0099] It should also be pointed out that, in one embodiment, if the cloud VR terminal itself performs motion prediction processing based on the motion sensor data in the initial stage of motion to obtain the predicted motion data, then in step 401, the cloud VR terminal can also execute the step of determining the picture offset data based on the predicted motion data, or the cloud VR terminal can send the predicted motion data to the edge controller, and the edge controller can execute the step of determining the picture offset data based on the predicted motion data.

[0100] In another embodiment, if the edge controller performs motion prediction processing based on the motion sensor data in the initial stage of movement of the cloud VR terminal to obtain the predicted motion data, then in step 401, the edge controller can also perform the step of determining the picture offset data based on the predicted motion data.

[0101] Step 402: The cloud VR terminal sends the image offset data to the cloud server.

[0102] In an optional embodiment of the present application, if the step of determining the image offset data based on the predicted motion data is performed by the edge controller, the step of sending the image offset data to the cloud server is also performed by the edge controller. If the step of determining the image offset data based on the predicted motion data is performed by the cloud VR terminal, the step of sending the image offset data to the cloud server can be performed by the cloud VR terminal itself. Alternatively, the cloud VR terminal can send the image offset data to the edge controller, and the edge controller can perform the step of sending the image offset data to the cloud server.

[0103] In one embodiment, the screen offset data is used to instruct the cloud server to adjust the current screen capture range according to the screen offset data, and to intercept and process the original cloud VR image according to the adjusted screen capture range, to obtain and return the first cloud VR image, so that the cloud VR terminal can display the target cloud VR screen on the display device according to the first cloud VR image.

[0104] In other words, the picture offset data can instruct the cloud server to offset the current screen capture range according to the picture offset data to obtain an adjusted screen capture range, and then intercept and process the original cloud VR image according to the adjusted screen capture range to obtain and return the first cloud VR image.

[0105] In one implementation, the cloud server may send the first cloud VR image to the edge controller, which forwards the first cloud VR image to the cloud VR terminal, so that the cloud VR terminal displays the target cloud VR screen on the display device based on the first cloud VR image.

[0106] In another implementation, the cloud server may send the first cloud VR image directly to the cloud VR terminal, so that the cloud VR terminal displays the target cloud VR picture on the display device according to the first cloud VR image.

[0107] In one embodiment, the display device of the cloud VR terminal may include two display screens, the two display screens being a first display screen corresponding to the left eye and a second display screen corresponding to the right eye.

[0108] After obtaining the first cloud VR image sent by the cloud server, the target cloud VR screen can be determined based on the first cloud VR image, wherein the target cloud VR screen includes a second left-eye cloud VR screen and a second right-eye cloud VR screen. Then, the second left-eye cloud VR screen can be displayed on the first display screen, and the second right-eye cloud VR screen can be displayed on the second display screen.

[0109] In one embodiment, a second left-eye cloud VR picture and a second right-eye cloud VR picture can be determined from the first cloud VR image based on binocular display data such as viewing distance data and pupil distance data of the cloud VR terminal. The second left-eye cloud VR picture and the second right-eye cloud VR picture have some identical pictures, so that the split-screen display of the second left-eye cloud VR picture and the second right-eye cloud VR picture can bring a three-dimensional sensory effect.

[0110] In one implementation, the edge controller may execute the step of determining the target cloud VR picture based on the first cloud VR image, and then the edge controller may send the second left-eye cloud VR picture and the second right-eye cloud VR picture to the cloud VR terminal, so that the cloud VR terminal displays the second left-eye cloud VR picture on the first display screen and displays the second right-eye cloud VR picture on the second display screen.

[0111] In another implementation, the cloud VR terminal may execute the step of determining the target cloud VR picture based on the first cloud VR image, and then the cloud VR terminal may display the second left-eye cloud VR picture on the first display screen and the second right-eye cloud VR picture on the second display screen.

[0112] In the related art, if the cloud VR terminal includes two display screens, two cloud VR images are generally sent down by the cloud server, so that the two display screens of the cloud VR terminal respectively display the two cloud VR images sent down by the cloud server. However, this requires the cloud server to be divided into two paths for image encoding and streaming processing. Considering that the two cloud VR images sent down by the cloud server generally have the same parts (in order to achieve a stereoscopic sensory effect), therefore, the cloud server is divided into two paths for image encoding and streaming processing, which will cause the same image parts to be repeatedly encoded and streamed, thereby wasting the processing power of the cloud server and increasing the computing load of the cloud server. At the same time, the cloud server sending down two cloud VR images will also increase the pressure on network transmission, and may cause the two display screens of the cloud VR terminal to display out of sync.

[0113] In view of this, in an embodiment of the present application, a cloud VR image, that is, a first cloud VR image, can be sent down by the cloud server. The first cloud VR image contains all the picture content of the two cloud VR images sent down by the cloud server, and then the edge controller or the cloud VR terminal obtains the target cloud VR picture based on the first cloud VR image, that is, obtains the second left-eye cloud VR picture and the second right-eye cloud VR picture. Then, the cloud VR terminal displays the second left-eye cloud VR picture on the first display screen and displays the second right-eye cloud VR picture on the second display screen. In this way, the cloud server is prevented from repeatedly encoding and streaming the same image part, thereby saving the processing power of the cloud server and reducing the computing load of the cloud server. In addition, the pressure on network transmission can be reduced, avoiding the problem of the two display screens of the cloud VR terminal being out of sync.

[0114] In actual applications, in many scenarios, the movement of the cloud VR terminal does not require screen offset, or the screen offset caused by the movement of the cloud VR terminal is relatively small. The cloud VR image captured by the current screen capture range can completely cover the screen offset, and the cloud server does not need to adjust the current screen capture range. In order to reduce the computational complexity of the cloud server and conserve its processing power, it is necessary to filter these situations to avoid making requests to the cloud server in these situations. In other words, avoid executing the step of sending screen offset data to the cloud server in these situations.

[0115] It should be noted that the filtering of the above-mentioned situations can be performed by the cloud VR terminal or by the edge controller, and the embodiments of the present application do not specifically limit this.

[0116] Please refer to FIG5 , which shows the technical process of filtering the above-mentioned situations proposed in an embodiment of the present application. As shown in FIG5 , the technical process includes the following steps:

[0117] Step 501: The cloud VR terminal determines whether the movement of the cloud VR terminal is caused by the user's unconscious movement based on the picture offset data; when it is determined based on the picture offset data that the movement of the cloud VR terminal is caused by the user's unconscious movement, the picture adjustment process is not performed and the process can be directly ended; when it is determined based on the picture offset data that the movement of the cloud VR terminal is not caused by the user's unconscious movement, step 502 is executed.

[0118] In one embodiment, when it is determined based on the screen offset data that the offset of the cloud VR screen is less than a first offset threshold, it is determined that the movement of the cloud VR terminal is caused by unconscious movement of the user, wherein the first offset threshold can be set in advance by a technician, and the embodiment of the present application does not specifically limit this.

[0119] In one embodiment, the offset of the cloud VR screen may include at least one of an offset distance and an offset angle. Correspondingly, the first offset threshold may include at least one of a first offset distance threshold and a first offset angle threshold.

[0120] When the offset of the cloud VR screen includes both the offset distance and the offset angle, and when the offset distance is less than the first offset distance threshold and the offset angle is less than the first offset angle threshold, it is determined that the movement of the cloud VR terminal is caused by unconscious movement of the user.

[0121] In the case where the movement of the cloud VR terminal is caused by the user's unconscious movement, the movement of the cloud VR terminal does not need to cause screen offset, so the screen adjustment process is not performed and the process can be directly terminated. In the case where the movement of the cloud VR terminal is not caused by the user's unconscious movement, screen adjustment process is required, so the following step 502 can be executed.

[0122] Step 502: The cloud VR terminal determines whether the offset of the cloud VR screen is greater than the second offset threshold based on the screen offset data. If it is greater, step 503 is executed; if it is not greater, the step of sending the screen offset data to the cloud server is not executed, and step 504 is executed.

[0123] The second offset threshold is greater than the first offset threshold. Similar to the first offset threshold, the second offset threshold can also be pre-set by a technician, and the embodiment of the present application does not specifically limit this.

[0124] Furthermore, corresponding to the offset of the cloud VR image, the second offset threshold may include at least one of a second offset distance threshold and a second offset angle threshold. If the offset of the cloud VR image includes both the offset distance and the offset angle, and if the offset distance is greater than the second offset distance threshold, or if the offset angle is greater than the second offset angle threshold, then the offset of the cloud VR image is determined to be greater than the second offset threshold; otherwise, then the offset of the cloud VR image is determined to be not greater than the second offset threshold.

[0125] If the offset of the cloud VR image is no greater than the second offset threshold, it indicates that the image offset caused by the movement of the cloud VR terminal is small, and the cloud VR image captured by the current screen capture range can completely cover the image offset, so there is no need for the cloud server to adjust the current screen capture range. Therefore, the step of sending the image offset data to the cloud server is not performed, and step 504 can be directly executed. Conversely, if the offset of the cloud VR image is greater than the second offset threshold, it indicates that the image offset caused by the movement of the cloud VR terminal is large, and the cloud VR image captured by the current screen capture range can no longer cover the image offset. In this case, the cloud server needs to adjust the current screen capture range. Therefore, in this case, step 503 can be executed.

[0126] Step 503: The cloud VR terminal sends the screen offset data to the cloud server and ends the current process.

[0127] Step 504: The cloud VR terminal receives a second cloud VR image obtained by the cloud server by intercepting the original cloud VR image based on the current screen capture range.

[0128] Step 505: The cloud VR terminal determines the target cloud VR image based on the second cloud VR image.

[0129] As described above, although the image offset caused by the movement of the cloud VR terminal is small, and the cloud VR image captured by the current screen capture range can completely cover the image offset, the movement of the cloud VR terminal still causes an image offset. In order to make the target cloud VR image displayed by the cloud VR terminal meet the image offset, after obtaining the second cloud VR image sent by the cloud server, in one embodiment, the target cloud VR image can be determined based on the second cloud VR image and the image offset data, where the target cloud VR image includes a first left-eye cloud VR image and a first right-eye cloud VR image. For example, the image center of the second cloud VR image can be offset according to the image offset data to obtain the offset-processed cloud VR image. Then, the first left-eye cloud VR image and the first right-eye cloud VR image are determined from the offset-processed cloud VR image based on the cloud VR terminal's binocular display data such as viewing distance data and pupil distance data.

[0130] Step 506: The cloud VR terminal displays the first left-eye cloud VR picture on the first display screen, and displays the first right-eye cloud VR picture on the second display screen.

[0131] Among them, split-screen display of the first left-eye cloud VR picture and the first right-eye cloud VR picture can bring a three-dimensional sensory effect.

[0132] Please refer to FIG6 , which shows an implementation method for predicting and processing the motion of a cloud VR terminal based on motion sensor data collected in the early stage of motion of the cloud VR terminal to obtain predicted motion data. As shown in FIG6 , the implementation method includes the following steps:

[0133] Step 601: The cloud VR terminal inputs the motion sensing data into a pre-trained motion prediction model to use the motion prediction model to predict the motion of the cloud VR terminal.

[0134] In one embodiment, the motion prediction model may be a Kalman-like error compensation model, a real-time perception algorithm model, etc. The embodiment of the present application does not limit the type of the motion prediction model.

[0135] Step 602: The cloud VR terminal obtains predicted motion data based on the output of the motion prediction model.

[0136] In one embodiment, the motion prediction model can be optimized to continuously improve the motion prediction model's ability to predict motion and improve the accuracy of the motion prediction model. Referring to FIG7 , a technical process for optimizing the motion prediction model is shown. As shown in FIG7 , the technical process includes the following steps:

[0137] Step 701: After the cloud VR terminal finishes moving, the cloud VR terminal obtains the real movement data of the cloud VR terminal.

[0138] Step 702: The cloud VR terminal optimizes the motion prediction model based on the real motion data.

[0139] In one embodiment, if the difference between the actual motion data and the predicted motion data exceeds a preset difference threshold, it indicates that the motion prediction model's prediction of motion is significantly different from the actual motion. In this case, it is necessary to fine-tune the motion prediction model based on the actual motion data of the cloud VR terminal. In one embodiment, the preset difference threshold can be 10%.

[0140] In one implementation, the motion sensor data and the real motion data collected by the cloud VR terminal during the initial stage of motion can be added to a training sample set as training samples. If the number of samples in the training sample set is greater than a preset number, or if other predefined conditions are met, the motion prediction model can be trained using the training samples in the training sample set to optimize the motion prediction model.

[0141] Among them, using the training samples in the training sample set to train the motion prediction model can, for example, be: inputting the motion sensor data in the training samples into the motion prediction model to obtain the predicted motion data output by the motion prediction model, using a pre-set loss function to determine the gap between the actual motion data and the predicted motion data, and adjusting the parameters of the motion prediction model according to the gap.

[0142] In one embodiment, as shown in FIG8 , a screen display method is provided. The screen display method may be executed by a cloud server and includes the following steps:

[0143] Step 801: The cloud server receives image offset data.

[0144] As mentioned above, the picture offset data is obtained after predicting the movement of the cloud VR terminal based on the motion sensor data collected by the cloud VR terminal in the initial stage of movement to obtain the predicted motion data. The picture offset data is used to characterize the offset of the cloud VR picture caused by the movement predicted by the cloud VR terminal.

[0145] Step 802: The cloud server adjusts the current screen capture range according to the screen offset data, and intercepts and processes the original cloud VR image according to the adjusted screen capture range to obtain and return a first cloud VR image, so that the cloud VR terminal can display the target cloud VR image on the display device according to the first cloud VR image.

[0146] In an optional embodiment of the present application, a technical process is provided for exemplary adjusting the current screen capture range according to the screen offset data, and intercepting the original cloud VR image according to the adjusted screen capture range. As shown in FIG9 , the technical process includes the following steps:

[0147] Step 901: The cloud server adjusts the center point of the image corresponding to the current screen capture range according to the image offset data.

[0148] Step 902: The cloud server captures the original cloud VR image based on the adjusted image center point and image capture size.

[0149] The image capture size is determined according to the screen display range of the cloud VR terminal.

[0150] In order to facilitate understanding of the technical solutions provided by the embodiments of the present application, the technical solutions provided by the embodiments of the present application will be exemplarily described below.

[0151] Step S1: The cloud VR terminal obtains motion sensor data collected by itself in the initial stage of movement.

[0152] Step S2: The cloud VR terminal inputs the motion sensing data into a pre-trained motion prediction model to use the motion prediction model to predict the motion of the cloud VR terminal.

[0153] Step S3: The cloud VR terminal obtains predicted motion data based on the output of the motion prediction model.

[0154] Step S4: The cloud VR terminal determines the picture offset data based on the predicted motion data.

[0155] In step S5, the cloud VR terminal determines whether the movement of the cloud VR terminal is caused by the user's unconscious movement based on the picture offset data. When it is determined based on the picture offset data that the movement of the cloud VR terminal is caused by the user's unconscious movement, the picture adjustment processing is not performed and the process can be directly ended; when it is determined based on the picture offset data that the movement of the cloud VR terminal is not caused by the user's unconscious movement, step S6 is executed.

[0156] Step S6: The cloud VR terminal determines whether the offset of the cloud VR picture is greater than the second offset threshold based on the picture offset data. If it is greater, step S7 is executed; if it is not greater, the step of sending the picture offset data to the cloud server is not executed, and steps S8 and S9 are executed.

[0157] Step S7: The cloud VR terminal sends the screen offset data to the cloud server and jumps to step S10.

[0158] Step S8: The cloud VR terminal receives a second cloud VR image obtained by the cloud server by intercepting the original cloud VR image based on the current screen capture range.

[0159] Step S9: The cloud VR terminal determines the first left-eye cloud VR picture and the first right-eye cloud VR picture based on the second cloud VR image and the picture offset data, and displays the first left-eye cloud VR picture on the first display screen and the first right-eye cloud VR picture on the second display screen, and then ends the process.

[0160] Step S10: The cloud server receives the image offset data.

[0161] Step S11: The cloud server adjusts the center point of the image corresponding to the current screen capture range according to the image offset data.

[0162] Step S12: The cloud server intercepts the original cloud VR image based on the adjusted image center point and image interception size, obtains and returns a first cloud VR image to the cloud VR terminal.

[0163] Step S13: The cloud VR terminal determines a second left-eye cloud VR picture and a second right-eye cloud VR picture based on the first cloud VR image, and displays the second left-eye cloud VR picture on the first display screen, and displays the second right-eye cloud VR picture on the second display screen.

[0164] It should be understood that, although the various steps in the flowcharts involved in the various embodiments described above are displayed in sequence according to the instructions of the arrows, these steps are not necessarily executed in sequence in the order indicated by the arrows. Unless otherwise specified herein, there is no strict order restriction on the execution of these steps, and these steps can be executed in other orders. Moreover, at least a portion of the steps in the flowcharts involved in the various embodiments described above can include multiple steps or multiple stages, and these steps or stages are not necessarily executed and completed at the same time, but can be executed at different times, and the execution order of these steps or stages is not necessarily to be carried out in sequence, but can be executed in turn or alternately with other steps or at least a portion of steps or stages in other steps.

[0165] Based on the same inventive concept, the present application also provides an embodiment of a screen display device for implementing the screen display method described above. The solution provided by this device is similar to the solution described in the method described above. Therefore, the specific limitations of one or more screen display device embodiments provided below can be found in the above-mentioned limitations of the screen display method and will not be repeated here.

[0166] In one embodiment, as shown in FIG10 , a picture display device 1000 is provided for a cloud VR terminal, including: a prediction module 1001 and a control module 1002, wherein:

[0167] The prediction module 1001 is used to predict the movement of the cloud virtual reality VR terminal based on the motion sensor data collected by the cloud VR terminal in the initial stage of movement to obtain predicted motion data.

[0168] The control module 1002 is used to control the display device of the cloud VR terminal to display the target cloud VR picture determined based on the predicted motion data.

[0169] In one embodiment, the control module 1002 is specifically used to: determine the picture offset data based on the predicted motion data, where the picture offset data is used to characterize the offset of the cloud VR picture caused by the motion predicted by the cloud VR terminal; send the picture offset data to the cloud server to instruct the cloud server to adjust the current screen capture range according to the picture offset data, and intercept and process the original cloud VR image according to the adjusted screen capture range to obtain and return the first cloud VR image, so that the cloud VR terminal can display the target cloud VR picture on the display device according to the first cloud VR image.

[0170] In one embodiment, the control module 1002 is specifically configured to convert the predicted motion data from a coordinate system corresponding to the cloud VR terminal to an image coordinate system corresponding to the original cloud VR image to obtain image offset data.

[0171] In an optional embodiment of the present application, the control module 1002 is further configured to: when it is determined based on the picture offset data that the movement of the cloud VR terminal is caused by unconscious movement of the user, not perform picture adjustment processing.

[0172] In one embodiment, the control module 1002 is further configured to: when it is determined based on the screen offset data that the offset of the cloud VR screen is less than a first offset threshold, determine that the movement of the cloud VR terminal is caused by unconscious movement of the user.

[0173] In one embodiment, the control module 1002 is further used to: when it is determined according to the picture offset data that the movement of the cloud VR terminal is not caused by unconscious movement of the user, determine according to the picture offset data whether the offset of the cloud VR picture is greater than a second offset threshold; when it is determined according to the picture offset data that the offset of the cloud VR picture is greater than the second offset threshold, execute the step of sending the picture offset data to the cloud server.

[0174] In one embodiment, the control module 1002 is further configured to: when it is determined based on the picture offset data that the offset of the cloud VR picture is less than or equal to a second offset threshold, not execute the step of sending the picture offset data to the cloud server.

[0175] In one embodiment, the display device includes a first display screen corresponding to the left eye and a second display screen corresponding to the right eye. The control module 1002 is specifically configured to: receive a second cloud VR image obtained by the cloud server by intercepting and processing the original cloud VR image based on the current screen capture range, without performing the step of sending the screen offset data to the cloud server; determine a target cloud VR screen based on the second cloud VR image, wherein the target cloud VR screen includes a first left-eye cloud VR screen and a first right-eye cloud VR screen; display the first left-eye cloud VR screen on the first display screen, and display the first right-eye cloud VR screen on the second display screen.

[0176] In one embodiment, the control module 1002 is specifically configured to determine a target cloud VR image based on the second cloud VR image and the image offset data.

[0177] In one embodiment, the display device includes a first display screen corresponding to the left eye and a second display screen corresponding to the right eye. The control module 1002 is specifically configured to: determine a target cloud VR image based on the first cloud VR image, wherein the target cloud VR image includes a second left-eye cloud VR image and a second right-eye cloud VR image; display the second left-eye cloud VR image on the first display screen, and display the second right-eye cloud VR image on the second display screen.

[0178] In one embodiment, the prediction module 1001 is specifically used to: input motion sensor data into a pre-trained motion prediction model to use the motion prediction model to predict the motion of the cloud VR terminal; and obtain predicted motion data based on the output of the motion prediction model.

[0179] In one embodiment, the prediction module 1001 is further used to: obtain the real motion data of the cloud VR terminal after the cloud VR terminal moves; and optimize the motion prediction model according to the real motion data.

[0180] In one embodiment, the prediction module 1001 is further configured to: when the gap between the actual motion data and the predicted motion data is greater than a preset gap threshold, perform optimization processing on the motion prediction model according to the actual motion data.

[0181] In one embodiment, the initial stage of movement includes: a preset time period after the cloud VR terminal is detected to start moving.

[0182] In one embodiment, the preset duration is less than or equal to 5 milliseconds.

[0183] Each module in the above-mentioned image display device can be implemented in whole or in part through software, hardware, or a combination thereof. Each of the above-mentioned modules can be embedded in or independent of the processor in the cloud VR terminal in hardware form, or can be stored in the memory of the cloud VR terminal in software form, so that the processor can call and execute the corresponding operations of each of the above modules.

[0184] In one embodiment, as shown in FIG11 , a picture display device 1100 is provided for a cloud server, including: a receiving module 1101 and an intercepting module 1102 .

[0185] Among them, the receiving module 1101 is used to receive picture offset data, wherein the picture offset data is obtained based on the predicted motion data after predicting the movement of the cloud VR terminal based on the motion sensor data collected by the cloud VR terminal in the initial stage of the movement, and obtaining the predicted motion data. The picture offset data is used to characterize the offset of the cloud VR picture caused by the movement predicted by the cloud VR terminal.

[0186] The interception module 1102 is used to adjust the current screen capture range according to the screen offset data, and intercept the original cloud VR image according to the adjusted screen capture range to obtain and return the first cloud VR image, so that the cloud VR terminal can display the target cloud VR screen on the display device according to the first cloud VR image.

[0187] In one embodiment, the capture module 1102 is specifically used to: adjust the center point of the picture corresponding to the current screen capture range according to the picture offset data; and capture the original cloud VR image based on the adjusted picture center point and the picture capture size.

[0188] In one embodiment, the screen capture size is determined according to the screen display range of the cloud VR terminal.

[0189] Each module in the above-mentioned screen display device can be implemented in whole or in part through software, hardware, or a combination thereof. Each of the above-mentioned modules can be embedded in or independent of the processor in the cloud server in hardware form, or can be stored in the memory of the cloud server in software form, so that the processor can call and execute the corresponding operations of each of the above modules.

[0190] In one embodiment, a computer device is provided, which may be a cloud VR terminal. A diagram of its internal structure may be shown in FIG12 . The computer device includes a processor, memory, an input / output interface, a communication interface, a display unit, and an input device. The processor, memory, and input / output interface are connected via a system bus, and the communication interface, display unit, and input device are connected to the system bus via the input / output interface. The processor of the computer device is used to provide computing and control capabilities. The memory of the computer device includes a non-volatile storage medium and internal memory. The non-volatile storage medium stores an operating system and a computer program. The internal memory provides an environment for the operation of the operating system and computer program in the non-volatile storage medium. The input / output interface of the computer device is used to exchange information between the processor and an external device. The communication interface of the computer device is used to communicate with an external terminal via wired or wireless communication, where the wireless communication may be achieved via Wi-Fi, a mobile cellular network, NFC (near-field communication), or other technologies. When executed by the processor, the computer program implements a screen display method. The display unit of the computer device is used to form a visually visible screen and may be a display screen, a projection device, or a virtual reality imaging device. The display screen can be a liquid crystal display screen or an electronic ink display screen, and the input device of the computer device can be a touch layer covering the display screen, or a button, trackball or touchpad set on the computer device casing, or an external keyboard, touchpad or mouse.

[0191] Those skilled in the art will understand that the structure shown in FIG12 is merely a block diagram of a portion of the structure related to the solution of the present application, and does not constitute a limitation on the computer device to which the solution of the present application is applied. The specific computer device may include more or fewer components than shown in the figure, or combine certain components, or have a different arrangement of components.

[0192] In one embodiment, a computer device is provided, which may be a cloud server, and its internal structure diagram may be shown in Figure 13. The computer device includes a processor, a memory, an input / output interface (I / O) and a communication interface. The processor, the memory and the input / output interface are connected via a system bus, and the communication interface is connected to the system bus via the input / output interface. The processor of the computer device is used to provide computing and control capabilities. The memory of the computer device includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system, a computer program and a database. The internal memory provides an environment for the operation of the operating system and the computer program in the non-volatile storage medium. The database of the computer device is used to store data. The input / output interface of the computer device is used to exchange information between the processor and an external device. The communication interface of the computer device is used to communicate with an external terminal via a network connection. When the computer program is executed by the processor, a screen display method is implemented.

[0193] Those skilled in the art will understand that the structure shown in FIG13 is merely a block diagram of a portion of the structure related to the solution of the present application, and does not constitute a limitation on the computer device to which the solution of the present application is applied. The specific computer device may include more or fewer components than shown in the figure, or combine certain components, or have a different arrangement of components.

[0194] In one embodiment, a computer device is provided, including a memory and a processor, wherein a computer program is stored in the memory, and when the processor executes the computer program, the following steps are implemented:

[0195] Based on the motion sensor data collected by the cloud virtual reality VR terminal in the initial stage of movement, the movement of the cloud VR terminal is predicted and processed to obtain predicted motion data; the display device of the cloud VR terminal is controlled to display the target cloud VR picture determined based on the predicted motion data.

[0196] In one embodiment, when the processor executes the computer program, it further implements the following steps: determining picture offset data based on the predicted motion data, where the picture offset data is used to characterize the offset of the cloud VR picture caused by the motion predicted by the cloud VR terminal; sending the picture offset data to the cloud server to instruct the cloud server to adjust the current screen capture range based on the picture offset data, and intercepting and processing the original cloud VR image based on the adjusted screen capture range to obtain and return a first cloud VR image, so that the cloud VR terminal can display the target cloud VR picture on the display device based on the first cloud VR image.

[0197] In one embodiment, when the processor executes the computer program, it further implements the following steps: converting the predicted motion data from the coordinate system corresponding to the cloud VR terminal to the image coordinate system corresponding to the original cloud VR image to obtain the picture offset data.

[0198] In one embodiment, when the processor executes the computer program, the following steps are also implemented: when it is determined based on the picture offset data that the movement of the cloud VR terminal is caused by the user's unconscious movement, the picture adjustment processing is not performed.

[0199] In one embodiment, when the processor executes the computer program, the following steps are further implemented: when it is determined based on the screen offset data that the offset of the cloud VR screen is less than a first offset threshold, it is determined that the movement of the cloud VR terminal is caused by unconscious movement of the user.

[0200] In one embodiment, when the processor executes the computer program, the following steps are further implemented: when it is determined based on the picture offset data that the movement of the cloud VR terminal is not caused by unconscious movement of the user, determining based on the picture offset data whether the offset of the cloud VR picture is greater than a second offset threshold; when it is determined based on the picture offset data that the offset of the cloud VR picture is greater than the second offset threshold, executing the step of sending the picture offset data to the cloud server.

[0201] In one embodiment, when the processor executes the computer program, the following steps are further implemented: when it is determined based on the picture offset data that the offset of the cloud VR picture is less than or equal to the second offset threshold, the step of sending the picture offset data to the cloud server is not performed.

[0202] In one embodiment, the display device includes a first display screen corresponding to the left eye and a second display screen corresponding to the right eye. When the processor executes the computer program, the processor further implements the following steps: without executing the step of sending the screen offset data to the cloud server, receiving a second cloud VR image obtained by the cloud server intercepting and processing the original cloud VR image based on the current screen capture range; determining a target cloud VR screen based on the second cloud VR image, wherein the target cloud VR screen includes a first left-eye cloud VR screen and a first right-eye cloud VR screen; displaying the first left-eye cloud VR screen on the first display screen, and displaying the first right-eye cloud VR screen on the second display screen.

[0203] In one embodiment, when the processor executes the computer program, the processor further implements the following steps: determining the target cloud VR picture based on the second cloud VR image and the picture offset data.

[0204] In one embodiment, the display device includes a first display screen corresponding to the left eye and a second display screen corresponding to the right eye. When the processor executes the computer program, it also implements the following steps: determining a target cloud VR picture based on the first cloud VR image, wherein the target cloud VR picture includes a second left-eye cloud VR picture and a second right-eye cloud VR picture; displaying the second left-eye cloud VR picture on the first display screen, and displaying the second right-eye cloud VR picture on the second display screen.

[0205] In one embodiment, when the processor executes the computer program, it also implements the following steps: inputting the motion sensing data into a pre-trained motion prediction model to use the motion prediction model to predict the motion of the cloud VR terminal; and obtaining predicted motion data based on the output of the motion prediction model.

[0206] In one embodiment, when the processor executes the computer program, it also implements the following steps: after the cloud VR terminal moves, the real motion data of the cloud VR terminal is obtained; and the motion prediction model is tuned according to the real motion data.

[0207] In one embodiment, when the processor executes the computer program, the following steps are further implemented: when the gap between the actual motion data and the predicted motion data is greater than a preset gap threshold, the motion prediction model is tuned according to the actual motion data.

[0208] In one embodiment, the initial stage of movement includes: a preset time period after the cloud VR terminal is detected to start moving.

[0209] In one embodiment, the preset duration is less than or equal to 5 milliseconds.

[0210] In one embodiment, a computer device is provided, including a memory and a processor, wherein a computer program is stored in the memory, and when the processor executes the computer program, the following steps are implemented:

[0211] Receive picture offset data, where the picture offset data is obtained after predicting the movement of the cloud VR terminal based on motion sensor data collected by the cloud VR terminal in the initial stage of movement to obtain predicted motion data, and the picture offset data is used to characterize the offset of the cloud VR picture caused by the movement predicted by the cloud VR terminal; adjust the current screen capture range according to the picture offset data, and intercept the original cloud VR image according to the adjusted screen capture range to obtain and return a first cloud VR image, so that the cloud VR terminal can display the target cloud VR picture on the display device according to the first cloud VR image.

[0212] In one embodiment, when the processor executes the computer program, the following steps are also implemented: adjusting the center point of the picture corresponding to the current screen capture range according to the picture offset data; and intercepting the original cloud VR image based on the adjusted picture center point and the picture interception size.

[0213] In one embodiment, the screen capture size is determined according to the screen display range of the cloud VR terminal.

[0214] In one embodiment, a computer-readable storage medium is provided, on which a computer program is stored. When the computer program is executed by a processor, the following steps are implemented:

[0215] Based on the motion sensor data collected by the cloud virtual reality VR terminal in the initial stage of movement, the movement of the cloud VR terminal is predicted and processed to obtain predicted motion data; the display device of the cloud VR terminal is controlled to display the target cloud VR picture determined based on the predicted motion data.

[0216] In one embodiment, when the computer program is executed by the processor, the following steps are further implemented: determining picture offset data based on the predicted motion data, where the picture offset data is used to characterize the offset of the cloud VR picture caused by the motion predicted by the cloud VR terminal; sending the picture offset data to the cloud server to instruct the cloud server to adjust the current screen capture range based on the picture offset data, and intercepting and processing the original cloud VR image based on the adjusted screen capture range to obtain and return a first cloud VR image, so that the cloud VR terminal can display the target cloud VR picture on the display device based on the first cloud VR image.

[0217] In one embodiment, when the computer program is executed by the processor, the following steps are further implemented: the predicted motion data is converted from the coordinate system corresponding to the cloud VR terminal to the image coordinate system corresponding to the original cloud VR image to obtain the picture offset data.

[0218] In one embodiment, when the computer program is executed by the processor, the following steps are also implemented: when it is determined based on the picture offset data that the movement of the cloud VR terminal is caused by the user's unconscious movement, the picture adjustment processing is not performed.

[0219] In one embodiment, when the computer program is executed by the processor, the following steps are also implemented: when it is determined based on the screen offset data that the offset of the cloud VR screen is less than a first offset threshold, it is determined that the movement of the cloud VR terminal is caused by unconscious movement of the user.

[0220] In one embodiment, when the computer program is executed by the processor, the following steps are also implemented: when it is determined based on the picture offset data that the movement of the cloud VR terminal is not caused by unconscious movement of the user, determining based on the picture offset data whether the offset of the cloud VR picture is greater than a second offset threshold; when it is determined based on the picture offset data that the offset of the cloud VR picture is greater than the second offset threshold, executing the step of sending the picture offset data to the cloud server.

[0221] In one embodiment, when the computer program is executed by the processor, the following steps are further implemented: when it is determined based on the screen offset data that the offset of the cloud VR screen is less than or equal to the second offset threshold, the step of sending the screen offset data to the cloud server is not performed.

[0222] In one embodiment, the display device includes a first display screen corresponding to the left eye and a second display screen corresponding to the right eye. When the computer program is executed by the processor, the following steps are further implemented: without executing the step of sending picture offset data to the cloud server, a second cloud VR image is received by the cloud server based on the current screen capture range to intercept and process the original cloud VR image; a target cloud VR picture is determined according to the second cloud VR image, wherein the target cloud VR picture includes a first left-eye cloud VR picture and a first right-eye cloud VR picture; the first left-eye cloud VR picture is displayed on the first display screen, and the first right-eye cloud VR picture is displayed on the second display screen.

[0223] In one embodiment, when the computer program is executed by the processor, the following steps are further implemented: determining the target cloud VR picture based on the second cloud VR image and the picture offset data.

[0224] In one embodiment, the display device includes a first display screen corresponding to the left eye and a second display screen corresponding to the right eye. When the computer program is executed by the processor, the following steps are also implemented: determining a target cloud VR picture based on the first cloud VR image, wherein the target cloud VR picture includes a second left-eye cloud VR picture and a second right-eye cloud VR picture; displaying the second left-eye cloud VR picture on the first display screen, and displaying the second right-eye cloud VR picture on the second display screen.

[0225] In one embodiment, when the computer program is executed by the processor, the following steps are also implemented: inputting motion sensing data into a pre-trained motion prediction model to use the motion prediction model to predict the motion of the cloud VR terminal; and obtaining predicted motion data based on the output of the motion prediction model.

[0226] In one embodiment, when the computer program is executed by the processor, the following steps are also implemented: after the cloud VR terminal moves, the real motion data of the cloud VR terminal is obtained; and the motion prediction model is tuned according to the real motion data.

[0227] In one embodiment, when the computer program is executed by the processor, the following steps are further implemented: when the gap between the actual motion data and the predicted motion data is greater than a preset gap threshold, the motion prediction model is tuned according to the actual motion data.

[0228] In one embodiment, the initial stage of movement includes: a preset time period after the cloud VR terminal is detected to start moving.

[0229] In one embodiment, the preset duration is less than or equal to 5 milliseconds.

[0230] In one embodiment, a computer-readable storage medium is provided, on which a computer program is stored. When the computer program is executed by a processor, the following steps are implemented:

[0231] Receive picture offset data, where the picture offset data is obtained after predicting the movement of the cloud VR terminal based on motion sensor data collected by the cloud VR terminal in the initial stage of movement to obtain predicted motion data, and the picture offset data is used to characterize the offset of the cloud VR picture caused by the movement predicted by the cloud VR terminal; adjust the current screen capture range according to the picture offset data, and intercept the original cloud VR image according to the adjusted screen capture range to obtain and return a first cloud VR image, so that the cloud VR terminal can display the target cloud VR picture on the display device according to the first cloud VR image.

[0232] In one embodiment, when the computer program is executed by the processor, the following steps are also implemented: adjusting the center point of the picture corresponding to the current screen capture range according to the picture offset data; and intercepting the original cloud VR image based on the adjusted picture center point and the picture interception size.

[0233] In one embodiment, the screen capture size is determined according to the screen display range of the cloud VR terminal.

[0234] In one embodiment, a computer program product is provided, comprising a computer program, which, when executed by a processor, implements the following steps:

[0235] Based on the motion sensor data collected by the cloud virtual reality VR terminal in the initial stage of movement, the movement of the cloud VR terminal is predicted and processed to obtain predicted motion data; the display device of the cloud VR terminal is controlled to display the target cloud VR picture determined based on the predicted motion data.

[0236] In one embodiment, when the computer program is executed by the processor, the following steps are further implemented: determining picture offset data based on the predicted motion data, where the picture offset data is used to characterize the offset of the cloud VR picture caused by the motion predicted by the cloud VR terminal; sending the picture offset data to the cloud server to instruct the cloud server to adjust the current screen capture range based on the picture offset data, and intercepting and processing the original cloud VR image based on the adjusted screen capture range to obtain and return a first cloud VR image, so that the cloud VR terminal can display the target cloud VR picture on the display device based on the first cloud VR image.

[0237] In one embodiment, when the computer program is executed by the processor, the following steps are further implemented: the predicted motion data is converted from the coordinate system corresponding to the cloud VR terminal to the image coordinate system corresponding to the original cloud VR image to obtain the picture offset data.

[0238] In one embodiment, when the computer program is executed by the processor, the following steps are also implemented: when it is determined based on the picture offset data that the movement of the cloud VR terminal is caused by the user's unconscious movement, the picture adjustment processing is not performed.

[0239] In one embodiment, when the computer program is executed by the processor, the following steps are also implemented: when it is determined based on the screen offset data that the offset of the cloud VR screen is less than a first offset threshold, it is determined that the movement of the cloud VR terminal is caused by unconscious movement of the user.

[0240] In one embodiment, when the computer program is executed by the processor, the following steps are also implemented: when it is determined based on the picture offset data that the movement of the cloud VR terminal is not caused by unconscious movement of the user, determining based on the picture offset data whether the offset of the cloud VR picture is greater than a second offset threshold; when it is determined based on the picture offset data that the offset of the cloud VR picture is greater than the second offset threshold, executing the step of sending the picture offset data to the cloud server.

[0241] In one embodiment, when the computer program is executed by the processor, the following steps are further implemented: when it is determined based on the screen offset data that the offset of the cloud VR screen is less than or equal to the second offset threshold, the step of sending the screen offset data to the cloud server is not performed.

[0242] In one embodiment, the display device includes a first display screen corresponding to the left eye and a second display screen corresponding to the right eye. When the computer program is executed by the processor, the following steps are further implemented: without executing the step of sending picture offset data to the cloud server, a second cloud VR image is received by the cloud server based on the current screen capture range to intercept and process the original cloud VR image; a target cloud VR picture is determined according to the second cloud VR image, wherein the target cloud VR picture includes a first left-eye cloud VR picture and a first right-eye cloud VR picture; the first left-eye cloud VR picture is displayed on the first display screen, and the first right-eye cloud VR picture is displayed on the second display screen.

[0243] In one embodiment, when the computer program is executed by the processor, the following steps are further implemented: determining the target cloud VR picture based on the second cloud VR image and the picture offset data.

[0244] In one embodiment, the display device includes a first display screen corresponding to the left eye and a second display screen corresponding to the right eye. When the computer program is executed by the processor, the following steps are also implemented: determining a target cloud VR picture based on the first cloud VR image, wherein the target cloud VR picture includes a second left-eye cloud VR picture and a second right-eye cloud VR picture; displaying the second left-eye cloud VR picture on the first display screen, and displaying the second right-eye cloud VR picture on the second display screen.

[0245] In one embodiment, when the computer program is executed by the processor, the following steps are also implemented: inputting motion sensing data into a pre-trained motion prediction model to use the motion prediction model to predict the motion of the cloud VR terminal; and obtaining predicted motion data based on the output of the motion prediction model.

[0246] In one embodiment, when the computer program is executed by the processor, the following steps are also implemented: after the cloud VR terminal moves, the real motion data of the cloud VR terminal is obtained; and the motion prediction model is tuned according to the real motion data.

[0247] In one embodiment, when the computer program is executed by the processor, the following steps are further implemented: when the gap between the actual motion data and the predicted motion data is greater than a preset gap threshold, the motion prediction model is tuned according to the actual motion data.

[0248] In one embodiment, the initial stage of movement includes: a preset time period after the cloud VR terminal is detected to start moving.

[0249] In one embodiment, the preset duration is less than or equal to 5 milliseconds.

[0250] In one embodiment, a computer program product is provided, comprising a computer program, which, when executed by a processor, implements the following steps:

[0251] Receive picture offset data, where the picture offset data is obtained after predicting the movement of the cloud VR terminal based on motion sensor data collected by the cloud VR terminal in the initial stage of movement to obtain predicted motion data, and the picture offset data is used to characterize the offset of the cloud VR picture caused by the movement predicted by the cloud VR terminal; adjust the current screen capture range according to the picture offset data, and intercept the original cloud VR image according to the adjusted screen capture range to obtain and return a first cloud VR image, so that the cloud VR terminal can display the target cloud VR picture on the display device according to the first cloud VR image.

[0252] In one embodiment, when the computer program is executed by the processor, the following steps are also implemented: adjusting the center point of the picture corresponding to the current screen capture range according to the picture offset data; and intercepting the original cloud VR image based on the adjusted picture center point and the picture interception size.

[0253] In one embodiment, the screen capture size is determined according to the screen display range of the cloud VR terminal.

[0254] It should be noted that the user information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data used for analysis, stored data, displayed data, etc.) involved in this application are all information and data authorized by the user or fully authorized by all parties, and the collection, use and processing of relevant data must comply with the relevant laws, regulations and standards of relevant countries and regions.

[0255] Those skilled in the art will appreciate that all or part of the processes in the above-mentioned embodiment methods can be implemented by instructing the relevant hardware through a computer program, and the computer program can be stored in a non-volatile computer-readable storage medium. When the computer program is executed, it can include the processes of the embodiments of the above-mentioned methods. Among them, any reference to memory, database or other media used in the embodiments provided in this application may include at least one of non-volatile and volatile memory. Non-volatile memory may include read-only memory (ROM), magnetic tape, floppy disk, flash memory, optical memory, high-density embedded non-volatile memory, resistive random access memory (ReRAM), magnetic random access memory (MRAM), ferroelectric random access memory (FRAM), phase change memory (PCM), graphene memory, etc. Volatile memory may include random access memory (RAM) or external cache memory, etc. By way of illustration and not limitation, RAM can be in various forms, such as static random access memory (SRAM) or dynamic random access memory (DRAM). The database involved in the various embodiments provided herein may include at least one of a relational database and a non-relational database. Non-relational databases may include, but are not limited to, distributed databases based on blockchains. The processor involved in the various embodiments provided herein may be, but are not limited to, a general-purpose processor, a central processing unit, a graphics processing unit, a digital signal processor, a programmable logic unit, a data processing logic unit based on quantum computing, and the like.

[0256] The technical features of the above embodiments can be combined arbitrarily. To make the description concise, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this specification.

[0257] The above-described embodiments merely represent several implementation methods of the present application. While the descriptions are relatively specific and detailed, they should not be construed as limiting the scope of the present application. It should be noted that a person of ordinary skill in the art may make various modifications and improvements without departing from the spirit of the present application, and these modifications and improvements fall within the scope of protection of the present application. Therefore, the scope of protection of the present application shall be determined by the appended claims.

Claims

1. A screen display method, comprising: According to the motion sensor data collected by the cloud virtual reality VR terminal in the initial stage of the motion, the motion of the cloud VR terminal is predicted and processed to obtain predicted motion data; The display device of the cloud VR terminal is controlled to display a target cloud VR picture determined based on the predicted motion data.

2. The method according to claim 1, wherein: The controlling the display device of the cloud VR terminal to display a target cloud VR picture determined based on the predicted motion data includes: Determine picture offset data according to the predicted motion data, where the picture offset data is used to characterize the offset of the cloud VR picture caused by the motion predicted by the cloud VR terminal; The picture offset data is sent to the cloud server to instruct the cloud server to adjust the current screen capture range according to the picture offset data, and the original cloud VR image is intercepted and processed according to the adjusted screen capture range to obtain and return the first cloud VR image, so that the cloud VR terminal can display the target cloud VR picture on the display device according to the first cloud VR image.

3. The method according to claim 2, wherein: The determining of the picture offset data according to the predicted motion data comprises: The predicted motion data is converted from the coordinate system corresponding to the cloud VR terminal to the image coordinate system corresponding to the original cloud VR image to obtain the picture offset data.

4. The method according to claim 2, further comprising: When it is determined according to the picture offset data that the movement of the cloud VR terminal is caused by unconscious movement of the user, picture adjustment processing is not performed.

5. The method according to claim 4, further comprising: When it is determined according to the picture offset data that the offset of the cloud VR picture is less than the first offset threshold, it is determined that the movement of the cloud VR terminal is caused by unconscious movement of the user.

6. The method according to claim 4, further comprising: When it is determined according to the picture offset data that the movement of the cloud VR terminal is not caused by unconscious movement of the user, determining according to the picture offset data whether the offset of the cloud VR picture is greater than a second offset threshold; When it is determined according to the picture offset data that the offset of the cloud VR picture is greater than the second offset threshold, the step of sending the picture offset data to the cloud server is executed.

7. The method according to claim 6, further comprising: When it is determined according to the picture offset data that the offset of the cloud VR picture is less than or equal to the second offset threshold, the step of sending the picture offset data to the cloud server is not performed.

8. The method according to claim 7, wherein: The display device includes a first display screen corresponding to a left eye and a second display screen corresponding to a right eye, and the method further includes: Without executing the step of sending the picture offset data to the cloud server, receiving a second cloud VR image obtained by intercepting the original cloud VR image based on the current screen capture range by the cloud server; Determine the target cloud VR picture according to the second cloud VR image, wherein the target cloud VR picture includes a first left-eye cloud VR picture and a first right-eye cloud VR picture; The first left-eye cloud VR picture is displayed on the first display screen, and the first right-eye cloud VR picture is displayed on the second display screen.

9. The method according to claim 8, wherein: The determining the target cloud VR picture according to the second cloud VR image includes: The target cloud VR picture is determined according to the second cloud VR image and the picture offset data.

10. The method according to claim 2, wherein: The display device includes a first display screen corresponding to a left eye and a second display screen corresponding to a right eye, and the method further includes: Determining the target cloud VR picture according to the first cloud VR image, wherein the target cloud VR picture includes a second left-eye cloud VR picture and a second right-eye cloud VR picture; Display the second left-eye cloud VR picture on the first display screen, and display the second right-eye cloud VR picture on the second display screen VR picture.

11. The method according to claim 1, wherein: The method predicts the movement of the cloud virtual reality VR terminal according to the motion sensor data collected by the cloud virtual reality VR terminal in the initial stage of the movement to obtain the predicted motion data, including: Inputting the motion sensor data into a pre-trained motion prediction model to predict the motion of the cloud VR terminal using the motion prediction model; The predicted motion data is obtained according to the output of the motion prediction model.

12. The method according to claim 11, further comprising: After the cloud VR terminal finishes moving, obtaining real movement data of the cloud VR terminal; The motion prediction model is tuned according to the real motion data.

13. The method according to claim 12, wherein: The tuning process of the motion prediction model according to the real motion data includes: When the difference between the real motion data and the predicted motion data is greater than a preset difference threshold, the motion prediction model is tuned according to the real motion data.

14. The method according to claim 1, wherein: The initial stage of the movement includes: a preset time period after the cloud VR terminal starts to move.

15. The method according to claim 14, wherein: The preset duration is less than or equal to 5 milliseconds.

16. The method according to claim 1, wherein: The method predicts the movement of the cloud virtual reality VR terminal according to the motion sensor data collected by the cloud virtual reality VR terminal in the initial stage of the movement to obtain the predicted motion data, including: The cloud VR terminal collects the motion sensing data in the initial stage of the motion; The cloud VR terminal predicts its own motion based on the motion sensor data, thereby obtaining predicted motion data.

17. The method according to claim 1, wherein: The method predicts the movement of the cloud virtual reality VR terminal according to the motion sensor data collected by the cloud virtual reality VR terminal in the initial stage of the movement to obtain the predicted motion data, including: The cloud VR terminal collects the motion sensing data in the initial stage of the motion; The cloud VR terminal reports the motion sensor data to the edge controller; The edge controller predicts the motion of the cloud VR terminal based on the motion sensing data to obtain predicted motion data.

18. The method according to claim 1, wherein: The controlling the display device of the cloud VR terminal to display a target cloud VR picture determined based on the predicted motion data includes: The cloud server directly sends a cloud VR image obtained according to the predicted motion data to the cloud VR terminal; The cloud VR terminal displays the target cloud VR picture according to the cloud VR image sent by the cloud server.

19. The method according to claim 1, wherein: The controlling the display device of the cloud VR terminal to display a target cloud VR picture determined based on the predicted motion data includes: The cloud server sends a cloud VR image obtained according to the predicted motion data to the edge controller; The edge controller forwards the cloud VR image sent by the cloud server to the cloud VR terminal; The cloud VR terminal displays the target cloud VR picture according to the cloud VR image sent by the cloud server.

20. A screen display method, comprising: Receiving picture offset data, wherein the picture offset data is obtained based on the predicted motion data obtained after predicting the motion of the cloud VR terminal based on motion sensor data collected by the cloud VR terminal in the initial stage of motion, and the picture offset data is used to characterize the offset of the cloud VR picture caused by the motion predicted by the cloud VR terminal; The current screen capture range is adjusted according to the screen offset data, and the original cloud VR image is intercepted and processed according to the adjusted screen capture range to obtain and return the first cloud VR image, so that the cloud VR terminal can display the target cloud VR image on the display device according to the first cloud VR image.

21. The method according to claim 20, wherein: The adjusting the current screen capture range according to the screen offset data, and intercepting the original cloud VR image according to the adjusted screen capture range, includes: Adjusting the picture center point corresponding to the current screen capture range according to the picture offset data; The original cloud VR image is intercepted based on the adjusted picture center point and picture interception size.

22. The method according to claim 21, wherein: The screen capture size is determined according to the screen display range of the cloud VR terminal.

23. A picture display device, comprising: A prediction module, used to predict the movement of the cloud VR terminal according to the motion sensor data collected by the cloud VR terminal in the initial stage of the movement, and obtain predicted motion data; A control module is used to control the display device of the cloud VR terminal to display a target cloud VR picture determined based on the predicted motion data.

24. A picture display device, comprising: A receiving module, configured to receive picture offset data, wherein the picture offset data is obtained after predicting the movement of the cloud VR terminal based on the motion sensor data collected by the cloud VR terminal in the initial stage of the movement to obtain the predicted motion data, and the picture offset data is used to characterize the offset of the cloud VR picture caused by the movement predicted by the cloud VR terminal; The capture module is used to adjust the current screen capture range according to the screen offset data, and to capture the original cloud VR image according to the adjusted screen capture range to obtain and return the first cloud VR image, so that the cloud VR terminal can display the target cloud VR image on the display device according to the first cloud VR image.

25. A computer device comprising a memory and a processor, wherein the memory stores a computer program, wherein: When the processor executes the computer program, the steps of the method according to any one of claims 1 to 22 are implemented.

26. A computer-readable storage medium having a computer program stored thereon, wherein: When the computer program is executed by a processor, the steps of the method according to any one of claims 1 to 22 are implemented.

27. A computer program product comprising a computer program, wherein: When the computer program is executed by a processor, the steps of the method according to any one of claims 1 to 22 are implemented.

Images