Multi-VR terminal message pushing method and system for cloud platform

Abstract

The invention provides a multi-VR terminal message pushing method and system for a cloud platform, and the method comprises the steps: dividing all VR terminals into a plurality of VR terminal clusters based on the working state information of all VR terminals, determining the network connection information of each VR terminal cluster in a cloud network, carrying out the differentiated control management of all VR terminals, and carrying out the management of the VR terminals. The workload of message interaction between the cloud platform and the VR terminal is reduced; video stream data sampling and analysis are carried out on the subordinate VR terminals of the VR terminal cluster, the VR terminal generating a video stream transmission abnormal event is identified, and a first instruction message is pushed, so that the VR terminal generating the video stream transmission abnormal event changes the current network connection state, and the video data receiving efficiency of the VR terminal is improved; and the second instruction message is pushed based on the display state information of the VR terminal, so that the working state of the VR terminal is adjusted, the connection state of the corresponding VR terminal cluster and the cloud platform is adjusted, and the control efficiency of the multiple VR terminals is improved.

Description

Technical Field

[0001] The present invention relates to the field of VR terminal control, and in particular to a method and system for pushing messages of multiple VR terminals for a cloud platform. Background Art

[0002] VR virtual scenarios, especially VR virtual game scenarios, involve multiple VR terminals working in the same virtual scenario. In order to ensure that all VR terminals maintain a coordinated display state during the display of virtual images, corresponding display control needs to be performed on each VR terminal. Generally, individual control is performed according to the actual virtual image display state of each VR terminal, which leads to an increase in the control workload for all VR terminals and makes it impossible to perform integrated and unified control on VR terminals. In addition, when a VR terminal has a working anomaly, it is necessary to promptly perform differentiated state control on the VR terminal, which also requires pushing targeted control messages to different VR terminals. The prior art does not perform fast and efficient control on all VR terminals under a multi-VR terminal system and cannot perform accurate and reliable adjustment control on VR terminals. Summary of the Invention

[0003] The purpose of the present invention is to provide a method and system for pushing messages of multiple VR terminals for a cloud platform. Based on the working state information of all VR terminals, all VR terminals are divided into several VR terminal clusters, and the network connection information of each VR terminal cluster in the cloud network is determined, so as to perform differentiated control management on all VR terminals and reduce the message interaction workload between the cloud platform and VR terminals; video stream data sampling and analysis are also performed on the VR terminals under the VR terminal cluster to identify the VR terminals that have video stream transmission anomaly events, and thus push a first instruction message to cause the VR terminals that have video stream transmission anomaly events to change the current network connection state and improve the video data reception efficiency of VR terminals; a second instruction message is also pushed based on the display state information of VR terminals to adjust the working state of VR terminals and adjust the connection state between the corresponding VR terminal cluster and the cloud platform, thereby improving the control efficiency and reliability of multiple VR terminals.

[0004] The present invention is realized through the following technical solutions:

[0005] A method for pushing messages of multiple VR terminals for a cloud platform includes:

[0006] Identifying all VR terminals currently connected to the cloud platform to obtain the respective working state information of all VR terminals; based on the working state information, dividing all VR terminals into several VR terminal clusters, and determining the network connection information of each VR terminal cluster in the cloud network;

[0007] Perform video stream data sampling on all VR terminals under the VR terminal cluster to obtain corresponding video stream data samples; analyze the video stream data samples to identify the VR terminals in the VR terminal cluster where video stream transmission abnormal events occur; based on the network connection information, push a first instruction message to the VR terminals where video stream transmission abnormal events occur, so that the VR terminals where video stream transmission abnormal events occur change their current network connection status;

[0008] Based on the display status information of all VR terminals under the VR terminal cluster, push a second instruction message to the corresponding VR terminals under the VR terminal cluster to adjust the working status of the corresponding VR terminals under the VR terminal cluster; and based on the actual active VR terminal status information of each VR terminal cluster, adjust the connection status of each VR terminal cluster to the cloud platform.

[0009] Optionally, identify all VR terminals currently connected to the cloud platform to obtain the working status information of each VR terminal; based on the working status information, divide all VR terminals into several VR terminal clusters, and determine the network connection information of each VR terminal cluster in the cloud network, including:

[0010] Obtain the working logs of all VR terminals currently connected to the cloud platform, analyze the working logs to obtain the VR display task execution status information of each VR terminal; wherein, the VR display task execution status information includes the virtual scene type information of the VR display task currently executed by the VR terminal and the VR display task execution progress information;

[0011] Based on the VR display task execution status information, divide all VR terminals into several VR terminal clusters, where all VR terminals under each VR terminal cluster have the same virtual scene type information of the VR display task and the VR display task execution progress information;

[0012] Obtain the access gateway address information of all VR terminals under each VR terminal cluster in the cloud network, and based on the access gateway address information, determine the connection network path information of all VR terminals under each VR terminal cluster to the cloud platform.

[0013] Optionally, perform video stream data sampling on all VR terminals under the VR terminal cluster to obtain corresponding video stream data samples; analyze the video stream data samples to identify the VR terminals in the VR terminal cluster where video stream transmission abnormal events occur; based on the network connection information, push a first instruction message to the VR terminals where video stream transmission abnormal events occur, so that the VR terminals where video stream transmission abnormal events occur change their current network connection status, including:

[0014] Perform video stream data sampling on all VR terminals under the VR terminal cluster respectively to obtain video stream data samples transmitted by the cloud platform to each VR terminal; analyze the video stream data samples to obtain the transmission distortion degree and transmission delay value of the video stream data of each VR terminal; if the transmission distortion degree is greater than the preset distortion degree threshold or the transmission delay value, determine that a video stream transmission abnormal event occurs for the corresponding VR terminal; otherwise, determine that a video stream transmission abnormal event does not occur for the corresponding VR terminal;

[0015] Based on the connection network path information between the VR terminal with a video stream transmission abnormal event and the cloud platform, push a first instruction message containing a gateway connection switching instruction to the VR terminal with a video stream transmission abnormal event, so that the VR terminal with a video stream transmission abnormal event changes the network path connected to the cloud platform.

[0016] Optionally, performing video stream data sampling on all VR terminals under the VR terminal cluster includes:

[0017] Step S1, using the following formula (1), obtain the difference value between the action image of the current frame and the action image of the previous frame of the collected video stream data,

[0018]

[0019] In the above formula (1), Q(a) represents the difference value between the action image of the current a-th frame and the action image of the previous frame of the collected video stream data; a represents the frame number of the current action image of the collected video stream data; D a (i,j) represents the pixel value of the pixel point at the i-th row and j-th column in the action image of the current a-th frame of the collected video stream data; D a-1 (i,j) represents the pixel value of the pixel point at the i-th row and j-th column in the action image of the current (a - 1)-th frame of the collected video stream data; || represents taking the absolute value; m represents the total number of pixel points in any row of the action image of the collected video stream data; n represents the total number of pixel points in any column of the action image of the collected video stream data;

[0020] Step S2, using the following formula (2), according to the difference value between the action image of the current frame and the action image of the previous frame of the collected video stream data, obtain the sampling duration for the next video stream data action image sampling,

[0021]

[0022] In the above formula (2), T(a + 1) represents the sampling duration of the action image of the (a + 1)-th frame of the video stream data collected; T(a) represents the sampling duration of the action image of the a-th frame of the video stream data collected; D max represents the maximum value of the pixels of the action image; T(1) represents the initial sampling duration; T0 represents the preset sampling duration;

[0023] Step S3: Use the following formula (3) to determine whether there is a lag phenomenon in the video stream data based on the action images of the video stream data collected continuously five times,

[0024]

[0025] In the above formula (3), E(a) represents the determination value for determining whether there is a lag phenomenon in the video stream data; k represents an integer variable; T(a - k) represents the sampling duration of the action image of the (a - k)-th frame of the video stream data collected;

[0026] If E(a) = 1, it means that there is a lag phenomenon in the video stream data, and at this time, the acquisition of the video stream data is stopped

[0027] If E(a) = 0, it means that there is no lag phenomenon in the video stream data, and at this time, the current acquisition state of the video stream data remains unchanged.

[0028] Optionally, based on the display status information of all VR terminals under the VR terminal cluster, a second instruction message is pushed to the corresponding VR terminals under the VR terminal cluster to adjust the working status of the corresponding VR terminals under the VR terminal cluster; and based on the actual active VR terminal status information of each VR terminal cluster, the connection status between each VR terminal cluster and the cloud platform is adjusted, including:

[0029] Obtain the virtual image display visual parameters of all VR terminals under the VR terminal cluster respectively, and based on the virtual image display visual parameters, determine whether the VR terminal is in a normal display state; if the VR terminal is not in a normal display state, a second instruction message containing a stop display instruction is pushed to the VR terminal to switch the VR terminal to a non-display active state;

[0030] Determine whether the number of VR terminals in the display active state under each VR terminal cluster is less than the preset number threshold. If so, interrupt the network connection between the VR terminal cluster and the cloud platform; if not, keep the current network connection between the VR terminal cluster and the cloud platform unchanged.

[0031] A multi-VR terminal message push system for a cloud platform, including:

[0032] A VR terminal recognition module, which is used to recognize all VR terminals currently connected to the cloud platform to obtain the working status information of each VR terminal;

[0033] A VR terminal division module, which is used to divide all VR terminals into several VR terminal clusters based on the working status information and determine the network connection information of each VR terminal cluster in the cloud network;

[0034] A VR terminal anomaly judgment module, which is used to sample video stream data of all VR terminals subordinate to the VR terminal cluster to obtain corresponding video stream data samples; analyze the video stream data samples to identify the VR terminals in the VR terminal cluster that have video stream transmission anomaly events;

[0035] A first message push module, which is used to push a first instruction message to the VR terminals that have video stream transmission anomaly events based on the network connection information, so that the VR terminals that have video stream transmission anomaly events change their current network connection status;

[0036] A second message push module, which is used to push a second instruction message to the corresponding VR terminals subordinate to the VR terminal cluster based on the display status information of all VR terminals subordinate to the VR terminal cluster, so as to adjust the working status of the corresponding VR terminals subordinate to the VR terminal cluster;

[0037] A connection status adjustment module, which is used to adjust the connection status of each VR terminal cluster and the cloud platform based on the actual active VR terminal status information of all VR terminal clusters.

[0038] Optionally, the VR terminal recognition module is used to recognize all VR terminals currently connected to the cloud platform to obtain the working status information of each VR terminal, including:

[0039] Obtain the work logs of all VR terminals currently connected to the cloud platform, analyze the work logs to obtain the VR display task execution status information of each VR terminal; wherein, the VR display task execution status information includes the virtual scene type information of the VR display task currently executed by the VR terminal and the VR display task execution progress information;

[0040] The VR terminal division module is used to divide all VR terminals into several VR terminal clusters based on the working status information and determine the network connection information of each VR terminal cluster, including:

[0041] Based on the VR display task execution status information, all VR terminals are divided into several VR terminal clusters, where all VR terminals under each VR terminal cluster have the same virtual scene type information and VR display task execution progress information of the VR display task;

[0042] Obtain the access gateway address information of all VR terminals under each VR terminal cluster in the cloud network respectively. Based on the access gateway address information, determine the connection network path information between all VR terminals under each VR terminal cluster and the cloud platform.

[0043] Optionally, the VR terminal anomaly judgment module is used to sample video stream data of all VR terminals under the VR terminal cluster to obtain corresponding video stream data samples; analyze the video stream data samples to identify the VR terminals in the VR terminal cluster where video stream transmission anomaly events occur, including:

[0044] Sample the video stream data of all VR terminals under the VR terminal cluster respectively to obtain the video stream data samples transmitted by the cloud platform to each VR terminal; analyze the video stream data samples to obtain the transmission distortion degree and transmission delay value of the video stream data of each VR terminal; if the transmission distortion degree is greater than the preset distortion degree threshold or the transmission delay value, it is determined that the corresponding VR terminal has a video stream transmission anomaly event; otherwise, it is determined that the corresponding VR terminal does not have a video stream transmission anomaly event;

[0045] The first message push module is used to push a first instruction message to the VR terminals where video stream transmission anomaly events occur based on the network connection information, so that the VR terminals where video stream transmission anomaly events occur change their current network connection status, including:

[0046] Based on the connection network path information between the VR terminals where video stream transmission anomaly events occur and the cloud platform, push a first instruction message containing a gateway connection switching instruction to the VR terminals where video stream transmission anomaly events occur, so that the VR terminals where video stream transmission anomaly events occur change the network path connected to the cloud platform.

[0047] Optionally, the second message push module is used to push a second instruction message to the corresponding VR terminals under the VR terminal cluster based on the display status information of all VR terminals under the VR terminal cluster, so as to adjust the working status of the corresponding VR terminals under the VR terminal cluster, including:

[0048] Obtain the virtual image display visual parameters of each VR terminal under the VR terminal cluster, and based on the virtual image display visual parameters, determine whether the VR terminal is in a normal display state; if the VR terminal is not in a normal display state, then push a second instruction message containing a stop display instruction to the VR terminal, thereby switching the VR terminal to a non-display active state;

[0049] The connection state adjustment module is used to adjust the connection state between each VR terminal cluster and the cloud platform based on the actual active VR terminal state information of all VR terminal clusters, including:

[0050] Judge whether the number of VR terminals in the display active state under each VR terminal cluster is less than a preset number threshold. If so, interrupt the network connection between the VR terminal cluster and the cloud platform; if not, keep the current network connection between the VR terminal cluster and the cloud platform unchanged.

[0051] Compared with the prior art, the present invention has the following beneficial effects:

[0052] The multi-VR terminal message pushing method and system for a cloud platform provided by this application are based on the working state information of all VR terminals, divide all VR terminals into several VR terminal clusters, and determine the network connection information of each VR terminal cluster in the cloud network, so as to perform differentiated control and management on all VR terminals, reducing the message interaction workload between the cloud platform and VR terminals; it also samples and analyzes the video stream data of the VR terminals under the VR terminal cluster, identifies the VR terminals that have video stream transmission abnormal events, and thereby pushes the first instruction message to make the VR terminals that have video stream transmission abnormal events change the current network connection state, improving the video data reception efficiency of VR terminals; it also pushes the second instruction message based on the display state information of VR terminals, thereby adjusting the working state of VR terminals and adjusting the connection state between the corresponding VR terminal clusters and the cloud platform, improving the control efficiency and reliability of multi-VR terminals. BRIEF DESCRIPTION OF THE DRAWINGS

[0053] In order to more clearly illustrate the technical solutions in the embodiments of the present invention or the prior art, the following will briefly introduce the drawings required for use in the description of the embodiments or the prior art. Obviously, the following drawings are only some embodiments of the present invention. For those of ordinary skill in the art, without creative efforts, other drawings can also be obtained based on these drawings. Among them:

[0054] Figure 1 It is a flowchart of the multi-VR terminal message pushing method for a cloud platform provided by the present invention.

[0055] Figure 2Schematic structural diagram of the multi-VR terminal message push system for a cloud platform provided by the present invention. Detailed implementation manners

[0056] To make the above objects, features, and advantages of the present application more obvious and understandable, the following will describe the detailed implementation manners of the present application in conjunction with the accompanying drawings. It can be understood that the specific embodiments described herein are only used to explain the present application, rather than limiting the present application. Additionally, it should be noted that for the sake of convenience of description, only the parts related to the present application rather than all the structures are shown in the drawings. Based on the embodiments in the present application, all other embodiments obtained by those of ordinary skill in the art without creative efforts fall within the scope of protection of the present application.

[0057] The terms "including" and "having" and any variations thereof in the present application are intended to cover non-exclusive inclusion. For example, a process, method, system, product, or device that includes a series of steps or units is not limited to the listed steps or units, but may optionally further include steps or units not listed, or may optionally further include other steps or units inherent to these processes, methods, products, or devices.

[0058] Referring to the following, it means that specific features, structures, or characteristics described in conjunction with the embodiments may be included in at least one embodiment of the present application. The appearance of this phrase in various positions in the specification does not necessarily refer to the same embodiment, nor is it an independent or alternative embodiment mutually exclusive with other embodiments. Those skilled in the art explicitly and implicitly understand that the embodiments described herein may be combined with other embodiments.

[0059] Please refer to Figure 1 As shown, the multi-VR terminal message push method for a cloud platform provided by an embodiment of the present application includes:

[0060] Identify all VR terminals currently connected to the cloud platform to obtain the working state information of each VR terminal; based on this working state information, divide all VR terminals into several VR terminal clusters, and determine the network connection information of each VR terminal cluster in the cloud network;

[0061] Sample the video stream data of all VR terminals under the VR terminal cluster to obtain corresponding video stream data samples; analyze the video stream data samples to identify the VR terminals in the VR terminal cluster that have video stream transmission abnormal events; based on this network connection information, push a first instruction message to the VR terminals that have video stream transmission abnormal events, so that the VR terminals that have video stream transmission abnormal events change their current network connection states;

[0062] Based on the display status information of all VR terminals subordinate to the VR terminal cluster, a second instruction message is pushed to the corresponding VR terminals subordinate to the VR terminal cluster, thereby adjusting the working status of the corresponding VR terminals subordinate to the VR terminal cluster; and based on the actual active VR terminal status information of each VR terminal cluster, the connection status between each VR terminal cluster and the cloud platform is adjusted accordingly.

[0063] The beneficial effects of the above embodiments are as follows. The multi-VR terminal message pushing method for the cloud platform divides all VR terminals into several VR terminal clusters based on the working status information of all VR terminals, determines the network connection information of each VR terminal cluster in the cloud network, and conducts differentiated control and management of all VR terminals, reducing the message interaction workload between the cloud platform and VR terminals; it also samples and analyzes the video stream data of the VR terminals subordinate to the VR terminal cluster, identifies the VR terminals that have video stream transmission abnormal events, and pushes the first instruction message accordingly, so that the VR terminals with video stream transmission abnormal events change their current network connection status, improving the video data reception efficiency of VR terminals; it also pushes the second instruction message based on the display status information of VR terminals, thereby adjusting the working status of VR terminals and adjusting the connection status between the corresponding VR terminal cluster and the cloud platform, improving the control efficiency and reliability of multi-VR terminals.

[0064] In another embodiment, all VR terminals currently connected to the cloud platform are identified to obtain the working status information of each VR terminal; based on this working status information, all VR terminals are divided into several VR terminal clusters, and the network connection information of each VR terminal cluster in the cloud network is determined, including:

[0065] Obtain the work logs of all VR terminals currently connected to the cloud platform, analyze the work logs, and obtain the VR display task execution status information of each VR terminal; wherein, the VR display task execution status information includes the virtual scene type information of the VR display task currently executed by the VR terminal and the VR display task execution progress information.

[0066] Based on the VR display task execution status information, all VR terminals are divided into several VR terminal clusters, and all VR terminals subordinate to each VR terminal cluster have the same virtual scene type information of the VR display task and the VR display task execution progress information.

[0067] Obtain the access gateway address information of all VR terminals subordinate to each VR terminal cluster in the cloud network, and based on this access gateway address information, determine the connection network path information between all VR terminals subordinate to each VR terminal cluster and the cloud platform.

[0068] Beneficial effects of the above embodiments: The cloud platform serves as a unified control and management platform, with multiple VR terminals connected under it. By obtaining the work logs of each VR terminal and analyzing the work logs, the status information corresponding to the current VR display task executed by each VR terminal is obtained, that is, the virtual scene type information and execution progress information corresponding to the current VR display task executed by each VR terminal are obtained. By comparing the virtual scene type information and execution progress information corresponding to the VR display tasks executed by different VR terminals, all VR terminals with the same virtual scene type information and the same execution progress information are classified into the same VR terminal cluster. This facilitates subsequent unified control of VR terminals with the same VR display task execution status information, improves the control efficiency of VR terminals, and reduces the workload of pushing control messages. In addition, the access gateway address information of all VR terminals under each VR terminal cluster in the cloud network is also obtained to determine the connection network path information of all VR terminals under each VR terminal cluster to the cloud platform. In this way, the cloud platform can push messages to the VR terminals under the same VR terminal cluster according to a specific connection network path, avoiding incorrect message pushing.

[0069] In another embodiment, video stream data sampling is performed on all VR terminals under the VR terminal cluster to obtain corresponding video stream data samples; the video stream data samples are analyzed to identify the VR terminals in the VR terminal cluster where video stream transmission abnormal events occur; based on the network connection information, a first instruction message is pushed to the VR terminals where video stream transmission abnormal events occur, so that the VR terminals where video stream transmission abnormal events occur change their current network connection status, including:

[0070] Video stream data sampling is respectively performed on all VR terminals under the VR terminal cluster to obtain the video stream data samples transmitted by the cloud platform to each VR terminal; the video stream data samples are analyzed to obtain the transmission distortion degree and transmission delay value of the video stream data of each VR terminal; if the transmission distortion degree is greater than a preset distortion degree threshold or the transmission delay value, it is determined that the corresponding VR terminal has a video stream transmission abnormal event; otherwise, it is determined that the corresponding VR terminal does not have a video stream transmission abnormal event;

[0071] Based on the connection network path information between the VR terminals where video stream transmission abnormal events occur and the cloud platform, a first instruction message containing a gateway connection switching instruction is pushed to the VR terminals where video stream transmission abnormal events occur, so that the VR terminals where video stream transmission abnormal events occur change the network path connected to the cloud platform.

[0072] The beneficial effects of the above embodiments are as follows: For all VR terminals subordinate to the VR terminal cluster, video stream data sampling is respectively performed on each VR terminal from the cloud platform to obtain video stream data samples for each VR terminal. Then, by analyzing these video stream data samples, the transmission distortion degree and transmission delay value during the process of the cloud platform transmitting video stream data to each VR terminal are determined. Next, by respectively comparing these transmission distortion degree and transmission delay value with thresholds, it is determined whether a video stream transmission abnormal event occurs in the VR terminal, so as to accurately and timely identify events that affect the normal display of virtual images in the VR terminals subordinate to the VR terminal cluster. In addition, based on the connection network path information between the VR terminal where the video stream transmission abnormal event occurs and the cloud platform, a first instruction message containing a gateway connection switching instruction is pushed to the VR terminal where the video stream transmission abnormal event occurs, so that the corresponding VR terminal can timely change the network path connected to the cloud platform, improving the video stream data transmission distortion and transmission delay conditions of the VR terminal.

[0073] In another embodiment, video stream data sampling is performed on all VR terminals subordinate to the VR terminal cluster, including:

[0074] Step S1: Using the following formula (1), obtain the difference value between the action image of the current frame and the action image of the previous frame of the collected video stream data.

[0075]

[0076] In the above formula (1), Q(a) represents the difference value between the action image of the current a-th frame and the action image of the previous frame of the collected video stream data; a represents the frame number of the current action image of the collected video stream data; D a (i, j) represents the pixel value of the pixel point at the i-th row and j-th column in the action image of the current a-th frame of the collected video stream data; D a-1 (i, j) represents the pixel value of the pixel point at the i-th row and j-th column in the action image of the current (a - 1)-th frame of the collected video stream data; || represents taking the absolute value; m represents the total number of pixel points in any row of the action image of the collected video stream data; n represents the total number of pixel points in any column of the action image of the collected video stream data.

[0077] Step S2: Using the following formula (2), according to the difference value between the action image of the current frame and the action image of the previous frame of the collected video stream data, obtain the sampling duration for the next action image sampling of the video stream data.

[0078]

[0079] In the above formula (2), T(a + 1) represents the sampling duration of the action image of the (a + 1)-th frame of the video stream data collected; T(a) represents the sampling duration of the action image of the a-th frame of the video stream data collected; D max represents the maximum value of the pixel points of the action image; T(1) represents the initial sampling duration; T0 represents the preset sampling duration;

[0080] Step S3, use the following formula (3) to determine whether there is a stuttering phenomenon in the video stream data according to the action images of the video stream data collected continuously five times,

[0081]

[0082] In the above formula (3), E(a) represents the determination value for determining whether there is a stuttering phenomenon in the video stream data; k represents an integer variable; T(a - k) represents the sampling duration of the action image of the (a - k)-th frame of the video stream data collected;

[0083] If E(a) = 1, it means that there is a stuttering phenomenon in the video stream data, and at this time, the acquisition of the video stream data is stopped

[0084] If E(a) = 0, it means that there is no stuttering phenomenon in the video stream data, and at this time, the current acquisition state of the video stream data remains unchanged.

[0085] The beneficial effects of the above embodiments are as follows: Using the above formula (1), the difference value between the action image of the current frame and the previous frame of the collected video stream data is obtained, so as to numerically quantify the action amplitude state of the action image, which is convenient for subsequent acquisition control; then using the above formula (2), according to the difference value between the action image of the current frame and the previous frame of the collected video stream data, the sampling duration for the next sampling of the action image of the video stream data is obtained; finally, using the above formula (3), according to the action images of the video stream data collected continuously five times, it is determined whether there is a stuttering phenomenon in the video stream data, ensuring the acquisition reliability of the video stream data.

[0086] In another embodiment, based on the display status information of all VR terminals under the VR terminal cluster, a second instruction message is pushed to the corresponding VR terminals under the VR terminal cluster to adjust the working status of the corresponding VR terminals under the VR terminal cluster; and based on the actual active VR terminal status information of each VR terminal cluster, the connection status between each VR terminal cluster and the cloud platform is adjusted accordingly, including:

[0087] Obtain the virtual image display visual parameters of each VR terminal under the VR terminal cluster, and based on the virtual image display visual parameters, determine whether the VR terminal is in a normal display state; if the VR terminal is not in a normal display state, then push a second instruction message containing a stop display instruction to the VR terminal, thereby switching the VR terminal to a non-display active state;

[0088] Determine whether the number of VR terminals in the display active state under each VR terminal cluster is less than a preset number threshold. If so, then interrupt the network connection between the VR terminal cluster and the cloud platform; if not, then keep the current network connection between the VR terminal cluster and the cloud platform unchanged.

[0089] The beneficial effects of the above embodiments are as follows: Obtain the display visual parameters such as the display resolution or display contrast of the virtual images of each VR terminal under the VR terminal cluster. If the display resolution is less than the preset resolution threshold or the display contrast is less than the preset contrast threshold, then determine that the VR terminal is not in a normal display state; otherwise, determine that the VR terminal is in a normal display state. Then push a second instruction message containing a stop display instruction to the VR terminal that is not in a normal display state. In this way, after receiving the second instruction message, the VR terminal that is not in a normal display state will switch to a non-display active state (i.e., not display the corresponding virtual image), thereby avoiding the VR terminal from affecting the user's image viewing experience. In addition, determine whether the number of VR terminals in the display active state under each VR terminal cluster is less than a preset number threshold. When the number of VR terminals in the display active state under the VR terminal cluster is less than the preset number threshold, then interrupt the network connection between the VR terminal cluster and the cloud platform to avoid the VR terminal cluster from occupying the data transmission bandwidth of the cloud platform and improving the data transmission efficiency of the cloud platform for other VR terminal clusters.

[0090] Please refer to Figure 2 As shown, a multi-VR terminal message push system for a cloud platform provided by an embodiment of the present application includes:

[0091] A VR terminal identification module, configured to identify all VR terminals currently connected to the cloud platform to obtain the working state information of each VR terminal;

[0092] A VR terminal division module, configured to divide all VR terminals into several VR terminal clusters based on the working state information, and determine the network connection information of each VR terminal cluster in the cloud network;

[0093] A VR terminal anomaly judgment module, configured to sample video stream data of all VR terminals under the VR terminal cluster to obtain corresponding video stream data samples; analyze the video stream data samples to identify the VR terminals in which video stream transmission anomaly events occur in the VR terminal cluster;

[0094] The first message push module is used to push a first instruction message to the VR terminal where a video stream transmission exception event occurs based on the network connection information, so that the VR terminal where the video stream transmission exception event occurs changes its current network connection status;

[0095] The second message push module is used to push a second instruction message to the corresponding VR terminals under the VR terminal cluster based on the display status information of all VR terminals under the VR terminal cluster, so as to adjust the working status of the corresponding VR terminals under the VR terminal cluster;

[0096] The connection status adjustment module is used to adjust the connection status between each VR terminal cluster and the cloud platform based on the actual active VR terminal status information of all VR terminal clusters.

[0097] The beneficial effects of the above embodiments are as follows: The multi-VR terminal message push system for the cloud platform divides all VR terminals into several VR terminal clusters based on the working status information of all VR terminals, determines the network connection information of each VR terminal cluster in the cloud network, and performs differentiated control and management on all VR terminals, reducing the message interaction workload between the cloud platform and VR terminals; it also samples and analyzes the video stream data of the VR terminals under the VR terminal cluster, identifies the VR terminals where video stream transmission exception events occur, and pushes the first instruction message accordingly, so that the VR terminals where video stream transmission exception events occur change their current network connection status, improving the video data reception efficiency of VR terminals; it also pushes the second instruction message based on the display status information of VR terminals, adjusts the working status of VR terminals, and adjusts the connection status between the corresponding VR terminal clusters and the cloud platform, improving the control efficiency and reliability of multi-VR terminals.

[0098] In another embodiment, the VR terminal identification module is used to identify all VR terminals currently connected to the cloud platform to obtain the working status information of each VR terminal, including:

[0099] Obtain the work logs of all VR terminals currently connected to the cloud platform, analyze the work logs, and obtain the VR display task execution status information of each VR terminal; wherein, the VR display task execution status information includes the virtual scene type information of the VR display task currently executed by the VR terminal and the VR display task execution progress information;

[0100] The VR terminal division module is used to divide all VR terminals into several VR terminal clusters based on the working status information, and determine the network connection information of each VR terminal cluster in the cloud network, including:

[0101] Based on the VR display task execution status information, all VR terminals are divided into several VR terminal clusters, where all VR terminals under each VR terminal cluster have the same virtual scene type information and VR display task execution progress information of the VR display task;

[0102] Obtain the access gateway address information of all VR terminals under each VR terminal cluster in the cloud network respectively. Based on this access gateway address information, determine the connection network path information of all VR terminals under each VR terminal cluster to the cloud platform respectively.

[0103] The beneficial effects of the above embodiments are as follows: The cloud platform is used as a unified control and management platform, and multiple VR terminals are connected under it. By obtaining the working logs of each VR terminal and analyzing the working logs, the status information corresponding to the current VR display task executed by each VR terminal is obtained, that is, the virtual scene type information and execution progress information corresponding to the current VR display task executed by each VR terminal are obtained. Compare the virtual scene type information and execution progress information corresponding to the VR display tasks executed by different VR terminals, and divide all VR terminals with the same virtual scene type information and the same execution progress information into the same VR terminal cluster. In this way, it is convenient to uniformly control VR terminals with the same VR display task execution status information in the subsequent process, improve the control efficiency of VR terminals and reduce the workload of pushing control messages. In addition, the access gateway address information of all VR terminals under each VR terminal cluster in the cloud network is also obtained respectively, and based on this, the connection network path information of all VR terminals under each VR terminal cluster to the cloud platform is determined respectively. In this way, the cloud platform can push messages to VR terminals under the same VR terminal cluster according to a specific connection network path, avoiding incorrect message pushing.

[0104] In another embodiment, the VR terminal anomaly judgment module is used to sample video stream data of all VR terminals under the VR terminal cluster to obtain corresponding video stream data samples; analyze the video stream data samples to identify VR terminals in the VR terminal cluster that have video stream transmission anomaly events, including:

[0105] Respectively sample the video stream data of all VR terminals under the VR terminal cluster to obtain the video stream data samples transmitted by the cloud platform to each VR terminal; analyze the video stream data samples to obtain the transmission distortion degree and transmission delay value of the video stream data of each VR terminal; if the transmission distortion degree is greater than a preset distortion degree threshold or the transmission delay value, it is determined that the corresponding VR terminal has a video stream transmission anomaly event; otherwise, it is determined that the corresponding VR terminal has not had a video stream transmission anomaly event;

[0106] The first message pushing module is used to push a first instruction message to the VR terminal where a video stream transmission exception event occurs based on the network connection information, so that the VR terminal where the video stream transmission exception event occurs changes its current network connection state, including:

[0107] Based on the connection network path information between the VR terminal where the video stream transmission exception event occurs and the cloud platform, push a first instruction message containing a gateway connection switching instruction to the VR terminal where the video stream transmission exception event occurs, so that the VR terminal where the video stream transmission exception event occurs changes the network path connected to the cloud platform.

[0108] The beneficial effects of the above embodiments are as follows: for each VR terminal under the VR terminal cluster, video stream data sampling is performed on the video stream data from the cloud platform to obtain a video stream data sample for each VR terminal. Then, the video stream data sample is analyzed to determine the transmission distortion degree and transmission delay value during the process of the cloud platform transmitting video stream data to each VR terminal. Next, the transmission distortion degree and the transmission delay value are respectively compared with the thresholds to determine whether a video stream transmission exception event occurs in the VR terminal, so as to accurately and timely identify events that affect the normal display of virtual images in the VR terminals under the VR terminal cluster. In addition, based on the connection network path information between the VR terminal where the video stream transmission exception event occurs and the cloud platform, a first instruction message containing a gateway connection switching instruction is pushed to the VR terminal where the video stream transmission exception event occurs, so that the corresponding VR terminal can timely change the network path connected to the cloud platform, and improve the video stream data transmission distortion and transmission delay conditions of the VR terminal.

[0109] In another embodiment, the second message pushing module is used to push a second instruction message to the corresponding VR terminal under the VR terminal cluster based on the display state information of all VR terminals under the VR terminal cluster, so as to adjust the working state of the corresponding VR terminal under the VR terminal cluster, including:

[0110] Obtain the virtual image display visual parameters of each VR terminal under the VR terminal cluster, and based on the virtual image display visual parameters, determine whether the VR terminal is in a normal display state; if the VR terminal is not in a normal display state, push a second instruction message containing a stop display instruction to the VR terminal, so as to switch the VR terminal to a non-display active state;

[0111] The connection state adjustment module is used to adjust the connection state between each VR terminal cluster and the cloud platform based on the actual active VR terminal state information of all VR terminal clusters, including:

[0112] Determine whether the number of VR terminals in the display active state under each VR terminal cluster is less than a preset number threshold. If so, interrupt the network connection between the VR terminal cluster and the cloud platform; if not, keep the current network connection between the VR terminal cluster and the cloud platform unchanged.

[0113] The beneficial effects of the above embodiments are as follows: Obtain the display visual parameters such as the display resolution or display contrast of the virtual images of all VR terminals under the VR terminal cluster. If the display resolution is less than the preset resolution threshold or the display contrast is less than the preset contrast threshold, it is determined that the VR terminal is not in the normal display state; otherwise, it is determined that the VR terminal is in the normal display state. Then, a second instruction message containing a stop display instruction is pushed to the VR terminals that are not in the normal display state. In this way, after receiving the second instruction message, the VR terminals that are not in the normal display state will switch to the non-display active state (i.e., not display the corresponding virtual image), thus avoiding the VR terminals from affecting the user's image viewing experience. In addition, determine whether the number of VR terminals in the display active state under each VR terminal cluster is less than a preset number threshold. When the number of VR terminals in the display active state under the VR terminal cluster is less than the preset number threshold, interrupt the network connection between the VR terminal cluster and the cloud platform to avoid the VR terminal cluster occupying the data transmission bandwidth of the cloud platform and improving the data transmission efficiency of the cloud platform to other VR terminal clusters.

[0114] Generally speaking, the multi-VR terminal message pushing method and system for the cloud platform are based on the working state information of all VR terminals, divide all VR terminals into several VR terminal clusters, determine the network connection information of each VR terminal cluster in the cloud network, and perform differentiated control and management on all VR terminals, reducing the message interaction workload between the cloud platform and the VR terminals; also sample and analyze the video stream data of the VR terminals under the VR terminal cluster, identify the VR terminals that have video stream transmission abnormal events, and push the first instruction message accordingly, so that the VR terminals that have video stream transmission abnormal events change their current network connection state and improve the video data reception efficiency of the VR terminals; also based on the display state information of the VR terminals, push the second instruction message to adjust the working state of the VR terminals and adjust the connection state of the corresponding VR terminal cluster and the cloud platform, improving the control efficiency and reliability of the multi-VR terminals.

[0115] The above is only a specific embodiment of the present invention, and any improvement made on the premise of the present invention concept is regarded as the protection scope of the present invention.

Claims

1. A multi-VR terminal message pushing method for a cloud platform, characterized in that, Including: Identifying all VR terminals currently connected to the cloud platform to obtain the working status information of each VR terminal; Based on the working status information, dividing all VR terminals into several VR terminal clusters and determining the network connection information of each VR terminal cluster in the cloud network; Sampling video stream data of all VR terminals under the VR terminal cluster to obtain corresponding video stream data samples; Analyzing the video stream data samples to identify the VR terminals in the VR terminal cluster where video stream transmission abnormal events occur; Based on the network connection information, pushing a first instruction message to the VR terminals where video stream transmission abnormal events occur, so that the VR terminals where video stream transmission abnormal events occur change their current network connection status; Based on the display status information of all VR terminals under the VR terminal cluster, pushing a second instruction message to the corresponding VR terminals under the VR terminal cluster to adjust the working status of the corresponding VR terminals under the VR terminal cluster; and based on the actual active VR terminal status information of each VR terminal cluster, adjusting the connection status between each VR terminal cluster and the cloud platform.

2. The multi-VR terminal message pushing method for a cloud platform according to claim 1, characterized in that: Identifying all VR terminals currently connected to the cloud platform to obtain the working status information of each VR terminal; based on the working status information, dividing all VR terminals into several VR terminal clusters and determining the network connection information of each VR terminal cluster in the cloud network, including: Obtaining the work logs of all VR terminals currently connected to the cloud platform, analyzing the work logs to obtain the VR display task execution status information of each VR terminal; wherein, the VR display task execution status information includes the virtual scene type information of the VR display task currently executed by the VR terminal and the VR display task execution progress information; Based on the VR display task execution status information, dividing all VR terminals into several VR terminal clusters, where all VR terminals under each VR terminal cluster have the same virtual scene type information of the VR display task and the VR display task execution progress information; Obtaining the access gateway address information of all VR terminals under each VR terminal cluster in the cloud network, and based on the access gateway address information, determining the connection network path information of all VR terminals under each VR terminal cluster to the cloud platform.

3. The multi-VR terminal message pushing method for a cloud platform according to claim 1, characterized in that: Sampling video stream data of all VR terminals under the VR terminal cluster to obtain corresponding video stream data samples; analyzing the video stream data samples to identify the VR terminals in the VR terminal cluster where video stream transmission abnormal events occur; Based on the network connection information, pushing a first instruction message to the VR terminals where video stream transmission abnormal events occur, so that the VR terminals where video stream transmission abnormal events occur change their current network connection status, including: Perform video stream data sampling on all VR terminals under the VR terminal cluster to obtain video stream data samples transmitted by the cloud platform to each VR terminal; analyze the video stream data samples to obtain the transmission distortion degree and transmission delay value of the video stream data of each VR terminal; if the transmission distortion degree is greater than the preset distortion degree threshold or the transmission delay value, determine that a video stream transmission abnormal event occurs for the corresponding VR terminal; otherwise, determine that a video stream transmission abnormal event does not occur for the corresponding VR terminal; Based on the connection network path information between the VR terminal where the video stream transmission abnormal event occurs and the cloud platform, push a first instruction message containing a gateway connection switching instruction to the VR terminal where the video stream transmission abnormal event occurs, so that the VR terminal where the video stream transmission abnormal event occurs changes the network path connected to the cloud platform.

4. The multi-VR terminal message pushing method for a cloud platform according to claim 3, wherein: Performing video stream data sampling on all VR terminals under the VR terminal cluster includes: Step S1, using the following formula (1), obtain the difference value between the action image of the current frame and the action image of the previous frame of the collected video stream data, In the above formula (1), Q(a) represents the difference value between the action image of the current a-th frame and the action image of the previous frame in the collected video stream data; a represents the frame number of the current action image in the collected video stream data; D a (i, j) represents the pixel value of the pixel point at the i-th row and j-th column in the action image of the current a-th frame in the collected video stream data; D a-1 (i, j) represents the pixel value of the pixel point at the i-th row and j-th column in the action image of the current (a - 1)-th frame in the collected video stream data; || represents taking the absolute value; m represents the total number of pixel points in any row in the action image of the collected video stream data; n represents the total number of pixel points in any column in the action image of the collected video stream data; Step S2, using the following formula (2), according to the difference value between the action image of the current frame and the action image of the previous frame of the collected video stream data, obtain the sampling duration for the next action image sampling of the video stream data, In the above formula (2), T(a + 1) represents the sampling duration of the action image for collecting the (a + 1)-th frame of the video stream data; T(a) represents the sampling duration of the action image for collecting the a-th frame of the video stream data; D max represents the maximum value of the pixels of the action image; T(1) represents the initial sampling duration; T0 represents the preset sampling duration; Step S3, using the following formula (3), according to the action images of the video stream data collected continuously five times, judge whether there is a lag phenomenon in the video stream data, In the above formula (3), E(a) represents the determination value for judging whether there is a lag phenomenon in the video stream data; k represents an integer variable; T(a-k) represents the sampling duration of the action image of the a-kth frame of the video stream data collected; If E(a)=1, it means that there is a lag phenomenon in the video stream data, and at this time, stop collecting the video stream data If E(a)=0, it means that there is no lag phenomenon in the video stream data, and at this time, keep the current collection state of the video stream data unchanged.

5. The multi-VR terminal message pushing method for a cloud platform according to claim 1, wherein: Based on the display state information of all VR terminals under the VR terminal cluster, push a second instruction message to the corresponding VR terminal under the VR terminal cluster to adjust the working state of the corresponding VR terminal under the VR terminal cluster; And based on the actual active VR terminal state information of each VR terminal cluster, adjust the connection state between each VR terminal cluster and the cloud platform, including: Obtain the virtual image display visual parameters of all VR terminals under the VR terminal cluster, and based on the virtual image display visual parameters, judge whether the VR terminal is in a normal display state; if the VR terminal is not in a normal display state, push a second instruction message containing a stop display instruction to the VR terminal to switch the VR terminal to a non-display active state; Determine whether the number of VR terminals in the display active state under each VR terminal cluster is less than a preset number threshold. If so, interrupt the network connection between the VR terminal cluster and the cloud platform; if not, keep the current network connection between the VR terminal cluster and the cloud platform unchanged.

6. A multi-VR terminal message push system for a cloud platform, characterized in that, Including: A VR terminal identification module, configured to identify all VR terminals currently connected to the cloud platform to obtain the working state information of each VR terminal. A VR terminal division module, configured to divide all VR terminals into several VR terminal clusters based on the working state information, and determine the network connection information of each VR terminal cluster in the cloud network. A VR terminal anomaly judgment module, configured to sample video stream data of all VR terminals under the VR terminal cluster to obtain corresponding video stream data samples. Analyze the video stream data samples to identify the VR terminals in the VR terminal cluster where video stream transmission anomaly events occur. A first message push module, configured to push a first instruction message to the VR terminals where video stream transmission anomaly events occur based on the network connection information, so that the VR terminals where video stream transmission anomaly events occur change their current network connection states. A second message push module, configured to push a second instruction message to the corresponding VR terminals under the VR terminal cluster based on the display state information of all VR terminals under the VR terminal cluster, thereby adjusting the working states of the corresponding VR terminals under the VR terminal cluster. A connection state adjustment module, configured to adjust the connection states between each VR terminal cluster and the cloud platform based on the actual active VR terminal state information of all VR terminal clusters.

7. The multi-VR terminal message push system for a cloud platform according to claim 6, wherein: The VR terminal identification module is configured to identify all VR terminals currently connected to the cloud platform to obtain the working state information of each VR terminal, including: Obtain the work logs of all VR terminals currently connected to the cloud platform, analyze the work logs to obtain the VR display task execution state information of each VR terminal; wherein, the VR display task execution state information includes the virtual scene type information of the VR display task currently executed by the VR terminal and the VR display task execution progress information. The VR terminal division module is configured to divide all VR terminals into several VR terminal clusters based on the working state information, and determine the network connection information of each VR terminal cluster in the cloud network, including: Divide all VR terminals into several VR terminal clusters based on the VR display task execution state information, where all VR terminals under each VR terminal cluster have the same virtual scene type information of the VR display task and the VR display task execution progress information. Obtain the access gateway address information of all VR terminals under each VR terminal cluster in the cloud network, and determine the connection network path information between each VR terminal cluster and the cloud platform based on the access gateway address information.

8. The multi-VR terminal message push system for a cloud platform according to claim 6, wherein: The VR terminal anomaly judgment module is used to sample video stream data of all VR terminals under the VR terminal cluster to obtain corresponding video stream data samples; Analyze the video stream data samples to identify the VR terminals in the VR terminal cluster where video stream transmission anomaly events occur, including: Respectively sample the video stream data of all VR terminals under the VR terminal cluster to obtain the video stream data samples transmitted by the cloud platform to each VR terminal; analyze the video stream data samples to obtain the transmission distortion degree and transmission delay value of the video stream data of each VR terminal; if the transmission distortion degree is greater than the preset distortion degree threshold or the transmission delay value, determine that the corresponding VR terminal has a video stream transmission anomaly event; otherwise, determine that the corresponding VR terminal has not had a video stream transmission anomaly event; The first message push module is used to push a first instruction message to the VR terminals where video stream transmission anomaly events occur based on the network connection information, so that the VR terminals where video stream transmission anomaly events occur change the current network connection state, including: Based on the connection network path information between the VR terminal where a video stream transmission anomaly event occurs and the cloud platform, push a first instruction message containing a gateway connection switching instruction to the VR terminal where a video stream transmission anomaly event occurs, so that the VR terminal where a video stream transmission anomaly event occurs changes the network path connected to the cloud platform.

9. The multi-VR terminal message push system for a cloud platform according to claim 6, wherein: The second message push module is used to push a second instruction message to the corresponding VR terminals under the VR terminal cluster based on the display state information of all VR terminals under the VR terminal cluster, so as to adjust the working state of the corresponding VR terminals under the VR terminal cluster, including: Obtain the virtual image display visual parameters of all VR terminals under the VR terminal cluster respectively, and judge whether the VR terminal is in a normal display state based on the virtual image display visual parameters; if the VR terminal is not in a normal display state, push a second instruction message containing a stop display instruction to the VR terminal, so as to switch the VR terminal to a non-display active state; The connection state adjustment module is used to adjust the connection state between each VR terminal cluster and the cloud platform based on the actual active VR terminal state information of all VR terminal clusters, including: Judge whether the number of VR terminals in the display active state under each VR terminal cluster is less than the preset number threshold. If so, interrupt the network connection between the VR terminal cluster and the cloud platform; if not, keep the current network connection between the VR terminal cluster and the cloud platform unchanged.

Images