Multi-VR terminal operation interaction control method and system in same virtual scene

Abstract

The invention provides a multi-VR terminal operation interaction control method and system in the same virtual scene, and the method comprises the steps: sending a connection invitation to different VR terminals based on the real-time operation state of a VR scene platform, and carrying out the connection configuration of the VR terminals based on the response information of the VR terminals and the real-time VR terminal connection state of the VR scene platform, so as to enable a plurality of VR terminals to be connected to the same VR scene; a virtual scene interaction request initiated by the VR terminal is obtained based on the state information of the VR terminal, so that interaction demand identification can be conveniently carried out on the subordinate VR terminal of the VR scene; according to the method, the virtual scene interaction request is sent to other VR terminals, interaction connection instructions are sent to other VR terminals based on the virtual scene interaction request, interaction operation of different VR terminals in the same virtual scene is achieved, VR working states of other VR terminals are adjusted based on the interaction connection instructions, real-time interaction of multiple VR terminals in the same virtual scene is achieved, and display verisimilitude and flexibility of a VR virtual display scene are improved.

Description

Technical Field

[0001] The present invention relates to the field of VR interactive display, and particularly to a method and system for interactive control of multiple VR terminals running in the same virtual scene. Background Art

[0002] VR virtual display can provide users with a realistic immersive display experience. Users can view virtual images through wearing a head-mounted VR display device and interact with virtual objects in the virtual display scene. Existing VR virtual display operations are limited to a single VR display device, that is, different VR display devices only allow the display of virtual images in their respective virtual display scenes. Different VR display devices cannot effectively interact in the same virtual scene, and it is impossible for users wearing different VR display devices to have one-on-one interactions in the same virtual scene, reducing the display realism and flexibility of the VR virtual display scene. Summary of the Invention

[0003] The purpose of the present invention is to provide a method and system for interactive control of multiple VR terminals running in the same virtual scene. Based on the real-time operating state of the VR scene platform, connection invitations are sent to different VR terminals, and based on the response messages of the VR terminals to the connection invitations and the real-time VR terminal connection state of the VR scene platform, VR terminal connection configuration is performed, so that multiple VR terminals can be connected to the same VR scene; based on the status information of the VR terminals, virtual scene interaction requests initiated by the VR terminals are obtained, facilitating the identification of interaction requirements for VR terminals subordinate to the VR scene; and then based on the virtual scene interaction requests, interaction connection instructions are sent to other VR terminals to achieve interactive operations of different VR terminals in the same virtual scene, and based on the interaction connection instructions, the VR working states of other VR terminals are adjusted to achieve real-time interaction of multiple VR terminals in the same virtual scene, improving the display realism and flexibility of the VR virtual display scene.

[0004] The present invention is realized through the following technical solutions:

[0005] A method for interactive control of multiple VR terminals running in the same virtual scene includes:

[0006] Based on the real-time operating state of the VR scene platform, sending connection invitations to different VR terminals; based on the response messages of the VR terminals to the connection invitations and the real-time VR terminal connection state of the VR scene platform, performing connection permission configuration on the VR terminals;

[0007] Obtain the first status information and the second status information of each VR terminal currently connected to the VR scenario platform; based on the first status information, determine whether the VR terminal is in a normal display state; if the VR terminal is in a normal display state, then based on the second status information, obtain the virtual scenario interaction request initiated by the VR terminal;

[0008] Based on the virtual scenario interaction request, send an interaction connection instruction to other VR terminals currently connected to the VR scenario platform; based on the interaction connection instruction, adjust the VR working state of other VR terminals.

[0009] Optionally, based on the real-time operating state of the VR scenario platform, send connection invitations to different VR terminals; based on the response message of the VR terminal to the connection invitation and the real-time VR terminal connection state of the VR scenario platform, configure the connection permissions for the VR terminal, including:

[0010] Analyze the operation log of the VR scenario platform to obtain the real-time virtual scenario display status information of the VR scenario platform; based on the real-time virtual scenario display status information, determine whether a virtual scenario display change event occurs in the VR scenario platform;

[0011] When a virtual scenario display change event occurs in the VR scenario platform, instruct the VR scenario platform to send connection invitations to different VR terminals; extract the response time from the response message of the VR terminal to the connection invitation, if the response time does not exceed the preset time threshold and the real-time VR terminal connection number of the VR scenario platform does not exceed the preset number threshold, then determine that the VR terminal has the connection permission to the VR scenario platform; otherwise, determine that the VR terminal does not have the connection permission to the VR scenario platform.

[0012] Optionally, when the number of VR terminals that meet the condition that the response time does not exceed the preset time threshold is 0, adjust the preset time threshold, including:

[0013] Step S1, set the number of VR terminals invited this time as I, i is the number of each invited VR terminal, i is an integer greater than or equal to 1 and less than or equal to I, Y ij is the j-th historical delay data of the VR terminal numbered i, use the following formula (1) to determine the theoretical network delay of the VR terminal numbered i,

[0014]

[0015] In the above formula (1), F ij represents the theoretical network delay of the VR terminal numbered i; J represents the total number of historical delay data of the VR terminal numbered i;

[0016] Step S2, using the following formula (2), the average delay and the standard deviation of the delay of the VR terminals in this invitation

[0017]

[0018] In the above formula (2), A I represents the average delay of the VR terminals in this invitation; S I represents the standard deviation of the delay of the VR terminals in this invitation;

[0019] Step S3, using the following formula (3), determine the adjusted time threshold

[0020]

[0021] In the above formula (3), T I represents the adjusted time threshold; T represents the original preset time threshold.

[0022] Optionally, obtain the respective first status information and second status information of all VR terminals currently connected to the VR scene platform; based on the first status information, determine whether the VR terminal is in a normal display state; if the VR terminal is in a normal display state, then based on the second status information, obtain the virtual scene interaction requests initiated by the VR terminal, including:

[0023] Obtain the respective wearing posture information of all VR terminals currently connected to the VR scene platform and the voice information or action information initiated by the user to the VR terminal;

[0024] Analyze the wearing posture information to determine whether the VR image display range of the VR terminal in the current wearing posture matches the user's viewing field of view; if the two match, then determine that the VR terminal is in a normal display state; if the two do not match, then determine that the VR terminal is not in a normal display state;

[0025] If the VR terminal is in a normal display state, then parse the voice information or the action information to obtain the interaction requirement information that the user expects the VR terminal to have with other terminals connected to the VR scene platform; based on the interaction requirement information, generate the virtual scene interaction request corresponding to the VR terminal.

[0026] Optionally, based on the virtual scene interaction request, send an interaction connection instruction to other VR terminals currently connected to the VR scene platform; based on the interaction connection instruction, adjust the VR working states of other VR terminals, including:

[0027] Parse and process the virtual scene interaction request to determine the identity information of other VR terminals that the VR terminal expects to interact and connect with in the virtual scene currently displayed on the VR scene platform; based on the identity information, send an interaction connection instruction to the other VR terminals.

[0028] Analyze the response message of the other VR terminals regarding the interaction connection instruction to determine whether the other VR terminals accept the interaction connection with the VR terminal; if so, establish a communication channel between the other VR terminals and the VR terminal, and adjust the other VR terminals to have the same virtual scene viewing field as the VR terminal.

[0029] The multi-VR terminal operation interaction control system under the same virtual scene includes:

[0030] The VR terminal invitation module is used to send connection invitations to different VR terminals based on the real-time operation status of the VR scene platform.

[0031] The VR terminal connection configuration module is used to configure the connection permissions of the VR terminal based on the response message of the VR terminal to the connection invitation and the real-time VR terminal connection status of the VR scene platform.

[0032] The VR terminal status acquisition module is used to acquire the respective first status information and second status information of all VR terminals currently connected to the VR scene platform.

[0033] The virtual scene interaction request determination module is used to determine whether the VR terminal is in a normal display state based on the first status information; if the VR terminal is in a normal display state, obtain the virtual scene interaction request initiated by the VR terminal based on the second status information.

[0034] The interaction connection instruction sending module is used to send an interaction connection instruction to other VR terminals currently connected to the VR scene platform based on the virtual scene interaction request.

[0035] The VR working state adjustment module is used to adjust the VR working state of other VR terminals based on the interaction connection instruction.

[0036] Optionally, the VR terminal invitation module is used to send connection invitations to different VR terminals based on the real-time operation status of the VR scene platform, including:

[0037] Analyze the operation log of the VR scene platform to obtain the real-time virtual scene display status information of the VR scene platform; based on the real-time virtual scene display status information, determine whether a virtual scene display change event has occurred on the VR scene platform.

[0038] When a virtual scene display change event occurs in the VR scene platform, it instructs the VR scene platform to send connection invitations to different VR terminals;

[0039] The VR terminal connection configuration module is used to configure the connection permissions of the VR terminal based on the response message of the VR terminal to the connection invitation and the real-time VR terminal connection status of the VR scene platform, including:

[0040] Extract the response time from the response message of the VR terminal to the connection invitation. If the response time does not exceed the preset time threshold and the real-time number of VR terminal connections of the VR scene platform does not exceed the preset number threshold, it is determined that the VR terminal has the connection permission to the VR scene platform; otherwise, it is determined that the VR terminal does not have the connection permission to the VR scene platform.

[0041] Optionally, the VR terminal status acquisition module is used to acquire the respective first status information and second status information of all VR terminals currently connected to the VR scene platform, including:

[0042] Acquire the wearing posture information of all VR terminals currently connected to the VR scene platform and the voice information or action information initiated by the user to the VR terminal;

[0043] The virtual scene interaction request determination module is used to determine whether the VR terminal is in a normal display state based on the first status information; if the VR terminal is in a normal display state, then based on the second status information, obtain the virtual scene interaction request initiated by the VR terminal, including:

[0044] Analyze the wearing posture information to determine whether the VR image display range of the VR terminal in the current wearing posture matches the user's viewing field range; if the two match, it is determined that the VR terminal is in a normal display state; if the two do not match, it is determined that the VR terminal is not in a normal display state;

[0045] If the VR terminal is in a normal display state, then parse the voice information or the action information to obtain the interaction requirement information between the other terminals that the user expects the VR terminal to connect to the VR scene platform; based on the interaction requirement information, generate the virtual scene interaction request corresponding to the VR terminal.

[0046] Optionally, the interaction connection instruction sending module is used to send interaction connection instructions to other VR terminals currently connected to the VR scene platform based on the virtual scene interaction request, including:

[0047] Parse and process the virtual scene interaction request to determine the identity information of other VR terminals that the VR terminal expects to interact and connect with in the virtual scene currently displayed on the VR scene platform; based on the identity information, send an interaction connection instruction to the other VR terminals;

[0048] The VR working state adjustment module is used to adjust the VR working states of other VR terminals based on the interaction connection instruction, including:

[0049] Analyze the response message of the other VR terminals regarding the interaction connection instruction to determine whether the other VR terminals accept the interaction connection with the VR terminal; if so, construct a communication channel between the other VR terminals and the VR terminal, and adjust the other VR terminals to have the same virtual scene viewing field of view as the VR terminal.

[0050] Compared with the prior art, the present invention has the following beneficial effects:

[0051] The multi-VR terminal operation interaction control method and system under the same virtual scene provided by the present application send connection invitations to different VR terminals based on the real-time operation state of the VR scene platform, and perform VR terminal connection configuration based on the response messages of the VR terminals and the real-time VR terminal connection state of the VR scene platform, so that multiple VR terminals can be connected to the same VR scene; based on the state information of the VR terminals, obtain the virtual scene interaction requests initiated by the VR terminals, which is convenient for identifying the interaction requirements of the VR terminals under the VR scene; then, based on the virtual scene interaction requests, send interaction connection instructions to other VR terminals to realize the interaction operations of different VR terminals in the same virtual scene, and adjust the VR working states of other VR terminals based on the interaction connection instructions to achieve real-time interaction of multiple VR terminals in the same virtual scene, improving the display vividness and flexibility of the VR virtual display scene. BRIEF DESCRIPTION OF THE DRAWINGS

[0052] In order to more clearly illustrate the technical solutions in the embodiments of the present invention or the prior art, the following will briefly introduce the drawings required for use in the description of the embodiments or the prior art. Obviously, the following drawings are only some embodiments of the present invention. For those of ordinary skill in the art, other drawings can be obtained based on these drawings without creative efforts. Among them:

[0053] Figure 1 It is a schematic flowchart of the multi-VR terminal operation interaction control method under the same virtual scene provided by the present invention.

[0054] Figure 2 It is a schematic structural diagram of the multi-VR terminal operation interaction control system under the same virtual scene provided by the present invention. Detailed implementation manners

[0055] To make the above objects, features, and advantages of the present application more obvious and understandable, the following will describe in detail the specific implementation manners of the present application with reference to the accompanying drawings. It can be understood that the specific embodiments described herein are only used to explain the present application, rather than limiting the present application. In addition, it should be noted that for the convenience of description, only parts related to the present application rather than all structures are shown in the accompanying drawings. Based on the embodiments in the present application, all other embodiments obtained by those of ordinary skill in the art without creative efforts belong to the scope of protection of the present application.

[0056] The terms "include" and "have" in the present application and any variations thereof are intended to cover non-exclusive inclusion. For example, a process, method, system, product, or device that includes a series of steps or units is not limited to the listed steps or units, but optionally further includes steps or units not listed, or optionally further includes other steps or units inherent to these processes, methods, products, or devices.

[0057] Referring to "embodiments" herein means that the specific features, structures, or characteristics described in connection with the embodiments can be included in at least one embodiment of the present application. The phrase appears in various places in the specification does not necessarily refer to the same embodiment, nor is it an independent or alternative embodiment mutually exclusive with other embodiments. Those skilled in the art explicitly and implicitly understand that the embodiments described herein can be combined with other embodiments.

[0058] Please refer to Figure 1 As shown, the multi-VR terminal operation interaction control method under the same virtual scenario provided by an embodiment of the present application includes:

[0059] Based on the real-time operation state of the VR scene platform, send connection invitations to different VR terminals; based on the response message of the VR terminal to the connection invitation and the real-time VR terminal connection state of the VR scene platform, configure the connection permissions of the VR terminal;

[0060] Obtain the respective first status information and second status information of all VR terminals currently connected to the VR scene platform; based on the first status information, determine whether the VR terminal is in a normal display state; if the VR terminal is in a normal display state, then based on the second status information, obtain the virtual scene interaction request initiated by the VR terminal;

[0061] Based on the virtual scene interaction request, send interaction connection instructions to other VR terminals currently connected to the VR scene platform; based on the interaction connection instructions, adjust the VR working states of other VR terminals.

[0062] Beneficial effects of the above embodiments. The multi-VR terminal operation interaction control method in the same virtual scenario is based on the real-time operation state of the VR scenario platform, sends connection invitations to different VR terminals, and configures the VR terminal connections based on the response messages of the VR terminals and the real-time VR terminal connection state of the VR scenario platform, enabling multiple VR terminals to connect to the same VR scenario; based on the status information of the VR terminals, virtual scenario interaction requests initiated by the VR terminals are obtained, facilitating the identification of interaction requirements for the VR terminals subordinate to the VR scenario; then, based on the virtual scenario interaction requests, interaction connection instructions are sent to other VR terminals to achieve interactive operations of different VR terminals in the same virtual scenario, and based on the interaction connection instructions, the VR working states of other VR terminals are adjusted to achieve real-time interaction of multiple VR terminals in the same virtual scenario, improving the display realism and flexibility of the VR virtual display scenario.

[0063] In another embodiment, based on the real-time operation state of the VR scenario platform, connection invitations are sent to different VR terminals; based on the response message of the VR terminal to the connection invitation and the real-time VR terminal connection state of the VR scenario platform, connection permission configuration is performed on the VR terminal, including:

[0064] Analyze the operation log of the VR scenario platform to obtain the real-time virtual scenario display status information of the VR scenario platform; based on the real-time virtual scenario display status information, determine whether a virtual scenario display change event has occurred on the VR scenario platform;

[0065] When a virtual scenario display change event occurs on the VR scenario platform, instruct the VR scenario platform to send connection invitations to different VR terminals; extract the response time from the response message of the VR terminal to the connection invitation. If the response time does not exceed the preset time threshold and the real-time VR terminal connection number of the VR scenario platform does not exceed the preset number threshold, it is determined that the VR terminal has the connection permission to the VR scenario platform; otherwise, it is determined that the VR terminal does not have the connection permission to the VR scenario platform.

[0066] The beneficial effects of the above embodiments are as follows. The VR scenario platform is used to provide corresponding virtual scenario video data sources for different VR terminals. After the VR terminal is connected to the VR scenario platform, the VR scenario platform will send corresponding virtual scenario video data to the VR terminal according to the requirements of the VR terminal, so that the VR terminal can display the corresponding virtual scenario. Among them, the VR terminal can be, but is not limited to, a head-mounted or glasses-type VR display device. By analyzing the operation log of the VR scenario platform, the real-time virtual scenario display status information of the VR scenario platform is obtained. The real-time virtual scenario display status information can be, but is not limited to, the transmission progress information of the virtual scenario video data transmitted from the VR scenario platform to the VR terminal. According to the real-time virtual scenario display status information, it is judged whether the VR scenario platform has completed the transmission of the corresponding virtual scenario video data. If it has been completed, it is judged that the VR scenario platform has a virtual scenario display change event; if it has not been completed, it is judged that the VR scenario platform has not had a virtual scenario display change event. When the VR scenario platform has a virtual scenario display change event, it instructs the VR scenario platform to send connection invitations to different VR terminals, which is convenient for the VR scenario platform to replace the connected VR terminals in a timely manner. Extract the response time from the response message of the VR terminal to the connection invitation. If the response time does not exceed the preset time threshold and the real-time VR terminal connection number of the VR scenario platform does not exceed the preset number threshold, it is determined that the VR terminal has the connection permission to the VR scenario platform; otherwise, it is determined that the VR terminal does not have the connection permission to the VR scenario platform, ensuring the timely and accurate connection between the VR scenario platform and the VR terminal.

[0067] In another embodiment, when the number of VR terminals that meet the condition that the response time does not exceed the preset time threshold is 0, the preset time threshold is adjusted, including:

[0068] Step S1, set the number of VR terminals invited this time as I, i is the number of each invited VR terminal, i is an integer greater than or equal to 1 and less than or equal to I, and Y ij is the jth historical delay data of the VR terminal numbered i. Using the following formula (1), determine the theoretical network delay of the VR terminal numbered i.

[0069]

[0070] In the above formula (1), F ij represents the theoretical network delay of the VR terminal numbered i; J represents the total number of historical delay data of the VR terminal numbered i;

[0071] Step S2, use the following formula (2) to calculate the delay mean and delay standard deviation of the VR terminals invited this time.

[0072]

[0073] In the above formula (2), A I represents the average delay of the VR terminals for this invitation; S I represents the standard deviation of the delay of the VR terminals for this invitation;

[0074] Step S3, use the following formula (3) to determine the adjusted time threshold,

[0075]

[0076] In the above formula (3), T I represents the adjusted time threshold; T represents the original preset time threshold.

[0077] The beneficial effects of the above embodiments are as follows. Since the delays in different network environments are different, when the number of real-time VR terminal connections of the VR scene platform within the preset time threshold is 0, it is necessary to consider the influence of the delay, so as to relax the preset time threshold and give sufficient response time for each VR terminal connection invitation to ensure that there are a sufficient number of VR terminal connections. For example, the preset time threshold is 2 seconds, but the network delays of all VR terminal devices for a certain connection invitation are greater than 2 seconds, which will inevitably result in no response time of VR terminal devices within the preset time threshold, thus resulting in the number of VR terminal connections always being 0. Therefore, to solve the above problems, when the number of real-time VR terminal connections of the VR scene platform within the preset time threshold is 0, the preset time threshold is adjusted accordingly to ensure that there are a sufficient number of VR terminal connections.

[0078] In another embodiment, obtain the respective first state information and second state information of all VR terminals currently connected to the VR scene platform; based on the first state information, judge whether the VR terminal is in a normal display state; if the VR terminal is in a normal display state, then based on the second state information, obtain the virtual scene interaction requests initiated by the VR terminal, including:

[0079] Obtain the respective wearing posture information of all VR terminals currently connected to the VR scene platform and the voice information or action information initiated by the user for the VR terminal;

[0080] Analyze the wearing posture information to judge whether the VR image display range of the VR terminal in the current wearing posture matches the user's viewing field range; if the two match, then judge that the VR terminal is in a normal display state; if the two do not match, then judge that the VR terminal is not in a normal display state;

[0081] If the VR terminal is in a normal display state, then parse the voice information or the action information to obtain the interactive demand information of the user's expectation for the interaction between the VR terminal and other terminals connected to the VR scene platform; based on the interactive demand information, generate a virtual scene interaction request corresponding to the VR terminal.

[0082] The beneficial effects of the above embodiments are as follows: obtain the wearing posture information of each VR terminal currently connected to the VR scene platform and the voice information or action information initiated by the user to the VR terminal, and use them as the first state information and the second state information of the VR terminal. Then analyze the wearing posture information to determine whether the VR image display range of the VR terminal in the current wearing posture matches the user's viewing field of view, that is, determine whether there is an overlapping area range between the VR image display range of the VR terminal in the current wearing posture and the user's viewing field of view. If there is, it is determined that the two match, and it is determined that the VR terminal is in a normal display state. If not, it is determined that the VR terminal is not in a normal display state. At this time, the user needs to adjust the wearing posture of the VR terminal to adjust the VR terminal to a normal display state. When the VR terminal is in a normal display state, perform voice parsing or action posture parsing on the voice information or action information initiated by the user to the VR terminal to obtain the interactive demand information of the user's expectation for the interaction between the VR terminal and other terminals connected to the VR scene platform; then, based on the interactive demand information, generate a virtual scene interaction request corresponding to the VR terminal, which is convenient for subsequent selection of corresponding VR terminals from other VR terminals connected to the VR scene platform for interaction.

[0083] In another embodiment, based on the virtual scene interaction request, send an interactive connection instruction to other VR terminals currently connected to the VR scene platform; based on the interactive connection instruction, adjust the VR working state of other VR terminals, including:

[0084] Parse and process the virtual scene interaction request to determine the identity information of other VR terminals that the VR terminal expects to interact and connect with in the virtual scene currently displayed on the VR scene platform; based on the identity information, send an interactive connection instruction to the other VR terminals;

[0085] Analyze the response message of the other VR terminal regarding the interactive connection instruction to determine whether the other VR terminal accepts to interact and connect with the VR terminal; if so, construct a communication channel between the other VR terminal and the VR terminal, and adjust the other VR terminal to have the same virtual scene viewing field as the VR terminal.

[0086] The beneficial effects of the above embodiments are as follows: parsing and processing the virtual scene interaction request to determine the identity information of other VR terminals that the VR terminal expects to interact with in the virtual scene currently displayed on the VR scene platform. Based on this identity information, select corresponding VR terminals from the VR terminals connected to the VR scene platform and send an interaction connection instruction to ensure the interaction accuracy between VR terminals. Then analyze the response message of other VR terminals regarding this interaction connection instruction to determine whether the other VR terminals accept the interaction connection with this VR terminal. If accepted, construct a communication channel between the other VR terminal and this VR terminal, and adjust the other VR terminal to have the same virtual scene viewing field as this VR terminal, so that there is a synchronized virtual scene display operation between this VR terminal and the other VR terminal, improving the interaction accuracy between the two.

[0087] Please refer to Figure 2 As shown in the figure, the multi-VR terminal operation interaction control system under the same virtual scene provided by an embodiment of the present application includes:

[0088] The VR terminal invitation module is used to send connection invitations to different VR terminals based on the real-time operating status of the VR scene platform;

[0089] The VR terminal connection configuration module is used to configure the connection permission for the VR terminal based on the response message of the VR terminal to the connection invitation and the real-time VR terminal connection status of the VR scene platform;

[0090] The VR terminal status acquisition module is used to acquire the respective first status information and second status information of all VR terminals currently connected to the VR scene platform;

[0091] The virtual scene interaction request determination module is used to determine whether the VR terminal is in a normal display state based on the first status information; if the VR terminal is in a normal display state, then based on the second status information, obtain the virtual scene interaction request initiated by the VR terminal;

[0092] The interaction connection instruction sending module is used to send an interaction connection instruction to other VR terminals currently connected to the VR scene platform based on the virtual scene interaction request;

[0093] The VR working state adjustment module is used to adjust the VR working state of other VR terminals based on the interaction connection instruction.

[0094] Beneficial effects of the above embodiments. The multi-VR terminal operation interaction control system in the same virtual scenario sends connection invitations to different VR terminals based on the real-time operating status of the VR scenario platform, and performs VR terminal connection configuration based on the response messages of the VR terminals and the real-time VR terminal connection status of the VR scenario platform, enabling multiple VR terminals to be connected to the same VR scenario. Based on the status information of the VR terminals, virtual scenario interaction requests initiated by the VR terminals are obtained, facilitating the identification of interaction requirements for VR terminals under the VR scenario. Then, based on the virtual scenario interaction requests, interaction connection instructions are sent to other VR terminals to implement interactive operations of different VR terminals in the same virtual scenario, and based on the interaction connection instructions, the VR working status of other VR terminals is adjusted to achieve real-time interaction of multiple VR terminals in the same virtual scenario, improving the display realism and flexibility of the VR virtual display scenario.

[0095] In another embodiment, the VR terminal invitation module is used to send connection invitations to different VR terminals based on the real-time operating status of the VR scenario platform, including:

[0096] Analyze the operation log of the VR scenario platform to obtain the real-time virtual scenario display status information of the VR scenario platform; based on the real-time virtual scenario display status information, determine whether a virtual scenario display change event has occurred on the VR scenario platform;

[0097] When a virtual scenario display change event occurs on the VR scenario platform, instruct the VR scenario platform to send connection invitations to different VR terminals;

[0098] The VR terminal connection configuration module is used to configure the connection permissions of the VR terminal based on the response message of the VR terminal to the connection invitation and the real-time VR terminal connection status of the VR scenario platform, including:

[0099] Extract the response time from the response message of the VR terminal to the connection invitation. If the response time does not exceed the preset time threshold and the real-time VR terminal connection number of the VR scenario platform does not exceed the preset number threshold, it is determined that the VR terminal has the connection permission to the VR scenario platform; otherwise, it is determined that the VR terminal does not have the connection permission to the VR scenario platform.

[0100] The beneficial effects of the above embodiments are as follows. The VR scenario platform is used to provide corresponding virtual scenario video data sources for different VR terminals. After the VR terminal is connected to the VR scenario platform, the VR scenario platform will send corresponding virtual scenario video data to the VR terminal according to the requirements of the VR terminal, enabling the VR terminal to display corresponding virtual scenarios. Among them, the VR terminal can be, but is not limited to, a head-mounted or glasses-type VR display device. By analyzing the operation logs of the VR scenario platform, the real-time virtual scenario display status information of the VR scenario platform is obtained. The real-time virtual scenario display status information can be, but is not limited to, the transmission progress information of the virtual scenario video data transmitted from the VR scenario platform to the VR terminal. According to this real-time virtual scenario display status information, it is judged whether the VR scenario platform has completed the transmission of the corresponding virtual scenario video data. If it has been completed, it is judged that the VR scenario platform has experienced a virtual scenario display change event; if it has not been completed, it is judged that the VR scenario platform has not experienced a virtual scenario display change event. When the VR scenario platform experiences a virtual scenario display change event, it instructs the VR scenario platform to send connection invitations to different VR terminals, facilitating the VR scenario platform to promptly replace the connected VR terminals. The response time is extracted from the response message of the VR terminal to the connection invitation. If the response time does not exceed the preset time threshold and the real-time number of connected VR terminals of the VR scenario platform does not exceed the preset number threshold, it is determined that the VR terminal has the connection permission to the VR scenario platform; otherwise, it is determined that the VR terminal does not have the connection permission to the VR scenario platform, ensuring the timely and accurate connection between the VR scenario platform and the VR terminal.

[0101] In another embodiment, the VR terminal status acquisition module is used to acquire the respective first status information and second status information of all VR terminals currently connected to the VR scenario platform, including:

[0102] Acquire the wearing posture information of all VR terminals currently connected to the VR scenario platform and the voice information or action information initiated by the user to the VR terminal;

[0103] The virtual scenario interaction request determination module is used to judge whether the VR terminal is in a normal display state based on the first status information; if the VR terminal is in a normal display state, then based on the second status information, obtain the virtual scenario interaction request initiated by the VR terminal, including:

[0104] Analyze the wearing posture information to judge whether the VR image display range of the VR terminal in the current wearing posture matches the user's viewing field of view range; if the two match, it is judged that the VR terminal is in a normal display state; if the two do not match, it is judged that the VR terminal is not in a normal display state;

[0105] If the VR terminal is in a normal display state, parse the voice information or the action information to obtain the interactive demand information of the other terminals that the user expects the VR terminal to connect to the VR scene platform; based on the interactive demand information, generate a virtual scene interaction request corresponding to the VR terminal.

[0106] The beneficial effects of the above embodiments are as follows: Obtain the wearing posture information of each VR terminal currently connected to the VR scene platform and the voice information or action information initiated by the user to the VR terminal, and use this as the first state information and the second state information of the VR terminal. Then analyze the wearing posture information to determine whether the VR image display range of the VR terminal in the current wearing posture matches the user's viewing field range, that is, determine whether there is an overlapping area range between the VR image display range of the VR terminal in the current wearing posture and the user's viewing field range. If there is, it is determined that the two match, and it is determined that the VR terminal is in a normal display state. If not, it is determined that the VR terminal is not in a normal display state. At this time, the user needs to adjust the wearing posture of the VR terminal to adjust the VR terminal to the normal display state. When the VR terminal is in a normal display state, perform voice parsing or action posture parsing on the voice information or action information initiated by the user to the VR terminal to obtain the interactive demand information of the other terminals that the user expects the VR terminal to connect to the VR scene platform; then, based on the interactive demand information, generate a virtual scene interaction request corresponding to the VR terminal, which is convenient for subsequent selection of corresponding VR terminals from other VR terminals connected to the VR scene platform for interaction.

[0107] In another embodiment, the interactive connection instruction sending module is used to send an interactive connection instruction to other VR terminals currently connected to the VR scene platform based on the virtual scene interaction request, including:

[0108] Parse and process the virtual scene interaction request to determine the identity information of the other VR terminals that the VR terminal expects to interact with in the virtual scene currently displayed on the VR scene platform; based on the identity information, send an interactive connection instruction to the other VR terminals.

[0109] The VR working state adjustment module is used to adjust the VR working state of other VR terminals based on the interactive connection instruction, including:

[0110] Analyze the response message of the other VR terminal regarding the interactive connection instruction to determine whether the other VR terminal accepts the interactive connection with the VR terminal; if so, construct a communication channel between the other VR terminal and the VR terminal, and adjust the other VR terminal to have the same virtual scene viewing field as the VR terminal.

[0111] The beneficial effects of the above embodiments are as follows: analyze and process the virtual scene interaction request, determine the identity information of other VR terminals that the VR terminal expects to interact and connect with in the virtual scene currently displayed on the VR scene platform, and based on this identity information, select corresponding VR terminals from the VR terminals connected to the VR scene platform to send interaction connection instructions, ensuring the interaction accuracy between VR terminals. Then analyze the response messages of other VR terminals regarding the interaction connection instructions to determine whether the other VR terminals accept the interaction connection with the VR terminal. If accepted, establish a communication channel between the other VR terminal and the VR terminal, and adjust the other VR terminal to have the same virtual scene viewing field as the VR terminal, enabling synchronized virtual scene display operations between the VR terminal and the other VR terminal and improving the interaction accuracy between the two.

[0112] Generally speaking, the multi-VR terminal operation interaction control method and system under the same virtual scene, based on the real-time operation state of the VR scene platform, send connection invitations to different VR terminals, and based on the response messages of the VR terminals and the real-time VR terminal connection state of the VR scene platform, perform VR terminal connection configuration, enabling multiple VR terminals to be connected to the same VR scene; based on the status information of the VR terminals, obtain the virtual scene interaction requests initiated by the VR terminals, facilitating the identification of interaction requirements for the VR terminals under the VR scene; then based on the virtual scene interaction requests, send interaction connection instructions to other VR terminals, realizing the interaction operations of different VR terminals in the same virtual scene, and based on the interaction connection instructions, adjust the VR working states of other VR terminals, achieving real-time interaction of multiple VR terminals in the same virtual scene and improving the display vividness and flexibility of the VR virtual display scene.

[0113] The above is only a specific implementation manner of the present invention, and any improvements made on the premise of the present invention's concept are regarded as the protection scope of the present invention.

Claims

1. A method for interactive control of multi-VR terminal operation in the same virtual scenario, characterized in that, Including: Sending connection invitations to different VR terminals based on the real-time operating status of the VR scene platform; Configuring connection permissions for the VR terminals based on the response messages of the VR terminals to the connection invitations and the real-time VR terminal connection status of the VR scene platform; Obtaining the respective first status information and second status information of all VR terminals currently connected to the VR scene platform; Based on the first status information, determining whether the VR terminal is in a normal display state; If the VR terminal is in a normal display state, then based on the second status information, obtaining the virtual scene interaction request initiated by the VR terminal; Based on the virtual scene interaction request, sending an interaction connection instruction to other VR terminals currently connected to the VR scene platform; and adjusting the VR working status of other VR terminals based on the interaction connection instruction.

2. The method for interactive control of multi-VR terminal operation in the same virtual scene according to claim 1, characterized in that: Sending connection invitations to different VR terminals based on the real-time operating status of the VR scene platform; Configuring connection permissions for the VR terminals based on the response messages of the VR terminals to the connection invitations and the real-time VR terminal connection status of the VR scene platform, including: Analyzing the operation log of the VR scene platform to obtain the real-time virtual scene display status information of the VR scene platform; and based on the real-time virtual scene display status information, determining whether a virtual scene display change event occurs in the VR scene platform; When a virtual scene display change event occurs in the VR scene platform, instructing the VR scene platform to send connection invitations to different VR terminals; extracting the response time from the response messages of the VR terminals to the connection invitations, and if the response time does not exceed a preset time threshold and the real-time VR terminal connection number of the VR scene platform does not exceed a preset number threshold, determining that the VR terminal has the connection permission to the VR scene platform; otherwise, determining that the VR terminal does not have the connection permission to the VR scene platform.

3. The method for interactive control of multi-VR terminal operation in the same virtual scene according to claim 2, characterized in that: When the number of VR terminals that meet the condition that the response time does not exceed the preset time threshold is 0, adjusting the preset time threshold, including: Step S1, set the number of VR terminals for this invitation as I, where i is the number of each invitation VR terminal, and i is an integer greater than or equal to 1 and less than or equal to I, Y ij is the j-th historical delay data of the VR terminal numbered i. Using the following formula (1), determine the theoretical network delay of the VR terminal numbered i In the above formula (1), F ij represents the theoretical network latency of the VR terminal numbered i; J represents the total number of historical latency data of the VR terminal numbered i; Step S2, using the following formula (2), the delay mean and delay standard deviation of the VR terminals invited this time, In the above formula (2), A I represents the average latency of the VR terminals for this invitation; SI represents the standard deviation of the latency of the VR terminals for this invitation; Step S3, using the following formula (3), determining the adjusted time threshold, In the above common (3), T I represents the adjusted time threshold; T represents the original preset time threshold.

4. The method for interactive control of multi-VR terminal operation in the same virtual scene according to claim 1, characterized in that: Obtaining the respective first status information and second status information of all VR terminals currently connected to the VR scene platform; and based on the first status information, determining whether the VR terminal is in a normal display state; If the VR terminal is in a normal display state, then based on the second status information, obtaining the virtual scene interaction request initiated by the VR terminal, including: Obtain the wearing posture information of each VR terminal currently connected to the VR scene platform and the voice information or action information initiated by the user for the VR terminal. Analyze the wearing posture information to determine whether the VR image display range of the VR terminal in the current wearing posture matches the user's viewing field of view range; if the two match, it is determined that the VR terminal is in a normal display state; if the two do not match, it is determined that the VR terminal is not in a normal display state. If the VR terminal is in a normal display state, parse the voice information or the action information to obtain the interactive demand information of the user's expectation for the interaction between the VR terminal and other terminals connected to the VR scene platform; based on the interactive demand information, generate a virtual scene interaction request corresponding to the VR terminal.

5. The multi-VR terminal operation interaction control method in the same virtual scene as claimed in claim 1, characterized in that: Based on the virtual scene interaction request, send an interaction connection instruction to other VR terminals currently connected to the VR scene platform. Based on the interaction connection instruction, adjust the VR working state of other VR terminals, including: Parse and process the virtual scene interaction request to determine the identity information of other VR terminals that the VR terminal expects to interact and connect with in the virtual scene currently displayed on the VR scene platform; based on the identity information, send an interaction connection instruction to the other VR terminals; analyze the response message of the other VR terminals regarding the interaction connection instruction to determine whether the other VR terminals accept to interact and connect with the VR terminal; if so, construct a communication channel between the other VR terminals and the VR terminal, and adjust the other VR terminals to have the same virtual scene viewing field of view as the VR terminal.

6. Multi-VR terminal operation interaction control system under the same virtual scenario, characterized in that, Including: A VR terminal invitation module for sending connection invitations to different VR terminals based on the real-time operating state of the VR scene platform. A VR terminal connection configuration module for configuring the connection permissions of the VR terminal based on the response message of the VR terminal to the connection invitation and the real-time VR terminal connection state of the VR scene platform. A VR terminal state acquisition module for acquiring the first state information and the second state information of each VR terminal currently connected to the VR scene platform. A virtual scene interaction request determination module for determining whether the VR terminal is in a normal display state based on the first state information. If the VR terminal is in a normal display state, obtain the virtual scene interaction request initiated by the VR terminal based on the second state information. An interaction connection instruction sending module for sending an interaction connection instruction to other VR terminals currently connected to the VR scene platform based on the virtual scene interaction request. A VR working state adjustment module for adjusting the VR working state of other VR terminals based on the interaction connection instruction.

7. The multi-VR terminal operation interaction control system in the same virtual scene as claimed in claim 6, characterized in that: The VR terminal invitation module is used to send connection invitations to different VR terminals based on the real-time operating status of the VR scenario platform, including: Analyze the operation log of the VR scenario platform to obtain the real-time virtual scenario display status information of the VR scenario platform; based on the real-time virtual scenario display status information, determine whether a virtual scenario display change event occurs in the VR scenario platform; When a virtual scenario display change event occurs in the VR scenario platform, instruct the VR scenario platform to send connection invitations to different VR terminals; The VR terminal connection configuration module is used to configure the connection permissions of the VR terminal based on the response message of the VR terminal to the connection invitation and the real-time VR terminal connection status of the VR scenario platform, including: Extract the response time from the response message of the VR terminal to the connection invitation. If the response time does not exceed the preset time threshold and the real-time VR terminal connection number of the VR scenario platform does not exceed the preset number threshold, determine that the VR terminal has the connection permission to the VR scenario platform; otherwise, determine that the VR terminal does not have the connection permission to the VR scenario platform.

8. The multi-VR terminal operation interaction control system in the same virtual scenario according to claim 6, wherein: The VR terminal status acquisition module is used to acquire the respective first status information and second status information of all VR terminals currently connected to the VR scenario platform, including: Acquire the respective wearing postures of all VR terminals currently connected to the VR scenario platform and the voice information or action information initiated by the user to the VR terminal; The virtual scenario interaction request determination module is used to determine whether the VR terminal is in a normal display state based on the first status information; if the VR terminal is in a normal display state, obtain the virtual scenario interaction request initiated by the VR terminal based on the second status information, including: Analyze the wearing posture information to determine whether the VR image display range of the VR terminal in the current wearing posture matches the user's viewing field range; if the two match, determine that the VR terminal is in a normal display state; if the two do not match, determine that the VR terminal is not in a normal display state; If the VR terminal is in a normal display state, parse the voice information or the action information to obtain the interaction requirement information between the other terminals that the user expects the VR terminal to connect to the VR scenario platform; based on the interaction requirement information, generate the virtual scenario interaction request corresponding to the VR terminal.

9. The multi-VR terminal operation interaction control system in the same virtual scenario according to claim 6, wherein: The interaction connection instruction sending module is used to send interaction connection instructions to other VR terminals currently connected to the VR scenario platform based on the virtual scenario interaction request, including: Parse and process the virtual scene interaction request to determine the identity information of other VR terminals that the VR terminal expects to interact with in the virtual scene currently displayed on the VR scene platform; based on the identity information, send an interaction connection instruction to the other VR terminals; the VR working state adjustment module is used to adjust the VR working state of other VR terminals based on the interaction connection instruction, including: Analyze the response message of the other VR terminals regarding the interaction connection instruction to determine whether the other VR terminals accept the interaction connection with the VR terminal; if so, establish a communication channel between the other VR terminals and the VR terminal, and adjust the other VR terminals to have the same virtual scene viewing field of view as the VR terminal.

Images