A multi-user collaboration method, system and medium across applications

Abstract

The present invention discloses a multi-user collaboration method, system and medium across applications. The present invention includes registering a synchronization unit model for a VR terminal according to a registration request, waiting for the VR terminal to send a state change event of the synchronization unit model, parsing the state change event of the synchronization unit model, and generating a corresponding state change trigger event if the state change event of the synchronization unit model is received, and broadcasting the state change trigger event to all VR terminals, so that each VR terminal responds to the state change trigger event to update the model state change and visual rendering screen of each synchronization unit model in the local virtual reality scene. The present invention can realize multi-user collaboration across applications in virtual reality, meet the collaborative interaction requirements between different VR terminals in virtual reality applications, such as meeting the multi-user collaboration requirements of multi-position and multi-trade training in virtual reality in different VR terminals.

Description

Technical Field

[0001] The present invention relates to the field of virtual reality (VR) technology, and in particular to a multi-user collaboration method, system and medium across application programs. Background Art

[0002] Traditional virtual reality (VR) is generally single-player. Even if it includes multi-player collaboration, current multi-player collaboration is based on the same program (same scene) and cannot cross different scenes and programs. Collaboration between different programs also relies on data dump integration, and is not applied in the field of virtual reality. It is only implemented in some online documents and information systems. With the development of virtual reality technology and its application in the field of practical training, there is an increasing demand for collaborative training in multiple positions and projects. The nature of work in different positions has different requirements for VR terminals, and the applications and interaction methods installed on different terminals are completely different. Therefore, how to achieve multi-player collaboration across applications in virtual reality has become a key technical problem that needs to be solved urgently. Summary of the invention

[0003] Technical problem to be solved by the present invention: In view of the above-mentioned problems in the prior art, a cross-application multi-user collaboration method, system and medium are provided. The present invention can realize cross-application multi-person collaboration in virtual reality and meet the collaborative interaction needs between different VR terminals in virtual reality applications. For example, it can meet the multi-person collaboration needs of multi-position and multi-trade training in virtual reality on different VR terminals.

[0004] In order to solve the above technical problems, the technical solution adopted by the present invention is:

[0005] A multi-user collaboration method across applications, including:

[0006] S101, registering a synchronization unit model for a VR terminal according to a registration request;

[0007] S102, waiting for the VR terminal to send a state change event of the synchronization unit model. If a state change event of the synchronization unit model is received, the state change event of the synchronization unit model is parsed, and a corresponding state change trigger event is generated, and the state change trigger event is broadcast to all VR terminals, so that each VR terminal responds to the state change trigger event to update the model state change and visual rendering screen of each synchronization unit model in the local virtual reality scene.

[0008] Optionally, when parsing the state change event of the synchronization unit model in step S102, it also includes determining the current online state mark of the synchronization unit model. If the current online state mark is online, a corresponding state change trigger event is generated, otherwise a message indicating that the current online state mark is offline is returned to the VR terminal that sent the state change event of the synchronization unit model.

[0009] Optionally, generating a corresponding state change triggering event in step S102 refers to querying a preset state change event-state change triggering event relationship table according to the state change event to obtain a corresponding state change triggering event.

[0010] Optionally, the state change triggering event in step S102 includes one or more synchronization unit models, and a model state change or a changed model state corresponding to the synchronization unit model.

[0011] Optionally, in step S102, each VR terminal responds to the state change trigger event to update the model state change and visual rendering screen of each synchronization unit model in the local virtual reality scene, including: for the synchronization unit model in the state change trigger event, if the synchronization unit model exists in the current VR terminal, then the model state of the synchronization unit model is updated, otherwise the trigger event of the synchronization unit model is discarded; and a new visual rendering screen is generated by re-rendering according to the new model state of the synchronization unit model.

[0012] Optionally, when the state change trigger event is broadcast to all VR terminals in step S102, the virtual reality management applications in each VR terminal are partially or completely different, and the virtual reality management applications in each VR terminal use the same communication protocol to communicate with the server used to broadcast the state change trigger event.

[0013] Optionally, before step S101, the step of pre-establishing a synchronization unit model warehouse is also included, wherein the synchronization unit model warehouse contains multiple synchronization unit models and their model states that can be registered, and an initialization state change event-state change trigger event relationship table is used to register state change events and their corresponding state change trigger events for each synchronization unit model respectively, and the synchronization unit models, state change events and state change trigger events are all represented by globally unified numbers or names.

[0014] In addition, the present invention also provides a cross-application multi-user collaboration system, including a server and one or more VR terminals connected to the server, wherein the server is programmed or configured to execute the cross-application multi-user collaboration method.

[0015] In addition, the present invention also provides a cross-application multi-user collaboration system, comprising a microprocessor and a memory connected to each other, wherein the microprocessor is programmed or configured to execute the cross-application multi-user collaboration method.

[0016] In addition, the present invention also provides a computer-readable storage medium, in which a computer program is stored. The computer program is used to be programmed or configured by a microprocessor to execute the cross-application multi-user collaboration method.

[0017] Compared with the prior art, the present invention mainly has the following advantages:

[0018] The present invention includes registering a synchronization unit model for a VR terminal according to a registration request, waiting for the VR terminal to send a state change event of the synchronization unit model, and if a state change event of the synchronization unit model is received, parsing the state change event of the synchronization unit model, and generating a corresponding state change trigger event, and broadcasting the state change trigger event to all VR terminals, so that each VR terminal responds to the state change trigger event to update the model state change and visual rendering screen of each synchronization unit model in the local virtual reality scene. Through the above method, multi-person collaboration across applications in virtual reality can be realized, and the collaborative interaction requirements between different VR terminals in virtual reality applications can be met, such as meeting the multi-person collaboration requirements of multi-position and multi-work training in virtual reality on different VR terminals. The present invention can realize real-time multi-person collaborative training in virtual reality without changing the interaction mode of the application and user habits, and intercommunication of data between applications on different devices and presenting them on different terminals in real time with different visual representations. BRIEF DESCRIPTION OF THE DRAWINGS

[0019] Figure 1 Schematic diagram of the basic flow of the method of the embodiment of the present invention.

[0020] Figure 2 The figure is a schematic diagram of the deployment process of the method according to the embodiment of the present invention.

[0021] Figure 3 This is a collaborative example of two VR terminals (VR terminal 1 and VR terminal 2) in an embodiment of the present invention. DETAILED DESCRIPTION

[0022] like Figure 1 As shown, the multi-user collaboration method across applications in this embodiment includes:

[0023] S101, registering a synchronization unit model for a VR terminal according to a registration request;

[0024] S102, waiting for the VR terminal to send a state change event of the synchronization unit model. If a state change event of the synchronization unit model is received, the state change event of the synchronization unit model is parsed, and a corresponding state change trigger event is generated, and the state change trigger event is broadcast to all VR terminals, so that each VR terminal responds to the state change trigger event to update the model state change and visual rendering screen of each synchronization unit model in the local virtual reality scene.

[0025] The synchronization unit model mentioned above refers to a component model that can be used as a whole to control the model state in the virtual reality scene, such as a joystick, a valve switch, etc. It can be specified according to actual needs in different virtual reality scenes.

[0026] Considering that some synchronization unit models may have online and offline status issues, for example, a valve switch should not be operated under normal circumstances, this embodiment uses an online status mark for the synchronization unit model to manage the online and offline status. When parsing the state change event of the synchronization unit model in step S102, it also includes judging the current online status mark of the synchronization unit model. If the current online status mark is online, a corresponding state change trigger event is generated, otherwise a message indicating that the current online status mark is offline is returned to the VR terminal that sent the state change event of the synchronization unit model.

[0027] The core of generating the corresponding state change trigger event in step S102 is to realize the mapping between the state change event and the state change trigger event. An achievable mapping method can be adopted as needed. For example, as an optional implementation method, generating the corresponding state change trigger event in step S102 of this embodiment refers to querying the preset state change event-state change trigger event relationship table according to the state change event to obtain the corresponding state change trigger event.

[0028] Taking into account that the state change event of the synchronization unit model may trigger a model state change of one or more synchronization unit models, the state change trigger event in step S102 of this embodiment includes one or more synchronization unit models, which can be represented by an array or a collection, as well as the model state change or the changed model state corresponding to the synchronization unit model.

[0029] In addition, in order to simplify the communication between the execution subject (usually the server) of step S101 and step S102 and the VR terminal, and avoid the overhead caused by handshake and querying the synchronization unit model, the execution subject (usually the server) of step S102 in this embodiment broadcasts the state change trigger event to all VR terminals, so that there is no need to determine whether the VR terminal contains the synchronization unit model, and the broadcast method can realize one-to-many communication, which can effectively reduce the communication overhead. At the same time, considering that the VR terminal may receive invalid state change trigger event information, each VR terminal in step S102 responds to the state change trigger event to update the model state change and visual rendering screen of each synchronization unit model in the local virtual reality scene, including: for the synchronization unit model in the state change trigger event, if the synchronization unit model exists in the VR terminal, the model state of the synchronization unit model is updated, otherwise the trigger event of the synchronization unit model is discarded; re-rendering generates a new visual rendering screen according to the new model state of the synchronization unit model.

[0030] As mentioned above, one of the key technical problems to be solved by the method of this embodiment is to achieve collaboration between different types of VR terminals. Therefore, when broadcasting the state change trigger event to all VR terminals in step S102, the virtual reality management applications in each VR terminal are partially or completely different, and the virtual reality management applications in each VR terminal use the same communication protocol to communicate with the server used to broadcast the state change trigger event. In addition, the method of this embodiment can also use collaboration between multiple VR terminals of the same type. The core of this embodiment is to interconnect through the same communication protocol, realize decoupling between VR terminals, and can easily achieve collaboration between different types or the same type of VR terminals.

[0031] In this embodiment, before step S101, there is also a step of pre-establishing a synchronization unit model warehouse, wherein the synchronization unit model warehouse contains multiple synchronization unit models and their model states available for registration, and initializes a state change event-state change trigger event relationship table to register state change events and their corresponding state change trigger events for each synchronization unit model, and the synchronization unit models, state change events, and state change trigger events are all represented by globally unified numbers or names. Figure 2The deployment process of the method of this embodiment includes: defining a synchronization unit model, defining the synchronization unit model at the item level, defining all synchronization unit models such as models, scenes and virtual characters involved in the interaction according to the functional requirements of the training in virtual reality, and organizing the status of the above synchronization unit models, defining the triggering events of the state change, and uniformly numbering the synchronization unit models and events. For the event synchronization mechanism, a standard communication protocol is designed, and the protocol includes the above synchronization identification number and the corresponding event number. After the application is launched, all the numbered synchronization unit models in the program will send the online registration information to the server, and the server will allocate an event cache for each synchronization unit model. The server will send a communication broadcast to the synchronization unit model associated with the event based on the event communication data, and all applications involving the synchronization unit model will receive the event data. On the application side, the received event is parsed in an event-driven manner, and the state change and visual presentation of the synchronization unit models such as models, scenes, and characters that should occur under the event are coded.

[0032] Figure 3 This is an example of the method of this embodiment, wherein: VR terminal 1 is a head-screening VR helmet device, the server is a multi-person collaborative server, and VR terminal 2 is a desktop VR device. VR terminal 1 is logged in by the user, and the model A and model B corresponding to the program installed by VR terminal 1 are registered to the server and marked as online; VR terminal 2 is operated by the user, and the model A corresponding to the program installed by VR terminal 2 is registered to the server and marked as online. Model A and model B in VR terminal 1 have changed their states due to user interaction, thereby synchronizing the state change event to the server. The server verifies through the rule engine that the state change of model A triggers event E1, and the state change of model B triggers event E2, and broadcasts E1 and E2 events to all registered terminals. After receiving E1 and E2 events, VR terminal 1 changes the state of model A according to the event E1 rule, and changes the state of model B according to the event E2 plan. After receiving E1 and E2 events, VR terminal 2 changes the state of model A according to the event E1 rule, and discards the E2 event because event E2 does not match the corresponding model B.

[0033] In summary, the cross-application multi-user collaboration method of this embodiment can realize cross-application multi-user collaboration in virtual reality, and meet the collaborative interaction requirements between different VR terminals in virtual reality applications, such as meeting the multi-user collaboration requirements of multi-position and multi-job training in virtual reality on different VR terminals. The present invention can realize real-time multi-user collaborative training in virtual reality without changing the interaction mode of the application and user habits, and can communicate data between applications on different devices and present them on different terminals in real time with different visual representations.

[0034] In addition, this embodiment also provides a cross-application multi-user collaboration system, including a server and one or more VR terminals connected to the server, wherein the server is programmed or configured to execute the cross-application multi-user collaboration method.

[0035] In addition, this embodiment also provides a cross-application multi-user collaboration system, including a microprocessor and a memory connected to each other, wherein the microprocessor is programmed or configured to execute the cross-application multi-user collaboration method.

[0036] In addition, this embodiment further provides a computer-readable storage medium, in which a computer program is stored. The computer program is used to be programmed or configured by a microprocessor to execute the cross-application multi-user collaboration method.

[0037] Those skilled in the art should understand that the embodiments of the present application can be provided as methods, systems, or computer program products. Therefore, the present application can take the form of a complete hardware embodiment, a complete software embodiment, or an embodiment combining software and hardware. Moreover, the present application can take the form of a computer program product implemented on one or more computer-readable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code. The present application is described with reference to the flowcharts and / or block diagrams of the methods, devices (systems), and computer program products according to the embodiments of the present application. It should be understood that each process and / or box in the flowchart and / or block diagram, as well as the combination of the processes and / or boxes in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing device to produce a machine, so that the instructions executed by the processor of the computer or other programmable data processing device generate instructions for implementing the processes in the process Figure 1 A process or multiple processes and / or boxes Figure 1 These computer program instructions can also be stored in a computer-readable memory that can guide a computer or other programmable data processing device to work in a specific way, so that the instructions stored in the computer-readable memory produce a product including an instruction device, which implements the functions specified in the process. Figure 1 A process or multiple processes and / or boxes Figure 1 These computer program instructions can also be loaded onto a computer or other programmable data processing device, so that a series of operation steps are executed on the computer or other programmable device to produce a computer-implemented process, so that the instructions executed on the computer or other programmable device provide for implementing the process in the process. Figure 1A process or multiple processes and / or boxes Figure 1 The steps for the functions specified in one or more boxes.

[0038] The above is only a preferred embodiment of the present invention, and the protection scope of the present invention is not limited to the above embodiments. All technical solutions under the concept of the present invention belong to the protection scope of the present invention. It should be pointed out that for ordinary technicians in this technical field, some improvements and modifications without departing from the principle of the present invention should also be regarded as the protection scope of the present invention.

Claims

1. A multi-user collaboration method across applications, characterized in that: include: S101, registering a synchronization unit model for a VR terminal according to a registration request; S102, waiting for the VR terminal to send a state change event of the synchronization unit model. If the state change event of the synchronization unit model is received, the state change event of the synchronization unit model is parsed, and a corresponding state change trigger event is generated, and the state change trigger event is broadcast to all VR terminals, so that each VR terminal responds to the state change trigger event to update the model state change and visual rendering screen of each synchronization unit model in the local virtual reality scene; When parsing the state change event of the synchronization unit model in step S102, it also includes determining the current online state mark of the synchronization unit model. If the current online state mark is online, a corresponding state change trigger event is generated, otherwise a message indicating that the current online state mark is offline is returned to the VR terminal that sent the state change event of the synchronization unit model. Before step S101, the method also includes the step of pre-establishing a synchronization unit model warehouse, wherein the synchronization unit model warehouse contains multiple synchronization unit models and their model states that can be registered, and initializes a state change event-state change trigger event relationship table to register state change events and their corresponding state change trigger events for each synchronization unit model respectively, and the synchronization unit models, state change events and state change trigger events are all represented by globally unified numbers or names.

2. The cross-application multi-user collaboration method according to claim 1, characterized in that: Generating the corresponding state change trigger event in step S102 refers to querying a preset state change event-state change trigger event relationship table according to the state change event to obtain the corresponding state change trigger event.

3. The cross-application multi-user collaboration method according to claim 2, characterized in that: The state change triggering event in step S102 includes one or more synchronization unit models, and the model state change or the changed model state corresponding to the synchronization unit model.

4. The cross-application multi-user collaboration method according to claim 3, characterized in that: In step S102, each VR terminal responds to the state change trigger event to update the model state change and visual rendering screen of each synchronization unit model in the local virtual reality scene, including: for the synchronization unit model in the state change trigger event, if the synchronization unit model exists in the current VR terminal, the model state of the synchronization unit model is updated, otherwise the trigger event of the synchronization unit model is discarded; and a new visual rendering screen is generated by re-rendering according to the new model state of the synchronization unit model.

5. The cross-application multi-user collaboration method according to claim 4, characterized in that: When the state change trigger event is broadcast to all VR terminals in step S102, the virtual reality management applications in each VR terminal are partially or completely different, and the virtual reality management applications in each VR terminal use the same communication protocol to communicate with the server used to broadcast the state change trigger event.

6. A multi-user collaborative system across applications, comprising a server and one or more VR terminals connected to the server, characterized in that: The server is programmed or configured to execute the cross-application multi-user collaboration method according to any one of claims 1 to 5.

7. A multi-user collaborative system across applications, comprising interconnected microprocessors and memories, characterized in that: The microprocessor is programmed or configured to execute the cross-application multi-user collaboration method according to any one of claims 1 to 5.

8. A computer-readable storage medium having a computer program stored therein, characterized in that: The computer program is used to be programmed or configured by a microprocessor to execute the cross-application multi-user collaboration method according to any one of claims 1 to 5.

Images