Multi-person teaching cooperation method, device and equipment and storage medium

Abstract

The embodiment of the invention discloses a multi-person teaching cooperation method and device, equipment and a storage medium. According to the technical scheme provided by the embodiment of the invention, the first scene change data sent by the first terminal equipment and / or the second scene change data sent by the second terminal equipment are / is received, and the first scene change data are sent to the second terminal equipment, so that the second terminal equipment performs scene updating processing; and / or sending second scene change data to the first terminal device, so that the first terminal device performs scene updating processing, and when the first scene change data and the second scene change data have change overlapping, updating the scene. And the first scene change data and the second scene change data are merged based on a set operation merging strategy to obtain first merged change data, and scene updating processing is performed on the three-dimensional teaching scene according to the first merged change data, so that the multi-person teaching cooperation efficiency is effectively improved.

Description

Technical Field

[0001] The embodiments of the present application relate to the field of computer technology, and in particular to a multi-person teaching collaboration method, device, equipment and storage medium. Background Art

[0002] With the popularity of VR (Virtual Reality) technology, more and more schools have adopted VR technology in experimental teaching. In VR teaching scenarios, there are generally teacher VR device ends and student VR device ends. Teachers and students use VR devices to enter their own VR scenes respectively. The VR scenes of teachers and students are isolated and uncoordinated.

[0003] Traditional high-end VR scene collaboration adopts the teaching mode solution, that is, the teacher initiates the teaching mode and synchronizes it to the student end to achieve one-way collaboration from the teacher end to the student end. In order to enhance the interaction between teachers and students, lock operation is generally used for multi-end and multi-directional collaboration between the teacher end and the student end. However, the lock operation or center state conflict merging method can only have one user operate at the same time, and the efficiency of multi-person teaching collaboration is low. Summary of the invention

[0004] The embodiments of the present application provide a multi-person teaching collaboration method, device, equipment and storage medium to solve the technical problem that multi-person teaching collaboration in the related technology uses a lock operation method so that only one user can operate at the same time, and the efficiency of multi-person teaching collaboration is low, thereby effectively improving the efficiency of multi-person teaching collaboration.

[0005] In a first aspect, an embodiment of the present application provides a multi-person teaching collaboration method, including:

[0006] In response to a three-dimensional teaching scene acquisition request from a first terminal device and / or a second terminal device, sending three-dimensional teaching scene data to the first terminal device and / or the second terminal device, so that the first terminal device and / or the second terminal device can display the three-dimensional teaching scene based on the three-dimensional teaching scene data;

[0007] receiving first scene change data sent by the first terminal device, and / or second scene change data sent by the second terminal device, wherein the first scene change data is generated by the first terminal device based on a three-dimensional scene operation performed on the three-dimensional teaching scene, and the second scene change data is generated by the second terminal device based on a three-dimensional operation performed on the three-dimensional teaching scene;

[0008] The first scene change data is sent to the second terminal device so that the second terminal device can perform scene update processing on the three-dimensional teaching scene in the second terminal device based on the first scene change data, and / or the second scene change data is sent to the first terminal device so that the first terminal device can perform scene update processing on the three-dimensional teaching scene in the first terminal device based on the second scene change data, wherein, when there is overlap in changes between the first scene change data and the second scene change data, the first terminal device and the second terminal device merge the first scene change data and the second scene change data based on a set operation merging strategy to obtain first merged change data, and perform scene update processing on the three-dimensional teaching scene according to the first merged change data.

[0009] In a second aspect, an embodiment of the present application provides a multi-person teaching collaboration device, including a response acquisition module, a data receiving module, and a data collaboration module, wherein:

[0010] The acquisition response module is used to respond to the three-dimensional teaching scene acquisition request of the first terminal device and / or the second terminal device, and send the three-dimensional teaching scene data to the first terminal device and / or the second terminal device, so that the first terminal device and / or the second terminal device can display the three-dimensional teaching scene based on the three-dimensional teaching scene data;

[0011] The data receiving module is used to receive first scene change data sent by the first terminal device and / or second scene change data sent by the second terminal device, the first scene change data is generated by the first terminal device based on a three-dimensional scene operation performed on the three-dimensional teaching scene, and the second scene change data is generated by the second terminal device based on a three-dimensional operation performed on the three-dimensional teaching scene;

[0012] The data collaboration module is used to send the first scene change data to the second terminal device so that the second terminal device can perform scene update processing on the three-dimensional teaching scene in the second terminal device based on the first scene change data, and / or send the second scene change data to the first terminal device so that the first terminal device can perform scene update processing on the three-dimensional teaching scene in the first terminal device based on the second scene change data, wherein, when there is overlap in the changes of the first scene change data and the second scene change data, the first terminal device and the second terminal device merge the first scene change data and the second scene change data based on a set operation merging strategy to obtain first merged change data, and perform scene update processing on the three-dimensional teaching scene according to the first merged change data.

[0013] In a third aspect, an embodiment of the present application provides a multi-person teaching collaborative device, including: a memory and one or more processors;

[0014] The memory is used to store one or more programs;

[0015] When the one or more programs are executed by the one or more processors, the one or more processors implement the multi-person teaching collaborative method as described in the first aspect.

[0016] In a fourth aspect, an embodiment of the present application provides a storage medium storing computer executable instructions, which, when executed by a computer processor, are used to execute the multi-person teaching collaborative method as described in the first aspect.

[0017] In an embodiment of the present application, upon receiving a three-dimensional teaching scene acquisition request from the first terminal device and / or the second terminal device, three-dimensional teaching scene data is sent to the first terminal device and / or the second terminal device to display the three-dimensional teaching scene, first scene change data sent by the first terminal device, and / or second scene change data sent by the second terminal device are received, and the first scene change data is sent to the second terminal device for the second terminal device to perform scene update processing, and / or the second scene change data is sent to the first terminal device for the first terminal device to perform scene update processing, and when there is overlap in the first scene change data and the second scene change data, the first scene change data and the second scene change data are merged based on a set operation merging strategy to obtain first merged change data, and the three-dimensional teaching scene is updated according to the first merged change data, so that multi-terminal and multi-directional collaboration of multi-person teaching can be achieved without using a lock operation to lock the elements in the three-dimensional teaching scene, thereby effectively improving the efficiency of multi-person teaching collaboration. BRIEF DESCRIPTION OF THE DRAWINGS

[0018] Figure 1 It is a flow chart of a multi-person teaching collaborative method provided by an embodiment of the present application;

[0019] Figure 2 It is a structural diagram of a multi-person teaching collaborative system provided by an embodiment of the present application;

[0020] Figure 3 is a flow chart of another multi-person teaching collaborative method provided in an embodiment of the present application;

[0021] Figure 4 is a structural diagram of another multi-person teaching collaborative system provided in an embodiment of the present application;

[0022] Figure 5 It is a structural schematic diagram of a multi-person teaching collaborative device provided in an embodiment of the present application;

[0023] Figure 6 It is a structural diagram of a multi-person teaching collaborative device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0024] In order to make the purpose, technical scheme and advantages of the present application clearer, the specific embodiments of the present application are further described in detail below in conjunction with the accompanying drawings. It is understood that the specific embodiments described herein are only used to explain the present application, rather than to limit the present application. It should also be noted that, for the convenience of description, only the part related to the present application but not all the contents are shown in the accompanying drawings. Before discussing the exemplary embodiments in more detail, it should be mentioned that some exemplary embodiments are described as processes or methods depicted as flow charts. Although the flow chart describes each operation (or step) as a sequential process, many of the operations therein can be implemented in parallel, concurrently or simultaneously. In addition, the order of each operation can be rearranged. The above process can be terminated when its operation is completed, but it can also have additional steps not included in the accompanying drawings. The above process can correspond to a method, a function, a procedure, a subroutine, a subprogram, etc.

[0025] The multi-person teaching collaboration method provided in this application can be applied to multi-terminal and multi-directional synchronization in multi-person VR experimental teaching. It aims to collaboratively distribute the scene change data of the terminal device to each terminal device through a collaborative distribution service, and each terminal device updates the scene. When there is a conflict in the scene change data of different terminal devices, each terminal device merges the conflicting scene change data into the first merged change data based on the set operation merging strategy, and updates the three-dimensional teaching scene according to the first merged change data, so as to realize multi-terminal and multi-directional collaboration of multi-person teaching and effectively improve the efficiency of multi-person teaching collaboration.

[0026] In the existing multi-person teaching collaboration scheme, it is generally implemented by pessimistic locking or central state conflict merging. Pessimistic locking generally locks the entire document or a certain element to ensure that only one user edits an element at the same time, thereby avoiding operational conflicts. This scheme requires the configuration of a distributed lock coordination service, and the locking mode that does not allow other users to operate has a greater impact on the user experience. The central state conflict merging scheme requires the central server to uniformly receive the operation command, perform state conversion processing according to the operation command, and then uniformly send it to each terminal device. Since it needs to pass through the central server, the real-time response will be affected by the concurrency pressure of the network and server, which will seriously affect the user's real-time collaborative experience. In addition, since it is necessary to process the conversion and merging of the state on the central server, the coupling between the client and the server will be increased, which greatly increases the development cost. Based on this, a multi-person teaching collaboration method of an embodiment of the present application is provided to solve the technical problems of low efficiency, low real-time performance and high development cost of the existing multi-person teaching collaboration scheme.

[0027] Figure 1 A flowchart of a multi-person teaching collaboration method provided in an embodiment of the present application is given. The multi-person teaching collaboration method provided in an embodiment of the present application can be applied to a collaborative distribution service. The multi-person teaching collaboration method provided in an embodiment of the present application can be executed by a multi-person teaching collaboration device, which can be implemented by hardware and / or software and integrated in a multi-person teaching collaboration device (for example, a collaborative distribution service).

[0028] The following description takes the multi-person teaching collaborative device executing the multi-person teaching collaborative method as an example. Figure 1 , the multi-person teaching collaborative method includes:

[0029] S110: In response to a three-dimensional teaching scene acquisition request from the first terminal device and / or the second terminal device, three-dimensional teaching scene data is sent to the first terminal device and / or the second terminal device, so that the first terminal device and / or the second terminal device can display the three-dimensional teaching scene based on the three-dimensional teaching scene data.

[0030] The first terminal device and the second terminal device provided by this solution can be VR wearable devices (such as VR glasses), interactive tablets, computer devices, etc. Optionally, the first terminal device and the second terminal device can communicate with the collaborative distribution service through the network communication modules configured by themselves, and can also communicate with the collaborative distribution service through routing devices. The first terminal device and the second terminal device can be arranged in different scenarios. For example, the first terminal device and the second terminal device can be arranged in a classroom. The first terminal device and the second terminal device in the classroom can communicate with the collaborative distribution service through routing devices. The first terminal device and the second terminal device can also be arranged outside the classroom (such as teachers, students’ homes, or outdoors), and communicate with the collaborative distribution service through the network communication modules configured by themselves. Optionally, the first terminal device provided by this solution can be a terminal device used by teachers, and the second terminal can be a terminal device used by students. Figure 2 As shown in the structural diagram of a multi-person teaching collaborative system provided, the multi-person teaching collaborative system provided by this solution includes a collaborative distribution service, a first terminal device, and multiple second terminal devices, wherein the first terminal device and multiple second terminal devices are distributed and communicated with the collaborative distribution service. The collaborative distribution service is arranged on the cloud side, the first terminal device and some of the second terminal devices are arranged on the classroom side (VR classroom), and communicate with the collaborative distribution service through the routing device, and another part of the second terminal devices are arranged on the remote side, and communicate with the collaborative distribution service through the network communication module configured by themselves.

[0031] Exemplarily, when the first terminal and / or the second terminal needs to obtain three-dimensional teaching scene data to display the three-dimensional teaching scene, the first terminal and / or the second terminal may send a three-dimensional scene acquisition request pointing to the corresponding three-dimensional teaching scene to the collaborative distribution service. After receiving the three-dimensional teaching scene acquisition request sent by the first terminal and / or the second terminal, the collaborative distribution service obtains the three-dimensional teaching scene data corresponding to the three-dimensional teaching scene acquisition request and sends the three-dimensional teaching scene data to the first terminal device and / or the second terminal device.

[0032] After receiving the three-dimensional teaching scene data, the first terminal device and / or the second terminal device may display the three-dimensional teaching scene based on the received three-dimensional teaching scene data. In one embodiment, three-dimensional teaching software is configured in the first terminal and the second terminal, and the three-dimensional teaching software may display the three-dimensional teaching scene according to the received three-dimensional teaching scene data, and in response to the three-dimensional operation of the user (teacher or student) on the terminal device or the three-dimensional operation received from the collaborative distribution service, the elements in the three-dimensional teaching scene are updated accordingly.

[0033] S120: Receive first scene change data sent by the first terminal device and / or second scene change data sent by the second terminal device, the first scene change data is generated by the first terminal device based on a three-dimensional scene operation performed on the three-dimensional teaching scene, and the second scene change data is generated by the second terminal device based on a three-dimensional operation performed on the three-dimensional teaching scene.

[0034] Exemplarily, when the first terminal device and the second terminal device detect the three-dimensional scene operation performed by the user on the three-dimensional teaching scene, the first terminal device and the second terminal device respectively generate the first scene change data and the second scene change data according to the three-dimensional scene operation performed on the three-dimensional teaching scene. It needs to be explained that the collaborative distribution service may receive the first scene change data and the second scene change data (for example, the first terminal device and the second terminal device both detect the three-dimensional scene operation performed by the user on the three-dimensional teaching scene within a set time period), or may only receive the first scene change data (for example, only the first terminal device detects the three-dimensional scene operation performed by the user on the three-dimensional teaching scene within a set time period), or may only receive the second scene change data (for example, only the second terminal device detects the three-dimensional scene operation performed by the user on the three-dimensional teaching scene within a set time period).

[0035] In one embodiment, different terminal devices (between the first terminal device and the second terminal device, and between different second terminal devices) can perform 3D scene operations on the same element in the 3D teaching scene, or can perform 3D scene operations on different elements. For example, when a teacher performs a 3D scene operation on the first element in the 3D teaching scene displayed by the first terminal device, and a student also performs a 3D scene operation on the first element in the 3D teaching scene displayed by the second terminal device, the two terminal devices perform 3D scene operations on the same element in the 3D teaching scene.

[0036] S130: Sending first scene change data to the second terminal device so that the second terminal device can perform scene update processing on the three-dimensional teaching scene in the second terminal device based on the first scene change data, and / or sending second scene change data to the first terminal device so that the first terminal device can perform scene update processing on the three-dimensional teaching scene in the first terminal device based on the second scene change data.

[0037] Among them, when there is overlap in the first scene change data and the second scene change data, the first terminal device and the second terminal device merge the first scene change data and the second scene change data based on the set operation merging strategy to obtain the first merged change data, and perform scene update processing on the three-dimensional teaching scene according to the first merged change data.

[0038] Exemplarily, after receiving the first scene change data sent by the first terminal device and / or the second scene change data sent by the second terminal device, the collaborative distribution service sends the first scene change data to each second terminal device, and / or sends the second scene change data sent by other second terminal devices, so that each second terminal device can perform scene update processing on the three-dimensional teaching scene in the second terminal device based on the first scene change data and / or the second scene change data sent by other second terminal devices.

[0039] For example, when only the first terminal device uploads the first scene change data, the first scene change data is sent to each second terminal device, and each second terminal device performs scene update processing based on the first scene change data. When the first terminal device uploads the first scene change data and some of the second terminal devices upload the second scene change data, the second scene change data uploaded by these second terminal devices are sent to the first terminal device, so that the first terminal device performs scene update processing based on these second scene change data, and the first scene change data and the second scene change data sent by other second terminal devices are sent to each second terminal device, and each second terminal device performs scene update processing based on the first scene change data and the received second scene change data. When only the second terminal device uploads the second scene change data, the second scene change data uploaded by each second terminal device is sent to the first terminal device, so that the first terminal device performs scene update processing based on these second scene change data, and the second scene change data sent by other second terminal devices is sent to each second terminal device, and each second terminal device performs scene update processing based on the received second scene change data.

[0040] In one embodiment, when there is a change overlap between the first scene change data and the second scene change data, or there is a change overlap between the second scene change data of different second terminal devices, each terminal device (including the first terminal device and the second terminal device) sets an operation merging strategy to merge the first scene change data and the second scene change data with overlapping changes, or the second scene change data with overlapping changes to obtain first merged change data, and perform scene update processing on the three-dimensional teaching scene according to the first merged change data. Among them, different terminal devices are configured with the same operation merging strategy, and different terminal devices perform merging processing based on the same scene change data to obtain the same merged change data. Optionally, the operation merging strategy can be based on the scene change data executed first, and other scene change data are discarded, or based on the scene change data corresponding to the user with the highest operation authority (such as a teacher), and other scene change data are discarded, so as to realize the merge processing of conflicting operations on different terminal devices.

[0041] In the above, when a three-dimensional teaching scene acquisition request is received from the first terminal device and / or the second terminal device, three-dimensional teaching scene data is sent to the first terminal device and / or the second terminal device to display the three-dimensional teaching scene, first scene change data sent by the first terminal device, and / or second scene change data sent by the second terminal device are received, and the first scene change data is sent to the second terminal device for the second terminal device to perform scene update processing, and / or the second scene change data is sent to the first terminal device for the first terminal device to perform scene update processing, and when there is overlap in the first scene change data and the second scene change data, the first scene change data and the second scene change data are merged based on the set operation merging strategy to obtain the first merged change data, and the three-dimensional teaching scene is updated according to the first merged change data. Multi-terminal and multi-directional collaboration of multi-person teaching can be achieved without using a lock operation to lock the elements in the three-dimensional teaching scene, thereby effectively improving the efficiency of multi-person teaching collaboration.

[0042] Based on the above embodiments, Figure 3 A flowchart of another multi-person teaching collaborative method provided in an embodiment of the present application is given, and the multi-person teaching collaborative method is a specific embodiment of the multi-person teaching collaborative method described above. Figure 3 , the multi-person teaching collaborative method includes:

[0043] S210: In response to a three-dimensional teaching scene acquisition request from the first terminal device and / or the second terminal device, searching a set memory location for three-dimensional teaching scene data corresponding to the three-dimensional teaching scene acquisition request.

[0044] like Figure 4 As shown in the structural diagram of another multi-person teaching collaborative system provided, the multi-person teaching collaborative system provided by this scheme includes a collaborative distribution service, a snapshot service, a first terminal device and a plurality of second terminal devices, wherein the collaborative distribution service and the snapshot service are arranged on the cloud side, the first terminal device and some of the second terminal devices are arranged on the teacher side, and the other part of the second terminal is arranged on the remote side. The first terminal device and the plurality of second terminal devices are distributed and communicated with the collaborative distribution service, and the snapshot service is communicated with the collaborative distribution service. Among them, the snapshot service is used to store snapshot data corresponding to the three-dimensional teaching scene, the snapshot data can record the serialized information of the three-dimensional teaching scene, and the three-dimensional teaching scene data corresponding to the three-dimensional teaching scene can be generated according to the snapshot data, and the three-dimensional teaching scene data can be persistently stored through the snapshot data. Among them, all terminal devices can communicate with the collaborative distribution service through the configured collaborative module (for example, the multi-person teaching collaborative module configured in the three-dimensional teaching software), and all terminal devices are indistinguishable from the collaborative module. The classroom side and the remote side are different in the access scenes, and are also indistinguishable from the collaborative module.

[0045] In one possible embodiment, the collaborative distribution service provided by this solution is configured with multiple network protocols corresponding to different deployment scenarios, and is configured with corresponding collaborative network channels. The first terminal device and / or the second terminal device communicates with the collaborative distribution service through the collaborative network channel based on the network protocol corresponding to the deployment scenario. For example, the collaborative distribution service can be configured with network protocols such as websocket, webrtc, and dat, among which the websocket protocol can correspond to the client-server type of deployment scenario, and the webrtc protocol and the dat protocol can correspond to the p2p type of deployment scenario. This solution can access different network protocols by configuring the collaborative network channel in an extensible manner, and can select different network protocols according to different deployment scenarios, thereby improving the flexibility of multi-person teaching collaboration.

[0046] In one possible embodiment, this solution normalizes the data channel for each terminal device to send data to the collaborative distribution service. The collaborative distribution service is configured with a model information data channel, a perception information data channel, and an instruction information data channel. The first terminal device and / or the second terminal device can select the model information data channel, the perception information data channel, or the instruction information data channel according to the data type to transmit data with the collaborative distribution service. Among them, the model information data channel is responsible for sending data that needs to be persisted to the three-dimensional teaching scene, such as the increase of meshes (Mesh) in the three-dimensional teaching scene, the movement of meshes, and other scene change data that need to be persistently stored. The perception information data channel is responsible for transmitting data related to user perception, such as the mouse position on the terminal device, the camera position of the terminal device, and other scene change data. The instruction information data channel is responsible for transmitting data related to instruction control, such as sending the teacher's user identification information (clientID) in the teaching mode, and the terminal device corresponding to the teacher is in the control state, and the terminal devices corresponding to other user identification information are in the controlled state. This solution standardizes the data channel for each terminal device to send data to the collaborative distribution service, so as to facilitate the classification and processing of data of different types of uses and improve the data processing efficiency of multi-person teaching collaboration.

[0047] Exemplarily, when a three-dimensional teaching scene acquisition request is received from the first terminal device and / or the second terminal device, the three-dimensional teaching scene data corresponding to the three-dimensional teaching scene acquisition request is searched in the set memory location. If the three-dimensional teaching scene data corresponding to the three-dimensional teaching scene acquisition request exists in the set memory location, jump to step S220; if the three-dimensional teaching scene data corresponding to the three-dimensional teaching scene acquisition request does not exist in the set memory location, jump to step S230.

[0048] S220: When three-dimensional teaching scene data corresponding to the three-dimensional teaching scene acquisition request exists in the set memory location, the three-dimensional teaching scene data is sent to the first terminal device and / or the second terminal device, so that the first terminal device and / or the second terminal device can display the three-dimensional teaching scene based on the three-dimensional teaching scene data.

[0049] Exemplarily, when the three-dimensional teaching scene data corresponding to the three-dimensional teaching scene acquisition request exists in the set memory location, the three-dimensional teaching scene data is directly sent to the first terminal device and / or the second terminal device, so that the first terminal device and / or the second terminal device can display the three-dimensional teaching scene based on the three-dimensional teaching scene data. This solution saves the three-dimensional teaching scene data in the set memory location of the collaborative distribution service, quickly responds to the three-dimensional teaching scene acquisition request of the terminal device and sends the three-dimensional teaching scene data to the terminal device, thereby improving the speed of acquiring the three-dimensional teaching scene data and the efficiency of displaying the three-dimensional teaching scene, thereby improving the user experience.

[0050] S230: When the three-dimensional teaching scene data corresponding to the three-dimensional teaching scene acquisition request does not exist in the set memory location, the three-dimensional teaching scene data is sent to the first terminal device and / or the second terminal device according to the snapshot data stored in the snapshot service.

[0051] Exemplarily, when the three-dimensional teaching scene data corresponding to the three-dimensional teaching scene acquisition request does not exist in the set memory location, the snapshot data corresponding to the three-dimensional teaching scene acquisition request is obtained from the snapshot service, and the three-dimensional teaching scene data is sent to the first terminal device and / or the second terminal device based on the snapshot data. Among them, when the collaborative distribution service obtains the snapshot data from the snapshot service and determines the three-dimensional teaching scene data based on the snapshot data, the three-dimensional teaching scene data is saved in the set memory location to improve the response speed when the subsequent terminal device requests to obtain the three-dimensional teaching scene, improve the speed of obtaining the three-dimensional teaching scene data and the efficiency of displaying the three-dimensional teaching scene, and improve the user experience.

[0052] In a possible embodiment, the multi-person teaching collaborative method provided by the present solution includes: when sending three-dimensional teaching scene data to the first terminal device and / or the second terminal device according to the snapshot data stored in the snapshot service:

[0053] S231: Obtain snapshot data corresponding to the three-dimensional teaching scene acquisition request from the snapshot service.

[0054] S232: Generate three-dimensional teaching scene data in a set memory location according to the snapshot data, and send the three-dimensional teaching scene data to the first terminal device and / or the second terminal device.

[0055] Exemplarily, when the three-dimensional teaching scene data corresponding to the three-dimensional teaching scene acquisition request does not exist in the set memory location, the collaborative distribution service obtains the snapshot data corresponding to the three-dimensional teaching scene acquisition request from the snapshot service, generates the three-dimensional teaching scene data in the set memory location according to the snapshot data and saves the three-dimensional teaching scene data in the set memory location, and at the same time, sends the three-dimensional teaching scene data to the first terminal device and / or the second terminal device. In one embodiment, when all terminal devices finish displaying the three-dimensional teaching scene for a set time length, the corresponding three-dimensional teaching scene data is released until the terminal device requests to obtain the three-dimensional teaching scene again.

[0056] This solution obtains snapshot data from the snapshot service and generates the three-dimensional teaching scene data in the set memory location when the three-dimensional teaching scene data corresponding to the three-dimensional teaching scene acquisition request does not exist in the set memory location. When the subsequent terminal device requests to obtain the same three-dimensional teaching scene, the three-dimensional teaching scene data can be directly obtained from the set memory location, thereby effectively improving the speed of obtaining three-dimensional teaching scene data and the efficiency of three-dimensional teaching scene display, thereby improving the user experience.

[0057] S240: Receive first scene change data sent by the first terminal device and / or second scene change data sent by the second terminal device, the first scene change data is generated by the first terminal device based on a three-dimensional scene operation performed on the three-dimensional teaching scene, and the second scene change data is generated by the second terminal device based on a three-dimensional operation performed on the three-dimensional teaching scene.

[0058] S250: Based on the set operation merging strategy, the first scene change data and / or the second scene change data are merged to obtain second merged change data, and the three-dimensional teaching scene data in the set memory position is updated according to the second merged change data.

[0059] Exemplarily, after receiving the first scene change data sent by the first terminal device, and / or the second scene change data sent by the second terminal device, the collaborative distribution service merges the first scene change data and / or the second scene change data based on the set operation merge strategy to obtain the second merged change data. For example, when there is a change overlap between the received first scene change data and the second scene change data, and there is a change overlap between the second scene change data provided by different second terminal devices, the first scene change data and the second scene change data with the change overlap, and the multiple second scene change data with the change overlap are merged according to the set operation merge strategy to obtain the second merged change data. Among them, the operation merge strategy configured on the collaborative distribution service is the same as the operation merge strategy configured on each terminal device, and the collaborative distribution service and each terminal device merge and process based on the same scene change data to obtain the same merged change data (that is, the second merged change data is consistent with the first merged change data).

[0060] Furthermore, the collaborative distribution service updates the three-dimensional teaching scene data in the set memory location according to the second merged change data determined above. At this time, the three-dimensional teaching scene data maintains the synchronous response update to the three-dimensional operations on different terminal devices, and is consistent with the update results of each terminal device, reducing the inconsistent data update caused by operation conflicts. This solution merges the scene change data according to the set operation merging strategy to obtain the second merged change data, and updates the three-dimensional teaching scene data in the set memory location according to the second merged change data, effectively maintaining the consistency of the three-dimensional teaching scene data update between the collaborative distribution service and each terminal device, ensuring that the three-dimensional teaching scene displayed by the terminal device that subsequently obtains the three-dimensional teaching scene data is consistent with the three-dimensional teaching scene displayed by other terminal devices, and ensuring the quality of multi-person teaching collaboration.

[0061] S260: Send the first scene change data and / or the second scene change data to the snapshot service, so that the snapshot service can merge the first scene change data and / or the second scene change data based on the set operation merge strategy to obtain third merged change data, and perform snapshot update processing on the snapshot data according to the third merged change data.

[0062] Exemplarily, after receiving first scene change data sent by the first terminal device and / or second scene change data sent by the second terminal device, the collaborative distribution service sends the first scene change data and / or the second scene change data to the snapshot service.

[0063] After receiving the first scene change data and / or the second scene change data, the snapshot service merges the first scene change data and / or the second scene change data based on the set operation merge strategy to obtain third merged change data. For example, when there is overlap in changes between the first scene change data and the second scene change data received by the snapshot service, and there is overlap in changes between the second scene change data provided by different second terminal devices, the snapshot service merges the first scene change data and the second scene change data with overlap in changes, and the multiple second scene change data with overlap in changes according to the set operation merge strategy to obtain third merged change data. Among them, the operation merge strategy configured on the snapshot service is the same as the operation merge strategy configured on each terminal device, and the snapshot service and each terminal device obtain the same merged change data (that is, the third merged change data is consistent with the first merged change data) after merging based on the same scene change data.

[0064] Furthermore, the snapshot service performs data update processing on the snapshot data corresponding to the three-dimensional teaching scene according to the third merge change data determined above. At this time, the snapshot data maintains the synchronous response update to the three-dimensional operations on different terminal devices, and is consistent with the update results of each terminal device, thereby reducing the data update inconsistency caused by operation conflicts. In one embodiment, the first scene change data and / or the second scene change data can be sent to the snapshot service at a set time interval, so that the snapshot service performs snapshot update processing on the snapshot data based on the set operation merge strategy, thereby maintaining the consistency of the snapshot service and the three-dimensional teaching scene data update of each terminal device.

[0065] This solution merges the scene change data according to the set operation merging strategy to obtain the third merged change data, and updates the snapshot data according to the third merged change data, thereby effectively maintaining the consistency of the snapshot service and the three-dimensional teaching scene data update of each terminal device, ensuring that the three-dimensional teaching scene displayed by the terminal device that subsequently obtains the three-dimensional teaching scene data is the latest three-dimensional teaching scene, thereby improving the quality of multi-person teaching collaboration.

[0066] S270: Sending first scene change data to the second terminal device so that the second terminal device can perform scene update processing on the three-dimensional teaching scene in the second terminal device based on the first scene change data, and / or sending second scene change data to the first terminal device so that the first terminal device can perform scene update processing on the three-dimensional teaching scene in the first terminal device based on the second scene change data.

[0067] Among them, when there is overlap in the first scene change data and the second scene change data, the first terminal device and the second terminal device merge the first scene change data and the second scene change data based on the set operation merging strategy to obtain the first merged change data, and perform scene update processing on the three-dimensional teaching scene according to the first merged change data.

[0068] In the above, when receiving a three-dimensional teaching scene acquisition request from the first terminal device and / or the second terminal device, the three-dimensional teaching scene data is sent to the first terminal device and / or the second terminal device to display the three-dimensional teaching scene, the first scene change data sent by the first terminal device and / or the second scene change data sent by the second terminal device are received, and the first scene change data is sent to the second terminal device for the second terminal device to perform scene update processing, and / or the second scene change data is sent to the first terminal device for the first terminal device to perform scene update processing, and when there is a change overlap between the first scene change data and the second scene change data, the first scene change data and the second scene change data are merged based on the set operation merging strategy to obtain the first merged change data, and the three-dimensional teaching scene is updated according to the first merged change data, and the multi-terminal multi-directional collaboration of multi-person teaching can be realized without using a lock operation to lock the elements in the three-dimensional teaching scene, effectively improving the efficiency of multi-person teaching collaboration. At the same time, when the collaborative distribution service obtains snapshot data from the snapshot service and determines the three-dimensional teaching scene data based on the snapshot data, the three-dimensional teaching scene data is saved in the set memory location, effectively improving the speed of obtaining the three-dimensional teaching scene data and the efficiency of displaying the three-dimensional teaching scene, and improving the user experience. In addition, this solution uses distributed processing to handle three-dimensional operations. Compared with the situation where pessimistic locks need to lock elements and can only be operated by one user at a time, this solution can operate the same element at the same time and does not require the central lock coordination service of pessimistic locks to allocate locks, effectively reducing the impact of network latency and central server performance on user operation experience. At the same time, the use of distributed processing to handle three-dimensional operations is different from the method of merging central state conflicts in the central service. Each terminal device merges scene change data based on the same operation merging strategy, which also effectively reduces the impact of network latency and central server performance on user operation experience. There is no need to process state conversion and merging in the central server, which reduces the coupling between the client and the server and reduces development costs.

[0069] Figure 5 A schematic diagram of the structure of a multi-person teaching collaboration device provided in an embodiment of the present application is given. Figure 5 The multi-person teaching collaborative device includes a response acquisition module 51, a data receiving module 52 and a data collaborative module 53.

[0070] The acquisition response module 51 is used to respond to the three-dimensional teaching scene acquisition request of the first terminal device and / or the second terminal device, and send the three-dimensional teaching scene data to the first terminal device and / or the second terminal device, so that the first terminal device and / or the second terminal device can display the three-dimensional teaching scene based on the three-dimensional teaching scene data;

[0071] A data receiving module 52 is used to receive first scene change data sent by a first terminal device and / or second scene change data sent by a second terminal device, wherein the first scene change data is generated by the first terminal device based on a three-dimensional scene operation performed on the three-dimensional teaching scene, and the second scene change data is generated by the second terminal device based on a three-dimensional operation performed on the three-dimensional teaching scene;

[0072] The data collaboration module 53 is used to send first scene change data to the second terminal device so that the second terminal device can perform scene update processing on the three-dimensional teaching scene in the second terminal device based on the first scene change data, and / or send second scene change data to the first terminal device so that the first terminal device can perform scene update processing on the three-dimensional teaching scene in the first terminal device based on the second scene change data, wherein, when there is overlap in the first scene change data and the second scene change data, the first terminal device and the second terminal device merge the first scene change data and the second scene change data based on a set operation merging strategy to obtain first merged change data, and perform scene update processing on the three-dimensional teaching scene according to the first merged change data.

[0073] In the above, when a three-dimensional teaching scene acquisition request is received from the first terminal device and / or the second terminal device, three-dimensional teaching scene data is sent to the first terminal device and / or the second terminal device to display the three-dimensional teaching scene, first scene change data sent by the first terminal device, and / or second scene change data sent by the second terminal device are received, and the first scene change data is sent to the second terminal device for the second terminal device to perform scene update processing, and / or the second scene change data is sent to the first terminal device for the first terminal device to perform scene update processing, and when there is overlap in the first scene change data and the second scene change data, the first scene change data and the second scene change data are merged based on the set operation merging strategy to obtain the first merged change data, and the three-dimensional teaching scene is updated according to the first merged change data. Multi-terminal and multi-directional collaboration of multi-person teaching can be achieved without using a lock operation to lock the elements in the three-dimensional teaching scene, thereby effectively improving the efficiency of multi-person teaching collaboration.

[0074] In a possible embodiment, when the acquisition response module 51 sends the three-dimensional teaching scene data to the first terminal device and / or the second terminal device in response to the three-dimensional teaching scene acquisition request of the first terminal device and / or the second terminal device, it includes:

[0075] In response to a three-dimensional teaching scene acquisition request from the first terminal device and / or the second terminal device, searching for three-dimensional teaching scene data corresponding to the three-dimensional teaching scene acquisition request in a set memory location;

[0076] When the three-dimensional teaching scene data corresponding to the three-dimensional teaching scene acquisition request exists in the set memory location, the three-dimensional teaching scene data is sent to the first terminal device and / or the second terminal device;

[0077] When the three-dimensional teaching scene data corresponding to the three-dimensional teaching scene acquisition request does not exist in the set memory location, the three-dimensional teaching scene data is sent to the first terminal device and / or the second terminal device according to the snapshot data stored in the snapshot service.

[0078] In a possible embodiment, when the acquisition response module 51 sends the three-dimensional teaching scene data to the first terminal device and / or the second terminal device according to the snapshot data stored in the snapshot service, it includes:

[0079] Obtain the snapshot data corresponding to the three-dimensional teaching scene acquisition request from the snapshot service;

[0080] Generate three-dimensional teaching scene data in a set memory location according to the snapshot data, and send the three-dimensional teaching scene data to the first terminal device and / or the second terminal device.

[0081] In a possible embodiment, the multi-person teaching collaborative device also includes a data update module, which is used to merge the first scene change data and / or the second scene change data based on a set operation merging strategy to obtain second merged change data, and update the three-dimensional teaching scene data in the set memory location according to the second merged change data.

[0082] In a possible embodiment, the multi-person teaching collaborative device also includes a snapshot update module, which is used to send the first scene change data and / or the second scene change data to the snapshot service, so that the snapshot service can merge the first scene change data and / or the second scene change data based on the set operation merge strategy to obtain the third merged change data, and perform snapshot update processing on the snapshot data according to the third merged change data.

[0083] In a possible embodiment, the collaborative distribution service is configured with multiple network protocols corresponding to different deployment scenarios, and the first terminal device and / or the second terminal device communicates with the collaborative distribution service via the network protocol corresponding to the deployment scenario.

[0084] In one possible embodiment, the collaborative distribution service is configured with a model information data channel, a perception information data channel, and an instruction information data channel. The first terminal device and / or the second terminal device selects the model information data channel, the perception information data channel, or the instruction information data channel according to the data type to transmit data with the collaborative distribution service.

[0085] It is worth noting that in the embodiment of the above-mentioned multi-person teaching collaborative device, the various units and modules included are only divided according to functional logic, but are not limited to the above-mentioned division, as long as the corresponding functions can be achieved; in addition, the specific names of the functional units are only for the convenience of distinguishing each other, and are not used to limit the protection scope of the embodiments of the present application.

[0086] The embodiment of the present application also provides a multi-person teaching collaboration device, which can integrate the multi-person teaching collaboration apparatus provided in the embodiment of the present application. Figure 6 Schematic diagram of a multi-person teaching collaborative device provided by an embodiment of the present application. Figure 6 The multi-person teaching collaborative device includes: an input device 63, an output device 64, a memory 62 and one or more processors 61; the memory 62 is used to store one or more programs; when one or more programs are executed by one or more processors 61, the one or more processors 61 implement the multi-person teaching collaborative method provided in the above embodiment. The input device 63, the output device 64, the memory 62 and the processor 61 can be connected by a bus or other means. Figure 6 The example of connecting through bus is taken in the following.

[0087] The memory 62, as a computing device readable storage medium, can be used to store software programs, computer executable programs and modules, such as program instructions / modules corresponding to the multi-person teaching collaborative method provided in any embodiment of the present application (for example, the acquisition response module 51, the data receiving module 52 and the data collaborative module 53 in the multi-person teaching collaborative device). The memory 62 may mainly include a program storage area and a data storage area, wherein the program storage area may store an operating system, an application required for at least one function; the data storage area may store data created according to the use of the device, etc. In addition, the memory 62 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, or other non-volatile solid-state storage device. In some instances, the memory 62 may further include a memory remotely arranged relative to the processor 61, and these remote memories may be connected to the device via a network. Examples of the above-mentioned network include, but are not limited to, the Internet, an intranet, a local area network, a mobile communication network and a combination thereof.

[0088] The input device 63 may be used to receive input digital or character information and generate key signal input related to user settings and function control of the device. The output device 64 may include a display device such as a display screen.

[0089] The processor 61 executes various functional applications and data processing of the device by running the software programs, instructions and modules stored in the memory 62, that is, realizes the above-mentioned multi-person teaching collaborative method.

[0090] The multi-person teaching collaborative device, equipment and computer provided above can be used to execute the multi-person teaching collaborative method provided in any of the above embodiments, and have corresponding functions and beneficial effects.

[0091] An embodiment of the present application also provides a storage medium storing computer executable instructions, which, when executed by a computer processor, are used to execute a multi-person teaching collaboration method as provided in the above embodiment, the multi-person teaching collaboration method comprising: in response to a three-dimensional teaching scene acquisition request of a first terminal device and / or a second terminal device, sending three-dimensional teaching scene data to the first terminal device and / or the second terminal device, so that the first terminal device and / or the second terminal device can display the three-dimensional teaching scene based on the three-dimensional teaching scene data; receiving first scene change data sent by the first terminal device, and / or second scene change data sent by the second terminal device, the first scene change data being generated by the first terminal device based on a three-dimensional scene operation performed on the three-dimensional teaching scene, and the second scene change data being generated by the second terminal device based on a three-dimensional scene operation performed on the three-dimensional teaching scene. The terminal device generates based on the three-dimensional operation performed on the three-dimensional teaching scene; sends first scene change data to the second terminal device, so that the second terminal device can perform scene update processing on the three-dimensional teaching scene in the second terminal device based on the first scene change data, and / or sends second scene change data to the first terminal device, so that the first terminal device can perform scene update processing on the three-dimensional teaching scene in the first terminal device based on the second scene change data, wherein, when there is overlap in the first scene change data and the second scene change data, the first terminal device and the second terminal device merge the first scene change data and the second scene change data based on the set operation merging strategy to obtain first merged change data, and perform scene update processing on the three-dimensional teaching scene according to the first merged change data.

[0092] Storage medium - any of various types of memory devices or storage devices. The term "storage medium" is intended to include: installation media, such as CD-ROM, floppy disk or tape device; computer system memory or random access memory, such as DRAM, DDR RAM, SRAM, EDO RAM, Rambus RAM, etc.; non-volatile memory, such as flash memory, magnetic media (such as hard disk or optical storage); registers or other similar types of memory elements, etc. Storage media may also include other types of memory or combinations thereof. In addition, the storage medium may be located in the first computer system in which the program is executed, or may be located in a different second computer system, which is connected to the first computer system via a network (such as the Internet). The second computer system can provide program instructions to the first computer for execution. The term "storage medium" may include two or more storage media that may reside in different locations (for example, in different computer systems connected by a network). The storage medium may store program instructions (for example, embodied as a computer program) that can be executed by one or more processors.

[0093] Of course, the computer executable instructions of a storage medium storing computer executable instructions provided in an embodiment of the present application are not limited to the multi-person teaching collaborative method provided above, and can also execute related operations in the multi-person teaching collaborative method provided in any embodiment of the present application.

[0094] The multi-person teaching collaboration apparatus, equipment and storage medium provided in the above embodiments can execute the multi-person teaching collaboration method provided in any embodiment of the present application. For technical details not described in detail in the above embodiments, please refer to the multi-person teaching collaboration method provided in any embodiment of the present application.

[0095] The above are only preferred embodiments of the present application and the technical principles used. The present application is not limited to the specific embodiments provided herein, and various obvious changes, readjustments and substitutions that can be made by those skilled in the art will not deviate from the scope of protection of the present application. Therefore, although the present application is described in more detail through the above embodiments, the present application is not limited to the above embodiments, and may include more other equivalent embodiments without departing from the concept of the present application, and the scope of the present application is determined by the scope of the claims.

Claims

1. A multi-person teaching collaborative method, applied to collaborative distribution services, characterized in that: include: In response to a three-dimensional teaching scene acquisition request from a first terminal device and / or a second terminal device, sending three-dimensional teaching scene data to the first terminal device and / or the second terminal device, so that the first terminal device and / or the second terminal device can display the three-dimensional teaching scene based on the three-dimensional teaching scene data; receiving first scene change data sent by the first terminal device, and / or second scene change data sent by the second terminal device, wherein the first scene change data is generated by the first terminal device based on a three-dimensional scene operation performed on the three-dimensional teaching scene, and the second scene change data is generated by the second terminal device based on a three-dimensional operation performed on the three-dimensional teaching scene; The first scene change data is sent to the second terminal device so that the second terminal device can perform scene update processing on the three-dimensional teaching scene in the second terminal device based on the first scene change data, and / or the second scene change data is sent to the first terminal device so that the first terminal device can perform scene update processing on the three-dimensional teaching scene in the first terminal device based on the second scene change data, wherein, when there is overlap in changes between the first scene change data and the second scene change data, the first terminal device and the second terminal device merge the first scene change data and the second scene change data based on a set operation merging strategy to obtain first merged change data, and perform scene update processing on the three-dimensional teaching scene according to the first merged change data.

2. The multi-person teaching collaborative method according to claim 1, characterized in that: The sending of the three-dimensional teaching scene data to the first terminal device and / or the second terminal device in response to the three-dimensional teaching scene acquisition request of the first terminal device and / or the second terminal device comprises: In response to a three-dimensional teaching scene acquisition request from the first terminal device and / or the second terminal device, searching a set memory location for three-dimensional teaching scene data corresponding to the three-dimensional teaching scene acquisition request; In a case where the three-dimensional teaching scene data corresponding to the three-dimensional teaching scene acquisition request exists in the set memory location, sending the three-dimensional teaching scene data to the first terminal device and / or the second terminal device; When the three-dimensional teaching scene data corresponding to the three-dimensional teaching scene acquisition request does not exist in the set memory location, the three-dimensional teaching scene data is sent to the first terminal device and / or the second terminal device according to the snapshot data saved in the snapshot service.

3. The multi-person teaching collaborative method according to claim 2, characterized in that: The sending of the three-dimensional teaching scene data to the first terminal device and / or the second terminal device according to the snapshot data stored in the snapshot service includes: Acquire snapshot data corresponding to the three-dimensional teaching scene acquisition request from a snapshot service; Generate three-dimensional teaching scene data in the set memory location according to the snapshot data, and send the three-dimensional teaching scene data to the first terminal device and / or the second terminal device.

4. The multi-person teaching collaborative method according to claim 2, characterized in that: After receiving the first scene change data sent by the first terminal device and / or the second scene change data sent by the second terminal device, the method further includes: Based on the set operation merging strategy, the first scene change data and / or the second scene change data are merged to obtain second merged change data, and the three-dimensional teaching scene data in the set memory location is updated according to the second merged change data.

5. The multi-person teaching collaborative method according to claim 2, characterized in that: After receiving the first scene change data sent by the first terminal device and / or the second scene change data sent by the second terminal device, the method further includes: The first scene change data and / or the second scene change data are sent to the snapshot service, so that the snapshot service can merge the first scene change data and / or the second scene change data based on the set operation merge strategy to obtain third merged change data, and perform snapshot update processing on the snapshot data according to the third merged change data.

6. The multi-person teaching collaborative method according to any one of claims 1 to 5, characterized in that: The collaborative distribution service is configured with multiple network protocols corresponding to different deployment scenarios, and the first terminal device and / or the second terminal device communicates with the collaborative distribution service via the network protocol corresponding to the deployment scenario.

7. The multi-person teaching collaborative method according to any one of claims 1 to 5, characterized in that: The collaborative distribution service is configured with a model information data channel, a perception information data channel and an instruction information data channel. The first terminal device and / or the second terminal device selects the model information data channel, the perception information data channel or the instruction information data channel according to the data type to transmit data with the collaborative distribution service.

8. A multi-person teaching collaborative device, characterized in that: It includes a response acquisition module, a data receiving module and a data coordination module, among which: The acquisition response module is used to respond to the three-dimensional teaching scene acquisition request of the first terminal device and / or the second terminal device, and send the three-dimensional teaching scene data to the first terminal device and / or the second terminal device, so that the first terminal device and / or the second terminal device can display the three-dimensional teaching scene based on the three-dimensional teaching scene data; The data receiving module is used to receive first scene change data sent by the first terminal device and / or second scene change data sent by the second terminal device, the first scene change data is generated by the first terminal device based on a three-dimensional scene operation performed on the three-dimensional teaching scene, and the second scene change data is generated by the second terminal device based on a three-dimensional operation performed on the three-dimensional teaching scene; The data collaboration module is used to send the first scene change data to the second terminal device so that the second terminal device can perform scene update processing on the three-dimensional teaching scene in the second terminal device based on the first scene change data, and / or send the second scene change data to the first terminal device so that the first terminal device can perform scene update processing on the three-dimensional teaching scene in the first terminal device based on the second scene change data, wherein, when there is overlap in the changes of the first scene change data and the second scene change data, the first terminal device and the second terminal device merge the first scene change data and the second scene change data based on a set operation merging strategy to obtain first merged change data, and perform scene update processing on the three-dimensional teaching scene according to the first merged change data.

9. A multi-person teaching collaborative device, characterized in that: include: memory and one or more processors; The memory is used to store one or more programs; When the one or more programs are executed by the one or more processors, the one or more processors implement the multi-person teaching collaborative method as described in any one of claims 1-7.

10. A storage medium storing computer executable instructions, characterized in that: When the computer executable instructions are executed by a computer processor, they are used to execute the multi-person teaching collaborative method as described in any one of claims 1-7.

Images