Three-dimensional courseware synchronous demonstration method and device, equipment and storage medium
By conducting fine-grained synchronous demonstrations of three-dimensional courseware between the teacher and the student side, the problem that the student-side three-dimensional courseware is not controlled by teachers is solved, the teaching quality and learning efficiency are improved, and the immersive teaching effect of the virtual classroom is achieved.
Patent Information
- Application Number
- CN202310540699.X
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2023-05-12
- Publication Date
- 2024-11-12
AI Technical Summary
In the prior art, the student side is not controlled by the teacher when used in teaching classrooms, resulting in poor teaching quality and affecting students' learning efficiency.
Through the server, the virtual reality three-dimensional courseware is presented in fine-grained synchronous demonstration between the teacher and the student side. Teachers can control the courseware content on the student side by controlling the three-dimensional courseware on the teacher side to realize teachers' control of the classroom rhythm.
Students can learn with the teacher's teaching rhythm, improve teaching quality and learning efficiency, and give full play to the immersive teaching advantages of virtual classrooms.
Smart Images

Figure CN118942294A_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the field of smart classroom technology, and in particular to a method, device, equipment and storage medium for synchronous presentation of three-dimensional courseware. Background Art
[0002] Virtual reality technology is a computer simulation technology that can create and experience a virtual world. It can use computers to generate an interactive three-dimensional dynamic scene, allowing users to immerse themselves in the scene. With the advancement of the education industry, virtual reality technology has been applied to smart classrooms to bring students an immersive learning experience.
[0003] In the prior art, various scenes can be simulated through virtual reality three-dimensional courseware, such as physical, chemical and biological experiment scenes, vocational education practice scenes and situational simulation scenes, so that students can immerse themselves in learning in various scenes, which is conducive to improving students' learning efficiency. These three-dimensional courseware are generally used in a single virtual reality device. If these three-dimensional courseware are used in teaching classes, the three-dimensional courseware on the student side is not controlled by the teacher, and it is difficult for students to follow the teacher's teaching rhythm to learn, resulting in poor teaching quality and affecting students' learning efficiency. Summary of the invention
[0004] The present application provides a method, device, equipment and storage medium for synchronous presentation of three-dimensional courseware, which performs fine-grained synchronous presentation of three-dimensional courseware of virtual reality between a first pair of glasses and a second pair of glasses through a server, so as to facilitate teachers to control the rhythm of the class and solve the problem in the prior art that the three-dimensional courseware of the second pair of glasses is not controlled by the teacher, so that students can learn according to the rhythm of the teacher's teaching, ensure the teaching quality, and further improve the students' learning efficiency, thereby giving full play to the advantages of immersive teaching in virtual classrooms.
[0005] In a first aspect, the present application provides a method for synchronously presenting a three-dimensional courseware, which is applied to a first pair of glasses, wherein the first pair of glasses is connected to a second pair of glasses via a server, and the method comprises:
[0006] If it is detected that the attribute of the target object and / or the virtual character in the first virtual scene has changed, the attribute data of the target object and / or the virtual character after the change is obtained; wherein the first virtual scene is rendered by the first glasses based on the local three-dimensional courseware;
[0007] The changed attribute data is sent to the second glasses through the server, so that the second glasses synchronously modify the attributes of the target object and / or virtual character in the second virtual scene based on the changed attribute data; wherein the second virtual scene is rendered by the second glasses based on local three-dimensional courseware.
[0008] In a second aspect, the present application provides a three-dimensional courseware synchronous presentation device, which is applied to a first pair of glasses, wherein the first pair of glasses is connected to a second pair of glasses via a server, and the device comprises:
[0009] a data detection module configured to obtain the changed attribute data of the target object and / or the virtual character if it is detected that the attribute of the target object and / or the virtual character in the first virtual scene has changed; wherein the first virtual scene is rendered by the first glasses based on the local three-dimensional courseware;
[0010] The first data synchronization module is configured to send the changed attribute data to the second glasses through the server, so that the second glasses synchronously modify the attributes of the target object and / or virtual character in the second virtual scene based on the changed attribute data; wherein the second virtual scene is rendered by the second glasses based on local three-dimensional courseware.
[0011] In a third aspect, the present application provides a three-dimensional courseware synchronous presentation device, comprising:
[0012] One or more processors; a memory storing one or more programs, when the one or more programs are executed by the one or more processors, the one or more processors implement the three-dimensional courseware synchronous presentation method as described in the first aspect.
[0013] In a fourth aspect, the present application provides a storage medium comprising computer executable instructions, which, when executed by a computer processor, are used to perform the three-dimensional courseware synchronous presentation method as described in the first aspect.
[0014] In the present application, the first glasses render a first virtual scene based on the local three-dimensional courseware, and the second glasses render a second virtual scene based on the local three-dimensional courseware. When the first glasses detect that the attributes of the target object and / or virtual character in the first virtual scene have changed, the changed attribute data of the target object and / or virtual character are obtained, and the changed attribute data are sent to the second glasses through the server. The second glasses synchronously modify the attributes of the corresponding target object and / or virtual character in the second virtual scene based on the changed attribute data, so that the target object and virtual character in the second virtual scene synchronously demonstrate the interaction process of the target object and virtual character in the first virtual scene. Through the above technical means, when the attributes of the virtual character and / or target object in the first virtual scene have changed, the first glasses will forward only the changed attribute data to the second glasses through the server, which effectively reduces the transmission bandwidth, improves the data transmission efficiency, and realizes the fine-grained synchronous demonstration of the three-dimensional courseware of virtual reality between the first glasses and the second glasses. Since the 3D courseware of the first glasses and the second glasses can be demonstrated synchronously, the teacher can control the demonstration content of the 3D courseware of the second glasses by controlling the demonstration content of the 3D courseware of the first glasses, which makes it easier for the teacher to control the classroom rhythm. Students can learn by following the teacher's teaching rhythm, ensuring the teaching quality, improving the students' learning efficiency, and giving full play to the advantages of immersive teaching in virtual classrooms. BRIEF DESCRIPTION OF THE DRAWINGS
[0015] Figure 1 It is a flow chart of a three-dimensional courseware synchronous presentation method provided in an embodiment of the present application;
[0016] Figure 2 is a first schematic diagram of a first virtual scene provided in an embodiment of the present application;
[0017] Figure 3 is a first schematic diagram of the interaction process between a first virtual character and a target object provided in an embodiment of the present application;
[0018] Figure 4 is a second schematic diagram of the interaction process between the first virtual character and the target object provided in an embodiment of the present application;
[0019] Figure 5 is a third schematic diagram of the interaction process between the first virtual character and the target object provided in the embodiment of the present application;
[0020] Figure 6 It is a schematic diagram of classroom activities of the three-dimensional courseware provided in the embodiment of the present application;
[0021] Figure 7 It is a structural schematic diagram of a three-dimensional courseware synchronous demonstration device provided in an embodiment of the present application;
[0022] Figure 8is a schematic diagram of attribute data transmission after change provided by an embodiment of the present application;
[0023] Fig. 9 It is a structural schematic diagram of a three-dimensional courseware synchronous demonstration device provided in an embodiment of the present application. DETAILED DESCRIPTION
[0024] In order to make the purpose, technical scheme and advantages of the present application clearer, the specific embodiments of the present application are further described in detail below in conjunction with the accompanying drawings. It is understood that the specific embodiments described herein are only used to explain the present application, rather than to limit the present application. It should also be noted that, for the convenience of description, only the part related to the present application but not all the contents are shown in the accompanying drawings. Before discussing the exemplary embodiments in more detail, it should be mentioned that some exemplary embodiments are described as processes or methods depicted as flow charts. Although the flow chart describes each operation (or step) as a sequential process, many of the operations therein can be implemented in parallel, concurrently or simultaneously. In addition, the order of each operation can be rearranged. The process can be terminated when its operation is completed, but it can also have additional steps not included in the accompanying drawings. The process can correspond to a method, a function, a procedure, a subroutine, a subprogram, etc.
[0025] The terms "first", "second", etc. in the specification and claims of the present application are used to distinguish similar objects, and are not used to describe a specific order or sequence. It should be understood that the data used in this way can be interchangeable under appropriate circumstances, so that the embodiments of the present application can be implemented in an order other than those illustrated or described here, and the objects distinguished by "first", "second", etc. are generally of one type, and the number of objects is not limited. For example, the first object can be one or more. In addition, "and / or" in the specification and claims represents at least one of the connected objects, and the character " / " generally indicates that the objects associated with each other are in an "or" relationship.
[0026] In the more common existing implementation methods, virtual reality three-dimensional courseware can simulate various teaching scenes, and students can immerse themselves in learning in various teaching scenes. However, the existing three-dimensional courseware is basically made for local experience, such as physical, chemical, and biological experiments, vocational education practices, and situational simulations. These three-dimensional courseware can basically only be used in a single virtual reality device. If the existing three-dimensional courseware is used in the teaching classroom, the student side and the teacher side will demonstrate the local three-dimensional courseware respectively, and the three-dimensional courseware on the student side is controlled by the student. Therefore, the teacher side cannot control the three-dimensional courseware on the student side, and it is difficult for students to learn according to the teacher's teaching rhythm. In the existing scheme, there is also a teacher side that pushes the three-dimensional courseware to the student side through the edge server in the teaching classroom to achieve control of the three-dimensional courseware on the student side to a certain extent. However, the amount of data in the three-dimensional courseware is too large, and the teacher side controls the student side with large granularity, resulting in the student side missing details when demonstrating the three-dimensional courseware.
[0027] To solve the above problems, this embodiment provides a three-dimensional courseware synchronous demonstration method, device, equipment and storage medium, which uses a server to perform fine-grained synchronous demonstration of virtual reality three-dimensional courseware between the teacher's end and the student's end, so that the teacher can control the classroom rhythm, solving the problem in the prior art that the three-dimensional courseware on the student's end is not controlled by the teacher.
[0028] The three-dimensional courseware synchronization demonstration method provided in this embodiment can be executed by a three-dimensional courseware synchronization demonstration device, which can be implemented by software and / or hardware. The three-dimensional courseware synchronization demonstration device can be composed of two or more physical entities, or it can be composed of one physical entity. In this embodiment, the three-dimensional courseware synchronization demonstration device can be a three-dimensional courseware synchronization demonstration system, and the three-dimensional courseware synchronization demonstration system includes a server, a first pair of glasses and a plurality of second pairs of glasses. The server connects the first pair of glasses and the second pair of glasses, and the server, the first pair of glasses and the second pair of glasses cooperate to implement the three-dimensional courseware synchronization demonstration method. Further, the three-dimensional courseware synchronization demonstration device can also be the first pair of glasses. Among them, the first pair of glasses and the second pair of glasses are virtual reality glasses, and the virtual reality glasses are equipped with a somatosensory device or a virtual character control device for recognizing hand movements. The somatosensory device and the virtual character control device are both used to operate the virtual character in the virtual scene corresponding to the virtual reality glasses.
[0029] It should be noted that the first pair of glasses can be seen as the virtual reality glasses used by the teacher, and the second pair of glasses can be seen as the virtual reality glasses used by the students. For the virtual reality glasses, they do not know whether they are the first pair of glasses or the second pair of glasses at the beginning, but only determine whether they are the first pair of glasses or the second pair of glasses after the user inputs the identity identifier representing the person. Exemplarily, after the teacher or the student enters the classroom, they select a virtual reality pair of glasses and input the identifier representing the corresponding person's identity, and the virtual reality glasses bind the identity identifier with the device identifier. The virtual reality glasses used by the teacher confirm that they are the first pair of glasses as the teacher's end, and the virtual reality glasses used by the student confirm that they are the second pair of glasses as the student's end. The first pair of glasses and the second pair of glasses join the classroom through the server, and the server can obtain the device identifiers of the first pair of glasses and the second pair of glasses in the classroom and the corresponding bound identity identifiers.
[0030] The 3D courseware synchronization demonstration device is installed with at least one type of operating system, wherein the operating system includes but is not limited to Android system, Linux system and Windows system. The 3D courseware synchronization demonstration device can install at least one application based on the operating system, and the application can be an application that comes with the operating system or an application downloaded from a third-party device or server. In this embodiment, the 3D courseware synchronization demonstration device has at least an application that can execute the 3D courseware synchronization demonstration method.
[0031] For ease of understanding, this embodiment is described by taking the first glasses as the main body of the method for synchronously presenting three-dimensional courseware as an example.
[0032] Figure 1 A flowchart of a three-dimensional courseware synchronous presentation method provided by an embodiment of the present application is given. Figure 1 , the three-dimensional courseware synchronous demonstration method specifically includes:
[0033] S110. If a change in the attribute of the target object and / or the virtual character in the first virtual scene is detected, the changed attribute data of the target object and / or the virtual character is obtained; wherein the first virtual scene is rendered by the first glasses based on the local three-dimensional courseware.
[0034] S120. Send the changed attribute data to the second glasses through the server, so that the second glasses synchronously modify the attributes of the target object and / or the virtual character in the second virtual scene based on the changed attribute data; wherein the second virtual scene is rendered by the second glasses based on the local three-dimensional courseware.
[0035] In this embodiment, the three-dimensional courseware includes four levels, namely, world, scene, area and object from top to bottom. The world of the three-dimensional courseware (equivalent to the drawing board of the two-dimensional courseware) can be understood as the virtual reality world, and a three-dimensional courseware has only one world. The scene of the three-dimensional courseware (equivalent to the master of the two-dimensional courseware) can be understood as a virtual scene visible in the virtual reality world, such as a classroom scene, a space scene and a grassland scene. Just as multiple masters can be used in a two-dimensional courseware, a three-dimensional courseware can also set multiple scenes at the same time. In most cases, a three-dimensional courseware can set one scene, but the possibility of setting multiple scenes is not excluded. When a three-dimensional courseware sets multiple scenes, there is no positional association between the scenes, so the scene conversion of the three-dimensional courseware is realized by controlling the jump. The area of the three-dimensional courseware (equivalent to the page of the two-dimensional courseware) can be understood as a virtual area where the virtual character can move in the virtual scene. For example, when the virtual character can only move in a certain classroom, the classroom is the virtual area in the three-dimensional courseware. Multiple areas can be set in a virtual scene, and each area has corresponding three-dimensional coordinates in the corresponding scene. You can switch from one area to the next by controlling the page turning. If there is an intersection between adjacent areas, you can operate the virtual character to go directly to the next area. Objects in three-dimensional courseware (equivalent to elements in two-dimensional courseware) can be understood as virtual objects in the virtual area that can or cannot interact with virtual characters. When using three-dimensional courseware for classroom teaching, teachers can operate virtual characters in the virtual area to interact with virtual objects to convey classroom knowledge, giving full play to the advantages of immersive teaching in virtual classrooms.
[0036] Teachers can use courseware production resources to make three-dimensional courseware for classroom teaching, and upload it to the server after production, so that the first and second glasses can download the three-dimensional courseware from the server; or, the server itself stores various three-dimensional courseware that can be used for classroom teaching, and the first and second glasses can download the three-dimensional courseware stored in the server to the local. After the first and second glasses download the three-dimensional courseware locally, start the local three-dimensional courseware to enter the classroom, and the second glasses will perform a synchronous demonstration with the first glasses based on the local three-dimensional courseware. In addition, the second glasses can also download the three-dimensional courseware while performing a synchronous demonstration with the first glasses based on the downloaded courseware data, but the premise is that the courseware data downloaded by the second glasses contains the courseware content currently demonstrated by the first glasses. For example, the first glasses are currently demonstrating the first virtual scene of the three-dimensional courseware, and the three-dimensional courseware of the second glasses has downloaded the courseware data of the third virtual scene. At this time, the second glasses can perform a synchronous demonstration with the first glasses based on the downloaded courseware data.
[0037] Before the class starts, the first glasses and the second glasses join the same class through the server, and the data received by the server from the first glasses or the second glasses will be forwarded to the second glasses or the first glasses in the same class accordingly. At the beginning of the class, the first glasses and the second glasses open the local three-dimensional courseware respectively. After opening the local three-dimensional courseware, the first glasses render the scene specified by the three-dimensional courseware, and render the virtual character corresponding to the bound identity in the area specified by the scene, that is, the first virtual character of the teacher. Among them, the first virtual scene can be understood as the scene currently rendered by the first glasses. In this embodiment, when the first glasses open the three-dimensional courseware for the first time, the scene and area specified by the three-dimensional courseware are the initial area in the initial scene; when the three-dimensional courseware is opened for the second time or later, the scene and area specified by the three-dimensional courseware can be the scene and area where the corresponding virtual character was located last time in the historical record.
[0038] After the first glasses render the teacher's first virtual character in the area specified by the scene, the first virtual character is created from nothing, and the attribute data of the first virtual character is changed, then the changed attribute data of the first virtual character is obtained. Among them, the attribute data of the virtual character may include character information, position information, posture information and the scene, etc. The position information of the first virtual character refers to the three-dimensional coordinates of the first virtual character in the scene. The first glasses send the changed attribute data of the first virtual character to the server, and the server forwards the changed attribute data of the first virtual character to the second glasses. The second glasses synchronously add the first virtual character to the second virtual scene based on the changed attribute data of the first virtual character, so that the second glasses render the same scene as the first glasses, ensuring the synchronous presentation of the three-dimensional courseware. Among them, the second virtual scene can be understood as the scene currently rendered by the second glasses. It should be noted that if only the position information of the first virtual character's attribute data changes, for example, the first glasses control the first virtual character to move from coordinate point A to coordinate point B, then the changed position information of the first virtual character is obtained, and the changed position information of the first virtual character is sent to the second glasses through the server, so that the second glasses move the first virtual character in the second virtual scene from coordinate point A to coordinate point B according to the changed position information of the first virtual character. Therefore, if the virtual character includes multiple attribute data, when a certain attribute data changes, only the changed attribute data is sent to the second glasses through the server, which effectively reduces the transmission bandwidth, improves the data transmission efficiency, and realizes the fine-grained synchronous demonstration of virtual reality three-dimensional courseware between the first glasses and the second glasses.
[0039] The target object is an interactive object that can interact with the virtual character. The first glasses can operate the target object through the first virtual character and cooperate with the teaching explanation. The second glasses synchronously demonstrate the interaction process between the first virtual character and the target object, so that students can follow the teacher's explanation and watch the process of the first virtual character operating the target object through the second glasses, realizing immersive teaching in the virtual classroom. When the teacher controls the first virtual character to operate the target object through the virtual character control device or somatosensory device configured by the first glasses, the attribute data of the first virtual character and the target object changes, and the changed attribute data of the first virtual character and the target object are obtained, and the changed attribute data of the first virtual character and the target object are sent to the second glasses through the server. Based on the changed attribute data of the first virtual character and the target object, the second glasses synchronously modify the attribute data of the first virtual character and the target object in the second virtual scene, so that the state of the first virtual character and the target object in the second virtual scene is the same as the state of the first virtual character and the target object in the first virtual scene, and the second glasses replicate the interaction process with the first virtual character and the target object of the first glasses, realizing the synchronous demonstration of the three-dimensional courseware of the first glasses and the second glasses.
[0040] It should be noted that when the first glasses receive the input operation, the attribute data of the first virtual character and the target object are updated at a certain frequency, so that the first virtual character and the target object in the first virtual scene demonstrate a coherent interaction process. Each time the first glasses update the attribute data of the first virtual character and the target object, the updated attribute data is sent to the server, and the server forwards it to the second glasses. When the second glasses synchronously update the attribute data of the first virtual character and the target object in the second virtual scene according to the received attribute data, the first virtual character and the target object in the second virtual scene also demonstrate a coherent interaction process, ensuring the synchronous demonstration effect of the first glasses and the second glasses.
[0041] like Figure 2-4 As shown, there is a desk 11 in the first virtual scene, and three balls are placed on the desk 11. The desk 11 is a non-interactive object, and the balls on the desk 11 are target objects. When the first glasses control the first virtual character 12 (only the hands of the first virtual character are shown in the figure) to grab and pick up ball C, the first glasses update the attribute data of the first virtual character 12 and ball C according to the operation input by the teacher, and send the changed attribute data of the first virtual character 12 and ball C to the server. The server sends the changed attribute data of the first virtual character 12 and ball C to the second glasses, and the second glasses synchronously modify the attribute data of the first virtual character and ball C in the second virtual scene, so that the second glasses can demonstrate Figures 2 to 4 The interactive process of the first virtual character picking up ball C is shown.
[0042] In this embodiment, the attributes of the target object are at least one of the virtual character information grabbing the target object, state information of the grabbing state or the releasing state, posture information and custom attribute information. Among them, when the virtual character grabs the target object, it is in the grabbing state, and when no virtual character grabs the target object, it is in the releasing state; posture information refers to the three-dimensional coordinates and attitude angle of the target object in the scene; custom attribute information is used to define the specific state that the target object can have, for example, the custom attribute information includes state information of the display state or the hidden state. When the target object is in the display state, the target object is visible in the scene, and when the target object is in the hidden state, the target object is invisible in the scene. Figure 2 and Figure 3 As shown, when the first glasses control the first virtual character 12 in the first virtual scene to grab the C ball placed on the desk 11, the position information and posture information of the first virtual character 12 are updated to Figure 3 The position and posture of the ball C are updated to the grasping state and the virtual character information grasping the ball C is updated to the first virtual character 12. At this time, the first glasses send the updated position information and posture information of the first virtual character 12, the grasping state of the ball C and the virtual character information grasping the ball C to the server, and the server forwards it to the second glasses, so that the second glasses modify the position information and posture information of the first virtual character in the second virtual scene to Figure 3 The position and posture shown change the local C ball from a released state to a grasped state, and the virtual character information grasping the C ball is changed to the first virtual character.
[0043] If the first virtual character in the first virtual scene changes the custom attribute information of the target object during the interaction with the target object, the first glasses send the changed custom attribute information of the target object to the server. The server sends the changed custom attribute information of the target object to the second glasses, and the second glasses synchronously modify the custom attribute information of the target object in the second virtual character. Figure 5 As shown, it is assumed that the custom attribute information of ball C includes the attribute "whether captured by the basket". When ball C in the first virtual scene falls into the basket 13, the first glasses change the attribute "whether captured by the basket" of ball C to "captured by the basket", and then send the attribute "captured by the basket" of ball C to the server, and the server sends the attribute "captured by the basket" of ball C to the second glasses, and the second glasses update the attribute "whether captured by the basket" of ball C in the second virtual scene to the attribute "captured by the basket".
[0044] Similarly, when the target object includes multiple attribute data, when a certain attribute data changes, only the changed attribute data is sent to the second glasses through the server, which effectively reduces the transmission bandwidth, improves the data transmission efficiency, and realizes the fine-grained synchronous presentation of virtual reality three-dimensional courseware between the first glasses and the second glasses.
[0045] It should be noted that when making 3D courseware, the material information of the target object will also be set, so that when the 3D courseware is demonstrated, the virtual light will determine the light and shadow effect of the target object according to the material information, virtual light, other virtual objects, scenes and camera angles, and render the target object according to the light and shadow effect. However, the material information of the target object of the first glasses and the second glasses is unified and unchanged, so there is no need to synchronize the material information of the target object of the first glasses and the second glasses. Instead, when rendering the target object, the material information of the target object configured by the 3D courseware can be directly called to achieve the same visual effect.
[0046] In one embodiment, the attributes of the target object and / or the virtual character do not include corresponding posture information. Accordingly, when the posture information of the target object and / or the virtual character in the first virtual scene changes, the first glasses send the posture information of the target object and the virtual character in the first virtual scene to the second glasses through the server at a preset frequency, so that the second glasses synchronously modify the posture information of the target object and the virtual character in the second virtual scene according to the received posture information. Figure 3 and Figure 4 , when the first glasses control the first virtual character 12 to pick up the C ball, the real-time position information of the first virtual character 12 and the C ball is sent to the server at a preset frequency. The server forwards the position information of the first virtual character 12 and the C ball to the second glasses every time it receives it, which is equivalent to the second glasses receiving the real-time position information of the first virtual character 12 and the C ball sent by the first glasses at a preset frequency. The second glasses update the local position information of the first virtual character 12 and the C ball according to the received real-time position information of the first virtual character 12 and the C ball, thereby synchronously demonstrating the process of the first virtual character 12 picking up the C ball in the second virtual scene. Figure 5 As shown, the first glasses control the first virtual character 12 in the first virtual scene to throw the C ball into the basket 13. When the C ball is released by the first virtual character 12, the first glasses update the C ball to a released state and update the virtual character information that holds the C ball to none. Then, the updated released state of the C ball is sent to the server, and the server forwards it to the second glasses, so that the second glasses update the C ball in the second virtual scene to a released state and update the virtual character information that holds the C ball to none. When the first glasses control the first virtual character 12 to throw the C ball toward the basket, the first glasses determine the posture information of the C ball after it leaves the first virtual character 12 through the physics engine, and update the posture information of the C ball so that the C ball in the first virtual scene moves toward the basket 13. At the same time, the first glasses send the real-time posture information of the C ball to the server at a preset frequency, and the server sends the real-time posture information of the C ball to the second glasses, so that the second glasses update the posture information of the C ball in the second virtual scene, so that the C ball in the first virtual scene and the second virtual scene are both updated according to the preset frequency. Figure 5The moving track 14 shown in the figure moves. It is easy to understand that when the first glasses frequently update the position information of the target object or the first virtual character, if the changed position information is sent to the second glasses every time the position information changes, the first glasses need to respond frequently, which places high requirements on the performance of the first glasses. Therefore, the sending frequency of the position information can be set to send the position information according to the sending frequency, and the first glasses do not need to respond frequently.
[0047] When making a three-dimensional courseware, an action can be added when the target object is displayed or disappears in the teaching area. When the first glasses control the display of the target object in the teaching area rendered by the local three-dimensional courseware, the target object will be displayed in the teaching area according to the preset action. If the first glasses send the attribute data updated in the display process of the target object to the second glasses at this time, the amount of data transmitted is too large. Therefore, this embodiment proposes that if the first glasses detect that the input operation is an operation to control the display or disappearance of the target object in the first virtual scene according to the preset action, the input operation is sent to the second glasses through the server, so that the second glasses respond to the input operation to control the display or disappearance of the target object in the second virtual scene according to the preset action. Exemplarily, when the input operation is an operation to display or disappear the target object in the first virtual scene according to the preset action, the first glasses respond to the input operation to call the action data pre-stored in the local three-dimensional courseware, and control the display or disappearance of the target object in the first virtual scene according to the preset action according to the action data. At the same time, the first glasses send the input operation to the second glasses through the server, and the second glasses respond to the input operation to call the action data pre-stored in the local three-dimensional courseware, and control the display or disappearance of the target object in the second virtual scene according to the preset action according to the action data. The first glasses only need to send the input operation to the second glasses, and the second glasses will synchronously demonstrate the change process of the target object based on the input operation and the courseware resources of the three-dimensional courseware, which greatly saves the transmission bandwidth.
[0048] If a new second pair of glasses joins the class while a class is in progress, in order for the second pair of glasses to synchronously demonstrate three-dimensional courseware with the first pair of glasses in subsequent classes, the first pair of glasses can synchronize the latest attribute data of each virtual character and target object in the first virtual scene to the second pair of glasses that have just joined the class, so that the second pair of glasses that have just joined the class can update each virtual character and target object in the second virtual scene to the latest status. In this embodiment, when the new second pair of glasses joins the class, it will connect to the server. If the first pair of glasses detects that the server is connected to the new second pair of glasses, it will obtain the latest attribute data of the target objects and virtual characters in the first virtual scene; the latest attribute data will be sent to the new second pair of glasses through the server, so that the new second pair of glasses can update the attributes of the target objects and / or virtual characters in the corresponding second virtual scene based on the latest attribute data. Exemplarily, assuming that when the first pair of glasses detects that the server is connected to the new second pair of glasses, the first virtual scene is as follows: Figure 4 As shown, the first glasses send the attribute data of the current first virtual character 12 and ball A, ball B and ball C to the server, and the server forwards the received attribute data to the newly connected second glasses. The newly connected second glasses render the first virtual character with the same attributes in the second virtual scene according to the attribute data of the first virtual character 12, and render the ball A, ball B and ball C with the same attributes in the second virtual scene according to the attribute data of ball A, ball B and ball C, so that the second virtual scene shows that ball A and ball B are placed on the desk 11, and ball C is placed in the hands of the first virtual character, so that the second glasses newly added to the class can demonstrate the three-dimensional courseware synchronously with the first glasses in the next class. In this embodiment, if the first glasses render the virtual characters of the identity identifiers corresponding to the bound identities of each second glasses in the first virtual scene, that is, the second virtual characters of the students, the first glasses will send the attribute data of each second virtual character in the first virtual scene to the server, and the server will send the attribute data of each second virtual character to the newly connected second glasses, so that the second glasses newly added to the class can demonstrate the three-dimensional courseware synchronously with other second glasses in the next class.
[0049] In one embodiment, after the second glasses open the local three-dimensional courseware and render the second virtual scene, the second virtual character corresponding to the bound identity identifier is rendered in the designated area, and the second virtual character is created from nothing. If the attribute data of the second virtual character is changed, the second glasses send the changed attribute data of the second virtual character to the first glasses through the server, and the first glasses synchronously add the second virtual character to the first virtual scene based on the changed attribute data of the second virtual character. After the first glasses add the second virtual character to the first virtual scene, the second virtual character of the second glasses can be allowed to operate the target object in subsequent classroom activities, so that students can interact with the target object by controlling the corresponding second virtual character through the second glasses, and deepen students' understanding of the teaching content through immersive classroom activities, thereby improving students' learning efficiency.
[0050] This embodiment provides two implementation methods of classroom activities, one is to carry out multi-person classroom activities, and the other is to carry out individual classroom activities. In multi-person classroom activities, the process of the second glasses operating the second virtual character to interact with the target object will be demonstrated synchronously with the first glasses and the second glasses in the same classroom. In individual classroom activities, the process of the second glasses operating the second virtual character to interact with the target object will not be synchronized to other second glasses, but the teacher can view the process of the second virtual character interacting with the target object demonstrated by any second glasses through the first glasses.
[0051] The implementation process of carrying out multi-person classroom activities is as follows: the teacher inputs the first activity operation to the first glasses, the first glasses receive the first activity operation, and generate the first activity instruction according to the first activity operation, the first activity instruction includes the operator list and the first object identifier, and the operator list includes the device identifier of at least one second glasses; the first activity instruction is sent to the server, so that the server, based on the first activity instruction, opens the permission to operate the first target object corresponding to the first object identifier to the second glasses corresponding to each device identifier in the operator list. Among them, the first activity operation refers to the operation of carrying out multi-person classroom activities, and the first activity instruction is an instruction for notifying the server to carry out multi-person classroom activities. When the server receives the first activity instruction, it confirms that the current classroom is ready to carry out multi-person classroom activities, then obtains the operator list and the first object identifier from the first activity instruction, and determines the second glasses that can operate the first target object corresponding to the first object identifier in this multi-person classroom activity according to the device identifier in the operator list, and then opens the permission to operate the first target object to the second glasses. After the second glasses corresponding to the device identifier in the operator list opens the operation authority to the first target object, the students can use the second glasses to operate the corresponding second virtual character to interact with the first target object. During the interaction between the second virtual character and the first target object, the second glasses detect that the attribute data of the second virtual character and / or the first target object has changed, and the changed attribute data of the second virtual character and / or the first target object is sent to the first glasses through the server. The first glasses synchronously modify the attribute data of the second virtual character and / or the first target object in the first virtual scene, so that the first glasses and the second glasses synchronously demonstrate the interaction process between the second virtual character corresponding to the student and the first target object.
[0052] like Figure 6As shown, the teacher wants students E and D to choose one of the three balls placed on the desk 11 and throw it into the basket 13 as the answer to the choice question displayed on the basket 13. At this time, the first glasses designate the A ball, the B ball, the C ball and the basket 13 as the first target object in the multi-person classroom activity, designate the second glasses used by students E and D as operators to generate an operator list based on the device identifier of the second glasses, package the first object identifier of the first target object and the operator list to generate a first activity instruction, and send the first activity instruction to the server. The server obtains the operator list and the first object identifier from the first activity instruction, opens the permission to operate the A ball, the B ball, the C ball and the basket 13 to the second glasses used by students E and D according to the device identifier and the first object identifier in the operator list, and notifies the second glasses used by students E and D after opening the permission, so that students E and D can control the corresponding second virtual characters to interact with the A ball, the B ball, the C ball and the basket 13 through the second glasses. When student E controls the second virtual character of student E to catch ball A through the second glasses, the attribute data of the second virtual character of student E and ball A in the second virtual scene of the second glasses are changed, and the changed attribute data are sent to the server. The server forwards the changed attribute data to other second glasses and first glasses in the classroom, and the other second glasses and first glasses demonstrate the process of student E's second virtual character catching ball A in the corresponding second virtual scene and first virtual scene according to the changed attribute data. After the second virtual character of student E catches ball A, the ball A in the second virtual scene corresponding to the second glasses used by student D changes from a released state to a caught state. At this time, even if student D has the right to operate ball A, he cannot operate ball A. Only when ball A is updated to a released state can student D's second glasses operate ball A.
[0053] In this embodiment, when the state information of the first target object is the grasped state, if the first glasses do not receive the attribute data sent by the second glasses corresponding to the virtual character information grasping the first target object within the preset time period, the state information of the first target object in the first virtual scene is changed from the grasped state to the released state. It is easy to understand that, considering the instability of the network, if the second virtual character of student E grasps ball A, and the second glasses of student E do not send the changed attribute data of the second virtual character and ball A to the server within the preset time period, it can be confirmed that the second glasses of student E are offline due to network jitter. When the first glasses confirm that the second glasses of student E are offline, the state information of ball A in the first virtual scene is updated from the grasped state to the released state, and the changed state information is sent to the second glasses in the classroom through the server, and the second glasses update the state information of ball A in the corresponding second virtual scene from the grasped state to the released state and the virtual character information grasping ball A to none. After the state information of ball A is updated to the released state, the second glasses of student D can operate the corresponding second virtual character to take ball A from the second virtual character of student E to ensure that the classroom activities can continue. After the second glasses that have been disconnected recover from the network and reconnect to the server, the first glasses detect that the second glasses have reconnected to the server, and then send the latest attribute data of each virtual character and target object in the first virtual scene to the second glasses through the server, so that the second glasses can update the virtual characters and target objects in the corresponding second virtual scene to a state synchronized with the first glasses, ensuring that the second glasses that have recovered the network can demonstrate three-dimensional courseware synchronously with the first glasses in the next class.
[0054] The implementation process of carrying out a separate classroom activity is as follows: the teacher inputs a second activity operation to the first glasses, the first glasses receive the second activity operation, and generate a second activity instruction in response to the second activity operation, the second activity instruction including a second object identifier; the second activity instruction is sent to the server, so that the server opens the permission of operating the second target object corresponding to the second object identifier to each second glasses based on the second activity instruction; the activity viewing operation is received, and the activity viewing instruction is generated in response to the activity viewing operation, the activity viewing instruction including a device identifier of the second glasses; the activity viewing instruction is sent to the server, so that the server sends a synchronization request to the corresponding second glasses based on the device identifier in the activity viewing instruction, so that the corresponding second glasses send the changed attribute data of the second target object and the virtual character in the corresponding second virtual scene to the first glasses through the server. Among them, the second activity operation refers to the operation of carrying out a separate classroom activity, and the second activity instruction refers to the instruction for notifying the server to carry out a separate classroom activity. When the server receives the second activity instruction, it confirms that the current class is ready to carry out a separate classroom activity, and then obtains the second object identifier from the second activity instruction, so as to open the permission of operating the second target object corresponding to the second object identifier to the second glasses in the classroom according to the second object identifier. After opening the operation rights of the second target object to the second glasses, students can operate the corresponding second virtual character and the second target object through the second glasses. Among them, the activity viewing operation refers to the operation of viewing the classroom activities demonstrated by the second glasses. The activity viewing instruction refers to the instruction used to notify the server that the first glasses view the classroom activities demonstrated by the second glasses. When the server receives the activity viewing instruction, it obtains the device identification from the activity viewing instruction and sends a synchronization request to the second glasses corresponding to the device identification. The second glasses that receive the synchronization request, when detecting that the attribute data corresponding to the second virtual character and the second target object in the corresponding second virtual scene has changed, send the changed attribute data to the first glasses through the server, and the first glasses synchronously modify the attribute data of the second virtual character and the second target object in the first virtual scene, so that the first glasses demonstrate the interaction process between the second virtual character and the second target object.
[0055] like Figure 6As shown, after the teacher designates ball A, ball B, ball C and basket 13 as the second target object in a separate classroom activity, the first glasses generate a second activity instruction based on the second object identifier of the second target object, and send the first activity instruction to the server. The server obtains the second object identifier from the first activity instruction, and opens the permission to operate ball A, ball B, ball C and basket 13 to the second glasses in the same classroom. After opening the permission, the server notifies the second glasses that the permission has been released, so that the student can start to operate the corresponding second virtual character through the second glasses to catch ball A, ball B or ball C, and throw the caught ball into the basket 13 as the answer to the multiple-choice question displayed by the basket 13. After the second glasses carry out a separate classroom activity, if the teacher wants to view the answering process of student E, the teacher inputs the activity viewing operation for student E, the first glasses generate an activity viewing instruction based on the device identifier of the second glasses used by student E, and send the activity viewing instruction to the server, and the server sends a synchronization request to the second glasses of student E according to the device identifier in the activity viewing instruction. After the second glasses of student E receive the synchronization request, when the attribute data of the second virtual character of student E and ball A, ball B, ball C and basket 13 in the second virtual scene change, the changed attribute data is sent to the first glasses through the server, so that the first glasses can synchronously demonstrate the process of student E's second virtual character grabbing ball A, ball B or ball C and throwing the grabbed ball into basket 13 to answer the question.
[0056] In one embodiment, the first glasses can control the second glasses in the same classroom to update the world attributes of the corresponding second virtual scene, and the world attributes include the teaching scene, the focus object, the focus scene background and the real world projection, so that the teacher can decide whether the students should look at the teaching scene, the target object, the background of the teaching scene, the blackboard or the podium in the real world according to the rhythm of the class. Exemplarily, if the first glasses detect that the world attributes of the first virtual scene have changed, the changed world attribute data is obtained, and the changed world attribute data is sent to the second glasses through the server, so that the second glasses can synchronously modify the world attributes of the second virtual scene based on the changed world attribute data. Furthermore, after the second glasses set the world attribute of the second virtual scene to the projection of the real world, the second glasses collect the images of the real world through the camera and render them in the second virtual scene, so that the students can see the real world through the second glasses; after the second glasses set the world attribute of the second virtual scene to the teaching scene, the second glasses render the teaching scene of the three-dimensional courseware in the second virtual scene, so that the students can see the teaching scene of the three-dimensional courseware through the second glasses; after the second glasses set the world attribute of the second virtual scene to the focusing object, the second virtual scene displays the target object separately, so that the students can only see the target object of the three-dimensional courseware through the second glasses; after the second glasses set the world attribute of the second virtual scene to the focusing scene background, the second virtual scene displays the background of the teaching scene separately, so that the students can only see the background of the teaching scene of the three-dimensional courseware through the second glasses.
[0057] In summary, the method for synchronous presentation of three-dimensional courseware provided in the embodiment of the present application is to render a first virtual scene based on the local three-dimensional courseware through the first glasses, and render a second virtual scene based on the local three-dimensional courseware through the second glasses. When the first glasses detect that the attributes of the target object and / or virtual character in the first virtual scene have changed, the changed attribute data of the target object and / or virtual character are obtained, and the changed attribute data are sent to the second glasses through the server. The second glasses synchronously modify the attributes of the corresponding target object and / or virtual character in the second virtual scene based on the changed attribute data, so that the target object and virtual character in the second virtual scene synchronously demonstrate the interaction process of the target object and virtual character in the first virtual scene. Through the above technical means, when the attributes of the virtual character and / or target object in the first virtual scene have changed, the first glasses will forward only the changed attribute data to the second glasses through the server, which effectively reduces the transmission bandwidth, improves the data transmission efficiency, and realizes the fine-grained synchronous presentation of the three-dimensional courseware of virtual reality between the first glasses and the second glasses. Since the 3D courseware of the first glasses and the second glasses can be demonstrated synchronously, the teacher can control the demonstration content of the 3D courseware of the second glasses by controlling the demonstration content of the 3D courseware of the first glasses, which makes it easier for the teacher to control the classroom rhythm. Students can learn by following the teacher's teaching rhythm, ensuring the teaching quality, improving the students' learning efficiency, and giving full play to the advantages of immersive teaching in virtual classrooms.
[0058] Based on the above embodiments, Figure 7 This is a schematic diagram of the structure of a three-dimensional courseware synchronous demonstration device provided in an embodiment of the present application. Figure 7 The three-dimensional courseware synchronous demonstration device provided in this embodiment specifically includes: a data detection module 21 and a first data synchronization module 22.
[0059] The data detection module 21 is configured to obtain the changed attribute data of the target object and / or the virtual character if it is detected that the attribute of the target object and / or the virtual character in the first virtual scene has changed; wherein the first virtual scene is rendered by the first glasses based on the local three-dimensional courseware;
[0060] The first data synchronization module 22 is configured to send the changed attribute data to the second glasses through the server, so that the second glasses can synchronously modify the attributes of the target object and / or virtual character in the second virtual scene based on the changed attribute data; wherein the second virtual scene is rendered by the second glasses based on the local three-dimensional courseware.
[0061] Based on the above embodiment, the attribute of the target object is at least one of information of a virtual character grasping the target object, state information of a grasping state or a releasing state, position information and custom attribute information.
[0062] Based on the above embodiment, the attributes of the target object and / or virtual character do not include corresponding posture information, and the three-dimensional courseware synchronization demonstration device also includes: a posture information synchronization module, which is configured to send the posture information of the target object and the virtual character in the first virtual scene to the second glasses through the server at a preset frequency, so that the second glasses can synchronously modify the posture information of the target object and the virtual character in the second virtual scene according to the received posture information.
[0063] Based on the above embodiment, the three-dimensional courseware synchronous demonstration device also includes: an operation synchronization module, which is configured to send the input operation to the second glasses through the server if it is detected that the input operation is an operation to control the target object in the first virtual scene to display or disappear according to the preset action, so that the second glasses respond to the input operation to control the target object in the second virtual scene to display or disappear according to the preset action.
[0064] On the basis of the above-mentioned embodiment, the three-dimensional courseware synchronous demonstration device also includes: a connection detection module, which is configured to obtain the latest attribute data of the target object and the virtual character in the first virtual scene if it detects that a new second pair of glasses is connected to the server; a second data synchronization module, which is configured to send the latest attribute data to the newly connected second pair of glasses through the server, so that the newly connected second pair of glasses can update the attributes of the target object and / or the virtual character in the corresponding second virtual scene based on the latest attribute data.
[0065] On the basis of the above-mentioned embodiment, the three-dimensional courseware synchronous demonstration device also includes: a first activity carrying out module, configured to receive a first activity operation, generate a first activity instruction according to the first activity operation, the first activity instruction includes an operator list and a first object identifier, the operator list includes a device identifier of at least one second pair of glasses; a first instruction sending module, configured to send the first activity instruction to the server, so that the server opens the permission to operate the first target object corresponding to the first object identifier to the second pair of glasses corresponding to each device identifier in the operator list based on the first activity instruction.
[0066] On the basis of the above embodiments, the three-dimensional courseware synchronous demonstration device also includes: a state change module, which is configured to, after sending the first activity instruction to the server, when the state information of the first target object is a grasped state, if the attribute data sent by the second glasses corresponding to the virtual character information grasping the first target object is not received within a preset time period, then change the state information of the first target object in the first virtual scene from a grasped state to a released state.
[0067] On the basis of the above-mentioned embodiment, the three-dimensional courseware synchronous demonstration device also includes: a second activity carrying out module, configured to receive a second activity operation, and generate a second activity instruction in response to the second activity operation, the second activity instruction including a second object identifier; a second instruction sending module, configured to send the second activity instruction to the server, so that the server opens the permission of operating the second target object corresponding to the second object identifier to each second pair of glasses based on the second activity instruction; an activity viewing module, configured to receive an activity viewing operation, and generate an activity viewing instruction in response to the activity viewing operation, the activity viewing instruction including a device identifier of a second pair of glasses; a third data synchronization module, configured to send the activity viewing instruction to the server, so that the server sends a synchronization request to the corresponding second pair of glasses based on the device identifier in the activity viewing instruction, so that the corresponding second pair of glasses sends the changed attribute data of the second target object and the virtual character in the corresponding second virtual scene to the first pair of glasses through the server.
[0068] On the basis of the above-mentioned embodiment, the three-dimensional courseware synchronous demonstration device also includes: a world attribute update module, which is configured to obtain the changed world attribute data if it is detected that the world attribute of the first virtual scene has changed, and send the changed world attribute data to the second glasses through the server, so that the second glasses can synchronously modify the world attributes of the second virtual scene based on the changed world attribute data; wherein the world attributes include virtual scenes, focused objects, focused scene backgrounds and real-world projections.
[0069] In one embodiment, Figure 8 Schematic diagram of the attribute data transmission after the change provided by the embodiment of the present application. Figure 2-Figure 4The virtual scene in the specific teaching scenario shown is described as follows. In this teaching scenario, the virtual reality glasses used by each student are the second glasses, and the virtual reality glasses used by the teacher are the first glasses. The second glasses and the first glasses are added to the classroom constructed by the server. The first glasses detect whether the attribute data of the first virtual character and the target object in the first virtual scene has changed. If it is detected that the attribute data of the first virtual character and / or the target object in the first virtual scene has changed, the changed attribute data of the first virtual character and / or the target object is sent to the server. For example, when the first virtual character 12 picks up the C ball in the first virtual scene, the attribute data of the first virtual character and the C ball changes, and the first glasses send the changed attribute data of the first virtual character 12 and the C ball to the server. The server forwards the received changed attribute data to the second glasses, and the second glasses modify the attributes of the first virtual character and / or the target object in the second virtual scene based on the changed attribute data of the first virtual character and / or the target object, so that the second virtual scene demonstrates the same content as the first virtual scene. For example, when the second glasses receive the changed attribute data of the first virtual character 12 and the ball C, the attributes of the first virtual character and the ball C in the second virtual scene are modified to the changed attribute data. At this time, the second virtual scene shows Figure 3 The state where the first virtual character picks up ball C.
[0070] As described above, the three-dimensional courseware synchronous demonstration device provided by the embodiment of the present application renders a first virtual scene based on the local three-dimensional courseware through the first glasses, and renders a second virtual scene based on the local three-dimensional courseware through the second glasses. When the first glasses detect that the attributes of the target object and / or virtual character in the first virtual scene have changed, the changed attribute data of the target object and / or virtual character are obtained, and the changed attribute data are sent to the second glasses through the server. The second glasses synchronously modify the attributes of the corresponding target object and / or virtual character in the second virtual scene based on the changed attribute data, so that the target object and virtual character in the second virtual scene synchronously demonstrate the interaction process of the target object and virtual character in the first virtual scene. Through the above technical means, when the attributes of the virtual character and / or target object in the first virtual scene have changed, the first glasses will forward only the changed attribute data to the second glasses through the server, which effectively reduces the transmission bandwidth, improves the data transmission efficiency, and realizes the fine-grained synchronous demonstration of the three-dimensional courseware of virtual reality between the first glasses and the second glasses. Since the 3D courseware of the first glasses and the second glasses can be demonstrated synchronously, the teacher can control the demonstration content of the 3D courseware of the second glasses by controlling the demonstration content of the 3D courseware of the first glasses, which makes it easier for the teacher to control the classroom rhythm. Students can learn by following the teacher's teaching rhythm, ensuring the teaching quality, improving the students' learning efficiency, and giving full play to the advantages of immersive teaching in virtual classrooms.
[0071] The three-dimensional courseware synchronous demonstration device provided in the embodiment of the present application can be used to execute the three-dimensional courseware synchronous demonstration method provided in the above embodiment, and has corresponding functions and beneficial effects.
[0072] Fig. 9 This is a schematic diagram of the structure of a three-dimensional courseware synchronous demonstration device provided in an embodiment of the present application, with reference to Fig. 9 The three-dimensional courseware synchronous demonstration device includes: a processor 31, a memory 32, a communication device 33, an input device 34 and an output device 35. The number of processors 31 in the three-dimensional courseware synchronous demonstration device can be one or more, and the number of memories 32 in the three-dimensional courseware synchronous demonstration device can be one or more. The processor 31, memory 32, communication device 33, input device 34 and output device 35 of the three-dimensional courseware synchronous demonstration device can be connected through a bus or other methods.
[0073] The memory 32, as a computer-readable storage medium, can be used to store software programs, computer executable programs and modules, such as the program instructions / modules corresponding to the three-dimensional courseware synchronization demonstration method of any embodiment of the present application (for example, the data detection module 21 and the first data synchronization module 22 in the three-dimensional courseware synchronization demonstration device). The memory 32 may mainly include a program storage area and a data storage area, wherein the program storage area may store an operating system, an application required for at least one function; the data storage area may store data created according to the use of the device, etc. In addition, the memory 32 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, or other non-volatile solid-state storage device. In some instances, the memory may further include a memory remotely arranged relative to the processor, and these remote memories may be connected to the device via a network. Examples of the above-mentioned network include, but are not limited to, the Internet, an intranet, a local area network, a mobile communication network, and combinations thereof.
[0074] The communication device 33 is used for data transmission.
[0075] The processor 31 executes various functional applications and data processing of the device by running software programs, instructions and modules stored in the memory 32.
[0076] Among them, the processor 31 is used to obtain the changed attribute data of the target object and / or the virtual character if it is detected that the attribute of the target object and / or the virtual character in the first virtual scene has changed; wherein the first virtual scene is rendered by the first glasses based on local three-dimensional courseware; the changed attribute data is sent to the second glasses through the server, so that the second glasses synchronously modify the attributes of the target object and / or the virtual character in the second virtual scene based on the changed attribute data; wherein the second virtual scene is rendered by the second glasses based on local three-dimensional courseware.
[0077] Furthermore, the attribute of the target object is at least one of information of a virtual character grasping the target object, state information of a grasping state or a releasing state, position information, and custom attribute information.
[0078] Furthermore, the attributes of the target object and / or virtual character do not include corresponding posture information, and the processor 31 is also used to send the posture information of the target object and the virtual character in the first virtual scene to the second glasses through the server at a preset frequency, so that the second glasses synchronously modify the posture information of the target object and the virtual character in the second virtual scene according to the received posture information.
[0079] Furthermore, the processor 31 is also used to, if it is detected that the input operation is an operation of controlling the display or disappearance of the target object in the first virtual scene according to a preset action, send the input operation to the second glasses through the server, so that the second glasses respond to the input operation to control the display or disappearance of the target object in the second virtual scene according to the preset action.
[0080] Furthermore, the processor 31 is also used to, if it is detected that a new second pair of glasses is connected to the server, obtain the latest attribute data of the target object and the virtual character in the first virtual scene; and send the latest attribute data to the newly connected second pair of glasses through the server, so that the newly connected second pair of glasses updates the attributes of the target object and / or the virtual character in the corresponding second virtual scene based on the latest attribute data.
[0081] Furthermore, the processor 31 is also used to receive a first activity operation, generate a first activity instruction based on the first activity operation, the first activity instruction including an operator list and a first object identifier, the operator list including at least one device identifier of the second glasses; send the first activity instruction to the server, so that the server opens the permission to operate the first target object corresponding to the first object identifier to the second glasses corresponding to each device identifier in the operator list based on the first activity instruction.
[0082] Furthermore, the processor 31 is also used to, after sending the first activity instruction to the server, when the state information of the first target object is a grasped state, if the attribute data sent by the second glasses corresponding to the virtual character information grasping the first target object is not received within a preset time period, then change the state information of the first target object in the first virtual scene from a grasped state to a released state.
[0083] Furthermore, the processor 31 is also used to receive a second activity operation, generate a second activity instruction in response to the second activity operation, the second activity instruction including a second object identifier; send the second activity instruction to the server, so that the server opens the permission to operate the second target object corresponding to the second object identifier to each second pair of glasses based on the second activity instruction; receive an activity viewing operation, generate an activity viewing instruction in response to the activity viewing operation, the activity viewing instruction including a device identifier of a second pair of glasses; send the activity viewing instruction to the server, so that the server sends a synchronization request to the corresponding second pair of glasses based on the device identifier in the activity viewing instruction, so that the corresponding second pair of glasses sends the changed attribute data of the second target object and the virtual character in the corresponding second virtual scene to the first pair of glasses through the server.
[0084] Furthermore, the processor 31 is also used to, if it is detected that the world attributes of the first virtual scene have changed, obtain the changed world attribute data, and send the changed world attribute data to the second glasses through the server, so that the second glasses can synchronously modify the world attributes of the second virtual scene based on the changed world attribute data; wherein the world attributes include virtual scenes, focused objects, focused scene backgrounds and real-world projections.
[0085] The input device 34 may be used to receive input digital or character information and generate key signal input related to user settings and function control of the device. The output device 35 may include a display device such as a display screen.
[0086] The three-dimensional courseware synchronous demonstration device provided above can be used to execute the three-dimensional courseware synchronous demonstration method provided in the above embodiment, and has corresponding functions and beneficial effects.
[0087] An embodiment of the present application also provides a storage medium containing computer executable instructions, which, when executed by a computer processor, are used to execute a method for synchronously demonstrating three-dimensional courseware. The method for synchronously demonstrating three-dimensional courseware includes: if a first pair of glasses detects that the attributes of a target object and / or a virtual character in a first virtual scene have changed, then the changed attribute data of the target object and / or the virtual character is obtained; wherein the first virtual scene is rendered by the first pair of glasses based on local three-dimensional courseware; the changed attribute data is sent to the second pair of glasses through a server, so that the second pair of glasses synchronously modifies the attributes of the target object and / or the virtual character in the second virtual scene based on the changed attribute data; wherein the second virtual scene is rendered by the second pair of glasses based on the local three-dimensional courseware.
[0088] Storage medium - any of various types of memory devices or storage devices. The term "storage medium" is intended to include: installation media, such as CD-ROM, floppy disk or tape device; computer system memory or random access memory, such as DRAM, DDR RAM, SRAM, EDO RAM, Rambus RAM, etc.; non-volatile memory, such as flash memory, magnetic media (such as hard disk or optical storage); registers or other similar types of memory elements, etc. Storage media may also include other types of memory or combinations thereof. In addition, the storage medium may be located in the first computer system in which the program is executed, or may be located in a different second computer system, which is connected to the first computer system via a network (such as the Internet). The second computer system can provide program instructions to the first computer for execution. The term "storage medium" may include two or more storage media residing in different locations (for example, in different computer systems connected by a network). The storage medium may store program instructions (for example, embodied as a computer program) that can be executed by one or more processors.
[0089] Of course, the storage medium containing computer executable instructions provided in the embodiment of the present application is not limited to the above-mentioned three-dimensional courseware synchronization presentation method, and can also execute related operations in the three-dimensional courseware synchronization presentation method provided in any embodiment of the present application.
[0090] The three-dimensional courseware synchronization demonstration device, storage medium and three-dimensional courseware synchronization demonstration equipment provided in the above embodiments can execute the three-dimensional courseware synchronization demonstration method provided in any embodiment of the present application. For technical details not described in detail in the above embodiments, please refer to the three-dimensional courseware synchronization demonstration method provided in any embodiment of the present application.
[0091] The above are only preferred embodiments of the present application and the technical principles used. The present application is not limited to the specific embodiments herein, and various obvious changes, readjustments and substitutions that can be made by those skilled in the art will not deviate from the protection scope of the present application. Therefore, although the present application is described in more detail through the above embodiments, the present application is not limited to the above embodiments, and may include more other equivalent embodiments without departing from the concept of the present application, and the scope of the present application is determined by the scope of the claims.
Claims
1. A three-dimensional courseware synchronous demonstration method, characterized in that: Applied to a first pair of glasses, the first pair of glasses is connected to a second pair of glasses via a server, and the method includes: If it is detected that the attribute of the target object and / or the virtual character in the first virtual scene has changed, the attribute data of the target object and / or the virtual character after the change is obtained; wherein the first virtual scene is rendered by the first glasses based on the local three-dimensional courseware; The changed attribute data is sent to the second glasses through the server, so that the second glasses synchronously modify the attributes of the target object and / or virtual character in the second virtual scene based on the changed attribute data; wherein the second virtual scene is rendered by the second glasses based on local three-dimensional courseware.
2. The three-dimensional courseware synchronous demonstration method according to claim 1, characterized in that: The attribute of the target object is at least one of information of a virtual character grasping the target object, state information of a grasping state or a releasing state, position information, and custom attribute information.
3. The three-dimensional courseware synchronous demonstration method according to claim 1, characterized in that: The attributes of the target object and / or the virtual character do not include corresponding posture information, and the method further includes: According to a preset frequency, the position information of the target object and the virtual character in the first virtual scene is sent to the second glasses through the server, so that the second glasses synchronously modify the position information of the target object and the virtual character in the second virtual scene according to the received position information.
4. The three-dimensional courseware synchronous presentation method according to claim 1, characterized in that: The method further comprises: If it is detected that the input operation is an operation to control the target object in the first virtual scene to display or disappear according to a preset action, the input operation is sent to the second glasses through the server, so that the second glasses respond to the input operation to control the target object in the second virtual scene to display or disappear according to the preset action.
5. The three-dimensional courseware synchronous demonstration method according to claim 1, characterized in that: The method further comprises: If it is detected that the server is connected to a new second pair of glasses, the latest attribute data of the target object and the virtual character in the first virtual scene are obtained; The server sends the latest attribute data to the newly connected second glasses, so that the newly connected second glasses update the attributes of the target object and / or the virtual character in the corresponding second virtual scene based on the latest attribute data.
6. The three-dimensional courseware synchronous demonstration method according to claim 2, characterized in that: The method further comprises: receiving a first activity operation, and generating a first activity instruction according to the first activity operation, wherein the first activity instruction includes an operator list and a first object identifier, and the operator list includes at least one device identifier of the second glasses; The first activity instruction is sent to the server, so that the server, based on the first activity instruction, grants permission to operate the first target object corresponding to the first object identifier to the second glasses corresponding to each device identifier in the operator list.
7. The three-dimensional courseware synchronous demonstration method according to claim 6, characterized in that: After sending the first activity instruction to the server, the method further includes: When the state information of the first target object is a grasped state, if the attribute data sent by the second glasses corresponding to the virtual character information grasping the first target object is not received within a preset time period, the state information of the first target object in the first virtual scene is changed from a grasped state to a released state.
8. The method for synchronously demonstrating three-dimensional courseware according to claim 6, characterized in that: The method further comprises: receiving a second activity operation, and generating a second activity instruction in response to the second activity operation, wherein the second activity instruction includes a second object identifier; sending the second activity instruction to the server, so that the server grants permission to each of the second glasses to operate the second target object corresponding to the second object identifier based on the second activity instruction; receiving an activity viewing operation, and generating an activity viewing instruction in response to the activity viewing operation, wherein the activity viewing instruction includes a device identifier of a second pair of glasses; The activity viewing instruction is sent to the server, so that the server sends a synchronization request to the corresponding second glasses based on the device identifier in the activity viewing instruction, so that the corresponding second glasses send the changed attribute data of the second target object and the virtual character in the corresponding second virtual scene to the first glasses through the server.
9. The three-dimensional courseware synchronous demonstration method according to claim 1, characterized in that: The method further comprises: If it is detected that the world attribute of the first virtual scene has changed, the changed world attribute data is obtained, and the changed world attribute data is sent to the second glasses through the server, so that the second glasses synchronously modify the world attributes of the second virtual scene based on the changed world attribute data; wherein the world attributes include virtual scenes, focused objects, focused scene backgrounds and real-world projections.
10. A three-dimensional courseware synchronous demonstration device, characterized in that: Applied to a first pair of glasses, the first pair of glasses is connected to a second pair of glasses via a server, and the device comprises: a data detection module configured to obtain the changed attribute data of the target object and / or the virtual character if it is detected that the attribute of the target object and / or the virtual character in the first virtual scene has changed; wherein the first virtual scene is rendered by the first glasses based on the local three-dimensional courseware; The first data synchronization module is configured to send the changed attribute data to the second glasses through the server, so that the second glasses synchronously modify the attributes of the target object and / or virtual character in the second virtual scene based on the changed attribute data; wherein the second virtual scene is rendered by the second glasses based on local three-dimensional courseware.
11. A three-dimensional courseware synchronous demonstration device, characterized in that: include: one or more processors; A memory stores one or more programs. When the one or more programs are executed by the one or more processors, the one or more processors implement the three-dimensional courseware synchronous presentation method as described in any one of claims 1-9.
12. A storage medium containing computer executable instructions, characterized in that: The computer executable instructions are used to execute the three-dimensional courseware synchronous presentation method as described in any one of claims 1-9 when executed by a computer processor.
Citation Information
Patent Citations
Display method and system based on virtual reality technique
CN106774821A
Virtual reality courseware processing method and device, electronic equipment and storage medium
CN112446948A
Immersive virtual reality case teaching display method and system
CN112783320A
Multi-person remote teaching system based on VR and teaching method thereof
CN113129661A
Virtual synchronous classroom teaching system in 5G network environment and working method thereof
CN113242277A
